Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6691 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6686 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17681 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7510 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6691 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8715 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8960 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2987 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29307 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5155 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30091 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4683 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12991 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9256 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4710 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8041 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5194 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5537 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3911 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins12240726850765051823.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-13 21:44:19 + trial_dir_prefix=trial- + rm -rf trial-2394 trial-2394-bin.tgz trial-2394-run.tgz + trial_dir=trial-2395 + mkdir -p trial-2395 + mv open5gs.build-8.tgz osmo-bsc.build-17681.tgz osmo-bts-oc2g.build-5537.tgz osmo-bts-sysmo.build-8041.tgz osmo-bts.build-7510.tgz osmo-ggsn.build-6691.tgz osmo-hlr.build-8715.tgz osmo-hnbgw.build-2987.tgz osmo-mgw.build-8960.tgz osmo-msc.build-29307.tgz osmo-nitb.build-12991.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30091.tgz osmo-stp.build-9256.tgz osmo-trx.build-4683.tgz osmocom-bb.build-4710.tgz srslte.build-19.tgz trial-2395 + cat open5gs.build-8.md5 osmo-bsc.build-17681.md5 osmo-bts-oc2g.build-5537.md5 osmo-bts-sysmo.build-8041.md5 osmo-bts.build-7510.md5 osmo-ggsn.build-6691.md5 osmo-hlr.build-8715.md5 osmo-hnbgw.build-2987.md5 osmo-mgw.build-8960.md5 osmo-msc.build-29307.md5 osmo-nitb.build-12991.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30091.md5 osmo-stp.build-9256.md5 osmo-trx.build-4683.md5 osmocom-bb.build-4710.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17681.md5 osmo-bts-oc2g.build-5537.md5 osmo-bts-sysmo.build-8041.md5 osmo-bts.build-7510.md5 osmo-ggsn.build-6691.md5 osmo-hlr.build-8715.md5 osmo-hnbgw.build-2987.md5 osmo-mgw.build-8960.md5 osmo-msc.build-29307.md5 osmo-nitb.build-12991.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30091.md5 osmo-stp.build-9256.md5 osmo-trx.build-4683.md5 osmocom-bb.build-4710.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2395 combinations: None trial: 'trial-2395' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2395 -------------------------------------------------------------------------------------------- 21:44:31.192311 tst trial-2395: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/log --------------------------------------------------------------------- trial-2395 nitb_sms:sysmo --------------------------------------------------------------------- 21:46:39.005525 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:46:39.009465 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 21:46:39.030161 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 21:46:39.037257 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 21:46:39.093807 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 21:46:39.114340 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 21:46:39.120819 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 21:46:39.657739 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 21:46:39.662763 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 21:46:39.673604 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 21:46:40.045806 tst mo_mt_sms.py: using LAC 36430 21:46:40.278702 tst mo_mt_sms.py: using RAC 220 21:46:40.390603 tst mo_mt_sms.py: using CellId 36430 21:46:40.502730 tst mo_mt_sms.py: using BVCI 36431 21:46:40.605967 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 21:46:40.787495 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 21:46:40.903721 tst mo_mt_sms.py:9: start nitb and bts... 21:46:41.099997 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:46:43.311661 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3368): Launched 21:46:43.605988 run osmo-nitb_10.42.42.2(pid=3369): Launched 21:46:43.766793 run osmo-nitb_10.42.42.2(pid=3369): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3369)] 21:46:43.888523 run osmo-nitb_10.42.42.2(pid=3369): stdout: | (launched: 2022-12-13_21:46:43.551775) 21:46:44.011700 run osmo-nitb_10.42.42.2(pid=3369): stderr: | (launched: 2022-12-13_21:46:43.595654) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:46:44.134962 run osmo-nitb_10.42.42.2(pid=3369): stdout: | (launched: 2022-12-13_21:46:43.551775) 21:46:44.253775 run osmo-nitb_10.42.42.2(pid=3369): stderr: | (launched: 2022-12-13_21:46:43.595654) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:46:44.394512 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=3369): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3369) [trial-2395↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3369)] [trial-2395↪nitb_sms:sysmo↪mo_mt_sms.py:11] 21:46:44.402662 tst mo_mt_sms.py:11: Test FAILED (4.7 sec) 21:46:44.409124 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3368): Terminating (SIGTERM) 21:46:44.618916 --- ParallelTerminationStrategy: PID 3368 died... 21:46:44.639401 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3368): Terminated: ok {rc=0} 21:46:44.726032 bus /sierra_3: Setting Powered False 21:46:45.826386 bus /sierra_3: Setting Powered False 21:46:46.977497 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 sms:sysmo --------------------------------------------------------------------- 21:46:48.161634 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:46:48.166148 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 21:46:48.187183 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 21:46:48.215635 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 21:46:48.270578 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 21:46:48.291481 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 21:46:48.318319 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 21:46:48.862864 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 sms:sysmo mo_mt_sms.py ---------------------------------------------- 21:46:48.867989 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:48.878399 tst sms:sysmo: Using 1 x bts (candidates: 1) 21:46:48.911965 tst mo_mt_sms.py: using LAC 36431 21:46:49.037365 tst mo_mt_sms.py: using RAC 221 21:46:49.160511 tst mo_mt_sms.py: using CellId 36431 21:46:49.283521 tst mo_mt_sms.py: using BVCI 36432 21:46:49.398001 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:49.408746 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:49.419479 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:49.430197 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:49.441422 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 21:46:49.452704 tst sms:sysmo: Using 1 x modem (candidates: 2) 21:46:49.568459 tst sms:sysmo: Using 1 x modem (candidates: 2) 21:46:49.689808 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:46:51.390421 run create_hlr_db(pid=3373): Launched 21:46:51.504418 bus /sierra_2: Setting Powered False 21:46:52.563451 run create_hlr_db(pid=3373): Terminated: ok {rc=0} 21:46:52.996902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3375): Launched 21:46:53.312679 run osmo-hlr_10.42.42.2(pid=3376): Launched 21:46:53.434360 run osmo-stp_10.42.42.5: Starting osmo-stp 21:46:56.010971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3378): Launched 21:46:56.326710 run osmo-stp_10.42.42.5(pid=3379): Launched 21:46:56.446744 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:01.958718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3381): Launched 21:47:02.286072 run osmo-msc_10.42.42.6(pid=3382): Launched 21:47:02.461509 run osmo-stp_10.42.42.5(pid=3379): ERR: Terminated: ERROR {rc=1} [trial-2395↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3379)] 21:47:02.594363 run osmo-stp_10.42.42.5(pid=3379): stdout: | (launched: 2022-12-13_21:46:56.268070) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:02.728244 run osmo-stp_10.42.42.5(pid=3379): stderr: | 20221213214656459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214656459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214656460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214656460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214656460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214656461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214656461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:02.861378 run osmo-stp_10.42.42.5(pid=3379): stdout: | (launched: 2022-12-13_21:46:56.268070) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:02.986622 run osmo-stp_10.42.42.5(pid=3379): stderr: | 20221213214656459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214656459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214656460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214656460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214656460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214656461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214656461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:03.136667 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=3379): Process ended prematurely: osmo-stp_10.42.42.5(pid=3379) [trial-2395↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3379)] [trial-2395↪sms:sysmo↪mo_mt_sms.py:16] 21:47:03.145489 tst mo_mt_sms.py:16: Test FAILED (14.3 sec) 21:47:03.172309 run osmo-hlr_10.42.42.2(pid=3376): ERR: Terminated: ERROR {rc=237} [trial-2395↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3376)] 21:47:03.221906 run osmo-hlr_10.42.42.2(pid=3376): stdout: | (launched: 2022-12-13_21:46:53.254692) 21:47:03.273337 run osmo-hlr_10.42.42.2(pid=3376): stderr: | 20221213214653452 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214653452 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214653452 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214653452 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214653452 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214653452 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214653464 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214653472 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214653473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214653473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:03.345014 run osmo-msc_10.42.42.6(pid=3382): ERR: Terminated: ERROR {rc=2} [trial-2395↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3382)] 21:47:03.394661 run osmo-msc_10.42.42.6(pid=3382): stdout: | (launched: 2022-12-13_21:47:02.227971) 21:47:03.446027 run osmo-msc_10.42.42.6(pid=3382): stderr: | 20221213214702551 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214702551 DLGLOBAL DEBUG validating counter group 0x7f4f0dad2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214702552 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214702552 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214702552 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214702552 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214702554 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214702554 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214702555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214702555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:03.498654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3375): Terminating (SIGTERM) 21:47:03.540035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3378): Terminating (SIGTERM) 21:47:03.581652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3381): Terminating (SIGTERM) 21:47:03.623288 --- ParallelTerminationStrategy: PID 3375 died... 21:47:03.643216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3375): Terminated: ok {rc=0} 21:47:03.689215 --- ParallelTerminationStrategy: PID 3378 died... 21:47:03.709025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3378): Terminated: ok {rc=0} 21:47:03.754746 --- ParallelTerminationStrategy: PID 3381 died... 21:47:03.774243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3381): Terminated: ok {rc=0} 21:47:03.862555 bus /sierra_3: Setting Powered False 21:47:04.962276 bus /sierra_3: Setting Powered False 21:47:06.078275 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_ussd:sysmo --------------------------------------------------------------------- 21:47:07.300333 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:47:07.304895 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 21:47:07.328406 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 21:47:07.335441 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 21:47:07.370944 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 21:47:07.392037 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 21:47:07.398851 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 21:47:07.923016 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2395 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 21:47:07.928321 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 21:47:07.939430 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 21:47:07.973369 tst assert_extension.py: using LAC 36432 21:47:08.091508 tst assert_extension.py: using RAC 222 21:47:08.212690 tst assert_extension.py: using CellId 36432 21:47:08.340539 tst assert_extension.py: using BVCI 36433 21:47:08.456266 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 21:47:08.571501 tst assert_extension.py:10: start nitb and bts... 21:47:08.768490 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:47:09.370837 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3387): Launched 21:47:09.665192 run osmo-nitb_10.42.42.2(pid=3388): Launched 21:47:09.828542 run osmo-nitb_10.42.42.2(pid=3388): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3388)] 21:47:09.961350 run osmo-nitb_10.42.42.2(pid=3388): stdout: | (launched: 2022-12-13_21:47:09.610744) 21:47:10.095706 run osmo-nitb_10.42.42.2(pid=3388): stderr: | (launched: 2022-12-13_21:47:09.654536) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:47:10.230059 run osmo-nitb_10.42.42.2(pid=3388): stdout: | (launched: 2022-12-13_21:47:09.610744) 21:47:10.359311 run osmo-nitb_10.42.42.2(pid=3388): stderr: | (launched: 2022-12-13_21:47:09.654536) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3388): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3388) [trial-2395↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3388)] 21:47:10.776572 tst osmo-nitb_10.42.42.2(pid=3388): stdout: | (launched: 2022-12-13_21:47:09.610744) 21:47:10.895871 tst osmo-nitb_10.42.42.2(pid=3388): stderr: | (launched: 2022-12-13_21:47:09.654536) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:47:11.036602 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=3388): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3388) [trial-2395↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3388)] [trial-2395↪nitb_ussd:sysmo↪assert_extension.py:12] 21:47:11.045056 tst assert_extension.py:12: Test FAILED (3.1 sec) 21:47:11.051809 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3387): Terminating (SIGTERM) 21:47:11.260523 --- ParallelTerminationStrategy: PID 3387 died... 21:47:11.281255 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3387): Terminated: ok {rc=0} 21:47:11.367694 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 ussd:sysmo --------------------------------------------------------------------- 21:47:12.560433 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:47:12.564042 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 21:47:12.584262 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 21:47:12.611427 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 21:47:12.645969 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 21:47:12.666637 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 21:47:12.692797 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 21:47:13.221495 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2395 ussd:sysmo assert_extension.py ---------------------------------------------- 21:47:13.227768 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:13.239120 tst ussd:sysmo: Using 1 x bts (candidates: 1) 21:47:13.273778 tst assert_extension.py: using LAC 36433 21:47:13.400399 tst assert_extension.py: using RAC 223 21:47:13.523693 tst assert_extension.py: using CellId 36433 21:47:13.646775 tst assert_extension.py: using BVCI 36434 21:47:13.761219 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:13.772071 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:13.782868 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:13.793640 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:13.804262 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 21:47:13.815422 tst ussd:sysmo: Using 1 x modem (candidates: 1) 21:47:13.930084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:14.387093 run create_hlr_db(pid=3392): Launched 21:47:14.500039 bus /sierra_2: Setting Powered False 21:47:15.559869 run create_hlr_db(pid=3392): Terminated: ok {rc=0} 21:47:16.020916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3394): Launched 21:47:16.351402 run osmo-hlr_10.42.42.2(pid=3395): Launched 21:47:16.564780 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:17.217753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3397): Launched 21:47:17.543429 run osmo-stp_10.42.42.5(pid=3398): Launched 21:47:17.664599 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:18.234323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3400): Launched 21:47:18.549408 run osmo-msc_10.42.42.6(pid=3401): Launched 21:47:18.726362 run osmo-stp_10.42.42.5(pid=3398): ERR: Terminated: ERROR {rc=1} [trial-2395↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3398)] 21:47:18.859327 run osmo-stp_10.42.42.5(pid=3398): stdout: | (launched: 2022-12-13_21:47:17.485369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:18.993093 run osmo-stp_10.42.42.5(pid=3398): stderr: | 20221213214717678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214717678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214717678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214717679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214717679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214717679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214717679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:19.126656 run osmo-stp_10.42.42.5(pid=3398): stdout: | (launched: 2022-12-13_21:47:17.485369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:19.252382 run osmo-stp_10.42.42.5(pid=3398): stderr: | 20221213214717678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214717678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214717678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214717679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214717679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214717679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214717679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:19.402519 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=3398): Process ended prematurely: osmo-stp_10.42.42.5(pid=3398) [trial-2395↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3398)] [trial-2395↪ussd:sysmo↪assert_extension.py:17] 21:47:19.411159 tst assert_extension.py:17: Test FAILED (6.2 sec) 21:47:19.437907 run osmo-hlr_10.42.42.2(pid=3395): ERR: Terminated: ERROR {rc=237} [trial-2395↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3395)] 21:47:19.488004 run osmo-hlr_10.42.42.2(pid=3395): stdout: | (launched: 2022-12-13_21:47:16.287162) 21:47:19.539408 run osmo-hlr_10.42.42.2(pid=3395): stderr: | 20221213214716491 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214716491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214716491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214716491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214716491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214716491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214716584 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214716592 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214716593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214716593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:19.610776 run osmo-msc_10.42.42.6(pid=3401): ERR: Terminated: ERROR {rc=2} [trial-2395↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3401)] 21:47:19.660417 run osmo-msc_10.42.42.6(pid=3401): stdout: | (launched: 2022-12-13_21:47:18.491308) 21:47:19.711660 run osmo-msc_10.42.42.6(pid=3401): stderr: | 20221213214718813 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214718813 DLGLOBAL DEBUG validating counter group 0x7fbf72610c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214718813 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214718813 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214718813 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214718813 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214718815 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214718815 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214718816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214718816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:19.763518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3394): Terminating (SIGTERM) 21:47:19.804671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3397): Terminating (SIGTERM) 21:47:19.845873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3400): Terminating (SIGTERM) 21:47:19.887293 --- ParallelTerminationStrategy: PID 3394 died... 21:47:19.907110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3394): Terminated: ok {rc=0} 21:47:19.952894 --- ParallelTerminationStrategy: PID 3397 died... 21:47:19.972348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3397): Terminated: ok {rc=0} 21:47:20.017953 --- ParallelTerminationStrategy: PID 3400 died... 21:47:20.037306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3400): Terminated: ok {rc=0} 21:47:20.123991 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 21:47:21.320388 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:47:21.327152 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 21:47:21.348163 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 21:47:21.375291 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 21:47:21.427496 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 21:47:21.448789 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 21:47:21.475823 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 21:47:22.027412 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 21:47:22.080082 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:22.091409 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:47:22.148353 tst mo_mt_call.py: using LAC 36434 21:47:22.275394 tst mo_mt_call.py: using RAC 224 21:47:22.406044 tst mo_mt_call.py: using CellId 36434 21:47:22.531494 tst mo_mt_call.py: using BVCI 36435 21:47:22.647352 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:22.658809 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:22.670040 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:22.681300 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:22.692608 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:22.703958 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:47:22.821546 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:47:22.938923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:23.438540 run create_hlr_db(pid=3406): Launched 21:47:23.568495 bus /sierra_2: Setting Powered False 21:47:24.633193 run create_hlr_db(pid=3406): Terminated: ok {rc=0} 21:47:25.066267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3408): Launched 21:47:25.367882 run osmo-hlr_10.42.42.2(pid=3409): Launched 21:47:25.483265 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:26.015726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3411): Launched 21:47:26.317085 run osmo-stp_10.42.42.5(pid=3412): Launched 21:47:26.452708 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:26.997728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3414): Launched 21:47:27.297878 run osmo-msc_10.42.42.6(pid=3415): Launched 21:47:27.466013 run osmo-stp_10.42.42.5(pid=3412): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3412)] 21:47:27.595595 run osmo-stp_10.42.42.5(pid=3412): stdout: | (launched: 2022-12-13_21:47:26.261284) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:27.723015 run osmo-stp_10.42.42.5(pid=3412): stderr: | 20221213214726437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214726437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214726437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214726438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214726438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214726438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214726438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:27.848604 run osmo-stp_10.42.42.5(pid=3412): stdout: | (launched: 2022-12-13_21:47:26.261284) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:27.969309 run osmo-stp_10.42.42.5(pid=3412): stderr: | 20221213214726437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214726437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214726437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214726438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214726438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214726438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214726438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:28.113488 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3412): Process ended prematurely: osmo-stp_10.42.42.5(pid=3412) [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3412)] [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 21:47:28.122277 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 21:47:28.148314 run osmo-hlr_10.42.42.2(pid=3409): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3409)] 21:47:28.197254 run osmo-hlr_10.42.42.2(pid=3409): stdout: | (launched: 2022-12-13_21:47:25.312203) 21:47:28.247106 run osmo-hlr_10.42.42.2(pid=3409): stderr: | 20221213214725490 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214725490 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214725490 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214725490 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214725490 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214725490 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214725502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214725513 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214725513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214725514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:28.316271 run osmo-msc_10.42.42.6(pid=3415): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3415)] 21:47:28.363681 run osmo-msc_10.42.42.6(pid=3415): stdout: | (launched: 2022-12-13_21:47:27.242072) 21:47:28.413256 run osmo-msc_10.42.42.6(pid=3415): stderr: | 20221213214727515 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214727515 DLGLOBAL DEBUG validating counter group 0x7f8257701c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214727515 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214727515 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214727515 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214727515 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214727517 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214727518 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214727518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214727518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:28.462899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3408): Terminating (SIGTERM) 21:47:28.502850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3411): Terminating (SIGTERM) 21:47:28.543126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3414): Terminating (SIGTERM) 21:47:28.583134 --- ParallelTerminationStrategy: PID 3408 died... 21:47:28.602626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3408): Terminated: ok {rc=0} 21:47:28.646629 --- ParallelTerminationStrategy: PID 3411 died... 21:47:28.665443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3411): Terminated: ok {rc=0} 21:47:28.709380 --- ParallelTerminationStrategy: PID 3414 died... 21:47:28.728212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3414): Terminated: ok {rc=0} 21:47:28.812290 bus /sierra_3: Setting Powered False 21:47:29.908895 bus /sierra_3: Setting Powered False 21:47:31.027733 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 21:47:32.176216 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:32.188603 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:47:32.251513 tst mo_mt_call_osmux.py: using LAC 36435 21:47:32.371924 tst mo_mt_call_osmux.py: using RAC 225 21:47:32.489398 tst mo_mt_call_osmux.py: using CellId 36435 21:47:32.606263 tst mo_mt_call_osmux.py: using BVCI 36436 21:47:32.717418 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:32.728362 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:32.739320 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:32.750021 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:32.761113 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:47:32.772143 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:47:32.893053 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:47:33.010417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:33.480060 run create_hlr_db(pid=3417): Launched 21:47:33.594175 bus /sierra_2: Setting Powered False 21:47:34.654852 run create_hlr_db(pid=3417): Terminated: ok {rc=0} 21:47:35.076611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3419): Launched 21:47:35.378636 run osmo-hlr_10.42.42.2(pid=3420): Launched 21:47:35.493661 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:36.011538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3422): Launched 21:47:36.312196 run osmo-stp_10.42.42.5(pid=3423): Launched 21:47:36.427389 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:36.973713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3425): Launched 21:47:37.274850 run osmo-msc_10.42.42.6(pid=3426): Launched 21:47:37.443773 run osmo-stp_10.42.42.5(pid=3423): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3423)] 21:47:37.573591 run osmo-stp_10.42.42.5(pid=3423): stdout: | (launched: 2022-12-13_21:47:36.256604) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:37.701582 run osmo-stp_10.42.42.5(pid=3423): stderr: | 20221213214736426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214736426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214736427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214736427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214736427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214736428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214736428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:37.827488 run osmo-stp_10.42.42.5(pid=3423): stdout: | (launched: 2022-12-13_21:47:36.256604) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:37.947557 run osmo-stp_10.42.42.5(pid=3423): stderr: | 20221213214736426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214736426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214736427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214736427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214736427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214736428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214736428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:38.091200 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3423): Process ended prematurely: osmo-stp_10.42.42.5(pid=3423) [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3423)] [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 21:47:38.100081 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 21:47:38.126343 run osmo-hlr_10.42.42.2(pid=3420): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3420)] 21:47:38.174927 run osmo-hlr_10.42.42.2(pid=3420): stdout: | (launched: 2022-12-13_21:47:35.322907) 21:47:38.224174 run osmo-hlr_10.42.42.2(pid=3420): stderr: | 20221213214735501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214735501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214735501 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214735501 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214735501 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214735501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214735562 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214735572 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214735573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214735573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:38.293082 run osmo-msc_10.42.42.6(pid=3426): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3426)] 21:47:38.340670 run osmo-msc_10.42.42.6(pid=3426): stdout: | (launched: 2022-12-13_21:47:37.219550) 21:47:38.390075 run osmo-msc_10.42.42.6(pid=3426): stderr: | 20221213214737493 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214737493 DLGLOBAL DEBUG validating counter group 0x7fba3acfbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214737493 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214737494 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214737494 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214737494 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214737496 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214737496 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214737496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214737496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:38.439630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3419): Terminating (SIGTERM) 21:47:38.479513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3422): Terminating (SIGTERM) 21:47:38.519377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3425): Terminating (SIGTERM) 21:47:38.559199 --- ParallelTerminationStrategy: PID 3419 died... 21:47:38.578605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3419): Terminated: ok {rc=0} 21:47:38.622878 --- ParallelTerminationStrategy: PID 3422 died... 21:47:38.641848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3422): Terminated: ok {rc=0} 21:47:38.685883 --- ParallelTerminationStrategy: PID 3425 died... 21:47:38.704865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3425): Terminated: ok {rc=0} 21:47:38.790646 bus /sierra_3: Setting Powered False 21:47:39.889168 bus /sierra_3: Setting Powered False 21:47:41.000802 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 21:47:42.241103 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:47:42.247854 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 21:47:42.269061 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 21:47:42.296371 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 21:47:42.347497 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 21:47:42.369127 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 21:47:42.396536 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 21:47:42.952562 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 21:47:43.005003 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:43.016451 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:47:43.073039 tst mo_mt_call.py: using LAC 36436 21:47:43.198540 tst mo_mt_call.py: using RAC 226 21:47:43.323516 tst mo_mt_call.py: using CellId 36436 21:47:43.448335 tst mo_mt_call.py: using BVCI 36437 21:47:43.564938 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:43.576366 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:43.587599 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:43.598834 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:43.610181 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:43.621439 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:47:43.741880 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:47:43.859977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:44.361583 run create_hlr_db(pid=3431): Launched 21:47:44.492519 bus /sierra_2: Setting Powered False 21:47:45.557482 run create_hlr_db(pid=3431): Terminated: ok {rc=0} 21:47:46.023402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3433): Launched 21:47:46.365658 run osmo-hlr_10.42.42.2(pid=3434): Launched 21:47:46.600254 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:47.290998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3436): Launched 21:47:47.592505 run osmo-stp_10.42.42.5(pid=3437): Launched 21:47:47.707368 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:48.252477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3439): Launched 21:47:48.554426 run osmo-msc_10.42.42.6(pid=3440): Launched 21:47:48.723694 run osmo-stp_10.42.42.5(pid=3437): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3437)] 21:47:48.851613 run osmo-stp_10.42.42.5(pid=3437): stdout: | (launched: 2022-12-13_21:47:47.536679) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:48.979520 run osmo-stp_10.42.42.5(pid=3437): stderr: | 20221213214747708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214747708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214747709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214747709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214747710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214747710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214747710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:49.104904 run osmo-stp_10.42.42.5(pid=3437): stdout: | (launched: 2022-12-13_21:47:47.536679) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:49.224786 run osmo-stp_10.42.42.5(pid=3437): stderr: | 20221213214747708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214747708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214747709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214747709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214747710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214747710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214747710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:49.368045 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3437): Process ended prematurely: osmo-stp_10.42.42.5(pid=3437) [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3437)] [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 21:47:49.376790 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:47:49.402771 run osmo-hlr_10.42.42.2(pid=3434): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3434)] 21:47:49.451002 run osmo-hlr_10.42.42.2(pid=3434): stdout: | (launched: 2022-12-13_21:47:46.290376) 21:47:49.500015 run osmo-hlr_10.42.42.2(pid=3434): stderr: | 20221213214746557 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214746557 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214746557 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214746557 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214746557 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214746558 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214746623 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214746634 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214746634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214746634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:49.568505 run osmo-msc_10.42.42.6(pid=3440): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3440)] 21:47:49.615535 run osmo-msc_10.42.42.6(pid=3440): stdout: | (launched: 2022-12-13_21:47:48.498853) 21:47:49.664406 run osmo-msc_10.42.42.6(pid=3440): stderr: | 20221213214748772 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214748773 DLGLOBAL DEBUG validating counter group 0x7fa72f264c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214748773 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214748773 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214748773 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214748773 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214748775 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214748775 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214748775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214748775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:47:49.713898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3433): Terminating (SIGTERM) 21:47:49.753326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3436): Terminating (SIGTERM) 21:47:49.792650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3439): Terminating (SIGTERM) 21:47:49.832305 --- ParallelTerminationStrategy: PID 3433 died... 21:47:49.851435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3433): Terminated: ok {rc=0} 21:47:49.895483 --- ParallelTerminationStrategy: PID 3436 died... 21:47:49.914289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3436): Terminated: ok {rc=0} 21:47:49.957716 --- ParallelTerminationStrategy: PID 3439 died... 21:47:49.976405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3439): Terminated: ok {rc=0} 21:47:50.062411 bus /sierra_3: Setting Powered False 21:47:51.161447 bus /sierra_3: Setting Powered False 21:47:52.273759 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 21:47:53.421612 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:53.433681 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:47:53.492837 tst mo_mt_call_osmux.py: using LAC 36437 21:47:53.621901 tst mo_mt_call_osmux.py: using RAC 227 21:47:53.747830 tst mo_mt_call_osmux.py: using CellId 36437 21:47:53.866458 tst mo_mt_call_osmux.py: using BVCI 36438 21:47:53.983989 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:53.995654 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:54.007082 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:54.018485 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:54.030025 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:47:54.041628 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:47:54.162096 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:47:54.279937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:47:54.783130 run create_hlr_db(pid=3442): Launched 21:47:54.914257 bus /sierra_2: Setting Powered False 21:47:55.977940 run create_hlr_db(pid=3442): Terminated: ok {rc=0} 21:47:56.427242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3444): Launched 21:47:56.750865 run osmo-hlr_10.42.42.2(pid=3445): Launched 21:47:56.874888 run osmo-stp_10.42.42.5: Starting osmo-stp 21:47:57.434703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3447): Launched 21:47:57.758212 run osmo-stp_10.42.42.5(pid=3448): Launched 21:47:57.880863 run osmo-msc_10.42.42.6: Starting osmo-msc 21:47:58.464191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3450): Launched 21:47:58.787571 run osmo-msc_10.42.42.6(pid=3451): Launched 21:47:58.967559 run osmo-stp_10.42.42.5(pid=3448): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3448)] 21:47:59.103607 run osmo-stp_10.42.42.5(pid=3448): stdout: | (launched: 2022-12-13_21:47:57.698590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:59.240203 run osmo-stp_10.42.42.5(pid=3448): stderr: | 20221213214757894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214757894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214757894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214757894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214757895 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214757895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214757895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:59.375793 run osmo-stp_10.42.42.5(pid=3448): stdout: | (launched: 2022-12-13_21:47:57.698590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:47:59.504471 run osmo-stp_10.42.42.5(pid=3448): stderr: | 20221213214757894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214757894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214757894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214757894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214757895 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214757895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214757895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:47:59.658286 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3448): Process ended prematurely: osmo-stp_10.42.42.5(pid=3448) [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3448)] [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 21:47:59.667754 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:47:59.695199 run osmo-hlr_10.42.42.2(pid=3445): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3445)] 21:47:59.745459 run osmo-hlr_10.42.42.2(pid=3445): stdout: | (launched: 2022-12-13_21:47:56.690780) 21:47:59.797227 run osmo-hlr_10.42.42.2(pid=3445): stderr: | 20221213214756893 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214756893 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214756893 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214756893 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214756893 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214756893 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214756906 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214756914 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214756914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214756914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:47:59.868762 run osmo-msc_10.42.42.6(pid=3451): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3451)] 21:47:59.918344 run osmo-msc_10.42.42.6(pid=3451): stdout: | (launched: 2022-12-13_21:47:58.727529) 21:47:59.969814 run osmo-msc_10.42.42.6(pid=3451): stderr: | 20221213214759052 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214759052 DLGLOBAL DEBUG validating counter group 0x7f856d2e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214759052 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214759052 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214759052 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214759053 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214759054 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214759055 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214759055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214759055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:00.021453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3444): Terminating (SIGTERM) 21:48:00.062622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3447): Terminating (SIGTERM) 21:48:00.104030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3450): Terminating (SIGTERM) 21:48:00.145687 --- ParallelTerminationStrategy: PID 3444 died... 21:48:00.165645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3444): Terminated: ok {rc=0} 21:48:00.211724 --- ParallelTerminationStrategy: PID 3447 died... 21:48:00.231377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3447): Terminated: ok {rc=0} 21:48:00.277254 --- ParallelTerminationStrategy: PID 3450 died... 21:48:00.296668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3450): Terminated: ok {rc=0} 21:48:00.384284 bus /sierra_3: Setting Powered False 21:48:01.479908 bus /sierra_3: Setting Powered False 21:48:02.594682 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 21:48:03.833329 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:48:03.840075 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 21:48:03.861157 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 21:48:03.888159 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 21:48:03.940089 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 21:48:03.961375 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 21:48:03.988917 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 21:48:04.540246 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 21:48:04.593118 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:04.604566 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:48:04.662641 tst mo_mt_call.py: using LAC 36438 21:48:04.789442 tst mo_mt_call.py: using RAC 228 21:48:04.918263 tst mo_mt_call.py: using CellId 36438 21:48:05.046315 tst mo_mt_call.py: using BVCI 36439 21:48:05.163429 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:05.174931 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:05.186119 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:05.197356 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:05.208854 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:05.220142 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:48:05.340574 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:48:05.458137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:05.926785 run create_hlr_db(pid=3456): Launched 21:48:06.042242 bus /sierra_2: Setting Powered False 21:48:07.102556 run create_hlr_db(pid=3456): Terminated: ok {rc=0} 21:48:07.524415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3458): Launched 21:48:07.825644 run osmo-hlr_10.42.42.2(pid=3459): Launched 21:48:07.940503 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:08.472113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3461): Launched 21:48:08.773412 run osmo-stp_10.42.42.5(pid=3462): Launched 21:48:08.888785 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:09.433136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3464): Launched 21:48:09.734390 run osmo-msc_10.42.42.6(pid=3465): Launched 21:48:09.903045 run osmo-stp_10.42.42.5(pid=3462): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3462)] 21:48:10.031350 run osmo-stp_10.42.42.5(pid=3462): stdout: | (launched: 2022-12-13_21:48:08.717644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:10.159624 run osmo-stp_10.42.42.5(pid=3462): stderr: | 20221213214808891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214808891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214808891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214808892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214808892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214808892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214808892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:10.285583 run osmo-stp_10.42.42.5(pid=3462): stdout: | (launched: 2022-12-13_21:48:08.717644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:10.405925 run osmo-stp_10.42.42.5(pid=3462): stderr: | 20221213214808891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214808891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214808891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214808892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214808892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214808892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214808892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:10.550153 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3462): Process ended prematurely: osmo-stp_10.42.42.5(pid=3462) [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3462)] [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 21:48:10.559020 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 21:48:10.585172 run osmo-hlr_10.42.42.2(pid=3459): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3459)] 21:48:10.633827 run osmo-hlr_10.42.42.2(pid=3459): stdout: | (launched: 2022-12-13_21:48:07.770062) 21:48:10.683291 run osmo-hlr_10.42.42.2(pid=3459): stderr: | 20221213214807948 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214807948 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214807948 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214807949 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214807949 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214807949 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214807960 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214807969 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214807969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214807969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:10.752604 run osmo-msc_10.42.42.6(pid=3465): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3465)] 21:48:10.800148 run osmo-msc_10.42.42.6(pid=3465): stdout: | (launched: 2022-12-13_21:48:09.678868) 21:48:10.849514 run osmo-msc_10.42.42.6(pid=3465): stderr: | 20221213214809951 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214809952 DLGLOBAL DEBUG validating counter group 0x7f9db9e2dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214809952 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214809952 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214809952 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214809952 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214809954 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214809954 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214809954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214809955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:10.899613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3458): Terminating (SIGTERM) 21:48:10.939447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3461): Terminating (SIGTERM) 21:48:10.979196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3464): Terminating (SIGTERM) 21:48:11.019093 --- ParallelTerminationStrategy: PID 3458 died... 21:48:11.038648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3458): Terminated: ok {rc=0} 21:48:11.082658 --- ParallelTerminationStrategy: PID 3461 died... 21:48:11.101495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3461): Terminated: ok {rc=0} 21:48:11.145355 --- ParallelTerminationStrategy: PID 3464 died... 21:48:11.164230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3464): Terminated: ok {rc=0} 21:48:11.249891 bus /sierra_3: Setting Powered False 21:48:12.348273 bus /sierra_3: Setting Powered False 21:48:13.463396 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 21:48:14.607910 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:14.619492 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:48:14.675122 tst mo_mt_call_osmux.py: using LAC 36439 21:48:14.795553 tst mo_mt_call_osmux.py: using RAC 229 21:48:14.917432 tst mo_mt_call_osmux.py: using CellId 36439 21:48:15.046473 tst mo_mt_call_osmux.py: using BVCI 36440 21:48:15.163527 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:15.175134 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:15.186556 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:15.198017 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:15.209213 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:48:15.220383 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:48:15.337600 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:48:15.455220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:15.970126 run create_hlr_db(pid=3467): Launched 21:48:16.127990 bus /sierra_2: Setting Powered False 21:48:17.198273 run create_hlr_db(pid=3467): Terminated: ok {rc=0} 21:48:17.624410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3469): Launched 21:48:17.925180 run osmo-hlr_10.42.42.2(pid=3470): Launched 21:48:18.040159 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:18.571096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3472): Launched 21:48:18.872847 run osmo-stp_10.42.42.5(pid=3473): Launched 21:48:18.987735 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:19.532933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3475): Launched 21:48:19.835023 run osmo-msc_10.42.42.6(pid=3476): Launched 21:48:20.003482 run osmo-stp_10.42.42.5(pid=3473): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3473)] 21:48:20.131704 run osmo-stp_10.42.42.5(pid=3473): stdout: | (launched: 2022-12-13_21:48:18.816855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:20.259534 run osmo-stp_10.42.42.5(pid=3473): stderr: | 20221213214818989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214818989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214818990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214818990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214818990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214818990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214818991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:20.385145 run osmo-stp_10.42.42.5(pid=3473): stdout: | (launched: 2022-12-13_21:48:18.816855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:20.505180 run osmo-stp_10.42.42.5(pid=3473): stderr: | 20221213214818989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214818989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214818990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214818990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214818990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214818990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214818991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:20.648564 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3473): Process ended prematurely: osmo-stp_10.42.42.5(pid=3473) [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3473)] [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 21:48:20.657478 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 21:48:20.683445 run osmo-hlr_10.42.42.2(pid=3470): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3470)] 21:48:20.731872 run osmo-hlr_10.42.42.2(pid=3470): stdout: | (launched: 2022-12-13_21:48:17.869784) 21:48:20.781355 run osmo-hlr_10.42.42.2(pid=3470): stderr: | 20221213214818047 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214818047 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214818047 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214818047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214818047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214818047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214818059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214818069 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214818069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214818069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:20.850262 run osmo-msc_10.42.42.6(pid=3476): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3476)] 21:48:20.897520 run osmo-msc_10.42.42.6(pid=3476): stdout: | (launched: 2022-12-13_21:48:19.779349) 21:48:20.947094 run osmo-msc_10.42.42.6(pid=3476): stderr: | 20221213214820052 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214820052 DLGLOBAL DEBUG validating counter group 0x7f97ff616c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214820052 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214820052 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214820052 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214820053 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214820054 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214820055 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214820055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214820055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:20.996776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3469): Terminating (SIGTERM) 21:48:21.036557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3472): Terminating (SIGTERM) 21:48:21.076407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3475): Terminating (SIGTERM) 21:48:21.116432 --- ParallelTerminationStrategy: PID 3469 died... 21:48:21.135835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3469): Terminated: ok {rc=0} 21:48:21.179796 --- ParallelTerminationStrategy: PID 3472 died... 21:48:21.198658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3472): Terminated: ok {rc=0} 21:48:21.242440 --- ParallelTerminationStrategy: PID 3475 died... 21:48:21.261237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3475): Terminated: ok {rc=0} 21:48:21.344271 bus /sierra_3: Setting Powered False 21:48:22.441741 bus /sierra_3: Setting Powered False 21:48:23.558210 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 21:48:24.809379 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:48:24.816024 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 21:48:24.836926 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 21:48:24.863971 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 21:48:24.923212 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 21:48:24.945726 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 21:48:24.973716 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 21:48:25.515730 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 21:48:25.568014 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:25.579366 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:48:25.637800 tst mo_mt_call.py: using LAC 36440 21:48:25.766505 tst mo_mt_call.py: using RAC 230 21:48:25.898372 tst mo_mt_call.py: using CellId 36440 21:48:26.024640 tst mo_mt_call.py: using BVCI 36441 21:48:26.142227 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:26.153646 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:26.164736 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:26.175941 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:26.187524 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:26.199174 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:48:26.315884 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:48:26.435827 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:26.937251 run create_hlr_db(pid=3481): Launched 21:48:27.067873 bus /sierra_2: Setting Powered False 21:48:28.129037 run create_hlr_db(pid=3481): Terminated: ok {rc=0} 21:48:28.577604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3483): Launched 21:48:28.900058 run osmo-hlr_10.42.42.2(pid=3484): Launched 21:48:29.022418 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:29.580803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3486): Launched 21:48:29.902704 run osmo-stp_10.42.42.5(pid=3487): Launched 21:48:30.024837 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:30.607969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3489): Launched 21:48:30.961825 run osmo-msc_10.42.42.6(pid=3490): Launched 21:48:31.171699 run osmo-stp_10.42.42.5(pid=3487): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3487)] 21:48:31.419768 run osmo-stp_10.42.42.5(pid=3487): stdout: | (launched: 2022-12-13_21:48:29.843443) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:31.681103 run osmo-stp_10.42.42.5(pid=3487): stderr: | 20221213214830035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214830035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214830035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214830036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214830036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214830036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214830036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:31.825938 run osmo-stp_10.42.42.5(pid=3487): stdout: | (launched: 2022-12-13_21:48:29.843443) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:31.999489 run osmo-stp_10.42.42.5(pid=3487): stderr: | 20221213214830035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214830035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214830035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214830036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214830036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214830036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214830036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:32.148936 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3487): Process ended prematurely: osmo-stp_10.42.42.5(pid=3487) [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3487)] [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 21:48:32.158874 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 21:48:32.186850 run osmo-hlr_10.42.42.2(pid=3484): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3484)] 21:48:32.238162 run osmo-hlr_10.42.42.2(pid=3484): stdout: | (launched: 2022-12-13_21:48:28.840870) 21:48:32.291932 run osmo-hlr_10.42.42.2(pid=3484): stderr: | 20221213214829040 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214829040 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214829041 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214829041 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214829041 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214829041 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214829052 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214829060 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214829060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214829060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:32.363969 run osmo-msc_10.42.42.6(pid=3490): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3490)] 21:48:32.413131 run osmo-msc_10.42.42.6(pid=3490): stdout: | (launched: 2022-12-13_21:48:30.887642) 21:48:32.465292 run osmo-msc_10.42.42.6(pid=3490): stderr: | 20221213214831479 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214831479 DLGLOBAL DEBUG validating counter group 0x7f88bafc7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214831479 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214831479 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214831479 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214831480 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214831490 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214831491 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214831491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214831491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:32.519045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3483): Terminating (SIGTERM) 21:48:32.559823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3486): Terminating (SIGTERM) 21:48:32.600538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3489): Terminating (SIGTERM) 21:48:32.641554 --- ParallelTerminationStrategy: PID 3483 died... 21:48:32.661515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3483): Terminated: ok {rc=0} 21:48:32.706684 --- ParallelTerminationStrategy: PID 3486 died... 21:48:32.726182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3486): Terminated: ok {rc=0} 21:48:32.770927 --- ParallelTerminationStrategy: PID 3489 died... 21:48:32.790373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3489): Terminated: ok {rc=0} 21:48:32.878211 bus /sierra_3: Setting Powered False 21:48:33.976688 bus /sierra_3: Setting Powered False 21:48:35.088843 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 21:48:36.236525 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:36.248501 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:48:36.305970 tst mo_mt_call_osmux.py: using LAC 36441 21:48:36.431758 tst mo_mt_call_osmux.py: using RAC 231 21:48:36.551473 tst mo_mt_call_osmux.py: using CellId 36441 21:48:36.670501 tst mo_mt_call_osmux.py: using BVCI 36442 21:48:36.781873 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:36.793002 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:36.803861 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:36.814868 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:36.826027 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:48:36.837371 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:48:36.957928 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:48:37.075060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:37.544767 run create_hlr_db(pid=3492): Launched 21:48:37.659941 bus /sierra_2: Setting Powered False 21:48:38.720789 run create_hlr_db(pid=3492): Terminated: ok {rc=0} 21:48:39.163607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3494): Launched 21:48:39.486883 run osmo-hlr_10.42.42.2(pid=3495): Launched 21:48:39.611153 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:40.156490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3497): Launched 21:48:40.459081 run osmo-stp_10.42.42.5(pid=3498): Launched 21:48:40.574794 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:41.122074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3500): Launched 21:48:41.422938 run osmo-msc_10.42.42.6(pid=3501): Launched 21:48:41.591400 run osmo-stp_10.42.42.5(pid=3498): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3498)] 21:48:41.719352 run osmo-stp_10.42.42.5(pid=3498): stdout: | (launched: 2022-12-13_21:48:40.403699) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:41.847101 run osmo-stp_10.42.42.5(pid=3498): stderr: | 20221213214840575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214840575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214840575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214840575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214840576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214840576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214840576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:41.972486 run osmo-stp_10.42.42.5(pid=3498): stdout: | (launched: 2022-12-13_21:48:40.403699) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:42.092569 run osmo-stp_10.42.42.5(pid=3498): stderr: | 20221213214840575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214840575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214840575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214840575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214840576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214840576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214840576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:42.235857 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3498): Process ended prematurely: osmo-stp_10.42.42.5(pid=3498) [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3498)] [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 21:48:42.244854 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 21:48:42.271027 run osmo-hlr_10.42.42.2(pid=3495): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3495)] 21:48:42.319084 run osmo-hlr_10.42.42.2(pid=3495): stdout: | (launched: 2022-12-13_21:48:39.427806) 21:48:42.368318 run osmo-hlr_10.42.42.2(pid=3495): stderr: | 20221213214839624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214839624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214839624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214839624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214839624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214839624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214839639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214839649 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214839650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214839650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:42.437251 run osmo-msc_10.42.42.6(pid=3501): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3501)] 21:48:42.484646 run osmo-msc_10.42.42.6(pid=3501): stdout: | (launched: 2022-12-13_21:48:41.367221) 21:48:42.534186 run osmo-msc_10.42.42.6(pid=3501): stderr: | 20221213214841640 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214841640 DLGLOBAL DEBUG validating counter group 0x7f62773cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214841641 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214841641 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214841641 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214841641 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214841643 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214841643 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214841643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214841643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:42.583476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3494): Terminating (SIGTERM) 21:48:42.622992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3497): Terminating (SIGTERM) 21:48:42.662668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3500): Terminating (SIGTERM) 21:48:42.702404 --- ParallelTerminationStrategy: PID 3494 died... 21:48:42.721723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3494): Terminated: ok {rc=0} 21:48:42.765703 --- ParallelTerminationStrategy: PID 3497 died... 21:48:42.784710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3497): Terminated: ok {rc=0} 21:48:42.828653 --- ParallelTerminationStrategy: PID 3500 died... 21:48:42.847563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3500): Terminated: ok {rc=0} 21:48:42.933748 bus /sierra_3: Setting Powered False 21:48:44.031588 bus /sierra_3: Setting Powered False 21:48:45.144570 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 21:48:46.414844 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:48:46.425310 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 21:48:46.453985 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 21:48:46.490229 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 21:48:46.556368 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 21:48:46.589451 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 21:48:46.627468 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 21:48:47.156919 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 21:48:47.207970 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:47.219450 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:48:47.277203 tst mo_mt_call.py: using LAC 36442 21:48:47.397228 tst mo_mt_call.py: using RAC 232 21:48:47.515530 tst mo_mt_call.py: using CellId 36442 21:48:47.634535 tst mo_mt_call.py: using BVCI 36443 21:48:47.745516 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:47.756350 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:47.767035 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:47.777699 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:47.788660 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:47.800249 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:48:47.920444 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:48:48.037622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:48.504605 run create_hlr_db(pid=3506): Launched 21:48:48.619686 bus /sierra_2: Setting Powered False 21:48:49.680124 run create_hlr_db(pid=3506): Terminated: ok {rc=0} 21:48:50.122785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3508): Launched 21:48:50.445636 run osmo-hlr_10.42.42.2(pid=3509): Launched 21:48:50.569312 run osmo-stp_10.42.42.5: Starting osmo-stp 21:48:51.124547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3511): Launched 21:48:51.447464 run osmo-stp_10.42.42.5(pid=3512): Launched 21:48:51.571314 run osmo-msc_10.42.42.6: Starting osmo-msc 21:48:52.155841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3514): Launched 21:48:52.479390 run osmo-msc_10.42.42.6(pid=3515): Launched 21:48:52.649925 run osmo-stp_10.42.42.5(pid=3512): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3512)] 21:48:52.781384 run osmo-stp_10.42.42.5(pid=3512): stdout: | (launched: 2022-12-13_21:48:51.388367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:52.909688 run osmo-stp_10.42.42.5(pid=3512): stderr: | 20221213214851580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214851580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214851580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214851581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214851581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214851581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214851582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:53.035961 run osmo-stp_10.42.42.5(pid=3512): stdout: | (launched: 2022-12-13_21:48:51.388367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:48:53.156141 run osmo-stp_10.42.42.5(pid=3512): stderr: | 20221213214851580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214851580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214851580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214851581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214851581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214851581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214851582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:48:53.301100 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3512): Process ended prematurely: osmo-stp_10.42.42.5(pid=3512) [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3512)] [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 21:48:53.309979 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 21:48:53.336223 run osmo-hlr_10.42.42.2(pid=3509): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3509)] 21:48:53.384505 run osmo-hlr_10.42.42.2(pid=3509): stdout: | (launched: 2022-12-13_21:48:50.386656) 21:48:53.433506 run osmo-hlr_10.42.42.2(pid=3509): stderr: | 20221213214850585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214850585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214850585 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214850585 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214850585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214850585 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214850607 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214850616 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214850616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214850617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:48:53.501802 run osmo-msc_10.42.42.6(pid=3515): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3515)] 21:48:53.548679 run osmo-msc_10.42.42.6(pid=3515): stdout: | (launched: 2022-12-13_21:48:52.419446) 21:48:53.597545 run osmo-msc_10.42.42.6(pid=3515): stderr: | 20221213214852693 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214852694 DLGLOBAL DEBUG validating counter group 0x7fe3e058fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214852694 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214852694 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214852694 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214852694 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214852696 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214852696 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214852696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214852696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:48:53.646875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3508): Terminating (SIGTERM) 21:48:53.686591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3511): Terminating (SIGTERM) 21:48:53.726119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3514): Terminating (SIGTERM) 21:48:53.765995 --- ParallelTerminationStrategy: PID 3508 died... 21:48:53.785415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3508): Terminated: ok {rc=0} 21:48:53.829901 --- ParallelTerminationStrategy: PID 3511 died... 21:48:53.848865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3511): Terminated: ok {rc=0} 21:48:53.892828 --- ParallelTerminationStrategy: PID 3514 died... 21:48:53.912416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3514): Terminated: ok {rc=0} 21:48:53.996932 bus /sierra_3: Setting Powered False 21:48:55.095179 bus /sierra_3: Setting Powered False 21:48:56.211374 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 21:48:57.360088 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:57.372222 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:48:57.430020 tst mo_mt_call_osmux.py: using LAC 36443 21:48:57.557772 tst mo_mt_call_osmux.py: using RAC 233 21:48:57.685945 tst mo_mt_call_osmux.py: using CellId 36443 21:48:57.814336 tst mo_mt_call_osmux.py: using BVCI 36444 21:48:57.932655 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:57.944083 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:57.955338 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:57.966532 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:57.977767 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:48:57.988916 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:48:58.108516 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:48:58.227693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:48:58.695967 run create_hlr_db(pid=3517): Launched 21:48:58.811603 bus /sierra_2: Setting Powered False 21:48:59.872401 run create_hlr_db(pid=3517): Terminated: ok {rc=0} 21:49:00.292911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3519): Launched 21:49:00.593594 run osmo-hlr_10.42.42.2(pid=3520): Launched 21:49:00.708239 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:01.347030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3522): Launched 21:49:01.693668 run osmo-stp_10.42.42.5(pid=3523): Launched 21:49:01.961153 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:02.546788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3525): Launched 21:49:02.869408 run osmo-msc_10.42.42.6(pid=3526): Launched 21:49:03.047631 run osmo-stp_10.42.42.5(pid=3523): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3523)] 21:49:03.182486 run osmo-stp_10.42.42.5(pid=3523): stdout: | (launched: 2022-12-13_21:49:01.626978) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:03.318563 run osmo-stp_10.42.42.5(pid=3523): stderr: | 20221213214901802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214901802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214901802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214901803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214901803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214901803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214901803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:03.453453 run osmo-stp_10.42.42.5(pid=3523): stdout: | (launched: 2022-12-13_21:49:01.626978) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:03.581402 run osmo-stp_10.42.42.5(pid=3523): stderr: | 20221213214901802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214901802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214901802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214901803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214901803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214901803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214901803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:03.734852 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3523): Process ended prematurely: osmo-stp_10.42.42.5(pid=3523) [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3523)] [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 21:49:03.744066 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 21:49:03.771705 run osmo-hlr_10.42.42.2(pid=3520): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3520)] 21:49:03.821218 run osmo-hlr_10.42.42.2(pid=3520): stdout: | (launched: 2022-12-13_21:49:00.537915) 21:49:03.872366 run osmo-hlr_10.42.42.2(pid=3520): stderr: | 20221213214900716 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214900716 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214900716 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214900716 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214900716 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214900717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214900729 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214900739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214900740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214900740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:03.944262 run osmo-msc_10.42.42.6(pid=3526): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3526)] 21:49:03.993627 run osmo-msc_10.42.42.6(pid=3526): stdout: | (launched: 2022-12-13_21:49:02.810275) 21:49:04.044766 run osmo-msc_10.42.42.6(pid=3526): stderr: | 20221213214903135 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214903135 DLGLOBAL DEBUG validating counter group 0x7f97b4052c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214903135 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214903135 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214903136 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214903136 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214903138 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214903138 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214903138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214903138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:04.096082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3519): Terminating (SIGTERM) 21:49:04.137257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3522): Terminating (SIGTERM) 21:49:04.178204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3525): Terminating (SIGTERM) 21:49:04.219407 --- ParallelTerminationStrategy: PID 3519 died... 21:49:04.239141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3519): Terminated: ok {rc=0} 21:49:04.284492 --- ParallelTerminationStrategy: PID 3522 died... 21:49:04.304081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3522): Terminated: ok {rc=0} 21:49:04.349872 --- ParallelTerminationStrategy: PID 3525 died... 21:49:04.369169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3525): Terminated: ok {rc=0} 21:49:04.455956 bus /sierra_3: Setting Powered False 21:49:05.554223 bus /sierra_3: Setting Powered False 21:49:06.668689 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:49:07.908587 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:49:07.916820 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:49:07.939159 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 21:49:07.966259 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:49:08.016867 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:49:08.038237 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 21:49:08.065221 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:49:08.618666 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 21:49:08.670777 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:08.682461 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:49:08.739061 tst mo_mt_call.py: using LAC 36444 21:49:08.866386 tst mo_mt_call.py: using RAC 234 21:49:08.990451 tst mo_mt_call.py: using CellId 36444 21:49:09.114972 tst mo_mt_call.py: using BVCI 36445 21:49:09.233092 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:09.244521 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:09.255760 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:09.267020 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:09.278331 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:09.289679 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:49:09.406161 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:49:09.525994 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:10.025950 run create_hlr_db(pid=3532): Launched 21:49:10.155946 bus /sierra_2: Setting Powered False 21:49:11.220557 run create_hlr_db(pid=3532): Terminated: ok {rc=0} 21:49:11.670561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3534): Launched 21:49:11.993522 run osmo-hlr_10.42.42.2(pid=3535): Launched 21:49:12.115441 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:12.668778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3537): Launched 21:49:12.990819 run osmo-stp_10.42.42.5(pid=3538): Launched 21:49:13.113368 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:13.699178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3540): Launched 21:49:14.021315 run osmo-msc_10.42.42.6(pid=3541): Launched 21:49:14.201225 run osmo-stp_10.42.42.5(pid=3538): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3538)] 21:49:14.336247 run osmo-stp_10.42.42.5(pid=3538): stdout: | (launched: 2022-12-13_21:49:12.931787) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:14.472429 run osmo-stp_10.42.42.5(pid=3538): stderr: | 20221213214913126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214913126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214913126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214913127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214913127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214913127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214913127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:14.607865 run osmo-stp_10.42.42.5(pid=3538): stdout: | (launched: 2022-12-13_21:49:12.931787) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:14.736542 run osmo-stp_10.42.42.5(pid=3538): stderr: | 20221213214913126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214913126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214913126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214913127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214913127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214913127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214913127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:14.890999 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3538): Process ended prematurely: osmo-stp_10.42.42.5(pid=3538) [trial-2395↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3538)] [trial-2395↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 21:49:14.900437 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:49:14.928077 run osmo-hlr_10.42.42.2(pid=3535): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3535)] 21:49:14.977704 run osmo-hlr_10.42.42.2(pid=3535): stdout: | (launched: 2022-12-13_21:49:11.934517) 21:49:15.029395 run osmo-hlr_10.42.42.2(pid=3535): stderr: | 20221213214912134 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214912134 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214912134 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214912134 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214912134 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214912134 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214912147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214912155 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214912155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214912155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:15.101606 run osmo-msc_10.42.42.6(pid=3541): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3541)] 21:49:15.151334 run osmo-msc_10.42.42.6(pid=3541): stdout: | (launched: 2022-12-13_21:49:13.962407) 21:49:15.202684 run osmo-msc_10.42.42.6(pid=3541): stderr: | 20221213214914291 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214914291 DLGLOBAL DEBUG validating counter group 0x7fb203702c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214914291 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214914291 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214914291 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214914291 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214914293 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214914293 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214914294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214914294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:15.254680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3534): Terminating (SIGTERM) 21:49:15.295750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3537): Terminating (SIGTERM) 21:49:15.337261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3540): Terminating (SIGTERM) 21:49:15.378974 --- ParallelTerminationStrategy: PID 3534 died... 21:49:15.399063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3534): Terminated: ok {rc=0} 21:49:15.444825 --- ParallelTerminationStrategy: PID 3537 died... 21:49:15.464856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3537): Terminated: ok {rc=0} 21:49:15.510825 --- ParallelTerminationStrategy: PID 3540 died... 21:49:15.530408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3540): Terminated: ok {rc=0} 21:49:15.618067 bus /sierra_3: Setting Powered False 21:49:16.713599 bus /sierra_3: Setting Powered False 21:49:17.832700 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 21:49:18.981365 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:18.993636 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:49:19.052649 tst mo_mt_call_osmux.py: using LAC 36445 21:49:19.181371 tst mo_mt_call_osmux.py: using RAC 235 21:49:19.307359 tst mo_mt_call_osmux.py: using CellId 36445 21:49:19.433316 tst mo_mt_call_osmux.py: using BVCI 36446 21:49:19.544662 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:19.555864 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:19.566933 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:19.577892 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:19.589330 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:49:19.600406 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:49:19.720539 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:49:19.837968 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:20.306635 run create_hlr_db(pid=3543): Launched 21:49:20.421490 bus /sierra_2: Setting Powered False 21:49:21.480820 run create_hlr_db(pid=3543): Terminated: ok {rc=0} 21:49:21.923908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3545): Launched 21:49:22.246447 run osmo-hlr_10.42.42.2(pid=3546): Launched 21:49:22.369781 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:22.925512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3548): Launched 21:49:23.245612 run osmo-stp_10.42.42.5(pid=3549): Launched 21:49:23.367652 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:23.951421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3551): Launched 21:49:24.273528 run osmo-msc_10.42.42.6(pid=3552): Launched 21:49:24.453248 run osmo-stp_10.42.42.5(pid=3549): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3549)] 21:49:24.588729 run osmo-stp_10.42.42.5(pid=3549): stdout: | (launched: 2022-12-13_21:49:23.186962) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:24.724641 run osmo-stp_10.42.42.5(pid=3549): stderr: | 20221213214923379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214923380 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214923380 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214923380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214923381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214923381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214923381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:24.860108 run osmo-stp_10.42.42.5(pid=3549): stdout: | (launched: 2022-12-13_21:49:23.186962) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:24.988270 run osmo-stp_10.42.42.5(pid=3549): stderr: | 20221213214923379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214923380 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214923380 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214923380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214923381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214923381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214923381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:25.141318 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3549): Process ended prematurely: osmo-stp_10.42.42.5(pid=3549) [trial-2395↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3549)] [trial-2395↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:49:25.150601 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 21:49:25.177980 run osmo-hlr_10.42.42.2(pid=3546): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3546)] 21:49:25.227805 run osmo-hlr_10.42.42.2(pid=3546): stdout: | (launched: 2022-12-13_21:49:22.187257) 21:49:25.279003 run osmo-hlr_10.42.42.2(pid=3546): stderr: | 20221213214922387 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214922387 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214922387 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214922387 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214922387 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214922387 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214922399 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214922407 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214922408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214922408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:25.350315 run osmo-msc_10.42.42.6(pid=3552): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3552)] 21:49:25.399733 run osmo-msc_10.42.42.6(pid=3552): stdout: | (launched: 2022-12-13_21:49:24.214368) 21:49:25.451137 run osmo-msc_10.42.42.6(pid=3552): stderr: | 20221213214924539 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214924539 DLGLOBAL DEBUG validating counter group 0x7f29aecbec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214924540 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214924540 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214924540 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214924540 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214924542 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214924542 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214924542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214924542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:25.502694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3545): Terminating (SIGTERM) 21:49:25.543644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3548): Terminating (SIGTERM) 21:49:25.584842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3551): Terminating (SIGTERM) 21:49:25.626863 --- ParallelTerminationStrategy: PID 3545 died... 21:49:25.646724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3545): Terminated: ok {rc=0} 21:49:25.692437 --- ParallelTerminationStrategy: PID 3548 died... 21:49:25.711845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3548): Terminated: ok {rc=0} 21:49:25.757424 --- ParallelTerminationStrategy: PID 3551 died... 21:49:25.776767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3551): Terminated: ok {rc=0} 21:49:25.863655 bus /sierra_3: Setting Powered False 21:49:26.961029 bus /sierra_3: Setting Powered False 21:49:28.075994 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:49:29.308111 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:49:29.313510 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:49:29.333781 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 21:49:29.365053 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 21:49:29.418212 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:49:29.438714 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 21:49:29.465250 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 21:49:30.018476 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 21:49:30.070649 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:30.082367 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:49:30.139930 tst mo_mt_call.py: using LAC 36446 21:49:30.268255 tst mo_mt_call.py: using RAC 236 21:49:30.399422 tst mo_mt_call.py: using CellId 36446 21:49:30.524878 tst mo_mt_call.py: using BVCI 36447 21:49:30.641230 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:30.652366 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:30.663549 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:30.674584 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:30.685650 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:30.696646 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:49:30.816008 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:49:30.954839 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:31.504456 run create_hlr_db(pid=3557): Launched 21:49:31.667994 bus /sierra_2: Setting Powered False 21:49:32.732174 run create_hlr_db(pid=3557): Terminated: ok {rc=0} 21:49:33.182932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3559): Launched 21:49:33.504735 run osmo-hlr_10.42.42.2(pid=3560): Launched 21:49:33.628126 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:34.186096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3562): Launched 21:49:34.509531 run osmo-stp_10.42.42.5(pid=3563): Launched 21:49:34.634176 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:35.220899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3565): Launched 21:49:35.543277 run osmo-msc_10.42.42.6(pid=3566): Launched 21:49:35.723519 run osmo-stp_10.42.42.5(pid=3563): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3563)] 21:49:35.860296 run osmo-stp_10.42.42.5(pid=3563): stdout: | (launched: 2022-12-13_21:49:34.450100) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:35.996387 run osmo-stp_10.42.42.5(pid=3563): stderr: | 20221213214934645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214934645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214934645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214934646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214934646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214934646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214934646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:36.132482 run osmo-stp_10.42.42.5(pid=3563): stdout: | (launched: 2022-12-13_21:49:34.450100) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:36.261313 run osmo-stp_10.42.42.5(pid=3563): stderr: | 20221213214934645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214934645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214934645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214934646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214934646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214934646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214934646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:36.415305 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3563): Process ended prematurely: osmo-stp_10.42.42.5(pid=3563) [trial-2395↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3563)] [trial-2395↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 21:49:36.424607 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:49:36.452094 run osmo-hlr_10.42.42.2(pid=3560): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3560)] 21:49:36.501672 run osmo-hlr_10.42.42.2(pid=3560): stdout: | (launched: 2022-12-13_21:49:33.445956) 21:49:36.553106 run osmo-hlr_10.42.42.2(pid=3560): stderr: | 20221213214933645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214933645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214933645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214933645 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214933645 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214933645 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214933657 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214933666 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214933666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214933666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:36.624302 run osmo-msc_10.42.42.6(pid=3566): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3566)] 21:49:36.674065 run osmo-msc_10.42.42.6(pid=3566): stdout: | (launched: 2022-12-13_21:49:35.484220) 21:49:36.725588 run osmo-msc_10.42.42.6(pid=3566): stderr: | 20221213214935807 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214935807 DLGLOBAL DEBUG validating counter group 0x7f2d63a28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214935807 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214935807 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214935808 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214935808 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214935809 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214935810 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214935810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214935810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:36.776920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3559): Terminating (SIGTERM) 21:49:36.818514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3562): Terminating (SIGTERM) 21:49:36.859966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3565): Terminating (SIGTERM) 21:49:36.901569 --- ParallelTerminationStrategy: PID 3559 died... 21:49:36.921508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3559): Terminated: ok {rc=0} 21:49:36.967364 --- ParallelTerminationStrategy: PID 3562 died... 21:49:36.986696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3562): Terminated: ok {rc=0} 21:49:37.032461 --- ParallelTerminationStrategy: PID 3565 died... 21:49:37.051802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3565): Terminated: ok {rc=0} 21:49:37.138282 bus /sierra_3: Setting Powered False 21:49:38.236560 bus /sierra_3: Setting Powered False 21:49:39.351805 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 21:49:40.497934 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:40.509361 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:49:40.565992 tst mo_mt_call_osmux.py: using LAC 36447 21:49:40.683868 tst mo_mt_call_osmux.py: using RAC 237 21:49:40.803392 tst mo_mt_call_osmux.py: using CellId 36447 21:49:40.921196 tst mo_mt_call_osmux.py: using BVCI 36448 21:49:41.031337 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:41.042328 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:41.052873 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:41.063468 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:41.074047 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:49:41.085645 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:49:41.201125 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:49:41.320363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:41.822885 run create_hlr_db(pid=3568): Launched 21:49:41.953944 bus /sierra_2: Setting Powered False 21:49:43.018036 run create_hlr_db(pid=3568): Terminated: ok {rc=0} 21:49:43.467663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3570): Launched 21:49:43.789956 run osmo-hlr_10.42.42.2(pid=3571): Launched 21:49:43.913401 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:44.471704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3573): Launched 21:49:44.794543 run osmo-stp_10.42.42.5(pid=3574): Launched 21:49:44.920498 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:45.506644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3576): Launched 21:49:45.833592 run osmo-msc_10.42.42.6(pid=3577): Launched 21:49:46.246171 run osmo-stp_10.42.42.5(pid=3574): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3574)] 21:49:46.459883 run osmo-stp_10.42.42.5(pid=3574): stdout: | (launched: 2022-12-13_21:49:44.735319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:46.597477 run osmo-stp_10.42.42.5(pid=3574): stderr: | 20221213214944929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214944929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214944929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214944929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214944930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214944930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214944930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:46.734349 run osmo-stp_10.42.42.5(pid=3574): stdout: | (launched: 2022-12-13_21:49:44.735319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:46.866748 run osmo-stp_10.42.42.5(pid=3574): stderr: | 20221213214944929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214944929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214944929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214944929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214944930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214944930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214944930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:47.024199 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3574): Process ended prematurely: osmo-stp_10.42.42.5(pid=3574) [trial-2395↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3574)] [trial-2395↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 21:49:47.034905 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 21:49:47.063628 run osmo-hlr_10.42.42.2(pid=3571): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3571)] 21:49:47.115049 run osmo-hlr_10.42.42.2(pid=3571): stdout: | (launched: 2022-12-13_21:49:43.730721) 21:49:47.167786 run osmo-hlr_10.42.42.2(pid=3571): stderr: | 20221213214943931 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214943931 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214943931 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214943931 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214943931 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214943931 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214943944 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214943953 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214943953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214943953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:47.241215 run osmo-msc_10.42.42.6(pid=3577): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3577)] 21:49:47.291025 run osmo-msc_10.42.42.6(pid=3577): stdout: | (launched: 2022-12-13_21:49:45.770716) 21:49:47.342583 run osmo-msc_10.42.42.6(pid=3577): stderr: | 20221213214946163 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214946163 DLGLOBAL DEBUG validating counter group 0x7f233d35ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214946163 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214946163 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214946164 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214946164 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214946166 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214946166 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214946166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214946166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:47.394593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3570): Terminating (SIGTERM) 21:49:47.436288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3573): Terminating (SIGTERM) 21:49:47.478008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3576): Terminating (SIGTERM) 21:49:47.520359 --- ParallelTerminationStrategy: PID 3570 died... 21:49:47.540413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3570): Terminated: ok {rc=0} 21:49:47.586912 --- ParallelTerminationStrategy: PID 3573 died... 21:49:47.606479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3573): Terminated: ok {rc=0} 21:49:47.652849 --- ParallelTerminationStrategy: PID 3576 died... 21:49:47.672337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3576): Terminated: ok {rc=0} 21:49:47.759861 bus /sierra_3: Setting Powered False 21:49:48.854450 bus /sierra_3: Setting Powered False 21:49:49.970056 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 emergency:sysmo --------------------------------------------------------------------- 21:49:51.202669 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:49:51.206744 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 21:49:51.226988 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 21:49:51.254461 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 21:49:51.340088 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 21:49:51.362399 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 21:49:51.389688 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 21:49:51.965743 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2395 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 21:49:51.971585 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:51.982697 tst emergency:sysmo: Using 1 x bts (candidates: 1) 21:49:52.018507 tst emergency_mo_mt_call.py: using LAC 36448 21:49:52.143810 tst emergency_mo_mt_call.py: using RAC 238 21:49:52.268851 tst emergency_mo_mt_call.py: using CellId 36448 21:49:52.393290 tst emergency_mo_mt_call.py: using BVCI 36449 21:49:52.507799 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:52.518785 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:52.529619 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:52.540328 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:52.551099 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:49:52.562603 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:49:52.678913 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:49:52.794446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:49:53.253651 run create_hlr_db(pid=3582): Launched 21:49:53.366808 bus /sierra_2: Setting Powered False 21:49:54.425984 run create_hlr_db(pid=3582): Terminated: ok {rc=0} 21:49:54.839688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3584): Launched 21:49:55.135813 run osmo-hlr_10.42.42.2(pid=3585): Launched 21:49:55.248746 run osmo-stp_10.42.42.5: Starting osmo-stp 21:49:55.757040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3587): Launched 21:49:56.052779 run osmo-stp_10.42.42.5(pid=3588): Launched 21:49:56.176224 tst emergency_mo_mt_call.py: using MSISDN 8350 21:49:56.329633 run osmo-msc_10.42.42.6: Starting osmo-msc 21:49:56.860850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3590): Launched 21:49:57.155946 run osmo-msc_10.42.42.6(pid=3591): Launched 21:49:57.321213 run osmo-stp_10.42.42.5(pid=3588): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3588)] 21:49:57.446335 run osmo-stp_10.42.42.5(pid=3588): stdout: | (launched: 2022-12-13_21:49:55.998120) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:57.573266 run osmo-stp_10.42.42.5(pid=3588): stderr: | 20221213214956168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214956169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214956169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214956169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214956172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214956172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214956172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:57.696604 run osmo-stp_10.42.42.5(pid=3588): stdout: | (launched: 2022-12-13_21:49:55.998120) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:49:57.815061 run osmo-stp_10.42.42.5(pid=3588): stderr: | 20221213214956168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213214956169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213214956169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213214956169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213214956172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213214956172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213214956172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:49:57.955588 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=3588): Process ended prematurely: osmo-stp_10.42.42.5(pid=3588) [trial-2395↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3588)] [trial-2395↪emergency:sysmo↪emergency_mo_mt_call.py:19] 21:49:57.963769 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 21:49:57.989418 run osmo-hlr_10.42.42.2(pid=3585): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3585)] 21:49:58.036912 run osmo-hlr_10.42.42.2(pid=3585): stdout: | (launched: 2022-12-13_21:49:55.080930) 21:49:58.086002 run osmo-hlr_10.42.42.2(pid=3585): stderr: | 20221213214955254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213214955254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213214955254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213214955254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213214955254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213214955255 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213214955266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213214955275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213214955275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213214955275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:49:58.154683 run osmo-msc_10.42.42.6(pid=3591): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3591)] 21:49:58.201869 run osmo-msc_10.42.42.6(pid=3591): stdout: | (launched: 2022-12-13_21:49:57.101170) 21:49:58.250695 run osmo-msc_10.42.42.6(pid=3591): stderr: | 20221213214957373 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213214957373 DLGLOBAL DEBUG validating counter group 0x7f0087218c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213214957373 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213214957373 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213214957373 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213214957374 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213214957375 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213214957376 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213214957376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213214957376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:49:58.300110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3584): Terminating (SIGTERM) 21:49:58.339670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3587): Terminating (SIGTERM) 21:49:58.379232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3590): Terminating (SIGTERM) 21:49:58.419071 --- ParallelTerminationStrategy: PID 3584 died... 21:49:58.438222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3584): Terminated: ok {rc=0} 21:49:58.482059 --- ParallelTerminationStrategy: PID 3587 died... 21:49:58.500825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3587): Terminated: ok {rc=0} 21:49:58.544478 --- ParallelTerminationStrategy: PID 3590 died... 21:49:58.563659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3590): Terminated: ok {rc=0} 21:49:58.647548 bus /sierra_3: Setting Powered False 21:49:59.745121 bus /sierra_3: Setting Powered False 21:50:00.871658 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 21:50:01.982130 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:50:02.001905 tst emergency:sysmo: Using 1 x bts (candidates: 1) 21:50:02.046801 tst emergency_preemptive_call.py: using LAC 36449 21:50:02.200864 tst emergency_preemptive_call.py: using RAC 239 21:50:02.342186 tst emergency_preemptive_call.py: using CellId 36449 21:50:02.471055 tst emergency_preemptive_call.py: using BVCI 36450 21:50:02.590280 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:50:02.601910 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:50:02.613321 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:50:02.624671 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:50:02.636257 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 21:50:02.647722 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:50:02.766064 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:50:02.883166 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:50:02.999049 tst emergency:sysmo: Using 1 x modem (candidates: 4) 21:50:03.115931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:03.606910 run create_hlr_db(pid=3603): Launched 21:50:03.735329 bus /sierra_2: Setting Powered False 21:50:04.798106 run create_hlr_db(pid=3603): Terminated: ok {rc=0} 21:50:05.240915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3605): Launched 21:50:05.559259 run osmo-hlr_10.42.42.2(pid=3606): Launched 21:50:05.680268 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:06.227448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3608): Launched 21:50:06.544849 run osmo-stp_10.42.42.5(pid=3609): Launched 21:50:06.675938 tst emergency_preemptive_call.py: using MSISDN 8351 21:50:06.838428 run osmo-msc_10.42.42.6: Starting osmo-msc 21:50:07.406845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3611): Launched 21:50:07.723932 run osmo-msc_10.42.42.6(pid=3612): Launched 21:50:07.907617 run osmo-stp_10.42.42.5(pid=3609): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3609)] 21:50:08.041055 run osmo-stp_10.42.42.5(pid=3609): stdout: | (launched: 2022-12-13_21:50:06.486242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:08.174887 run osmo-stp_10.42.42.5(pid=3609): stderr: | 20221213215006679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215006679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215006679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215006680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215006680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215006680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215006680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:08.308684 run osmo-stp_10.42.42.5(pid=3609): stdout: | (launched: 2022-12-13_21:50:06.486242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:08.435222 run osmo-stp_10.42.42.5(pid=3609): stderr: | 20221213215006679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215006679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215006679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215006680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215006680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215006680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215006680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:08.586397 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=3609): Process ended prematurely: osmo-stp_10.42.42.5(pid=3609) [trial-2395↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3609)] [trial-2395↪emergency:sysmo↪emergency_preemptive_call.py:32] 21:50:08.595215 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 21:50:08.622341 run osmo-hlr_10.42.42.2(pid=3606): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3606)] 21:50:08.672509 run osmo-hlr_10.42.42.2(pid=3606): stdout: | (launched: 2022-12-13_21:50:05.500526) 21:50:08.724304 run osmo-hlr_10.42.42.2(pid=3606): stderr: | 20221213215005700 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215005700 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215005701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215005701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215005701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215005701 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215005713 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215005722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215005722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215005722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:08.796298 run osmo-msc_10.42.42.6(pid=3612): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3612)] 21:50:08.845968 run osmo-msc_10.42.42.6(pid=3612): stdout: | (launched: 2022-12-13_21:50:07.665179) 21:50:08.897458 run osmo-msc_10.42.42.6(pid=3612): stderr: | 20221213215007992 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215007992 DLGLOBAL DEBUG validating counter group 0x7f276c277c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215007992 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215007992 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215007992 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215007992 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215007996 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215007997 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215007997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215007997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:50:08.949182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3605): Terminating (SIGTERM) 21:50:08.990522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3608): Terminating (SIGTERM) 21:50:09.031945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3611): Terminating (SIGTERM) 21:50:09.074012 --- ParallelTerminationStrategy: PID 3605 died... 21:50:09.093821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3605): Terminated: ok {rc=0} 21:50:09.140341 --- ParallelTerminationStrategy: PID 3608 died... 21:50:09.160000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3608): Terminated: ok {rc=0} 21:50:09.205734 --- ParallelTerminationStrategy: PID 3611 died... 21:50:09.225447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3611): Terminated: ok {rc=0} 21:50:09.312873 bus /sierra_9: Setting Powered False 21:50:10.411970 bus /sierra_9: Setting Powered False 21:50:11.525122 bus /sierra_8: Setting Powered False 21:50:12.622350 bus /sierra_8: Setting Powered False 21:50:13.741723 bus /sierra_3: Setting Powered False 21:50:14.850063 bus /sierra_3: Setting Powered False 21:50:15.971027 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:sysmo --------------------------------------------------------------------- 21:50:17.273295 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:50:17.279174 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 21:50:17.301952 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 21:50:17.341393 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 21:50:17.429081 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 21:50:17.450465 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 21:50:17.489622 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 21:50:18.081404 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 21:50:18.134578 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:18.145620 tst gprs:sysmo: Using 1 x bts (candidates: 1) 21:50:18.185120 tst cs_paging_gprs_active.py: using LAC 36450 21:50:18.313687 tst cs_paging_gprs_active.py: using RAC 240 21:50:18.438254 tst cs_paging_gprs_active.py: using CellId 36450 21:50:18.564586 tst cs_paging_gprs_active.py: using BVCI 36451 21:50:18.682578 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:18.693695 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:18.704376 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:18.715064 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:18.725739 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:18.736884 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:18.748074 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:18.759102 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:18.770110 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:18.886784 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:19.007259 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:50:19.226405 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:19.551970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3968): Launched 21:50:19.834241 run iperf3-srv_10.42.42.10(pid=3969): Launched 21:50:19.955810 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:50:20.174216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:20.499603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3970): Launched 21:50:20.781302 run iperf3-srv_10.42.42.10(pid=3971): Launched 21:50:20.902195 tst cs_paging_gprs_active.py:38: start network... 21:50:21.120621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:21.622242 run create_hlr_db(pid=3972): Launched 21:50:21.753222 bus /sierra_2: Setting Powered False 21:50:22.817833 run create_hlr_db(pid=3972): Terminated: ok {rc=0} 21:50:23.250747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3974): Launched 21:50:23.575064 run osmo-hlr_10.42.42.2(pid=3983): Launched 21:50:23.841196 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:24.477789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4151): Launched 21:50:24.817451 run osmo-stp_10.42.42.5(pid=4153): Launched 21:50:25.066368 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:50:26.745651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4155): Launched 21:50:26.869401 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:50:27.145771 run patchelf(pid=4156): Launched 21:50:27.340270 run osmo-stp_10.42.42.5(pid=4153): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4153)] 21:50:27.471641 run osmo-stp_10.42.42.5(pid=4153): stdout: | (launched: 2022-12-13_21:50:24.750526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:27.607072 run osmo-stp_10.42.42.5(pid=4153): stderr: | 20221213215025048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215025048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215025048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215025049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215025051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215025051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215025051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:27.739847 run osmo-stp_10.42.42.5(pid=4153): stdout: | (launched: 2022-12-13_21:50:24.750526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:27.867427 run osmo-stp_10.42.42.5(pid=4153): stderr: | 20221213215025048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215025048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215025048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215025049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215025051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215025051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215025051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:28.019066 run patchelf(pid=4156): Terminating (SIGINT) 21:50:28.193544 run patchelf(pid=4156): Terminated: ok {rc=0} 21:50:28.318972 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4153): Process ended prematurely: osmo-stp_10.42.42.5(pid=4153) [trial-2395↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4153)] [trial-2395↪gprs:sysmo↪cs_paging_gprs_active.py:38] 21:50:28.329559 tst cs_paging_gprs_active.py:38: Test FAILED (10.2 sec) 21:50:28.358381 run osmo-hlr_10.42.42.2(pid=3983): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3983)] 21:50:28.409337 run osmo-hlr_10.42.42.2(pid=3983): stdout: | (launched: 2022-12-13_21:50:23.508396) 21:50:28.461291 run osmo-hlr_10.42.42.2(pid=3983): stderr: | 20221213215023830 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215023830 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215023830 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215023830 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215023830 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215023830 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215023850 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215023866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215023867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215023867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:28.514157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3968): Terminating (SIGTERM) 21:50:28.557637 run iperf3-srv_10.42.42.10(pid=3969): Terminating (SIGTERM) 21:50:28.603733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3970): Terminating (SIGTERM) 21:50:28.647093 run iperf3-srv_10.42.42.10(pid=3971): Terminating (SIGTERM) 21:50:28.692461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3974): Terminating (SIGTERM) 21:50:28.735823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4151): Terminating (SIGTERM) 21:50:28.780546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4155): Terminating (SIGTERM) 21:50:28.824537 --- ParallelTerminationStrategy: PID 3968 died... 21:50:28.850765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3968): Terminated: ok {rc=0} 21:50:28.899187 --- ParallelTerminationStrategy: PID 3969 died... 21:50:28.920337 run iperf3-srv_10.42.42.10(pid=3969): Terminated {rc=256} 21:50:28.967362 --- ParallelTerminationStrategy: PID 3970 died... 21:50:28.988402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3970): Terminated: ok {rc=0} 21:50:29.035973 --- ParallelTerminationStrategy: PID 3971 died... 21:50:29.057458 run iperf3-srv_10.42.42.10(pid=3971): Terminated {rc=256} 21:50:29.105241 --- ParallelTerminationStrategy: PID 3974 died... 21:50:29.126828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3974): Terminated: ok {rc=0} 21:50:29.174935 --- ParallelTerminationStrategy: PID 4151 died... 21:50:29.196154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4151): Terminated: ok {rc=0} 21:50:29.243124 --- ParallelTerminationStrategy: PID 4155 died... 21:50:29.264189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4155): Terminated: ok {rc=0} 21:50:29.353139 bus /gobi_0: Setting Powered False 21:50:30.452020 bus /gobi_0: Setting Powered False 21:50:31.566025 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:sysmo iperf3.py ---------------------------------------------- 21:50:32.719456 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:32.730896 tst gprs:sysmo: Using 1 x bts (candidates: 1) 21:50:32.771658 tst iperf3.py: using LAC 36451 21:50:32.897845 tst iperf3.py: using RAC 241 21:50:33.022559 tst iperf3.py: using CellId 36451 21:50:33.149360 tst iperf3.py: using BVCI 36452 21:50:33.266670 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:33.277621 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:33.288403 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:33.299145 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:33.309804 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:33.320785 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:33.332149 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:33.343467 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:33.354783 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:33.474066 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:50:33.693012 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:34.019020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4158): Launched 21:50:34.300748 run iperf3-srv_10.42.42.10(pid=4159): Launched 21:50:34.421545 tst iperf3.py:8: start network... 21:50:34.638899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:35.139863 run create_hlr_db(pid=4160): Launched 21:50:35.269687 bus /gobi_6: Setting Powered False 21:50:36.333392 run create_hlr_db(pid=4160): Terminated: ok {rc=0} 21:50:36.765236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4162): Launched 21:50:37.067098 run osmo-hlr_10.42.42.2(pid=4163): Launched 21:50:37.182160 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:37.701808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4165): Launched 21:50:38.002588 run osmo-stp_10.42.42.5(pid=4166): Launched 21:50:38.117807 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:50:38.651156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4168): Launched 21:50:38.767065 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:50:39.022324 run patchelf(pid=4169): Launched 21:50:39.189905 run osmo-stp_10.42.42.5(pid=4166): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4166)] 21:50:39.317936 run osmo-stp_10.42.42.5(pid=4166): stdout: | (launched: 2022-12-13_21:50:37.946342) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:39.448152 run osmo-stp_10.42.42.5(pid=4166): stderr: | 20221213215038117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215038117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215038118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215038118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215038120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215038120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215038120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:39.577962 run osmo-stp_10.42.42.5(pid=4166): stdout: | (launched: 2022-12-13_21:50:37.946342) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:39.701633 run osmo-stp_10.42.42.5(pid=4166): stderr: | 20221213215038117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215038117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215038118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215038118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215038120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215038120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215038120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:39.848479 run patchelf(pid=4169): Terminating (SIGINT) 21:50:40.017950 run patchelf(pid=4169): Terminated: ok {rc=0} 21:50:40.141159 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4166): Process ended prematurely: osmo-stp_10.42.42.5(pid=4166) [trial-2395↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4166)] [trial-2395↪gprs:sysmo↪iperf3.py:8] 21:50:40.150550 tst iperf3.py:8: Test FAILED (7.5 sec) 21:50:40.177457 run osmo-hlr_10.42.42.2(pid=4163): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4163)] 21:50:40.225884 run osmo-hlr_10.42.42.2(pid=4163): stdout: | (launched: 2022-12-13_21:50:37.011328) 21:50:40.275288 run osmo-hlr_10.42.42.2(pid=4163): stderr: | 20221213215037187 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215037187 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215037187 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215037187 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215037187 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215037187 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215037199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215037207 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215037208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215037208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:40.325348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4158): Terminating (SIGTERM) 21:50:40.365609 run iperf3-srv_10.42.42.10(pid=4159): Terminating (SIGTERM) 21:50:40.405485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4162): Terminating (SIGTERM) 21:50:40.445556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4165): Terminating (SIGTERM) 21:50:40.485410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4168): Terminating (SIGTERM) 21:50:40.525577 --- ParallelTerminationStrategy: PID 4158 died... 21:50:40.544938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4158): Terminated: ok {rc=0} 21:50:40.589382 --- ParallelTerminationStrategy: PID 4159 died... 21:50:40.608319 run iperf3-srv_10.42.42.10(pid=4159): Terminated {rc=256} 21:50:40.652399 --- ParallelTerminationStrategy: PID 4162 died... 21:50:40.671333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4162): Terminated: ok {rc=0} 21:50:40.715381 --- ParallelTerminationStrategy: PID 4165 died... 21:50:40.734253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4165): Terminated: ok {rc=0} 21:50:40.778203 --- ParallelTerminationStrategy: PID 4168 died... 21:50:40.797087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4168): Terminated: ok {rc=0} 21:50:40.880875 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:sysmo iperf3m4.py ---------------------------------------------- 21:50:42.024345 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:42.035441 tst gprs:sysmo: Using 1 x bts (candidates: 1) 21:50:42.071316 tst iperf3m4.py: using LAC 36452 21:50:42.193207 tst iperf3m4.py: using RAC 242 21:50:42.321571 tst iperf3m4.py: using CellId 36452 21:50:42.442680 tst iperf3m4.py: using BVCI 36453 21:50:42.554559 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:42.565026 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:42.575372 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:42.585756 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:42.595795 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:42.606667 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:42.618442 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:42.629590 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:50:42.640764 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:42.758262 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:42.880822 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:43.000617 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:50:43.117478 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:50:43.320350 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:43.624070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4170): Launched 21:50:43.888247 run iperf3-srv_10.42.42.10(pid=4171): Launched 21:50:44.001540 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:50:44.203324 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:44.506681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4172): Launched 21:50:44.770159 run iperf3-srv_10.42.42.10(pid=4173): Launched 21:50:44.883080 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:50:45.085195 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:45.388624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4174): Launched 21:50:45.653100 run iperf3-srv_10.42.42.10(pid=4175): Launched 21:50:45.766382 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:50:45.974805 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:50:46.312248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4177): Launched 21:50:46.636869 run iperf3-srv_10.42.42.10(pid=4178): Launched 21:50:46.816512 tst iperf3m4.py:8: start network... 21:50:47.022500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:50:47.499554 run create_hlr_db(pid=4179): Launched 21:50:47.615337 bus /gobi_6: Setting Powered False 21:50:48.675573 run create_hlr_db(pid=4179): Terminated: ok {rc=0} 21:50:49.119511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4181): Launched 21:50:49.445176 run osmo-hlr_10.42.42.2(pid=4182): Launched 21:50:49.569178 run osmo-stp_10.42.42.5: Starting osmo-stp 21:50:50.128336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4184): Launched 21:50:50.451460 run osmo-stp_10.42.42.5(pid=4185): Launched 21:50:50.574469 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:50:51.132458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4187): Launched 21:50:51.255695 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:50:51.530094 run patchelf(pid=4188): Launched 21:50:51.709758 run osmo-stp_10.42.42.5(pid=4185): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4185)] 21:50:51.847085 run osmo-stp_10.42.42.5(pid=4185): stdout: | (launched: 2022-12-13_21:50:50.392173) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:51.987566 run osmo-stp_10.42.42.5(pid=4185): stderr: | 20221213215050585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215050585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215050585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215050585 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215050586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215050586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215050586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:52.126049 run osmo-stp_10.42.42.5(pid=4185): stdout: | (launched: 2022-12-13_21:50:50.392173) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:50:52.259166 run osmo-stp_10.42.42.5(pid=4185): stderr: | 20221213215050585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215050585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215050585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215050585 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215050586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215050586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215050586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:50:52.416102 run patchelf(pid=4188): Terminating (SIGINT) 21:50:52.596596 run patchelf(pid=4188): Terminated: ok {rc=0} 21:50:52.727480 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4185): Process ended prematurely: osmo-stp_10.42.42.5(pid=4185) [trial-2395↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4185)] [trial-2395↪gprs:sysmo↪iperf3m4.py:8] 21:50:52.737527 tst iperf3m4.py:8: Test FAILED (10.8 sec) 21:50:52.766049 run osmo-hlr_10.42.42.2(pid=4182): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4182)] 21:50:52.815996 run osmo-hlr_10.42.42.2(pid=4182): stdout: | (launched: 2022-12-13_21:50:49.385700) 21:50:52.868000 run osmo-hlr_10.42.42.2(pid=4182): stderr: | 20221213215049587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215049587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215049587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215049587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215049587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215049587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215049599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215049608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215049608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215049608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:50:52.920011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4170): Terminating (SIGTERM) 21:50:52.961427 run iperf3-srv_10.42.42.10(pid=4171): Terminating (SIGTERM) 21:50:53.002899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4172): Terminating (SIGTERM) 21:50:53.044314 run iperf3-srv_10.42.42.10(pid=4173): Terminating (SIGTERM) 21:50:53.085763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4174): Terminating (SIGTERM) 21:50:53.127293 run iperf3-srv_10.42.42.10(pid=4175): Terminating (SIGTERM) 21:50:53.168445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4177): Terminating (SIGTERM) 21:50:53.209879 run iperf3-srv_10.42.42.10(pid=4178): Terminating (SIGTERM) 21:50:53.250993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4181): Terminating (SIGTERM) 21:50:53.292375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4184): Terminating (SIGTERM) 21:50:53.333835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4187): Terminating (SIGTERM) 21:50:53.375386 --- ParallelTerminationStrategy: PID 4170 died... 21:50:53.395457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4170): Terminated: ok {rc=0} 21:50:53.441451 --- ParallelTerminationStrategy: PID 4171 died... 21:50:53.460827 run iperf3-srv_10.42.42.10(pid=4171): Terminated {rc=256} 21:50:53.506441 --- ParallelTerminationStrategy: PID 4172 died... 21:50:53.525938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4172): Terminated: ok {rc=0} 21:50:53.571651 --- ParallelTerminationStrategy: PID 4173 died... 21:50:53.591176 run iperf3-srv_10.42.42.10(pid=4173): Terminated {rc=256} 21:50:53.637074 --- ParallelTerminationStrategy: PID 4174 died... 21:50:53.656457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4174): Terminated: ok {rc=0} 21:50:53.702435 --- ParallelTerminationStrategy: PID 4175 died... 21:50:53.721894 run iperf3-srv_10.42.42.10(pid=4175): Terminated {rc=256} 21:50:53.767545 --- ParallelTerminationStrategy: PID 4177 died... 21:50:53.787094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4177): Terminated: ok {rc=0} 21:50:53.833273 --- ParallelTerminationStrategy: PID 4178 died... 21:50:53.852670 run iperf3-srv_10.42.42.10(pid=4178): Terminated {rc=256} 21:50:53.898583 --- ParallelTerminationStrategy: PID 4181 died... 21:50:53.918082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4181): Terminated: ok {rc=0} 21:50:53.963878 --- ParallelTerminationStrategy: PID 4184 died... 21:50:53.983372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4184): Terminated: ok {rc=0} 21:50:54.029288 --- ParallelTerminationStrategy: PID 4187 died... 21:50:54.048612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4187): Terminated: ok {rc=0} 21:50:54.136765 bus /gobi_4: Setting Powered False 21:50:55.236121 bus /gobi_4: Setting Powered False 21:50:56.351354 bus /gobi_1: Setting Powered False 21:50:57.446209 bus /gobi_1: Setting Powered False 21:50:58.561441 bus /gobi_0: Setting Powered False 21:50:59.658795 bus /gobi_0: Setting Powered False 21:51:00.773399 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:sysmo ping.py ---------------------------------------------- 21:51:01.876110 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:01.888569 tst gprs:sysmo: Using 1 x bts (candidates: 1) 21:51:01.927796 tst ping.py: using LAC 36453 21:51:02.048712 tst ping.py: using RAC 243 21:51:02.167307 tst ping.py: using CellId 36453 21:51:02.285404 tst ping.py: using BVCI 36454 21:51:02.398326 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:02.408907 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:02.419474 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:02.430120 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:02.440451 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:02.451741 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:02.465389 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:02.476075 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:51:02.595334 tst ping.py:19: start network... 21:51:02.794835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:03.256865 run create_hlr_db(pid=4192): Launched 21:51:03.371655 bus /gobi_6: Setting Powered False 21:51:04.432165 run create_hlr_db(pid=4192): Terminated: ok {rc=0} 21:51:04.848668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4194): Launched 21:51:05.146817 run osmo-hlr_10.42.42.2(pid=4195): Launched 21:51:05.259990 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:05.768784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4197): Launched 21:51:06.065478 run osmo-stp_10.42.42.5(pid=4198): Launched 21:51:06.178956 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:06.690719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4200): Launched 21:51:06.803358 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:07.054379 run patchelf(pid=4201): Launched 21:51:07.219056 run osmo-stp_10.42.42.5(pid=4198): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4198)] 21:51:07.344768 run osmo-stp_10.42.42.5(pid=4198): stdout: | (launched: 2022-12-13_21:51:06.009972) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:07.472404 run osmo-stp_10.42.42.5(pid=4198): stderr: | 20221213215106182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215106182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215106182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215106182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215106183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215106183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215106183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:07.599873 run osmo-stp_10.42.42.5(pid=4198): stdout: | (launched: 2022-12-13_21:51:06.009972) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:07.721661 run osmo-stp_10.42.42.5(pid=4198): stderr: | 20221213215106182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215106182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215106182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215106182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215106183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215106183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215106183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:07.866047 run patchelf(pid=4201): Terminating (SIGINT) 21:51:08.032089 run patchelf(pid=4201): Terminated: ok {rc=0} 21:51:08.151888 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4198): Process ended prematurely: osmo-stp_10.42.42.5(pid=4198) [trial-2395↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4198)] [trial-2395↪gprs:sysmo↪ping.py:22] 21:51:08.160732 tst ping.py:22: Test FAILED (6.3 sec) 21:51:08.187247 run osmo-hlr_10.42.42.2(pid=4195): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4195)] 21:51:08.235420 run osmo-hlr_10.42.42.2(pid=4195): stdout: | (launched: 2022-12-13_21:51:05.091357) 21:51:08.285177 run osmo-hlr_10.42.42.2(pid=4195): stderr: | 20221213215105268 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215105268 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215105268 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215105268 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215105268 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215105268 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215105322 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215105332 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215105332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215105332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:08.334908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4194): Terminating (SIGTERM) 21:51:08.374885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4197): Terminating (SIGTERM) 21:51:08.414985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4200): Terminating (SIGTERM) 21:51:08.455222 --- ParallelTerminationStrategy: PID 4194 died... 21:51:08.474728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4194): Terminated: ok {rc=0} 21:51:08.519021 --- ParallelTerminationStrategy: PID 4197 died... 21:51:08.537942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4197): Terminated: ok {rc=0} 21:51:08.581998 --- ParallelTerminationStrategy: PID 4200 died... 21:51:08.600881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4200): Terminated: ok {rc=0} 21:51:08.687322 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 21:51:09.776706 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:09.788363 tst gprs:sysmo: Using 1 x bts (candidates: 1) 21:51:09.828102 tst ping_idle_ping.py: using LAC 36454 21:51:09.946622 tst ping_idle_ping.py: using RAC 244 21:51:10.060915 tst ping_idle_ping.py: using CellId 36454 21:51:10.176225 tst ping_idle_ping.py: using BVCI 36455 21:51:10.283871 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:10.294395 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:10.304868 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:10.315126 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:10.325484 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:10.335838 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:10.346507 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 21:51:10.356931 tst gprs:sysmo: Using 1 x modem (candidates: 4) 21:51:10.482809 tst ping_idle_ping.py:24: start network... 21:51:10.697516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:11.191638 run create_hlr_db(pid=4202): Launched 21:51:11.320793 bus /gobi_6: Setting Powered False 21:51:12.384427 run create_hlr_db(pid=4202): Terminated: ok {rc=0} 21:51:12.811459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4204): Launched 21:51:13.109479 run osmo-hlr_10.42.42.2(pid=4205): Launched 21:51:13.223158 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:13.752032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4207): Launched 21:51:14.049324 run osmo-stp_10.42.42.5(pid=4208): Launched 21:51:14.163197 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:14.679583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4210): Launched 21:51:14.793520 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:15.046082 run patchelf(pid=4211): Launched 21:51:15.211610 run osmo-stp_10.42.42.5(pid=4208): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4208)] 21:51:15.337830 run osmo-stp_10.42.42.5(pid=4208): stdout: | (launched: 2022-12-13_21:51:13.994111) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:15.466010 run osmo-stp_10.42.42.5(pid=4208): stderr: | 20221213215114164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215114164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215114164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215114165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215114165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215114165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215114165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:15.594134 run osmo-stp_10.42.42.5(pid=4208): stdout: | (launched: 2022-12-13_21:51:13.994111) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:15.716621 run osmo-stp_10.42.42.5(pid=4208): stderr: | 20221213215114164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215114164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215114164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215114165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215114165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215114165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215114165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:15.863590 run patchelf(pid=4211): Terminating (SIGINT) 21:51:16.039905 run patchelf(pid=4211): Terminated: ok {rc=0} 21:51:16.163555 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4208): Process ended prematurely: osmo-stp_10.42.42.5(pid=4208) [trial-2395↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4208)] [trial-2395↪gprs:sysmo↪ping_idle_ping.py:27] 21:51:16.173515 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 21:51:16.201303 run osmo-hlr_10.42.42.2(pid=4205): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4205)] 21:51:16.252817 run osmo-hlr_10.42.42.2(pid=4205): stdout: | (launched: 2022-12-13_21:51:13.054235) 21:51:16.304560 run osmo-hlr_10.42.42.2(pid=4205): stderr: | 20221213215113231 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215113231 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215113231 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215113231 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215113231 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215113231 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215113247 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215113257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215113257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215113257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:16.357244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4204): Terminating (SIGTERM) 21:51:16.399459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4207): Terminating (SIGTERM) 21:51:16.442110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4210): Terminating (SIGTERM) 21:51:16.485399 --- ParallelTerminationStrategy: PID 4204 died... 21:51:16.507783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4204): Terminated: ok {rc=0} 21:51:16.555793 --- ParallelTerminationStrategy: PID 4207 died... 21:51:16.576635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4207): Terminated: ok {rc=0} 21:51:16.623606 --- ParallelTerminationStrategy: PID 4210 died... 21:51:16.644426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4210): Terminated: ok {rc=0} 21:51:16.731763 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 21:51:18.018541 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:51:18.023889 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:51:18.045255 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:51:18.085474 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:51:18.174195 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:51:18.195269 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:51:18.234577 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:51:18.828748 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:51:18.881749 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:18.892879 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:51:18.930603 tst cs_paging_gprs_active.py: using LAC 36455 21:51:19.058237 tst cs_paging_gprs_active.py: using RAC 245 21:51:19.184856 tst cs_paging_gprs_active.py: using CellId 36455 21:51:19.311317 tst cs_paging_gprs_active.py: using BVCI 36456 21:51:19.429154 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:19.440304 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:19.451227 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:19.462211 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:19.473066 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:19.484339 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:19.495427 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:19.506253 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:19.517313 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:19.639403 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:19.759977 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:51:19.980502 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:20.306929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4215): Launched 21:51:20.590981 run iperf3-srv_10.42.42.10(pid=4216): Launched 21:51:20.712380 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:51:20.932448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:21.258919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4217): Launched 21:51:21.541632 run iperf3-srv_10.42.42.10(pid=4218): Launched 21:51:21.662742 tst cs_paging_gprs_active.py:38: start network... 21:51:21.882881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:22.386603 run create_hlr_db(pid=4219): Launched 21:51:22.518337 bus /gobi_6: Setting Powered False 21:51:23.582653 run create_hlr_db(pid=4219): Terminated: ok {rc=0} 21:51:24.016921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4221): Launched 21:51:24.320694 run osmo-hlr_10.42.42.2(pid=4222): Launched 21:51:24.437886 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:24.974453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4224): Launched 21:51:25.278379 run osmo-stp_10.42.42.5(pid=4225): Launched 21:51:25.394324 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:25.918095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4227): Launched 21:51:26.034543 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:26.291748 run patchelf(pid=4228): Launched 21:51:26.461552 run osmo-stp_10.42.42.5(pid=4225): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4225)] 21:51:26.590149 run osmo-stp_10.42.42.5(pid=4225): stdout: | (launched: 2022-12-13_21:51:25.222460) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:26.720333 run osmo-stp_10.42.42.5(pid=4225): stderr: | 20221213215125392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215125392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215125392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215125393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215125393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215125393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215125394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:26.850892 run osmo-stp_10.42.42.5(pid=4225): stdout: | (launched: 2022-12-13_21:51:25.222460) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:26.975457 run osmo-stp_10.42.42.5(pid=4225): stderr: | 20221213215125392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215125392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215125392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215125393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215125393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215125393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215125394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:27.122874 run patchelf(pid=4228): Terminating (SIGINT) 21:51:27.292765 run patchelf(pid=4228): Terminated: ok {rc=0} 21:51:27.415015 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4225): Process ended prematurely: osmo-stp_10.42.42.5(pid=4225) [trial-2395↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4225)] [trial-2395↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:51:27.424356 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 21:51:27.451380 run osmo-hlr_10.42.42.2(pid=4222): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4222)] 21:51:27.499949 run osmo-hlr_10.42.42.2(pid=4222): stdout: | (launched: 2022-12-13_21:51:24.264570) 21:51:27.549649 run osmo-hlr_10.42.42.2(pid=4222): stderr: | 20221213215124444 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215124444 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215124444 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215124444 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215124444 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215124444 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215124462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215124472 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215124472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215124472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:27.599776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4215): Terminating (SIGTERM) 21:51:27.639959 run iperf3-srv_10.42.42.10(pid=4216): Terminating (SIGTERM) 21:51:27.679973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4217): Terminating (SIGTERM) 21:51:27.719991 run iperf3-srv_10.42.42.10(pid=4218): Terminating (SIGTERM) 21:51:27.759878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4221): Terminating (SIGTERM) 21:51:27.799900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4224): Terminating (SIGTERM) 21:51:27.839932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4227): Terminating (SIGTERM) 21:51:27.880451 --- ParallelTerminationStrategy: PID 4215 died... 21:51:27.900248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4215): Terminated: ok {rc=0} 21:51:27.945095 --- ParallelTerminationStrategy: PID 4216 died... 21:51:27.964124 run iperf3-srv_10.42.42.10(pid=4216): Terminated {rc=256} 21:51:28.007940 --- ParallelTerminationStrategy: PID 4217 died... 21:51:28.026884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4217): Terminated: ok {rc=0} 21:51:28.070772 --- ParallelTerminationStrategy: PID 4218 died... 21:51:28.089757 run iperf3-srv_10.42.42.10(pid=4218): Terminated {rc=256} 21:51:28.133857 --- ParallelTerminationStrategy: PID 4221 died... 21:51:28.152774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4221): Terminated: ok {rc=0} 21:51:28.196694 --- ParallelTerminationStrategy: PID 4224 died... 21:51:28.215814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4224): Terminated: ok {rc=0} 21:51:28.260084 --- ParallelTerminationStrategy: PID 4227 died... 21:51:28.278950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4227): Terminated: ok {rc=0} 21:51:28.363152 bus /gobi_0: Setting Powered False 21:51:29.461784 bus /gobi_0: Setting Powered False 21:51:30.579671 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:51:31.752350 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:31.768559 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:51:31.814661 tst iperf3.py: using LAC 36456 21:51:31.935599 tst iperf3.py: using RAC 246 21:51:32.065527 tst iperf3.py: using CellId 36456 21:51:32.230974 tst iperf3.py: using BVCI 36457 21:51:32.351662 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:32.363028 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:32.374417 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:32.385655 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:32.397373 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:32.408906 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:32.420757 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:32.432463 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:32.444298 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:32.570025 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:51:32.790344 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:33.115386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4229): Launched 21:51:33.396884 run iperf3-srv_10.42.42.10(pid=4230): Launched 21:51:33.517759 tst iperf3.py:8: start network... 21:51:33.734919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:34.236010 run create_hlr_db(pid=4231): Launched 21:51:34.367578 bus /gobi_6: Setting Powered False 21:51:35.431252 run create_hlr_db(pid=4231): Terminated: ok {rc=0} 21:51:35.882126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4233): Launched 21:51:36.205615 run osmo-hlr_10.42.42.2(pid=4234): Launched 21:51:36.329488 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:36.890184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4236): Launched 21:51:37.213514 run osmo-stp_10.42.42.5(pid=4237): Launched 21:51:37.337079 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:37.898786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4239): Launched 21:51:38.022210 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:38.297221 run patchelf(pid=4240): Launched 21:51:38.475726 run osmo-stp_10.42.42.5(pid=4237): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4237)] 21:51:38.613191 run osmo-stp_10.42.42.5(pid=4237): stdout: | (launched: 2022-12-13_21:51:37.154119) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:38.751761 run osmo-stp_10.42.42.5(pid=4237): stderr: | 20221213215137347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215137347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215137347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215137348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215137348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215137348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215137348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:38.890690 run osmo-stp_10.42.42.5(pid=4237): stdout: | (launched: 2022-12-13_21:51:37.154119) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:39.023485 run osmo-stp_10.42.42.5(pid=4237): stderr: | 20221213215137347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215137347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215137347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215137348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215137348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215137348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215137348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:39.180863 run patchelf(pid=4240): Terminating (SIGINT) 21:51:39.362159 run patchelf(pid=4240): Terminated: ok {rc=0} 21:51:39.492843 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4237): Process ended prematurely: osmo-stp_10.42.42.5(pid=4237) [trial-2395↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4237)] [trial-2395↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 21:51:39.503222 tst iperf3.py:8: Test FAILED (7.8 sec) 21:51:39.531520 run osmo-hlr_10.42.42.2(pid=4234): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4234)] 21:51:39.581597 run osmo-hlr_10.42.42.2(pid=4234): stdout: | (launched: 2022-12-13_21:51:36.146197) 21:51:39.633410 run osmo-hlr_10.42.42.2(pid=4234): stderr: | 20221213215136348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215136348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215136348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215136348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215136348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215136348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215136360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215136368 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215136369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215136369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:39.685433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4229): Terminating (SIGTERM) 21:51:39.727018 run iperf3-srv_10.42.42.10(pid=4230): Terminating (SIGTERM) 21:51:39.768599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4233): Terminating (SIGTERM) 21:51:39.810343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4236): Terminating (SIGTERM) 21:51:39.852223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4239): Terminating (SIGTERM) 21:51:39.894393 --- ParallelTerminationStrategy: PID 4229 died... 21:51:39.914519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4229): Terminated: ok {rc=0} 21:51:39.960539 --- ParallelTerminationStrategy: PID 4230 died... 21:51:39.980104 run iperf3-srv_10.42.42.10(pid=4230): Terminated {rc=256} 21:51:40.025972 --- ParallelTerminationStrategy: PID 4233 died... 21:51:40.045569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4233): Terminated: ok {rc=0} 21:51:40.091519 --- ParallelTerminationStrategy: PID 4236 died... 21:51:40.111231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4236): Terminated: ok {rc=0} 21:51:40.157267 --- ParallelTerminationStrategy: PID 4239 died... 21:51:40.176691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4239): Terminated: ok {rc=0} 21:51:40.264865 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:51:41.414405 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:41.426239 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:51:41.463791 tst iperf3m4.py: using LAC 36457 21:51:41.589567 tst iperf3m4.py: using RAC 247 21:51:41.710703 tst iperf3m4.py: using CellId 36457 21:51:41.828415 tst iperf3m4.py: using BVCI 36458 21:51:41.938692 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:41.949606 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:41.960227 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:41.970939 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:41.982127 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:41.993033 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:42.004067 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:42.014865 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:51:42.025912 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:42.146133 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:42.268267 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:42.385939 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:51:42.502929 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:51:42.706918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:43.014504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4241): Launched 21:51:43.278788 run iperf3-srv_10.42.42.10(pid=4242): Launched 21:51:43.392266 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:51:43.595529 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:43.901165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4243): Launched 21:51:44.165749 run iperf3-srv_10.42.42.10(pid=4244): Launched 21:51:44.278979 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:51:44.481745 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:44.787266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4245): Launched 21:51:45.052467 run iperf3-srv_10.42.42.10(pid=4246): Launched 21:51:45.166041 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:51:45.368509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:51:45.674103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4247): Launched 21:51:45.965823 run iperf3-srv_10.42.42.10(pid=4248): Launched 21:51:46.095596 tst iperf3m4.py:8: start network... 21:51:46.305610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:51:46.800868 run create_hlr_db(pid=4249): Launched 21:51:46.951208 bus /gobi_6: Setting Powered False 21:51:48.015407 run create_hlr_db(pid=4249): Terminated: ok {rc=0} 21:51:48.448882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4251): Launched 21:51:48.752537 run osmo-hlr_10.42.42.2(pid=4252): Launched 21:51:48.868188 run osmo-stp_10.42.42.5: Starting osmo-stp 21:51:49.403510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4254): Launched 21:51:49.706268 run osmo-stp_10.42.42.5(pid=4255): Launched 21:51:49.821726 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:51:50.345100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4257): Launched 21:51:50.460746 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:51:50.718532 run patchelf(pid=4258): Launched 21:51:50.886300 run osmo-stp_10.42.42.5(pid=4255): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4255)] 21:51:51.014543 run osmo-stp_10.42.42.5(pid=4255): stdout: | (launched: 2022-12-13_21:51:49.650394) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:51.144171 run osmo-stp_10.42.42.5(pid=4255): stderr: | 20221213215149822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215149822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215149822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215149823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215149823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215149823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215149823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:51.274206 run osmo-stp_10.42.42.5(pid=4255): stdout: | (launched: 2022-12-13_21:51:49.650394) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:51:51.397996 run osmo-stp_10.42.42.5(pid=4255): stderr: | 20221213215149822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215149822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215149822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215149823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215149823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215149823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215149823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:51:51.544663 run patchelf(pid=4258): Terminating (SIGINT) 21:51:51.714730 run patchelf(pid=4258): Terminated: ok {rc=0} 21:51:51.837095 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4255): Process ended prematurely: osmo-stp_10.42.42.5(pid=4255) [trial-2395↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4255)] [trial-2395↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 21:51:51.846431 tst iperf3m4.py:8: Test FAILED (10.5 sec) 21:51:51.873818 run osmo-hlr_10.42.42.2(pid=4252): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4252)] 21:51:51.922526 run osmo-hlr_10.42.42.2(pid=4252): stdout: | (launched: 2022-12-13_21:51:48.696324) 21:51:51.972855 run osmo-hlr_10.42.42.2(pid=4252): stderr: | 20221213215148875 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215148875 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215148875 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215148875 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215148875 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215148875 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215148887 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215148898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215148899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215148899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:51:52.023240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4241): Terminating (SIGTERM) 21:51:52.063174 run iperf3-srv_10.42.42.10(pid=4242): Terminating (SIGTERM) 21:51:52.103089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4243): Terminating (SIGTERM) 21:51:52.143032 run iperf3-srv_10.42.42.10(pid=4244): Terminating (SIGTERM) 21:51:52.182546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4245): Terminating (SIGTERM) 21:51:52.222270 run iperf3-srv_10.42.42.10(pid=4246): Terminating (SIGTERM) 21:51:52.261855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4247): Terminating (SIGTERM) 21:51:52.301658 run iperf3-srv_10.42.42.10(pid=4248): Terminating (SIGTERM) 21:51:52.341140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4251): Terminating (SIGTERM) 21:51:52.381047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4254): Terminating (SIGTERM) 21:51:52.421086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4257): Terminating (SIGTERM) 21:51:52.461289 --- ParallelTerminationStrategy: PID 4241 died... 21:51:52.480745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4241): Terminated: ok {rc=0} 21:51:52.524802 --- ParallelTerminationStrategy: PID 4242 died... 21:51:52.544109 run iperf3-srv_10.42.42.10(pid=4242): Terminated {rc=256} 21:51:52.587923 --- ParallelTerminationStrategy: PID 4243 died... 21:51:52.606853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4243): Terminated: ok {rc=0} 21:51:52.650734 --- ParallelTerminationStrategy: PID 4244 died... 21:51:52.669593 run iperf3-srv_10.42.42.10(pid=4244): Terminated {rc=256} 21:51:52.713436 --- ParallelTerminationStrategy: PID 4245 died... 21:51:52.732223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4245): Terminated: ok {rc=0} 21:51:52.776142 --- ParallelTerminationStrategy: PID 4246 died... 21:51:52.795057 run iperf3-srv_10.42.42.10(pid=4246): Terminated {rc=256} 21:51:52.839118 --- ParallelTerminationStrategy: PID 4247 died... 21:51:52.858011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4247): Terminated: ok {rc=0} 21:51:52.901904 --- ParallelTerminationStrategy: PID 4248 died... 21:51:52.920717 run iperf3-srv_10.42.42.10(pid=4248): Terminated {rc=256} 21:51:52.964762 --- ParallelTerminationStrategy: PID 4251 died... 21:51:52.983813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4251): Terminated: ok {rc=0} 21:51:53.027699 --- ParallelTerminationStrategy: PID 4254 died... 21:51:53.046600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4254): Terminated: ok {rc=0} 21:51:53.090544 --- ParallelTerminationStrategy: PID 4257 died... 21:51:53.109450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4257): Terminated: ok {rc=0} 21:51:53.195965 bus /gobi_4: Setting Powered False 21:51:54.294133 bus /gobi_4: Setting Powered False 21:51:55.411595 bus /gobi_1: Setting Powered False 21:51:56.509435 bus /gobi_1: Setting Powered False 21:51:57.625397 bus /gobi_0: Setting Powered False 21:51:58.722651 bus /gobi_0: Setting Powered False 21:51:59.840770 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 21:52:00.949212 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:00.961687 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:52:01.002698 tst ping.py: using LAC 36458 21:52:01.168907 tst ping.py: using RAC 248 21:52:01.299383 tst ping.py: using CellId 36458 21:52:01.425744 tst ping.py: using BVCI 36459 21:52:01.572423 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:01.587937 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:01.603731 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:01.618883 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:01.633959 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:01.649502 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:01.662163 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:01.678694 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:52:01.829217 tst ping.py:19: start network... 21:52:02.055064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:02.529366 run create_hlr_db(pid=4259): Launched 21:52:02.643614 bus /gobi_6: Setting Powered False 21:52:03.703185 run create_hlr_db(pid=4259): Terminated: ok {rc=0} 21:52:04.140601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4261): Launched 21:52:04.459289 run osmo-hlr_10.42.42.2(pid=4262): Launched 21:52:04.581018 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:05.129666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4264): Launched 21:52:05.446973 run osmo-stp_10.42.42.5(pid=4265): Launched 21:52:05.568206 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:52:06.117380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4267): Launched 21:52:06.238298 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:52:06.506833 run patchelf(pid=4268): Launched 21:52:06.682902 run osmo-stp_10.42.42.5(pid=4265): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4265)] 21:52:06.818025 run osmo-stp_10.42.42.5(pid=4265): stdout: | (launched: 2022-12-13_21:52:05.388310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:06.954635 run osmo-stp_10.42.42.5(pid=4265): stderr: | 20221213215205580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215205580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215205580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215205581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215205581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215205581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215205581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:07.090894 run osmo-stp_10.42.42.5(pid=4265): stdout: | (launched: 2022-12-13_21:52:05.388310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:07.221272 run osmo-stp_10.42.42.5(pid=4265): stderr: | 20221213215205580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215205580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215205580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215205581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215205581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215205581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215205581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:07.375653 run patchelf(pid=4268): Terminating (SIGINT) 21:52:07.553578 run patchelf(pid=4268): Terminated: ok {rc=0} 21:52:07.681555 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4265): Process ended prematurely: osmo-stp_10.42.42.5(pid=4265) [trial-2395↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4265)] [trial-2395↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 21:52:07.691017 tst ping.py:22: Test FAILED (6.7 sec) 21:52:07.719523 run osmo-hlr_10.42.42.2(pid=4262): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4262)] 21:52:07.770168 run osmo-hlr_10.42.42.2(pid=4262): stdout: | (launched: 2022-12-13_21:52:04.400506) 21:52:07.821977 run osmo-hlr_10.42.42.2(pid=4262): stderr: | 20221213215204598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215204598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215204598 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215204598 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215204598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215204598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215204610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215204618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215204619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215204619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:07.874497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4261): Terminating (SIGTERM) 21:52:07.916372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4264): Terminating (SIGTERM) 21:52:07.958174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4267): Terminating (SIGTERM) 21:52:08.000352 --- ParallelTerminationStrategy: PID 4261 died... 21:52:08.020398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4261): Terminated: ok {rc=0} 21:52:08.066746 --- ParallelTerminationStrategy: PID 4264 died... 21:52:08.086490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4264): Terminated: ok {rc=0} 21:52:08.132453 --- ParallelTerminationStrategy: PID 4267 died... 21:52:08.152019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4267): Terminated: ok {rc=0} 21:52:08.239899 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:52:09.327631 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:09.339505 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:52:09.378623 tst ping_idle_ping.py: using LAC 36459 21:52:09.498536 tst ping_idle_ping.py: using RAC 249 21:52:09.616141 tst ping_idle_ping.py: using CellId 36459 21:52:09.734621 tst ping_idle_ping.py: using BVCI 36460 21:52:09.843104 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:09.853887 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:09.864554 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:09.875134 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:09.885837 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:09.897186 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:09.908941 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:52:09.920280 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:52:10.042221 tst ping_idle_ping.py:24: start network... 21:52:10.241552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:10.702235 run create_hlr_db(pid=4269): Launched 21:52:10.815226 bus /gobi_6: Setting Powered False 21:52:11.875157 run create_hlr_db(pid=4269): Terminated: ok {rc=0} 21:52:12.313486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4271): Launched 21:52:12.631147 run osmo-hlr_10.42.42.2(pid=4272): Launched 21:52:12.752695 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:13.302127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4274): Launched 21:52:13.620729 run osmo-stp_10.42.42.5(pid=4275): Launched 21:52:13.742538 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:52:14.294036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4277): Launched 21:52:14.414999 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:52:14.684506 run patchelf(pid=4278): Launched 21:52:14.862205 run osmo-stp_10.42.42.5(pid=4275): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4275)] 21:52:14.997303 run osmo-stp_10.42.42.5(pid=4275): stdout: | (launched: 2022-12-13_21:52:13.561770) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:15.133929 run osmo-stp_10.42.42.5(pid=4275): stderr: | 20221213215213753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215213753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215213754 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215213754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215213755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215213755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215213755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:15.270723 run osmo-stp_10.42.42.5(pid=4275): stdout: | (launched: 2022-12-13_21:52:13.561770) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:15.401792 run osmo-stp_10.42.42.5(pid=4275): stderr: | 20221213215213753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215213753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215213754 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215213754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215213755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215213755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215213755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:15.556898 run patchelf(pid=4278): Terminating (SIGINT) 21:52:15.735471 run patchelf(pid=4278): Terminated: ok {rc=0} 21:52:15.887352 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4275): Process ended prematurely: osmo-stp_10.42.42.5(pid=4275) [trial-2395↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4275)] [trial-2395↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 21:52:15.899924 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 21:52:15.938729 run osmo-hlr_10.42.42.2(pid=4272): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4272)] 21:52:15.994554 run osmo-hlr_10.42.42.2(pid=4272): stdout: | (launched: 2022-12-13_21:52:12.572476) 21:52:16.060042 run osmo-hlr_10.42.42.2(pid=4272): stderr: | 20221213215212772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215212772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215212772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215212772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215212772 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215212772 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215212785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215212793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215212793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215212793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:16.126508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4271): Terminating (SIGTERM) 21:52:16.176638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4274): Terminating (SIGTERM) 21:52:16.222213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4277): Terminating (SIGTERM) 21:52:16.267506 --- ParallelTerminationStrategy: PID 4271 died... 21:52:16.289216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4271): Terminated: ok {rc=0} 21:52:16.338555 --- ParallelTerminationStrategy: PID 4274 died... 21:52:16.360237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4274): Terminated: ok {rc=0} 21:52:16.407731 --- ParallelTerminationStrategy: PID 4277 died... 21:52:16.429030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4277): Terminated: ok {rc=0} 21:52:16.519638 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 21:52:17.807486 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:52:17.814186 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 21:52:17.835621 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 21:52:17.878881 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 21:52:17.965076 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 21:52:17.985481 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 21:52:18.023617 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 21:52:18.614911 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 21:52:18.663886 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:18.674768 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:52:18.731153 tst cs_paging_gprs_active.py: using LAC 36460 21:52:18.851741 tst cs_paging_gprs_active.py: using RAC 250 21:52:18.982343 tst cs_paging_gprs_active.py: using CellId 36460 21:52:19.110876 tst cs_paging_gprs_active.py: using BVCI 36461 21:52:19.230336 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:19.241596 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:19.252489 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:19.263474 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:19.275000 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:19.286430 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:19.298037 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:19.309477 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:19.321097 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:19.438603 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:19.559054 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:52:19.778871 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:20.105670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4283): Launched 21:52:20.387483 run iperf3-srv_10.42.42.10(pid=4284): Launched 21:52:20.509042 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:52:20.727303 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:21.053374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4285): Launched 21:52:21.334024 run iperf3-srv_10.42.42.10(pid=4286): Launched 21:52:21.454833 tst cs_paging_gprs_active.py:38: start network... 21:52:21.674115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:22.177589 run create_hlr_db(pid=4287): Launched 21:52:22.309285 bus /gobi_6: Setting Powered False 21:52:23.372865 run create_hlr_db(pid=4287): Terminated: ok {rc=0} 21:52:23.825651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4289): Launched 21:52:24.150228 run osmo-hlr_10.42.42.2(pid=4290): Launched 21:52:24.273970 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:24.829369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4292): Launched 21:52:25.153786 run osmo-stp_10.42.42.5(pid=4293): Launched 21:52:25.277162 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:52:25.835999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4295): Launched 21:52:25.960294 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:52:26.234518 run patchelf(pid=4296): Launched 21:52:26.414863 run osmo-stp_10.42.42.5(pid=4293): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4293)] 21:52:26.551549 run osmo-stp_10.42.42.5(pid=4293): stdout: | (launched: 2022-12-13_21:52:25.094324) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:26.690235 run osmo-stp_10.42.42.5(pid=4293): stderr: | 20221213215225289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215225289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215225289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215225289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215225290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215225290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215225290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:26.829115 run osmo-stp_10.42.42.5(pid=4293): stdout: | (launched: 2022-12-13_21:52:25.094324) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:26.962860 run osmo-stp_10.42.42.5(pid=4293): stderr: | 20221213215225289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215225289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215225289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215225289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215225290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215225290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215225290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:27.120090 run patchelf(pid=4296): Terminating (SIGINT) 21:52:27.301294 run patchelf(pid=4296): Terminated: ok {rc=0} 21:52:27.431463 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4293): Process ended prematurely: osmo-stp_10.42.42.5(pid=4293) [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4293)] [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 21:52:27.441530 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 21:52:27.469995 run osmo-hlr_10.42.42.2(pid=4290): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4290)] 21:52:27.519763 run osmo-hlr_10.42.42.2(pid=4290): stdout: | (launched: 2022-12-13_21:52:24.090648) 21:52:27.570972 run osmo-hlr_10.42.42.2(pid=4290): stderr: | 20221213215224288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215224288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215224288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215224288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215224288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215224288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215224301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215224310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215224310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215224310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:27.622981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4283): Terminating (SIGTERM) 21:52:27.664594 run iperf3-srv_10.42.42.10(pid=4284): Terminating (SIGTERM) 21:52:27.705954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4285): Terminating (SIGTERM) 21:52:27.747648 run iperf3-srv_10.42.42.10(pid=4286): Terminating (SIGTERM) 21:52:27.789330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4289): Terminating (SIGTERM) 21:52:27.830994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4292): Terminating (SIGTERM) 21:52:27.872892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4295): Terminating (SIGTERM) 21:52:27.915220 --- ParallelTerminationStrategy: PID 4283 died... 21:52:27.935492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4283): Terminated: ok {rc=0} 21:52:27.981749 --- ParallelTerminationStrategy: PID 4284 died... 21:52:28.001066 run iperf3-srv_10.42.42.10(pid=4284): Terminated {rc=256} 21:52:28.046392 --- ParallelTerminationStrategy: PID 4285 died... 21:52:28.065851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4285): Terminated: ok {rc=0} 21:52:28.111645 --- ParallelTerminationStrategy: PID 4286 died... 21:52:28.130928 run iperf3-srv_10.42.42.10(pid=4286): Terminated {rc=256} 21:52:28.176237 --- ParallelTerminationStrategy: PID 4289 died... 21:52:28.195742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4289): Terminated: ok {rc=0} 21:52:28.241268 --- ParallelTerminationStrategy: PID 4292 died... 21:52:28.260656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4292): Terminated: ok {rc=0} 21:52:28.306351 --- ParallelTerminationStrategy: PID 4295 died... 21:52:28.325786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4295): Terminated: ok {rc=0} 21:52:28.413553 bus /gobi_0: Setting Powered False 21:52:29.512040 bus /gobi_0: Setting Powered False 21:52:30.627892 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 21:52:31.783908 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:31.796654 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:52:31.860376 tst iperf3.py: using LAC 36461 21:52:31.982204 tst iperf3.py: using RAC 251 21:52:32.105814 tst iperf3.py: using CellId 36461 21:52:32.226363 tst iperf3.py: using BVCI 36462 21:52:32.342531 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:32.353816 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:32.364729 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:32.375821 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:32.387297 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:32.398861 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:32.410465 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:32.421839 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:32.433463 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:32.553518 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:52:32.773603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:33.101130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4297): Launched 21:52:33.382607 run iperf3-srv_10.42.42.10(pid=4298): Launched 21:52:33.503300 tst iperf3.py:8: start network... 21:52:33.721881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:34.225355 run create_hlr_db(pid=4299): Launched 21:52:34.355688 bus /gobi_6: Setting Powered False 21:52:35.419688 run create_hlr_db(pid=4299): Terminated: ok {rc=0} 21:52:35.851445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4301): Launched 21:52:36.153962 run osmo-hlr_10.42.42.2(pid=4302): Launched 21:52:36.269091 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:36.803969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4304): Launched 21:52:37.107597 run osmo-stp_10.42.42.5(pid=4305): Launched 21:52:37.222549 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:52:37.742986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4307): Launched 21:52:37.858356 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:52:38.113929 run patchelf(pid=4308): Launched 21:52:38.281503 run osmo-stp_10.42.42.5(pid=4305): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4305)] 21:52:38.408803 run osmo-stp_10.42.42.5(pid=4305): stdout: | (launched: 2022-12-13_21:52:37.050977) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:38.537993 run osmo-stp_10.42.42.5(pid=4305): stderr: | 20221213215237221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215237221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215237221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215237222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215237224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215237224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215237224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:38.667397 run osmo-stp_10.42.42.5(pid=4305): stdout: | (launched: 2022-12-13_21:52:37.050977) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:38.790866 run osmo-stp_10.42.42.5(pid=4305): stderr: | 20221213215237221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215237221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215237221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215237222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215237224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215237224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215237224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:38.937494 run patchelf(pid=4308): Terminating (SIGINT) 21:52:39.106283 run patchelf(pid=4308): Terminated: ok {rc=0} 21:52:39.228535 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4305): Process ended prematurely: osmo-stp_10.42.42.5(pid=4305) [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4305)] [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 21:52:39.238088 tst iperf3.py:8: Test FAILED (7.5 sec) 21:52:39.265167 run osmo-hlr_10.42.42.2(pid=4302): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4302)] 21:52:39.313472 run osmo-hlr_10.42.42.2(pid=4302): stdout: | (launched: 2022-12-13_21:52:36.097502) 21:52:39.363207 run osmo-hlr_10.42.42.2(pid=4302): stderr: | 20221213215236275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215236275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215236275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215236275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215236275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215236275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215236287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215236299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215236299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215236299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:39.412929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4297): Terminating (SIGTERM) 21:52:39.453214 run iperf3-srv_10.42.42.10(pid=4298): Terminating (SIGTERM) 21:52:39.494620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4301): Terminating (SIGTERM) 21:52:39.535053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4304): Terminating (SIGTERM) 21:52:39.574973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4307): Terminating (SIGTERM) 21:52:39.615263 --- ParallelTerminationStrategy: PID 4297 died... 21:52:39.634682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4297): Terminated: ok {rc=0} 21:52:39.678879 --- ParallelTerminationStrategy: PID 4298 died... 21:52:39.697742 run iperf3-srv_10.42.42.10(pid=4298): Terminated {rc=256} 21:52:39.741805 --- ParallelTerminationStrategy: PID 4301 died... 21:52:39.760711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4301): Terminated: ok {rc=0} 21:52:39.804757 --- ParallelTerminationStrategy: PID 4304 died... 21:52:39.823730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4304): Terminated: ok {rc=0} 21:52:39.867814 --- ParallelTerminationStrategy: PID 4307 died... 21:52:39.886812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4307): Terminated: ok {rc=0} 21:52:39.969407 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 21:52:41.118099 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:41.129886 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:52:41.188707 tst iperf3m4.py: using LAC 36462 21:52:41.316800 tst iperf3m4.py: using RAC 252 21:52:41.442485 tst iperf3m4.py: using CellId 36462 21:52:41.570469 tst iperf3m4.py: using BVCI 36463 21:52:41.689269 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:41.700571 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:41.711705 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:41.722845 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:41.733934 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:41.744840 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:41.756143 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:41.767145 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:52:41.778483 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:41.895495 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:42.017985 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:42.134825 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:52:42.253544 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:52:42.472395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:42.798184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4309): Launched 21:52:43.081125 run iperf3-srv_10.42.42.10(pid=4310): Launched 21:52:43.202507 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:52:43.421666 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:43.747198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4311): Launched 21:52:44.029214 run iperf3-srv_10.42.42.10(pid=4312): Launched 21:52:44.149763 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:52:44.369670 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:44.694207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4313): Launched 21:52:44.975647 run iperf3-srv_10.42.42.10(pid=4314): Launched 21:52:45.097528 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:52:45.315939 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:52:45.641549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4315): Launched 21:52:45.954679 run iperf3-srv_10.42.42.10(pid=4316): Launched 21:52:46.110357 tst iperf3m4.py:8: start network... 21:52:46.367086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:52:46.907807 run create_hlr_db(pid=4317): Launched 21:52:47.061144 bus /gobi_6: Setting Powered False 21:52:48.125585 run create_hlr_db(pid=4317): Terminated: ok {rc=0} 21:52:48.575738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4319): Launched 21:52:48.900403 run osmo-hlr_10.42.42.2(pid=4320): Launched 21:52:49.023222 run osmo-stp_10.42.42.5: Starting osmo-stp 21:52:49.581013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4322): Launched 21:52:49.904351 run osmo-stp_10.42.42.5(pid=4323): Launched 21:52:50.026904 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:52:50.584767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4325): Launched 21:52:50.707771 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:52:50.981764 run patchelf(pid=4326): Launched 21:52:51.163013 run osmo-stp_10.42.42.5(pid=4323): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4323)] 21:52:51.299188 run osmo-stp_10.42.42.5(pid=4323): stdout: | (launched: 2022-12-13_21:52:49.844491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:51.437177 run osmo-stp_10.42.42.5(pid=4323): stderr: | 20221213215250036 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215250036 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215250037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215250037 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215250038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215250038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215250038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:51.574898 run osmo-stp_10.42.42.5(pid=4323): stdout: | (launched: 2022-12-13_21:52:49.844491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:52:51.707004 run osmo-stp_10.42.42.5(pid=4323): stderr: | 20221213215250036 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215250036 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215250037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215250037 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215250038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215250038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215250038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:52:51.863422 run patchelf(pid=4326): Terminating (SIGINT) 21:52:52.068538 run patchelf(pid=4326): Terminated: ok {rc=0} 21:52:52.198978 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4323): Process ended prematurely: osmo-stp_10.42.42.5(pid=4323) [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4323)] [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 21:52:52.208927 tst iperf3m4.py:8: Test FAILED (11.1 sec) 21:52:52.237334 run osmo-hlr_10.42.42.2(pid=4320): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4320)] 21:52:52.286842 run osmo-hlr_10.42.42.2(pid=4320): stdout: | (launched: 2022-12-13_21:52:48.839437) 21:52:52.338106 run osmo-hlr_10.42.42.2(pid=4320): stderr: | 20221213215249039 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215249039 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215249039 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215249039 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215249040 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215249040 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215249062 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215249073 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215249073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215249073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:52:52.389900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4309): Terminating (SIGTERM) 21:52:52.430995 run iperf3-srv_10.42.42.10(pid=4310): Terminating (SIGTERM) 21:52:52.472229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4311): Terminating (SIGTERM) 21:52:52.513643 run iperf3-srv_10.42.42.10(pid=4312): Terminating (SIGTERM) 21:52:52.555374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4313): Terminating (SIGTERM) 21:52:52.596710 run iperf3-srv_10.42.42.10(pid=4314): Terminating (SIGTERM) 21:52:52.638112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4315): Terminating (SIGTERM) 21:52:52.679322 run iperf3-srv_10.42.42.10(pid=4316): Terminating (SIGTERM) 21:52:52.720305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4319): Terminating (SIGTERM) 21:52:52.761536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4322): Terminating (SIGTERM) 21:52:52.802723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4325): Terminating (SIGTERM) 21:52:52.844139 --- ParallelTerminationStrategy: PID 4309 died... 21:52:52.864167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4309): Terminated: ok {rc=0} 21:52:52.910554 --- ParallelTerminationStrategy: PID 4310 died... 21:52:52.930058 run iperf3-srv_10.42.42.10(pid=4310): Terminated {rc=256} 21:52:52.975810 --- ParallelTerminationStrategy: PID 4311 died... 21:52:52.995187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4311): Terminated: ok {rc=0} 21:52:53.041088 --- ParallelTerminationStrategy: PID 4312 died... 21:52:53.060510 run iperf3-srv_10.42.42.10(pid=4312): Terminated {rc=256} 21:52:53.106473 --- ParallelTerminationStrategy: PID 4313 died... 21:52:53.126387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4313): Terminated: ok {rc=0} 21:52:53.172084 --- ParallelTerminationStrategy: PID 4314 died... 21:52:53.191408 run iperf3-srv_10.42.42.10(pid=4314): Terminated {rc=256} 21:52:53.237066 --- ParallelTerminationStrategy: PID 4315 died... 21:52:53.256475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4315): Terminated: ok {rc=0} 21:52:53.302186 --- ParallelTerminationStrategy: PID 4316 died... 21:52:53.321763 run iperf3-srv_10.42.42.10(pid=4316): Terminated {rc=256} 21:52:53.367426 --- ParallelTerminationStrategy: PID 4319 died... 21:52:53.387014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4319): Terminated: ok {rc=0} 21:52:53.432765 --- ParallelTerminationStrategy: PID 4322 died... 21:52:53.452223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4322): Terminated: ok {rc=0} 21:52:53.498024 --- ParallelTerminationStrategy: PID 4325 died... 21:52:53.517638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4325): Terminated: ok {rc=0} 21:52:53.604669 bus /gobi_4: Setting Powered False 21:52:54.703715 bus /gobi_4: Setting Powered False 21:52:55.819885 bus /gobi_1: Setting Powered False 21:52:56.918437 bus /gobi_1: Setting Powered False 21:52:58.034254 bus /gobi_0: Setting Powered False 21:52:59.131667 bus /gobi_0: Setting Powered False 21:53:00.249979 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 21:53:01.350517 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:01.363298 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:53:01.422163 tst ping.py: using LAC 36463 21:53:01.549953 tst ping.py: using RAC 253 21:53:01.697671 tst ping.py: using CellId 36463 21:53:01.854288 tst ping.py: using BVCI 36464 21:53:01.972836 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:01.985461 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:01.997666 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:02.010117 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:02.022221 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:02.034338 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:02.046728 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:02.058929 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:53:02.179742 tst ping.py:19: start network... 21:53:02.397992 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:02.891578 run create_hlr_db(pid=4327): Launched 21:53:03.020781 bus /gobi_6: Setting Powered False 21:53:04.084404 run create_hlr_db(pid=4327): Terminated: ok {rc=0} 21:53:04.528725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4329): Launched 21:53:04.846771 run osmo-hlr_10.42.42.2(pid=4330): Launched 21:53:04.968760 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:05.504106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4332): Launched 21:53:05.801923 run osmo-stp_10.42.42.5(pid=4333): Launched 21:53:05.915349 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:53:06.426141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4335): Launched 21:53:06.538694 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:53:06.789198 run patchelf(pid=4336): Launched 21:53:06.953468 run osmo-stp_10.42.42.5(pid=4333): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4333)] 21:53:07.078697 run osmo-stp_10.42.42.5(pid=4333): stdout: | (launched: 2022-12-13_21:53:05.747047) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:07.205468 run osmo-stp_10.42.42.5(pid=4333): stderr: | 20221213215305916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215305916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215305916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215305917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215305917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215305917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215305917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:07.332701 run osmo-stp_10.42.42.5(pid=4333): stdout: | (launched: 2022-12-13_21:53:05.747047) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:07.454190 run osmo-stp_10.42.42.5(pid=4333): stderr: | 20221213215305916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215305916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215305916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215305917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215305917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215305917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215305917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:07.598152 run patchelf(pid=4336): Terminating (SIGINT) 21:53:07.763834 run patchelf(pid=4336): Terminated: ok {rc=0} 21:53:07.883864 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4333): Process ended prematurely: osmo-stp_10.42.42.5(pid=4333) [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4333)] [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 21:53:07.893105 tst ping.py:22: Test FAILED (6.5 sec) 21:53:07.919469 run osmo-hlr_10.42.42.2(pid=4330): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4330)] 21:53:07.967279 run osmo-hlr_10.42.42.2(pid=4330): stdout: | (launched: 2022-12-13_21:53:04.787675) 21:53:08.016276 run osmo-hlr_10.42.42.2(pid=4330): stderr: | 20221213215304969 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215304969 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215304969 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215304969 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215304969 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215304969 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215304981 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215304989 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215304989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215304989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:08.065480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4329): Terminating (SIGTERM) 21:53:08.104904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4332): Terminating (SIGTERM) 21:53:08.144557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4335): Terminating (SIGTERM) 21:53:08.184430 --- ParallelTerminationStrategy: PID 4329 died... 21:53:08.203724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4329): Terminated: ok {rc=0} 21:53:08.247371 --- ParallelTerminationStrategy: PID 4332 died... 21:53:08.266012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4332): Terminated: ok {rc=0} 21:53:08.309463 --- ParallelTerminationStrategy: PID 4335 died... 21:53:08.328175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4335): Terminated: ok {rc=0} 21:53:08.411823 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 21:53:09.497048 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:09.509200 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:53:09.566620 tst ping_idle_ping.py: using LAC 36464 21:53:09.693630 tst ping_idle_ping.py: using RAC 254 21:53:09.820746 tst ping_idle_ping.py: using CellId 36464 21:53:09.949608 tst ping_idle_ping.py: using BVCI 36465 21:53:10.064755 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:10.076134 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:10.087203 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:10.098286 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:10.109170 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:10.120179 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:10.131320 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:53:10.142389 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:53:10.261159 tst ping_idle_ping.py:24: start network... 21:53:10.476082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:10.972787 run create_hlr_db(pid=4337): Launched 21:53:11.102799 bus /gobi_6: Setting Powered False 21:53:12.166038 run create_hlr_db(pid=4337): Terminated: ok {rc=0} 21:53:12.593593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4339): Launched 21:53:12.891690 run osmo-hlr_10.42.42.2(pid=4340): Launched 21:53:13.005326 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:13.522332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4342): Launched 21:53:13.819243 run osmo-stp_10.42.42.5(pid=4343): Launched 21:53:13.932926 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:53:14.446595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4345): Launched 21:53:14.560106 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:53:14.812393 run patchelf(pid=4346): Launched 21:53:14.977482 run osmo-stp_10.42.42.5(pid=4343): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4343)] 21:53:15.103749 run osmo-stp_10.42.42.5(pid=4343): stdout: | (launched: 2022-12-13_21:53:13.764104) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:15.231443 run osmo-stp_10.42.42.5(pid=4343): stderr: | 20221213215313935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215313936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215313936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215313936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215313937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215313937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215313937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:15.359307 run osmo-stp_10.42.42.5(pid=4343): stdout: | (launched: 2022-12-13_21:53:13.764104) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:15.481548 run osmo-stp_10.42.42.5(pid=4343): stderr: | 20221213215313935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215313936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215313936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215313936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215313937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215313937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215313937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:15.626492 run patchelf(pid=4346): Terminating (SIGINT) 21:53:15.793571 run patchelf(pid=4346): Terminated: ok {rc=0} 21:53:15.949451 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4343): Process ended prematurely: osmo-stp_10.42.42.5(pid=4343) [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4343)] [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 21:53:15.959614 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 21:53:15.987150 run osmo-hlr_10.42.42.2(pid=4340): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4340)] 21:53:16.039010 run osmo-hlr_10.42.42.2(pid=4340): stdout: | (launched: 2022-12-13_21:53:12.836465) 21:53:16.090326 run osmo-hlr_10.42.42.2(pid=4340): stderr: | 20221213215313012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215313012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215313012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215313012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215313012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215313012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215313024 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215313033 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215313033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215313033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:16.142749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4339): Terminating (SIGTERM) 21:53:16.185176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4342): Terminating (SIGTERM) 21:53:16.228232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4345): Terminating (SIGTERM) 21:53:16.271277 --- ParallelTerminationStrategy: PID 4339 died... 21:53:16.292423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4339): Terminated: ok {rc=0} 21:53:16.340255 --- ParallelTerminationStrategy: PID 4342 died... 21:53:16.361198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4342): Terminated: ok {rc=0} 21:53:16.407792 --- ParallelTerminationStrategy: PID 4345 died... 21:53:16.428712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4345): Terminated: ok {rc=0} 21:53:16.516103 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:53:17.800044 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:53:17.805849 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:53:17.826150 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 21:53:17.864323 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 21:53:17.951713 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:53:17.972293 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 21:53:18.010382 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 21:53:18.605548 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 21:53:18.655778 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:18.666536 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:53:18.721388 tst cs_paging_gprs_active.py: using LAC 36465 21:53:18.838039 tst cs_paging_gprs_active.py: using RAC 255 21:53:18.961127 tst cs_paging_gprs_active.py: using CellId 36465 21:53:19.089511 tst cs_paging_gprs_active.py: using BVCI 36466 21:53:19.202065 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:19.212714 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:19.223230 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:19.233823 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:19.244171 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:19.255823 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:19.267195 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:19.277958 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:19.288783 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:19.409620 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:19.529516 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:53:19.748601 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:20.073917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4352): Launched 21:53:20.355634 run iperf3-srv_10.42.42.10(pid=4353): Launched 21:53:20.476755 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:53:20.696128 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:21.022276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4354): Launched 21:53:21.304900 run iperf3-srv_10.42.42.10(pid=4355): Launched 21:53:21.426135 tst cs_paging_gprs_active.py:38: start network... 21:53:21.644103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:22.147393 run create_hlr_db(pid=4356): Launched 21:53:22.279224 bus /gobi_6: Setting Powered False 21:53:23.342960 run create_hlr_db(pid=4356): Terminated: ok {rc=0} 21:53:23.793584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4358): Launched 21:53:24.116252 run osmo-hlr_10.42.42.2(pid=4359): Launched 21:53:24.239697 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:24.799379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4361): Launched 21:53:25.122460 run osmo-stp_10.42.42.5(pid=4362): Launched 21:53:25.245772 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:53:25.804749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4364): Launched 21:53:25.928126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:53:26.202142 run patchelf(pid=4365): Launched 21:53:26.381467 run osmo-stp_10.42.42.5(pid=4362): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4362)] 21:53:26.517738 run osmo-stp_10.42.42.5(pid=4362): stdout: | (launched: 2022-12-13_21:53:25.063168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:26.655976 run osmo-stp_10.42.42.5(pid=4362): stderr: | 20221213215325257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215325257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215325257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215325258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215325258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215325258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215325258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:26.794321 run osmo-stp_10.42.42.5(pid=4362): stdout: | (launched: 2022-12-13_21:53:25.063168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:26.926873 run osmo-stp_10.42.42.5(pid=4362): stderr: | 20221213215325257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215325257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215325257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215325258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215325258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215325258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215325258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:27.083710 run patchelf(pid=4365): Terminating (SIGINT) 21:53:27.264374 run patchelf(pid=4365): Terminated: ok {rc=0} 21:53:27.395582 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4362): Process ended prematurely: osmo-stp_10.42.42.5(pid=4362) [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4362)] [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 21:53:27.405733 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 21:53:27.433831 run osmo-hlr_10.42.42.2(pid=4359): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4359)] 21:53:27.483265 run osmo-hlr_10.42.42.2(pid=4359): stdout: | (launched: 2022-12-13_21:53:24.056921) 21:53:27.534464 run osmo-hlr_10.42.42.2(pid=4359): stderr: | 20221213215324255 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215324255 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215324255 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215324255 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215324255 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215324255 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215324267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215324275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215324276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215324276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:27.585860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4352): Terminating (SIGTERM) 21:53:27.626985 run iperf3-srv_10.42.42.10(pid=4353): Terminating (SIGTERM) 21:53:27.668005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4354): Terminating (SIGTERM) 21:53:27.709371 run iperf3-srv_10.42.42.10(pid=4355): Terminating (SIGTERM) 21:53:27.750412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4358): Terminating (SIGTERM) 21:53:27.791416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4361): Terminating (SIGTERM) 21:53:27.832436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4364): Terminating (SIGTERM) 21:53:27.873848 --- ParallelTerminationStrategy: PID 4352 died... 21:53:27.893823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4352): Terminated: ok {rc=0} 21:53:27.939355 --- ParallelTerminationStrategy: PID 4353 died... 21:53:27.958769 run iperf3-srv_10.42.42.10(pid=4353): Terminated {rc=256} 21:53:28.003987 --- ParallelTerminationStrategy: PID 4354 died... 21:53:28.023322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4354): Terminated: ok {rc=0} 21:53:28.068535 --- ParallelTerminationStrategy: PID 4355 died... 21:53:28.087801 run iperf3-srv_10.42.42.10(pid=4355): Terminated {rc=256} 21:53:28.133764 --- ParallelTerminationStrategy: PID 4358 died... 21:53:28.153121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4358): Terminated: ok {rc=0} 21:53:28.198411 --- ParallelTerminationStrategy: PID 4361 died... 21:53:28.217717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4361): Terminated: ok {rc=0} 21:53:28.263039 --- ParallelTerminationStrategy: PID 4364 died... 21:53:28.282285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4364): Terminated: ok {rc=0} 21:53:28.369204 bus /gobi_0: Setting Powered False 21:53:29.466406 bus /gobi_0: Setting Powered False 21:53:30.578713 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 21:53:31.734926 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:31.750955 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:53:31.821322 tst iperf3.py: using LAC 36466 21:53:31.947374 tst iperf3.py: using RAC 1 21:53:32.112269 tst iperf3.py: using CellId 36466 21:53:32.239616 tst iperf3.py: using BVCI 36467 21:53:32.351249 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:32.362484 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:32.373335 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:32.383974 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:32.395661 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:32.407177 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:32.418769 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:32.430408 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:32.442454 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:32.563309 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:53:32.782095 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:33.107699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4366): Launched 21:53:33.389447 run iperf3-srv_10.42.42.10(pid=4367): Launched 21:53:33.510540 tst iperf3.py:8: start network... 21:53:33.727997 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:34.229067 run create_hlr_db(pid=4368): Launched 21:53:34.359543 bus /gobi_6: Setting Powered False 21:53:35.423555 run create_hlr_db(pid=4368): Terminated: ok {rc=0} 21:53:35.875332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4370): Launched 21:53:36.199177 run osmo-hlr_10.42.42.2(pid=4371): Launched 21:53:36.321715 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:36.884682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4373): Launched 21:53:37.206885 run osmo-stp_10.42.42.5(pid=4374): Launched 21:53:37.330392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:53:37.889533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4376): Launched 21:53:38.013394 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:53:38.287328 run patchelf(pid=4377): Launched 21:53:38.466919 run osmo-stp_10.42.42.5(pid=4374): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4374)] 21:53:38.603673 run osmo-stp_10.42.42.5(pid=4374): stdout: | (launched: 2022-12-13_21:53:37.147805) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:38.742080 run osmo-stp_10.42.42.5(pid=4374): stderr: | 20221213215337339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215337339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215337340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215337340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215337341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215337341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215337341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:38.880777 run osmo-stp_10.42.42.5(pid=4374): stdout: | (launched: 2022-12-13_21:53:37.147805) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:39.013778 run osmo-stp_10.42.42.5(pid=4374): stderr: | 20221213215337339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215337339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215337340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215337340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215337341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215337341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215337341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:39.170598 run patchelf(pid=4377): Terminating (SIGINT) 21:53:39.351628 run patchelf(pid=4377): Terminated: ok {rc=0} 21:53:39.482442 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4374): Process ended prematurely: osmo-stp_10.42.42.5(pid=4374) [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4374)] [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 21:53:39.492525 tst iperf3.py:8: Test FAILED (7.8 sec) 21:53:39.520807 run osmo-hlr_10.42.42.2(pid=4371): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4371)] 21:53:39.570544 run osmo-hlr_10.42.42.2(pid=4371): stdout: | (launched: 2022-12-13_21:53:36.139934) 21:53:39.622152 run osmo-hlr_10.42.42.2(pid=4371): stderr: | 20221213215336339 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215336339 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215336339 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215336339 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215336339 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215336339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215336352 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215336360 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215336361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215336361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:39.674040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4366): Terminating (SIGTERM) 21:53:39.715555 run iperf3-srv_10.42.42.10(pid=4367): Terminating (SIGTERM) 21:53:39.756934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4370): Terminating (SIGTERM) 21:53:39.798373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4373): Terminating (SIGTERM) 21:53:39.839696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4376): Terminating (SIGTERM) 21:53:39.881348 --- ParallelTerminationStrategy: PID 4366 died... 21:53:39.901491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4366): Terminated: ok {rc=0} 21:53:39.947430 --- ParallelTerminationStrategy: PID 4367 died... 21:53:39.967251 run iperf3-srv_10.42.42.10(pid=4367): Terminated {rc=256} 21:53:40.013015 --- ParallelTerminationStrategy: PID 4370 died... 21:53:40.032450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4370): Terminated: ok {rc=0} 21:53:40.078541 --- ParallelTerminationStrategy: PID 4373 died... 21:53:40.098122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4373): Terminated: ok {rc=0} 21:53:40.144093 --- ParallelTerminationStrategy: PID 4376 died... 21:53:40.163581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4376): Terminated: ok {rc=0} 21:53:40.251095 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 21:53:41.403912 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:41.415677 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:53:41.475294 tst iperf3m4.py: using LAC 36467 21:53:41.602965 tst iperf3m4.py: using RAC 2 21:53:41.731581 tst iperf3m4.py: using CellId 36467 21:53:41.858667 tst iperf3m4.py: using BVCI 36468 21:53:41.978326 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:41.989773 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:42.000767 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:42.011990 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:42.023461 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:42.035032 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:42.046696 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:42.058268 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:53:42.070136 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:42.187977 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:42.311434 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:42.428781 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:53:42.544693 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:53:42.746940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:43.047925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4378): Launched 21:53:43.311214 run iperf3-srv_10.42.42.10(pid=4379): Launched 21:53:43.424096 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:53:43.625890 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:43.929320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4380): Launched 21:53:44.192630 run iperf3-srv_10.42.42.10(pid=4381): Launched 21:53:44.305590 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:53:44.507516 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:44.810788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4382): Launched 21:53:45.073500 run iperf3-srv_10.42.42.10(pid=4383): Launched 21:53:45.186529 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:53:45.387816 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:53:45.690771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4384): Launched 21:53:45.997670 run iperf3-srv_10.42.42.10(pid=4385): Launched 21:53:46.119510 tst iperf3m4.py:8: start network... 21:53:46.324336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:53:46.805476 run create_hlr_db(pid=4386): Launched 21:53:46.934884 bus /gobi_6: Setting Powered False 21:53:47.996040 run create_hlr_db(pid=4386): Terminated: ok {rc=0} 21:53:48.416884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4388): Launched 21:53:48.718829 run osmo-hlr_10.42.42.2(pid=4389): Launched 21:53:48.834318 run osmo-stp_10.42.42.5: Starting osmo-stp 21:53:49.376558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4391): Launched 21:53:49.681530 run osmo-stp_10.42.42.5(pid=4392): Launched 21:53:49.797159 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:53:50.320194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4394): Launched 21:53:50.436708 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:53:50.693386 run patchelf(pid=4395): Launched 21:53:50.862094 run osmo-stp_10.42.42.5(pid=4392): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4392)] 21:53:50.990939 run osmo-stp_10.42.42.5(pid=4392): stdout: | (launched: 2022-12-13_21:53:49.624666) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:51.120747 run osmo-stp_10.42.42.5(pid=4392): stderr: | 20221213215349798 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215349798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215349798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215349799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215349799 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215349799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215349799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:51.250486 run osmo-stp_10.42.42.5(pid=4392): stdout: | (launched: 2022-12-13_21:53:49.624666) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:53:51.374362 run osmo-stp_10.42.42.5(pid=4392): stderr: | 20221213215349798 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215349798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215349798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215349799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215349799 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215349799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215349799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:53:51.521704 run patchelf(pid=4395): Terminating (SIGINT) 21:53:51.691813 run patchelf(pid=4395): Terminated: ok {rc=0} 21:53:51.814310 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4392): Process ended prematurely: osmo-stp_10.42.42.5(pid=4392) [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4392)] [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 21:53:51.823823 tst iperf3m4.py:8: Test FAILED (10.5 sec) 21:53:51.851124 run osmo-hlr_10.42.42.2(pid=4389): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4389)] 21:53:51.899544 run osmo-hlr_10.42.42.2(pid=4389): stdout: | (launched: 2022-12-13_21:53:48.662876) 21:53:51.949381 run osmo-hlr_10.42.42.2(pid=4389): stderr: | 20221213215348840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215348840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215348840 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215348840 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215348840 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215348840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215348854 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215348864 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215348864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215348864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:53:51.999350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4378): Terminating (SIGTERM) 21:53:52.039594 run iperf3-srv_10.42.42.10(pid=4379): Terminating (SIGTERM) 21:53:52.079614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4380): Terminating (SIGTERM) 21:53:52.119794 run iperf3-srv_10.42.42.10(pid=4381): Terminating (SIGTERM) 21:53:52.159865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4382): Terminating (SIGTERM) 21:53:52.199883 run iperf3-srv_10.42.42.10(pid=4383): Terminating (SIGTERM) 21:53:52.239796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4384): Terminating (SIGTERM) 21:53:52.279768 run iperf3-srv_10.42.42.10(pid=4385): Terminating (SIGTERM) 21:53:52.319482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4388): Terminating (SIGTERM) 21:53:52.359683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4391): Terminating (SIGTERM) 21:53:52.399542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4394): Terminating (SIGTERM) 21:53:52.439814 --- ParallelTerminationStrategy: PID 4378 died... 21:53:52.459592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4378): Terminated: ok {rc=0} 21:53:52.503952 --- ParallelTerminationStrategy: PID 4379 died... 21:53:52.522971 run iperf3-srv_10.42.42.10(pid=4379): Terminated {rc=256} 21:53:52.567120 --- ParallelTerminationStrategy: PID 4380 died... 21:53:52.586207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4380): Terminated: ok {rc=0} 21:53:52.630445 --- ParallelTerminationStrategy: PID 4381 died... 21:53:52.649511 run iperf3-srv_10.42.42.10(pid=4381): Terminated {rc=256} 21:53:52.693486 --- ParallelTerminationStrategy: PID 4382 died... 21:53:52.712501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4382): Terminated: ok {rc=0} 21:53:52.756586 --- ParallelTerminationStrategy: PID 4383 died... 21:53:52.775536 run iperf3-srv_10.42.42.10(pid=4383): Terminated {rc=256} 21:53:52.819703 --- ParallelTerminationStrategy: PID 4384 died... 21:53:52.838713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4384): Terminated: ok {rc=0} 21:53:52.882927 --- ParallelTerminationStrategy: PID 4385 died... 21:53:52.902044 run iperf3-srv_10.42.42.10(pid=4385): Terminated {rc=256} 21:53:52.946302 --- ParallelTerminationStrategy: PID 4388 died... 21:53:52.965379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4388): Terminated: ok {rc=0} 21:53:53.009603 --- ParallelTerminationStrategy: PID 4391 died... 21:53:53.028607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4391): Terminated: ok {rc=0} 21:53:53.072788 --- ParallelTerminationStrategy: PID 4394 died... 21:53:53.091935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4394): Terminated: ok {rc=0} 21:53:53.175698 bus /gobi_4: Setting Powered False 21:53:54.271359 bus /gobi_4: Setting Powered False 21:53:55.383760 bus /gobi_1: Setting Powered False 21:53:56.481577 bus /gobi_1: Setting Powered False 21:53:57.596438 bus /gobi_0: Setting Powered False 21:53:58.693964 bus /gobi_0: Setting Powered False 21:53:59.810098 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 21:54:00.928210 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:00.945462 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:54:01.016807 tst ping.py: using LAC 36468 21:54:01.145130 tst ping.py: using RAC 3 21:54:01.313091 tst ping.py: using CellId 36468 21:54:01.468043 tst ping.py: using BVCI 36469 21:54:01.614013 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:01.625882 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:01.637533 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:01.649481 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:01.661087 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:01.673236 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:01.685110 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:01.696524 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:54:01.849520 tst ping.py:19: start network... 21:54:02.084100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:54:02.617658 run create_hlr_db(pid=4460): Launched 21:54:02.818742 bus /gobi_6: Setting Powered False 21:54:03.891770 run create_hlr_db(pid=4460): Terminated: ok {rc=0} 21:54:04.353701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4667): Launched 21:54:04.681698 run osmo-hlr_10.42.42.2(pid=4668): Launched 21:54:04.914854 run osmo-stp_10.42.42.5: Starting osmo-stp 21:54:05.649666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4670): Launched 21:54:05.987300 run osmo-stp_10.42.42.5(pid=4671): Launched 21:54:06.182405 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:54:06.857276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4675): Launched 21:54:06.980281 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:54:07.249412 run patchelf(pid=4676): Launched 21:54:07.434546 run osmo-stp_10.42.42.5(pid=4671): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4671)] 21:54:07.565713 run osmo-stp_10.42.42.5(pid=4671): stdout: | (launched: 2022-12-13_21:54:05.922281) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:07.696579 run osmo-stp_10.42.42.5(pid=4671): stderr: | 20221213215406206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215406207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215406207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215406207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215406208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215406208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215406208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:07.828851 run osmo-stp_10.42.42.5(pid=4671): stdout: | (launched: 2022-12-13_21:54:05.922281) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:07.955782 run osmo-stp_10.42.42.5(pid=4671): stderr: | 20221213215406206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215406207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215406207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215406207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215406208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215406208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215406208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:08.104247 run patchelf(pid=4676): Terminating (SIGINT) 21:54:08.274763 run patchelf(pid=4676): Terminated: ok {rc=0} 21:54:08.398861 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4671): Process ended prematurely: osmo-stp_10.42.42.5(pid=4671) [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4671)] [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 21:54:08.408770 tst ping.py:22: Test FAILED (7.5 sec) 21:54:08.436757 run osmo-hlr_10.42.42.2(pid=4668): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4668)] 21:54:08.486836 run osmo-hlr_10.42.42.2(pid=4668): stdout: | (launched: 2022-12-13_21:54:04.608662) 21:54:08.539348 run osmo-hlr_10.42.42.2(pid=4668): stderr: | 20221213215404960 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215404960 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215404960 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215404960 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215404960 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215404960 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215404978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215404993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215404994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215404994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:54:08.591344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4667): Terminating (SIGTERM) 21:54:08.633235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4670): Terminating (SIGTERM) 21:54:08.676754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4675): Terminating (SIGTERM) 21:54:08.721954 --- ParallelTerminationStrategy: PID 4667 died... 21:54:08.742227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4667): Terminated: ok {rc=0} 21:54:08.789445 --- ParallelTerminationStrategy: PID 4670 died... 21:54:08.809558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4670): Terminated: ok {rc=0} 21:54:08.855070 --- ParallelTerminationStrategy: PID 4675 died... 21:54:08.875032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4675): Terminated: ok {rc=0} 21:54:08.963572 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 21:54:10.053543 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:10.065958 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:54:10.128045 tst ping_idle_ping.py: using LAC 36469 21:54:10.250517 tst ping_idle_ping.py: using RAC 4 21:54:10.371721 tst ping_idle_ping.py: using CellId 36469 21:54:10.494594 tst ping_idle_ping.py: using BVCI 36470 21:54:10.608457 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:10.620382 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:10.632081 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:10.643794 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:10.656195 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:10.670030 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:10.682695 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:54:10.695306 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:54:10.815608 tst ping_idle_ping.py:24: start network... 21:54:11.021055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:54:11.511835 run create_hlr_db(pid=4677): Launched 21:54:11.676274 bus /gobi_6: Setting Powered False 21:54:12.737451 run create_hlr_db(pid=4677): Terminated: ok {rc=0} 21:54:13.181650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4679): Launched 21:54:13.516876 run osmo-hlr_10.42.42.2(pid=4680): Launched 21:54:13.765635 run osmo-stp_10.42.42.5: Starting osmo-stp 21:54:14.431714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4682): Launched 21:54:14.777669 run osmo-stp_10.42.42.5(pid=4683): Launched 21:54:15.020376 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:54:15.677691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4685): Launched 21:54:15.807675 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:54:16.112356 run patchelf(pid=4686): Launched 21:54:16.307917 run osmo-stp_10.42.42.5(pid=4683): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4683)] 21:54:16.463696 run osmo-stp_10.42.42.5(pid=4683): stdout: | (launched: 2022-12-13_21:54:14.707678) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:16.604451 run osmo-stp_10.42.42.5(pid=4683): stderr: | 20221213215415006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215415006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215415007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215415007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215415007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215415008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215415008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:16.745358 run osmo-stp_10.42.42.5(pid=4683): stdout: | (launched: 2022-12-13_21:54:14.707678) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:16.880420 run osmo-stp_10.42.42.5(pid=4683): stderr: | 20221213215415006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215415006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215415007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215415007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215415007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215415008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215415008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:17.041093 run patchelf(pid=4686): Terminating (SIGINT) 21:54:17.224679 run patchelf(pid=4686): Terminated: ok {rc=0} 21:54:17.357593 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4683): Process ended prematurely: osmo-stp_10.42.42.5(pid=4683) [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4683)] [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 21:54:17.368278 tst ping_idle_ping.py:27: Test FAILED (7.3 sec) 21:54:17.397855 run osmo-hlr_10.42.42.2(pid=4680): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4680)] 21:54:17.453106 run osmo-hlr_10.42.42.2(pid=4680): stdout: | (launched: 2022-12-13_21:54:13.451377) 21:54:17.509115 run osmo-hlr_10.42.42.2(pid=4680): stderr: | 20221213215413759 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215413759 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215413759 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215413759 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215413759 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215413759 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215413783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215413800 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215413800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215413800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:54:17.564182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4679): Terminating (SIGTERM) 21:54:17.607805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4682): Terminating (SIGTERM) 21:54:17.654198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4685): Terminating (SIGTERM) 21:54:17.701217 --- ParallelTerminationStrategy: PID 4679 died... 21:54:17.723287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4679): Terminated: ok {rc=0} 21:54:17.773195 --- ParallelTerminationStrategy: PID 4682 died... 21:54:17.794894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4682): Terminated: ok {rc=0} 21:54:17.845112 --- ParallelTerminationStrategy: PID 4685 died... 21:54:17.866769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4685): Terminated: ok {rc=0} 21:54:17.960061 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:54:19.259635 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:54:19.266842 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:54:19.288246 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 21:54:19.325201 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:54:19.378678 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:54:19.400272 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 21:54:19.436375 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:54:19.993335 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2395 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 21:54:19.999959 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:20.012715 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:54:20.071127 tst switch_tch_pdch.py: using LAC 36470 21:54:20.192135 tst switch_tch_pdch.py: using RAC 5 21:54:20.313395 tst switch_tch_pdch.py: using CellId 36470 21:54:20.437226 tst switch_tch_pdch.py: using BVCI 36471 21:54:20.551351 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:20.564104 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:20.576081 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:20.588250 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:20.600413 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:20.612935 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:20.626140 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:54:20.638279 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:54:20.758977 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:54:20.877950 tst switch_tch_pdch.py:51: start network... 21:54:21.083368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:54:21.570137 run create_hlr_db(pid=4690): Launched 21:54:21.732748 bus /gobi_6: Setting Powered False 21:54:22.794854 run create_hlr_db(pid=4690): Terminated: ok {rc=0} 21:54:23.241672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4692): Launched 21:54:23.561166 run osmo-hlr_10.42.42.2(pid=4693): Launched 21:54:23.802588 run osmo-stp_10.42.42.5: Starting osmo-stp 21:54:24.532789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4695): Launched 21:54:24.860602 run osmo-stp_10.42.42.5(pid=4696): Launched 21:54:25.105173 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:54:25.691126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4699): Launched 21:54:25.812082 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:54:26.081611 run patchelf(pid=4700): Launched 21:54:26.257475 run osmo-stp_10.42.42.5(pid=4696): ERR: Terminated: ERROR {rc=1} [trial-2395↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4696)] 21:54:26.392013 run osmo-stp_10.42.42.5(pid=4696): stdout: | (launched: 2022-12-13_21:54:24.796524) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:26.527937 run osmo-stp_10.42.42.5(pid=4696): stderr: | 20221213215425140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215425140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215425140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215425141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215425141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215425141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215425142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:26.663881 run osmo-stp_10.42.42.5(pid=4696): stdout: | (launched: 2022-12-13_21:54:24.796524) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:26.794106 run osmo-stp_10.42.42.5(pid=4696): stderr: | 20221213215425140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215425140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215425140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215425141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215425141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215425141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215425142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:26.949003 run patchelf(pid=4700): Terminating (SIGINT) 21:54:27.128114 run patchelf(pid=4700): Terminated: ok {rc=0} 21:54:27.257142 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4696): Process ended prematurely: osmo-stp_10.42.42.5(pid=4696) [trial-2395↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4696)] [trial-2395↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 21:54:27.266613 tst switch_tch_pdch.py:54: Test FAILED (7.3 sec) 21:54:27.294387 run osmo-hlr_10.42.42.2(pid=4693): ERR: Terminated: ERROR {rc=237} [trial-2395↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4693)] 21:54:27.344909 run osmo-hlr_10.42.42.2(pid=4693): stdout: | (launched: 2022-12-13_21:54:23.496133) 21:54:27.397126 run osmo-hlr_10.42.42.2(pid=4693): stderr: | 20221213215423846 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215423846 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215423847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215423847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215423847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215423847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215423865 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215423881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215423881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215423882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:54:27.449147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4692): Terminating (SIGTERM) 21:54:27.491138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4695): Terminating (SIGTERM) 21:54:27.533226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4699): Terminating (SIGTERM) 21:54:27.575924 --- ParallelTerminationStrategy: PID 4692 died... 21:54:27.596526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4692): Terminated: ok {rc=0} 21:54:27.642827 --- ParallelTerminationStrategy: PID 4695 died... 21:54:27.662927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4695): Terminated: ok {rc=0} 21:54:27.709081 --- ParallelTerminationStrategy: PID 4699 died... 21:54:27.728924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4699): Terminated: ok {rc=0} 21:54:27.816576 bus /gobi_0: Setting Powered False 21:54:28.915418 bus /gobi_0: Setting Powered False 21:54:30.030220 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 21:54:31.298404 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:54:31.306564 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 21:54:31.332296 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 21:54:31.373177 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 21:54:31.434469 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 21:54:31.457259 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 21:54:31.495342 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 21:54:32.043571 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2395 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 21:54:32.049239 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:32.060578 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 21:54:32.115920 tst switch_tch_pdch.py: using LAC 36471 21:54:32.245230 tst switch_tch_pdch.py: using RAC 6 21:54:32.375181 tst switch_tch_pdch.py: using CellId 36471 21:54:32.499482 tst switch_tch_pdch.py: using BVCI 36472 21:54:32.616566 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:32.628053 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:32.639316 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:32.650579 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:32.662584 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:32.674875 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:32.687135 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:54:32.699096 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:54:32.818151 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:54:32.937233 tst switch_tch_pdch.py:51: start network... 21:54:33.151178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:54:33.616092 run create_hlr_db(pid=4704): Launched 21:54:33.737581 bus /gobi_6: Setting Powered False 21:54:34.801470 run create_hlr_db(pid=4704): Terminated: ok {rc=0} 21:54:35.203545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4706): Launched 21:54:35.501584 run osmo-hlr_10.42.42.2(pid=4707): Launched 21:54:35.615501 run osmo-stp_10.42.42.5: Starting osmo-stp 21:54:36.101667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4709): Launched 21:54:36.398206 run osmo-stp_10.42.42.5(pid=4710): Launched 21:54:36.510938 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:54:36.999031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4712): Launched 21:54:37.112637 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:54:37.363995 run patchelf(pid=4713): Launched 21:54:37.529281 run osmo-stp_10.42.42.5(pid=4710): ERR: Terminated: ERROR {rc=1} [trial-2395↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4710)] 21:54:37.655367 run osmo-stp_10.42.42.5(pid=4710): stdout: | (launched: 2022-12-13_21:54:36.342684) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:37.782665 run osmo-stp_10.42.42.5(pid=4710): stderr: | 20221213215436513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215436513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215436513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215436514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215436514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215436514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215436514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:37.910153 run osmo-stp_10.42.42.5(pid=4710): stdout: | (launched: 2022-12-13_21:54:36.342684) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:38.032565 run osmo-stp_10.42.42.5(pid=4710): stderr: | 20221213215436513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215436513 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215436513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215436514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215436514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215436514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215436514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:38.177081 run patchelf(pid=4713): Terminating (SIGINT) 21:54:38.343150 run patchelf(pid=4713): Terminated: ok {rc=0} 21:54:38.463366 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4710): Process ended prematurely: osmo-stp_10.42.42.5(pid=4710) [trial-2395↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4710)] [trial-2395↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 21:54:38.472133 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 21:54:38.498590 run osmo-hlr_10.42.42.2(pid=4707): ERR: Terminated: ERROR {rc=237} [trial-2395↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4707)] 21:54:38.546405 run osmo-hlr_10.42.42.2(pid=4707): stdout: | (launched: 2022-12-13_21:54:35.446492) 21:54:38.595452 run osmo-hlr_10.42.42.2(pid=4707): stderr: | 20221213215435623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215435623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215435623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215435623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215435623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215435623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215435644 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215435653 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215435653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215435653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:54:38.645028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4706): Terminating (SIGTERM) 21:54:38.684446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4709): Terminating (SIGTERM) 21:54:38.723765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4712): Terminating (SIGTERM) 21:54:38.763521 --- ParallelTerminationStrategy: PID 4706 died... 21:54:38.782700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4706): Terminated: ok {rc=0} 21:54:38.826696 --- ParallelTerminationStrategy: PID 4709 died... 21:54:38.845537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4709): Terminated: ok {rc=0} 21:54:38.889502 --- ParallelTerminationStrategy: PID 4712 died... 21:54:38.908358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4712): Terminated: ok {rc=0} 21:54:38.994768 bus /gobi_0: Setting Powered False 21:54:40.095142 bus /gobi_0: Setting Powered False 21:54:41.211920 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_sms:oc2g --------------------------------------------------------------------- 21:54:42.453961 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:54:42.459314 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 21:54:42.481221 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 21:54:42.488032 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 21:54:42.542222 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 21:54:42.563177 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 21:54:42.570112 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 21:54:43.108899 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 21:54:43.114330 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 21:54:43.125417 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 21:54:43.159840 tst mo_mt_sms.py: using LAC 36472 21:54:43.276379 tst mo_mt_sms.py: using RAC 7 21:54:43.395458 tst mo_mt_sms.py: using CellId 36472 21:54:43.512171 tst mo_mt_sms.py: using BVCI 36473 21:54:43.619657 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 21:54:43.737677 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 21:54:43.853898 tst mo_mt_sms.py:9: start nitb and bts... 21:54:44.053858 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:54:44.663652 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4719): Launched 21:54:44.961718 run osmo-nitb_10.42.42.2(pid=4720): Launched 21:54:45.126351 run osmo-nitb_10.42.42.2(pid=4720): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4720)] 21:54:45.260074 run osmo-nitb_10.42.42.2(pid=4720): stdout: | (launched: 2022-12-13_21:54:44.906519) 21:54:45.394631 run osmo-nitb_10.42.42.2(pid=4720): stderr: | (launched: 2022-12-13_21:54:44.950818) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:54:45.528851 run osmo-nitb_10.42.42.2(pid=4720): stdout: | (launched: 2022-12-13_21:54:44.906519) 21:54:45.658251 run osmo-nitb_10.42.42.2(pid=4720): stderr: | (launched: 2022-12-13_21:54:44.950818) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4720): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4720) [trial-2395↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4720)] 21:54:46.073723 tst osmo-nitb_10.42.42.2(pid=4720): stdout: | (launched: 2022-12-13_21:54:44.906519) 21:54:46.195927 tst osmo-nitb_10.42.42.2(pid=4720): stderr: | (launched: 2022-12-13_21:54:44.950818) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:54:46.340248 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=4720): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4720) [trial-2395↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4720)] [trial-2395↪nitb_sms:oc2g↪mo_mt_sms.py:11] 21:54:46.349755 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 21:54:46.357277 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4719): Terminating (SIGTERM) 21:54:46.566448 --- ParallelTerminationStrategy: PID 4719 died... 21:54:46.590271 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4719): Terminated: ok {rc=0} 21:54:46.693140 bus /sierra_3: Setting Powered False 21:54:47.798843 bus /sierra_3: Setting Powered False 21:54:48.914522 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 sms:oc2g --------------------------------------------------------------------- 21:54:50.094747 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:54:50.098491 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 21:54:50.118675 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 21:54:50.144812 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 21:54:50.195680 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 21:54:50.216555 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 21:54:50.243368 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 21:54:50.787691 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 sms:oc2g mo_mt_sms.py ---------------------------------------------- 21:54:50.792677 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:50.803199 tst sms:oc2g: Using 1 x bts (candidates: 1) 21:54:50.837655 tst mo_mt_sms.py: using LAC 36473 21:54:50.955603 tst mo_mt_sms.py: using RAC 8 21:54:51.072060 tst mo_mt_sms.py: using CellId 36473 21:54:51.188819 tst mo_mt_sms.py: using BVCI 36474 21:54:51.295638 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:51.306192 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:51.316403 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:51.326696 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:51.336854 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 21:54:51.347161 tst sms:oc2g: Using 1 x modem (candidates: 2) 21:54:51.466447 tst sms:oc2g: Using 1 x modem (candidates: 2) 21:54:51.580274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:54:52.041659 run create_hlr_db(pid=4725): Launched 21:54:52.162661 bus /sierra_2: Setting Powered False 21:54:53.221823 run create_hlr_db(pid=4725): Terminated: ok {rc=0} 21:54:53.658798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4727): Launched 21:54:53.978921 run osmo-hlr_10.42.42.2(pid=4728): Launched 21:54:54.101270 run osmo-stp_10.42.42.5: Starting osmo-stp 21:54:54.651121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4730): Launched 21:54:54.970337 run osmo-stp_10.42.42.5(pid=4731): Launched 21:54:55.092318 run osmo-msc_10.42.42.6: Starting osmo-msc 21:54:55.669807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4733): Launched 21:54:55.987921 run osmo-msc_10.42.42.6(pid=4734): Launched 21:54:56.166596 run osmo-stp_10.42.42.5(pid=4731): ERR: Terminated: ERROR {rc=1} [trial-2395↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4731)] 21:54:56.301741 run osmo-stp_10.42.42.5(pid=4731): stdout: | (launched: 2022-12-13_21:54:54.911051) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:56.437612 run osmo-stp_10.42.42.5(pid=4731): stderr: | 20221213215455102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215455102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215455102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215455102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215455105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215455105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215455105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:56.572270 run osmo-stp_10.42.42.5(pid=4731): stdout: | (launched: 2022-12-13_21:54:54.911051) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:54:56.699768 run osmo-stp_10.42.42.5(pid=4731): stderr: | 20221213215455102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215455102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215455102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215455102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215455105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215455105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215455105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:54:56.851578 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=4731): Process ended prematurely: osmo-stp_10.42.42.5(pid=4731) [trial-2395↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4731)] [trial-2395↪sms:oc2g↪mo_mt_sms.py:16] 21:54:56.860322 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 21:54:56.887346 run osmo-hlr_10.42.42.2(pid=4728): ERR: Terminated: ERROR {rc=237} [trial-2395↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4728)] 21:54:56.938090 run osmo-hlr_10.42.42.2(pid=4728): stdout: | (launched: 2022-12-13_21:54:53.919934) 21:54:56.989861 run osmo-hlr_10.42.42.2(pid=4728): stderr: | 20221213215454118 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215454118 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215454118 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215454118 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215454118 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215454118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215454131 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215454139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215454140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215454140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:54:57.061983 run osmo-msc_10.42.42.6(pid=4734): ERR: Terminated: ERROR {rc=2} [trial-2395↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4734)] 21:54:57.111547 run osmo-msc_10.42.42.6(pid=4734): stdout: | (launched: 2022-12-13_21:54:55.928733) 21:54:57.163034 run osmo-msc_10.42.42.6(pid=4734): stderr: | 20221213215456250 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215456250 DLGLOBAL DEBUG validating counter group 0x7ff86fc3fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215456250 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215456250 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215456250 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215456251 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215456252 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215456253 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215456253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215456253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:54:57.214329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4727): Terminating (SIGTERM) 21:54:57.255568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4730): Terminating (SIGTERM) 21:54:57.297149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4733): Terminating (SIGTERM) 21:54:57.338786 --- ParallelTerminationStrategy: PID 4727 died... 21:54:57.358912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4727): Terminated: ok {rc=0} 21:54:57.404799 --- ParallelTerminationStrategy: PID 4730 died... 21:54:57.424871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4730): Terminated: ok {rc=0} 21:54:57.470887 --- ParallelTerminationStrategy: PID 4733 died... 21:54:57.490672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4733): Terminated: ok {rc=0} 21:54:57.577538 bus /sierra_3: Setting Powered False 21:54:58.675095 bus /sierra_3: Setting Powered False 21:54:59.790225 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_ussd:oc2g --------------------------------------------------------------------- 21:55:01.028139 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:55:01.032801 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 21:55:01.054799 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 21:55:01.062794 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 21:55:01.103307 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 21:55:01.137043 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 21:55:01.149171 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 21:55:01.664170 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2395 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 21:55:01.671749 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 21:55:01.684433 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 21:55:01.728737 tst assert_extension.py: using LAC 36474 21:55:01.860338 tst assert_extension.py: using RAC 9 21:55:01.989554 tst assert_extension.py: using CellId 36474 21:55:02.122085 tst assert_extension.py: using BVCI 36475 21:55:02.249663 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 21:55:02.383170 tst assert_extension.py:10: start nitb and bts... 21:55:02.599930 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:55:03.250588 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4742): Launched 21:55:03.570186 run osmo-nitb_10.42.42.2(pid=4743): Launched 21:55:03.746517 run osmo-nitb_10.42.42.2(pid=4743): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4743)] 21:55:03.890197 run osmo-nitb_10.42.42.2(pid=4743): stdout: | (launched: 2022-12-13_21:55:03.511490) 21:55:04.036111 run osmo-nitb_10.42.42.2(pid=4743): stderr: | (launched: 2022-12-13_21:55:03.558836) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:55:04.181342 run osmo-nitb_10.42.42.2(pid=4743): stdout: | (launched: 2022-12-13_21:55:03.511490) 21:55:04.320924 run osmo-nitb_10.42.42.2(pid=4743): stderr: | (launched: 2022-12-13_21:55:03.558836) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4743): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4743) [trial-2395↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4743)] 21:55:04.690277 tst osmo-nitb_10.42.42.2(pid=4743): stdout: | (launched: 2022-12-13_21:55:03.511490) 21:55:04.819440 tst osmo-nitb_10.42.42.2(pid=4743): stderr: | (launched: 2022-12-13_21:55:03.558836) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:55:04.971510 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=4743): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4743) [trial-2395↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4743)] [trial-2395↪nitb_ussd:oc2g↪assert_extension.py:12] 21:55:04.980398 tst assert_extension.py:12: Test FAILED (3.3 sec) 21:55:04.987685 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4742): Terminating (SIGTERM) 21:55:05.198828 --- ParallelTerminationStrategy: PID 4742 died... 21:55:05.220840 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4742): Terminated: ok {rc=0} 21:55:05.309729 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 ussd:oc2g --------------------------------------------------------------------- 21:55:06.479224 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:55:06.483379 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 21:55:06.504245 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 21:55:06.533189 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 21:55:06.567383 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 21:55:06.588623 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 21:55:06.615707 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 21:55:07.145735 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2395 ussd:oc2g assert_extension.py ---------------------------------------------- 21:55:07.150818 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:07.161686 tst ussd:oc2g: Using 1 x bts (candidates: 1) 21:55:07.195397 tst assert_extension.py: using LAC 36475 21:55:07.319133 tst assert_extension.py: using RAC 10 21:55:07.442857 tst assert_extension.py: using CellId 36475 21:55:07.565258 tst assert_extension.py: using BVCI 36476 21:55:07.680450 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:07.691418 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:07.702249 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:07.712890 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:07.724052 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 21:55:07.735508 tst ussd:oc2g: Using 1 x modem (candidates: 1) 21:55:07.855774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:08.350272 run create_hlr_db(pid=4747): Launched 21:55:08.470717 bus /sierra_2: Setting Powered False 21:55:09.533600 run create_hlr_db(pid=4747): Terminated: ok {rc=0} 21:55:09.961201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4749): Launched 21:55:10.260845 run osmo-hlr_10.42.42.2(pid=4750): Launched 21:55:10.375137 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:10.893812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4752): Launched 21:55:11.191436 run osmo-stp_10.42.42.5(pid=4753): Launched 21:55:11.304730 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:11.841717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4755): Launched 21:55:12.139157 run osmo-msc_10.42.42.6(pid=4756): Launched 21:55:12.306089 run osmo-stp_10.42.42.5(pid=4753): ERR: Terminated: ERROR {rc=1} [trial-2395↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4753)] 21:55:12.431573 run osmo-stp_10.42.42.5(pid=4753): stdout: | (launched: 2022-12-13_21:55:11.136208) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:12.557799 run osmo-stp_10.42.42.5(pid=4753): stderr: | 20221213215511307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215511307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215511308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215511308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215511308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215511309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215511309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:12.681837 run osmo-stp_10.42.42.5(pid=4753): stdout: | (launched: 2022-12-13_21:55:11.136208) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:12.799762 run osmo-stp_10.42.42.5(pid=4753): stderr: | 20221213215511307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215511307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215511308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215511308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215511308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215511309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215511309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:12.941622 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=4753): Process ended prematurely: osmo-stp_10.42.42.5(pid=4753) [trial-2395↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4753)] [trial-2395↪ussd:oc2g↪assert_extension.py:17] 21:55:12.949864 tst assert_extension.py:17: Test FAILED (5.8 sec) 21:55:12.975806 run osmo-hlr_10.42.42.2(pid=4750): ERR: Terminated: ERROR {rc=237} [trial-2395↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4750)] 21:55:13.023123 run osmo-hlr_10.42.42.2(pid=4750): stdout: | (launched: 2022-12-13_21:55:10.204893) 21:55:13.071929 run osmo-hlr_10.42.42.2(pid=4750): stderr: | 20221213215510381 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215510381 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215510381 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215510381 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215510381 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215510381 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215510393 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215510402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215510402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215510402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:55:13.140320 run osmo-msc_10.42.42.6(pid=4756): ERR: Terminated: ERROR {rc=2} [trial-2395↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4756)] 21:55:13.187328 run osmo-msc_10.42.42.6(pid=4756): stdout: | (launched: 2022-12-13_21:55:12.083312) 21:55:13.236624 run osmo-msc_10.42.42.6(pid=4756): stderr: | 20221213215512356 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215512356 DLGLOBAL DEBUG validating counter group 0x7fbb0538bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215512356 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215512356 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215512357 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215512357 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215512358 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215512359 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215512359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215512359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:55:13.285977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4749): Terminating (SIGTERM) 21:55:13.325454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4752): Terminating (SIGTERM) 21:55:13.364883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4755): Terminating (SIGTERM) 21:55:13.404569 --- ParallelTerminationStrategy: PID 4749 died... 21:55:13.423809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4749): Terminated: ok {rc=0} 21:55:13.467437 --- ParallelTerminationStrategy: PID 4752 died... 21:55:13.486130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4752): Terminated: ok {rc=0} 21:55:13.529720 --- ParallelTerminationStrategy: PID 4755 died... 21:55:13.548215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4755): Terminated: ok {rc=0} 21:55:13.631837 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 21:55:14.824368 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:55:14.830679 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 21:55:14.850962 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 21:55:14.878822 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 21:55:14.930970 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 21:55:14.951950 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 21:55:14.978545 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 21:55:15.526031 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 21:55:15.575660 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:15.586743 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:55:15.641732 tst mo_mt_call.py: using LAC 36476 21:55:15.771139 tst mo_mt_call.py: using RAC 11 21:55:15.904227 tst mo_mt_call.py: using CellId 36476 21:55:16.038570 tst mo_mt_call.py: using BVCI 36477 21:55:16.195615 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:16.208855 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:16.220719 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:16.232808 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:16.246404 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:16.260134 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:55:16.389699 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:55:16.547046 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:17.072819 run create_hlr_db(pid=4761): Launched 21:55:17.219958 bus /sierra_2: Setting Powered False 21:55:18.283652 run create_hlr_db(pid=4761): Terminated: ok {rc=0} 21:55:18.718219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4763): Launched 21:55:19.022389 run osmo-hlr_10.42.42.2(pid=4764): Launched 21:55:19.137387 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:19.657294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4766): Launched 21:55:19.960349 run osmo-stp_10.42.42.5(pid=4767): Launched 21:55:20.075643 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:20.623579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4769): Launched 21:55:20.927185 run osmo-msc_10.42.42.6(pid=4770): Launched 21:55:21.096223 run osmo-stp_10.42.42.5(pid=4767): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4767)] 21:55:21.223206 run osmo-stp_10.42.42.5(pid=4767): stdout: | (launched: 2022-12-13_21:55:19.904326) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:21.351192 run osmo-stp_10.42.42.5(pid=4767): stderr: | 20221213215520077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215520077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215520077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215520078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215520078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215520078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215520078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:21.476628 run osmo-stp_10.42.42.5(pid=4767): stdout: | (launched: 2022-12-13_21:55:19.904326) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:21.597200 run osmo-stp_10.42.42.5(pid=4767): stderr: | 20221213215520077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215520077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215520077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215520078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215520078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215520078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215520078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:21.741260 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4767): Process ended prematurely: osmo-stp_10.42.42.5(pid=4767) [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4767)] [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 21:55:21.750057 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:55:21.776417 run osmo-hlr_10.42.42.2(pid=4764): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4764)] 21:55:21.824827 run osmo-hlr_10.42.42.2(pid=4764): stdout: | (launched: 2022-12-13_21:55:18.965967) 21:55:21.874133 run osmo-hlr_10.42.42.2(pid=4764): stderr: | 20221213215519141 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215519142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215519142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215519142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215519142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215519142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215519154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215519163 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215519163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215519163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:55:21.942804 run osmo-msc_10.42.42.6(pid=4770): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4770)] 21:55:21.990199 run osmo-msc_10.42.42.6(pid=4770): stdout: | (launched: 2022-12-13_21:55:20.870069) 21:55:22.039306 run osmo-msc_10.42.42.6(pid=4770): stderr: | 20221213215521144 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215521144 DLGLOBAL DEBUG validating counter group 0x7f32a54dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215521144 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215521144 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215521144 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215521145 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215521146 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215521147 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215521147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215521147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:55:22.089458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4763): Terminating (SIGTERM) 21:55:22.129199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4766): Terminating (SIGTERM) 21:55:22.169013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4769): Terminating (SIGTERM) 21:55:22.209059 --- ParallelTerminationStrategy: PID 4763 died... 21:55:22.228351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4763): Terminated: ok {rc=0} 21:55:22.272705 --- ParallelTerminationStrategy: PID 4766 died... 21:55:22.291861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4766): Terminated: ok {rc=0} 21:55:22.335645 --- ParallelTerminationStrategy: PID 4769 died... 21:55:22.354444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4769): Terminated: ok {rc=0} 21:55:22.439918 bus /sierra_3: Setting Powered False 21:55:23.538851 bus /sierra_3: Setting Powered False 21:55:24.655072 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 21:55:25.800464 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:25.812098 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:55:25.872591 tst mo_mt_call_osmux.py: using LAC 36477 21:55:25.999550 tst mo_mt_call_osmux.py: using RAC 12 21:55:26.125271 tst mo_mt_call_osmux.py: using CellId 36477 21:55:26.250258 tst mo_mt_call_osmux.py: using BVCI 36478 21:55:26.370049 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:26.381743 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:26.393243 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:26.404395 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:26.416114 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:55:26.427693 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:55:26.545586 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:55:26.666073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:27.171200 run create_hlr_db(pid=4772): Launched 21:55:27.295155 bus /sierra_2: Setting Powered False 21:55:28.359157 run create_hlr_db(pid=4772): Terminated: ok {rc=0} 21:55:28.793222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4774): Launched 21:55:29.095651 run osmo-hlr_10.42.42.2(pid=4775): Launched 21:55:29.210610 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:29.732460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4777): Launched 21:55:30.035735 run osmo-stp_10.42.42.5(pid=4778): Launched 21:55:30.151317 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:30.701630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4780): Launched 21:55:31.066013 run osmo-msc_10.42.42.6(pid=4781): Launched 21:55:31.517162 run osmo-stp_10.42.42.5(pid=4778): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4778)] 21:55:31.686097 run osmo-stp_10.42.42.5(pid=4778): stdout: | (launched: 2022-12-13_21:55:29.979479) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:31.833269 run osmo-stp_10.42.42.5(pid=4778): stderr: | 20221213215530150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215530150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215530150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215530151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215530151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215530151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215530151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:31.974882 run osmo-stp_10.42.42.5(pid=4778): stdout: | (launched: 2022-12-13_21:55:29.979479) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:32.108359 run osmo-stp_10.42.42.5(pid=4778): stderr: | 20221213215530150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215530150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215530150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215530151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215530151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215530151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215530151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:32.268847 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4778): Process ended prematurely: osmo-stp_10.42.42.5(pid=4778) [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4778)] [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 21:55:32.280046 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 21:55:32.309748 run osmo-hlr_10.42.42.2(pid=4775): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4775)] 21:55:32.361140 run osmo-hlr_10.42.42.2(pid=4775): stdout: | (launched: 2022-12-13_21:55:29.039831) 21:55:32.414315 run osmo-hlr_10.42.42.2(pid=4775): stderr: | 20221213215529219 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215529219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215529219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215529219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215529219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215529219 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215529270 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215529282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215529282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215529282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:55:32.486936 run osmo-msc_10.42.42.6(pid=4781): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4781)] 21:55:32.536888 run osmo-msc_10.42.42.6(pid=4781): stdout: | (launched: 2022-12-13_21:55:30.984302) 21:55:32.588938 run osmo-msc_10.42.42.6(pid=4781): stderr: | 20221213215531327 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215531328 DLGLOBAL DEBUG validating counter group 0x7fc6c7d0ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215531328 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215531328 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215531328 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215531328 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215531330 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215531330 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215531331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215531331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:55:32.641297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4774): Terminating (SIGTERM) 21:55:32.683855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4777): Terminating (SIGTERM) 21:55:32.726529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4780): Terminating (SIGTERM) 21:55:32.769038 --- ParallelTerminationStrategy: PID 4774 died... 21:55:32.789570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4774): Terminated: ok {rc=0} 21:55:32.836190 --- ParallelTerminationStrategy: PID 4777 died... 21:55:32.856221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4777): Terminated: ok {rc=0} 21:55:32.902666 --- ParallelTerminationStrategy: PID 4780 died... 21:55:32.922773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4780): Terminated: ok {rc=0} 21:55:33.011108 bus /sierra_3: Setting Powered False 21:55:34.109118 bus /sierra_3: Setting Powered False 21:55:35.223940 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 21:55:36.462663 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:55:36.471257 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 21:55:36.492374 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 21:55:36.520352 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 21:55:36.573402 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 21:55:36.594090 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 21:55:36.621077 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 21:55:37.171753 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 21:55:37.225276 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:37.236628 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:55:37.294529 tst mo_mt_call.py: using LAC 36478 21:55:37.423437 tst mo_mt_call.py: using RAC 13 21:55:37.550385 tst mo_mt_call.py: using CellId 36478 21:55:37.676674 tst mo_mt_call.py: using BVCI 36479 21:55:37.794103 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:37.805711 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:37.817125 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:37.828373 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:37.839879 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:37.851540 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:55:37.967099 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:55:38.086327 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:38.592770 run create_hlr_db(pid=4786): Launched 21:55:38.716047 bus /sierra_2: Setting Powered False 21:55:39.781275 run create_hlr_db(pid=4786): Terminated: ok {rc=0} 21:55:40.216124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4788): Launched 21:55:40.521207 run osmo-hlr_10.42.42.2(pid=4789): Launched 21:55:40.637573 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:41.173816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4791): Launched 21:55:41.476114 run osmo-stp_10.42.42.5(pid=4792): Launched 21:55:41.591243 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:42.137644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4794): Launched 21:55:42.439737 run osmo-msc_10.42.42.6(pid=4795): Launched 21:55:42.610471 run osmo-stp_10.42.42.5(pid=4792): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4792)] 21:55:42.738614 run osmo-stp_10.42.42.5(pid=4792): stdout: | (launched: 2022-12-13_21:55:41.420242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:42.866353 run osmo-stp_10.42.42.5(pid=4792): stderr: | 20221213215541592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215541592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215541593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215541593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215541594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215541594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215541594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:42.991929 run osmo-stp_10.42.42.5(pid=4792): stdout: | (launched: 2022-12-13_21:55:41.420242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:43.112259 run osmo-stp_10.42.42.5(pid=4792): stderr: | 20221213215541592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215541592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215541593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215541593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215541594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215541594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215541594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:43.256097 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4792): Process ended prematurely: osmo-stp_10.42.42.5(pid=4792) [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4792)] [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 21:55:43.265035 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 21:55:43.291447 run osmo-hlr_10.42.42.2(pid=4789): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4789)] 21:55:43.339736 run osmo-hlr_10.42.42.2(pid=4789): stdout: | (launched: 2022-12-13_21:55:40.465301) 21:55:43.388911 run osmo-hlr_10.42.42.2(pid=4789): stderr: | 20221213215540640 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215540640 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215540640 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215540640 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215540640 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215540640 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215540652 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215540660 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215540661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215540661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:55:43.457634 run osmo-msc_10.42.42.6(pid=4795): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4795)] 21:55:43.505081 run osmo-msc_10.42.42.6(pid=4795): stdout: | (launched: 2022-12-13_21:55:42.383734) 21:55:43.554530 run osmo-msc_10.42.42.6(pid=4795): stderr: | 20221213215542657 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215542657 DLGLOBAL DEBUG validating counter group 0x7fd72a2a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215542657 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215542657 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215542657 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215542657 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215542659 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215542660 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215542660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215542660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:55:43.604085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4788): Terminating (SIGTERM) 21:55:43.643458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4791): Terminating (SIGTERM) 21:55:43.683036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4794): Terminating (SIGTERM) 21:55:43.722697 --- ParallelTerminationStrategy: PID 4788 died... 21:55:43.742018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4788): Terminated: ok {rc=0} 21:55:43.785871 --- ParallelTerminationStrategy: PID 4791 died... 21:55:43.804291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4791): Terminated: ok {rc=0} 21:55:43.848072 --- ParallelTerminationStrategy: PID 4794 died... 21:55:43.866659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4794): Terminated: ok {rc=0} 21:55:43.951635 bus /sierra_3: Setting Powered False 21:55:45.050623 bus /sierra_3: Setting Powered False 21:55:46.163632 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 21:55:47.315502 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:47.327735 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:55:47.392443 tst mo_mt_call_osmux.py: using LAC 36479 21:55:47.520840 tst mo_mt_call_osmux.py: using RAC 14 21:55:47.648165 tst mo_mt_call_osmux.py: using CellId 36479 21:55:47.776322 tst mo_mt_call_osmux.py: using BVCI 36480 21:55:47.895507 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:47.907171 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:47.918633 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:47.930026 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:47.941983 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:55:47.953856 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:55:48.074717 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:55:48.198369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:48.703973 run create_hlr_db(pid=4797): Launched 21:55:48.827465 bus /sierra_2: Setting Powered False 21:55:49.891794 run create_hlr_db(pid=4797): Terminated: ok {rc=0} 21:55:50.346051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4799): Launched 21:55:50.671926 run osmo-hlr_10.42.42.2(pid=4800): Launched 21:55:50.797026 run osmo-stp_10.42.42.5: Starting osmo-stp 21:55:51.358940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4802): Launched 21:55:51.684114 run osmo-stp_10.42.42.5(pid=4803): Launched 21:55:51.808338 run osmo-msc_10.42.42.6: Starting osmo-msc 21:55:52.403678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4806): Launched 21:55:52.730097 run osmo-msc_10.42.42.6(pid=4807): Launched 21:55:52.911477 run osmo-stp_10.42.42.5(pid=4803): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4803)] 21:55:53.049585 run osmo-stp_10.42.42.5(pid=4803): stdout: | (launched: 2022-12-13_21:55:51.624447) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:53.187149 run osmo-stp_10.42.42.5(pid=4803): stderr: | 20221213215551817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215551817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215551818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215551818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215551819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215551819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215551819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:53.324303 run osmo-stp_10.42.42.5(pid=4803): stdout: | (launched: 2022-12-13_21:55:51.624447) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:55:53.454507 run osmo-stp_10.42.42.5(pid=4803): stderr: | 20221213215551817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215551817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215551818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215551818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215551819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215551819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215551819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:55:53.610038 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4803): Process ended prematurely: osmo-stp_10.42.42.5(pid=4803) [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4803)] [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 21:55:53.619721 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:55:53.647547 run osmo-hlr_10.42.42.2(pid=4800): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4800)] 21:55:53.698521 run osmo-hlr_10.42.42.2(pid=4800): stdout: | (launched: 2022-12-13_21:55:50.612278) 21:55:53.750806 run osmo-hlr_10.42.42.2(pid=4800): stderr: | 20221213215550810 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215550810 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215550810 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215550810 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215550810 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215550810 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215550823 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215550831 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215550832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215550832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:55:53.823874 run osmo-msc_10.42.42.6(pid=4807): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4807)] 21:55:53.873858 run osmo-msc_10.42.42.6(pid=4807): stdout: | (launched: 2022-12-13_21:55:52.670261) 21:55:53.926178 run osmo-msc_10.42.42.6(pid=4807): stderr: | 20221213215552995 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215552995 DLGLOBAL DEBUG validating counter group 0x7f21dcf3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215552995 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215552995 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215552995 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215552995 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215552997 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215552998 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215552998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215552998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:55:53.979500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4799): Terminating (SIGTERM) 21:55:54.021573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4802): Terminating (SIGTERM) 21:55:54.063561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4806): Terminating (SIGTERM) 21:55:54.106022 --- ParallelTerminationStrategy: PID 4799 died... 21:55:54.126522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4799): Terminated: ok {rc=0} 21:55:54.172611 --- ParallelTerminationStrategy: PID 4802 died... 21:55:54.192230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4802): Terminated: ok {rc=0} 21:55:54.238563 --- ParallelTerminationStrategy: PID 4806 died... 21:55:54.258429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4806): Terminated: ok {rc=0} 21:55:54.346092 bus /sierra_3: Setting Powered False 21:55:55.441977 bus /sierra_3: Setting Powered False 21:55:56.556545 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 21:55:57.789983 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:55:57.796240 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 21:55:57.816352 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 21:55:57.842661 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 21:55:57.891739 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 21:55:57.912061 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 21:55:57.937985 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 21:55:58.489606 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 21:55:58.538757 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:58.549651 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:55:58.605182 tst mo_mt_call.py: using LAC 36480 21:55:58.724172 tst mo_mt_call.py: using RAC 15 21:55:58.842786 tst mo_mt_call.py: using CellId 36480 21:55:58.962709 tst mo_mt_call.py: using BVCI 36481 21:55:59.073189 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:59.084095 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:59.094737 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:59.105517 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:59.116191 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:55:59.128303 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:55:59.250605 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:55:59.367868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:55:59.875043 run create_hlr_db(pid=4812): Launched 21:56:00.000024 bus /sierra_2: Setting Powered False 21:56:01.085924 run create_hlr_db(pid=4812): Terminated: ok {rc=0} 21:56:01.591740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4814): Launched 21:56:01.938794 run osmo-hlr_10.42.42.2(pid=4815): Launched 21:56:02.138093 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:02.705610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4818): Launched 21:56:03.030558 run osmo-stp_10.42.42.5(pid=4819): Launched 21:56:03.154278 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:03.742731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4821): Launched 21:56:04.068902 run osmo-msc_10.42.42.6(pid=4822): Launched 21:56:04.251462 run osmo-stp_10.42.42.5(pid=4819): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4819)] 21:56:04.389853 run osmo-stp_10.42.42.5(pid=4819): stdout: | (launched: 2022-12-13_21:56:02.970869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:04.527656 run osmo-stp_10.42.42.5(pid=4819): stderr: | 20221213215603165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215603165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215603165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215603166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215603166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215603166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215603166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:04.664935 run osmo-stp_10.42.42.5(pid=4819): stdout: | (launched: 2022-12-13_21:56:02.970869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:04.794761 run osmo-stp_10.42.42.5(pid=4819): stderr: | 20221213215603165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215603165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215603165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215603166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215603166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215603166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215603166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:04.949881 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4819): Process ended prematurely: osmo-stp_10.42.42.5(pid=4819) [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4819)] [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 21:56:04.959348 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 21:56:04.987485 run osmo-hlr_10.42.42.2(pid=4815): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4815)] 21:56:05.038805 run osmo-hlr_10.42.42.2(pid=4815): stdout: | (launched: 2022-12-13_21:56:01.871193) 21:56:05.090605 run osmo-hlr_10.42.42.2(pid=4815): stderr: | 20221213215602229 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215602229 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215602229 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215602229 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215602229 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215602229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215602244 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215602254 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215602254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215602255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:05.163413 run osmo-msc_10.42.42.6(pid=4822): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4822)] 21:56:05.213520 run osmo-msc_10.42.42.6(pid=4822): stdout: | (launched: 2022-12-13_21:56:04.008873) 21:56:05.265400 run osmo-msc_10.42.42.6(pid=4822): stderr: | 20221213215604332 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215604332 DLGLOBAL DEBUG validating counter group 0x7f8e2b1b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215604332 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215604332 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215604332 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215604333 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215604334 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215604335 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215604335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215604335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:05.317675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4814): Terminating (SIGTERM) 21:56:05.359557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4818): Terminating (SIGTERM) 21:56:05.401071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4821): Terminating (SIGTERM) 21:56:05.443038 --- ParallelTerminationStrategy: PID 4814 died... 21:56:05.462967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4814): Terminated: ok {rc=0} 21:56:05.509159 --- ParallelTerminationStrategy: PID 4818 died... 21:56:05.528940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4818): Terminated: ok {rc=0} 21:56:05.575125 --- ParallelTerminationStrategy: PID 4821 died... 21:56:05.594923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4821): Terminated: ok {rc=0} 21:56:05.682762 bus /sierra_3: Setting Powered False 21:56:06.781447 bus /sierra_3: Setting Powered False 21:56:07.897507 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 21:56:09.045988 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:09.058083 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:56:09.120010 tst mo_mt_call_osmux.py: using LAC 36481 21:56:09.249332 tst mo_mt_call_osmux.py: using RAC 16 21:56:09.375615 tst mo_mt_call_osmux.py: using CellId 36481 21:56:09.502585 tst mo_mt_call_osmux.py: using BVCI 36482 21:56:09.621622 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:09.633203 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:09.644411 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:09.655665 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:09.667238 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:56:09.678877 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:56:09.796834 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:56:09.913817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:10.420625 run create_hlr_db(pid=4824): Launched 21:56:10.543608 bus /sierra_2: Setting Powered False 21:56:11.607412 run create_hlr_db(pid=4824): Terminated: ok {rc=0} 21:56:12.042672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4826): Launched 21:56:12.345822 run osmo-hlr_10.42.42.2(pid=4827): Launched 21:56:12.460234 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:12.998583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4829): Launched 21:56:13.301878 run osmo-stp_10.42.42.5(pid=4830): Launched 21:56:13.416942 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:13.963817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4832): Launched 21:56:14.267068 run osmo-msc_10.42.42.6(pid=4833): Launched 21:56:14.436117 run osmo-stp_10.42.42.5(pid=4830): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4830)] 21:56:14.563924 run osmo-stp_10.42.42.5(pid=4830): stdout: | (launched: 2022-12-13_21:56:13.245553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:14.691488 run osmo-stp_10.42.42.5(pid=4830): stderr: | 20221213215613418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215613418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215613418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215613419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215613419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215613419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215613419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:14.817836 run osmo-stp_10.42.42.5(pid=4830): stdout: | (launched: 2022-12-13_21:56:13.245553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:14.938398 run osmo-stp_10.42.42.5(pid=4830): stderr: | 20221213215613418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215613418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215613418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215613419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215613419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215613419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215613419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:15.082979 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4830): Process ended prematurely: osmo-stp_10.42.42.5(pid=4830) [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4830)] [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 21:56:15.091755 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 21:56:15.118235 run osmo-hlr_10.42.42.2(pid=4827): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4827)] 21:56:15.166120 run osmo-hlr_10.42.42.2(pid=4827): stdout: | (launched: 2022-12-13_21:56:12.289179) 21:56:15.215113 run osmo-hlr_10.42.42.2(pid=4827): stderr: | 20221213215612465 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215612465 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215612465 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215612466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215612466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215612466 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215612478 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215612487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215612487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215612487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:15.283634 run osmo-msc_10.42.42.6(pid=4833): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4833)] 21:56:15.331403 run osmo-msc_10.42.42.6(pid=4833): stdout: | (launched: 2022-12-13_21:56:14.210325) 21:56:15.380599 run osmo-msc_10.42.42.6(pid=4833): stderr: | 20221213215614484 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215614485 DLGLOBAL DEBUG validating counter group 0x7f305aaf0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215614485 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215614485 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215614485 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215614485 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215614487 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215614487 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215614487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215614488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:15.429998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4826): Terminating (SIGTERM) 21:56:15.469512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4829): Terminating (SIGTERM) 21:56:15.508920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4832): Terminating (SIGTERM) 21:56:15.548696 --- ParallelTerminationStrategy: PID 4826 died... 21:56:15.567993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4826): Terminated: ok {rc=0} 21:56:15.611609 --- ParallelTerminationStrategy: PID 4829 died... 21:56:15.630194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4829): Terminated: ok {rc=0} 21:56:15.673747 --- ParallelTerminationStrategy: PID 4832 died... 21:56:15.692144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4832): Terminated: ok {rc=0} 21:56:15.776861 bus /sierra_3: Setting Powered False 21:56:16.883460 bus /sierra_3: Setting Powered False 21:56:18.000302 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 21:56:19.237693 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:56:19.244681 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 21:56:19.265868 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 21:56:19.294783 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 21:56:19.347103 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 21:56:19.368096 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 21:56:19.396125 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 21:56:19.947467 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 21:56:19.996709 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:20.007737 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:56:20.063151 tst mo_mt_call.py: using LAC 36482 21:56:20.183305 tst mo_mt_call.py: using RAC 17 21:56:20.304120 tst mo_mt_call.py: using CellId 36482 21:56:20.424495 tst mo_mt_call.py: using BVCI 36483 21:56:20.535295 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:20.546257 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:20.556894 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:20.567564 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:20.578243 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:20.589810 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:56:20.704529 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:56:20.826800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:21.333090 run create_hlr_db(pid=4838): Launched 21:56:21.458259 bus /sierra_2: Setting Powered False 21:56:22.522875 run create_hlr_db(pid=4838): Terminated: ok {rc=0} 21:56:22.959747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4840): Launched 21:56:23.263918 run osmo-hlr_10.42.42.2(pid=4841): Launched 21:56:23.379570 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:23.943448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4843): Launched 21:56:24.251139 run osmo-stp_10.42.42.5(pid=4844): Launched 21:56:24.366757 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:24.915723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4846): Launched 21:56:25.218954 run osmo-msc_10.42.42.6(pid=4847): Launched 21:56:25.387936 run osmo-stp_10.42.42.5(pid=4844): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4844)] 21:56:25.515830 run osmo-stp_10.42.42.5(pid=4844): stdout: | (launched: 2022-12-13_21:56:24.195017) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:25.644139 run osmo-stp_10.42.42.5(pid=4844): stderr: | 20221213215624367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215624367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215624367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215624367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215624368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215624368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215624368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:25.770174 run osmo-stp_10.42.42.5(pid=4844): stdout: | (launched: 2022-12-13_21:56:24.195017) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:25.890567 run osmo-stp_10.42.42.5(pid=4844): stderr: | 20221213215624367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215624367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215624367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215624367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215624368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215624368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215624368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:26.035156 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4844): Process ended prematurely: osmo-stp_10.42.42.5(pid=4844) [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4844)] [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 21:56:26.043945 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 21:56:26.070395 run osmo-hlr_10.42.42.2(pid=4841): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4841)] 21:56:26.118170 run osmo-hlr_10.42.42.2(pid=4841): stdout: | (launched: 2022-12-13_21:56:23.207549) 21:56:26.167467 run osmo-hlr_10.42.42.2(pid=4841): stderr: | 20221213215623387 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215623387 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215623387 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215623387 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215623387 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215623387 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215623399 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215623410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215623410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215623410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:26.235926 run osmo-msc_10.42.42.6(pid=4847): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4847)] 21:56:26.283433 run osmo-msc_10.42.42.6(pid=4847): stdout: | (launched: 2022-12-13_21:56:25.162690) 21:56:26.332266 run osmo-msc_10.42.42.6(pid=4847): stderr: | 20221213215625435 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215625435 DLGLOBAL DEBUG validating counter group 0x7f547d7f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215625435 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215625435 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215625435 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215625435 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215625437 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215625437 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215625438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215625438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:26.381722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4840): Terminating (SIGTERM) 21:56:26.421012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4843): Terminating (SIGTERM) 21:56:26.460492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4846): Terminating (SIGTERM) 21:56:26.500128 --- ParallelTerminationStrategy: PID 4840 died... 21:56:26.519473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4840): Terminated: ok {rc=0} 21:56:26.563176 --- ParallelTerminationStrategy: PID 4843 died... 21:56:26.581923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4843): Terminated: ok {rc=0} 21:56:26.625555 --- ParallelTerminationStrategy: PID 4846 died... 21:56:26.643863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4846): Terminated: ok {rc=0} 21:56:26.727443 bus /sierra_3: Setting Powered False 21:56:27.825563 bus /sierra_3: Setting Powered False 21:56:28.941780 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 21:56:30.083726 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:30.095421 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 21:56:30.152466 tst mo_mt_call_osmux.py: using LAC 36483 21:56:30.280816 tst mo_mt_call_osmux.py: using RAC 18 21:56:30.408133 tst mo_mt_call_osmux.py: using CellId 36483 21:56:30.534754 tst mo_mt_call_osmux.py: using BVCI 36484 21:56:30.652423 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:30.663940 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:30.675132 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:30.686467 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:30.698152 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 21:56:30.709762 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:56:30.831575 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 21:56:30.967764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:31.492037 run create_hlr_db(pid=4849): Launched 21:56:31.652518 bus /sierra_2: Setting Powered False 21:56:32.716490 run create_hlr_db(pid=4849): Terminated: ok {rc=0} 21:56:33.171645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4851): Launched 21:56:33.497556 run osmo-hlr_10.42.42.2(pid=4852): Launched 21:56:33.622980 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:34.183272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4854): Launched 21:56:34.508359 run osmo-stp_10.42.42.5(pid=4855): Launched 21:56:34.632835 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:35.224272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4857): Launched 21:56:35.549743 run osmo-msc_10.42.42.6(pid=4858): Launched 21:56:35.731221 run osmo-stp_10.42.42.5(pid=4855): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4855)] 21:56:35.869567 run osmo-stp_10.42.42.5(pid=4855): stdout: | (launched: 2022-12-13_21:56:34.448480) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:36.008663 run osmo-stp_10.42.42.5(pid=4855): stderr: | 20221213215634640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215634641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215634641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215634641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215634642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215634642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215634642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:36.145277 run osmo-stp_10.42.42.5(pid=4855): stdout: | (launched: 2022-12-13_21:56:34.448480) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:36.274963 run osmo-stp_10.42.42.5(pid=4855): stderr: | 20221213215634640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215634641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215634641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215634641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215634642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215634642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215634642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:36.429791 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4855): Process ended prematurely: osmo-stp_10.42.42.5(pid=4855) [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4855)] [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 21:56:36.439179 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 21:56:36.466831 run osmo-hlr_10.42.42.2(pid=4852): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4852)] 21:56:36.517103 run osmo-hlr_10.42.42.2(pid=4852): stdout: | (launched: 2022-12-13_21:56:33.437569) 21:56:36.568817 run osmo-hlr_10.42.42.2(pid=4852): stderr: | 20221213215633638 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215633638 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215633638 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215633638 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215633638 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215633638 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215633650 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215633658 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215633659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215633659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:36.641092 run osmo-msc_10.42.42.6(pid=4858): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4858)] 21:56:36.690633 run osmo-msc_10.42.42.6(pid=4858): stdout: | (launched: 2022-12-13_21:56:35.489694) 21:56:36.742629 run osmo-msc_10.42.42.6(pid=4858): stderr: | 20221213215635811 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215635811 DLGLOBAL DEBUG validating counter group 0x7fc179a87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215635811 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215635812 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215635812 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215635812 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215635815 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215635816 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215635816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215635816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:36.794930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4851): Terminating (SIGTERM) 21:56:36.836628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4854): Terminating (SIGTERM) 21:56:36.878197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4857): Terminating (SIGTERM) 21:56:36.920231 --- ParallelTerminationStrategy: PID 4851 died... 21:56:36.940659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4851): Terminated: ok {rc=0} 21:56:36.987141 --- ParallelTerminationStrategy: PID 4854 died... 21:56:37.006890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4854): Terminated: ok {rc=0} 21:56:37.053268 --- ParallelTerminationStrategy: PID 4857 died... 21:56:37.073035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4857): Terminated: ok {rc=0} 21:56:37.160200 bus /sierra_3: Setting Powered False 21:56:38.257899 bus /sierra_3: Setting Powered False 21:56:39.374103 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 21:56:40.611987 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:56:40.619171 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 21:56:40.640184 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 21:56:40.668298 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 21:56:40.719252 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 21:56:40.740515 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 21:56:40.768190 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 21:56:41.321916 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 21:56:41.376721 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:41.388391 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:56:41.444589 tst mo_mt_call.py: using LAC 36484 21:56:41.564479 tst mo_mt_call.py: using RAC 19 21:56:41.681648 tst mo_mt_call.py: using CellId 36484 21:56:41.798864 tst mo_mt_call.py: using BVCI 36485 21:56:41.909691 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:41.920643 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:41.931607 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:41.942455 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:41.953332 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:41.963921 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:56:42.085700 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:56:42.201985 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:42.671667 run create_hlr_db(pid=4863): Launched 21:56:42.795051 bus /sierra_2: Setting Powered False 21:56:43.855956 run create_hlr_db(pid=4863): Terminated: ok {rc=0} 21:56:44.279353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4865): Launched 21:56:44.582970 run osmo-hlr_10.42.42.2(pid=4866): Launched 21:56:44.697855 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:45.242521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4868): Launched 21:56:45.546048 run osmo-stp_10.42.42.5(pid=4869): Launched 21:56:45.660464 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:46.255099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4871): Launched 21:56:46.676441 run osmo-msc_10.42.42.6(pid=4872): Launched 21:56:47.051481 run osmo-stp_10.42.42.5(pid=4869): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4869)] 21:56:47.367416 run osmo-stp_10.42.42.5(pid=4869): stdout: | (launched: 2022-12-13_21:56:45.489713) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:47.495933 run osmo-stp_10.42.42.5(pid=4869): stderr: | 20221213215645661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215645661 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215645662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215645662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215645663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215645663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215645663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:47.621781 run osmo-stp_10.42.42.5(pid=4869): stdout: | (launched: 2022-12-13_21:56:45.489713) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:47.742765 run osmo-stp_10.42.42.5(pid=4869): stderr: | 20221213215645661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215645661 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215645662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215645662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215645663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215645663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215645663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:47.887180 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4869): Process ended prematurely: osmo-stp_10.42.42.5(pid=4869) [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4869)] [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 21:56:47.896057 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 21:56:47.922599 run osmo-hlr_10.42.42.2(pid=4866): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4866)] 21:56:47.970334 run osmo-hlr_10.42.42.2(pid=4866): stdout: | (launched: 2022-12-13_21:56:44.526649) 21:56:48.019781 run osmo-hlr_10.42.42.2(pid=4866): stderr: | 20221213215644702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215644702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215644703 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215644703 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215644703 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215644703 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215644715 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215644724 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215644724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215644724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:48.088556 run osmo-msc_10.42.42.6(pid=4872): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4872)] 21:56:48.136220 run osmo-msc_10.42.42.6(pid=4872): stdout: | (launched: 2022-12-13_21:56:46.614286) 21:56:48.185418 run osmo-msc_10.42.42.6(pid=4872): stderr: | 20221213215647199 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215647199 DLGLOBAL DEBUG validating counter group 0x7f275f6ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215647199 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215647199 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215647199 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215647199 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215647204 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215647205 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215647205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215647205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:48.234917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4865): Terminating (SIGTERM) 21:56:48.274327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4868): Terminating (SIGTERM) 21:56:48.313925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4871): Terminating (SIGTERM) 21:56:48.353781 --- ParallelTerminationStrategy: PID 4865 died... 21:56:48.372697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4865): Terminated: ok {rc=0} 21:56:48.416917 --- ParallelTerminationStrategy: PID 4868 died... 21:56:48.436045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4868): Terminated: ok {rc=0} 21:56:48.479933 --- ParallelTerminationStrategy: PID 4871 died... 21:56:48.498561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4871): Terminated: ok {rc=0} 21:56:48.583759 bus /sierra_3: Setting Powered False 21:56:49.683141 bus /sierra_3: Setting Powered False 21:56:50.798997 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 21:56:51.946034 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:51.957586 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:56:52.013911 tst mo_mt_call_osmux.py: using LAC 36485 21:56:52.134170 tst mo_mt_call_osmux.py: using RAC 20 21:56:52.255297 tst mo_mt_call_osmux.py: using CellId 36485 21:56:52.378579 tst mo_mt_call_osmux.py: using BVCI 36486 21:56:52.497041 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:52.508696 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:52.520069 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:52.531500 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:52.543648 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:56:52.555581 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:56:52.674032 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:56:52.795026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:56:53.302664 run create_hlr_db(pid=4874): Launched 21:56:53.426178 bus /sierra_2: Setting Powered False 21:56:54.490506 run create_hlr_db(pid=4874): Terminated: ok {rc=0} 21:56:54.925332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4876): Launched 21:56:55.230878 run osmo-hlr_10.42.42.2(pid=4877): Launched 21:56:55.346334 run osmo-stp_10.42.42.5: Starting osmo-stp 21:56:55.873326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4879): Launched 21:56:56.176872 run osmo-stp_10.42.42.5(pid=4880): Launched 21:56:56.293379 run osmo-msc_10.42.42.6: Starting osmo-msc 21:56:56.842809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4882): Launched 21:56:57.147387 run osmo-msc_10.42.42.6(pid=4883): Launched 21:56:57.317058 run osmo-stp_10.42.42.5(pid=4880): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4880)] 21:56:57.445320 run osmo-stp_10.42.42.5(pid=4880): stdout: | (launched: 2022-12-13_21:56:56.120444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:57.573385 run osmo-stp_10.42.42.5(pid=4880): stderr: | 20221213215656290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215656290 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215656291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215656291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215656294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215656294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215656294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:57.699047 run osmo-stp_10.42.42.5(pid=4880): stdout: | (launched: 2022-12-13_21:56:56.120444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:56:57.819474 run osmo-stp_10.42.42.5(pid=4880): stderr: | 20221213215656290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215656290 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215656291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215656291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215656294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215656294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215656294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:56:57.962960 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4880): Process ended prematurely: osmo-stp_10.42.42.5(pid=4880) [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4880)] [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 21:56:57.971636 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 21:56:57.998083 run osmo-hlr_10.42.42.2(pid=4877): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4877)] 21:56:58.045499 run osmo-hlr_10.42.42.2(pid=4877): stdout: | (launched: 2022-12-13_21:56:55.174033) 21:56:58.094559 run osmo-hlr_10.42.42.2(pid=4877): stderr: | 20221213215655353 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215655353 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215655353 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215655353 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215655353 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215655353 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215655366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215655377 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215655377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215655377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:56:58.163163 run osmo-msc_10.42.42.6(pid=4883): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4883)] 21:56:58.210602 run osmo-msc_10.42.42.6(pid=4883): stdout: | (launched: 2022-12-13_21:56:57.090618) 21:56:58.259681 run osmo-msc_10.42.42.6(pid=4883): stderr: | 20221213215657366 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215657366 DLGLOBAL DEBUG validating counter group 0x7fd400c23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215657366 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215657366 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215657366 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215657366 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215657368 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215657368 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215657369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215657369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:56:58.309722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4876): Terminating (SIGTERM) 21:56:58.349079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4879): Terminating (SIGTERM) 21:56:58.388307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4882): Terminating (SIGTERM) 21:56:58.427838 --- ParallelTerminationStrategy: PID 4876 died... 21:56:58.446809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4876): Terminated: ok {rc=0} 21:56:58.490995 --- ParallelTerminationStrategy: PID 4879 died... 21:56:58.509762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4879): Terminated: ok {rc=0} 21:56:58.553805 --- ParallelTerminationStrategy: PID 4882 died... 21:56:58.572317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4882): Terminated: ok {rc=0} 21:56:58.656161 bus /sierra_3: Setting Powered False 21:56:59.751419 bus /sierra_3: Setting Powered False 21:57:00.875892 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:57:02.143355 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:57:02.149708 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:57:02.170863 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 21:57:02.198411 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:57:02.249897 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:57:02.275655 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 21:57:02.303934 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:57:02.847014 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 21:57:02.895026 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:02.905982 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:57:02.966674 tst mo_mt_call.py: using LAC 36486 21:57:03.084063 tst mo_mt_call.py: using RAC 21 21:57:03.201289 tst mo_mt_call.py: using CellId 36486 21:57:03.322986 tst mo_mt_call.py: using BVCI 36487 21:57:03.436226 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:03.447314 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:03.458058 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:03.468717 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:03.479516 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:03.490358 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:57:03.610611 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:57:03.728043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:04.197200 run create_hlr_db(pid=4888): Launched 21:57:04.320484 bus /sierra_2: Setting Powered False 21:57:05.381868 run create_hlr_db(pid=4888): Terminated: ok {rc=0} 21:57:05.805294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4890): Launched 21:57:06.108501 run osmo-hlr_10.42.42.2(pid=4891): Launched 21:57:06.222571 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:06.761174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4893): Launched 21:57:07.064300 run osmo-stp_10.42.42.5(pid=4894): Launched 21:57:07.179453 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:07.727298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4896): Launched 21:57:08.030404 run osmo-msc_10.42.42.6(pid=4897): Launched 21:57:08.199286 run osmo-stp_10.42.42.5(pid=4894): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4894)] 21:57:08.327318 run osmo-stp_10.42.42.5(pid=4894): stdout: | (launched: 2022-12-13_21:57:07.008151) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:08.455313 run osmo-stp_10.42.42.5(pid=4894): stderr: | 20221213215707180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215707180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215707180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215707181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215707183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215707183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215707183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:08.581963 run osmo-stp_10.42.42.5(pid=4894): stdout: | (launched: 2022-12-13_21:57:07.008151) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:08.702469 run osmo-stp_10.42.42.5(pid=4894): stderr: | 20221213215707180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215707180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215707180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215707181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215707183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215707183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215707183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:08.846672 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4894): Process ended prematurely: osmo-stp_10.42.42.5(pid=4894) [trial-2395↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4894)] [trial-2395↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 21:57:08.855318 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 21:57:08.881622 run osmo-hlr_10.42.42.2(pid=4891): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4891)] 21:57:08.929261 run osmo-hlr_10.42.42.2(pid=4891): stdout: | (launched: 2022-12-13_21:57:06.052376) 21:57:08.978037 run osmo-hlr_10.42.42.2(pid=4891): stderr: | 20221213215706230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215706230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215706230 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215706230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215706230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215706230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215706243 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215706253 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215706254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215706254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:09.046172 run osmo-msc_10.42.42.6(pid=4897): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4897)] 21:57:09.093236 run osmo-msc_10.42.42.6(pid=4897): stdout: | (launched: 2022-12-13_21:57:07.973971) 21:57:09.142465 run osmo-msc_10.42.42.6(pid=4897): stderr: | 20221213215708245 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215708245 DLGLOBAL DEBUG validating counter group 0x7fbac7ea9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215708245 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215708245 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215708245 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215708246 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215708249 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215708249 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215708250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215708250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:09.191846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4890): Terminating (SIGTERM) 21:57:09.230877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4893): Terminating (SIGTERM) 21:57:09.269860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4896): Terminating (SIGTERM) 21:57:09.309248 --- ParallelTerminationStrategy: PID 4890 died... 21:57:09.328186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4890): Terminated: ok {rc=0} 21:57:09.371713 --- ParallelTerminationStrategy: PID 4893 died... 21:57:09.390257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4893): Terminated: ok {rc=0} 21:57:09.433881 --- ParallelTerminationStrategy: PID 4896 died... 21:57:09.452357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4896): Terminated: ok {rc=0} 21:57:09.537077 bus /sierra_3: Setting Powered False 21:57:10.635771 bus /sierra_3: Setting Powered False 21:57:11.750184 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 21:57:12.895473 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:12.907037 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:57:12.963789 tst mo_mt_call_osmux.py: using LAC 36487 21:57:13.083858 tst mo_mt_call_osmux.py: using RAC 22 21:57:13.203288 tst mo_mt_call_osmux.py: using CellId 36487 21:57:13.323207 tst mo_mt_call_osmux.py: using BVCI 36488 21:57:13.432910 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:13.443961 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:13.454878 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:13.465674 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:13.476424 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:57:13.487627 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:57:13.603811 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:57:13.724600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:14.200223 run create_hlr_db(pid=4899): Launched 21:57:14.323770 bus /sierra_2: Setting Powered False 21:57:15.384549 run create_hlr_db(pid=4899): Terminated: ok {rc=0} 21:57:15.808661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4901): Launched 21:57:16.175069 run osmo-hlr_10.42.42.2(pid=4902): Launched 21:57:16.344412 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:17.090328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4904): Launched 21:57:17.434276 run osmo-stp_10.42.42.5(pid=4905): Launched 21:57:17.563442 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:18.152337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4907): Launched 21:57:18.478298 run osmo-msc_10.42.42.6(pid=4908): Launched 21:57:18.660226 run osmo-stp_10.42.42.5(pid=4905): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4905)] 21:57:18.797216 run osmo-stp_10.42.42.5(pid=4905): stdout: | (launched: 2022-12-13_21:57:17.366991) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:18.935092 run osmo-stp_10.42.42.5(pid=4905): stderr: | 20221213215717566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215717566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215717566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215717567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215717567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215717567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215717567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:19.072201 run osmo-stp_10.42.42.5(pid=4905): stdout: | (launched: 2022-12-13_21:57:17.366991) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:19.202780 run osmo-stp_10.42.42.5(pid=4905): stderr: | 20221213215717566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215717566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215717566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215717567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215717567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215717567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215717567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:19.358690 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4905): Process ended prematurely: osmo-stp_10.42.42.5(pid=4905) [trial-2395↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4905)] [trial-2395↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:57:19.367998 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 21:57:19.395767 run osmo-hlr_10.42.42.2(pid=4902): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4902)] 21:57:19.446134 run osmo-hlr_10.42.42.2(pid=4902): stdout: | (launched: 2022-12-13_21:57:16.098971) 21:57:19.498009 run osmo-hlr_10.42.42.2(pid=4902): stderr: | 20221213215716466 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215716466 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215716466 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215716466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215716466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215716466 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215716489 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215716512 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215716512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215716512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:19.570675 run osmo-msc_10.42.42.6(pid=4908): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4908)] 21:57:19.620242 run osmo-msc_10.42.42.6(pid=4908): stdout: | (launched: 2022-12-13_21:57:18.418126) 21:57:19.672147 run osmo-msc_10.42.42.6(pid=4908): stderr: | 20221213215718741 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215718742 DLGLOBAL DEBUG validating counter group 0x7fb7b0507c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215718742 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215718742 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215718742 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215718742 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215718744 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215718744 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215718744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215718744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:19.724133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4901): Terminating (SIGTERM) 21:57:19.765615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4904): Terminating (SIGTERM) 21:57:19.807167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4907): Terminating (SIGTERM) 21:57:19.849048 --- ParallelTerminationStrategy: PID 4901 died... 21:57:19.869322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4901): Terminated: ok {rc=0} 21:57:19.915476 --- ParallelTerminationStrategy: PID 4904 died... 21:57:19.935488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4904): Terminated: ok {rc=0} 21:57:19.981540 --- ParallelTerminationStrategy: PID 4907 died... 21:57:20.001366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4907): Terminated: ok {rc=0} 21:57:20.089600 bus /sierra_3: Setting Powered False 21:57:21.186256 bus /sierra_3: Setting Powered False 21:57:22.301035 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:57:23.530449 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:57:23.535816 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:57:23.555997 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 21:57:23.582266 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 21:57:23.632793 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:57:23.653618 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 21:57:23.679833 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 21:57:24.231334 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 21:57:24.283967 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:24.295209 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:57:24.353377 tst mo_mt_call.py: using LAC 36488 21:57:24.480762 tst mo_mt_call.py: using RAC 23 21:57:24.601380 tst mo_mt_call.py: using CellId 36488 21:57:24.720110 tst mo_mt_call.py: using BVCI 36489 21:57:24.829780 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:24.840436 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:24.851023 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:24.861537 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:24.871958 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:24.882504 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:57:25.004510 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:57:25.122282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:25.628934 run create_hlr_db(pid=4913): Launched 21:57:25.752164 bus /sierra_2: Setting Powered False 21:57:26.817231 run create_hlr_db(pid=4913): Terminated: ok {rc=0} 21:57:27.252883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4915): Launched 21:57:27.558432 run osmo-hlr_10.42.42.2(pid=4916): Launched 21:57:27.673830 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:28.200546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4918): Launched 21:57:28.503087 run osmo-stp_10.42.42.5(pid=4919): Launched 21:57:28.618840 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:29.168721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4921): Launched 21:57:29.472520 run osmo-msc_10.42.42.6(pid=4922): Launched 21:57:29.642294 run osmo-stp_10.42.42.5(pid=4919): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4919)] 21:57:29.770258 run osmo-stp_10.42.42.5(pid=4919): stdout: | (launched: 2022-12-13_21:57:28.447063) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:29.897990 run osmo-stp_10.42.42.5(pid=4919): stderr: | 20221213215728619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215728619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215728620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215728620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215728621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215728621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215728621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:30.023686 run osmo-stp_10.42.42.5(pid=4919): stdout: | (launched: 2022-12-13_21:57:28.447063) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:30.144028 run osmo-stp_10.42.42.5(pid=4919): stderr: | 20221213215728619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215728619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215728620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215728620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215728621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215728621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215728621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:30.288176 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4919): Process ended prematurely: osmo-stp_10.42.42.5(pid=4919) [trial-2395↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4919)] [trial-2395↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 21:57:30.297068 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 21:57:30.323434 run osmo-hlr_10.42.42.2(pid=4916): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4916)] 21:57:30.371397 run osmo-hlr_10.42.42.2(pid=4916): stdout: | (launched: 2022-12-13_21:57:27.502110) 21:57:30.420534 run osmo-hlr_10.42.42.2(pid=4916): stderr: | 20221213215727679 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215727679 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215727679 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215727679 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215727679 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215727680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215727692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215727702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215727702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215727702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:30.489204 run osmo-msc_10.42.42.6(pid=4922): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4922)] 21:57:30.536355 run osmo-msc_10.42.42.6(pid=4922): stdout: | (launched: 2022-12-13_21:57:29.416042) 21:57:30.585428 run osmo-msc_10.42.42.6(pid=4922): stderr: | 20221213215729689 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215729689 DLGLOBAL DEBUG validating counter group 0x7fb20d360c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215729689 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215729689 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215729690 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215729690 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215729691 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215729692 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215729692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215729692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:30.634699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4915): Terminating (SIGTERM) 21:57:30.673719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4918): Terminating (SIGTERM) 21:57:30.712866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4921): Terminating (SIGTERM) 21:57:30.752475 --- ParallelTerminationStrategy: PID 4915 died... 21:57:30.771391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4915): Terminated: ok {rc=0} 21:57:30.815373 --- ParallelTerminationStrategy: PID 4918 died... 21:57:30.835637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4918): Terminated: ok {rc=0} 21:57:30.882320 --- ParallelTerminationStrategy: PID 4921 died... 21:57:30.909372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4921): Terminated: ok {rc=0} 21:57:30.992081 bus /sierra_3: Setting Powered False 21:57:32.087796 bus /sierra_3: Setting Powered False 21:57:33.200117 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 21:57:34.349255 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:34.361639 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:57:34.421204 tst mo_mt_call_osmux.py: using LAC 36489 21:57:34.549748 tst mo_mt_call_osmux.py: using RAC 24 21:57:34.678123 tst mo_mt_call_osmux.py: using CellId 36489 21:57:34.804336 tst mo_mt_call_osmux.py: using BVCI 36490 21:57:34.923523 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:34.934895 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:34.946049 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:34.957086 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:34.968508 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:57:34.979919 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:57:35.101610 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:57:35.219371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:35.692048 run create_hlr_db(pid=4924): Launched 21:57:35.815917 bus /sierra_2: Setting Powered False 21:57:36.876882 run create_hlr_db(pid=4924): Terminated: ok {rc=0} 21:57:37.321916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4926): Launched 21:57:37.648254 run osmo-hlr_10.42.42.2(pid=4927): Launched 21:57:37.772537 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:38.334517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4929): Launched 21:57:38.660571 run osmo-stp_10.42.42.5(pid=4930): Launched 21:57:38.785130 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:39.380011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4932): Launched 21:57:39.707476 run osmo-msc_10.42.42.6(pid=4933): Launched 21:57:39.888661 run osmo-stp_10.42.42.5(pid=4930): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4930)] 21:57:40.027259 run osmo-stp_10.42.42.5(pid=4930): stdout: | (launched: 2022-12-13_21:57:38.600583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:40.165267 run osmo-stp_10.42.42.5(pid=4930): stderr: | 20221213215738795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215738795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215738795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215738796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215738796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215738796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215738796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:40.302016 run osmo-stp_10.42.42.5(pid=4930): stdout: | (launched: 2022-12-13_21:57:38.600583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:40.432357 run osmo-stp_10.42.42.5(pid=4930): stderr: | 20221213215738795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215738795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215738795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215738796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215738796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215738796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215738796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:40.588324 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4930): Process ended prematurely: osmo-stp_10.42.42.5(pid=4930) [trial-2395↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4930)] [trial-2395↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 21:57:40.597927 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:57:40.625554 run osmo-hlr_10.42.42.2(pid=4927): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4927)] 21:57:40.676070 run osmo-hlr_10.42.42.2(pid=4927): stdout: | (launched: 2022-12-13_21:57:37.588501) 21:57:40.727989 run osmo-hlr_10.42.42.2(pid=4927): stderr: | 20221213215737788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215737788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215737788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215737788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215737788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215737788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215737801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215737809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215737809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215737809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:40.800792 run osmo-msc_10.42.42.6(pid=4933): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4933)] 21:57:40.850681 run osmo-msc_10.42.42.6(pid=4933): stdout: | (launched: 2022-12-13_21:57:39.646874) 21:57:40.902642 run osmo-msc_10.42.42.6(pid=4933): stderr: | 20221213215739970 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215739971 DLGLOBAL DEBUG validating counter group 0x7ff321105c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215739971 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215739971 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215739971 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215739971 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215739973 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215739973 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215739973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215739973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:40.954503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4926): Terminating (SIGTERM) 21:57:40.996060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4929): Terminating (SIGTERM) 21:57:41.038273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4932): Terminating (SIGTERM) 21:57:41.080366 --- ParallelTerminationStrategy: PID 4926 died... 21:57:41.100908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4926): Terminated: ok {rc=0} 21:57:41.147178 --- ParallelTerminationStrategy: PID 4929 died... 21:57:41.166984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4929): Terminated: ok {rc=0} 21:57:41.212820 --- ParallelTerminationStrategy: PID 4932 died... 21:57:41.233064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4932): Terminated: ok {rc=0} 21:57:41.319585 bus /sierra_3: Setting Powered False 21:57:42.417871 bus /sierra_3: Setting Powered False 21:57:43.532615 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 emergency:oc2g --------------------------------------------------------------------- 21:57:44.761828 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:57:44.766264 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 21:57:44.786468 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 21:57:44.812589 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 21:57:44.895887 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 21:57:44.916034 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 21:57:44.941944 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 21:57:45.523692 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2395 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 21:57:45.528445 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:45.539272 tst emergency:oc2g: Using 1 x bts (candidates: 1) 21:57:45.577133 tst emergency_mo_mt_call.py: using LAC 36490 21:57:45.696316 tst emergency_mo_mt_call.py: using RAC 25 21:57:45.812278 tst emergency_mo_mt_call.py: using CellId 36490 21:57:45.935195 tst emergency_mo_mt_call.py: using BVCI 36491 21:57:46.102484 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:46.118188 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:46.134172 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:46.150734 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:46.167012 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:46.182938 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:46.334510 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:46.455575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:46.939399 run create_hlr_db(pid=4940): Launched 21:57:47.081790 bus /sierra_2: Setting Powered False 21:57:48.142105 run create_hlr_db(pid=4940): Terminated: ok {rc=0} 21:57:48.559931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4942): Launched 21:57:48.857662 run osmo-hlr_10.42.42.2(pid=4943): Launched 21:57:48.970082 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:49.499779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4945): Launched 21:57:49.797796 run osmo-stp_10.42.42.5(pid=4946): Launched 21:57:49.924054 tst emergency_mo_mt_call.py: using MSISDN 8352 21:57:50.075673 run osmo-msc_10.42.42.6: Starting osmo-msc 21:57:50.613166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4948): Launched 21:57:50.911776 run osmo-msc_10.42.42.6(pid=4949): Launched 21:57:51.079438 run osmo-stp_10.42.42.5(pid=4946): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4946)] 21:57:51.205858 run osmo-stp_10.42.42.5(pid=4946): stdout: | (launched: 2022-12-13_21:57:49.742486) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:51.332323 run osmo-stp_10.42.42.5(pid=4946): stderr: | 20221213215749914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215749914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215749914 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215749914 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215749915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215749915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215749915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:51.456198 run osmo-stp_10.42.42.5(pid=4946): stdout: | (launched: 2022-12-13_21:57:49.742486) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:57:51.576043 run osmo-stp_10.42.42.5(pid=4946): stderr: | 20221213215749914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215749914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215749914 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215749914 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215749915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215749915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215749915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:57:51.717891 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=4946): Process ended prematurely: osmo-stp_10.42.42.5(pid=4946) [trial-2395↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4946)] [trial-2395↪emergency:oc2g↪emergency_mo_mt_call.py:19] 21:57:51.726215 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 21:57:51.752149 run osmo-hlr_10.42.42.2(pid=4943): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4943)] 21:57:51.799367 run osmo-hlr_10.42.42.2(pid=4943): stdout: | (launched: 2022-12-13_21:57:48.802300) 21:57:51.848869 run osmo-hlr_10.42.42.2(pid=4943): stderr: | 20221213215748978 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215748978 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215748978 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215748978 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215748978 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215748978 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215748990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215749002 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215749002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215749002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:57:51.917414 run osmo-msc_10.42.42.6(pid=4949): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4949)] 21:57:51.964754 run osmo-msc_10.42.42.6(pid=4949): stdout: | (launched: 2022-12-13_21:57:50.856191) 21:57:52.013576 run osmo-msc_10.42.42.6(pid=4949): stderr: | 20221213215751126 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215751127 DLGLOBAL DEBUG validating counter group 0x7f9e854f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215751127 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215751127 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215751127 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215751127 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215751129 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215751129 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215751130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215751130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:57:52.062908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4942): Terminating (SIGTERM) 21:57:52.102042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4945): Terminating (SIGTERM) 21:57:52.141313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4948): Terminating (SIGTERM) 21:57:52.181521 --- ParallelTerminationStrategy: PID 4942 died... 21:57:52.200472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4942): Terminated: ok {rc=0} 21:57:52.244457 --- ParallelTerminationStrategy: PID 4945 died... 21:57:52.263066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4945): Terminated: ok {rc=0} 21:57:52.306371 --- ParallelTerminationStrategy: PID 4948 died... 21:57:52.325092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4948): Terminated: ok {rc=0} 21:57:52.407637 bus /sierra_3: Setting Powered False 21:57:53.502566 bus /sierra_3: Setting Powered False 21:57:54.617388 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 21:57:55.704473 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:55.715481 tst emergency:oc2g: Using 1 x bts (candidates: 1) 21:57:55.751985 tst emergency_preemptive_call.py: using LAC 36491 21:57:55.868847 tst emergency_preemptive_call.py: using RAC 26 21:57:55.985910 tst emergency_preemptive_call.py: using CellId 36491 21:57:56.102579 tst emergency_preemptive_call.py: using BVCI 36492 21:57:56.212175 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:56.222648 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:56.232934 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:56.243183 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:56.253501 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 21:57:56.263659 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:56.383680 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:56.503356 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:56.624197 tst emergency:oc2g: Using 1 x modem (candidates: 4) 21:57:56.739382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:57:57.240924 run create_hlr_db(pid=4951): Launched 21:57:57.363240 bus /sierra_2: Setting Powered False 21:57:58.426901 run create_hlr_db(pid=4951): Terminated: ok {rc=0} 21:57:58.874936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4953): Launched 21:57:59.197624 run osmo-hlr_10.42.42.2(pid=4954): Launched 21:57:59.320353 run osmo-stp_10.42.42.5: Starting osmo-stp 21:57:59.871474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4956): Launched 21:58:00.193156 run osmo-stp_10.42.42.5(pid=4957): Launched 21:58:00.326299 tst emergency_preemptive_call.py: using MSISDN 8353 21:58:00.489310 run osmo-msc_10.42.42.6: Starting osmo-msc 21:58:01.088288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4959): Launched 21:58:01.479965 run osmo-msc_10.42.42.6(pid=4960): Launched 21:58:01.772035 run osmo-stp_10.42.42.5(pid=4957): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4957)] 21:58:02.031725 run osmo-stp_10.42.42.5(pid=4957): stdout: | (launched: 2022-12-13_21:58:00.133745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:02.195987 run osmo-stp_10.42.42.5(pid=4957): stderr: | 20221213215800327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215800328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215800328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215800328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215800329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215800329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215800329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:02.343871 run osmo-stp_10.42.42.5(pid=4957): stdout: | (launched: 2022-12-13_21:58:00.133745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:02.478610 run osmo-stp_10.42.42.5(pid=4957): stderr: | 20221213215800327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215800328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215800328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215800328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215800329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215800329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215800329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:02.632626 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=4957): Process ended prematurely: osmo-stp_10.42.42.5(pid=4957) [trial-2395↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4957)] [trial-2395↪emergency:oc2g↪emergency_preemptive_call.py:32] 21:58:02.641962 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 21:58:02.669880 run osmo-hlr_10.42.42.2(pid=4954): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4954)] 21:58:02.721321 run osmo-hlr_10.42.42.2(pid=4954): stdout: | (launched: 2022-12-13_21:57:59.138135) 21:58:02.773788 run osmo-hlr_10.42.42.2(pid=4954): stderr: | 20221213215759335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215759335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215759335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215759335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215759335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215759335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215759365 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215759375 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215759375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215759375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:02.847264 run osmo-msc_10.42.42.6(pid=4960): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4960)] 21:58:02.897655 run osmo-msc_10.42.42.6(pid=4960): stdout: | (launched: 2022-12-13_21:58:01.416337) 21:58:02.949910 run osmo-msc_10.42.42.6(pid=4960): stderr: | 20221213215802051 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213215802051 DLGLOBAL DEBUG validating counter group 0x7f50a0ba5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213215802051 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213215802051 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213215802052 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213215802052 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213215802062 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213215802062 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213215802063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213215802063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:58:03.002773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4953): Terminating (SIGTERM) 21:58:03.045553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4956): Terminating (SIGTERM) 21:58:03.088194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4959): Terminating (SIGTERM) 21:58:03.130907 --- ParallelTerminationStrategy: PID 4953 died... 21:58:03.151240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4953): Terminated: ok {rc=0} 21:58:03.198230 --- ParallelTerminationStrategy: PID 4956 died... 21:58:03.218431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4956): Terminated: ok {rc=0} 21:58:03.265262 --- ParallelTerminationStrategy: PID 4959 died... 21:58:03.285518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4959): Terminated: ok {rc=0} 21:58:03.374460 bus /sierra_9: Setting Powered False 21:58:04.472996 bus /sierra_9: Setting Powered False 21:58:05.588929 bus /sierra_8: Setting Powered False 21:58:06.687656 bus /sierra_8: Setting Powered False 21:58:07.803209 bus /sierra_3: Setting Powered False 21:58:08.901746 bus /sierra_3: Setting Powered False 21:58:10.016322 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:oc2g --------------------------------------------------------------------- 21:58:11.274275 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:58:11.279798 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 21:58:11.300806 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 21:58:11.340665 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 21:58:11.429086 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 21:58:11.450112 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 21:58:11.489559 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 21:58:12.079920 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 21:58:12.133288 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:12.144145 tst gprs:oc2g: Using 1 x bts (candidates: 1) 21:58:12.180479 tst cs_paging_gprs_active.py: using LAC 36492 21:58:12.311519 tst cs_paging_gprs_active.py: using RAC 27 21:58:12.441920 tst cs_paging_gprs_active.py: using CellId 36492 21:58:12.570807 tst cs_paging_gprs_active.py: using BVCI 36493 21:58:12.690919 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:12.701758 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:12.712412 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:12.723147 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:12.734562 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:12.746074 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:12.757649 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:12.769042 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:12.780599 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:12.897903 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:13.018351 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:58:13.240245 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:13.569164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4965): Launched 21:58:13.854073 run iperf3-srv_10.42.42.10(pid=4966): Launched 21:58:13.976427 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:58:14.198600 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:14.527795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4967): Launched 21:58:14.812663 run iperf3-srv_10.42.42.10(pid=4968): Launched 21:58:14.935223 tst cs_paging_gprs_active.py:38: start network... 21:58:15.157507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:15.664737 run create_hlr_db(pid=4969): Launched 21:58:15.788500 bus /sierra_2: Setting Powered False 21:58:16.849160 run create_hlr_db(pid=4969): Terminated: ok {rc=0} 21:58:17.317704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4971): Launched 21:58:17.624334 run osmo-hlr_10.42.42.2(pid=4972): Launched 21:58:17.741672 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:18.264112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4974): Launched 21:58:18.567457 run osmo-stp_10.42.42.5(pid=4975): Launched 21:58:18.682761 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:58:19.204756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4977): Launched 21:58:19.320597 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:58:19.577635 run patchelf(pid=4978): Launched 21:58:19.746824 run osmo-stp_10.42.42.5(pid=4975): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4975)] 21:58:19.874747 run osmo-stp_10.42.42.5(pid=4975): stdout: | (launched: 2022-12-13_21:58:18.511311) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:20.004604 run osmo-stp_10.42.42.5(pid=4975): stderr: | 20221213215818683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215818683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215818683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215818683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215818684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215818684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215818684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:20.134427 run osmo-stp_10.42.42.5(pid=4975): stdout: | (launched: 2022-12-13_21:58:18.511311) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:20.258407 run osmo-stp_10.42.42.5(pid=4975): stderr: | 20221213215818683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215818683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215818683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215818683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215818684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215818684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215818684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:20.405241 run patchelf(pid=4978): Terminating (SIGINT) 21:58:20.575198 run patchelf(pid=4978): Terminated: ok {rc=0} 21:58:20.697348 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4975): Process ended prematurely: osmo-stp_10.42.42.5(pid=4975) [trial-2395↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4975)] [trial-2395↪gprs:oc2g↪cs_paging_gprs_active.py:38] 21:58:20.706654 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 21:58:20.733563 run osmo-hlr_10.42.42.2(pid=4972): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4972)] 21:58:20.781140 run osmo-hlr_10.42.42.2(pid=4972): stdout: | (launched: 2022-12-13_21:58:17.567219) 21:58:20.830247 run osmo-hlr_10.42.42.2(pid=4972): stderr: | 20221213215817744 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215817745 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215817745 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215817745 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215817745 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215817745 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215817759 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215817769 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215817770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215817770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:20.879754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4965): Terminating (SIGTERM) 21:58:20.919234 run iperf3-srv_10.42.42.10(pid=4966): Terminating (SIGTERM) 21:58:20.958685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4967): Terminating (SIGTERM) 21:58:20.998238 run iperf3-srv_10.42.42.10(pid=4968): Terminating (SIGTERM) 21:58:21.039037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4971): Terminating (SIGTERM) 21:58:21.078829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4974): Terminating (SIGTERM) 21:58:21.118570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4977): Terminating (SIGTERM) 21:58:21.158442 --- ParallelTerminationStrategy: PID 4965 died... 21:58:21.177865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4965): Terminated: ok {rc=0} 21:58:21.221670 --- ParallelTerminationStrategy: PID 4966 died... 21:58:21.240146 run iperf3-srv_10.42.42.10(pid=4966): Terminated {rc=256} 21:58:21.283504 --- ParallelTerminationStrategy: PID 4967 died... 21:58:21.302095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4967): Terminated: ok {rc=0} 21:58:21.345698 --- ParallelTerminationStrategy: PID 4968 died... 21:58:21.364325 run iperf3-srv_10.42.42.10(pid=4968): Terminated {rc=256} 21:58:21.407618 --- ParallelTerminationStrategy: PID 4971 died... 21:58:21.426248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4971): Terminated: ok {rc=0} 21:58:21.469680 --- ParallelTerminationStrategy: PID 4974 died... 21:58:21.488271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4974): Terminated: ok {rc=0} 21:58:21.531921 --- ParallelTerminationStrategy: PID 4977 died... 21:58:21.550534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4977): Terminated: ok {rc=0} 21:58:21.635514 bus /gobi_0: Setting Powered False 21:58:22.735100 bus /gobi_0: Setting Powered False 21:58:23.850638 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:oc2g iperf3.py ---------------------------------------------- 21:58:24.995875 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:25.007409 tst gprs:oc2g: Using 1 x bts (candidates: 1) 21:58:25.043148 tst iperf3.py: using LAC 36493 21:58:25.172943 tst iperf3.py: using RAC 28 21:58:25.301371 tst iperf3.py: using CellId 36493 21:58:25.428921 tst iperf3.py: using BVCI 36494 21:58:25.546831 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:25.557899 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:25.568662 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:25.579571 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:25.590668 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:25.601763 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:25.612812 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:25.623799 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:25.634948 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:25.757331 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:58:25.978381 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:26.306260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4979): Launched 21:58:26.590566 run iperf3-srv_10.42.42.10(pid=4980): Launched 21:58:26.712604 tst iperf3.py:8: start network... 21:58:26.932733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:27.440069 run create_hlr_db(pid=4981): Launched 21:58:27.565403 bus /gobi_6: Setting Powered False 21:58:28.629804 run create_hlr_db(pid=4981): Terminated: ok {rc=0} 21:58:29.069704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4983): Launched 21:58:29.396680 run osmo-hlr_10.42.42.2(pid=4984): Launched 21:58:29.522191 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:30.084812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4986): Launched 21:58:30.411202 run osmo-stp_10.42.42.5(pid=4987): Launched 21:58:30.536352 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:58:31.111837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4989): Launched 21:58:31.255336 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:58:31.530493 run patchelf(pid=4990): Launched 21:58:31.718449 run osmo-stp_10.42.42.5(pid=4987): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4987)] 21:58:31.852182 run osmo-stp_10.42.42.5(pid=4987): stdout: | (launched: 2022-12-13_21:58:30.351373) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:31.985965 run osmo-stp_10.42.42.5(pid=4987): stderr: | 20221213215830545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215830545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215830545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215830546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215830546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215830546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215830546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:32.119631 run osmo-stp_10.42.42.5(pid=4987): stdout: | (launched: 2022-12-13_21:58:30.351373) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:32.247142 run osmo-stp_10.42.42.5(pid=4987): stderr: | 20221213215830545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215830545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215830545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215830546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215830546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215830546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215830546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:32.396545 run patchelf(pid=4990): Terminating (SIGINT) 21:58:32.568322 run patchelf(pid=4990): Terminated: ok {rc=0} 21:58:32.691398 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4987): Process ended prematurely: osmo-stp_10.42.42.5(pid=4987) [trial-2395↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4987)] [trial-2395↪gprs:oc2g↪iperf3.py:8] 21:58:32.700855 tst iperf3.py:8: Test FAILED (7.7 sec) 21:58:32.728071 run osmo-hlr_10.42.42.2(pid=4984): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4984)] 21:58:32.775621 run osmo-hlr_10.42.42.2(pid=4984): stdout: | (launched: 2022-12-13_21:58:29.336642) 21:58:32.824902 run osmo-hlr_10.42.42.2(pid=4984): stderr: | 20221213215829536 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215829536 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215829536 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215829536 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215829536 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215829536 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215829548 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215829558 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215829558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215829558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:32.874556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4979): Terminating (SIGTERM) 21:58:32.914376 run iperf3-srv_10.42.42.10(pid=4980): Terminating (SIGTERM) 21:58:32.954135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4983): Terminating (SIGTERM) 21:58:32.993699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4986): Terminating (SIGTERM) 21:58:33.033368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4989): Terminating (SIGTERM) 21:58:33.073300 --- ParallelTerminationStrategy: PID 4979 died... 21:58:33.092380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4979): Terminated: ok {rc=0} 21:58:33.136248 --- ParallelTerminationStrategy: PID 4980 died... 21:58:33.154838 run iperf3-srv_10.42.42.10(pid=4980): Terminated {rc=256} 21:58:33.198535 --- ParallelTerminationStrategy: PID 4983 died... 21:58:33.217360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4983): Terminated: ok {rc=0} 21:58:33.261140 --- ParallelTerminationStrategy: PID 4986 died... 21:58:33.279752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4986): Terminated: ok {rc=0} 21:58:33.323706 --- ParallelTerminationStrategy: PID 4989 died... 21:58:33.342399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4989): Terminated: ok {rc=0} 21:58:33.427668 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:oc2g iperf3m4.py ---------------------------------------------- 21:58:34.579192 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:34.590811 tst gprs:oc2g: Using 1 x bts (candidates: 1) 21:58:34.624848 tst iperf3m4.py: using LAC 36494 21:58:34.750609 tst iperf3m4.py: using RAC 29 21:58:34.876659 tst iperf3m4.py: using CellId 36494 21:58:35.002638 tst iperf3m4.py: using BVCI 36495 21:58:35.121835 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:35.132659 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:35.143509 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:35.154364 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:35.165235 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:35.176628 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:35.187977 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:35.199101 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:35.210438 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:35.331357 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:35.449515 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:35.568248 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:35.686670 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:58:35.906981 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:36.237027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4991): Launched 21:58:36.522281 run iperf3-srv_10.42.42.10(pid=4992): Launched 21:58:36.644493 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:58:36.865096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:37.194723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4993): Launched 21:58:37.479482 run iperf3-srv_10.42.42.10(pid=4994): Launched 21:58:37.603001 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:58:37.822926 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:38.152604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4995): Launched 21:58:38.437310 run iperf3-srv_10.42.42.10(pid=4996): Launched 21:58:38.559147 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:58:38.779072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:58:39.106901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4997): Launched 21:58:39.391139 run iperf3-srv_10.42.42.10(pid=4998): Launched 21:58:39.512878 tst iperf3m4.py:8: start network... 21:58:39.732879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:40.240221 run create_hlr_db(pid=4999): Launched 21:58:40.364511 bus /gobi_6: Setting Powered False 21:58:41.429495 run create_hlr_db(pid=4999): Terminated: ok {rc=0} 21:58:41.885417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5001): Launched 21:58:42.212293 run osmo-hlr_10.42.42.2(pid=5002): Launched 21:58:42.337826 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:42.899866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5004): Launched 21:58:43.227337 run osmo-stp_10.42.42.5(pid=5005): Launched 21:58:43.352123 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:58:43.917975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5007): Launched 21:58:44.043432 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:58:44.321285 run patchelf(pid=5008): Launched 21:58:44.502595 run osmo-stp_10.42.42.5(pid=5005): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5005)] 21:58:44.640400 run osmo-stp_10.42.42.5(pid=5005): stdout: | (launched: 2022-12-13_21:58:43.166806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:44.779678 run osmo-stp_10.42.42.5(pid=5005): stderr: | 20221213215843362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215843362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215843362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215843363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215843363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215843363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215843363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:44.919847 run osmo-stp_10.42.42.5(pid=5005): stdout: | (launched: 2022-12-13_21:58:43.166806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:58:45.053660 run osmo-stp_10.42.42.5(pid=5005): stderr: | 20221213215843362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215843362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215843362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215843363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215843363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215843363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215843363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:58:45.212451 run patchelf(pid=5008): Terminating (SIGINT) 21:58:45.394829 run patchelf(pid=5008): Terminated: ok {rc=0} 21:58:45.526255 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5005): Process ended prematurely: osmo-stp_10.42.42.5(pid=5005) [trial-2395↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5005)] [trial-2395↪gprs:oc2g↪iperf3m4.py:8] 21:58:45.536390 tst iperf3m4.py:8: Test FAILED (11.0 sec) 21:58:45.565136 run osmo-hlr_10.42.42.2(pid=5002): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5002)] 21:58:45.615667 run osmo-hlr_10.42.42.2(pid=5002): stdout: | (launched: 2022-12-13_21:58:42.151961) 21:58:45.667401 run osmo-hlr_10.42.42.2(pid=5002): stderr: | 20221213215842351 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215842351 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215842351 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215842351 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215842351 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215842351 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215842364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215842372 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215842372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215842373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:58:45.719461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4991): Terminating (SIGTERM) 21:58:45.761287 run iperf3-srv_10.42.42.10(pid=4992): Terminating (SIGTERM) 21:58:45.802984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4993): Terminating (SIGTERM) 21:58:45.859266 run iperf3-srv_10.42.42.10(pid=4994): Terminating (SIGTERM) 21:58:45.905038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4995): Terminating (SIGTERM) 21:58:45.947819 run iperf3-srv_10.42.42.10(pid=4996): Terminating (SIGTERM) 21:58:45.990203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4997): Terminating (SIGTERM) 21:58:46.032564 run iperf3-srv_10.42.42.10(pid=4998): Terminating (SIGTERM) 21:58:46.075335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5001): Terminating (SIGTERM) 21:58:46.118173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5004): Terminating (SIGTERM) 21:58:46.160562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5007): Terminating (SIGTERM) 21:58:46.203412 --- ParallelTerminationStrategy: PID 4991 died... 21:58:46.223873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4991): Terminated: ok {rc=0} 21:58:46.271000 --- ParallelTerminationStrategy: PID 4992 died... 21:58:46.291378 run iperf3-srv_10.42.42.10(pid=4992): Terminated {rc=256} 21:58:46.338264 --- ParallelTerminationStrategy: PID 4993 died... 21:58:46.358763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4993): Terminated: ok {rc=0} 21:58:46.405715 --- ParallelTerminationStrategy: PID 4994 died... 21:58:46.426170 run iperf3-srv_10.42.42.10(pid=4994): Terminated {rc=256} 21:58:46.473410 --- ParallelTerminationStrategy: PID 4995 died... 21:58:46.493929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4995): Terminated: ok {rc=0} 21:58:46.543415 --- ParallelTerminationStrategy: PID 4996 died... 21:58:46.569690 run iperf3-srv_10.42.42.10(pid=4996): Terminated {rc=256} 21:58:46.628888 --- ParallelTerminationStrategy: PID 4997 died... 21:58:46.653176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4997): Terminated: ok {rc=0} 21:58:46.700458 --- ParallelTerminationStrategy: PID 4998 died... 21:58:46.720998 run iperf3-srv_10.42.42.10(pid=4998): Terminated {rc=256} 21:58:46.767966 --- ParallelTerminationStrategy: PID 5001 died... 21:58:46.788440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5001): Terminated: ok {rc=0} 21:58:46.835726 --- ParallelTerminationStrategy: PID 5004 died... 21:58:46.856128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5004): Terminated: ok {rc=0} 21:58:46.903512 --- ParallelTerminationStrategy: PID 5007 died... 21:58:46.923983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5007): Terminated: ok {rc=0} 21:58:47.017178 bus /gobi_4: Setting Powered False 21:58:48.117287 bus /gobi_4: Setting Powered False 21:58:49.232363 bus /gobi_1: Setting Powered False 21:58:50.330368 bus /gobi_1: Setting Powered False 21:58:51.445019 bus /gobi_0: Setting Powered False 21:58:52.542399 bus /gobi_0: Setting Powered False 21:58:53.659256 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:oc2g ping.py ---------------------------------------------- 21:58:54.761790 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:54.773591 tst gprs:oc2g: Using 1 x bts (candidates: 1) 21:58:54.809306 tst ping.py: using LAC 36495 21:58:54.927366 tst ping.py: using RAC 30 21:58:55.047386 tst ping.py: using CellId 36495 21:58:55.167078 tst ping.py: using BVCI 36496 21:58:55.276621 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:55.287182 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:55.297575 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:55.307836 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:55.318102 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:55.328297 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:55.338697 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:58:55.348932 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:58:55.468676 tst ping.py:19: start network... 21:58:55.686282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:58:56.184656 run create_hlr_db(pid=5010): Launched 21:58:56.306760 bus /gobi_6: Setting Powered False 21:58:57.369923 run create_hlr_db(pid=5010): Terminated: ok {rc=0} 21:58:57.819223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5012): Launched 21:58:58.141814 run osmo-hlr_10.42.42.2(pid=5013): Launched 21:58:58.264309 run osmo-stp_10.42.42.5: Starting osmo-stp 21:58:58.817622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5015): Launched 21:58:59.139887 run osmo-stp_10.42.42.5(pid=5016): Launched 21:58:59.263053 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:58:59.818204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5018): Launched 21:58:59.941246 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:59:00.214890 run patchelf(pid=5019): Launched 21:59:00.392667 run osmo-stp_10.42.42.5(pid=5016): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5016)] 21:59:00.528539 run osmo-stp_10.42.42.5(pid=5016): stdout: | (launched: 2022-12-13_21:58:59.080091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:00.665958 run osmo-stp_10.42.42.5(pid=5016): stderr: | 20221213215859272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215859272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215859272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215859273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215859273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215859273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215859273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:00.803674 run osmo-stp_10.42.42.5(pid=5016): stdout: | (launched: 2022-12-13_21:58:59.080091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:00.957157 run osmo-stp_10.42.42.5(pid=5016): stderr: | 20221213215859272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215859272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215859272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215859273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215859273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215859273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215859273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:01.106992 run patchelf(pid=5019): Terminating (SIGINT) 21:59:01.280562 run patchelf(pid=5019): Terminated: ok {rc=0} 21:59:01.406805 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5016): Process ended prematurely: osmo-stp_10.42.42.5(pid=5016) [trial-2395↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5016)] [trial-2395↪gprs:oc2g↪ping.py:22] 21:59:01.416844 tst ping.py:22: Test FAILED (6.6 sec) 21:59:01.445438 run osmo-hlr_10.42.42.2(pid=5013): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5013)] 21:59:01.497688 run osmo-hlr_10.42.42.2(pid=5013): stdout: | (launched: 2022-12-13_21:58:58.082120) 21:59:01.548816 run osmo-hlr_10.42.42.2(pid=5013): stderr: | 20221213215858281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215858281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215858281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215858281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215858281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215858281 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215858294 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215858302 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215858302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215858302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:01.601760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5012): Terminating (SIGTERM) 21:59:01.643683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5015): Terminating (SIGTERM) 21:59:01.687548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5018): Terminating (SIGTERM) 21:59:01.731387 --- ParallelTerminationStrategy: PID 5012 died... 21:59:01.751719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5012): Terminated: ok {rc=0} 21:59:01.800306 --- ParallelTerminationStrategy: PID 5015 died... 21:59:01.820549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5015): Terminated: ok {rc=0} 21:59:01.868250 --- ParallelTerminationStrategy: PID 5018 died... 21:59:01.888193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5018): Terminated: ok {rc=0} 21:59:01.974606 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 21:59:03.060509 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:59:03.072542 tst gprs:oc2g: Using 1 x bts (candidates: 1) 21:59:03.109036 tst ping_idle_ping.py: using LAC 36496 21:59:03.234531 tst ping_idle_ping.py: using RAC 31 21:59:03.359513 tst ping_idle_ping.py: using CellId 36496 21:59:03.485212 tst ping_idle_ping.py: using BVCI 36497 21:59:03.602083 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:59:03.612923 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:59:03.623835 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:59:03.634583 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:59:03.645655 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:59:03.656672 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:59:03.667799 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 21:59:03.678948 tst gprs:oc2g: Using 1 x modem (candidates: 4) 21:59:03.794733 tst ping_idle_ping.py:24: start network... 21:59:03.995597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:04.463627 run create_hlr_db(pid=5020): Launched 21:59:04.586355 bus /gobi_6: Setting Powered False 21:59:05.646541 run create_hlr_db(pid=5020): Terminated: ok {rc=0} 21:59:06.086887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5022): Launched 21:59:06.409325 run osmo-hlr_10.42.42.2(pid=5023): Launched 21:59:06.532215 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:07.086869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5025): Launched 21:59:07.408691 run osmo-stp_10.42.42.5(pid=5026): Launched 21:59:07.532387 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:59:08.089418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5028): Launched 21:59:08.212700 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:59:08.485593 run patchelf(pid=5029): Launched 21:59:08.663691 run osmo-stp_10.42.42.5(pid=5026): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5026)] 21:59:08.799920 run osmo-stp_10.42.42.5(pid=5026): stdout: | (launched: 2022-12-13_21:59:07.349088) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:08.937875 run osmo-stp_10.42.42.5(pid=5026): stderr: | 20221213215907543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215907544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215907544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215907544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215907545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215907545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215907545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:09.076087 run osmo-stp_10.42.42.5(pid=5026): stdout: | (launched: 2022-12-13_21:59:07.349088) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:09.208610 run osmo-stp_10.42.42.5(pid=5026): stderr: | 20221213215907543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215907544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215907544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215907544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215907545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215907545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215907545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:09.365445 run patchelf(pid=5029): Terminating (SIGINT) 21:59:09.545751 run patchelf(pid=5029): Terminated: ok {rc=0} 21:59:09.675303 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5026): Process ended prematurely: osmo-stp_10.42.42.5(pid=5026) [trial-2395↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5026)] [trial-2395↪gprs:oc2g↪ping_idle_ping.py:27] 21:59:09.684765 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 21:59:09.712905 run osmo-hlr_10.42.42.2(pid=5023): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5023)] 21:59:09.763510 run osmo-hlr_10.42.42.2(pid=5023): stdout: | (launched: 2022-12-13_21:59:06.349797) 21:59:09.815587 run osmo-hlr_10.42.42.2(pid=5023): stderr: | 20221213215906547 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215906547 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215906547 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215906547 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215906547 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215906547 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215906559 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215906567 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215906568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215906568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:09.868150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5022): Terminating (SIGTERM) 21:59:09.910052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5025): Terminating (SIGTERM) 21:59:09.951808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5028): Terminating (SIGTERM) 21:59:09.994285 --- ParallelTerminationStrategy: PID 5022 died... 21:59:10.014976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5022): Terminated: ok {rc=0} 21:59:10.061582 --- ParallelTerminationStrategy: PID 5025 died... 21:59:10.081845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5025): Terminated: ok {rc=0} 21:59:10.129219 --- ParallelTerminationStrategy: PID 5028 died... 21:59:10.149221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5028): Terminated: ok {rc=0} 21:59:10.237032 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 21:59:11.525293 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:59:11.530312 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:59:11.550338 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:59:11.588129 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:59:11.672815 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:59:11.693764 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:59:11.731573 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:59:12.326811 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:59:12.379129 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:12.390402 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:59:12.427118 tst cs_paging_gprs_active.py: using LAC 36497 21:59:12.553123 tst cs_paging_gprs_active.py: using RAC 32 21:59:12.677590 tst cs_paging_gprs_active.py: using CellId 36497 21:59:12.795533 tst cs_paging_gprs_active.py: using BVCI 36498 21:59:12.903588 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:12.914341 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:12.924807 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:12.935311 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:12.945652 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:12.955825 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:12.966367 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:12.976567 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:12.987187 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:13.109218 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:13.226429 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:59:13.427228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:13.730137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5034): Launched 21:59:13.990102 run iperf3-srv_10.42.42.10(pid=5035): Launched 21:59:14.101234 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:59:14.301809 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:14.601276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5036): Launched 21:59:14.861897 run iperf3-srv_10.42.42.10(pid=5037): Launched 21:59:14.973113 tst cs_paging_gprs_active.py:38: start network... 21:59:15.173063 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:15.637951 run create_hlr_db(pid=5038): Launched 21:59:15.759437 bus /gobi_6: Setting Powered False 21:59:16.817857 run create_hlr_db(pid=5038): Terminated: ok {rc=0} 21:59:17.257744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5040): Launched 21:59:17.560619 run osmo-hlr_10.42.42.2(pid=5041): Launched 21:59:17.675310 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:18.207244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5043): Launched 21:59:18.506213 run osmo-stp_10.42.42.5(pid=5044): Launched 21:59:18.623608 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:59:19.153062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5046): Launched 21:59:19.267235 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:59:19.520057 run patchelf(pid=5047): Launched 21:59:19.686184 run osmo-stp_10.42.42.5(pid=5044): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5044)] 21:59:19.812566 run osmo-stp_10.42.42.5(pid=5044): stdout: | (launched: 2022-12-13_21:59:18.450101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:19.941102 run osmo-stp_10.42.42.5(pid=5044): stderr: | 20221213215918621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215918621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215918622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215918622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215918624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215918625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215918625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:20.069275 run osmo-stp_10.42.42.5(pid=5044): stdout: | (launched: 2022-12-13_21:59:18.450101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:20.192529 run osmo-stp_10.42.42.5(pid=5044): stderr: | 20221213215918621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215918621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215918622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215918622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215918624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215918625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215918625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:20.338075 run patchelf(pid=5047): Terminating (SIGINT) 21:59:20.505541 run patchelf(pid=5047): Terminated: ok {rc=0} 21:59:20.626058 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5044): Process ended prematurely: osmo-stp_10.42.42.5(pid=5044) [trial-2395↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5044)] [trial-2395↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:59:20.635471 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 21:59:20.662162 run osmo-hlr_10.42.42.2(pid=5041): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5041)] 21:59:20.709497 run osmo-hlr_10.42.42.2(pid=5041): stdout: | (launched: 2022-12-13_21:59:17.504094) 21:59:20.758360 run osmo-hlr_10.42.42.2(pid=5041): stderr: | 20221213215917679 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215917679 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215917679 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215917679 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215917679 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215917679 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215917691 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215917700 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215917700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215917701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:20.807831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5034): Terminating (SIGTERM) 21:59:20.847409 run iperf3-srv_10.42.42.10(pid=5035): Terminating (SIGTERM) 21:59:20.886803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5036): Terminating (SIGTERM) 21:59:20.926354 run iperf3-srv_10.42.42.10(pid=5037): Terminating (SIGTERM) 21:59:20.965565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5040): Terminating (SIGTERM) 21:59:21.004876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5043): Terminating (SIGTERM) 21:59:21.044269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5046): Terminating (SIGTERM) 21:59:21.083835 --- ParallelTerminationStrategy: PID 5034 died... 21:59:21.102840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5034): Terminated: ok {rc=0} 21:59:21.146479 --- ParallelTerminationStrategy: PID 5035 died... 21:59:21.164829 run iperf3-srv_10.42.42.10(pid=5035): Terminated {rc=256} 21:59:21.208185 --- ParallelTerminationStrategy: PID 5036 died... 21:59:21.226611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5036): Terminated: ok {rc=0} 21:59:21.270010 --- ParallelTerminationStrategy: PID 5037 died... 21:59:21.288646 run iperf3-srv_10.42.42.10(pid=5037): Terminated {rc=256} 21:59:21.332075 --- ParallelTerminationStrategy: PID 5040 died... 21:59:21.350487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5040): Terminated: ok {rc=0} 21:59:21.394016 --- ParallelTerminationStrategy: PID 5043 died... 21:59:21.412390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5043): Terminated: ok {rc=0} 21:59:21.455871 --- ParallelTerminationStrategy: PID 5046 died... 21:59:21.474283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5046): Terminated: ok {rc=0} 21:59:21.559740 bus /gobi_0: Setting Powered False 21:59:22.659309 bus /gobi_0: Setting Powered False 21:59:23.773939 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:59:24.919230 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:24.930545 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:59:24.967868 tst iperf3.py: using LAC 36498 21:59:25.094601 tst iperf3.py: using RAC 33 21:59:25.218998 tst iperf3.py: using CellId 36498 21:59:25.345280 tst iperf3.py: using BVCI 36499 21:59:25.462143 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:25.473396 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:25.484370 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:25.495315 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:25.506538 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:25.517908 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:25.529298 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:25.540370 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:25.551765 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:25.670526 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:59:25.886357 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:26.207552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5048): Launched 21:59:26.485875 run iperf3-srv_10.42.42.10(pid=5049): Launched 21:59:26.605508 tst iperf3.py:8: start network... 21:59:26.819961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:27.314186 run create_hlr_db(pid=5050): Launched 21:59:27.434219 bus /gobi_6: Setting Powered False 21:59:28.498289 run create_hlr_db(pid=5050): Terminated: ok {rc=0} 21:59:28.943263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5052): Launched 21:59:29.262746 run osmo-hlr_10.42.42.2(pid=5053): Launched 21:59:29.384194 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:29.935396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5055): Launched 21:59:30.255922 run osmo-stp_10.42.42.5(pid=5056): Launched 21:59:30.378395 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:59:30.961961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5058): Launched 21:59:31.118944 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:59:31.465694 run patchelf(pid=5059): Launched 21:59:31.659983 run osmo-stp_10.42.42.5(pid=5056): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5056)] 21:59:31.798553 run osmo-stp_10.42.42.5(pid=5056): stdout: | (launched: 2022-12-13_21:59:30.196641) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:31.939219 run osmo-stp_10.42.42.5(pid=5056): stderr: | 20221213215930390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215930390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215930391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215930391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215930391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215930391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215930392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:32.079844 run osmo-stp_10.42.42.5(pid=5056): stdout: | (launched: 2022-12-13_21:59:30.196641) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:32.214482 run osmo-stp_10.42.42.5(pid=5056): stderr: | 20221213215930390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215930390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215930391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215930391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215930391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215930391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215930392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:32.372324 run patchelf(pid=5059): Terminating (SIGINT) 21:59:32.551099 run patchelf(pid=5059): Terminated: ok {rc=0} 21:59:32.680391 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5056): Process ended prematurely: osmo-stp_10.42.42.5(pid=5056) [trial-2395↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5056)] [trial-2395↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 21:59:32.690962 tst iperf3.py:8: Test FAILED (7.8 sec) 21:59:32.719537 run osmo-hlr_10.42.42.2(pid=5053): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5053)] 21:59:32.770646 run osmo-hlr_10.42.42.2(pid=5053): stdout: | (launched: 2022-12-13_21:59:29.204251) 21:59:32.823071 run osmo-hlr_10.42.42.2(pid=5053): stderr: | 20221213215929402 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215929402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215929402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215929402 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215929402 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215929402 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215929414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215929422 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215929422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215929422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:32.876305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5048): Terminating (SIGTERM) 21:59:32.918698 run iperf3-srv_10.42.42.10(pid=5049): Terminating (SIGTERM) 21:59:32.960817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5052): Terminating (SIGTERM) 21:59:33.003557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5055): Terminating (SIGTERM) 21:59:33.046179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5058): Terminating (SIGTERM) 21:59:33.089492 --- ParallelTerminationStrategy: PID 5048 died... 21:59:33.109900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5048): Terminated: ok {rc=0} 21:59:33.156934 --- ParallelTerminationStrategy: PID 5049 died... 21:59:33.176918 run iperf3-srv_10.42.42.10(pid=5049): Terminated {rc=256} 21:59:33.223565 --- ParallelTerminationStrategy: PID 5052 died... 21:59:33.243606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5052): Terminated: ok {rc=0} 21:59:33.290344 --- ParallelTerminationStrategy: PID 5055 died... 21:59:33.310388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5055): Terminated: ok {rc=0} 21:59:33.357546 --- ParallelTerminationStrategy: PID 5058 died... 21:59:33.377548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5058): Terminated: ok {rc=0} 21:59:33.467216 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:59:34.611101 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:34.622556 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:59:34.658827 tst iperf3m4.py: using LAC 36499 21:59:34.777475 tst iperf3m4.py: using RAC 34 21:59:34.894270 tst iperf3m4.py: using CellId 36499 21:59:35.010974 tst iperf3m4.py: using BVCI 36500 21:59:35.118927 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:35.129576 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:35.140018 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:35.150525 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:35.160810 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:35.171299 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:35.182003 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:35.192402 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:35.203097 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:35.321375 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:35.437475 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:35.552896 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:35.667934 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:59:35.867146 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:36.167616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5060): Launched 21:59:36.428126 run iperf3-srv_10.42.42.10(pid=5061): Launched 21:59:36.539477 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:59:36.737864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:37.037129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5062): Launched 21:59:37.297086 run iperf3-srv_10.42.42.10(pid=5063): Launched 21:59:37.408140 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:59:37.606441 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:37.906218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5064): Launched 21:59:38.166633 run iperf3-srv_10.42.42.10(pid=5065): Launched 21:59:38.277700 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:59:38.477290 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:59:38.777228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5066): Launched 21:59:39.037815 run iperf3-srv_10.42.42.10(pid=5067): Launched 21:59:39.149059 tst iperf3m4.py:8: start network... 21:59:39.346800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:39.809267 run create_hlr_db(pid=5068): Launched 21:59:39.930512 bus /gobi_6: Setting Powered False 21:59:40.990653 run create_hlr_db(pid=5068): Terminated: ok {rc=0} 21:59:41.427414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5070): Launched 21:59:41.746970 run osmo-hlr_10.42.42.2(pid=5071): Launched 21:59:41.870675 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:42.421108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5073): Launched 21:59:42.740182 run osmo-stp_10.42.42.5(pid=5074): Launched 21:59:42.862409 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:59:43.415428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5076): Launched 21:59:43.538761 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:59:43.810634 run patchelf(pid=5077): Launched 21:59:43.987568 run osmo-stp_10.42.42.5(pid=5074): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5074)] 21:59:44.123292 run osmo-stp_10.42.42.5(pid=5074): stdout: | (launched: 2022-12-13_21:59:42.681522) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:44.260788 run osmo-stp_10.42.42.5(pid=5074): stderr: | 20221213215942873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215942873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215942874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215942874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215942874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215942874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215942875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:44.398345 run osmo-stp_10.42.42.5(pid=5074): stdout: | (launched: 2022-12-13_21:59:42.681522) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:59:44.529736 run osmo-stp_10.42.42.5(pid=5074): stderr: | 20221213215942873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215942873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215942874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215942874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215942874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215942874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215942875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:59:44.685185 run patchelf(pid=5077): Terminating (SIGINT) 21:59:44.863861 run patchelf(pid=5077): Terminated: ok {rc=0} 21:59:44.992773 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5074): Process ended prematurely: osmo-stp_10.42.42.5(pid=5074) [trial-2395↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5074)] [trial-2395↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 21:59:45.002972 tst iperf3m4.py:8: Test FAILED (10.4 sec) 21:59:45.031578 run osmo-hlr_10.42.42.2(pid=5071): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5071)] 21:59:45.082699 run osmo-hlr_10.42.42.2(pid=5071): stdout: | (launched: 2022-12-13_21:59:41.688090) 21:59:45.134848 run osmo-hlr_10.42.42.2(pid=5071): stderr: | 20221213215941889 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215941889 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215941889 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215941889 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215941889 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215941889 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215941910 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215941920 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215941920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215941920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:59:45.187305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5060): Terminating (SIGTERM) 21:59:45.229506 run iperf3-srv_10.42.42.10(pid=5061): Terminating (SIGTERM) 21:59:45.271474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5062): Terminating (SIGTERM) 21:59:45.313720 run iperf3-srv_10.42.42.10(pid=5063): Terminating (SIGTERM) 21:59:45.355832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5064): Terminating (SIGTERM) 21:59:45.397951 run iperf3-srv_10.42.42.10(pid=5065): Terminating (SIGTERM) 21:59:45.439900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5066): Terminating (SIGTERM) 21:59:45.482520 run iperf3-srv_10.42.42.10(pid=5067): Terminating (SIGTERM) 21:59:45.524344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5070): Terminating (SIGTERM) 21:59:45.566286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5073): Terminating (SIGTERM) 21:59:45.608211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5076): Terminating (SIGTERM) 21:59:45.650557 --- ParallelTerminationStrategy: PID 5060 died... 21:59:45.670781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5060): Terminated: ok {rc=0} 21:59:45.717666 --- ParallelTerminationStrategy: PID 5061 died... 21:59:45.737605 run iperf3-srv_10.42.42.10(pid=5061): Terminated {rc=256} 21:59:45.784113 --- ParallelTerminationStrategy: PID 5062 died... 21:59:45.804087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5062): Terminated: ok {rc=0} 21:59:45.852063 --- ParallelTerminationStrategy: PID 5063 died... 21:59:45.886954 run iperf3-srv_10.42.42.10(pid=5063): Terminated {rc=256} 21:59:45.935076 --- ParallelTerminationStrategy: PID 5064 died... 21:59:45.956285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5064): Terminated: ok {rc=0} 21:59:46.004375 --- ParallelTerminationStrategy: PID 5065 died... 21:59:46.025711 run iperf3-srv_10.42.42.10(pid=5065): Terminated {rc=256} 21:59:46.079829 --- ParallelTerminationStrategy: PID 5066 died... 21:59:46.101478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5066): Terminated: ok {rc=0} 21:59:46.150395 --- ParallelTerminationStrategy: PID 5067 died... 21:59:46.172180 run iperf3-srv_10.42.42.10(pid=5067): Terminated {rc=256} 21:59:46.220821 --- ParallelTerminationStrategy: PID 5070 died... 21:59:46.242723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5070): Terminated: ok {rc=0} 21:59:46.291436 --- ParallelTerminationStrategy: PID 5073 died... 21:59:46.313328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5073): Terminated: ok {rc=0} 21:59:46.362172 --- ParallelTerminationStrategy: PID 5076 died... 21:59:46.383926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5076): Terminated: ok {rc=0} 21:59:46.483605 bus /gobi_4: Setting Powered False 21:59:47.597647 bus /gobi_4: Setting Powered False 21:59:48.712186 bus /gobi_1: Setting Powered False 21:59:49.810867 bus /gobi_1: Setting Powered False 21:59:50.923417 bus /gobi_0: Setting Powered False 21:59:52.021340 bus /gobi_0: Setting Powered False 21:59:53.137907 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 21:59:54.239794 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:54.251499 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:59:54.289631 tst ping.py: using LAC 36500 21:59:54.405162 tst ping.py: using RAC 35 21:59:54.532463 tst ping.py: using CellId 36500 21:59:54.656771 tst ping.py: using BVCI 36501 21:59:54.770715 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:54.782088 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:54.793433 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:54.804483 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:54.816383 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:54.828642 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:54.840714 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:59:54.852724 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:59:54.968833 tst ping.py:19: start network... 21:59:55.181478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:59:55.668048 run create_hlr_db(pid=5078): Launched 21:59:55.787461 bus /gobi_6: Setting Powered False 21:59:56.850454 run create_hlr_db(pid=5078): Terminated: ok {rc=0} 21:59:57.289197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5080): Launched 21:59:57.603680 run osmo-hlr_10.42.42.2(pid=5081): Launched 21:59:57.723720 run osmo-stp_10.42.42.5: Starting osmo-stp 21:59:58.268862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5083): Launched 21:59:58.582550 run osmo-stp_10.42.42.5(pid=5084): Launched 21:59:58.702392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:59:59.245655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5086): Launched 21:59:59.365155 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:59:59.629903 run patchelf(pid=5087): Launched 21:59:59.803546 run osmo-stp_10.42.42.5(pid=5084): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5084)] 21:59:59.936678 run osmo-stp_10.42.42.5(pid=5084): stdout: | (launched: 2022-12-13_21:59:58.524436) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:00.071183 run osmo-stp_10.42.42.5(pid=5084): stderr: | 20221213215958716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215958717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215958717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215958717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215958718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215958718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215958718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:00.206650 run osmo-stp_10.42.42.5(pid=5084): stdout: | (launched: 2022-12-13_21:59:58.524436) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:00.335638 run osmo-stp_10.42.42.5(pid=5084): stderr: | 20221213215958716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213215958717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213215958717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213215958717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213215958718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213215958718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213215958718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:00.488188 run patchelf(pid=5087): Terminating (SIGINT) 22:00:00.664415 run patchelf(pid=5087): Terminated: ok {rc=0} 22:00:00.791255 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5084): Process ended prematurely: osmo-stp_10.42.42.5(pid=5084) [trial-2395↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5084)] [trial-2395↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 22:00:00.800624 tst ping.py:22: Test FAILED (6.6 sec) 22:00:00.828726 run osmo-hlr_10.42.42.2(pid=5081): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5081)] 22:00:00.881083 run osmo-hlr_10.42.42.2(pid=5081): stdout: | (launched: 2022-12-13_21:59:57.545682) 22:00:00.937201 run osmo-hlr_10.42.42.2(pid=5081): stderr: | 20221213215957741 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213215957741 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213215957741 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213215957741 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213215957741 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213215957741 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213215957754 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213215957763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213215957764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213215957764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:00.990098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5080): Terminating (SIGTERM) 22:00:01.031833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5083): Terminating (SIGTERM) 22:00:01.075024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5086): Terminating (SIGTERM) 22:00:01.118129 --- ParallelTerminationStrategy: PID 5080 died... 22:00:01.137970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5080): Terminated: ok {rc=0} 22:00:01.185781 --- ParallelTerminationStrategy: PID 5083 died... 22:00:01.205413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5083): Terminated: ok {rc=0} 22:00:01.251095 --- ParallelTerminationStrategy: PID 5086 died... 22:00:01.270493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5086): Terminated: ok {rc=0} 22:00:01.378525 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:00:02.480079 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:00:02.492402 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:00:02.531955 tst ping_idle_ping.py: using LAC 36501 22:00:02.656112 tst ping_idle_ping.py: using RAC 36 22:00:02.779271 tst ping_idle_ping.py: using CellId 36501 22:00:02.902521 tst ping_idle_ping.py: using BVCI 36502 22:00:03.016841 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:00:03.028350 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:00:03.039741 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:00:03.050978 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:00:03.062629 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:00:03.074238 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:00:03.086043 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:00:03.098195 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:00:03.213998 tst ping_idle_ping.py:24: start network... 22:00:03.410234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:03.867801 run create_hlr_db(pid=5091): Launched 22:00:03.989143 bus /gobi_6: Setting Powered False 22:00:05.048323 run create_hlr_db(pid=5091): Terminated: ok {rc=0} 22:00:05.481876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5093): Launched 22:00:05.784760 run osmo-hlr_10.42.42.2(pid=5094): Launched 22:00:05.898671 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:06.420358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5096): Launched 22:00:06.715654 run osmo-stp_10.42.42.5(pid=5097): Launched 22:00:06.826922 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:00:07.351508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5099): Launched 22:00:07.463221 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:00:07.712525 run patchelf(pid=5100): Launched 22:00:07.875726 run osmo-stp_10.42.42.5(pid=5097): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5097)] 22:00:08.000684 run osmo-stp_10.42.42.5(pid=5097): stdout: | (launched: 2022-12-13_22:00:06.660794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:08.127344 run osmo-stp_10.42.42.5(pid=5097): stderr: | 20221213220006832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220006832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220006832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220006833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220006833 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220006833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220006833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:08.254046 run osmo-stp_10.42.42.5(pid=5097): stdout: | (launched: 2022-12-13_22:00:06.660794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:08.375191 run osmo-stp_10.42.42.5(pid=5097): stderr: | 20221213220006832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220006832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220006832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220006833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220006833 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220006833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220006833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:08.518608 run patchelf(pid=5100): Terminating (SIGINT) 22:00:08.684709 run patchelf(pid=5100): Terminated: ok {rc=0} 22:00:08.803609 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5097): Process ended prematurely: osmo-stp_10.42.42.5(pid=5097) [trial-2395↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5097)] [trial-2395↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 22:00:08.812635 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 22:00:08.839150 run osmo-hlr_10.42.42.2(pid=5094): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5094)] 22:00:08.887018 run osmo-hlr_10.42.42.2(pid=5094): stdout: | (launched: 2022-12-13_22:00:05.729863) 22:00:08.935851 run osmo-hlr_10.42.42.2(pid=5094): stderr: | 20221213220005903 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220005903 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220005903 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220005903 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220005903 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220005903 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220005916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220005925 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220005925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220005925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:08.985401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5093): Terminating (SIGTERM) 22:00:09.024774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5096): Terminating (SIGTERM) 22:00:09.064108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5099): Terminating (SIGTERM) 22:00:09.103765 --- ParallelTerminationStrategy: PID 5093 died... 22:00:09.122752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5093): Terminated: ok {rc=0} 22:00:09.166249 --- ParallelTerminationStrategy: PID 5096 died... 22:00:09.184552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5096): Terminated: ok {rc=0} 22:00:09.228290 --- ParallelTerminationStrategy: PID 5099 died... 22:00:09.246898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5099): Terminated: ok {rc=0} 22:00:09.332644 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:00:10.627936 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:00:10.633729 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:00:10.653892 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:00:10.691729 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:00:10.776926 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:00:10.797495 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:00:10.835263 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:00:11.427664 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:00:11.475609 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:11.486304 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:00:11.544798 tst cs_paging_gprs_active.py: using LAC 36502 22:00:11.662902 tst cs_paging_gprs_active.py: using RAC 37 22:00:11.789109 tst cs_paging_gprs_active.py: using CellId 36502 22:00:11.914876 tst cs_paging_gprs_active.py: using BVCI 36503 22:00:12.024026 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:12.034987 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:12.045684 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:12.056357 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:12.066936 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:12.078015 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:12.089080 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:12.099782 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:12.110888 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:12.224031 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:12.342189 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:00:12.561762 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:12.886316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5104): Launched 22:00:13.167882 run iperf3-srv_10.42.42.10(pid=5105): Launched 22:00:13.289367 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:00:13.507616 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:13.831726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5106): Launched 22:00:14.112861 run iperf3-srv_10.42.42.10(pid=5107): Launched 22:00:14.233449 tst cs_paging_gprs_active.py:38: start network... 22:00:14.450555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:14.950263 run create_hlr_db(pid=5108): Launched 22:00:15.073864 bus /gobi_6: Setting Powered False 22:00:16.158462 run create_hlr_db(pid=5108): Terminated: ok {rc=0} 22:00:16.643639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5110): Launched 22:00:17.017904 run osmo-hlr_10.42.42.2(pid=5111): Launched 22:00:17.248268 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:17.801421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5113): Launched 22:00:18.122278 run osmo-stp_10.42.42.5(pid=5114): Launched 22:00:18.246074 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:00:18.802351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5116): Launched 22:00:18.925470 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:00:19.198772 run patchelf(pid=5117): Launched 22:00:19.377207 run osmo-stp_10.42.42.5(pid=5114): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5114)] 22:00:19.513572 run osmo-stp_10.42.42.5(pid=5114): stdout: | (launched: 2022-12-13_22:00:18.062907) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:19.651735 run osmo-stp_10.42.42.5(pid=5114): stderr: | 20221213220018253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220018254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220018254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220018254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220018256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220018257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220018257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:19.790237 run osmo-stp_10.42.42.5(pid=5114): stdout: | (launched: 2022-12-13_22:00:18.062907) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:19.922547 run osmo-stp_10.42.42.5(pid=5114): stderr: | 20221213220018253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220018254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220018254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220018254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220018256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220018257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220018257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:20.079189 run patchelf(pid=5117): Terminating (SIGINT) 22:00:20.260112 run patchelf(pid=5117): Terminated: ok {rc=0} 22:00:20.390340 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5114): Process ended prematurely: osmo-stp_10.42.42.5(pid=5114) [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5114)] [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:00:20.400247 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 22:00:20.428393 run osmo-hlr_10.42.42.2(pid=5111): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5111)] 22:00:20.478847 run osmo-hlr_10.42.42.2(pid=5111): stdout: | (launched: 2022-12-13_22:00:16.946110) 22:00:20.530356 run osmo-hlr_10.42.42.2(pid=5111): stderr: | 20221213220017239 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220017239 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220017239 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220017239 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220017239 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220017239 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220017267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220017276 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220017276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220017276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:20.582226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5104): Terminating (SIGTERM) 22:00:20.623945 run iperf3-srv_10.42.42.10(pid=5105): Terminating (SIGTERM) 22:00:20.665929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5106): Terminating (SIGTERM) 22:00:20.708245 run iperf3-srv_10.42.42.10(pid=5107): Terminating (SIGTERM) 22:00:20.749791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5110): Terminating (SIGTERM) 22:00:20.791454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5113): Terminating (SIGTERM) 22:00:20.832942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5116): Terminating (SIGTERM) 22:00:20.874881 --- ParallelTerminationStrategy: PID 5104 died... 22:00:20.894964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5104): Terminated: ok {rc=0} 22:00:20.941225 --- ParallelTerminationStrategy: PID 5105 died... 22:00:20.960694 run iperf3-srv_10.42.42.10(pid=5105): Terminated {rc=256} 22:00:21.006623 --- ParallelTerminationStrategy: PID 5106 died... 22:00:21.026296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5106): Terminated: ok {rc=0} 22:00:21.072364 --- ParallelTerminationStrategy: PID 5107 died... 22:00:21.092025 run iperf3-srv_10.42.42.10(pid=5107): Terminated {rc=256} 22:00:21.138365 --- ParallelTerminationStrategy: PID 5110 died... 22:00:21.158197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5110): Terminated: ok {rc=0} 22:00:21.204171 --- ParallelTerminationStrategy: PID 5113 died... 22:00:21.223942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5113): Terminated: ok {rc=0} 22:00:21.270015 --- ParallelTerminationStrategy: PID 5116 died... 22:00:21.289741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5116): Terminated: ok {rc=0} 22:00:21.378829 bus /gobi_0: Setting Powered False 22:00:22.476595 bus /gobi_0: Setting Powered False 22:00:23.593117 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:00:24.741933 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:24.753660 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:00:24.840041 tst iperf3.py: using LAC 36503 22:00:24.966559 tst iperf3.py: using RAC 38 22:00:25.093366 tst iperf3.py: using CellId 36503 22:00:25.220332 tst iperf3.py: using BVCI 36504 22:00:25.336711 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:25.347975 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:25.358909 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:25.369949 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:25.381160 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:25.392356 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:25.403773 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:25.414985 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:25.426479 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:25.546651 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:00:25.764391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:26.088158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5118): Launched 22:00:26.369674 run iperf3-srv_10.42.42.10(pid=5119): Launched 22:00:26.489843 tst iperf3.py:8: start network... 22:00:26.706891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:27.206719 run create_hlr_db(pid=5120): Launched 22:00:27.328182 bus /gobi_6: Setting Powered False 22:00:28.392057 run create_hlr_db(pid=5120): Terminated: ok {rc=0} 22:00:28.824249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5122): Launched 22:00:29.124792 run osmo-hlr_10.42.42.2(pid=5123): Launched 22:00:29.239118 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:29.758392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5125): Launched 22:00:30.057931 run osmo-stp_10.42.42.5(pid=5126): Launched 22:00:30.172303 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:00:30.694104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5128): Launched 22:00:30.809523 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:00:31.096186 run patchelf(pid=5129): Launched 22:00:31.322427 run osmo-stp_10.42.42.5(pid=5126): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5126)] 22:00:31.457294 run osmo-stp_10.42.42.5(pid=5126): stdout: | (launched: 2022-12-13_22:00:30.002301) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:31.594323 run osmo-stp_10.42.42.5(pid=5126): stderr: | 20221213220030175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220030175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220030175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220030175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220030176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220030176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220030176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:31.728068 run osmo-stp_10.42.42.5(pid=5126): stdout: | (launched: 2022-12-13_22:00:30.002301) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:31.856935 run osmo-stp_10.42.42.5(pid=5126): stderr: | 20221213220030175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220030175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220030175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220030175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220030176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220030176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220030176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:32.009731 run patchelf(pid=5129): Terminating (SIGINT) 22:00:32.184074 run patchelf(pid=5129): Terminated: ok {rc=0} 22:00:32.308191 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5126): Process ended prematurely: osmo-stp_10.42.42.5(pid=5126) [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5126)] [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 22:00:32.317755 tst iperf3.py:8: Test FAILED (7.6 sec) 22:00:32.344455 run osmo-hlr_10.42.42.2(pid=5123): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5123)] 22:00:32.393184 run osmo-hlr_10.42.42.2(pid=5123): stdout: | (launched: 2022-12-13_22:00:29.069144) 22:00:32.442876 run osmo-hlr_10.42.42.2(pid=5123): stderr: | 20221213220029245 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220029245 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220029245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220029245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220029245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220029245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220029258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220029268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220029268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220029268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:32.492716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5118): Terminating (SIGTERM) 22:00:32.532685 run iperf3-srv_10.42.42.10(pid=5119): Terminating (SIGTERM) 22:00:32.572771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5122): Terminating (SIGTERM) 22:00:32.612806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5125): Terminating (SIGTERM) 22:00:32.652741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5128): Terminating (SIGTERM) 22:00:32.693185 --- ParallelTerminationStrategy: PID 5118 died... 22:00:32.712561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5118): Terminated: ok {rc=0} 22:00:32.757288 --- ParallelTerminationStrategy: PID 5119 died... 22:00:32.776815 run iperf3-srv_10.42.42.10(pid=5119): Terminated {rc=256} 22:00:32.821200 --- ParallelTerminationStrategy: PID 5122 died... 22:00:32.840309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5122): Terminated: ok {rc=0} 22:00:32.884458 --- ParallelTerminationStrategy: PID 5125 died... 22:00:32.903486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5125): Terminated: ok {rc=0} 22:00:32.947671 --- ParallelTerminationStrategy: PID 5128 died... 22:00:32.966828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5128): Terminated: ok {rc=0} 22:00:33.053074 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:00:34.199201 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:34.210540 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:00:34.267824 tst iperf3m4.py: using LAC 36504 22:00:34.386083 tst iperf3m4.py: using RAC 39 22:00:34.505959 tst iperf3m4.py: using CellId 36504 22:00:34.624173 tst iperf3m4.py: using BVCI 36505 22:00:34.734443 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:34.745226 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:34.755707 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:34.766616 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:34.777257 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:34.787717 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:34.798993 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:34.809616 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:34.820423 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:34.937757 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:35.058969 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:35.176047 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:35.296242 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:00:35.514645 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:35.839299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5130): Launched 22:00:36.120896 run iperf3-srv_10.42.42.10(pid=5131): Launched 22:00:36.241885 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:00:36.458716 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:36.783223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5132): Launched 22:00:37.064475 run iperf3-srv_10.42.42.10(pid=5133): Launched 22:00:37.185953 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:00:37.402913 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:37.727164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5134): Launched 22:00:38.007238 run iperf3-srv_10.42.42.10(pid=5135): Launched 22:00:38.128799 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:00:38.346160 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:00:38.669984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5136): Launched 22:00:38.950708 run iperf3-srv_10.42.42.10(pid=5137): Launched 22:00:39.071037 tst iperf3m4.py:8: start network... 22:00:39.288591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:39.789450 run create_hlr_db(pid=5138): Launched 22:00:39.911434 bus /gobi_6: Setting Powered False 22:00:40.974504 run create_hlr_db(pid=5138): Terminated: ok {rc=0} 22:00:41.404395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5140): Launched 22:00:41.706397 run osmo-hlr_10.42.42.2(pid=5141): Launched 22:00:41.820611 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:42.358433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5143): Launched 22:00:42.657626 run osmo-stp_10.42.42.5(pid=5144): Launched 22:00:42.771054 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:00:43.290317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5146): Launched 22:00:43.404416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:00:43.658376 run patchelf(pid=5147): Launched 22:00:43.824647 run osmo-stp_10.42.42.5(pid=5144): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5144)] 22:00:43.951975 run osmo-stp_10.42.42.5(pid=5144): stdout: | (launched: 2022-12-13_22:00:42.601997) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:44.080612 run osmo-stp_10.42.42.5(pid=5144): stderr: | 20221213220042775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220042775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220042775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220042775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220042776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220042776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220042776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:44.209409 run osmo-stp_10.42.42.5(pid=5144): stdout: | (launched: 2022-12-13_22:00:42.601997) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:44.332538 run osmo-stp_10.42.42.5(pid=5144): stderr: | 20221213220042775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220042775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220042775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220042775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220042776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220042776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220042776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:44.478850 run patchelf(pid=5147): Terminating (SIGINT) 22:00:44.647387 run patchelf(pid=5147): Terminated: ok {rc=0} 22:00:44.768830 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5144): Process ended prematurely: osmo-stp_10.42.42.5(pid=5144) [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5144)] [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:00:44.778249 tst iperf3m4.py:8: Test FAILED (10.6 sec) 22:00:44.805354 run osmo-hlr_10.42.42.2(pid=5141): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5141)] 22:00:44.853297 run osmo-hlr_10.42.42.2(pid=5141): stdout: | (launched: 2022-12-13_22:00:41.650521) 22:00:44.902640 run osmo-hlr_10.42.42.2(pid=5141): stderr: | 20221213220041830 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220041830 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220041830 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220041830 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220041830 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220041831 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220041843 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220041852 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220041852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220041852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:00:44.952004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5130): Terminating (SIGTERM) 22:00:44.991429 run iperf3-srv_10.42.42.10(pid=5131): Terminating (SIGTERM) 22:00:45.031321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5132): Terminating (SIGTERM) 22:00:45.070718 run iperf3-srv_10.42.42.10(pid=5133): Terminating (SIGTERM) 22:00:45.110215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5134): Terminating (SIGTERM) 22:00:45.149823 run iperf3-srv_10.42.42.10(pid=5135): Terminating (SIGTERM) 22:00:45.189651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5136): Terminating (SIGTERM) 22:00:45.229304 run iperf3-srv_10.42.42.10(pid=5137): Terminating (SIGTERM) 22:00:45.269032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5140): Terminating (SIGTERM) 22:00:45.308351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5143): Terminating (SIGTERM) 22:00:45.348039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5146): Terminating (SIGTERM) 22:00:45.387671 --- ParallelTerminationStrategy: PID 5130 died... 22:00:45.406661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5130): Terminated: ok {rc=0} 22:00:45.450297 --- ParallelTerminationStrategy: PID 5131 died... 22:00:45.468655 run iperf3-srv_10.42.42.10(pid=5131): Terminated {rc=256} 22:00:45.512042 --- ParallelTerminationStrategy: PID 5132 died... 22:00:45.530459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5132): Terminated: ok {rc=0} 22:00:45.573966 --- ParallelTerminationStrategy: PID 5133 died... 22:00:45.592304 run iperf3-srv_10.42.42.10(pid=5133): Terminated {rc=256} 22:00:45.636337 --- ParallelTerminationStrategy: PID 5134 died... 22:00:45.654877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5134): Terminated: ok {rc=0} 22:00:45.698178 --- ParallelTerminationStrategy: PID 5135 died... 22:00:45.716383 run iperf3-srv_10.42.42.10(pid=5135): Terminated {rc=256} 22:00:45.760259 --- ParallelTerminationStrategy: PID 5136 died... 22:00:45.778679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5136): Terminated: ok {rc=0} 22:00:45.822094 --- ParallelTerminationStrategy: PID 5137 died... 22:00:45.840672 run iperf3-srv_10.42.42.10(pid=5137): Terminated {rc=256} 22:00:45.884889 --- ParallelTerminationStrategy: PID 5140 died... 22:00:45.910091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5140): Terminated: ok {rc=0} 22:00:45.954643 --- ParallelTerminationStrategy: PID 5143 died... 22:00:45.973904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5143): Terminated: ok {rc=0} 22:00:46.018545 --- ParallelTerminationStrategy: PID 5146 died... 22:00:46.037804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5146): Terminated: ok {rc=0} 22:00:46.138575 bus /gobi_4: Setting Powered False 22:00:47.251613 bus /gobi_4: Setting Powered False 22:00:48.372779 bus /gobi_1: Setting Powered False 22:00:49.472190 bus /gobi_1: Setting Powered False 22:00:50.588644 bus /gobi_0: Setting Powered False 22:00:51.688585 bus /gobi_0: Setting Powered False 22:00:52.805756 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:00:53.908839 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:53.920905 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:00:53.980605 tst ping.py: using LAC 36505 22:00:54.105133 tst ping.py: using RAC 40 22:00:54.221764 tst ping.py: using CellId 36505 22:00:54.337852 tst ping.py: using BVCI 36506 22:00:54.444692 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:54.455582 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:54.466184 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:54.476686 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:54.487157 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:54.498067 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:54.509249 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:00:54.520169 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:00:54.634193 tst ping.py:19: start network... 22:00:54.831989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:00:55.290964 run create_hlr_db(pid=5148): Launched 22:00:55.411735 bus /gobi_6: Setting Powered False 22:00:56.471889 run create_hlr_db(pid=5148): Terminated: ok {rc=0} 22:00:56.906035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5150): Launched 22:00:57.222804 run osmo-hlr_10.42.42.2(pid=5151): Launched 22:00:57.343314 run osmo-stp_10.42.42.5: Starting osmo-stp 22:00:57.894906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5153): Launched 22:00:58.211150 run osmo-stp_10.42.42.5(pid=5154): Launched 22:00:58.332261 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:00:58.879209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5156): Launched 22:00:59.000902 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:00:59.269634 run patchelf(pid=5157): Launched 22:00:59.445171 run osmo-stp_10.42.42.5(pid=5154): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5154)] 22:00:59.579243 run osmo-stp_10.42.42.5(pid=5154): stdout: | (launched: 2022-12-13_22:00:58.152495) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:59.715359 run osmo-stp_10.42.42.5(pid=5154): stderr: | 20221213220058343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220058343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220058343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220058344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220058346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220058346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220058346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:00:59.850983 run osmo-stp_10.42.42.5(pid=5154): stdout: | (launched: 2022-12-13_22:00:58.152495) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:00:59.980839 run osmo-stp_10.42.42.5(pid=5154): stderr: | 20221213220058343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220058343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220058343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220058344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220058346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220058346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220058346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:00.135251 run patchelf(pid=5157): Terminating (SIGINT) 22:01:00.312379 run patchelf(pid=5157): Terminated: ok {rc=0} 22:01:00.440246 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5154): Process ended prematurely: osmo-stp_10.42.42.5(pid=5154) [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5154)] [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 22:01:00.449776 tst ping.py:22: Test FAILED (6.5 sec) 22:01:00.477601 run osmo-hlr_10.42.42.2(pid=5151): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5151)] 22:01:00.528083 run osmo-hlr_10.42.42.2(pid=5151): stdout: | (launched: 2022-12-13_22:00:57.164444) 22:01:00.579906 run osmo-hlr_10.42.42.2(pid=5151): stderr: | 20221213220057361 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220057361 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220057361 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220057361 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220057361 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220057362 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220057374 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220057383 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220057383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220057383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:00.632242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5150): Terminating (SIGTERM) 22:01:00.674223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5153): Terminating (SIGTERM) 22:01:00.716154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5156): Terminating (SIGTERM) 22:01:00.758921 --- ParallelTerminationStrategy: PID 5150 died... 22:01:00.779290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5150): Terminated: ok {rc=0} 22:01:00.825941 --- ParallelTerminationStrategy: PID 5153 died... 22:01:00.857637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5153): Terminated: ok {rc=0} 22:01:00.913857 --- ParallelTerminationStrategy: PID 5156 died... 22:01:00.938404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5156): Terminated: ok {rc=0} 22:01:01.026504 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:01:02.114455 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:01:02.128168 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:01:02.194312 tst ping_idle_ping.py: using LAC 36506 22:01:02.312919 tst ping_idle_ping.py: using RAC 41 22:01:02.438321 tst ping_idle_ping.py: using CellId 36506 22:01:02.564412 tst ping_idle_ping.py: using BVCI 36507 22:01:02.680193 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:01:02.691479 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:01:02.702539 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:01:02.713684 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:01:02.725522 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:01:02.737274 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:01:02.749400 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:01:02.761764 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:01:02.878158 tst ping_idle_ping.py:24: start network... 22:01:03.078095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:03.540302 run create_hlr_db(pid=5158): Launched 22:01:03.662665 bus /gobi_6: Setting Powered False 22:01:04.721456 run create_hlr_db(pid=5158): Terminated: ok {rc=0} 22:01:05.160021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5160): Launched 22:01:05.478216 run osmo-hlr_10.42.42.2(pid=5161): Launched 22:01:05.599523 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:06.145722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5163): Launched 22:01:06.462486 run osmo-stp_10.42.42.5(pid=5164): Launched 22:01:06.584467 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:01:07.132024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5166): Launched 22:01:07.253642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:01:07.522528 run patchelf(pid=5167): Launched 22:01:07.698265 run osmo-stp_10.42.42.5(pid=5164): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5164)] 22:01:07.832267 run osmo-stp_10.42.42.5(pid=5164): stdout: | (launched: 2022-12-13_22:01:06.404048) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:07.968232 run osmo-stp_10.42.42.5(pid=5164): stderr: | 20221213220106595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220106595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220106595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220106595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220106596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220106596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220106596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:08.104550 run osmo-stp_10.42.42.5(pid=5164): stdout: | (launched: 2022-12-13_22:01:06.404048) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:08.235367 run osmo-stp_10.42.42.5(pid=5164): stderr: | 20221213220106595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220106595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220106595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220106595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220106596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220106596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220106596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:08.389807 run patchelf(pid=5167): Terminating (SIGINT) 22:01:08.567410 run patchelf(pid=5167): Terminated: ok {rc=0} 22:01:08.695412 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5164): Process ended prematurely: osmo-stp_10.42.42.5(pid=5164) [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5164)] [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:01:08.704878 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:01:08.732742 run osmo-hlr_10.42.42.2(pid=5161): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5161)] 22:01:08.783438 run osmo-hlr_10.42.42.2(pid=5161): stdout: | (launched: 2022-12-13_22:01:05.419787) 22:01:08.835449 run osmo-hlr_10.42.42.2(pid=5161): stderr: | 20221213220105619 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220105619 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220105619 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220105619 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220105619 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220105619 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220105631 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220105640 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220105640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220105640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:08.888035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5160): Terminating (SIGTERM) 22:01:08.930293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5163): Terminating (SIGTERM) 22:01:08.972257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5166): Terminating (SIGTERM) 22:01:09.015163 --- ParallelTerminationStrategy: PID 5160 died... 22:01:09.035864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5160): Terminated: ok {rc=0} 22:01:09.082390 --- ParallelTerminationStrategy: PID 5163 died... 22:01:09.102127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5163): Terminated: ok {rc=0} 22:01:09.148659 --- ParallelTerminationStrategy: PID 5166 died... 22:01:09.168609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5166): Terminated: ok {rc=0} 22:01:09.257409 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:01:10.555328 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:01:10.562064 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:01:10.582940 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:01:10.622256 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:01:10.711291 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:01:10.731727 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:01:10.770159 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:01:11.361954 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:01:11.416903 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:11.428209 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:01:11.485944 tst cs_paging_gprs_active.py: using LAC 36507 22:01:11.613993 tst cs_paging_gprs_active.py: using RAC 42 22:01:11.741172 tst cs_paging_gprs_active.py: using CellId 36507 22:01:11.866250 tst cs_paging_gprs_active.py: using BVCI 36508 22:01:11.982436 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:11.993750 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:12.004614 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:12.015604 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:12.026870 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:12.038249 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:12.049670 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:12.060735 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:12.072067 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:12.190750 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:12.312230 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:01:12.521871 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:12.824937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5172): Launched 22:01:13.087684 run iperf3-srv_10.42.42.10(pid=5173): Launched 22:01:13.200293 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:01:13.402005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:13.704888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5174): Launched 22:01:13.967778 run iperf3-srv_10.42.42.10(pid=5175): Launched 22:01:14.079580 tst cs_paging_gprs_active.py:38: start network... 22:01:14.280501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:14.747215 run create_hlr_db(pid=5176): Launched 22:01:14.870225 bus /gobi_6: Setting Powered False 22:01:15.944115 run create_hlr_db(pid=5176): Terminated: ok {rc=0} 22:01:16.411316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5178): Launched 22:01:16.741702 run osmo-hlr_10.42.42.2(pid=5179): Launched 22:01:16.978648 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:17.683533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5181): Launched 22:01:17.986617 run osmo-stp_10.42.42.5(pid=5182): Launched 22:01:18.101430 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:01:18.622438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5184): Launched 22:01:18.737662 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:01:18.993289 run patchelf(pid=5185): Launched 22:01:19.161759 run osmo-stp_10.42.42.5(pid=5182): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5182)] 22:01:19.289646 run osmo-stp_10.42.42.5(pid=5182): stdout: | (launched: 2022-12-13_22:01:17.930594) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:19.419058 run osmo-stp_10.42.42.5(pid=5182): stderr: | 20221213220118100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220118100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220118100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220118101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220118103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220118103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220118103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:19.548633 run osmo-stp_10.42.42.5(pid=5182): stdout: | (launched: 2022-12-13_22:01:17.930594) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:19.672601 run osmo-stp_10.42.42.5(pid=5182): stderr: | 20221213220118100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220118100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220118100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220118101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220118103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220118103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220118103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:19.819298 run patchelf(pid=5185): Terminating (SIGINT) 22:01:19.988273 run patchelf(pid=5185): Terminated: ok {rc=0} 22:01:20.110206 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5182): Process ended prematurely: osmo-stp_10.42.42.5(pid=5182) [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5182)] [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:01:20.119576 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:01:20.146421 run osmo-hlr_10.42.42.2(pid=5179): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5179)] 22:01:20.193793 run osmo-hlr_10.42.42.2(pid=5179): stdout: | (launched: 2022-12-13_22:01:16.676519) 22:01:20.242764 run osmo-hlr_10.42.42.2(pid=5179): stderr: | 20221213220117109 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220117109 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220117109 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220117109 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220117109 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220117109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220117132 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220117151 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220117152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220117152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:20.292229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5172): Terminating (SIGTERM) 22:01:20.331961 run iperf3-srv_10.42.42.10(pid=5173): Terminating (SIGTERM) 22:01:20.371593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5174): Terminating (SIGTERM) 22:01:20.411452 run iperf3-srv_10.42.42.10(pid=5175): Terminating (SIGTERM) 22:01:20.451707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5178): Terminating (SIGTERM) 22:01:20.491401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5181): Terminating (SIGTERM) 22:01:20.531018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5184): Terminating (SIGTERM) 22:01:20.571340 --- ParallelTerminationStrategy: PID 5172 died... 22:01:20.590456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5172): Terminated: ok {rc=0} 22:01:20.634361 --- ParallelTerminationStrategy: PID 5173 died... 22:01:20.653051 run iperf3-srv_10.42.42.10(pid=5173): Terminated {rc=256} 22:01:20.696598 --- ParallelTerminationStrategy: PID 5174 died... 22:01:20.715127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5174): Terminated: ok {rc=0} 22:01:20.758754 --- ParallelTerminationStrategy: PID 5175 died... 22:01:20.777278 run iperf3-srv_10.42.42.10(pid=5175): Terminated {rc=256} 22:01:20.820751 --- ParallelTerminationStrategy: PID 5178 died... 22:01:20.839434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5178): Terminated: ok {rc=0} 22:01:20.882867 --- ParallelTerminationStrategy: PID 5181 died... 22:01:20.901272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5181): Terminated: ok {rc=0} 22:01:20.944696 --- ParallelTerminationStrategy: PID 5184 died... 22:01:20.963128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5184): Terminated: ok {rc=0} 22:01:21.047881 bus /gobi_0: Setting Powered False 22:01:22.147914 bus /gobi_0: Setting Powered False 22:01:23.263457 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:01:24.412328 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:24.424331 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:01:24.485413 tst iperf3.py: using LAC 36508 22:01:24.636112 tst iperf3.py: using RAC 43 22:01:24.760103 tst iperf3.py: using CellId 36508 22:01:24.875540 tst iperf3.py: using BVCI 36509 22:01:24.982747 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:24.993549 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:25.003919 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:25.014508 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:25.024924 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:25.035323 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:25.046444 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:25.057196 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:25.067684 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:25.186913 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:01:25.401973 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:25.720245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5186): Launched 22:01:25.995969 run iperf3-srv_10.42.42.10(pid=5187): Launched 22:01:26.115013 tst iperf3.py:8: start network... 22:01:26.330508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:26.824922 run create_hlr_db(pid=5188): Launched 22:01:26.947109 bus /gobi_6: Setting Powered False 22:01:28.010400 run create_hlr_db(pid=5188): Terminated: ok {rc=0} 22:01:28.436838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5190): Launched 22:01:28.733882 run osmo-hlr_10.42.42.2(pid=5191): Launched 22:01:28.846721 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:29.359256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5193): Launched 22:01:29.654445 run osmo-stp_10.42.42.5(pid=5194): Launched 22:01:29.767400 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:01:30.278311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5196): Launched 22:01:30.391058 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:01:30.641298 run patchelf(pid=5197): Launched 22:01:30.805921 run osmo-stp_10.42.42.5(pid=5194): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5194)] 22:01:30.940435 run osmo-stp_10.42.42.5(pid=5194): stdout: | (launched: 2022-12-13_22:01:29.601078) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:31.070522 run osmo-stp_10.42.42.5(pid=5194): stderr: | 20221213220129772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220129772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220129773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220129773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220129773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220129773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220129774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:31.200785 run osmo-stp_10.42.42.5(pid=5194): stdout: | (launched: 2022-12-13_22:01:29.601078) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:31.326177 run osmo-stp_10.42.42.5(pid=5194): stderr: | 20221213220129772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220129772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220129773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220129773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220129773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220129773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220129774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:31.474098 run patchelf(pid=5197): Terminating (SIGINT) 22:01:31.644291 run patchelf(pid=5197): Terminated: ok {rc=0} 22:01:31.770938 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5194): Process ended prematurely: osmo-stp_10.42.42.5(pid=5194) [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5194)] [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 22:01:31.781464 tst iperf3.py:8: Test FAILED (7.4 sec) 22:01:31.809343 run osmo-hlr_10.42.42.2(pid=5191): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5191)] 22:01:31.857644 run osmo-hlr_10.42.42.2(pid=5191): stdout: | (launched: 2022-12-13_22:01:28.680381) 22:01:31.908381 run osmo-hlr_10.42.42.2(pid=5191): stderr: | 20221213220128856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220128856 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220128856 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220128856 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220128856 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220128856 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220128872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220128881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220128882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220128882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:31.959238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5186): Terminating (SIGTERM) 22:01:32.000060 run iperf3-srv_10.42.42.10(pid=5187): Terminating (SIGTERM) 22:01:32.044319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5190): Terminating (SIGTERM) 22:01:32.085495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5193): Terminating (SIGTERM) 22:01:32.126438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5196): Terminating (SIGTERM) 22:01:32.166749 --- ParallelTerminationStrategy: PID 5186 died... 22:01:32.185662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5186): Terminated: ok {rc=0} 22:01:32.230359 --- ParallelTerminationStrategy: PID 5187 died... 22:01:32.249128 run iperf3-srv_10.42.42.10(pid=5187): Terminated {rc=256} 22:01:32.293074 --- ParallelTerminationStrategy: PID 5190 died... 22:01:32.311917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5190): Terminated: ok {rc=0} 22:01:32.354913 --- ParallelTerminationStrategy: PID 5193 died... 22:01:32.373203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5193): Terminated: ok {rc=0} 22:01:32.416196 --- ParallelTerminationStrategy: PID 5196 died... 22:01:32.434502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5196): Terminated: ok {rc=0} 22:01:32.517291 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:01:33.658154 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:33.669533 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:01:33.726615 tst iperf3m4.py: using LAC 36509 22:01:33.844849 tst iperf3m4.py: using RAC 44 22:01:33.962719 tst iperf3m4.py: using CellId 36509 22:01:34.080667 tst iperf3m4.py: using BVCI 36510 22:01:34.188013 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:34.198752 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:34.209341 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:34.219953 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:34.230551 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:34.241217 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:34.252228 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:34.263173 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:34.273982 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:34.388563 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:34.510024 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:34.626354 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:34.741107 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:01:34.940798 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:35.239133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5198): Launched 22:01:35.497764 run iperf3-srv_10.42.42.10(pid=5199): Launched 22:01:35.609333 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:01:35.807306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:36.104358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5200): Launched 22:01:36.364156 run iperf3-srv_10.42.42.10(pid=5201): Launched 22:01:36.475338 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:01:36.673996 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:36.972402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5202): Launched 22:01:37.230983 run iperf3-srv_10.42.42.10(pid=5203): Launched 22:01:37.342906 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:01:37.541579 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:01:37.839869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5204): Launched 22:01:38.097817 run iperf3-srv_10.42.42.10(pid=5205): Launched 22:01:38.209002 tst iperf3m4.py:8: start network... 22:01:38.408004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:38.868686 run create_hlr_db(pid=5206): Launched 22:01:38.989715 bus /gobi_6: Setting Powered False 22:01:40.049275 run create_hlr_db(pid=5206): Terminated: ok {rc=0} 22:01:40.484502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5208): Launched 22:01:40.802381 run osmo-hlr_10.42.42.2(pid=5209): Launched 22:01:40.923597 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:41.476294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5211): Launched 22:01:41.793449 run osmo-stp_10.42.42.5(pid=5212): Launched 22:01:41.916291 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:01:42.465819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5214): Launched 22:01:42.587038 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:01:42.854538 run patchelf(pid=5215): Launched 22:01:43.030867 run osmo-stp_10.42.42.5(pid=5212): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5212)] 22:01:43.166247 run osmo-stp_10.42.42.5(pid=5212): stdout: | (launched: 2022-12-13_22:01:41.736428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:43.302881 run osmo-stp_10.42.42.5(pid=5212): stderr: | 20221213220141928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220141928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220141928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220141929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220141929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220141929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220141929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:43.439802 run osmo-stp_10.42.42.5(pid=5212): stdout: | (launched: 2022-12-13_22:01:41.736428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:43.570851 run osmo-stp_10.42.42.5(pid=5212): stderr: | 20221213220141928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220141928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220141928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220141929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220141929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220141929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220141929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:43.725792 run patchelf(pid=5215): Terminating (SIGINT) 22:01:43.903624 run patchelf(pid=5215): Terminated: ok {rc=0} 22:01:44.032521 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5212): Process ended prematurely: osmo-stp_10.42.42.5(pid=5212) [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5212)] [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:01:44.042651 tst iperf3m4.py:8: Test FAILED (10.4 sec) 22:01:44.070813 run osmo-hlr_10.42.42.2(pid=5209): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5209)] 22:01:44.121383 run osmo-hlr_10.42.42.2(pid=5209): stdout: | (launched: 2022-12-13_22:01:40.745364) 22:01:44.173295 run osmo-hlr_10.42.42.2(pid=5209): stderr: | 20221213220140941 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220140941 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220140941 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220140941 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220140941 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220140941 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220140954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220140963 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220140963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220140963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:44.225309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5198): Terminating (SIGTERM) 22:01:44.266848 run iperf3-srv_10.42.42.10(pid=5199): Terminating (SIGTERM) 22:01:44.308446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5200): Terminating (SIGTERM) 22:01:44.350101 run iperf3-srv_10.42.42.10(pid=5201): Terminating (SIGTERM) 22:01:44.391576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5202): Terminating (SIGTERM) 22:01:44.433280 run iperf3-srv_10.42.42.10(pid=5203): Terminating (SIGTERM) 22:01:44.474784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5204): Terminating (SIGTERM) 22:01:44.516375 run iperf3-srv_10.42.42.10(pid=5205): Terminating (SIGTERM) 22:01:44.559302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5208): Terminating (SIGTERM) 22:01:44.601742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5211): Terminating (SIGTERM) 22:01:44.643260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5214): Terminating (SIGTERM) 22:01:44.685489 --- ParallelTerminationStrategy: PID 5198 died... 22:01:44.705613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5198): Terminated: ok {rc=0} 22:01:44.751782 --- ParallelTerminationStrategy: PID 5199 died... 22:01:44.771316 run iperf3-srv_10.42.42.10(pid=5199): Terminated {rc=256} 22:01:44.817016 --- ParallelTerminationStrategy: PID 5200 died... 22:01:44.836622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5200): Terminated: ok {rc=0} 22:01:44.882448 --- ParallelTerminationStrategy: PID 5201 died... 22:01:44.901952 run iperf3-srv_10.42.42.10(pid=5201): Terminated {rc=256} 22:01:44.947480 --- ParallelTerminationStrategy: PID 5202 died... 22:01:44.967102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5202): Terminated: ok {rc=0} 22:01:45.013184 --- ParallelTerminationStrategy: PID 5203 died... 22:01:45.032708 run iperf3-srv_10.42.42.10(pid=5203): Terminated {rc=256} 22:01:45.078671 --- ParallelTerminationStrategy: PID 5204 died... 22:01:45.098355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5204): Terminated: ok {rc=0} 22:01:45.144270 --- ParallelTerminationStrategy: PID 5205 died... 22:01:45.163944 run iperf3-srv_10.42.42.10(pid=5205): Terminated {rc=256} 22:01:45.209793 --- ParallelTerminationStrategy: PID 5208 died... 22:01:45.229354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5208): Terminated: ok {rc=0} 22:01:45.275103 --- ParallelTerminationStrategy: PID 5211 died... 22:01:45.294704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5211): Terminated: ok {rc=0} 22:01:45.340756 --- ParallelTerminationStrategy: PID 5214 died... 22:01:45.360584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5214): Terminated: ok {rc=0} 22:01:45.448854 bus /gobi_4: Setting Powered False 22:01:46.545112 bus /gobi_4: Setting Powered False 22:01:47.661085 bus /gobi_1: Setting Powered False 22:01:48.759359 bus /gobi_1: Setting Powered False 22:01:49.873448 bus /gobi_0: Setting Powered False 22:01:50.970366 bus /gobi_0: Setting Powered False 22:01:52.086875 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:01:53.189490 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:53.201454 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:01:53.263324 tst ping.py: using LAC 36510 22:01:53.385314 tst ping.py: using RAC 45 22:01:53.517774 tst ping.py: using CellId 36510 22:01:53.650526 tst ping.py: using BVCI 36511 22:01:53.765965 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:53.777278 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:53.788330 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:53.799383 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:53.810634 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:53.821966 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:53.833491 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:01:53.844812 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:01:53.959595 tst ping.py:19: start network... 22:01:54.156249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:01:54.607638 run create_hlr_db(pid=5216): Launched 22:01:54.727469 bus /gobi_6: Setting Powered False 22:01:55.785903 run create_hlr_db(pid=5216): Terminated: ok {rc=0} 22:01:56.213362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5218): Launched 22:01:56.524406 run osmo-hlr_10.42.42.2(pid=5219): Launched 22:01:56.643565 run osmo-stp_10.42.42.5: Starting osmo-stp 22:01:57.183715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5221): Launched 22:01:57.495832 run osmo-stp_10.42.42.5(pid=5222): Launched 22:01:57.615934 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:01:58.154719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5224): Launched 22:01:58.274288 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:01:58.537132 run patchelf(pid=5225): Launched 22:01:58.710868 run osmo-stp_10.42.42.5(pid=5222): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5222)] 22:01:58.843595 run osmo-stp_10.42.42.5(pid=5222): stdout: | (launched: 2022-12-13_22:01:57.439374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:58.977833 run osmo-stp_10.42.42.5(pid=5222): stderr: | 20221213220157632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220157632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220157632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220157632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220157633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220157633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220157633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:59.112127 run osmo-stp_10.42.42.5(pid=5222): stdout: | (launched: 2022-12-13_22:01:57.439374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:01:59.241926 run osmo-stp_10.42.42.5(pid=5222): stderr: | 20221213220157632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220157632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220157632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220157632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220157633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220157633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220157633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:01:59.394409 run patchelf(pid=5225): Terminating (SIGINT) 22:01:59.569989 run patchelf(pid=5225): Terminated: ok {rc=0} 22:01:59.696470 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5222): Process ended prematurely: osmo-stp_10.42.42.5(pid=5222) [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5222)] [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 22:01:59.705984 tst ping.py:22: Test FAILED (6.5 sec) 22:01:59.733653 run osmo-hlr_10.42.42.2(pid=5219): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5219)] 22:01:59.784260 run osmo-hlr_10.42.42.2(pid=5219): stdout: | (launched: 2022-12-13_22:01:56.468249) 22:01:59.836015 run osmo-hlr_10.42.42.2(pid=5219): stderr: | 20221213220156664 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220156664 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220156664 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220156664 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220156664 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220156664 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220156677 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220156685 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220156685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220156685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:01:59.888091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5218): Terminating (SIGTERM) 22:01:59.930017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5221): Terminating (SIGTERM) 22:01:59.971716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5224): Terminating (SIGTERM) 22:02:00.013531 --- ParallelTerminationStrategy: PID 5218 died... 22:02:00.033854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5218): Terminated: ok {rc=0} 22:02:00.080140 --- ParallelTerminationStrategy: PID 5221 died... 22:02:00.099799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5221): Terminated: ok {rc=0} 22:02:00.146241 --- ParallelTerminationStrategy: PID 5224 died... 22:02:00.166040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5224): Terminated: ok {rc=0} 22:02:00.253763 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:02:01.353204 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:02:01.369939 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:02:01.438476 tst ping_idle_ping.py: using LAC 36511 22:02:01.602185 tst ping_idle_ping.py: using RAC 46 22:02:01.729118 tst ping_idle_ping.py: using CellId 36511 22:02:01.850814 tst ping_idle_ping.py: using BVCI 36512 22:02:01.963615 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:02:01.975396 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:02:01.986840 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:02:01.998402 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:02:02.009902 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:02:02.021321 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:02:02.032898 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:02:02.044364 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:02:02.159861 tst ping_idle_ping.py:24: start network... 22:02:02.359475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:02.819349 run create_hlr_db(pid=5226): Launched 22:02:02.938656 bus /gobi_6: Setting Powered False 22:02:03.997338 run create_hlr_db(pid=5226): Terminated: ok {rc=0} 22:02:04.402271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5228): Launched 22:02:04.691345 run osmo-hlr_10.42.42.2(pid=5229): Launched 22:02:04.801740 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:05.303038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5231): Launched 22:02:05.593844 run osmo-stp_10.42.42.5(pid=5232): Launched 22:02:05.704635 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:02:06.207285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5234): Launched 22:02:06.317968 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:02:06.563841 run patchelf(pid=5235): Launched 22:02:06.724800 run osmo-stp_10.42.42.5(pid=5232): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5232)] 22:02:06.848883 run osmo-stp_10.42.42.5(pid=5232): stdout: | (launched: 2022-12-13_22:02:05.541371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:06.974138 run osmo-stp_10.42.42.5(pid=5232): stderr: | 20221213220205709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220205709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220205709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220205710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220205710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220205710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220205710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:07.099692 run osmo-stp_10.42.42.5(pid=5232): stdout: | (launched: 2022-12-13_22:02:05.541371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:07.219742 run osmo-stp_10.42.42.5(pid=5232): stderr: | 20221213220205709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220205709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220205709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220205710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220205710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220205710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220205710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:07.361842 run patchelf(pid=5235): Terminating (SIGINT) 22:02:07.526369 run patchelf(pid=5235): Terminated: ok {rc=0} 22:02:07.645880 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5232): Process ended prematurely: osmo-stp_10.42.42.5(pid=5232) [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5232)] [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:02:07.654699 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 22:02:07.680701 run osmo-hlr_10.42.42.2(pid=5229): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5229)] 22:02:07.727651 run osmo-hlr_10.42.42.2(pid=5229): stdout: | (launched: 2022-12-13_22:02:04.638848) 22:02:07.776313 run osmo-hlr_10.42.42.2(pid=5229): stderr: | 20221213220204814 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220204814 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220204814 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220204814 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220204814 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220204815 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220204830 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220204838 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220204838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220204838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:07.825747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5228): Terminating (SIGTERM) 22:02:07.864903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5231): Terminating (SIGTERM) 22:02:07.904177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5234): Terminating (SIGTERM) 22:02:07.943947 --- ParallelTerminationStrategy: PID 5228 died... 22:02:07.962860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5228): Terminated: ok {rc=0} 22:02:08.006455 --- ParallelTerminationStrategy: PID 5231 died... 22:02:08.024870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5231): Terminated: ok {rc=0} 22:02:08.068250 --- ParallelTerminationStrategy: PID 5234 died... 22:02:08.086789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5234): Terminated: ok {rc=0} 22:02:08.169151 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:02:09.457928 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:09.464668 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:02:09.485577 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:02:09.521956 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:02:09.575547 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:02:09.596664 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:02:09.631864 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:02:10.191080 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2395 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:02:10.196199 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:10.207771 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:02:10.266055 tst switch_tch_pdch.py: using LAC 36512 22:02:10.390330 tst switch_tch_pdch.py: using RAC 47 22:02:10.514050 tst switch_tch_pdch.py: using CellId 36512 22:02:10.637067 tst switch_tch_pdch.py: using BVCI 36513 22:02:10.750612 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:10.762145 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:10.773470 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:10.784675 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:10.796272 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:10.807938 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:10.819621 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:02:10.831161 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:02:10.945784 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:02:11.065267 tst switch_tch_pdch.py:51: start network... 22:02:11.277023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:11.764873 run create_hlr_db(pid=5239): Launched 22:02:11.885452 bus /gobi_6: Setting Powered False 22:02:12.948416 run create_hlr_db(pid=5239): Terminated: ok {rc=0} 22:02:13.371416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5241): Launched 22:02:13.666592 run osmo-hlr_10.42.42.2(pid=5242): Launched 22:02:13.780519 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:14.285457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5244): Launched 22:02:14.578727 run osmo-stp_10.42.42.5(pid=5245): Launched 22:02:14.693273 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:02:15.200333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5247): Launched 22:02:15.313354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:02:15.561904 run patchelf(pid=5248): Launched 22:02:15.725874 run osmo-stp_10.42.42.5(pid=5245): ERR: Terminated: ERROR {rc=1} [trial-2395↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5245)] 22:02:15.851339 run osmo-stp_10.42.42.5(pid=5245): stdout: | (launched: 2022-12-13_22:02:14.525124) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:15.984750 run osmo-stp_10.42.42.5(pid=5245): stderr: | 20221213220214691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220214691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220214692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220214692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220214693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220214693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220214693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:16.112870 run osmo-stp_10.42.42.5(pid=5245): stdout: | (launched: 2022-12-13_22:02:14.525124) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:16.235707 run osmo-stp_10.42.42.5(pid=5245): stderr: | 20221213220214691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220214691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220214692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220214692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220214693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220214693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220214693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:16.381737 run patchelf(pid=5248): Terminating (SIGINT) 22:02:16.549362 run patchelf(pid=5248): Terminated: ok {rc=0} 22:02:16.670727 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5245): Process ended prematurely: osmo-stp_10.42.42.5(pid=5245) [trial-2395↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5245)] [trial-2395↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:02:16.680603 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 22:02:16.708356 run osmo-hlr_10.42.42.2(pid=5242): ERR: Terminated: ERROR {rc=237} [trial-2395↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5242)] 22:02:16.757516 run osmo-hlr_10.42.42.2(pid=5242): stdout: | (launched: 2022-12-13_22:02:13.613469) 22:02:16.808116 run osmo-hlr_10.42.42.2(pid=5242): stderr: | 20221213220213788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220213788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220213789 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220213789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220213789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220213789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220213806 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220213815 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220213816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220213816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:16.859437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5241): Terminating (SIGTERM) 22:02:16.900524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5244): Terminating (SIGTERM) 22:02:16.943941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5247): Terminating (SIGTERM) 22:02:16.986902 --- ParallelTerminationStrategy: PID 5241 died... 22:02:17.007314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5241): Terminated: ok {rc=0} 22:02:17.052794 --- ParallelTerminationStrategy: PID 5244 died... 22:02:17.073050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5244): Terminated: ok {rc=0} 22:02:17.118430 --- ParallelTerminationStrategy: PID 5247 died... 22:02:17.138509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5247): Terminated: ok {rc=0} 22:02:17.230123 bus /gobi_0: Setting Powered False 22:02:18.328862 bus /gobi_0: Setting Powered False 22:02:19.445587 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:02:20.684718 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:20.691158 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:02:20.711854 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:02:20.746011 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:02:20.799025 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:02:20.820342 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:02:20.855725 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:02:21.410547 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2395 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:02:21.415780 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:21.427055 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:02:21.484536 tst switch_tch_pdch.py: using LAC 36513 22:02:21.607520 tst switch_tch_pdch.py: using RAC 48 22:02:21.731541 tst switch_tch_pdch.py: using CellId 36513 22:02:21.856216 tst switch_tch_pdch.py: using BVCI 36514 22:02:21.969937 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:21.981181 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:21.992083 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:22.003118 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:22.014526 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:22.025963 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:22.037544 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:02:22.048734 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:02:22.168816 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:02:22.285340 tst switch_tch_pdch.py:51: start network... 22:02:22.497607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:22.958005 run create_hlr_db(pid=5252): Launched 22:02:23.078970 bus /gobi_6: Setting Powered False 22:02:24.141840 run create_hlr_db(pid=5252): Terminated: ok {rc=0} 22:02:24.539115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5254): Launched 22:02:24.833235 run osmo-hlr_10.42.42.2(pid=5255): Launched 22:02:24.945815 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:25.426764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5257): Launched 22:02:25.721250 run osmo-stp_10.42.42.5(pid=5258): Launched 22:02:25.834010 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:02:26.314992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5260): Launched 22:02:26.427395 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:02:26.674832 run patchelf(pid=5261): Launched 22:02:26.838448 run osmo-stp_10.42.42.5(pid=5258): ERR: Terminated: ERROR {rc=1} [trial-2395↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5258)] 22:02:26.962766 run osmo-stp_10.42.42.5(pid=5258): stdout: | (launched: 2022-12-13_22:02:25.667537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:27.088718 run osmo-stp_10.42.42.5(pid=5258): stderr: | 20221213220225837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220225837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220225838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220225838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220225839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220225839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220225839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:27.214576 run osmo-stp_10.42.42.5(pid=5258): stdout: | (launched: 2022-12-13_22:02:25.667537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:27.335343 run osmo-stp_10.42.42.5(pid=5258): stderr: | 20221213220225837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220225837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220225838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220225838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220225839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220225839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220225839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:27.478059 run patchelf(pid=5261): Terminating (SIGINT) 22:02:27.642011 run patchelf(pid=5261): Terminated: ok {rc=0} 22:02:27.760714 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5258): Process ended prematurely: osmo-stp_10.42.42.5(pid=5258) [trial-2395↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5258)] [trial-2395↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:02:27.769571 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 22:02:27.795851 run osmo-hlr_10.42.42.2(pid=5255): ERR: Terminated: ERROR {rc=237} [trial-2395↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5255)] 22:02:27.843788 run osmo-hlr_10.42.42.2(pid=5255): stdout: | (launched: 2022-12-13_22:02:24.779779) 22:02:27.892832 run osmo-hlr_10.42.42.2(pid=5255): stderr: | 20221213220224954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220224954 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220224954 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220224954 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220224954 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220224954 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220224968 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220224977 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220224977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220224977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:27.942566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5254): Terminating (SIGTERM) 22:02:27.981882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5257): Terminating (SIGTERM) 22:02:28.022305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5260): Terminating (SIGTERM) 22:02:28.062061 --- ParallelTerminationStrategy: PID 5254 died... 22:02:28.081103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5254): Terminated: ok {rc=0} 22:02:28.124761 --- ParallelTerminationStrategy: PID 5257 died... 22:02:28.143291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5257): Terminated: ok {rc=0} 22:02:28.186623 --- ParallelTerminationStrategy: PID 5260 died... 22:02:28.205114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5260): Terminated: ok {rc=0} 22:02:28.288278 bus /gobi_0: Setting Powered False 22:02:29.385691 bus /gobi_0: Setting Powered False 22:02:30.501870 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_sms:trx-b200 --------------------------------------------------------------------- 22:02:31.735313 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:31.739857 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 22:02:31.773787 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 22:02:31.781229 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 22:02:31.833568 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 22:02:31.881123 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 22:02:31.891061 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 22:02:32.415189 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 22:02:32.420327 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 22:02:32.431322 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 22:02:32.481215 tst mo_mt_sms.py: using LAC 36514 22:02:32.598321 tst mo_mt_sms.py: using RAC 49 22:02:32.714991 tst mo_mt_sms.py: using CellId 36514 22:02:32.831862 tst mo_mt_sms.py: using BVCI 36515 22:02:32.937232 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 22:02:33.055543 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 22:02:33.170068 tst mo_mt_sms.py:9: start nitb and bts... 22:02:33.367089 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:02:33.969262 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5265): Launched 22:02:34.264753 run osmo-nitb_10.42.42.2(pid=5266): Launched 22:02:34.428334 run osmo-nitb_10.42.42.2(pid=5266): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5266)] 22:02:34.561333 run osmo-nitb_10.42.42.2(pid=5266): stdout: | (launched: 2022-12-13_22:02:34.211052) 22:02:34.695462 run osmo-nitb_10.42.42.2(pid=5266): stderr: | (launched: 2022-12-13_22:02:34.255081) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:02:34.829557 run osmo-nitb_10.42.42.2(pid=5266): stdout: | (launched: 2022-12-13_22:02:34.211052) 22:02:34.958194 run osmo-nitb_10.42.42.2(pid=5266): stderr: | (launched: 2022-12-13_22:02:34.255081) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5266): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5266) [trial-2395↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5266)] 22:02:35.376800 tst osmo-nitb_10.42.42.2(pid=5266): stdout: | (launched: 2022-12-13_22:02:34.211052) 22:02:35.494974 tst osmo-nitb_10.42.42.2(pid=5266): stderr: | (launched: 2022-12-13_22:02:34.255081) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:02:35.634846 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=5266): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5266) [trial-2395↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5266)] [trial-2395↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 22:02:35.643036 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 22:02:35.649712 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5265): Terminating (SIGTERM) 22:02:35.858115 --- ParallelTerminationStrategy: PID 5265 died... 22:02:35.878908 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5265): Terminated: ok {rc=0} 22:02:35.966050 bus /sierra_3: Setting Powered False 22:02:37.065947 bus /sierra_3: Setting Powered False 22:02:38.180625 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 sms:trx-b200 --------------------------------------------------------------------- 22:02:39.380403 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:39.384724 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 22:02:39.418173 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 22:02:39.445755 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 22:02:39.499746 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 22:02:39.533758 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 22:02:39.561986 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 22:02:40.102861 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 22:02:40.108813 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:40.119700 tst sms:trx-b200: Using 1 x bts (candidates: 1) 22:02:40.166860 tst mo_mt_sms.py: using LAC 36515 22:02:40.285647 tst mo_mt_sms.py: using RAC 50 22:02:40.401180 tst mo_mt_sms.py: using CellId 36515 22:02:40.516579 tst mo_mt_sms.py: using BVCI 36516 22:02:40.622862 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:40.633301 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:40.643576 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:40.653804 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:40.663968 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:40.674246 tst sms:trx-b200: Using 1 x modem (candidates: 2) 22:02:40.790783 tst sms:trx-b200: Using 1 x modem (candidates: 2) 22:02:40.904686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:41.361634 run create_hlr_db(pid=5271): Launched 22:02:41.485514 bus /sierra_2: Setting Powered False 22:02:42.549079 run create_hlr_db(pid=5271): Terminated: ok {rc=0} 22:02:42.988278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5273): Launched 22:02:43.303612 run osmo-hlr_10.42.42.2(pid=5274): Launched 22:02:43.426038 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:43.970328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5276): Launched 22:02:44.285141 run osmo-stp_10.42.42.5(pid=5277): Launched 22:02:44.406997 run osmo-msc_10.42.42.6: Starting osmo-msc 22:02:44.976607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5279): Launched 22:02:45.291269 run osmo-msc_10.42.42.6(pid=5280): Launched 22:02:45.469171 run osmo-stp_10.42.42.5(pid=5277): ERR: Terminated: ERROR {rc=1} [trial-2395↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5277)] 22:02:45.603166 run osmo-stp_10.42.42.5(pid=5277): stdout: | (launched: 2022-12-13_22:02:44.227946) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:45.737873 run osmo-stp_10.42.42.5(pid=5277): stderr: | 20221213220244418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220244418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220244418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220244418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220244419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220244419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220244419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:45.877064 run osmo-stp_10.42.42.5(pid=5277): stdout: | (launched: 2022-12-13_22:02:44.227946) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:02:46.006812 run osmo-stp_10.42.42.5(pid=5277): stderr: | 20221213220244418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220244418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220244418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220244418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220244419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220244419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220244419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:02:46.151956 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=5277): Process ended prematurely: osmo-stp_10.42.42.5(pid=5277) [trial-2395↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5277)] [trial-2395↪sms:trx-b200↪mo_mt_sms.py:16] 22:02:46.161915 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 22:02:46.189162 run osmo-hlr_10.42.42.2(pid=5274): ERR: Terminated: ERROR {rc=237} [trial-2395↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5274)] 22:02:46.238323 run osmo-hlr_10.42.42.2(pid=5274): stdout: | (launched: 2022-12-13_22:02:43.247021) 22:02:46.288862 run osmo-hlr_10.42.42.2(pid=5274): stderr: | 20221213220243447 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220243447 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220243447 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220243447 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220243447 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220243447 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220243460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220243468 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220243468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220243468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:02:46.361271 run osmo-msc_10.42.42.6(pid=5280): ERR: Terminated: ERROR {rc=2} [trial-2395↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5280)] 22:02:46.409826 run osmo-msc_10.42.42.6(pid=5280): stdout: | (launched: 2022-12-13_22:02:45.234447) 22:02:46.460335 run osmo-msc_10.42.42.6(pid=5280): stderr: | 20221213220245552 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220245552 DLGLOBAL DEBUG validating counter group 0x7fedb6aacc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220245552 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220245553 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220245553 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220245553 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220245556 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220245557 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220245557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220245557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:02:46.510839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5273): Terminating (SIGTERM) 22:02:46.551910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5276): Terminating (SIGTERM) 22:02:46.596512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5279): Terminating (SIGTERM) 22:02:46.639352 --- ParallelTerminationStrategy: PID 5273 died... 22:02:46.658898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5273): Terminated: ok {rc=0} 22:02:46.706391 --- ParallelTerminationStrategy: PID 5276 died... 22:02:46.725872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5276): Terminated: ok {rc=0} 22:02:46.772860 --- ParallelTerminationStrategy: PID 5279 died... 22:02:46.792595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5279): Terminated: ok {rc=0} 22:02:46.878997 bus /sierra_3: Setting Powered False 22:02:47.975692 bus /sierra_3: Setting Powered False 22:02:49.090808 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_ussd:trx-b200 --------------------------------------------------------------------- 22:02:50.324272 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:50.328585 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 22:02:50.362066 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 22:02:50.370470 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 22:02:50.408003 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 22:02:50.441582 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 22:02:50.448371 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 22:02:50.966997 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2395 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 22:02:50.972104 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 22:02:50.983165 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 22:02:51.031965 tst assert_extension.py: using LAC 36516 22:02:51.157291 tst assert_extension.py: using RAC 51 22:02:51.282525 tst assert_extension.py: using CellId 36516 22:02:51.405854 tst assert_extension.py: using BVCI 36517 22:02:51.521386 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 22:02:51.636843 tst assert_extension.py:10: start nitb and bts... 22:02:51.834180 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:02:52.436840 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5286): Launched 22:02:52.731116 run osmo-nitb_10.42.42.2(pid=5287): Launched 22:02:52.894875 run osmo-nitb_10.42.42.2(pid=5287): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5287)] 22:02:53.027307 run osmo-nitb_10.42.42.2(pid=5287): stdout: | (launched: 2022-12-13_22:02:52.677703) 22:02:53.161518 run osmo-nitb_10.42.42.2(pid=5287): stderr: | (launched: 2022-12-13_22:02:52.721425) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:02:53.294980 run osmo-nitb_10.42.42.2(pid=5287): stdout: | (launched: 2022-12-13_22:02:52.677703) 22:02:53.423658 run osmo-nitb_10.42.42.2(pid=5287): stderr: | (launched: 2022-12-13_22:02:52.721425) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5287): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5287) [trial-2395↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5287)] 22:02:53.843132 tst osmo-nitb_10.42.42.2(pid=5287): stdout: | (launched: 2022-12-13_22:02:52.677703) 22:02:53.963002 tst osmo-nitb_10.42.42.2(pid=5287): stderr: | (launched: 2022-12-13_22:02:52.721425) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:02:54.102809 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=5287): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5287) [trial-2395↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5287)] [trial-2395↪nitb_ussd:trx-b200↪assert_extension.py:12] 22:02:54.111046 tst assert_extension.py:12: Test FAILED (3.1 sec) 22:02:54.117746 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5286): Terminating (SIGTERM) 22:02:54.325885 --- ParallelTerminationStrategy: PID 5286 died... 22:02:54.346852 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5286): Terminated: ok {rc=0} 22:02:54.433958 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 ussd:trx-b200 --------------------------------------------------------------------- 22:02:55.613093 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:02:55.617799 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 22:02:55.651580 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 22:02:55.679929 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 22:02:55.716417 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 22:02:55.749431 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 22:02:55.776713 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 22:02:56.302726 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2395 ussd:trx-b200 assert_extension.py ---------------------------------------------- 22:02:56.307498 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:56.317925 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 22:02:56.364620 tst assert_extension.py: using LAC 36517 22:02:56.480309 tst assert_extension.py: using RAC 52 22:02:56.597364 tst assert_extension.py: using CellId 36517 22:02:56.713048 tst assert_extension.py: using BVCI 36518 22:02:56.819004 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:56.829474 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:56.839697 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:56.850030 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:56.860166 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:02:56.870427 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 22:02:56.983853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:02:57.473734 run create_hlr_db(pid=5291): Launched 22:02:57.595951 bus /sierra_2: Setting Powered False 22:02:58.659498 run create_hlr_db(pid=5291): Terminated: ok {rc=0} 22:02:59.082057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5293): Launched 22:02:59.376665 run osmo-hlr_10.42.42.2(pid=5294): Launched 22:02:59.489954 run osmo-stp_10.42.42.5: Starting osmo-stp 22:02:59.999039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5296): Launched 22:03:00.292073 run osmo-stp_10.42.42.5(pid=5297): Launched 22:03:00.404657 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:00.973743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5299): Launched 22:03:01.282780 run osmo-msc_10.42.42.6(pid=5300): Launched 22:03:01.515985 run osmo-stp_10.42.42.5(pid=5297): ERR: Terminated: ERROR {rc=1} [trial-2395↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5297)] 22:03:01.778903 run osmo-stp_10.42.42.5(pid=5297): stdout: | (launched: 2022-12-13_22:03:00.238784) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:01.976342 run osmo-stp_10.42.42.5(pid=5297): stderr: | 20221213220300409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220300409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220300409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220300410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220300410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220300410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220300410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:02.239585 run osmo-stp_10.42.42.5(pid=5297): stdout: | (launched: 2022-12-13_22:03:00.238784) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:02.358761 run osmo-stp_10.42.42.5(pid=5297): stderr: | 20221213220300409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220300409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220300409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220300410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220300410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220300410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220300410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:02.499791 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=5297): Process ended prematurely: osmo-stp_10.42.42.5(pid=5297) [trial-2395↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5297)] [trial-2395↪ussd:trx-b200↪assert_extension.py:17] 22:03:02.507973 tst assert_extension.py:17: Test FAILED (6.2 sec) 22:03:02.533979 run osmo-hlr_10.42.42.2(pid=5294): ERR: Terminated: ERROR {rc=237} [trial-2395↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5294)] 22:03:02.581856 run osmo-hlr_10.42.42.2(pid=5294): stdout: | (launched: 2022-12-13_22:02:59.323137) 22:03:02.631041 run osmo-hlr_10.42.42.2(pid=5294): stderr: | 20221213220259494 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220259494 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220259494 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220259494 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220259494 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220259494 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220259507 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220259516 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220259516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220259516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:02.699811 run osmo-msc_10.42.42.6(pid=5300): ERR: Terminated: ERROR {rc=2} [trial-2395↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5300)] 22:03:02.747172 run osmo-msc_10.42.42.6(pid=5300): stdout: | (launched: 2022-12-13_22:03:01.223176) 22:03:02.796365 run osmo-msc_10.42.42.6(pid=5300): stderr: | 20221213220301888 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220301888 DLGLOBAL DEBUG validating counter group 0x7fd7bde74c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220301888 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220301888 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220301888 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220301890 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220301897 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220301897 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220301898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220301898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:02.845970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5293): Terminating (SIGTERM) 22:03:02.885521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5296): Terminating (SIGTERM) 22:03:02.925039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5299): Terminating (SIGTERM) 22:03:02.964645 --- ParallelTerminationStrategy: PID 5293 died... 22:03:02.983722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5293): Terminated: ok {rc=0} 22:03:03.027495 --- ParallelTerminationStrategy: PID 5296 died... 22:03:03.045942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5296): Terminated: ok {rc=0} 22:03:03.089444 --- ParallelTerminationStrategy: PID 5299 died... 22:03:03.107815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5299): Terminated: ok {rc=0} 22:03:03.191497 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:03:04.405693 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:03:04.412738 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:03:04.447180 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:03:04.474932 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:03:04.528280 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:03:04.562705 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:03:04.590347 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:03:05.138645 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:03:05.191842 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:05.203410 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:03:05.274649 tst mo_mt_call.py: using LAC 36518 22:03:05.398923 tst mo_mt_call.py: using RAC 53 22:03:05.523674 tst mo_mt_call.py: using CellId 36518 22:03:05.648433 tst mo_mt_call.py: using BVCI 36519 22:03:05.756800 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:05.767966 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:05.779832 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:05.790843 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:05.801901 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:05.812748 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:03:05.929153 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:03:06.048629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:06.544088 run create_hlr_db(pid=5306): Launched 22:03:06.666794 bus /sierra_2: Setting Powered False 22:03:07.730224 run create_hlr_db(pid=5306): Terminated: ok {rc=0} 22:03:08.158303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5308): Launched 22:03:08.456410 run osmo-hlr_10.42.42.2(pid=5309): Launched 22:03:08.571743 run osmo-stp_10.42.42.5: Starting osmo-stp 22:03:09.103493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5311): Launched 22:03:09.401349 run osmo-stp_10.42.42.5(pid=5312): Launched 22:03:09.516107 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:10.058725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5314): Launched 22:03:10.357582 run osmo-msc_10.42.42.6(pid=5315): Launched 22:03:10.524927 run osmo-stp_10.42.42.5(pid=5312): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5312)] 22:03:10.652173 run osmo-stp_10.42.42.5(pid=5312): stdout: | (launched: 2022-12-13_22:03:09.347559) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:10.778127 run osmo-stp_10.42.42.5(pid=5312): stderr: | 20221213220309516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220309516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220309516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220309516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220309517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220309517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220309517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:10.902753 run osmo-stp_10.42.42.5(pid=5312): stdout: | (launched: 2022-12-13_22:03:09.347559) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:11.022157 run osmo-stp_10.42.42.5(pid=5312): stderr: | 20221213220309516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220309516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220309516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220309516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220309517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220309517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220309517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:11.164755 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5312): Process ended prematurely: osmo-stp_10.42.42.5(pid=5312) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5312)] [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:03:11.173937 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:03:11.200195 run osmo-hlr_10.42.42.2(pid=5309): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5309)] 22:03:11.248162 run osmo-hlr_10.42.42.2(pid=5309): stdout: | (launched: 2022-12-13_22:03:08.402625) 22:03:11.297499 run osmo-hlr_10.42.42.2(pid=5309): stderr: | 20221213220308578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220308578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220308578 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220308578 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220308578 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220308578 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220308590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220308599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220308599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220308599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:11.366254 run osmo-msc_10.42.42.6(pid=5315): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5315)] 22:03:11.413400 run osmo-msc_10.42.42.6(pid=5315): stdout: | (launched: 2022-12-13_22:03:10.303598) 22:03:11.462349 run osmo-msc_10.42.42.6(pid=5315): stderr: | 20221213220310576 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220310576 DLGLOBAL DEBUG validating counter group 0x7fb0bd6cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220310576 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220310576 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220310576 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220310576 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220310578 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220310579 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220310579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220310579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:11.511551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5308): Terminating (SIGTERM) 22:03:11.551006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5311): Terminating (SIGTERM) 22:03:11.590369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5314): Terminating (SIGTERM) 22:03:11.629880 --- ParallelTerminationStrategy: PID 5308 died... 22:03:11.648858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5308): Terminated: ok {rc=0} 22:03:11.692557 --- ParallelTerminationStrategy: PID 5311 died... 22:03:11.711255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5311): Terminated: ok {rc=0} 22:03:11.754830 --- ParallelTerminationStrategy: PID 5314 died... 22:03:11.773386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5314): Terminated: ok {rc=0} 22:03:11.859108 bus /sierra_3: Setting Powered False 22:03:12.957936 bus /sierra_3: Setting Powered False 22:03:14.071511 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:03:15.221216 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:15.233205 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:03:15.307390 tst mo_mt_call_osmux.py: using LAC 36519 22:03:15.431338 tst mo_mt_call_osmux.py: using RAC 54 22:03:15.549270 tst mo_mt_call_osmux.py: using CellId 36519 22:03:15.667897 tst mo_mt_call_osmux.py: using BVCI 36520 22:03:15.777168 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:15.788219 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:15.799305 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:15.810411 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:15.821719 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:03:15.832620 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:03:15.971467 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:03:16.095499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:16.705708 run create_hlr_db(pid=5317): Launched 22:03:16.872784 bus /sierra_2: Setting Powered False 22:03:17.937194 run create_hlr_db(pid=5317): Terminated: ok {rc=0} 22:03:18.366676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5319): Launched 22:03:18.665859 run osmo-hlr_10.42.42.2(pid=5320): Launched 22:03:18.782156 run osmo-stp_10.42.42.5: Starting osmo-stp 22:03:19.299023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5322): Launched 22:03:19.598212 run osmo-stp_10.42.42.5(pid=5323): Launched 22:03:19.712508 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:20.255292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5325): Launched 22:03:20.554353 run osmo-msc_10.42.42.6(pid=5326): Launched 22:03:20.723323 run osmo-stp_10.42.42.5(pid=5323): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5323)] 22:03:20.850497 run osmo-stp_10.42.42.5(pid=5323): stdout: | (launched: 2022-12-13_22:03:19.544164) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:20.976815 run osmo-stp_10.42.42.5(pid=5323): stderr: | 20221213220319713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220319713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220319713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220319714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220319714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220319714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220319714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:21.102096 run osmo-stp_10.42.42.5(pid=5323): stdout: | (launched: 2022-12-13_22:03:19.544164) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:21.221771 run osmo-stp_10.42.42.5(pid=5323): stderr: | 20221213220319713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220319713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220319713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220319714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220319714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220319714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220319714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:21.365065 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5323): Process ended prematurely: osmo-stp_10.42.42.5(pid=5323) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5323)] [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:03:21.373983 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:03:21.400116 run osmo-hlr_10.42.42.2(pid=5320): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5320)] 22:03:21.447359 run osmo-hlr_10.42.42.2(pid=5320): stdout: | (launched: 2022-12-13_22:03:18.611562) 22:03:21.496573 run osmo-hlr_10.42.42.2(pid=5320): stderr: | 20221213220318789 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220318789 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220318789 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220318789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220318789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220318789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220318801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220318810 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220318810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220318810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:21.565024 run osmo-msc_10.42.42.6(pid=5326): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5326)] 22:03:21.611780 run osmo-msc_10.42.42.6(pid=5326): stdout: | (launched: 2022-12-13_22:03:20.500209) 22:03:21.660311 run osmo-msc_10.42.42.6(pid=5326): stderr: | 20221213220320769 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220320770 DLGLOBAL DEBUG validating counter group 0x7effb9ec1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220320770 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220320770 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220320771 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220320771 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220320773 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220320773 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220320773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220320774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:21.709351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5319): Terminating (SIGTERM) 22:03:21.748333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5322): Terminating (SIGTERM) 22:03:21.787485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5325): Terminating (SIGTERM) 22:03:21.826981 --- ParallelTerminationStrategy: PID 5319 died... 22:03:21.845991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5319): Terminated: ok {rc=0} 22:03:21.889411 --- ParallelTerminationStrategy: PID 5322 died... 22:03:21.907859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5322): Terminated: ok {rc=0} 22:03:21.951197 --- ParallelTerminationStrategy: PID 5325 died... 22:03:21.969633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5325): Terminated: ok {rc=0} 22:03:22.054841 bus /sierra_3: Setting Powered False 22:03:23.153993 bus /sierra_3: Setting Powered False 22:03:24.267974 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:03:25.515140 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:03:25.521352 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:03:25.553704 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:03:25.579884 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:03:25.630729 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:03:25.663405 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:03:25.689634 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:03:26.241070 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:03:26.288539 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:26.299638 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:03:26.371393 tst mo_mt_call.py: using LAC 36520 22:03:26.488287 tst mo_mt_call.py: using RAC 55 22:03:26.602538 tst mo_mt_call.py: using CellId 36520 22:03:26.720623 tst mo_mt_call.py: using BVCI 36521 22:03:26.829592 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:26.840475 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:26.851280 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:26.862085 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:26.872818 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:26.883490 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:03:27.005030 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:03:27.120798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:27.583796 run create_hlr_db(pid=5331): Launched 22:03:27.707033 bus /sierra_2: Setting Powered False 22:03:28.766489 run create_hlr_db(pid=5331): Terminated: ok {rc=0} 22:03:29.204432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5333): Launched 22:03:29.524436 run osmo-hlr_10.42.42.2(pid=5334): Launched 22:03:29.647793 run osmo-stp_10.42.42.5: Starting osmo-stp 22:03:30.199243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5336): Launched 22:03:30.519550 run osmo-stp_10.42.42.5(pid=5337): Launched 22:03:30.643987 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:31.253694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5339): Launched 22:03:31.586387 run osmo-msc_10.42.42.6(pid=5340): Launched 22:03:31.867082 run osmo-stp_10.42.42.5(pid=5337): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5337)] 22:03:32.081921 run osmo-stp_10.42.42.5(pid=5337): stdout: | (launched: 2022-12-13_22:03:30.462054) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:32.244613 run osmo-stp_10.42.42.5(pid=5337): stderr: | 20221213220330655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220330655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220330655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220330656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220330656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220330656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220330656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:32.447985 run osmo-stp_10.42.42.5(pid=5337): stdout: | (launched: 2022-12-13_22:03:30.462054) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:32.569118 run osmo-stp_10.42.42.5(pid=5337): stderr: | 20221213220330655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220330655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220330655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220330656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220330656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220330656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220330656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:32.712846 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5337): Process ended prematurely: osmo-stp_10.42.42.5(pid=5337) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5337)] [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:03:32.722062 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 22:03:32.748486 run osmo-hlr_10.42.42.2(pid=5334): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5334)] 22:03:32.797284 run osmo-hlr_10.42.42.2(pid=5334): stdout: | (launched: 2022-12-13_22:03:29.467026) 22:03:32.846623 run osmo-hlr_10.42.42.2(pid=5334): stderr: | 20221213220329663 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220329663 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220329663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220329663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220329663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220329663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220329675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220329684 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220329684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220329684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:32.915902 run osmo-msc_10.42.42.6(pid=5340): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5340)] 22:03:32.963228 run osmo-msc_10.42.42.6(pid=5340): stdout: | (launched: 2022-12-13_22:03:31.523456) 22:03:33.012670 run osmo-msc_10.42.42.6(pid=5340): stderr: | 20221213220332149 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220332149 DLGLOBAL DEBUG validating counter group 0x7f2e66daec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220332149 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220332149 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220332149 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220332149 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220332151 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220332151 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220332151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220332152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:33.062297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5333): Terminating (SIGTERM) 22:03:33.102681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5336): Terminating (SIGTERM) 22:03:33.142751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5339): Terminating (SIGTERM) 22:03:33.183031 --- ParallelTerminationStrategy: PID 5333 died... 22:03:33.202718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5333): Terminated: ok {rc=0} 22:03:33.247276 --- ParallelTerminationStrategy: PID 5336 died... 22:03:33.266576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5336): Terminated: ok {rc=0} 22:03:33.311197 --- ParallelTerminationStrategy: PID 5339 died... 22:03:33.330558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5339): Terminated: ok {rc=0} 22:03:33.417490 bus /sierra_3: Setting Powered False 22:03:34.516723 bus /sierra_3: Setting Powered False 22:03:35.630008 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:03:36.778918 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:36.791042 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:03:36.862539 tst mo_mt_call_osmux.py: using LAC 36521 22:03:36.989539 tst mo_mt_call_osmux.py: using RAC 56 22:03:37.109420 tst mo_mt_call_osmux.py: using CellId 36521 22:03:37.226592 tst mo_mt_call_osmux.py: using BVCI 36522 22:03:37.334664 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:37.345796 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:37.356704 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:37.367611 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:37.378477 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:03:37.389290 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:03:37.509434 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:03:37.627160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:38.092910 run create_hlr_db(pid=5342): Launched 22:03:38.216353 bus /sierra_2: Setting Powered False 22:03:39.277721 run create_hlr_db(pid=5342): Terminated: ok {rc=0} 22:03:39.716164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5344): Launched 22:03:40.036425 run osmo-hlr_10.42.42.2(pid=5345): Launched 22:03:40.160042 run osmo-stp_10.42.42.5: Starting osmo-stp 22:03:40.712585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5347): Launched 22:03:41.031421 run osmo-stp_10.42.42.5(pid=5348): Launched 22:03:41.154069 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:41.739414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5350): Launched 22:03:42.060417 run osmo-msc_10.42.42.6(pid=5351): Launched 22:03:42.240751 run osmo-stp_10.42.42.5(pid=5348): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5348)] 22:03:42.376598 run osmo-stp_10.42.42.5(pid=5348): stdout: | (launched: 2022-12-13_22:03:40.973983) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:42.512760 run osmo-stp_10.42.42.5(pid=5348): stderr: | 20221213220341164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220341164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220341165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220341165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220341165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220341166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220341166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:42.647968 run osmo-stp_10.42.42.5(pid=5348): stdout: | (launched: 2022-12-13_22:03:40.973983) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:42.776197 run osmo-stp_10.42.42.5(pid=5348): stderr: | 20221213220341164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220341164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220341165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220341165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220341165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220341166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220341166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:42.929936 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5348): Process ended prematurely: osmo-stp_10.42.42.5(pid=5348) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5348)] [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:03:42.939365 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:03:42.966986 run osmo-hlr_10.42.42.2(pid=5345): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5345)] 22:03:43.017313 run osmo-hlr_10.42.42.2(pid=5345): stdout: | (launched: 2022-12-13_22:03:39.978838) 22:03:43.069186 run osmo-hlr_10.42.42.2(pid=5345): stderr: | 20221213220340177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220340177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220340177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220340178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220340178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220340178 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220340197 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220340206 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220340206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220340206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:43.141186 run osmo-msc_10.42.42.6(pid=5351): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5351)] 22:03:43.190718 run osmo-msc_10.42.42.6(pid=5351): stdout: | (launched: 2022-12-13_22:03:42.002758) 22:03:43.242570 run osmo-msc_10.42.42.6(pid=5351): stderr: | 20221213220342322 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220342322 DLGLOBAL DEBUG validating counter group 0x7fc68185cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220342322 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220342322 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220342322 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220342323 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220342324 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220342325 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220342325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220342325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:43.294645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5344): Terminating (SIGTERM) 22:03:43.336173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5347): Terminating (SIGTERM) 22:03:43.377899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5350): Terminating (SIGTERM) 22:03:43.419666 --- ParallelTerminationStrategy: PID 5344 died... 22:03:43.439849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5344): Terminated: ok {rc=0} 22:03:43.485892 --- ParallelTerminationStrategy: PID 5347 died... 22:03:43.505652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5347): Terminated: ok {rc=0} 22:03:43.551336 --- ParallelTerminationStrategy: PID 5350 died... 22:03:43.571127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5350): Terminated: ok {rc=0} 22:03:43.658764 bus /sierra_3: Setting Powered False 22:03:44.756496 bus /sierra_3: Setting Powered False 22:03:45.878400 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:03:47.178838 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:03:47.186302 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:03:47.220750 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:03:47.248939 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:03:47.299602 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:03:47.331902 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:03:47.358426 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:03:47.908757 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:03:47.957549 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:47.968379 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:03:48.042365 tst mo_mt_call.py: using LAC 36522 22:03:48.159308 tst mo_mt_call.py: using RAC 57 22:03:48.275750 tst mo_mt_call.py: using CellId 36522 22:03:48.392859 tst mo_mt_call.py: using BVCI 36523 22:03:48.501126 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:48.512003 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:48.522764 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:48.533519 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:48.544231 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:48.555494 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:03:48.670106 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:03:48.789689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:49.287551 run create_hlr_db(pid=5356): Launched 22:03:49.411507 bus /sierra_2: Setting Powered False 22:03:50.474722 run create_hlr_db(pid=5356): Terminated: ok {rc=0} 22:03:50.921628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5358): Launched 22:03:51.241369 run osmo-hlr_10.42.42.2(pid=5359): Launched 22:03:51.365752 run osmo-stp_10.42.42.5: Starting osmo-stp 22:03:51.919332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5361): Launched 22:03:52.222237 run osmo-stp_10.42.42.5(pid=5362): Launched 22:03:52.337631 run osmo-msc_10.42.42.6: Starting osmo-msc 22:03:52.879443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5364): Launched 22:03:53.179425 run osmo-msc_10.42.42.6(pid=5365): Launched 22:03:53.362559 run osmo-stp_10.42.42.5(pid=5362): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5362)] 22:03:53.499991 run osmo-stp_10.42.42.5(pid=5362): stdout: | (launched: 2022-12-13_22:03:52.168404) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:53.639457 run osmo-stp_10.42.42.5(pid=5362): stderr: | 20221213220352338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220352338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220352338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220352339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220352339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220352339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220352339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:53.774901 run osmo-stp_10.42.42.5(pid=5362): stdout: | (launched: 2022-12-13_22:03:52.168404) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:03:53.903114 run osmo-stp_10.42.42.5(pid=5362): stderr: | 20221213220352338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220352338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220352338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220352339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220352339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220352339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220352339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:03:54.056736 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5362): Process ended prematurely: osmo-stp_10.42.42.5(pid=5362) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5362)] [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:03:54.066242 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:03:54.093858 run osmo-hlr_10.42.42.2(pid=5359): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5359)] 22:03:54.144233 run osmo-hlr_10.42.42.2(pid=5359): stdout: | (launched: 2022-12-13_22:03:51.183724) 22:03:54.195843 run osmo-hlr_10.42.42.2(pid=5359): stderr: | 20221213220351382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220351382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220351382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220351382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220351382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220351382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220351395 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220351403 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220351404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220351404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:03:54.268335 run osmo-msc_10.42.42.6(pid=5365): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5365)] 22:03:54.317964 run osmo-msc_10.42.42.6(pid=5365): stdout: | (launched: 2022-12-13_22:03:53.124677) 22:03:54.369612 run osmo-msc_10.42.42.6(pid=5365): stderr: | 20221213220353438 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220353439 DLGLOBAL DEBUG validating counter group 0x7fbae3fbbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220353439 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220353439 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220353439 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220353439 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220353441 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220353441 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220353441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220353442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:03:54.421529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5358): Terminating (SIGTERM) 22:03:54.462911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5361): Terminating (SIGTERM) 22:03:54.504331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5364): Terminating (SIGTERM) 22:03:54.546210 --- ParallelTerminationStrategy: PID 5358 died... 22:03:54.566357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5358): Terminated: ok {rc=0} 22:03:54.612496 --- ParallelTerminationStrategy: PID 5361 died... 22:03:54.632052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5361): Terminated: ok {rc=0} 22:03:54.677896 --- ParallelTerminationStrategy: PID 5364 died... 22:03:54.697453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5364): Terminated: ok {rc=0} 22:03:54.786909 bus /sierra_3: Setting Powered False 22:03:55.882650 bus /sierra_3: Setting Powered False 22:03:56.998309 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:03:58.144117 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:58.155636 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:03:58.225034 tst mo_mt_call_osmux.py: using LAC 36523 22:03:58.344553 tst mo_mt_call_osmux.py: using RAC 58 22:03:58.465215 tst mo_mt_call_osmux.py: using CellId 36523 22:03:58.582943 tst mo_mt_call_osmux.py: using BVCI 36524 22:03:58.700342 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:58.712038 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:58.723274 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:58.734771 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:58.746603 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:03:58.758308 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:03:58.874429 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:03:58.988401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:03:59.449910 run create_hlr_db(pid=5367): Launched 22:03:59.572575 bus /sierra_2: Setting Powered False 22:04:00.632818 run create_hlr_db(pid=5367): Terminated: ok {rc=0} 22:04:01.075331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5369): Launched 22:04:01.441771 run osmo-hlr_10.42.42.2(pid=5370): Launched 22:04:01.643178 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:02.276530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5372): Launched 22:04:02.628781 run osmo-stp_10.42.42.5(pid=5373): Launched 22:04:02.755237 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:03.337605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5375): Launched 22:04:03.658377 run osmo-msc_10.42.42.6(pid=5376): Launched 22:04:03.839676 run osmo-stp_10.42.42.5(pid=5373): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5373)] 22:04:03.976059 run osmo-stp_10.42.42.5(pid=5373): stdout: | (launched: 2022-12-13_22:04:02.570895) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:04.112432 run osmo-stp_10.42.42.5(pid=5373): stderr: | 20221213220402761 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220402761 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220402762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220402762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220402763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220402763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220402763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:04.248304 run osmo-stp_10.42.42.5(pid=5373): stdout: | (launched: 2022-12-13_22:04:02.570895) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:04.376635 run osmo-stp_10.42.42.5(pid=5373): stderr: | 20221213220402761 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220402761 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220402762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220402762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220402763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220402763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220402763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:04.530690 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5373): Process ended prematurely: osmo-stp_10.42.42.5(pid=5373) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5373)] [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:04:04.540341 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:04:04.568071 run osmo-hlr_10.42.42.2(pid=5370): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5370)] 22:04:04.618688 run osmo-hlr_10.42.42.2(pid=5370): stdout: | (launched: 2022-12-13_22:04:01.374189) 22:04:04.670952 run osmo-hlr_10.42.42.2(pid=5370): stderr: | 20221213220401742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220401742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220401742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220401742 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220401742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220401745 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220401782 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220401808 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220401808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220401808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:04.743331 run osmo-msc_10.42.42.6(pid=5376): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5376)] 22:04:04.793112 run osmo-msc_10.42.42.6(pid=5376): stdout: | (launched: 2022-12-13_22:04:03.600514) 22:04:04.844744 run osmo-msc_10.42.42.6(pid=5376): stderr: | 20221213220403919 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220403919 DLGLOBAL DEBUG validating counter group 0x7fc03d5d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220403919 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220403919 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220403920 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220403920 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220403922 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220403922 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220403922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220403922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:04.896626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5369): Terminating (SIGTERM) 22:04:04.938398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5372): Terminating (SIGTERM) 22:04:04.980092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5375): Terminating (SIGTERM) 22:04:05.022831 --- ParallelTerminationStrategy: PID 5369 died... 22:04:05.043264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5369): Terminated: ok {rc=0} 22:04:05.089545 --- ParallelTerminationStrategy: PID 5372 died... 22:04:05.109459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5372): Terminated: ok {rc=0} 22:04:05.155500 --- ParallelTerminationStrategy: PID 5375 died... 22:04:05.175754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5375): Terminated: ok {rc=0} 22:04:05.265243 bus /sierra_3: Setting Powered False 22:04:06.363461 bus /sierra_3: Setting Powered False 22:04:07.478911 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:04:08.728719 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:04:08.735689 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:04:08.769153 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:04:08.796460 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:04:08.849501 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:04:08.883133 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:04:08.910428 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:04:09.461736 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:04:09.514018 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:09.525674 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:04:09.601905 tst mo_mt_call.py: using LAC 36524 22:04:09.725982 tst mo_mt_call.py: using RAC 59 22:04:09.849406 tst mo_mt_call.py: using CellId 36524 22:04:09.973384 tst mo_mt_call.py: using BVCI 36525 22:04:10.089561 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:10.100918 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:10.112179 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:10.123629 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:10.135468 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:10.147168 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:04:10.263774 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:04:10.384864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:04:10.881312 run create_hlr_db(pid=5381): Launched 22:04:11.003887 bus /sierra_2: Setting Powered False 22:04:12.068602 run create_hlr_db(pid=5381): Terminated: ok {rc=0} 22:04:12.498566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5383): Launched 22:04:12.798880 run osmo-hlr_10.42.42.2(pid=5384): Launched 22:04:12.913799 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:13.428910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5386): Launched 22:04:13.728419 run osmo-stp_10.42.42.5(pid=5387): Launched 22:04:13.843386 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:14.390164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5389): Launched 22:04:14.690676 run osmo-msc_10.42.42.6(pid=5390): Launched 22:04:14.859712 run osmo-stp_10.42.42.5(pid=5387): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5387)] 22:04:14.986677 run osmo-stp_10.42.42.5(pid=5387): stdout: | (launched: 2022-12-13_22:04:13.673926) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:15.114115 run osmo-stp_10.42.42.5(pid=5387): stderr: | 20221213220413844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220413844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220413845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220413845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220413847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220413847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220413847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:15.239377 run osmo-stp_10.42.42.5(pid=5387): stdout: | (launched: 2022-12-13_22:04:13.673926) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:15.359399 run osmo-stp_10.42.42.5(pid=5387): stderr: | 20221213220413844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220413844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220413845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220413845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220413847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220413847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220413847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:15.502366 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5387): Process ended prematurely: osmo-stp_10.42.42.5(pid=5387) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5387)] [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:04:15.511290 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:04:15.537811 run osmo-hlr_10.42.42.2(pid=5384): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5384)] 22:04:15.585406 run osmo-hlr_10.42.42.2(pid=5384): stdout: | (launched: 2022-12-13_22:04:12.744493) 22:04:15.634604 run osmo-hlr_10.42.42.2(pid=5384): stderr: | 20221213220412919 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220412919 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220412919 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220412919 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220412919 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220412919 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220412932 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220412942 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220412942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220412942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:15.702509 run osmo-msc_10.42.42.6(pid=5390): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5390)] 22:04:15.749662 run osmo-msc_10.42.42.6(pid=5390): stdout: | (launched: 2022-12-13_22:04:14.636583) 22:04:15.798448 run osmo-msc_10.42.42.6(pid=5390): stderr: | 20221213220414910 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220414910 DLGLOBAL DEBUG validating counter group 0x7fbeb380ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220414910 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220414910 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220414910 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220414910 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220414912 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220414912 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220414913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220414913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:15.876636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5383): Terminating (SIGTERM) 22:04:15.924863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5386): Terminating (SIGTERM) 22:04:15.965611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5389): Terminating (SIGTERM) 22:04:16.009174 --- ParallelTerminationStrategy: PID 5383 died... 22:04:16.028358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5383): Terminated: ok {rc=0} 22:04:16.073381 --- ParallelTerminationStrategy: PID 5386 died... 22:04:16.092749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5386): Terminated: ok {rc=0} 22:04:16.137721 --- ParallelTerminationStrategy: PID 5389 died... 22:04:16.156621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5389): Terminated: ok {rc=0} 22:04:16.243275 bus /sierra_3: Setting Powered False 22:04:17.343498 bus /sierra_3: Setting Powered False 22:04:18.458545 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:04:19.607088 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:19.619083 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:04:19.690943 tst mo_mt_call_osmux.py: using LAC 36525 22:04:19.811026 tst mo_mt_call_osmux.py: using RAC 60 22:04:19.929056 tst mo_mt_call_osmux.py: using CellId 36525 22:04:20.046816 tst mo_mt_call_osmux.py: using BVCI 36526 22:04:20.157230 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:20.168327 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:20.179391 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:20.190154 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:20.200824 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:04:20.212212 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:04:20.327400 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:04:20.447339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:04:20.942543 run create_hlr_db(pid=5392): Launched 22:04:21.064478 bus /sierra_2: Setting Powered False 22:04:22.127835 run create_hlr_db(pid=5392): Terminated: ok {rc=0} 22:04:22.556017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5394): Launched 22:04:22.856357 run osmo-hlr_10.42.42.2(pid=5395): Launched 22:04:22.971031 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:23.486297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5397): Launched 22:04:23.785742 run osmo-stp_10.42.42.5(pid=5398): Launched 22:04:23.900171 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:24.442045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5400): Launched 22:04:24.741437 run osmo-msc_10.42.42.6(pid=5401): Launched 22:04:24.909321 run osmo-stp_10.42.42.5(pid=5398): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5398)] 22:04:25.035614 run osmo-stp_10.42.42.5(pid=5398): stdout: | (launched: 2022-12-13_22:04:23.730924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:25.162236 run osmo-stp_10.42.42.5(pid=5398): stderr: | 20221213220423900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220423900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220423900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220423900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220423903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220423903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220423903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:25.286770 run osmo-stp_10.42.42.5(pid=5398): stdout: | (launched: 2022-12-13_22:04:23.730924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:25.405977 run osmo-stp_10.42.42.5(pid=5398): stderr: | 20221213220423900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220423900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220423900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220423900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220423903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220423903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220423903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:25.548084 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5398): Process ended prematurely: osmo-stp_10.42.42.5(pid=5398) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5398)] [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:04:25.557027 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:04:25.583306 run osmo-hlr_10.42.42.2(pid=5395): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5395)] 22:04:25.630398 run osmo-hlr_10.42.42.2(pid=5395): stdout: | (launched: 2022-12-13_22:04:22.801866) 22:04:25.678736 run osmo-hlr_10.42.42.2(pid=5395): stderr: | 20221213220422979 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220422979 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220422979 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220422979 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220422979 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220422979 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220422992 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220423001 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220423001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220423001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:25.746581 run osmo-msc_10.42.42.6(pid=5401): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5401)] 22:04:25.795046 run osmo-msc_10.42.42.6(pid=5401): stdout: | (launched: 2022-12-13_22:04:24.687264) 22:04:25.843647 run osmo-msc_10.42.42.6(pid=5401): stderr: | 20221213220424961 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220424961 DLGLOBAL DEBUG validating counter group 0x7f8e5b06ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220424961 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220424961 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220424962 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220424962 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220424965 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220424966 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220424966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220424966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:25.892402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5394): Terminating (SIGTERM) 22:04:25.931493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5397): Terminating (SIGTERM) 22:04:25.970640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5400): Terminating (SIGTERM) 22:04:26.010057 --- ParallelTerminationStrategy: PID 5394 died... 22:04:26.029036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5394): Terminated: ok {rc=0} 22:04:26.072530 --- ParallelTerminationStrategy: PID 5397 died... 22:04:26.090975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5397): Terminated: ok {rc=0} 22:04:26.134280 --- ParallelTerminationStrategy: PID 5400 died... 22:04:26.152786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5400): Terminated: ok {rc=0} 22:04:26.237820 bus /sierra_3: Setting Powered False 22:04:27.335633 bus /sierra_3: Setting Powered False 22:04:28.448085 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:04:29.698871 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:04:29.706295 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:04:29.738639 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:04:29.765203 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:04:29.816466 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:04:29.849582 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:04:29.875721 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:04:30.425888 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:04:30.473563 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:30.484447 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:04:30.553480 tst mo_mt_call.py: using LAC 36526 22:04:30.670841 tst mo_mt_call.py: using RAC 61 22:04:30.788512 tst mo_mt_call.py: using CellId 36526 22:04:30.940012 tst mo_mt_call.py: using BVCI 36527 22:04:31.065970 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:31.077502 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:31.088812 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:31.100319 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:31.112054 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:31.123447 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:04:31.242785 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:04:31.362013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:04:31.840647 run create_hlr_db(pid=5406): Launched 22:04:31.998973 bus /sierra_2: Setting Powered False 22:04:33.058570 run create_hlr_db(pid=5406): Terminated: ok {rc=0} 22:04:33.476607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5408): Launched 22:04:33.774881 run osmo-hlr_10.42.42.2(pid=5409): Launched 22:04:33.888439 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:34.416796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5411): Launched 22:04:34.715832 run osmo-stp_10.42.42.5(pid=5412): Launched 22:04:34.830068 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:35.369702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5414): Launched 22:04:35.666974 run osmo-msc_10.42.42.6(pid=5415): Launched 22:04:35.834203 run osmo-stp_10.42.42.5(pid=5412): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5412)] 22:04:35.960336 run osmo-stp_10.42.42.5(pid=5412): stdout: | (launched: 2022-12-13_22:04:34.660646) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:36.088770 run osmo-stp_10.42.42.5(pid=5412): stderr: | 20221213220434834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220434834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220434835 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220434835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220434835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220434835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220434836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:36.214006 run osmo-stp_10.42.42.5(pid=5412): stdout: | (launched: 2022-12-13_22:04:34.660646) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:36.332867 run osmo-stp_10.42.42.5(pid=5412): stderr: | 20221213220434834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220434834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220434835 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220434835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220434835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220434835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220434836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:36.475073 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5412): Process ended prematurely: osmo-stp_10.42.42.5(pid=5412) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5412)] [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:04:36.483888 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:04:36.510033 run osmo-hlr_10.42.42.2(pid=5409): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5409)] 22:04:36.557826 run osmo-hlr_10.42.42.2(pid=5409): stdout: | (launched: 2022-12-13_22:04:33.721258) 22:04:36.606606 run osmo-hlr_10.42.42.2(pid=5409): stderr: | 20221213220433899 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220433899 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220433899 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220433899 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220433899 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220433899 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220433912 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220433922 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220433922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220433923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:36.674671 run osmo-msc_10.42.42.6(pid=5415): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5415)] 22:04:36.722168 run osmo-msc_10.42.42.6(pid=5415): stdout: | (launched: 2022-12-13_22:04:35.612904) 22:04:36.770548 run osmo-msc_10.42.42.6(pid=5415): stderr: | 20221213220435885 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220435885 DLGLOBAL DEBUG validating counter group 0x7fa712216c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220435886 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220435886 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220435886 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220435886 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220435888 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220435888 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220435888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220435888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:36.819355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5408): Terminating (SIGTERM) 22:04:36.858458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5411): Terminating (SIGTERM) 22:04:36.897577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5414): Terminating (SIGTERM) 22:04:36.936862 --- ParallelTerminationStrategy: PID 5408 died... 22:04:36.955881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5408): Terminated: ok {rc=0} 22:04:36.999127 --- ParallelTerminationStrategy: PID 5411 died... 22:04:37.017420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5411): Terminated: ok {rc=0} 22:04:37.061435 --- ParallelTerminationStrategy: PID 5414 died... 22:04:37.079899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5414): Terminated: ok {rc=0} 22:04:37.162748 bus /sierra_3: Setting Powered False 22:04:38.258032 bus /sierra_3: Setting Powered False 22:04:39.373522 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:04:40.518982 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:40.530531 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:04:40.600006 tst mo_mt_call_osmux.py: using LAC 36527 22:04:40.717388 tst mo_mt_call_osmux.py: using RAC 62 22:04:40.836284 tst mo_mt_call_osmux.py: using CellId 36527 22:04:40.953919 tst mo_mt_call_osmux.py: using BVCI 36528 22:04:41.062242 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:41.073235 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:41.084037 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:41.094807 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:41.105755 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:04:41.116479 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:04:41.238171 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:04:41.359367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:04:41.858550 run create_hlr_db(pid=5417): Launched 22:04:41.983300 bus /sierra_2: Setting Powered False 22:04:43.046564 run create_hlr_db(pid=5417): Terminated: ok {rc=0} 22:04:43.477720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5419): Launched 22:04:43.777722 run osmo-hlr_10.42.42.2(pid=5420): Launched 22:04:43.893074 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:44.424718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5422): Launched 22:04:44.724867 run osmo-stp_10.42.42.5(pid=5423): Launched 22:04:44.840492 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:45.386077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5425): Launched 22:04:45.686796 run osmo-msc_10.42.42.6(pid=5426): Launched 22:04:45.887455 run osmo-stp_10.42.42.5(pid=5423): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5423)] 22:04:46.080815 run osmo-stp_10.42.42.5(pid=5423): stdout: | (launched: 2022-12-13_22:04:44.670620) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:46.314231 run osmo-stp_10.42.42.5(pid=5423): stderr: | 20221213220444842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220444842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220444843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220444843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220444843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220444844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220444844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:46.453598 run osmo-stp_10.42.42.5(pid=5423): stdout: | (launched: 2022-12-13_22:04:44.670620) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:46.588245 run osmo-stp_10.42.42.5(pid=5423): stderr: | 20221213220444842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220444842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220444843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220444843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220444843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220444844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220444844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:46.746400 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5423): Process ended prematurely: osmo-stp_10.42.42.5(pid=5423) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5423)] [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:04:46.756919 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:04:46.789852 run osmo-hlr_10.42.42.2(pid=5420): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5420)] 22:04:46.843370 run osmo-hlr_10.42.42.2(pid=5420): stdout: | (launched: 2022-12-13_22:04:43.723118) 22:04:46.898354 run osmo-hlr_10.42.42.2(pid=5420): stderr: | 20221213220443900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220443900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220443900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220443900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220443900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220443900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220443912 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220443921 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220443921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220443921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:46.972808 run osmo-msc_10.42.42.6(pid=5426): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5426)] 22:04:47.026039 run osmo-msc_10.42.42.6(pid=5426): stdout: | (launched: 2022-12-13_22:04:45.631707) 22:04:47.079497 run osmo-msc_10.42.42.6(pid=5426): stderr: | 20221213220445989 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220445989 DLGLOBAL DEBUG validating counter group 0x7f8ff462cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220445989 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220445989 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220445990 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220445990 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220445992 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220445992 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220445992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220445992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:47.133809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5419): Terminating (SIGTERM) 22:04:47.176663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5422): Terminating (SIGTERM) 22:04:47.223342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5425): Terminating (SIGTERM) 22:04:47.268286 --- ParallelTerminationStrategy: PID 5419 died... 22:04:47.289604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5419): Terminated: ok {rc=0} 22:04:47.336577 --- ParallelTerminationStrategy: PID 5422 died... 22:04:47.357139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5422): Terminated: ok {rc=0} 22:04:47.403978 --- ParallelTerminationStrategy: PID 5425 died... 22:04:47.424429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5425): Terminated: ok {rc=0} 22:04:47.514863 bus /sierra_3: Setting Powered False 22:04:48.609736 bus /sierra_3: Setting Powered False 22:04:49.723483 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:04:50.975841 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:04:50.982902 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:04:51.016539 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:04:51.044422 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:04:51.096729 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:04:51.130116 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:04:51.157932 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:04:51.715375 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:04:51.767962 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:51.779436 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:04:51.852256 tst mo_mt_call.py: using LAC 36528 22:04:51.978179 tst mo_mt_call.py: using RAC 63 22:04:52.103812 tst mo_mt_call.py: using CellId 36528 22:04:52.232932 tst mo_mt_call.py: using BVCI 36529 22:04:52.343857 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:52.354927 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:52.366010 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:52.377047 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:52.388108 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:04:52.399114 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:04:52.520334 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:04:52.636637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:04:53.100732 run create_hlr_db(pid=5431): Launched 22:04:53.223318 bus /sierra_2: Setting Powered False 22:04:54.283661 run create_hlr_db(pid=5431): Terminated: ok {rc=0} 22:04:54.721685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5433): Launched 22:04:55.042076 run osmo-hlr_10.42.42.2(pid=5434): Launched 22:04:55.164884 run osmo-stp_10.42.42.5: Starting osmo-stp 22:04:55.720101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5436): Launched 22:04:56.039972 run osmo-stp_10.42.42.5(pid=5437): Launched 22:04:56.165854 run osmo-msc_10.42.42.6: Starting osmo-msc 22:04:56.751518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5439): Launched 22:04:57.072728 run osmo-msc_10.42.42.6(pid=5440): Launched 22:04:57.253873 run osmo-stp_10.42.42.5(pid=5437): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5437)] 22:04:57.389805 run osmo-stp_10.42.42.5(pid=5437): stdout: | (launched: 2022-12-13_22:04:55.982354) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:57.526541 run osmo-stp_10.42.42.5(pid=5437): stderr: | 20221213220456175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220456176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220456176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220456176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220456177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220456177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220456177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:57.661989 run osmo-stp_10.42.42.5(pid=5437): stdout: | (launched: 2022-12-13_22:04:55.982354) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:04:57.790023 run osmo-stp_10.42.42.5(pid=5437): stderr: | 20221213220456175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220456176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220456176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220456176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220456177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220456177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220456177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:04:57.942986 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5437): Process ended prematurely: osmo-stp_10.42.42.5(pid=5437) [trial-2395↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5437)] [trial-2395↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:04:57.952364 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:04:57.980080 run osmo-hlr_10.42.42.2(pid=5434): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5434)] 22:04:58.030430 run osmo-hlr_10.42.42.2(pid=5434): stdout: | (launched: 2022-12-13_22:04:54.984354) 22:04:58.081932 run osmo-hlr_10.42.42.2(pid=5434): stderr: | 20221213220455181 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220455181 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220455182 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220455182 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220455182 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220455182 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220455194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220455204 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220455205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220455205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:04:58.154082 run osmo-msc_10.42.42.6(pid=5440): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5440)] 22:04:58.203556 run osmo-msc_10.42.42.6(pid=5440): stdout: | (launched: 2022-12-13_22:04:57.014759) 22:04:58.255456 run osmo-msc_10.42.42.6(pid=5440): stderr: | 20221213220457337 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220457337 DLGLOBAL DEBUG validating counter group 0x7ff58c0e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220457337 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220457337 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220457337 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220457337 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220457339 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220457339 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220457340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220457340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:04:58.307462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5433): Terminating (SIGTERM) 22:04:58.349072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5436): Terminating (SIGTERM) 22:04:58.390625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5439): Terminating (SIGTERM) 22:04:58.432319 --- ParallelTerminationStrategy: PID 5433 died... 22:04:58.452438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5433): Terminated: ok {rc=0} 22:04:58.498612 --- ParallelTerminationStrategy: PID 5436 died... 22:04:58.518207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5436): Terminated: ok {rc=0} 22:04:58.563971 --- ParallelTerminationStrategy: PID 5439 died... 22:04:58.583721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5439): Terminated: ok {rc=0} 22:04:58.671401 bus /sierra_3: Setting Powered False 22:04:59.766537 bus /sierra_3: Setting Powered False 22:05:00.898138 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:05:02.048288 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:05:02.061656 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:05:02.136819 tst mo_mt_call_osmux.py: using LAC 36529 22:05:02.259528 tst mo_mt_call_osmux.py: using RAC 64 22:05:02.377562 tst mo_mt_call_osmux.py: using CellId 36529 22:05:02.504327 tst mo_mt_call_osmux.py: using BVCI 36530 22:05:02.620602 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:05:02.632172 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:05:02.643481 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:05:02.654856 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:05:02.666665 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:05:02.678292 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:05:02.800004 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:05:02.916638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:03.382472 run create_hlr_db(pid=5452): Launched 22:05:03.505179 bus /sierra_2: Setting Powered False 22:05:04.565715 run create_hlr_db(pid=5452): Terminated: ok {rc=0} 22:05:05.005462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5454): Launched 22:05:05.327336 run osmo-hlr_10.42.42.2(pid=5455): Launched 22:05:05.450950 run osmo-stp_10.42.42.5: Starting osmo-stp 22:05:06.007622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5457): Launched 22:05:06.329670 run osmo-stp_10.42.42.5(pid=5458): Launched 22:05:06.452581 run osmo-msc_10.42.42.6: Starting osmo-msc 22:05:07.035834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5460): Launched 22:05:07.356942 run osmo-msc_10.42.42.6(pid=5461): Launched 22:05:07.536844 run osmo-stp_10.42.42.5(pid=5458): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5458)] 22:05:07.673519 run osmo-stp_10.42.42.5(pid=5458): stdout: | (launched: 2022-12-13_22:05:06.271466) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:07.810438 run osmo-stp_10.42.42.5(pid=5458): stderr: | 20221213220506463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220506463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220506463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220506464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220506466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220506466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220506466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:07.945994 run osmo-stp_10.42.42.5(pid=5458): stdout: | (launched: 2022-12-13_22:05:06.271466) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:08.074379 run osmo-stp_10.42.42.5(pid=5458): stderr: | 20221213220506463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220506463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220506463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220506464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220506466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220506466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220506466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:08.227869 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5458): Process ended prematurely: osmo-stp_10.42.42.5(pid=5458) [trial-2395↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5458)] [trial-2395↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:05:08.237384 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:05:08.265192 run osmo-hlr_10.42.42.2(pid=5455): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5455)] 22:05:08.315465 run osmo-hlr_10.42.42.2(pid=5455): stdout: | (launched: 2022-12-13_22:05:05.269393) 22:05:08.367089 run osmo-hlr_10.42.42.2(pid=5455): stderr: | 20221213220505465 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220505465 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220505465 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220505465 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220505465 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220505465 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220505481 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220505490 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220505491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220505491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:05:08.439261 run osmo-msc_10.42.42.6(pid=5461): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5461)] 22:05:08.489253 run osmo-msc_10.42.42.6(pid=5461): stdout: | (launched: 2022-12-13_22:05:07.299105) 22:05:08.540655 run osmo-msc_10.42.42.6(pid=5461): stderr: | 20221213220507621 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220507621 DLGLOBAL DEBUG validating counter group 0x7f54f9631c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220507621 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220507621 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220507621 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220507621 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220507623 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220507623 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220507624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220507624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:05:08.592406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5454): Terminating (SIGTERM) 22:05:08.633892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5457): Terminating (SIGTERM) 22:05:08.675540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5460): Terminating (SIGTERM) 22:05:08.717236 --- ParallelTerminationStrategy: PID 5454 died... 22:05:08.737429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5454): Terminated: ok {rc=0} 22:05:08.783600 --- ParallelTerminationStrategy: PID 5457 died... 22:05:08.803236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5457): Terminated: ok {rc=0} 22:05:08.849204 --- ParallelTerminationStrategy: PID 5460 died... 22:05:08.868737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5460): Terminated: ok {rc=0} 22:05:08.956555 bus /sierra_3: Setting Powered False 22:05:10.054725 bus /sierra_3: Setting Powered False 22:05:11.169220 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:05:12.419938 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:05:12.426277 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:05:12.460407 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:05:12.489101 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:05:12.540235 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:05:12.574102 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:05:12.604325 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:05:13.150810 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:05:13.204445 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:13.216518 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:05:13.288059 tst mo_mt_call.py: using LAC 36530 22:05:13.410678 tst mo_mt_call.py: using RAC 65 22:05:13.539594 tst mo_mt_call.py: using CellId 36530 22:05:13.668355 tst mo_mt_call.py: using BVCI 36531 22:05:13.787129 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:13.799056 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:13.811803 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:13.823589 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:13.835715 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:13.847743 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:05:13.974290 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:05:14.092722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:14.558708 run create_hlr_db(pid=5817): Launched 22:05:14.681981 bus /sierra_2: Setting Powered False 22:05:15.742532 run create_hlr_db(pid=5817): Terminated: ok {rc=0} 22:05:16.208038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5819): Launched 22:05:16.524938 run osmo-hlr_10.42.42.2(pid=5820): Launched 22:05:16.758692 run osmo-stp_10.42.42.5: Starting osmo-stp 22:05:17.477703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5822): Launched 22:05:17.779178 run osmo-stp_10.42.42.5(pid=5823): Launched 22:05:17.894030 run osmo-msc_10.42.42.6: Starting osmo-msc 22:05:18.438468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5825): Launched 22:05:18.738948 run osmo-msc_10.42.42.6(pid=5826): Launched 22:05:18.907233 run osmo-stp_10.42.42.5(pid=5823): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5823)] 22:05:19.034642 run osmo-stp_10.42.42.5(pid=5823): stdout: | (launched: 2022-12-13_22:05:17.724429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:19.161920 run osmo-stp_10.42.42.5(pid=5823): stderr: | 20221213220517895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220517895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220517895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220517896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220517898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220517898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220517898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:19.287522 run osmo-stp_10.42.42.5(pid=5823): stdout: | (launched: 2022-12-13_22:05:17.724429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:19.407632 run osmo-stp_10.42.42.5(pid=5823): stderr: | 20221213220517895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220517895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220517895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220517896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220517898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220517898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220517898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:19.551288 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5823): Process ended prematurely: osmo-stp_10.42.42.5(pid=5823) [trial-2395↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5823)] [trial-2395↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:05:19.560139 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:05:19.586496 run osmo-hlr_10.42.42.2(pid=5820): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5820)] 22:05:19.634132 run osmo-hlr_10.42.42.2(pid=5820): stdout: | (launched: 2022-12-13_22:05:16.463142) 22:05:19.683892 run osmo-hlr_10.42.42.2(pid=5820): stderr: | 20221213220516807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220516807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220516807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220516807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220516807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220516808 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220516830 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220516846 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220516846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220516846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:05:19.752677 run osmo-msc_10.42.42.6(pid=5826): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5826)] 22:05:19.800133 run osmo-msc_10.42.42.6(pid=5826): stdout: | (launched: 2022-12-13_22:05:18.683916) 22:05:19.849227 run osmo-msc_10.42.42.6(pid=5826): stderr: | 20221213220518957 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220518957 DLGLOBAL DEBUG validating counter group 0x7f444362ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220518957 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220518958 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220518958 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220518958 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220518960 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220518960 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220518960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220518960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:05:19.898640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5819): Terminating (SIGTERM) 22:05:19.938054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5822): Terminating (SIGTERM) 22:05:19.977457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5825): Terminating (SIGTERM) 22:05:20.017197 --- ParallelTerminationStrategy: PID 5819 died... 22:05:20.036350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5819): Terminated: ok {rc=0} 22:05:20.079948 --- ParallelTerminationStrategy: PID 5822 died... 22:05:20.098529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5822): Terminated: ok {rc=0} 22:05:20.141994 --- ParallelTerminationStrategy: PID 5825 died... 22:05:20.160534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5825): Terminated: ok {rc=0} 22:05:20.243940 bus /sierra_3: Setting Powered False 22:05:21.342441 bus /sierra_3: Setting Powered False 22:05:22.457000 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:05:23.612806 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:23.625766 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:05:23.701501 tst mo_mt_call_osmux.py: using LAC 36531 22:05:23.831655 tst mo_mt_call_osmux.py: using RAC 66 22:05:23.958885 tst mo_mt_call_osmux.py: using CellId 36531 22:05:24.086782 tst mo_mt_call_osmux.py: using BVCI 36532 22:05:24.207286 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:24.219579 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:24.231701 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:24.243852 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:24.257624 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:05:24.270897 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:05:24.395981 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:05:24.520620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:25.035539 run create_hlr_db(pid=6003): Launched 22:05:25.199521 bus /sierra_2: Setting Powered False 22:05:26.263978 run create_hlr_db(pid=6003): Terminated: ok {rc=0} 22:05:26.733850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6005): Launched 22:05:27.073689 run osmo-hlr_10.42.42.2(pid=6006): Launched 22:05:27.325638 run osmo-stp_10.42.42.5: Starting osmo-stp 22:05:27.977936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6008): Launched 22:05:28.323309 run osmo-stp_10.42.42.5(pid=6010): Launched 22:05:28.571294 run osmo-msc_10.42.42.6: Starting osmo-msc 22:05:29.122511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6012): Launched 22:05:29.426707 run osmo-msc_10.42.42.6(pid=6013): Launched 22:05:29.597326 run osmo-stp_10.42.42.5(pid=6010): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6010)] 22:05:29.725237 run osmo-stp_10.42.42.5(pid=6010): stdout: | (launched: 2022-12-13_22:05:28.262314) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:29.853216 run osmo-stp_10.42.42.5(pid=6010): stderr: | 20221213220528561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220528561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220528562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220528562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220528568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220528569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220528569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:29.978888 run osmo-stp_10.42.42.5(pid=6010): stdout: | (launched: 2022-12-13_22:05:28.262314) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:30.099202 run osmo-stp_10.42.42.5(pid=6010): stderr: | 20221213220528561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220528561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220528562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220528562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220528568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220528569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220528569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:30.243691 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6010): Process ended prematurely: osmo-stp_10.42.42.5(pid=6010) [trial-2395↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6010)] [trial-2395↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:05:30.252516 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 22:05:30.278778 run osmo-hlr_10.42.42.2(pid=6006): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6006)] 22:05:30.326839 run osmo-hlr_10.42.42.2(pid=6006): stdout: | (launched: 2022-12-13_22:05:27.015362) 22:05:30.375597 run osmo-hlr_10.42.42.2(pid=6006): stderr: | 20221213220527314 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220527315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220527315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220527315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220527315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220527315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220527331 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220527348 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220527348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220527348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:05:30.443838 run osmo-msc_10.42.42.6(pid=6013): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6013)] 22:05:30.491087 run osmo-msc_10.42.42.6(pid=6013): stdout: | (launched: 2022-12-13_22:05:29.371395) 22:05:30.539858 run osmo-msc_10.42.42.6(pid=6013): stderr: | 20221213220529642 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220529642 DLGLOBAL DEBUG validating counter group 0x7fa7cf3e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220529642 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220529642 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220529642 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220529643 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220529644 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220529645 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220529645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220529645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:05:30.589063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6005): Terminating (SIGTERM) 22:05:30.628360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6008): Terminating (SIGTERM) 22:05:30.667729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6012): Terminating (SIGTERM) 22:05:30.707271 --- ParallelTerminationStrategy: PID 6005 died... 22:05:30.726459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6005): Terminated: ok {rc=0} 22:05:30.770276 --- ParallelTerminationStrategy: PID 6008 died... 22:05:30.788628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6008): Terminated: ok {rc=0} 22:05:30.832442 --- ParallelTerminationStrategy: PID 6012 died... 22:05:30.851762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6012): Terminated: ok {rc=0} 22:05:30.947628 bus /sierra_3: Setting Powered False 22:05:32.047318 bus /sierra_3: Setting Powered False 22:05:33.162356 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 22:05:34.421440 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:05:34.426776 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 22:05:34.460555 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 22:05:34.488449 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 22:05:34.541374 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 22:05:34.575202 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 22:05:34.603194 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 22:05:35.153884 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 22:05:35.207879 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:35.219339 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 22:05:35.271698 tst mo_mt_call.py: using LAC 36532 22:05:35.400307 tst mo_mt_call.py: using RAC 67 22:05:35.526422 tst mo_mt_call.py: using CellId 36532 22:05:35.654978 tst mo_mt_call.py: using BVCI 36533 22:05:35.772667 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:35.784279 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:35.795660 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:35.806985 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:35.818502 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:35.830311 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 22:05:35.949790 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 22:05:36.070304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:36.573413 run create_hlr_db(pid=6018): Launched 22:05:36.697322 bus /sierra_2: Setting Powered False 22:05:37.761485 run create_hlr_db(pid=6018): Terminated: ok {rc=0} 22:05:38.212884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6020): Launched 22:05:38.539182 run osmo-hlr_10.42.42.2(pid=6021): Launched 22:05:38.664039 run osmo-stp_10.42.42.5: Starting osmo-stp 22:05:39.225157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6023): Launched 22:05:39.551599 run osmo-stp_10.42.42.5(pid=6024): Launched 22:05:39.676646 run osmo-msc_10.42.42.6: Starting osmo-msc 22:05:40.265263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6026): Launched 22:05:40.589466 run osmo-msc_10.42.42.6(pid=6027): Launched 22:05:40.772290 run osmo-stp_10.42.42.5(pid=6024): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6024)] 22:05:40.909264 run osmo-stp_10.42.42.5(pid=6024): stdout: | (launched: 2022-12-13_22:05:39.492577) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:41.047235 run osmo-stp_10.42.42.5(pid=6024): stderr: | 20221213220539685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220539685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220539685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220539686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220539686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220539686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220539686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:41.183987 run osmo-stp_10.42.42.5(pid=6024): stdout: | (launched: 2022-12-13_22:05:39.492577) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:41.314429 run osmo-stp_10.42.42.5(pid=6024): stderr: | 20221213220539685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220539685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220539685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220539686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220539686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220539686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220539686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:41.469477 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6024): Process ended prematurely: osmo-stp_10.42.42.5(pid=6024) [trial-2395↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6024)] [trial-2395↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 22:05:41.479081 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:05:41.506604 run osmo-hlr_10.42.42.2(pid=6021): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6021)] 22:05:41.557186 run osmo-hlr_10.42.42.2(pid=6021): stdout: | (launched: 2022-12-13_22:05:38.480735) 22:05:41.609397 run osmo-hlr_10.42.42.2(pid=6021): stderr: | 20221213220538680 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220538680 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220538680 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220538681 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220538681 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220538681 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220538693 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220538701 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220538701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220538701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:05:41.682471 run osmo-msc_10.42.42.6(pid=6027): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6027)] 22:05:41.732879 run osmo-msc_10.42.42.6(pid=6027): stdout: | (launched: 2022-12-13_22:05:40.531008) 22:05:41.784519 run osmo-msc_10.42.42.6(pid=6027): stderr: | 20221213220540852 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220540853 DLGLOBAL DEBUG validating counter group 0x7f6207020c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220540853 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220540853 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220540853 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220540853 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220540856 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220540856 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220540856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220540857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:05:41.836511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6020): Terminating (SIGTERM) 22:05:41.878461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6023): Terminating (SIGTERM) 22:05:41.921283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6026): Terminating (SIGTERM) 22:05:41.963704 --- ParallelTerminationStrategy: PID 6020 died... 22:05:41.983941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6020): Terminated: ok {rc=0} 22:05:42.030933 --- ParallelTerminationStrategy: PID 6023 died... 22:05:42.050811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6023): Terminated: ok {rc=0} 22:05:42.096910 --- ParallelTerminationStrategy: PID 6026 died... 22:05:42.117248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6026): Terminated: ok {rc=0} 22:05:42.206019 bus /sierra_3: Setting Powered False 22:05:43.304685 bus /sierra_3: Setting Powered False 22:05:44.420258 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 22:05:45.568826 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:45.581027 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 22:05:45.634911 tst mo_mt_call_osmux.py: using LAC 36533 22:05:45.765614 tst mo_mt_call_osmux.py: using RAC 68 22:05:45.896549 tst mo_mt_call_osmux.py: using CellId 36533 22:05:46.031144 tst mo_mt_call_osmux.py: using BVCI 36534 22:05:46.183279 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:46.197882 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:46.212630 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:46.228336 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:46.243475 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:05:46.258774 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 22:05:46.411306 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 22:05:46.538976 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:47.049185 run create_hlr_db(pid=6029): Launched 22:05:47.211804 bus /sierra_2: Setting Powered False 22:05:48.275759 run create_hlr_db(pid=6029): Terminated: ok {rc=0} 22:05:48.728504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6031): Launched 22:05:49.053330 run osmo-hlr_10.42.42.2(pid=6032): Launched 22:05:49.178388 run osmo-stp_10.42.42.5: Starting osmo-stp 22:05:49.740866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6034): Launched 22:05:50.065416 run osmo-stp_10.42.42.5(pid=6035): Launched 22:05:50.192521 run osmo-msc_10.42.42.6: Starting osmo-msc 22:05:50.783843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6037): Launched 22:05:51.109243 run osmo-msc_10.42.42.6(pid=6038): Launched 22:05:51.293586 run osmo-stp_10.42.42.5(pid=6035): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6035)] 22:05:51.430817 run osmo-stp_10.42.42.5(pid=6035): stdout: | (launched: 2022-12-13_22:05:50.006945) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:51.568773 run osmo-stp_10.42.42.5(pid=6035): stderr: | 20221213220550199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220550199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220550199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220550200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220550200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220550200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220550200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:51.705779 run osmo-stp_10.42.42.5(pid=6035): stdout: | (launched: 2022-12-13_22:05:50.006945) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:05:51.835611 run osmo-stp_10.42.42.5(pid=6035): stderr: | 20221213220550199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220550199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220550199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220550200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220550200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220550200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220550200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:05:51.989588 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6035): Process ended prematurely: osmo-stp_10.42.42.5(pid=6035) [trial-2395↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6035)] [trial-2395↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 22:05:51.998495 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:05:52.024616 run osmo-hlr_10.42.42.2(pid=6032): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6032)] 22:05:52.072515 run osmo-hlr_10.42.42.2(pid=6032): stdout: | (launched: 2022-12-13_22:05:48.994534) 22:05:52.121492 run osmo-hlr_10.42.42.2(pid=6032): stderr: | 20221213220549193 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220549193 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220549193 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220549193 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220549194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220549194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220549207 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220549217 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220549217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220549217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:05:52.189494 run osmo-msc_10.42.42.6(pid=6038): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6038)] 22:05:52.236579 run osmo-msc_10.42.42.6(pid=6038): stdout: | (launched: 2022-12-13_22:05:51.050660) 22:05:52.285489 run osmo-msc_10.42.42.6(pid=6038): stderr: | 20221213220551372 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220551373 DLGLOBAL DEBUG validating counter group 0x7f83be346c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220551373 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220551373 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220551373 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220551373 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220551375 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220551375 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220551375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220551375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:05:52.335034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6031): Terminating (SIGTERM) 22:05:52.374684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6034): Terminating (SIGTERM) 22:05:52.414068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6037): Terminating (SIGTERM) 22:05:52.453800 --- ParallelTerminationStrategy: PID 6031 died... 22:05:52.472590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6031): Terminated: ok {rc=0} 22:05:52.516161 --- ParallelTerminationStrategy: PID 6034 died... 22:05:52.534706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6034): Terminated: ok {rc=0} 22:05:52.578259 --- ParallelTerminationStrategy: PID 6037 died... 22:05:52.597023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6037): Terminated: ok {rc=0} 22:05:52.683081 bus /sierra_3: Setting Powered False 22:05:53.782169 bus /sierra_3: Setting Powered False 22:05:54.896022 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:05:56.151164 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:05:56.158307 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:05:56.191454 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 22:05:56.218196 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 22:05:56.271214 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:05:56.305361 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 22:05:56.333236 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 22:05:56.882862 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 22:05:56.931091 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:56.942354 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:05:56.994462 tst mo_mt_call.py: using LAC 36534 22:05:57.113379 tst mo_mt_call.py: using RAC 69 22:05:57.233298 tst mo_mt_call.py: using CellId 36534 22:05:57.354202 tst mo_mt_call.py: using BVCI 36535 22:05:57.463642 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:57.474914 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:57.486060 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:57.497225 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:57.508393 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:05:57.519561 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:05:57.636674 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:05:57.756932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:05:58.264047 run create_hlr_db(pid=6044): Launched 22:05:58.389929 bus /sierra_2: Setting Powered False 22:05:59.454801 run create_hlr_db(pid=6044): Terminated: ok {rc=0} 22:05:59.889750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6047): Launched 22:06:00.194314 run osmo-hlr_10.42.42.2(pid=6048): Launched 22:06:00.312227 run osmo-stp_10.42.42.5: Starting osmo-stp 22:06:00.853929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6050): Launched 22:06:01.231100 run osmo-stp_10.42.42.5(pid=6051): Launched 22:06:01.502822 run osmo-msc_10.42.42.6: Starting osmo-msc 22:06:02.240072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6053): Launched 22:06:02.572576 run osmo-msc_10.42.42.6(pid=6054): Launched 22:06:02.744065 run osmo-stp_10.42.42.5(pid=6051): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6051)] 22:06:02.874284 run osmo-stp_10.42.42.5(pid=6051): stdout: | (launched: 2022-12-13_22:06:01.170316) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:03.002737 run osmo-stp_10.42.42.5(pid=6051): stderr: | 20221213220601370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220601371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220601371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220601371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220601372 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220601372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220601372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:03.129586 run osmo-stp_10.42.42.5(pid=6051): stdout: | (launched: 2022-12-13_22:06:01.170316) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:03.250745 run osmo-stp_10.42.42.5(pid=6051): stderr: | 20221213220601370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220601371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220601371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220601371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220601372 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220601372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220601372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:03.398427 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6051): Process ended prematurely: osmo-stp_10.42.42.5(pid=6051) [trial-2395↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6051)] [trial-2395↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 22:06:03.407334 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 22:06:03.433717 run osmo-hlr_10.42.42.2(pid=6048): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6048)] 22:06:03.481588 run osmo-hlr_10.42.42.2(pid=6048): stdout: | (launched: 2022-12-13_22:06:00.139429) 22:06:03.531005 run osmo-hlr_10.42.42.2(pid=6048): stderr: | 20221213220600317 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220600317 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220600317 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220600317 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220600317 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220600317 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220600339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220600349 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220600349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220600349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:06:03.600200 run osmo-msc_10.42.42.6(pid=6054): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6054)] 22:06:03.647833 run osmo-msc_10.42.42.6(pid=6054): stdout: | (launched: 2022-12-13_22:06:02.517373) 22:06:03.697114 run osmo-msc_10.42.42.6(pid=6054): stderr: | 20221213220602791 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220602792 DLGLOBAL DEBUG validating counter group 0x7f7aaa6b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220602792 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220602792 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220602792 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220602792 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220602794 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220602794 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220602795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220602795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:06:03.746497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6047): Terminating (SIGTERM) 22:06:03.786277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6050): Terminating (SIGTERM) 22:06:03.826267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6053): Terminating (SIGTERM) 22:06:03.866672 --- ParallelTerminationStrategy: PID 6047 died... 22:06:03.885776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6047): Terminated: ok {rc=0} 22:06:03.929601 --- ParallelTerminationStrategy: PID 6050 died... 22:06:03.948210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6050): Terminated: ok {rc=0} 22:06:03.991863 --- ParallelTerminationStrategy: PID 6053 died... 22:06:04.010417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6053): Terminated: ok {rc=0} 22:06:04.096486 bus /sierra_3: Setting Powered False 22:06:05.196476 bus /sierra_3: Setting Powered False 22:06:06.311795 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 22:06:07.459804 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:07.471836 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:06:07.534141 tst mo_mt_call_osmux.py: using LAC 36535 22:06:07.658742 tst mo_mt_call_osmux.py: using RAC 70 22:06:07.777974 tst mo_mt_call_osmux.py: using CellId 36535 22:06:07.895217 tst mo_mt_call_osmux.py: using BVCI 36536 22:06:08.004850 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:08.016236 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:08.027292 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:08.038436 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:08.049581 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:06:08.060633 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:06:08.176318 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:06:08.296406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:06:08.768159 run create_hlr_db(pid=6056): Launched 22:06:08.892336 bus /sierra_2: Setting Powered False 22:06:09.954136 run create_hlr_db(pid=6056): Terminated: ok {rc=0} 22:06:10.399547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6058): Launched 22:06:10.724824 run osmo-hlr_10.42.42.2(pid=6059): Launched 22:06:10.849680 run osmo-stp_10.42.42.5: Starting osmo-stp 22:06:11.411290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6061): Launched 22:06:11.735629 run osmo-stp_10.42.42.5(pid=6062): Launched 22:06:11.860077 run osmo-msc_10.42.42.6: Starting osmo-msc 22:06:12.449500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6064): Launched 22:06:12.773378 run osmo-msc_10.42.42.6(pid=6065): Launched 22:06:12.956636 run osmo-stp_10.42.42.5(pid=6062): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6062)] 22:06:13.093707 run osmo-stp_10.42.42.5(pid=6062): stdout: | (launched: 2022-12-13_22:06:11.676920) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:13.231568 run osmo-stp_10.42.42.5(pid=6062): stderr: | 20221213220611871 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220611871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220611871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220611871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220611874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220611874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220611874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:13.368863 run osmo-stp_10.42.42.5(pid=6062): stdout: | (launched: 2022-12-13_22:06:11.676920) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:13.498504 run osmo-stp_10.42.42.5(pid=6062): stderr: | 20221213220611871 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220611871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220611871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220611871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220611874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220611874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220611874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:13.653567 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6062): Process ended prematurely: osmo-stp_10.42.42.5(pid=6062) [trial-2395↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6062)] [trial-2395↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 22:06:13.663232 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:06:13.690863 run osmo-hlr_10.42.42.2(pid=6059): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6059)] 22:06:13.741895 run osmo-hlr_10.42.42.2(pid=6059): stdout: | (launched: 2022-12-13_22:06:10.665697) 22:06:13.793698 run osmo-hlr_10.42.42.2(pid=6059): stderr: | 20221213220610868 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220610868 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220610868 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220610868 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220610869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220610869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220610881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220610889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220610889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220610889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:06:13.865920 run osmo-msc_10.42.42.6(pid=6065): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6065)] 22:06:13.915439 run osmo-msc_10.42.42.6(pid=6065): stdout: | (launched: 2022-12-13_22:06:12.714819) 22:06:13.967007 run osmo-msc_10.42.42.6(pid=6065): stderr: | 20221213220613040 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220613040 DLGLOBAL DEBUG validating counter group 0x7fef7b2dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220613040 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220613040 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220613041 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220613041 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220613042 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220613043 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220613043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220613043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:06:14.018976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6058): Terminating (SIGTERM) 22:06:14.060603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6061): Terminating (SIGTERM) 22:06:14.102548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6064): Terminating (SIGTERM) 22:06:14.144463 --- ParallelTerminationStrategy: PID 6058 died... 22:06:14.164696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6058): Terminated: ok {rc=0} 22:06:14.211379 --- ParallelTerminationStrategy: PID 6061 died... 22:06:14.231131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6061): Terminated: ok {rc=0} 22:06:14.277057 --- ParallelTerminationStrategy: PID 6064 died... 22:06:14.296991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6064): Terminated: ok {rc=0} 22:06:14.385611 bus /sierra_3: Setting Powered False 22:06:15.484195 bus /sierra_3: Setting Powered False 22:06:16.607595 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 emergency:trx-b200 --------------------------------------------------------------------- 22:06:17.861975 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:06:17.867609 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 22:06:17.901717 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 22:06:17.930365 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 22:06:18.017585 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 22:06:18.051337 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 22:06:18.079007 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 22:06:18.664207 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2395 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 22:06:18.669459 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:18.680797 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 22:06:18.731915 tst emergency_mo_mt_call.py: using LAC 36536 22:06:18.858021 tst emergency_mo_mt_call.py: using RAC 71 22:06:18.983367 tst emergency_mo_mt_call.py: using CellId 36536 22:06:19.108387 tst emergency_mo_mt_call.py: using BVCI 36537 22:06:19.223791 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:19.234876 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:19.245938 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:19.256705 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:19.268051 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:19.279331 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:19.398012 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:19.518294 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:06:20.013847 run create_hlr_db(pid=6071): Launched 22:06:20.137830 bus /sierra_2: Setting Powered False 22:06:21.201170 run create_hlr_db(pid=6071): Terminated: ok {rc=0} 22:06:21.632612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6073): Launched 22:06:21.932207 run osmo-hlr_10.42.42.2(pid=6074): Launched 22:06:22.046395 run osmo-stp_10.42.42.5: Starting osmo-stp 22:06:22.560830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6076): Launched 22:06:22.859539 run osmo-stp_10.42.42.5(pid=6077): Launched 22:06:22.983853 tst emergency_mo_mt_call.py: using MSISDN 8354 22:06:23.139041 run osmo-msc_10.42.42.6: Starting osmo-msc 22:06:23.676848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6079): Launched 22:06:23.975992 run osmo-msc_10.42.42.6(pid=6080): Launched 22:06:24.142831 run osmo-stp_10.42.42.5(pid=6077): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6077)] 22:06:24.268078 run osmo-stp_10.42.42.5(pid=6077): stdout: | (launched: 2022-12-13_22:06:22.805186) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:24.394590 run osmo-stp_10.42.42.5(pid=6077): stderr: | 20221213220622975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220622975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220622976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220622977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220622977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220622977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220622978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:24.519087 run osmo-stp_10.42.42.5(pid=6077): stdout: | (launched: 2022-12-13_22:06:22.805186) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:24.637810 run osmo-stp_10.42.42.5(pid=6077): stderr: | 20221213220622975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220622975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220622976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220622977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220622977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220622977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220622978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:24.779669 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=6077): Process ended prematurely: osmo-stp_10.42.42.5(pid=6077) [trial-2395↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6077)] [trial-2395↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 22:06:24.788109 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 22:06:24.814028 run osmo-hlr_10.42.42.2(pid=6074): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6074)] 22:06:24.861835 run osmo-hlr_10.42.42.2(pid=6074): stdout: | (launched: 2022-12-13_22:06:21.877248) 22:06:24.911231 run osmo-hlr_10.42.42.2(pid=6074): stderr: | 20221213220622055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220622055 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220622056 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220622056 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220622056 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220622056 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220622068 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220622079 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220622079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220622079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:06:24.979893 run osmo-msc_10.42.42.6(pid=6080): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6080)] 22:06:25.027293 run osmo-msc_10.42.42.6(pid=6080): stdout: | (launched: 2022-12-13_22:06:23.921228) 22:06:25.076501 run osmo-msc_10.42.42.6(pid=6080): stderr: | 20221213220624194 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220624194 DLGLOBAL DEBUG validating counter group 0x7f24b94a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220624194 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220624194 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220624195 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220624195 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220624199 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220624199 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220624199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220624199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:06:25.125891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6073): Terminating (SIGTERM) 22:06:25.165490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6076): Terminating (SIGTERM) 22:06:25.204705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6079): Terminating (SIGTERM) 22:06:25.244338 --- ParallelTerminationStrategy: PID 6073 died... 22:06:25.263012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6073): Terminated: ok {rc=0} 22:06:25.306744 --- ParallelTerminationStrategy: PID 6076 died... 22:06:25.325298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6076): Terminated: ok {rc=0} 22:06:25.368567 --- ParallelTerminationStrategy: PID 6079 died... 22:06:25.387138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6079): Terminated: ok {rc=0} 22:06:25.471544 bus /sierra_3: Setting Powered False 22:06:26.570240 bus /sierra_3: Setting Powered False 22:06:27.686017 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 22:06:28.773225 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:28.785131 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 22:06:28.837378 tst emergency_preemptive_call.py: using LAC 36537 22:06:28.961371 tst emergency_preemptive_call.py: using RAC 72 22:06:29.085616 tst emergency_preemptive_call.py: using CellId 36537 22:06:29.210549 tst emergency_preemptive_call.py: using BVCI 36538 22:06:29.326918 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:29.338277 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:29.349491 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:29.360343 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:29.371693 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:06:29.383002 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:29.499715 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:29.620834 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:29.740236 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:06:29.855103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:06:30.319187 run create_hlr_db(pid=6082): Launched 22:06:30.442881 bus /sierra_2: Setting Powered False 22:06:31.502320 run create_hlr_db(pid=6082): Terminated: ok {rc=0} 22:06:31.968432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6084): Launched 22:06:32.293505 run osmo-hlr_10.42.42.2(pid=6085): Launched 22:06:32.409369 run osmo-stp_10.42.42.5: Starting osmo-stp 22:06:32.941808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6087): Launched 22:06:33.238943 run osmo-stp_10.42.42.5(pid=6088): Launched 22:06:33.364092 tst emergency_preemptive_call.py: using MSISDN 8355 22:06:33.514608 run osmo-msc_10.42.42.6: Starting osmo-msc 22:06:34.049920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6090): Launched 22:06:34.349585 run osmo-msc_10.42.42.6(pid=6091): Launched 22:06:34.516223 run osmo-stp_10.42.42.5(pid=6088): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6088)] 22:06:34.642127 run osmo-stp_10.42.42.5(pid=6088): stdout: | (launched: 2022-12-13_22:06:33.184936) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:34.768154 run osmo-stp_10.42.42.5(pid=6088): stderr: | 20221213220633355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220633355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220633356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220633357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220633357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220633357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220633357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:34.892240 run osmo-stp_10.42.42.5(pid=6088): stdout: | (launched: 2022-12-13_22:06:33.184936) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:35.010398 run osmo-stp_10.42.42.5(pid=6088): stderr: | 20221213220633355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220633355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220633356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220633357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220633357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220633357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220633357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:35.151754 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=6088): Process ended prematurely: osmo-stp_10.42.42.5(pid=6088) [trial-2395↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6088)] [trial-2395↪emergency:trx-b200↪emergency_preemptive_call.py:32] 22:06:35.160236 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 22:06:35.186302 run osmo-hlr_10.42.42.2(pid=6085): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6085)] 22:06:35.234587 run osmo-hlr_10.42.42.2(pid=6085): stdout: | (launched: 2022-12-13_22:06:32.236172) 22:06:35.283747 run osmo-hlr_10.42.42.2(pid=6085): stderr: | 20221213220632415 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220632415 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220632415 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220632415 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220632415 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220632415 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220632427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220632436 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220632436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220632436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:06:35.352446 run osmo-msc_10.42.42.6(pid=6091): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6091)] 22:06:35.400383 run osmo-msc_10.42.42.6(pid=6091): stdout: | (launched: 2022-12-13_22:06:34.295031) 22:06:35.449422 run osmo-msc_10.42.42.6(pid=6091): stderr: | 20221213220634567 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213220634567 DLGLOBAL DEBUG validating counter group 0x7f9d51d9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213220634567 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213220634567 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213220634567 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213220634568 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213220634569 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213220634570 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213220634570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213220634570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:06:35.498870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6084): Terminating (SIGTERM) 22:06:35.538375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6087): Terminating (SIGTERM) 22:06:35.577890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6090): Terminating (SIGTERM) 22:06:35.617657 --- ParallelTerminationStrategy: PID 6084 died... 22:06:35.637177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6084): Terminated: ok {rc=0} 22:06:35.681361 --- ParallelTerminationStrategy: PID 6087 died... 22:06:35.699930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6087): Terminated: ok {rc=0} 22:06:35.743688 --- ParallelTerminationStrategy: PID 6090 died... 22:06:35.762434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6090): Terminated: ok {rc=0} 22:06:35.848160 bus /sierra_9: Setting Powered False 22:06:36.948073 bus /sierra_9: Setting Powered False 22:06:38.061675 bus /sierra_8: Setting Powered False 22:06:39.162354 bus /sierra_8: Setting Powered False 22:06:40.279522 bus /sierra_3: Setting Powered False 22:06:41.378762 bus /sierra_3: Setting Powered False 22:06:42.497041 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-b200 --------------------------------------------------------------------- 22:06:43.786215 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:06:43.790914 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 22:06:43.824540 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 22:06:43.864823 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 22:06:43.956771 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 22:06:43.991891 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 22:06:44.031830 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 22:06:44.620554 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 22:06:44.675457 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:44.686494 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:06:44.740238 tst cs_paging_gprs_active.py: using LAC 36538 22:06:44.864436 tst cs_paging_gprs_active.py: using RAC 73 22:06:44.986997 tst cs_paging_gprs_active.py: using CellId 36538 22:06:45.109046 tst cs_paging_gprs_active.py: using BVCI 36539 22:06:45.219956 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:45.230758 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:45.241330 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:45.251688 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:45.262166 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:45.272867 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:45.283865 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:45.294254 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:45.304603 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:06:45.425747 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:06:45.546321 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:06:45.768829 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:06:46.108517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6097): Launched 22:06:46.408745 run iperf3-srv_10.42.42.10(pid=6098): Launched 22:06:46.552680 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:06:46.768568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:06:47.092041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6099): Launched 22:06:47.392210 run iperf3-srv_10.42.42.10(pid=6100): Launched 22:06:47.515683 tst cs_paging_gprs_active.py:38: start network... 22:06:47.737586 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:06:48.245131 run create_hlr_db(pid=6101): Launched 22:06:48.371540 bus /sierra_2: Setting Powered False 22:06:49.436155 run create_hlr_db(pid=6101): Terminated: ok {rc=0} 22:06:49.890522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6103): Launched 22:06:50.216291 run osmo-hlr_10.42.42.2(pid=6104): Launched 22:06:50.342983 run osmo-stp_10.42.42.5: Starting osmo-stp 22:06:50.903708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6106): Launched 22:06:51.229466 run osmo-stp_10.42.42.5(pid=6107): Launched 22:06:51.357272 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:06:51.920539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6109): Launched 22:06:52.045884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:06:52.321404 run patchelf(pid=6110): Launched 22:06:52.504327 run osmo-stp_10.42.42.5(pid=6107): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6107)] 22:06:52.642387 run osmo-stp_10.42.42.5(pid=6107): stdout: | (launched: 2022-12-13_22:06:51.170726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:52.782090 run osmo-stp_10.42.42.5(pid=6107): stderr: | 20221213220651362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220651362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220651362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220651363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220651363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220651363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220651363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:52.921739 run osmo-stp_10.42.42.5(pid=6107): stdout: | (launched: 2022-12-13_22:06:51.170726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:06:53.055610 run osmo-stp_10.42.42.5(pid=6107): stderr: | 20221213220651362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220651362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220651362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220651363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220651363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220651363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220651363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:06:53.214747 run patchelf(pid=6110): Terminating (SIGINT) 22:06:53.398338 run patchelf(pid=6110): Terminated: ok {rc=0} 22:06:53.529920 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6107): Process ended prematurely: osmo-stp_10.42.42.5(pid=6107) [trial-2395↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6107)] [trial-2395↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 22:06:53.540248 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 22:06:53.568815 run osmo-hlr_10.42.42.2(pid=6104): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6104)] 22:06:53.619544 run osmo-hlr_10.42.42.2(pid=6104): stdout: | (launched: 2022-12-13_22:06:50.157671) 22:06:53.672183 run osmo-hlr_10.42.42.2(pid=6104): stderr: | 20221213220650356 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220650356 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220650356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220650356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220650356 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220650356 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220650367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220650376 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220650376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220650376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:06:53.724399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6097): Terminating (SIGTERM) 22:06:53.766787 run iperf3-srv_10.42.42.10(pid=6098): Terminating (SIGTERM) 22:06:53.809658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6099): Terminating (SIGTERM) 22:06:53.852415 run iperf3-srv_10.42.42.10(pid=6100): Terminating (SIGTERM) 22:06:53.894802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6103): Terminating (SIGTERM) 22:06:53.937367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6106): Terminating (SIGTERM) 22:06:53.979597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6109): Terminating (SIGTERM) 22:06:54.022556 --- ParallelTerminationStrategy: PID 6097 died... 22:06:54.042916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6097): Terminated: ok {rc=0} 22:06:54.089652 --- ParallelTerminationStrategy: PID 6098 died... 22:06:54.109572 run iperf3-srv_10.42.42.10(pid=6098): Terminated {rc=256} 22:06:54.155946 --- ParallelTerminationStrategy: PID 6099 died... 22:06:54.175797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6099): Terminated: ok {rc=0} 22:06:54.222266 --- ParallelTerminationStrategy: PID 6100 died... 22:06:54.242051 run iperf3-srv_10.42.42.10(pid=6100): Terminated {rc=256} 22:06:54.288325 --- ParallelTerminationStrategy: PID 6103 died... 22:06:54.308435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6103): Terminated: ok {rc=0} 22:06:54.355120 --- ParallelTerminationStrategy: PID 6106 died... 22:06:54.375075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6106): Terminated: ok {rc=0} 22:06:54.421495 --- ParallelTerminationStrategy: PID 6109 died... 22:06:54.441431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6109): Terminated: ok {rc=0} 22:06:54.528744 bus /gobi_0: Setting Powered False 22:06:55.627895 bus /gobi_0: Setting Powered False 22:06:56.743670 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200 iperf3.py ---------------------------------------------- 22:06:57.895711 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:57.907536 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:06:57.960909 tst iperf3.py: using LAC 36539 22:06:58.087472 tst iperf3.py: using RAC 74 22:06:58.214204 tst iperf3.py: using CellId 36539 22:06:58.341357 tst iperf3.py: using BVCI 36540 22:06:58.461966 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:58.473125 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:58.483949 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:58.494863 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:58.506003 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:58.517177 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:58.528418 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:58.539531 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:06:58.550894 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:06:58.669994 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:06:58.875013 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:06:59.180853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6111): Launched 22:06:59.446954 run iperf3-srv_10.42.42.10(pid=6112): Launched 22:06:59.561113 tst iperf3.py:8: start network... 22:06:59.764731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:07:00.236555 run create_hlr_db(pid=6113): Launched 22:07:00.361253 bus /gobi_6: Setting Powered False 22:07:01.422186 run create_hlr_db(pid=6113): Terminated: ok {rc=0} 22:07:01.932908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6115): Launched 22:07:02.276315 run osmo-hlr_10.42.42.2(pid=6116): Launched 22:07:02.395230 run osmo-stp_10.42.42.5: Starting osmo-stp 22:07:02.936670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6118): Launched 22:07:03.240678 run osmo-stp_10.42.42.5(pid=6119): Launched 22:07:03.357637 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:07:03.882185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6121): Launched 22:07:03.998751 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:07:04.255380 run patchelf(pid=6122): Launched 22:07:04.424573 run osmo-stp_10.42.42.5(pid=6119): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6119)] 22:07:04.553509 run osmo-stp_10.42.42.5(pid=6119): stdout: | (launched: 2022-12-13_22:07:03.185503) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:04.683781 run osmo-stp_10.42.42.5(pid=6119): stderr: | 20221213220703356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220703356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220703357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220703357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220703358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220703358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220703358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:04.814946 run osmo-stp_10.42.42.5(pid=6119): stdout: | (launched: 2022-12-13_22:07:03.185503) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:04.939388 run osmo-stp_10.42.42.5(pid=6119): stderr: | 20221213220703356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220703356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220703357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220703357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220703358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220703358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220703358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:05.086793 run patchelf(pid=6122): Terminating (SIGINT) 22:07:05.256660 run patchelf(pid=6122): Terminated: ok {rc=0} 22:07:05.379636 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6119): Process ended prematurely: osmo-stp_10.42.42.5(pid=6119) [trial-2395↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6119)] [trial-2395↪gprs:trx-b200↪iperf3.py:8] 22:07:05.389213 tst iperf3.py:8: Test FAILED (7.5 sec) 22:07:05.416180 run osmo-hlr_10.42.42.2(pid=6116): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6116)] 22:07:05.463910 run osmo-hlr_10.42.42.2(pid=6116): stdout: | (launched: 2022-12-13_22:07:02.213407) 22:07:05.512865 run osmo-hlr_10.42.42.2(pid=6116): stderr: | 20221213220702397 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220702397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220702398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220702398 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220702398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220702398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220702410 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220702418 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220702419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220702419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:07:05.562027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6111): Terminating (SIGTERM) 22:07:05.601441 run iperf3-srv_10.42.42.10(pid=6112): Terminating (SIGTERM) 22:07:05.640785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6115): Terminating (SIGTERM) 22:07:05.680087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6118): Terminating (SIGTERM) 22:07:05.719330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6121): Terminating (SIGTERM) 22:07:05.758923 --- ParallelTerminationStrategy: PID 6111 died... 22:07:05.777906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6111): Terminated: ok {rc=0} 22:07:05.821535 --- ParallelTerminationStrategy: PID 6112 died... 22:07:05.839874 run iperf3-srv_10.42.42.10(pid=6112): Terminated {rc=256} 22:07:05.883639 --- ParallelTerminationStrategy: PID 6115 died... 22:07:05.902185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6115): Terminated: ok {rc=0} 22:07:05.945504 --- ParallelTerminationStrategy: PID 6118 died... 22:07:05.963962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6118): Terminated: ok {rc=0} 22:07:06.007450 --- ParallelTerminationStrategy: PID 6121 died... 22:07:06.025902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6121): Terminated: ok {rc=0} 22:07:06.111193 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 22:07:07.257760 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.269194 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:07:07.318661 tst iperf3m4.py: using LAC 36540 22:07:07.442414 tst iperf3m4.py: using RAC 75 22:07:07.575232 tst iperf3m4.py: using CellId 36540 22:07:07.696133 tst iperf3m4.py: using BVCI 36541 22:07:07.807901 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.818720 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.829275 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.839664 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.849988 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.860351 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.870826 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.881338 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:07.892152 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:08.011839 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:08.130929 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:08.252381 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:08.374299 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:07:08.595178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:08.922681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6123): Launched 22:07:09.206011 run iperf3-srv_10.42.42.10(pid=6124): Launched 22:07:09.330623 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:07:09.551053 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:09.878166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6125): Launched 22:07:10.161929 run iperf3-srv_10.42.42.10(pid=6126): Launched 22:07:10.285644 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:07:10.506590 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:10.833307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6127): Launched 22:07:11.116497 run iperf3-srv_10.42.42.10(pid=6128): Launched 22:07:11.238782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:07:11.458593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:11.784519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6129): Launched 22:07:12.067362 run iperf3-srv_10.42.42.10(pid=6130): Launched 22:07:12.189561 tst iperf3m4.py:8: start network... 22:07:12.409208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:07:12.915156 run create_hlr_db(pid=6131): Launched 22:07:13.039347 bus /gobi_6: Setting Powered False 22:07:14.104460 run create_hlr_db(pid=6131): Terminated: ok {rc=0} 22:07:14.539189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6133): Launched 22:07:14.843944 run osmo-hlr_10.42.42.2(pid=6134): Launched 22:07:14.960453 run osmo-stp_10.42.42.5: Starting osmo-stp 22:07:15.487382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6136): Launched 22:07:15.791094 run osmo-stp_10.42.42.5(pid=6137): Launched 22:07:16.051978 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:07:16.599758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6139): Launched 22:07:16.739750 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:07:17.030123 run patchelf(pid=6140): Launched 22:07:17.225429 run osmo-stp_10.42.42.5(pid=6137): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6137)] 22:07:17.367158 run osmo-stp_10.42.42.5(pid=6137): stdout: | (launched: 2022-12-13_22:07:15.735887) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:17.507885 run osmo-stp_10.42.42.5(pid=6137): stderr: | 20221213220715922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220715922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220715922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220715923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220715923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220715923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220715923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:17.648525 run osmo-stp_10.42.42.5(pid=6137): stdout: | (launched: 2022-12-13_22:07:15.735887) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:17.782826 run osmo-stp_10.42.42.5(pid=6137): stderr: | 20221213220715922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220715922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220715922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220715923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220715923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220715923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220715923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:17.942032 run patchelf(pid=6140): Terminating (SIGINT) 22:07:18.124725 run patchelf(pid=6140): Terminated: ok {rc=0} 22:07:18.256873 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6137): Process ended prematurely: osmo-stp_10.42.42.5(pid=6137) [trial-2395↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6137)] [trial-2395↪gprs:trx-b200↪iperf3m4.py:8] 22:07:18.267592 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:07:18.296895 run osmo-hlr_10.42.42.2(pid=6134): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6134)] 22:07:18.348277 run osmo-hlr_10.42.42.2(pid=6134): stdout: | (launched: 2022-12-13_22:07:14.788533) 22:07:18.400881 run osmo-hlr_10.42.42.2(pid=6134): stderr: | 20221213220714965 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220714965 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220714965 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220714965 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220714965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220714965 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220714977 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220714988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220714988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220714988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:07:18.453725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6123): Terminating (SIGTERM) 22:07:18.496266 run iperf3-srv_10.42.42.10(pid=6124): Terminating (SIGTERM) 22:07:18.538517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6125): Terminating (SIGTERM) 22:07:18.581359 run iperf3-srv_10.42.42.10(pid=6126): Terminating (SIGTERM) 22:07:18.623418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6127): Terminating (SIGTERM) 22:07:18.665711 run iperf3-srv_10.42.42.10(pid=6128): Terminating (SIGTERM) 22:07:18.707790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6129): Terminating (SIGTERM) 22:07:18.750549 run iperf3-srv_10.42.42.10(pid=6130): Terminating (SIGTERM) 22:07:18.793307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6133): Terminating (SIGTERM) 22:07:18.835888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6136): Terminating (SIGTERM) 22:07:18.878201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6139): Terminating (SIGTERM) 22:07:18.920551 --- ParallelTerminationStrategy: PID 6123 died... 22:07:18.940523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6123): Terminated: ok {rc=0} 22:07:18.987186 --- ParallelTerminationStrategy: PID 6124 died... 22:07:19.007142 run iperf3-srv_10.42.42.10(pid=6124): Terminated {rc=256} 22:07:19.053394 --- ParallelTerminationStrategy: PID 6125 died... 22:07:19.073315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6125): Terminated: ok {rc=0} 22:07:19.119743 --- ParallelTerminationStrategy: PID 6126 died... 22:07:19.139690 run iperf3-srv_10.42.42.10(pid=6126): Terminated {rc=256} 22:07:19.186112 --- ParallelTerminationStrategy: PID 6127 died... 22:07:19.206060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6127): Terminated: ok {rc=0} 22:07:19.252578 --- ParallelTerminationStrategy: PID 6128 died... 22:07:19.272549 run iperf3-srv_10.42.42.10(pid=6128): Terminated {rc=256} 22:07:19.319225 --- ParallelTerminationStrategy: PID 6129 died... 22:07:19.339216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6129): Terminated: ok {rc=0} 22:07:19.385936 --- ParallelTerminationStrategy: PID 6130 died... 22:07:19.405867 run iperf3-srv_10.42.42.10(pid=6130): Terminated {rc=256} 22:07:19.452282 --- ParallelTerminationStrategy: PID 6133 died... 22:07:19.472366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6133): Terminated: ok {rc=0} 22:07:19.518929 --- ParallelTerminationStrategy: PID 6136 died... 22:07:19.538945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6136): Terminated: ok {rc=0} 22:07:19.585779 --- ParallelTerminationStrategy: PID 6139 died... 22:07:19.605923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6139): Terminated: ok {rc=0} 22:07:19.695432 bus /gobi_4: Setting Powered False 22:07:20.794931 bus /gobi_4: Setting Powered False 22:07:21.910764 bus /gobi_1: Setting Powered False 22:07:23.009949 bus /gobi_1: Setting Powered False 22:07:24.126500 bus /gobi_0: Setting Powered False 22:07:25.225037 bus /gobi_0: Setting Powered False 22:07:26.344166 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200 ping.py ---------------------------------------------- 22:07:27.449710 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:27.461366 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:07:27.513054 tst ping.py: using LAC 36541 22:07:27.633268 tst ping.py: using RAC 76 22:07:27.751508 tst ping.py: using CellId 36541 22:07:27.871466 tst ping.py: using BVCI 36542 22:07:27.982065 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:27.992789 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:28.003302 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:28.013707 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:28.024041 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:28.034921 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:28.047124 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:28.058414 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:28.177217 tst ping.py:19: start network... 22:07:28.393771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:07:28.888466 run create_hlr_db(pid=6141): Launched 22:07:29.010668 bus /gobi_6: Setting Powered False 22:07:30.073520 run create_hlr_db(pid=6141): Terminated: ok {rc=0} 22:07:30.518244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6143): Launched 22:07:30.846517 run osmo-hlr_10.42.42.2(pid=6144): Launched 22:07:31.056080 run osmo-stp_10.42.42.5: Starting osmo-stp 22:07:31.817568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6146): Launched 22:07:32.196789 run osmo-stp_10.42.42.5(pid=6147): Launched 22:07:32.449707 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:07:33.061106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6149): Launched 22:07:33.184676 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:07:33.455834 run patchelf(pid=6150): Launched 22:07:33.636717 run osmo-stp_10.42.42.5(pid=6147): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6147)] 22:07:33.773389 run osmo-stp_10.42.42.5(pid=6147): stdout: | (launched: 2022-12-13_22:07:32.134589) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:33.911076 run osmo-stp_10.42.42.5(pid=6147): stderr: | 20221213220732463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220732463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220732463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220732463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220732464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220732464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220732464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:34.048726 run osmo-stp_10.42.42.5(pid=6147): stdout: | (launched: 2022-12-13_22:07:32.134589) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:34.181485 run osmo-stp_10.42.42.5(pid=6147): stderr: | 20221213220732463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220732463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220732463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220732463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220732464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220732464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220732464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:34.337867 run patchelf(pid=6150): Terminating (SIGINT) 22:07:34.516779 run patchelf(pid=6150): Terminated: ok {rc=0} 22:07:34.645529 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6147): Process ended prematurely: osmo-stp_10.42.42.5(pid=6147) [trial-2395↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6147)] [trial-2395↪gprs:trx-b200↪ping.py:22] 22:07:34.655161 tst ping.py:22: Test FAILED (7.2 sec) 22:07:34.683174 run osmo-hlr_10.42.42.2(pid=6144): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6144)] 22:07:34.733509 run osmo-hlr_10.42.42.2(pid=6144): stdout: | (launched: 2022-12-13_22:07:30.780079) 22:07:34.785104 run osmo-hlr_10.42.42.2(pid=6144): stderr: | 20221213220731183 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220731183 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220731183 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220731183 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220731184 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220731184 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220731211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220731230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220731231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220731231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:07:34.837228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6143): Terminating (SIGTERM) 22:07:34.878994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6146): Terminating (SIGTERM) 22:07:34.920754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6149): Terminating (SIGTERM) 22:07:34.963176 --- ParallelTerminationStrategy: PID 6143 died... 22:07:34.983499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6143): Terminated: ok {rc=0} 22:07:35.029638 --- ParallelTerminationStrategy: PID 6146 died... 22:07:35.049390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6146): Terminated: ok {rc=0} 22:07:35.095264 --- ParallelTerminationStrategy: PID 6149 died... 22:07:35.115009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6149): Terminated: ok {rc=0} 22:07:35.202910 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 22:07:36.290121 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:36.301868 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:07:36.356531 tst ping_idle_ping.py: using LAC 36542 22:07:36.474694 tst ping_idle_ping.py: using RAC 77 22:07:36.590793 tst ping_idle_ping.py: using CellId 36542 22:07:36.707956 tst ping_idle_ping.py: using BVCI 36543 22:07:36.816341 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:36.827038 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:36.837493 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:36.847874 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:36.858194 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:36.869065 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:36.880075 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:07:36.891470 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:07:37.008024 tst ping_idle_ping.py:24: start network... 22:07:37.208653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:07:37.674054 run create_hlr_db(pid=6151): Launched 22:07:37.798685 bus /gobi_6: Setting Powered False 22:07:38.858534 run create_hlr_db(pid=6151): Terminated: ok {rc=0} 22:07:39.295957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6153): Launched 22:07:39.616750 run osmo-hlr_10.42.42.2(pid=6154): Launched 22:07:39.740565 run osmo-stp_10.42.42.5: Starting osmo-stp 22:07:40.293925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6156): Launched 22:07:40.616432 run osmo-stp_10.42.42.5(pid=6157): Launched 22:07:40.739501 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:07:41.294246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6159): Launched 22:07:41.418472 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:07:41.690593 run patchelf(pid=6160): Launched 22:07:41.869410 run osmo-stp_10.42.42.5(pid=6157): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6157)] 22:07:42.005824 run osmo-stp_10.42.42.5(pid=6157): stdout: | (launched: 2022-12-13_22:07:40.558119) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:42.143477 run osmo-stp_10.42.42.5(pid=6157): stderr: | 20221213220740751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220740752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220740752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220740752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220740753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220740753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220740753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:42.282060 run osmo-stp_10.42.42.5(pid=6157): stdout: | (launched: 2022-12-13_22:07:40.558119) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:42.415172 run osmo-stp_10.42.42.5(pid=6157): stderr: | 20221213220740751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220740752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220740752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220740752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220740753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220740753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220740753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:42.571708 run patchelf(pid=6160): Terminating (SIGINT) 22:07:42.751359 run patchelf(pid=6160): Terminated: ok {rc=0} 22:07:42.880897 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6157): Process ended prematurely: osmo-stp_10.42.42.5(pid=6157) [trial-2395↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6157)] [trial-2395↪gprs:trx-b200↪ping_idle_ping.py:27] 22:07:42.890545 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:07:42.918527 run osmo-hlr_10.42.42.2(pid=6154): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6154)] 22:07:42.969579 run osmo-hlr_10.42.42.2(pid=6154): stdout: | (launched: 2022-12-13_22:07:39.558813) 22:07:43.021868 run osmo-hlr_10.42.42.2(pid=6154): stderr: | 20221213220739755 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220739755 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220739755 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220739756 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220739756 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220739756 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220739767 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220739776 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220739776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220739776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:07:43.074257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6153): Terminating (SIGTERM) 22:07:43.116157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6156): Terminating (SIGTERM) 22:07:43.158074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6159): Terminating (SIGTERM) 22:07:43.200399 --- ParallelTerminationStrategy: PID 6153 died... 22:07:43.220926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6153): Terminated: ok {rc=0} 22:07:43.267559 --- ParallelTerminationStrategy: PID 6156 died... 22:07:43.287870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6156): Terminated: ok {rc=0} 22:07:43.334917 --- ParallelTerminationStrategy: PID 6159 died... 22:07:43.354989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6159): Terminated: ok {rc=0} 22:07:43.443612 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 22:07:44.756723 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:07:44.762738 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:07:44.796667 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:07:44.837427 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:07:44.926582 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:07:44.960652 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:07:45.000228 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:07:45.595178 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:07:45.648316 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:45.659725 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:07:45.711309 tst cs_paging_gprs_active.py: using LAC 36543 22:07:45.834933 tst cs_paging_gprs_active.py: using RAC 78 22:07:45.979456 tst cs_paging_gprs_active.py: using CellId 36543 22:07:46.120476 tst cs_paging_gprs_active.py: using BVCI 36544 22:07:46.255747 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:46.267296 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:46.278922 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:46.290641 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:46.302632 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:46.314305 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:46.327457 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:46.340163 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:46.353358 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:07:46.477567 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:07:46.600703 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:07:46.816376 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:47.137083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6164): Launched 22:07:47.419214 run iperf3-srv_10.42.42.10(pid=6165): Launched 22:07:47.535052 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:07:47.740335 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:48.047152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6166): Launched 22:07:48.314616 run iperf3-srv_10.42.42.10(pid=6167): Launched 22:07:48.429389 tst cs_paging_gprs_active.py:38: start network... 22:07:48.634500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:07:49.105778 run create_hlr_db(pid=6168): Launched 22:07:49.229586 bus /gobi_6: Setting Powered False 22:07:50.290826 run create_hlr_db(pid=6168): Terminated: ok {rc=0} 22:07:50.714689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6170): Launched 22:07:51.020425 run osmo-hlr_10.42.42.2(pid=6171): Launched 22:07:51.137207 run osmo-stp_10.42.42.5: Starting osmo-stp 22:07:51.677969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6173): Launched 22:07:52.005307 run osmo-stp_10.42.42.5(pid=6174): Launched 22:07:52.122942 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:07:52.649491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6176): Launched 22:07:52.766372 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:07:53.023328 run patchelf(pid=6177): Launched 22:07:53.193149 run osmo-stp_10.42.42.5(pid=6174): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6174)] 22:07:53.321938 run osmo-stp_10.42.42.5(pid=6174): stdout: | (launched: 2022-12-13_22:07:51.950129) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:53.452878 run osmo-stp_10.42.42.5(pid=6174): stderr: | 20221213220752120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220752120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220752120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220752121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220752121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220752121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220752121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:53.583597 run osmo-stp_10.42.42.5(pid=6174): stdout: | (launched: 2022-12-13_22:07:51.950129) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:07:53.708731 run osmo-stp_10.42.42.5(pid=6174): stderr: | 20221213220752120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220752120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220752120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220752121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220752121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220752121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220752121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:07:53.856629 run patchelf(pid=6177): Terminating (SIGINT) 22:07:54.027410 run patchelf(pid=6177): Terminated: ok {rc=0} 22:07:54.150640 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6174): Process ended prematurely: osmo-stp_10.42.42.5(pid=6174) [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6174)] [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:07:54.160063 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:07:54.187031 run osmo-hlr_10.42.42.2(pid=6171): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6171)] 22:07:54.234733 run osmo-hlr_10.42.42.2(pid=6171): stdout: | (launched: 2022-12-13_22:07:50.964941) 22:07:54.284592 run osmo-hlr_10.42.42.2(pid=6171): stderr: | 20221213220751142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220751142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220751142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220751142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220751142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220751142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220751154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220751163 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220751164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220751164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:07:54.334465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6164): Terminating (SIGTERM) 22:07:54.374108 run iperf3-srv_10.42.42.10(pid=6165): Terminating (SIGTERM) 22:07:54.413504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6166): Terminating (SIGTERM) 22:07:54.453189 run iperf3-srv_10.42.42.10(pid=6167): Terminating (SIGTERM) 22:07:54.492510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6170): Terminating (SIGTERM) 22:07:54.531979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6173): Terminating (SIGTERM) 22:07:54.571604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6176): Terminating (SIGTERM) 22:07:54.611295 --- ParallelTerminationStrategy: PID 6164 died... 22:07:54.630130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6164): Terminated: ok {rc=0} 22:07:54.673459 --- ParallelTerminationStrategy: PID 6165 died... 22:07:54.691679 run iperf3-srv_10.42.42.10(pid=6165): Terminated {rc=256} 22:07:54.734987 --- ParallelTerminationStrategy: PID 6166 died... 22:07:54.753442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6166): Terminated: ok {rc=0} 22:07:54.796642 --- ParallelTerminationStrategy: PID 6167 died... 22:07:54.814954 run iperf3-srv_10.42.42.10(pid=6167): Terminated {rc=256} 22:07:54.858250 --- ParallelTerminationStrategy: PID 6170 died... 22:07:54.876532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6170): Terminated: ok {rc=0} 22:07:54.919945 --- ParallelTerminationStrategy: PID 6173 died... 22:07:54.938399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6173): Terminated: ok {rc=0} 22:07:54.981716 --- ParallelTerminationStrategy: PID 6176 died... 22:07:54.999999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6176): Terminated: ok {rc=0} 22:07:55.083739 bus /gobi_0: Setting Powered False 22:07:56.182010 bus /gobi_0: Setting Powered False 22:07:57.298215 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:07:58.441764 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:58.453384 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:07:58.506402 tst iperf3.py: using LAC 36544 22:07:58.627831 tst iperf3.py: using RAC 79 22:07:58.757228 tst iperf3.py: using CellId 36544 22:07:58.884601 tst iperf3.py: using BVCI 36545 22:07:59.002448 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:59.013875 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:59.024838 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:59.035943 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:59.047336 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:59.058722 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:59.070351 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:59.081649 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:07:59.093113 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:07:59.210110 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:07:59.415738 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:07:59.721652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6178): Launched 22:07:59.987337 run iperf3-srv_10.42.42.10(pid=6179): Launched 22:08:00.101497 tst iperf3.py:8: start network... 22:08:00.306098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:00.778169 run create_hlr_db(pid=6180): Launched 22:08:00.904623 bus /gobi_6: Setting Powered False 22:08:01.980920 run create_hlr_db(pid=6180): Terminated: ok {rc=0} 22:08:02.486966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6182): Launched 22:08:02.791060 run osmo-hlr_10.42.42.2(pid=6183): Launched 22:08:02.907401 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:03.445110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6185): Launched 22:08:03.748088 run osmo-stp_10.42.42.5(pid=6186): Launched 22:08:03.866053 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:08:04.390501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6188): Launched 22:08:04.508894 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:08:04.764764 run patchelf(pid=6189): Launched 22:08:04.934298 run osmo-stp_10.42.42.5(pid=6186): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6186)] 22:08:05.062806 run osmo-stp_10.42.42.5(pid=6186): stdout: | (launched: 2022-12-13_22:08:03.693097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:05.192562 run osmo-stp_10.42.42.5(pid=6186): stderr: | 20221213220803865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220803865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220803866 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220803866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220803866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220803867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220803867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:05.322915 run osmo-stp_10.42.42.5(pid=6186): stdout: | (launched: 2022-12-13_22:08:03.693097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:05.447283 run osmo-stp_10.42.42.5(pid=6186): stderr: | 20221213220803865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220803865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220803866 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220803866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220803866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220803867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220803867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:05.594884 run patchelf(pid=6189): Terminating (SIGINT) 22:08:05.764441 run patchelf(pid=6189): Terminated: ok {rc=0} 22:08:05.886796 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6186): Process ended prematurely: osmo-stp_10.42.42.5(pid=6186) [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6186)] [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 22:08:05.896154 tst iperf3.py:8: Test FAILED (7.5 sec) 22:08:05.923045 run osmo-hlr_10.42.42.2(pid=6183): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6183)] 22:08:05.970375 run osmo-hlr_10.42.42.2(pid=6183): stdout: | (launched: 2022-12-13_22:08:02.735197) 22:08:06.019193 run osmo-hlr_10.42.42.2(pid=6183): stderr: | 20221213220802911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220802912 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220802912 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220802912 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220802912 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220802912 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220802924 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220802934 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220802934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220802935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:06.068462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6178): Terminating (SIGTERM) 22:08:06.107907 run iperf3-srv_10.42.42.10(pid=6179): Terminating (SIGTERM) 22:08:06.147084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6182): Terminating (SIGTERM) 22:08:06.186393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6185): Terminating (SIGTERM) 22:08:06.225945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6188): Terminating (SIGTERM) 22:08:06.265391 --- ParallelTerminationStrategy: PID 6178 died... 22:08:06.284287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6178): Terminated: ok {rc=0} 22:08:06.328334 --- ParallelTerminationStrategy: PID 6179 died... 22:08:06.347128 run iperf3-srv_10.42.42.10(pid=6179): Terminated {rc=256} 22:08:06.390830 --- ParallelTerminationStrategy: PID 6182 died... 22:08:06.409727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6182): Terminated: ok {rc=0} 22:08:06.452923 --- ParallelTerminationStrategy: PID 6185 died... 22:08:06.472019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6185): Terminated: ok {rc=0} 22:08:06.515285 --- ParallelTerminationStrategy: PID 6188 died... 22:08:06.533765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6188): Terminated: ok {rc=0} 22:08:06.618576 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:08:07.765252 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:07.776781 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:08:07.827386 tst iperf3m4.py: using LAC 36545 22:08:07.947195 tst iperf3m4.py: using RAC 80 22:08:08.068084 tst iperf3m4.py: using CellId 36545 22:08:08.188162 tst iperf3m4.py: using BVCI 36546 22:08:08.297872 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:08.308576 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:08.319336 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:08.329927 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:08.340347 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:08.350932 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:08.362135 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:08.372739 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:08.383981 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:08.504622 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:08.623903 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:08.744926 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:08.867179 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:08:09.087149 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:09.415071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6190): Launched 22:08:09.699306 run iperf3-srv_10.42.42.10(pid=6191): Launched 22:08:09.821951 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:08:10.042004 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:10.369481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6192): Launched 22:08:10.652406 run iperf3-srv_10.42.42.10(pid=6193): Launched 22:08:10.774942 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:08:10.994918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:11.321788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6194): Launched 22:08:11.606250 run iperf3-srv_10.42.42.10(pid=6195): Launched 22:08:11.728545 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:08:11.949011 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:12.275733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6196): Launched 22:08:12.560870 run iperf3-srv_10.42.42.10(pid=6197): Launched 22:08:12.682900 tst iperf3m4.py:8: start network... 22:08:12.902314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:13.409678 run create_hlr_db(pid=6198): Launched 22:08:13.532766 bus /gobi_6: Setting Powered False 22:08:14.597505 run create_hlr_db(pid=6198): Terminated: ok {rc=0} 22:08:15.033264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6200): Launched 22:08:15.340065 run osmo-hlr_10.42.42.2(pid=6201): Launched 22:08:15.457824 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:16.041343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6203): Launched 22:08:16.384218 run osmo-stp_10.42.42.5(pid=6204): Launched 22:08:16.648330 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:08:17.250009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6206): Launched 22:08:17.376719 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:08:17.652523 run patchelf(pid=6207): Launched 22:08:17.834289 run osmo-stp_10.42.42.5(pid=6204): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6204)] 22:08:17.972330 run osmo-stp_10.42.42.5(pid=6204): stdout: | (launched: 2022-12-13_22:08:16.324582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:18.111837 run osmo-stp_10.42.42.5(pid=6204): stderr: | 20221213220816564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220816564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220816568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220816568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220816569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220816569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220816569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:18.251442 run osmo-stp_10.42.42.5(pid=6204): stdout: | (launched: 2022-12-13_22:08:16.324582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:18.385589 run osmo-stp_10.42.42.5(pid=6204): stderr: | 20221213220816564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220816564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220816568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220816568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220816569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220816569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220816569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:18.544197 run patchelf(pid=6207): Terminating (SIGINT) 22:08:18.727287 run patchelf(pid=6207): Terminated: ok {rc=0} 22:08:18.859242 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6204): Process ended prematurely: osmo-stp_10.42.42.5(pid=6204) [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6204)] [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 22:08:18.869600 tst iperf3m4.py:8: Test FAILED (11.1 sec) 22:08:18.898402 run osmo-hlr_10.42.42.2(pid=6201): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6201)] 22:08:18.949222 run osmo-hlr_10.42.42.2(pid=6201): stdout: | (launched: 2022-12-13_22:08:15.284464) 22:08:19.001832 run osmo-hlr_10.42.42.2(pid=6201): stderr: | 20221213220815460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220815460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220815461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220815461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220815461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220815461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220815473 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220815482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220815482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220815482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:19.054331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6190): Terminating (SIGTERM) 22:08:19.096259 run iperf3-srv_10.42.42.10(pid=6191): Terminating (SIGTERM) 22:08:19.138260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6192): Terminating (SIGTERM) 22:08:19.180241 run iperf3-srv_10.42.42.10(pid=6193): Terminating (SIGTERM) 22:08:19.222073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6194): Terminating (SIGTERM) 22:08:19.264135 run iperf3-srv_10.42.42.10(pid=6195): Terminating (SIGTERM) 22:08:19.306177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6196): Terminating (SIGTERM) 22:08:19.348516 run iperf3-srv_10.42.42.10(pid=6197): Terminating (SIGTERM) 22:08:19.390385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6200): Terminating (SIGTERM) 22:08:19.433000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6203): Terminating (SIGTERM) 22:08:19.474930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6206): Terminating (SIGTERM) 22:08:19.517233 --- ParallelTerminationStrategy: PID 6190 died... 22:08:19.537217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6190): Terminated: ok {rc=0} 22:08:19.583472 --- ParallelTerminationStrategy: PID 6191 died... 22:08:19.603220 run iperf3-srv_10.42.42.10(pid=6191): Terminated {rc=256} 22:08:19.649117 --- ParallelTerminationStrategy: PID 6192 died... 22:08:19.668791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6192): Terminated: ok {rc=0} 22:08:19.714723 --- ParallelTerminationStrategy: PID 6193 died... 22:08:19.734535 run iperf3-srv_10.42.42.10(pid=6193): Terminated {rc=256} 22:08:19.780443 --- ParallelTerminationStrategy: PID 6194 died... 22:08:19.800270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6194): Terminated: ok {rc=0} 22:08:19.846352 --- ParallelTerminationStrategy: PID 6195 died... 22:08:19.866069 run iperf3-srv_10.42.42.10(pid=6195): Terminated {rc=256} 22:08:19.912092 --- ParallelTerminationStrategy: PID 6196 died... 22:08:19.931872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6196): Terminated: ok {rc=0} 22:08:19.977824 --- ParallelTerminationStrategy: PID 6197 died... 22:08:19.997725 run iperf3-srv_10.42.42.10(pid=6197): Terminated {rc=256} 22:08:20.043615 --- ParallelTerminationStrategy: PID 6200 died... 22:08:20.063342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6200): Terminated: ok {rc=0} 22:08:20.109541 --- ParallelTerminationStrategy: PID 6203 died... 22:08:20.129456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6203): Terminated: ok {rc=0} 22:08:20.175413 --- ParallelTerminationStrategy: PID 6206 died... 22:08:20.195381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6206): Terminated: ok {rc=0} 22:08:20.283546 bus /gobi_4: Setting Powered False 22:08:21.382570 bus /gobi_4: Setting Powered False 22:08:22.499442 bus /gobi_1: Setting Powered False 22:08:23.597720 bus /gobi_1: Setting Powered False 22:08:24.713989 bus /gobi_0: Setting Powered False 22:08:25.812129 bus /gobi_0: Setting Powered False 22:08:26.930079 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 22:08:28.032928 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:28.045302 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:08:28.103061 tst ping.py: using LAC 36546 22:08:28.228563 tst ping.py: using RAC 81 22:08:28.351146 tst ping.py: using CellId 36546 22:08:28.474345 tst ping.py: using BVCI 36547 22:08:28.592356 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:28.603913 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:28.615079 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:28.626316 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:28.637707 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:28.649055 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:28.660703 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:28.672177 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:28.791967 tst ping.py:19: start network... 22:08:29.007325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:29.502080 run create_hlr_db(pid=6209): Launched 22:08:29.626546 bus /gobi_6: Setting Powered False 22:08:30.690154 run create_hlr_db(pid=6209): Terminated: ok {rc=0} 22:08:31.169926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6211): Launched 22:08:31.496138 run osmo-hlr_10.42.42.2(pid=6212): Launched 22:08:31.844624 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:32.520788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6214): Launched 22:08:32.826198 run osmo-stp_10.42.42.5(pid=6215): Launched 22:08:32.943210 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:08:33.459014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6217): Launched 22:08:33.575273 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:08:33.826686 run patchelf(pid=6218): Launched 22:08:33.993137 run osmo-stp_10.42.42.5(pid=6215): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6215)] 22:08:34.119035 run osmo-stp_10.42.42.5(pid=6215): stdout: | (launched: 2022-12-13_22:08:32.771399) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:34.246706 run osmo-stp_10.42.42.5(pid=6215): stderr: | 20221213220832940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220832940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220832940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220832941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220832943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220832943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220832943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:34.374552 run osmo-stp_10.42.42.5(pid=6215): stdout: | (launched: 2022-12-13_22:08:32.771399) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:34.496545 run osmo-stp_10.42.42.5(pid=6215): stderr: | 20221213220832940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220832940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220832940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220832941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220832943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220832943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220832943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:34.642912 run patchelf(pid=6218): Terminating (SIGINT) 22:08:34.809471 run patchelf(pid=6218): Terminated: ok {rc=0} 22:08:34.929858 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6215): Process ended prematurely: osmo-stp_10.42.42.5(pid=6215) [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6215)] [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 22:08:34.938750 tst ping.py:22: Test FAILED (6.9 sec) 22:08:34.965215 run osmo-hlr_10.42.42.2(pid=6212): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6212)] 22:08:35.012230 run osmo-hlr_10.42.42.2(pid=6212): stdout: | (launched: 2022-12-13_22:08:31.437727) 22:08:35.061093 run osmo-hlr_10.42.42.2(pid=6212): stderr: | 20221213220831776 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220831776 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220831776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220831776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220831776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220831778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220831798 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220831826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220831826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220831827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:35.110275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6211): Terminating (SIGTERM) 22:08:35.149572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6214): Terminating (SIGTERM) 22:08:35.188645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6217): Terminating (SIGTERM) 22:08:35.228299 --- ParallelTerminationStrategy: PID 6211 died... 22:08:35.247379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6211): Terminated: ok {rc=0} 22:08:35.291247 --- ParallelTerminationStrategy: PID 6214 died... 22:08:35.309807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6214): Terminated: ok {rc=0} 22:08:35.353365 --- ParallelTerminationStrategy: PID 6217 died... 22:08:35.371776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6217): Terminated: ok {rc=0} 22:08:35.457145 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:08:36.544426 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:36.556024 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:08:36.607370 tst ping_idle_ping.py: using LAC 36547 22:08:36.725382 tst ping_idle_ping.py: using RAC 82 22:08:36.843331 tst ping_idle_ping.py: using CellId 36547 22:08:36.962858 tst ping_idle_ping.py: using BVCI 36548 22:08:37.073651 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:37.084525 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:37.095277 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:37.106010 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:37.117146 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:37.128259 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:37.139545 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:08:37.150764 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:08:37.267816 tst ping_idle_ping.py:24: start network... 22:08:37.469956 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:37.937246 run create_hlr_db(pid=6219): Launched 22:08:38.061239 bus /gobi_6: Setting Powered False 22:08:39.121125 run create_hlr_db(pid=6219): Terminated: ok {rc=0} 22:08:39.540876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6221): Launched 22:08:39.842444 run osmo-hlr_10.42.42.2(pid=6222): Launched 22:08:39.956759 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:40.476025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6224): Launched 22:08:40.777528 run osmo-stp_10.42.42.5(pid=6225): Launched 22:08:40.893138 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:08:41.410487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6227): Launched 22:08:41.525641 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:08:41.778613 run patchelf(pid=6228): Launched 22:08:41.945725 run osmo-stp_10.42.42.5(pid=6225): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6225)] 22:08:42.072533 run osmo-stp_10.42.42.5(pid=6225): stdout: | (launched: 2022-12-13_22:08:40.722627) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:42.201185 run osmo-stp_10.42.42.5(pid=6225): stderr: | 20221213220840893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220840893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220840894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220840894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220840895 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220840895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220840895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:42.329517 run osmo-stp_10.42.42.5(pid=6225): stdout: | (launched: 2022-12-13_22:08:40.722627) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:42.452299 run osmo-stp_10.42.42.5(pid=6225): stderr: | 20221213220840893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220840893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220840894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220840894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220840895 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220840895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220840895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:42.597865 run patchelf(pid=6228): Terminating (SIGINT) 22:08:42.766335 run patchelf(pid=6228): Terminated: ok {rc=0} 22:08:42.887381 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6225): Process ended prematurely: osmo-stp_10.42.42.5(pid=6225) [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6225)] [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 22:08:42.896210 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 22:08:42.922788 run osmo-hlr_10.42.42.2(pid=6222): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6222)] 22:08:42.969847 run osmo-hlr_10.42.42.2(pid=6222): stdout: | (launched: 2022-12-13_22:08:39.787048) 22:08:43.018660 run osmo-hlr_10.42.42.2(pid=6222): stderr: | 20221213220839963 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220839963 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220839963 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220839963 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220839963 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220839963 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220839975 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220839984 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220839985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220839985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:43.068047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6221): Terminating (SIGTERM) 22:08:43.107261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6224): Terminating (SIGTERM) 22:08:43.146468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6227): Terminating (SIGTERM) 22:08:43.185985 --- ParallelTerminationStrategy: PID 6221 died... 22:08:43.204661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6221): Terminated: ok {rc=0} 22:08:43.248118 --- ParallelTerminationStrategy: PID 6224 died... 22:08:43.266518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6224): Terminated: ok {rc=0} 22:08:43.309654 --- ParallelTerminationStrategy: PID 6227 died... 22:08:43.328093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6227): Terminated: ok {rc=0} 22:08:43.413906 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:08:44.723602 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:08:44.729848 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:08:44.762569 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:08:44.800671 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:08:44.887148 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:08:44.919664 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:08:44.957603 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:08:45.552069 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:08:45.600754 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:45.611614 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:08:45.681079 tst cs_paging_gprs_active.py: using LAC 36548 22:08:45.801306 tst cs_paging_gprs_active.py: using RAC 83 22:08:45.935826 tst cs_paging_gprs_active.py: using CellId 36548 22:08:46.056222 tst cs_paging_gprs_active.py: using BVCI 36549 22:08:46.192251 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:46.203961 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:46.215541 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:46.227047 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:46.238532 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:46.250039 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:46.261591 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:46.272844 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:46.284457 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:08:46.405804 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:08:46.530168 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:08:46.772101 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:47.107155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6232): Launched 22:08:47.407872 run iperf3-srv_10.42.42.10(pid=6233): Launched 22:08:47.531215 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:08:47.752472 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:48.079546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6234): Launched 22:08:48.363177 run iperf3-srv_10.42.42.10(pid=6235): Launched 22:08:48.486591 tst cs_paging_gprs_active.py:38: start network... 22:08:48.707253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:49.213378 run create_hlr_db(pid=6236): Launched 22:08:49.340292 bus /gobi_6: Setting Powered False 22:08:50.405804 run create_hlr_db(pid=6236): Terminated: ok {rc=0} 22:08:50.842116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6238): Launched 22:08:51.146925 run osmo-hlr_10.42.42.2(pid=6239): Launched 22:08:51.264289 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:51.788828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6241): Launched 22:08:52.093265 run osmo-stp_10.42.42.5(pid=6242): Launched 22:08:52.209907 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:08:52.736396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6244): Launched 22:08:52.854028 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:08:53.112091 run patchelf(pid=6245): Launched 22:08:53.281799 run osmo-stp_10.42.42.5(pid=6242): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6242)] 22:08:53.410739 run osmo-stp_10.42.42.5(pid=6242): stdout: | (launched: 2022-12-13_22:08:52.037916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:53.541191 run osmo-stp_10.42.42.5(pid=6242): stderr: | 20221213220852209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220852209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220852210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220852210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220852210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220852211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220852211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:53.671682 run osmo-stp_10.42.42.5(pid=6242): stdout: | (launched: 2022-12-13_22:08:52.037916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:53.796310 run osmo-stp_10.42.42.5(pid=6242): stderr: | 20221213220852209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220852209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220852210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220852210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220852210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220852211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220852211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:53.944136 run patchelf(pid=6245): Terminating (SIGINT) 22:08:54.115061 run patchelf(pid=6245): Terminated: ok {rc=0} 22:08:54.237683 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6242): Process ended prematurely: osmo-stp_10.42.42.5(pid=6242) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6242)] [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:08:54.247155 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:08:54.274269 run osmo-hlr_10.42.42.2(pid=6239): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6239)] 22:08:54.321627 run osmo-hlr_10.42.42.2(pid=6239): stdout: | (launched: 2022-12-13_22:08:51.091607) 22:08:54.370928 run osmo-hlr_10.42.42.2(pid=6239): stderr: | 20221213220851268 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220851268 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220851268 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220851268 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220851268 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220851268 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220851280 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220851289 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220851289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220851289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:54.420357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6232): Terminating (SIGTERM) 22:08:54.460011 run iperf3-srv_10.42.42.10(pid=6233): Terminating (SIGTERM) 22:08:54.499428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6234): Terminating (SIGTERM) 22:08:54.538882 run iperf3-srv_10.42.42.10(pid=6235): Terminating (SIGTERM) 22:08:54.578118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6238): Terminating (SIGTERM) 22:08:54.617497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6241): Terminating (SIGTERM) 22:08:54.656700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6244): Terminating (SIGTERM) 22:08:54.696362 --- ParallelTerminationStrategy: PID 6232 died... 22:08:54.715344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6232): Terminated: ok {rc=0} 22:08:54.759397 --- ParallelTerminationStrategy: PID 6233 died... 22:08:54.777793 run iperf3-srv_10.42.42.10(pid=6233): Terminated {rc=256} 22:08:54.821179 --- ParallelTerminationStrategy: PID 6234 died... 22:08:54.839560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6234): Terminated: ok {rc=0} 22:08:54.883292 --- ParallelTerminationStrategy: PID 6235 died... 22:08:54.901701 run iperf3-srv_10.42.42.10(pid=6235): Terminated {rc=256} 22:08:54.945033 --- ParallelTerminationStrategy: PID 6238 died... 22:08:54.963300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6238): Terminated: ok {rc=0} 22:08:55.006691 --- ParallelTerminationStrategy: PID 6241 died... 22:08:55.025196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6241): Terminated: ok {rc=0} 22:08:55.068720 --- ParallelTerminationStrategy: PID 6244 died... 22:08:55.087747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6244): Terminated: ok {rc=0} 22:08:55.171333 bus /gobi_0: Setting Powered False 22:08:56.269255 bus /gobi_0: Setting Powered False 22:08:57.385925 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:08:58.536163 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:58.548180 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:08:58.623232 tst iperf3.py: using LAC 36549 22:08:58.750123 tst iperf3.py: using RAC 84 22:08:58.876424 tst iperf3.py: using CellId 36549 22:08:59.002729 tst iperf3.py: using BVCI 36550 22:08:59.120548 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:59.131965 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:59.143128 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:59.154353 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:59.165769 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:59.177279 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:59.188776 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:59.200129 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:08:59.211628 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:08:59.332094 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:08:59.552099 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:08:59.877493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6246): Launched 22:09:00.159654 run iperf3-srv_10.42.42.10(pid=6247): Launched 22:09:00.283352 tst iperf3.py:8: start network... 22:09:00.503802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:01.024792 run create_hlr_db(pid=6248): Launched 22:09:01.194103 bus /gobi_6: Setting Powered False 22:09:02.282473 run create_hlr_db(pid=6248): Terminated: ok {rc=0} 22:09:02.797295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6355): Launched 22:09:03.201291 run osmo-hlr_10.42.42.2(pid=6392): Launched 22:09:03.490830 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:04.307430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6522): Launched 22:09:04.651384 run osmo-stp_10.42.42.5(pid=6523): Launched 22:09:04.888581 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:09:05.607041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6525): Launched 22:09:05.739438 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:09:06.005553 run patchelf(pid=6527): Launched 22:09:06.200021 run osmo-stp_10.42.42.5(pid=6523): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6523)] 22:09:06.339966 run osmo-stp_10.42.42.5(pid=6523): stdout: | (launched: 2022-12-13_22:09:04.589695) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:06.481430 run osmo-stp_10.42.42.5(pid=6523): stderr: | 20221213220904929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220904930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220904930 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220904930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220904931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220904931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220904931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:06.622469 run osmo-stp_10.42.42.5(pid=6523): stdout: | (launched: 2022-12-13_22:09:04.589695) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:06.761152 run osmo-stp_10.42.42.5(pid=6523): stderr: | 20221213220904929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220904930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220904930 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220904930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220904931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220904931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220904931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:06.923039 run patchelf(pid=6527): Terminating (SIGINT) 22:09:07.108344 run patchelf(pid=6527): Terminated: ok {rc=0} 22:09:07.242526 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6523): Process ended prematurely: osmo-stp_10.42.42.5(pid=6523) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6523)] [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 22:09:07.253878 tst iperf3.py:8: Test FAILED (8.8 sec) 22:09:07.283889 run osmo-hlr_10.42.42.2(pid=6392): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6392)] 22:09:07.338556 run osmo-hlr_10.42.42.2(pid=6392): stdout: | (launched: 2022-12-13_22:09:03.128308) 22:09:07.393639 run osmo-hlr_10.42.42.2(pid=6392): stderr: | 20221213220903541 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220903541 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220903541 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220903541 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220903541 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220903541 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220903554 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220903568 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220903568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220903568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:07.449158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6246): Terminating (SIGTERM) 22:09:07.492683 run iperf3-srv_10.42.42.10(pid=6247): Terminating (SIGTERM) 22:09:07.540480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6355): Terminating (SIGTERM) 22:09:07.586163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6522): Terminating (SIGTERM) 22:09:07.633850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6525): Terminating (SIGTERM) 22:09:07.680303 --- ParallelTerminationStrategy: PID 6246 died... 22:09:07.702613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6246): Terminated: ok {rc=0} 22:09:07.752407 --- ParallelTerminationStrategy: PID 6247 died... 22:09:07.773759 run iperf3-srv_10.42.42.10(pid=6247): Terminated {rc=256} 22:09:07.822207 --- ParallelTerminationStrategy: PID 6355 died... 22:09:07.843764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6355): Terminated: ok {rc=0} 22:09:07.892117 --- ParallelTerminationStrategy: PID 6522 died... 22:09:07.913694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6522): Terminated: ok {rc=0} 22:09:07.962188 --- ParallelTerminationStrategy: PID 6525 died... 22:09:07.983768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6525): Terminated: ok {rc=0} 22:09:08.076653 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:09:09.234280 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.247206 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:09:09.321756 tst iperf3m4.py: using LAC 36550 22:09:09.454231 tst iperf3m4.py: using RAC 85 22:09:09.584225 tst iperf3m4.py: using CellId 36550 22:09:09.717379 tst iperf3m4.py: using BVCI 36551 22:09:09.842978 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.855367 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.867554 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.880627 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.893946 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.907318 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.920339 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.933727 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:09.947334 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:10.078213 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:10.207909 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:10.335116 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:10.461517 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:09:10.690800 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:11.031084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6529): Launched 22:09:11.335669 run iperf3-srv_10.42.42.10(pid=6530): Launched 22:09:11.476256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:09:11.704903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:12.045667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6531): Launched 22:09:12.348763 run iperf3-srv_10.42.42.10(pid=6532): Launched 22:09:12.488994 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:09:12.715828 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:13.053403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6533): Launched 22:09:13.353890 run iperf3-srv_10.42.42.10(pid=6534): Launched 22:09:13.493996 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:09:13.721428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:14.057340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6535): Launched 22:09:14.358469 run iperf3-srv_10.42.42.10(pid=6536): Launched 22:09:14.499161 tst iperf3m4.py:8: start network... 22:09:14.726209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:15.251660 run create_hlr_db(pid=6537): Launched 22:09:15.419736 bus /gobi_6: Setting Powered False 22:09:16.524138 run create_hlr_db(pid=6537): Terminated: ok {rc=0} 22:09:17.095782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6539): Launched 22:09:17.424637 run osmo-hlr_10.42.42.2(pid=6540): Launched 22:09:17.680399 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:18.442911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6542): Launched 22:09:18.790935 run osmo-stp_10.42.42.5(pid=6543): Launched 22:09:19.049752 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:09:19.711317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6545): Launched 22:09:19.852154 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:09:20.137717 run patchelf(pid=6546): Launched 22:09:20.338384 run osmo-stp_10.42.42.5(pid=6543): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6543)] 22:09:20.484107 run osmo-stp_10.42.42.5(pid=6543): stdout: | (launched: 2022-12-13_22:09:18.730526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:20.631786 run osmo-stp_10.42.42.5(pid=6543): stderr: | 20221213220919032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220919033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220919033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220919033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220919034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220919034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220919034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:20.777657 run osmo-stp_10.42.42.5(pid=6543): stdout: | (launched: 2022-12-13_22:09:18.730526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:20.918608 run osmo-stp_10.42.42.5(pid=6543): stderr: | 20221213220919032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220919033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220919033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220919033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220919034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220919034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220919034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:21.086128 run patchelf(pid=6546): Terminating (SIGINT) 22:09:21.277179 run patchelf(pid=6546): Terminated: ok {rc=0} 22:09:21.416458 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6543): Process ended prematurely: osmo-stp_10.42.42.5(pid=6543) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6543)] [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:09:21.428234 tst iperf3m4.py:8: Test FAILED (12.2 sec) 22:09:21.460880 run osmo-hlr_10.42.42.2(pid=6540): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6540)] 22:09:21.516340 run osmo-hlr_10.42.42.2(pid=6540): stdout: | (launched: 2022-12-13_22:09:17.369232) 22:09:21.572307 run osmo-hlr_10.42.42.2(pid=6540): stderr: | 20221213220917629 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220917633 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220917633 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220917633 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220917633 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220917633 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220917663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220917680 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220917681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220917681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:21.630183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6529): Terminating (SIGTERM) 22:09:21.675268 run iperf3-srv_10.42.42.10(pid=6530): Terminating (SIGTERM) 22:09:21.723839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6531): Terminating (SIGTERM) 22:09:21.770363 run iperf3-srv_10.42.42.10(pid=6532): Terminating (SIGTERM) 22:09:21.819330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6533): Terminating (SIGTERM) 22:09:21.867975 run iperf3-srv_10.42.42.10(pid=6534): Terminating (SIGTERM) 22:09:21.916800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6535): Terminating (SIGTERM) 22:09:21.962791 run iperf3-srv_10.42.42.10(pid=6536): Terminating (SIGTERM) 22:09:22.014948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6539): Terminating (SIGTERM) 22:09:22.059747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6542): Terminating (SIGTERM) 22:09:22.107505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6545): Terminating (SIGTERM) 22:09:22.154833 --- ParallelTerminationStrategy: PID 6529 died... 22:09:22.177656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6529): Terminated: ok {rc=0} 22:09:22.231109 --- ParallelTerminationStrategy: PID 6530 died... 22:09:22.252041 run iperf3-srv_10.42.42.10(pid=6530): Terminated {rc=256} 22:09:22.301339 --- ParallelTerminationStrategy: PID 6531 died... 22:09:22.323192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6531): Terminated: ok {rc=0} 22:09:22.374304 --- ParallelTerminationStrategy: PID 6532 died... 22:09:22.395129 run iperf3-srv_10.42.42.10(pid=6532): Terminated {rc=256} 22:09:22.445436 --- ParallelTerminationStrategy: PID 6533 died... 22:09:22.468032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6533): Terminated: ok {rc=0} 22:09:22.517556 --- ParallelTerminationStrategy: PID 6534 died... 22:09:22.539944 run iperf3-srv_10.42.42.10(pid=6534): Terminated {rc=256} 22:09:22.590925 --- ParallelTerminationStrategy: PID 6535 died... 22:09:22.613049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6535): Terminated: ok {rc=0} 22:09:22.666133 --- ParallelTerminationStrategy: PID 6536 died... 22:09:22.687089 run iperf3-srv_10.42.42.10(pid=6536): Terminated {rc=256} 22:09:22.736786 --- ParallelTerminationStrategy: PID 6539 died... 22:09:22.758821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6539): Terminated: ok {rc=0} 22:09:22.808751 --- ParallelTerminationStrategy: PID 6542 died... 22:09:22.830518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6542): Terminated: ok {rc=0} 22:09:22.879427 --- ParallelTerminationStrategy: PID 6545 died... 22:09:22.902052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6545): Terminated: ok {rc=0} 22:09:22.997934 bus /gobi_4: Setting Powered False 22:09:24.104089 bus /gobi_4: Setting Powered False 22:09:25.222142 bus /gobi_1: Setting Powered False 22:09:26.319572 bus /gobi_1: Setting Powered False 22:09:27.436255 bus /gobi_0: Setting Powered False 22:09:28.535562 bus /gobi_0: Setting Powered False 22:09:29.654841 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:09:30.758828 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:30.770954 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:09:30.848339 tst ping.py: using LAC 36551 22:09:30.974771 tst ping.py: using RAC 86 22:09:31.108228 tst ping.py: using CellId 36551 22:09:31.236241 tst ping.py: using BVCI 36552 22:09:31.368792 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:31.381494 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:31.393136 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:31.405719 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:31.418437 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:31.431534 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:31.445039 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:31.458265 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:31.581581 tst ping.py:19: start network... 22:09:31.872587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:32.401958 run create_hlr_db(pid=6549): Launched 22:09:32.524586 bus /gobi_6: Setting Powered False 22:09:33.584812 run create_hlr_db(pid=6549): Terminated: ok {rc=0} 22:09:34.002676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6551): Launched 22:09:34.302215 run osmo-hlr_10.42.42.2(pid=6552): Launched 22:09:34.415902 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:34.945556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6554): Launched 22:09:35.244724 run osmo-stp_10.42.42.5(pid=6555): Launched 22:09:35.358641 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:09:35.873627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6557): Launched 22:09:35.987311 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:09:36.238878 run patchelf(pid=6558): Launched 22:09:36.405376 run osmo-stp_10.42.42.5(pid=6555): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6555)] 22:09:36.531629 run osmo-stp_10.42.42.5(pid=6555): stdout: | (launched: 2022-12-13_22:09:35.189854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:36.659398 run osmo-stp_10.42.42.5(pid=6555): stderr: | 20221213220935359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220935359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220935359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220935360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220935360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220935360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220935361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:36.786833 run osmo-stp_10.42.42.5(pid=6555): stdout: | (launched: 2022-12-13_22:09:35.189854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:36.909225 run osmo-stp_10.42.42.5(pid=6555): stderr: | 20221213220935359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220935359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220935359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220935360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220935360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220935360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220935361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:37.053915 run patchelf(pid=6558): Terminating (SIGINT) 22:09:37.222261 run patchelf(pid=6558): Terminated: ok {rc=0} 22:09:37.342598 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6555): Process ended prematurely: osmo-stp_10.42.42.5(pid=6555) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6555)] [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 22:09:37.351459 tst ping.py:22: Test FAILED (6.6 sec) 22:09:37.378122 run osmo-hlr_10.42.42.2(pid=6552): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6552)] 22:09:37.425732 run osmo-hlr_10.42.42.2(pid=6552): stdout: | (launched: 2022-12-13_22:09:34.247822) 22:09:37.475115 run osmo-hlr_10.42.42.2(pid=6552): stderr: | 20221213220934425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220934425 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220934425 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220934425 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220934425 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220934425 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220934439 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220934449 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220934449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220934449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:37.524884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6551): Terminating (SIGTERM) 22:09:37.564547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6554): Terminating (SIGTERM) 22:09:37.603969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6557): Terminating (SIGTERM) 22:09:37.643727 --- ParallelTerminationStrategy: PID 6551 died... 22:09:37.662958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6551): Terminated: ok {rc=0} 22:09:37.706971 --- ParallelTerminationStrategy: PID 6554 died... 22:09:37.725655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6554): Terminated: ok {rc=0} 22:09:37.769456 --- ParallelTerminationStrategy: PID 6557 died... 22:09:37.787943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6557): Terminated: ok {rc=0} 22:09:37.873506 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:09:38.961158 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:38.972699 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:09:39.043202 tst ping_idle_ping.py: using LAC 36552 22:09:39.163380 tst ping_idle_ping.py: using RAC 87 22:09:39.282674 tst ping_idle_ping.py: using CellId 36552 22:09:39.402321 tst ping_idle_ping.py: using BVCI 36553 22:09:39.512346 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:39.523518 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:39.534233 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:39.544894 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:39.555640 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:39.566440 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:39.577364 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:09:39.588054 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:09:39.707477 tst ping_idle_ping.py:24: start network... 22:09:39.924175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:40.429851 run create_hlr_db(pid=6559): Launched 22:09:40.553491 bus /gobi_6: Setting Powered False 22:09:41.617641 run create_hlr_db(pid=6559): Terminated: ok {rc=0} 22:09:42.046877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6561): Launched 22:09:42.347176 run osmo-hlr_10.42.42.2(pid=6562): Launched 22:09:42.462200 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:42.994299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6564): Launched 22:09:43.294115 run osmo-stp_10.42.42.5(pid=6565): Launched 22:09:43.408532 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:09:43.928533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6567): Launched 22:09:44.043685 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:09:44.295320 run patchelf(pid=6568): Launched 22:09:44.462085 run osmo-stp_10.42.42.5(pid=6565): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6565)] 22:09:44.588768 run osmo-stp_10.42.42.5(pid=6565): stdout: | (launched: 2022-12-13_22:09:43.239368) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:44.717179 run osmo-stp_10.42.42.5(pid=6565): stderr: | 20221213220943411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220943411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220943411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220943412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220943412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220943412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220943412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:44.845618 run osmo-stp_10.42.42.5(pid=6565): stdout: | (launched: 2022-12-13_22:09:43.239368) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:44.968033 run osmo-stp_10.42.42.5(pid=6565): stderr: | 20221213220943411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220943411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220943411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220943412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220943412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220943412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220943412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:45.113908 run patchelf(pid=6568): Terminating (SIGINT) 22:09:45.281984 run patchelf(pid=6568): Terminated: ok {rc=0} 22:09:45.402980 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6565): Process ended prematurely: osmo-stp_10.42.42.5(pid=6565) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6565)] [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:09:45.411736 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:09:45.438041 run osmo-hlr_10.42.42.2(pid=6562): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6562)] 22:09:45.485362 run osmo-hlr_10.42.42.2(pid=6562): stdout: | (launched: 2022-12-13_22:09:42.292457) 22:09:45.534426 run osmo-hlr_10.42.42.2(pid=6562): stderr: | 20221213220942471 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220942471 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220942471 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220942471 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220942471 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220942471 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220942483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220942494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220942494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220942494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:45.583829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6561): Terminating (SIGTERM) 22:09:45.623029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6564): Terminating (SIGTERM) 22:09:45.662294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6567): Terminating (SIGTERM) 22:09:45.701751 --- ParallelTerminationStrategy: PID 6561 died... 22:09:45.720552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6561): Terminated: ok {rc=0} 22:09:45.763826 --- ParallelTerminationStrategy: PID 6564 died... 22:09:45.782360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6564): Terminated: ok {rc=0} 22:09:45.825699 --- ParallelTerminationStrategy: PID 6567 died... 22:09:45.845080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6567): Terminated: ok {rc=0} 22:09:45.936035 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:09:47.277601 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:09:47.285178 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:09:47.319192 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:09:47.358716 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:09:47.444806 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:09:47.478805 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:09:47.518347 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:09:48.110682 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:09:48.159869 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:48.170778 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:09:48.239376 tst cs_paging_gprs_active.py: using LAC 36553 22:09:48.359372 tst cs_paging_gprs_active.py: using RAC 88 22:09:48.477637 tst cs_paging_gprs_active.py: using CellId 36553 22:09:48.598976 tst cs_paging_gprs_active.py: using BVCI 36554 22:09:48.718738 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:48.730083 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:48.741439 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:48.752695 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:48.764238 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:48.775936 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:48.787505 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:48.798977 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:09:48.811120 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:09:48.929477 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:09:49.047205 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:09:49.254956 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:49.562743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6575): Launched 22:09:49.830256 run iperf3-srv_10.42.42.10(pid=6576): Launched 22:09:49.945975 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:09:50.151375 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:09:50.459119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6577): Launched 22:09:50.726292 run iperf3-srv_10.42.42.10(pid=6578): Launched 22:09:50.841172 tst cs_paging_gprs_active.py:38: start network... 22:09:51.046507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:51.520764 run create_hlr_db(pid=6579): Launched 22:09:51.646131 bus /gobi_6: Setting Powered False 22:09:52.706739 run create_hlr_db(pid=6579): Terminated: ok {rc=0} 22:09:53.151718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6581): Launched 22:09:53.480766 run osmo-hlr_10.42.42.2(pid=6582): Launched 22:09:53.607813 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:54.169581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6584): Launched 22:09:54.495763 run osmo-stp_10.42.42.5(pid=6585): Launched 22:09:54.622589 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:09:55.187360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6587): Launched 22:09:55.313859 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:09:55.591380 run patchelf(pid=6588): Launched 22:09:55.773895 run osmo-stp_10.42.42.5(pid=6585): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6585)] 22:09:55.912442 run osmo-stp_10.42.42.5(pid=6585): stdout: | (launched: 2022-12-13_22:09:54.437277) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:56.052333 run osmo-stp_10.42.42.5(pid=6585): stderr: | 20221213220954627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220954627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220954628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220954628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220954629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220954629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220954629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:56.192103 run osmo-stp_10.42.42.5(pid=6585): stdout: | (launched: 2022-12-13_22:09:54.437277) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:56.326469 run osmo-stp_10.42.42.5(pid=6585): stderr: | 20221213220954627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213220954627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213220954628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213220954628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213220954629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213220954629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213220954629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:56.486132 run patchelf(pid=6588): Terminating (SIGINT) 22:09:56.669104 run patchelf(pid=6588): Terminated: ok {rc=0} 22:09:56.800826 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6585): Process ended prematurely: osmo-stp_10.42.42.5(pid=6585) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6585)] [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:09:56.811123 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:09:56.839496 run osmo-hlr_10.42.42.2(pid=6582): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6582)] 22:09:56.890065 run osmo-hlr_10.42.42.2(pid=6582): stdout: | (launched: 2022-12-13_22:09:53.421572) 22:09:56.942766 run osmo-hlr_10.42.42.2(pid=6582): stderr: | 20221213220953621 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213220953621 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213220953621 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213220953621 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213220953621 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213220953621 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213220953634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213220953644 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213220953644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213220953644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:56.994857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6575): Terminating (SIGTERM) 22:09:57.036549 run iperf3-srv_10.42.42.10(pid=6576): Terminating (SIGTERM) 22:09:57.078449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6577): Terminating (SIGTERM) 22:09:57.120364 run iperf3-srv_10.42.42.10(pid=6578): Terminating (SIGTERM) 22:09:57.162170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6581): Terminating (SIGTERM) 22:09:57.204424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6584): Terminating (SIGTERM) 22:09:57.246277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6587): Terminating (SIGTERM) 22:09:57.288357 --- ParallelTerminationStrategy: PID 6575 died... 22:09:57.308576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6575): Terminated: ok {rc=0} 22:09:57.355289 --- ParallelTerminationStrategy: PID 6576 died... 22:09:57.374873 run iperf3-srv_10.42.42.10(pid=6576): Terminated {rc=256} 22:09:57.421252 --- ParallelTerminationStrategy: PID 6577 died... 22:09:57.441163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6577): Terminated: ok {rc=0} 22:09:57.487231 --- ParallelTerminationStrategy: PID 6578 died... 22:09:57.506856 run iperf3-srv_10.42.42.10(pid=6578): Terminated {rc=256} 22:09:57.552562 --- ParallelTerminationStrategy: PID 6581 died... 22:09:57.572427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6581): Terminated: ok {rc=0} 22:09:57.618260 --- ParallelTerminationStrategy: PID 6584 died... 22:09:57.637952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6584): Terminated: ok {rc=0} 22:09:57.683964 --- ParallelTerminationStrategy: PID 6587 died... 22:09:57.703692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6587): Terminated: ok {rc=0} 22:09:57.791763 bus /gobi_0: Setting Powered False 22:09:58.894211 bus /gobi_0: Setting Powered False 22:10:00.011016 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:10:01.161876 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:01.174585 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:10:01.255089 tst iperf3.py: using LAC 36554 22:10:01.411563 tst iperf3.py: using RAC 89 22:10:01.541327 tst iperf3.py: using CellId 36554 22:10:01.681588 tst iperf3.py: using BVCI 36555 22:10:01.849390 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:01.866173 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:01.886602 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:01.902189 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:01.924514 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:01.939728 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:01.955474 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:01.970219 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:01.986178 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:02.117600 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:10:02.329917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:02.638866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6592): Launched 22:10:02.906040 run iperf3-srv_10.42.42.10(pid=6593): Launched 22:10:03.021058 tst iperf3.py:8: start network... 22:10:03.225314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:03.698521 run create_hlr_db(pid=6594): Launched 22:10:03.824007 bus /gobi_6: Setting Powered False 22:10:04.885272 run create_hlr_db(pid=6594): Terminated: ok {rc=0} 22:10:05.328903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6596): Launched 22:10:05.655540 run osmo-hlr_10.42.42.2(pid=6597): Launched 22:10:05.781557 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:06.347468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6599): Launched 22:10:06.672045 run osmo-stp_10.42.42.5(pid=6600): Launched 22:10:06.796365 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:10:07.358508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6602): Launched 22:10:07.483680 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:10:07.758799 run patchelf(pid=6603): Launched 22:10:07.939794 run osmo-stp_10.42.42.5(pid=6600): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6600)] 22:10:08.077701 run osmo-stp_10.42.42.5(pid=6600): stdout: | (launched: 2022-12-13_22:10:06.612893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:08.216773 run osmo-stp_10.42.42.5(pid=6600): stderr: | 20221213221006804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221006804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221006804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221006805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221006805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221006805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221006805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:08.356075 run osmo-stp_10.42.42.5(pid=6600): stdout: | (launched: 2022-12-13_22:10:06.612893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:08.490575 run osmo-stp_10.42.42.5(pid=6600): stderr: | 20221213221006804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221006804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221006804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221006805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221006805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221006805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221006805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:08.648454 run patchelf(pid=6603): Terminating (SIGINT) 22:10:08.830499 run patchelf(pid=6603): Terminated: ok {rc=0} 22:10:08.961625 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6600): Process ended prematurely: osmo-stp_10.42.42.5(pid=6600) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6600)] [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 22:10:08.971795 tst iperf3.py:8: Test FAILED (7.9 sec) 22:10:09.000471 run osmo-hlr_10.42.42.2(pid=6597): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6597)] 22:10:09.051194 run osmo-hlr_10.42.42.2(pid=6597): stdout: | (launched: 2022-12-13_22:10:05.596360) 22:10:09.104148 run osmo-hlr_10.42.42.2(pid=6597): stderr: | 20221213221005793 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221005794 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221005794 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221005794 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221005794 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221005794 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221005807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221005817 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221005817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221005817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:09.156832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6592): Terminating (SIGTERM) 22:10:09.198534 run iperf3-srv_10.42.42.10(pid=6593): Terminating (SIGTERM) 22:10:09.240445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6596): Terminating (SIGTERM) 22:10:09.282674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6599): Terminating (SIGTERM) 22:10:09.324695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6602): Terminating (SIGTERM) 22:10:09.367145 --- ParallelTerminationStrategy: PID 6592 died... 22:10:09.387532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6592): Terminated: ok {rc=0} 22:10:09.434374 --- ParallelTerminationStrategy: PID 6593 died... 22:10:09.454274 run iperf3-srv_10.42.42.10(pid=6593): Terminated {rc=256} 22:10:09.500285 --- ParallelTerminationStrategy: PID 6596 died... 22:10:09.520113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6596): Terminated: ok {rc=0} 22:10:09.566722 --- ParallelTerminationStrategy: PID 6599 died... 22:10:09.586784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6599): Terminated: ok {rc=0} 22:10:09.633155 --- ParallelTerminationStrategy: PID 6602 died... 22:10:09.652805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6602): Terminated: ok {rc=0} 22:10:09.741635 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:10:10.892175 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:10.904414 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:10:10.977987 tst iperf3m4.py: using LAC 36555 22:10:11.106964 tst iperf3m4.py: using RAC 90 22:10:11.232894 tst iperf3m4.py: using CellId 36555 22:10:11.358898 tst iperf3m4.py: using BVCI 36556 22:10:11.479556 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:11.491168 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:11.502611 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:11.514026 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:11.525680 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:11.537273 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:11.548827 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:11.560359 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:11.572010 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:11.690933 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:11.810492 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:11.927446 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:12.047932 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:10:12.268543 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:12.596511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6604): Launched 22:10:12.881711 run iperf3-srv_10.42.42.10(pid=6605): Launched 22:10:13.004273 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:10:13.224332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:13.552676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6606): Launched 22:10:13.836221 run iperf3-srv_10.42.42.10(pid=6607): Launched 22:10:13.958725 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:10:14.178556 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:14.506724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6608): Launched 22:10:14.790306 run iperf3-srv_10.42.42.10(pid=6609): Launched 22:10:14.913134 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:10:15.132900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:15.461914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6610): Launched 22:10:15.746464 run iperf3-srv_10.42.42.10(pid=6611): Launched 22:10:15.874108 tst iperf3m4.py:8: start network... 22:10:16.100725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:16.617584 run create_hlr_db(pid=6612): Launched 22:10:16.776800 bus /gobi_6: Setting Powered False 22:10:17.841675 run create_hlr_db(pid=6612): Terminated: ok {rc=0} 22:10:18.295082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6614): Launched 22:10:18.622354 run osmo-hlr_10.42.42.2(pid=6615): Launched 22:10:18.749063 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:19.309958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6617): Launched 22:10:19.614581 run osmo-stp_10.42.42.5(pid=6618): Launched 22:10:19.729486 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:10:20.252022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6620): Launched 22:10:20.368363 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:10:20.625373 run patchelf(pid=6621): Launched 22:10:20.794987 run osmo-stp_10.42.42.5(pid=6618): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6618)] 22:10:20.923952 run osmo-stp_10.42.42.5(pid=6618): stdout: | (launched: 2022-12-13_22:10:19.559208) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:21.054624 run osmo-stp_10.42.42.5(pid=6618): stderr: | 20221213221019727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221019728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221019728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221019728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221019729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221019729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221019729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:21.185120 run osmo-stp_10.42.42.5(pid=6618): stdout: | (launched: 2022-12-13_22:10:19.559208) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:21.310129 run osmo-stp_10.42.42.5(pid=6618): stderr: | 20221213221019727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221019728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221019728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221019728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221019729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221019729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221019729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:21.458745 run patchelf(pid=6621): Terminating (SIGINT) 22:10:21.628789 run patchelf(pid=6621): Terminated: ok {rc=0} 22:10:21.751795 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6618): Process ended prematurely: osmo-stp_10.42.42.5(pid=6618) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6618)] [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:10:21.761465 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:10:21.788697 run osmo-hlr_10.42.42.2(pid=6615): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6615)] 22:10:21.836346 run osmo-hlr_10.42.42.2(pid=6615): stdout: | (launched: 2022-12-13_22:10:18.563040) 22:10:21.886023 run osmo-hlr_10.42.42.2(pid=6615): stderr: | 20221213221018761 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221018761 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221018761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221018761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221018761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221018761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221018774 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221018783 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221018783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221018783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:21.935156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6604): Terminating (SIGTERM) 22:10:21.974653 run iperf3-srv_10.42.42.10(pid=6605): Terminating (SIGTERM) 22:10:22.013965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6606): Terminating (SIGTERM) 22:10:22.053344 run iperf3-srv_10.42.42.10(pid=6607): Terminating (SIGTERM) 22:10:22.092484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6608): Terminating (SIGTERM) 22:10:22.131868 run iperf3-srv_10.42.42.10(pid=6609): Terminating (SIGTERM) 22:10:22.170903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6610): Terminating (SIGTERM) 22:10:22.209931 run iperf3-srv_10.42.42.10(pid=6611): Terminating (SIGTERM) 22:10:22.248796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6614): Terminating (SIGTERM) 22:10:22.287960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6617): Terminating (SIGTERM) 22:10:22.327040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6620): Terminating (SIGTERM) 22:10:22.366522 --- ParallelTerminationStrategy: PID 6604 died... 22:10:22.385600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6604): Terminated: ok {rc=0} 22:10:22.429322 --- ParallelTerminationStrategy: PID 6605 died... 22:10:22.447835 run iperf3-srv_10.42.42.10(pid=6605): Terminated {rc=256} 22:10:22.491272 --- ParallelTerminationStrategy: PID 6606 died... 22:10:22.509746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6606): Terminated: ok {rc=0} 22:10:22.553299 --- ParallelTerminationStrategy: PID 6607 died... 22:10:22.571725 run iperf3-srv_10.42.42.10(pid=6607): Terminated {rc=256} 22:10:22.615127 --- ParallelTerminationStrategy: PID 6608 died... 22:10:22.633637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6608): Terminated: ok {rc=0} 22:10:22.676937 --- ParallelTerminationStrategy: PID 6609 died... 22:10:22.695410 run iperf3-srv_10.42.42.10(pid=6609): Terminated {rc=256} 22:10:22.738731 --- ParallelTerminationStrategy: PID 6610 died... 22:10:22.757349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6610): Terminated: ok {rc=0} 22:10:22.800826 --- ParallelTerminationStrategy: PID 6611 died... 22:10:22.819938 run iperf3-srv_10.42.42.10(pid=6611): Terminated {rc=256} 22:10:22.863455 --- ParallelTerminationStrategy: PID 6614 died... 22:10:22.882031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6614): Terminated: ok {rc=0} 22:10:22.925745 --- ParallelTerminationStrategy: PID 6617 died... 22:10:22.944397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6617): Terminated: ok {rc=0} 22:10:22.988568 --- ParallelTerminationStrategy: PID 6620 died... 22:10:23.007360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6620): Terminated: ok {rc=0} 22:10:23.092924 bus /gobi_4: Setting Powered False 22:10:24.193259 bus /gobi_4: Setting Powered False 22:10:25.309087 bus /gobi_1: Setting Powered False 22:10:26.410930 bus /gobi_1: Setting Powered False 22:10:27.527416 bus /gobi_0: Setting Powered False 22:10:28.625219 bus /gobi_0: Setting Powered False 22:10:29.742257 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:10:30.861229 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:30.878186 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:10:30.960108 tst ping.py: using LAC 36556 22:10:31.086273 tst ping.py: using RAC 91 22:10:31.246285 tst ping.py: using CellId 36556 22:10:31.376914 tst ping.py: using BVCI 36557 22:10:31.497351 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:31.509818 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:31.522194 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:31.534352 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:31.547655 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:31.561375 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:31.574958 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:31.589539 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:31.712201 tst ping.py:19: start network... 22:10:31.994390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:32.515911 run create_hlr_db(pid=6622): Launched 22:10:32.639348 bus /gobi_6: Setting Powered False 22:10:33.702240 run create_hlr_db(pid=6622): Terminated: ok {rc=0} 22:10:34.148663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6624): Launched 22:10:34.470284 run osmo-hlr_10.42.42.2(pid=6625): Launched 22:10:34.596175 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:35.160121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6627): Launched 22:10:35.481571 run osmo-stp_10.42.42.5(pid=6628): Launched 22:10:35.605490 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:10:36.159128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6630): Launched 22:10:36.282746 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:10:36.554148 run patchelf(pid=6631): Launched 22:10:36.732726 run osmo-stp_10.42.42.5(pid=6628): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6628)] 22:10:36.868449 run osmo-stp_10.42.42.5(pid=6628): stdout: | (launched: 2022-12-13_22:10:35.423016) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:37.006059 run osmo-stp_10.42.42.5(pid=6628): stderr: | 20221213221035618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221035619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221035619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221035619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221035620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221035620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221035620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:37.143073 run osmo-stp_10.42.42.5(pid=6628): stdout: | (launched: 2022-12-13_22:10:35.423016) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:37.274727 run osmo-stp_10.42.42.5(pid=6628): stderr: | 20221213221035618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221035619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221035619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221035619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221035620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221035620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221035620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:37.431173 run patchelf(pid=6631): Terminating (SIGINT) 22:10:37.610487 run patchelf(pid=6631): Terminated: ok {rc=0} 22:10:37.739459 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6628): Process ended prematurely: osmo-stp_10.42.42.5(pid=6628) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6628)] [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 22:10:37.749078 tst ping.py:22: Test FAILED (6.9 sec) 22:10:37.776895 run osmo-hlr_10.42.42.2(pid=6625): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6625)] 22:10:37.827355 run osmo-hlr_10.42.42.2(pid=6625): stdout: | (launched: 2022-12-13_22:10:34.411868) 22:10:37.879251 run osmo-hlr_10.42.42.2(pid=6625): stderr: | 20221213221034612 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221034612 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221034612 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221034612 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221034612 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221034612 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221034623 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221034631 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221034632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221034632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:37.931378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6624): Terminating (SIGTERM) 22:10:37.972681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6627): Terminating (SIGTERM) 22:10:38.014808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6630): Terminating (SIGTERM) 22:10:38.057225 --- ParallelTerminationStrategy: PID 6624 died... 22:10:38.077875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6624): Terminated: ok {rc=0} 22:10:38.124330 --- ParallelTerminationStrategy: PID 6627 died... 22:10:38.144317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6627): Terminated: ok {rc=0} 22:10:38.190466 --- ParallelTerminationStrategy: PID 6630 died... 22:10:38.210374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6630): Terminated: ok {rc=0} 22:10:38.298905 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:10:39.386298 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:39.398511 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:10:39.473062 tst ping_idle_ping.py: using LAC 36557 22:10:39.600585 tst ping_idle_ping.py: using RAC 92 22:10:39.719340 tst ping_idle_ping.py: using CellId 36557 22:10:39.837654 tst ping_idle_ping.py: using BVCI 36558 22:10:39.957139 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:39.968114 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:39.979036 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:39.989922 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:40.000847 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:40.011902 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:40.022970 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:10:40.033799 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:10:40.155279 tst ping_idle_ping.py:24: start network... 22:10:40.373047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:40.874216 run create_hlr_db(pid=6632): Launched 22:10:40.998431 bus /gobi_6: Setting Powered False 22:10:42.061996 run create_hlr_db(pid=6632): Terminated: ok {rc=0} 22:10:42.491336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6634): Launched 22:10:42.792338 run osmo-hlr_10.42.42.2(pid=6635): Launched 22:10:42.907909 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:43.425242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6637): Launched 22:10:43.726301 run osmo-stp_10.42.42.5(pid=6638): Launched 22:10:43.841336 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:10:44.357977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6640): Launched 22:10:44.472774 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:10:44.725237 run patchelf(pid=6641): Launched 22:10:44.892039 run osmo-stp_10.42.42.5(pid=6638): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6638)] 22:10:45.020256 run osmo-stp_10.42.42.5(pid=6638): stdout: | (launched: 2022-12-13_22:10:43.670877) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:45.148863 run osmo-stp_10.42.42.5(pid=6638): stderr: | 20221213221043840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221043840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221043840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221043841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221043841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221043841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221043841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:45.277256 run osmo-stp_10.42.42.5(pid=6638): stdout: | (launched: 2022-12-13_22:10:43.670877) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:45.399803 run osmo-stp_10.42.42.5(pid=6638): stderr: | 20221213221043840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221043840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221043840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221043841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221043841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221043841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221043841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:45.545477 run patchelf(pid=6641): Terminating (SIGINT) 22:10:45.713893 run patchelf(pid=6641): Terminated: ok {rc=0} 22:10:45.849501 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6638): Process ended prematurely: osmo-stp_10.42.42.5(pid=6638) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6638)] [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:10:45.863117 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:10:45.894953 run osmo-hlr_10.42.42.2(pid=6635): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6635)] 22:10:45.949678 run osmo-hlr_10.42.42.2(pid=6635): stdout: | (launched: 2022-12-13_22:10:42.737218) 22:10:46.004698 run osmo-hlr_10.42.42.2(pid=6635): stderr: | 20221213221042916 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221042916 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221042916 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221042916 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221042917 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221042917 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221042928 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221042937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221042938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221042938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:46.060843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6634): Terminating (SIGTERM) 22:10:46.104443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6637): Terminating (SIGTERM) 22:10:46.150572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6640): Terminating (SIGTERM) 22:10:46.197920 --- ParallelTerminationStrategy: PID 6634 died... 22:10:46.220828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6634): Terminated: ok {rc=0} 22:10:46.270700 --- ParallelTerminationStrategy: PID 6637 died... 22:10:46.291913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6637): Terminated: ok {rc=0} 22:10:46.340412 --- ParallelTerminationStrategy: PID 6640 died... 22:10:46.362222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6640): Terminated: ok {rc=0} 22:10:46.455886 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:10:47.765205 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:10:47.772062 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:10:47.805374 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 22:10:47.844050 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 22:10:47.930807 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:10:47.963665 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 22:10:48.001892 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 22:10:48.607352 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 22:10:48.661429 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:48.673660 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:10:48.727874 tst cs_paging_gprs_active.py: using LAC 36558 22:10:48.857364 tst cs_paging_gprs_active.py: using RAC 93 22:10:48.985772 tst cs_paging_gprs_active.py: using CellId 36558 22:10:49.117451 tst cs_paging_gprs_active.py: using BVCI 36559 22:10:49.237944 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:49.249845 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:49.261396 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:49.272775 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:49.284779 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:49.296734 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:49.308930 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:49.320818 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:10:49.333248 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:10:49.455975 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:10:49.574722 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:10:49.782389 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:50.090709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6645): Launched 22:10:50.358515 run iperf3-srv_10.42.42.10(pid=6646): Launched 22:10:50.473550 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:10:50.679476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:10:50.986391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6647): Launched 22:10:51.253343 run iperf3-srv_10.42.42.10(pid=6648): Launched 22:10:51.368920 tst cs_paging_gprs_active.py:38: start network... 22:10:51.574735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:52.058714 run create_hlr_db(pid=6652): Launched 22:10:52.185401 bus /gobi_6: Setting Powered False 22:10:53.246351 run create_hlr_db(pid=6652): Terminated: ok {rc=0} 22:10:53.691732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6654): Launched 22:10:54.018201 run osmo-hlr_10.42.42.2(pid=6655): Launched 22:10:54.145955 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:54.709129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6657): Launched 22:10:55.037158 run osmo-stp_10.42.42.5(pid=6658): Launched 22:10:55.166865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:10:55.733170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6660): Launched 22:10:55.859225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:10:56.136101 run patchelf(pid=6661): Launched 22:10:56.318671 run osmo-stp_10.42.42.5(pid=6658): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6658)] 22:10:56.457873 run osmo-stp_10.42.42.5(pid=6658): stdout: | (launched: 2022-12-13_22:10:54.978058) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:56.598456 run osmo-stp_10.42.42.5(pid=6658): stderr: | 20221213221055173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221055173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221055173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221055174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221055174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221055174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221055174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:56.739079 run osmo-stp_10.42.42.5(pid=6658): stdout: | (launched: 2022-12-13_22:10:54.978058) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:56.873504 run osmo-stp_10.42.42.5(pid=6658): stderr: | 20221213221055173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221055173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221055173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221055174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221055174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221055174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221055174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:57.033084 run patchelf(pid=6661): Terminating (SIGINT) 22:10:57.216589 run patchelf(pid=6661): Terminated: ok {rc=0} 22:10:57.348936 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6658): Process ended prematurely: osmo-stp_10.42.42.5(pid=6658) [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6658)] [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 22:10:57.359265 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:10:57.387935 run osmo-hlr_10.42.42.2(pid=6655): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6655)] 22:10:57.439031 run osmo-hlr_10.42.42.2(pid=6655): stdout: | (launched: 2022-12-13_22:10:53.959603) 22:10:57.491656 run osmo-hlr_10.42.42.2(pid=6655): stderr: | 20221213221054158 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221054158 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221054158 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221054158 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221054158 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221054158 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221054170 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221054179 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221054179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221054179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:57.544436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6645): Terminating (SIGTERM) 22:10:57.586227 run iperf3-srv_10.42.42.10(pid=6646): Terminating (SIGTERM) 22:10:57.628329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6647): Terminating (SIGTERM) 22:10:57.670667 run iperf3-srv_10.42.42.10(pid=6648): Terminating (SIGTERM) 22:10:57.712863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6654): Terminating (SIGTERM) 22:10:57.755516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6657): Terminating (SIGTERM) 22:10:57.797834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6660): Terminating (SIGTERM) 22:10:57.840758 --- ParallelTerminationStrategy: PID 6645 died... 22:10:57.861195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6645): Terminated: ok {rc=0} 22:10:57.907727 --- ParallelTerminationStrategy: PID 6646 died... 22:10:57.927599 run iperf3-srv_10.42.42.10(pid=6646): Terminated {rc=256} 22:10:57.973938 --- ParallelTerminationStrategy: PID 6647 died... 22:10:57.993742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6647): Terminated: ok {rc=0} 22:10:58.039888 --- ParallelTerminationStrategy: PID 6648 died... 22:10:58.059691 run iperf3-srv_10.42.42.10(pid=6648): Terminated {rc=256} 22:10:58.106058 --- ParallelTerminationStrategy: PID 6654 died... 22:10:58.125941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6654): Terminated: ok {rc=0} 22:10:58.172077 --- ParallelTerminationStrategy: PID 6657 died... 22:10:58.191901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6657): Terminated: ok {rc=0} 22:10:58.238156 --- ParallelTerminationStrategy: PID 6660 died... 22:10:58.258208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6660): Terminated: ok {rc=0} 22:10:58.346841 bus /gobi_0: Setting Powered False 22:10:59.446868 bus /gobi_0: Setting Powered False 22:11:00.561197 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 22:11:01.746971 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:01.764530 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:11:01.837360 tst iperf3.py: using LAC 36559 22:11:01.971779 tst iperf3.py: using RAC 94 22:11:02.093295 tst iperf3.py: using CellId 36559 22:11:02.223086 tst iperf3.py: using BVCI 36560 22:11:02.347765 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:02.359565 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:02.371231 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:02.382786 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:02.394602 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:02.406719 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:02.418707 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:02.430814 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:02.442933 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:02.564891 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:11:02.786678 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:03.114850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6662): Launched 22:11:03.400887 run iperf3-srv_10.42.42.10(pid=6663): Launched 22:11:03.524528 tst iperf3.py:8: start network... 22:11:03.745763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:04.254095 run create_hlr_db(pid=6664): Launched 22:11:04.378872 bus /gobi_6: Setting Powered False 22:11:05.443486 run create_hlr_db(pid=6664): Terminated: ok {rc=0} 22:11:05.898488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6666): Launched 22:11:06.225723 run osmo-hlr_10.42.42.2(pid=6667): Launched 22:11:06.351051 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:06.916461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6669): Launched 22:11:07.242087 run osmo-stp_10.42.42.5(pid=6670): Launched 22:11:07.369518 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:07.934800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6672): Launched 22:11:08.060576 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:08.336743 run patchelf(pid=6673): Launched 22:11:08.519538 run osmo-stp_10.42.42.5(pid=6670): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6670)] 22:11:08.658103 run osmo-stp_10.42.42.5(pid=6670): stdout: | (launched: 2022-12-13_22:11:07.183433) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:08.798218 run osmo-stp_10.42.42.5(pid=6670): stderr: | 20221213221107375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221107375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221107375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221107376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221107376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221107376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221107376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:08.938105 run osmo-stp_10.42.42.5(pid=6670): stdout: | (launched: 2022-12-13_22:11:07.183433) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:09.072502 run osmo-stp_10.42.42.5(pid=6670): stderr: | 20221213221107375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221107375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221107375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221107376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221107376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221107376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221107376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:09.231758 run patchelf(pid=6673): Terminating (SIGINT) 22:11:09.415050 run patchelf(pid=6673): Terminated: ok {rc=0} 22:11:09.547598 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6670): Process ended prematurely: osmo-stp_10.42.42.5(pid=6670) [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6670)] [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 22:11:09.557949 tst iperf3.py:8: Test FAILED (7.9 sec) 22:11:09.586573 run osmo-hlr_10.42.42.2(pid=6667): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6667)] 22:11:09.637097 run osmo-hlr_10.42.42.2(pid=6667): stdout: | (launched: 2022-12-13_22:11:06.166415) 22:11:09.689369 run osmo-hlr_10.42.42.2(pid=6667): stderr: | 20221213221106366 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221106366 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221106366 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221106366 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221106366 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221106366 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221106379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221106387 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221106387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221106387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:09.741752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6662): Terminating (SIGTERM) 22:11:09.783093 run iperf3-srv_10.42.42.10(pid=6663): Terminating (SIGTERM) 22:11:09.825301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6666): Terminating (SIGTERM) 22:11:09.867008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6669): Terminating (SIGTERM) 22:11:09.908659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6672): Terminating (SIGTERM) 22:11:09.951154 --- ParallelTerminationStrategy: PID 6662 died... 22:11:09.971502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6662): Terminated: ok {rc=0} 22:11:10.017647 --- ParallelTerminationStrategy: PID 6663 died... 22:11:10.037302 run iperf3-srv_10.42.42.10(pid=6663): Terminated {rc=256} 22:11:10.083146 --- ParallelTerminationStrategy: PID 6666 died... 22:11:10.102867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6666): Terminated: ok {rc=0} 22:11:10.148781 --- ParallelTerminationStrategy: PID 6669 died... 22:11:10.168907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6669): Terminated: ok {rc=0} 22:11:10.214932 --- ParallelTerminationStrategy: PID 6672 died... 22:11:10.234818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6672): Terminated: ok {rc=0} 22:11:10.323438 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 22:11:11.474878 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:11.487478 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:11:11.546376 tst iperf3m4.py: using LAC 36560 22:11:11.677379 tst iperf3m4.py: using RAC 95 22:11:11.807975 tst iperf3m4.py: using CellId 36560 22:11:11.936454 tst iperf3m4.py: using BVCI 36561 22:11:12.054916 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:12.066876 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:12.078509 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:12.090141 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:12.102616 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:12.115058 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:12.127577 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:12.139966 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:12.152677 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:12.273888 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:12.397779 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:12.519399 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:12.642818 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:11:12.864322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:13.191996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6674): Launched 22:11:13.477084 run iperf3-srv_10.42.42.10(pid=6675): Launched 22:11:13.602614 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:11:13.823204 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:14.151388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6676): Launched 22:11:14.436348 run iperf3-srv_10.42.42.10(pid=6677): Launched 22:11:14.559430 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:11:14.780197 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:15.107400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6678): Launched 22:11:15.391821 run iperf3-srv_10.42.42.10(pid=6679): Launched 22:11:15.514950 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:11:15.734996 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:16.085771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6680): Launched 22:11:16.446528 run iperf3-srv_10.42.42.10(pid=6681): Launched 22:11:16.574891 tst iperf3m4.py:8: start network... 22:11:16.783682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:17.321605 run create_hlr_db(pid=6682): Launched 22:11:17.446869 bus /gobi_6: Setting Powered False 22:11:18.508060 run create_hlr_db(pid=6682): Terminated: ok {rc=0} 22:11:18.931462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6684): Launched 22:11:19.236350 run osmo-hlr_10.42.42.2(pid=6685): Launched 22:11:19.353374 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:19.882245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6687): Launched 22:11:20.185719 run osmo-stp_10.42.42.5(pid=6688): Launched 22:11:20.302642 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:20.829034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6690): Launched 22:11:20.945727 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:21.203417 run patchelf(pid=6691): Launched 22:11:21.373276 run osmo-stp_10.42.42.5(pid=6688): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6688)] 22:11:21.502518 run osmo-stp_10.42.42.5(pid=6688): stdout: | (launched: 2022-12-13_22:11:20.130448) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:21.633121 run osmo-stp_10.42.42.5(pid=6688): stderr: | 20221213221120302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221120302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221120302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221120303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221120303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221120303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221120303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:21.763490 run osmo-stp_10.42.42.5(pid=6688): stdout: | (launched: 2022-12-13_22:11:20.130448) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:21.888457 run osmo-stp_10.42.42.5(pid=6688): stderr: | 20221213221120302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221120302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221120302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221120303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221120303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221120303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221120303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:22.037317 run patchelf(pid=6691): Terminating (SIGINT) 22:11:22.208352 run patchelf(pid=6691): Terminated: ok {rc=0} 22:11:22.332146 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6688): Process ended prematurely: osmo-stp_10.42.42.5(pid=6688) [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6688)] [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 22:11:22.341752 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:11:22.369281 run osmo-hlr_10.42.42.2(pid=6685): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6685)] 22:11:22.417217 run osmo-hlr_10.42.42.2(pid=6685): stdout: | (launched: 2022-12-13_22:11:19.180394) 22:11:22.466513 run osmo-hlr_10.42.42.2(pid=6685): stderr: | 20221213221119358 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221119358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221119358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221119358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221119358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221119359 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221119370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221119379 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221119380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221119380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:22.516275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6674): Terminating (SIGTERM) 22:11:22.556263 run iperf3-srv_10.42.42.10(pid=6675): Terminating (SIGTERM) 22:11:22.596170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6676): Terminating (SIGTERM) 22:11:22.636029 run iperf3-srv_10.42.42.10(pid=6677): Terminating (SIGTERM) 22:11:22.675779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6678): Terminating (SIGTERM) 22:11:22.715683 run iperf3-srv_10.42.42.10(pid=6679): Terminating (SIGTERM) 22:11:22.755409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6680): Terminating (SIGTERM) 22:11:22.795060 run iperf3-srv_10.42.42.10(pid=6681): Terminating (SIGTERM) 22:11:22.834772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6684): Terminating (SIGTERM) 22:11:22.874618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6687): Terminating (SIGTERM) 22:11:22.914305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6690): Terminating (SIGTERM) 22:11:22.954280 --- ParallelTerminationStrategy: PID 6674 died... 22:11:22.973619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6674): Terminated: ok {rc=0} 22:11:23.017686 --- ParallelTerminationStrategy: PID 6675 died... 22:11:23.036314 run iperf3-srv_10.42.42.10(pid=6675): Terminated {rc=256} 22:11:23.080794 --- ParallelTerminationStrategy: PID 6676 died... 22:11:23.100217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6676): Terminated: ok {rc=0} 22:11:23.144163 --- ParallelTerminationStrategy: PID 6677 died... 22:11:23.163150 run iperf3-srv_10.42.42.10(pid=6677): Terminated {rc=256} 22:11:23.206994 --- ParallelTerminationStrategy: PID 6678 died... 22:11:23.225897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6678): Terminated: ok {rc=0} 22:11:23.269852 --- ParallelTerminationStrategy: PID 6679 died... 22:11:23.288787 run iperf3-srv_10.42.42.10(pid=6679): Terminated {rc=256} 22:11:23.332597 --- ParallelTerminationStrategy: PID 6680 died... 22:11:23.351520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6680): Terminated: ok {rc=0} 22:11:23.395436 --- ParallelTerminationStrategy: PID 6681 died... 22:11:23.414258 run iperf3-srv_10.42.42.10(pid=6681): Terminated {rc=256} 22:11:23.458040 --- ParallelTerminationStrategy: PID 6684 died... 22:11:23.477088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6684): Terminated: ok {rc=0} 22:11:23.521150 --- ParallelTerminationStrategy: PID 6687 died... 22:11:23.539887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6687): Terminated: ok {rc=0} 22:11:23.583659 --- ParallelTerminationStrategy: PID 6690 died... 22:11:23.602515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6690): Terminated: ok {rc=0} 22:11:23.685424 bus /gobi_4: Setting Powered False 22:11:24.783984 bus /gobi_4: Setting Powered False 22:11:25.901115 bus /gobi_1: Setting Powered False 22:11:26.999757 bus /gobi_1: Setting Powered False 22:11:28.115202 bus /gobi_0: Setting Powered False 22:11:29.211853 bus /gobi_0: Setting Powered False 22:11:30.330477 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 22:11:31.433991 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:31.447842 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:11:31.506672 tst ping.py: using LAC 36561 22:11:31.639276 tst ping.py: using RAC 96 22:11:31.760500 tst ping.py: using CellId 36561 22:11:31.884817 tst ping.py: using BVCI 36562 22:11:31.996119 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:32.007848 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:32.019214 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:32.031024 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:32.042586 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:32.054448 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:32.066252 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:32.077950 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:32.195181 tst ping.py:19: start network... 22:11:32.395593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:32.859106 run create_hlr_db(pid=6693): Launched 22:11:32.982037 bus /gobi_6: Setting Powered False 22:11:34.043153 run create_hlr_db(pid=6693): Terminated: ok {rc=0} 22:11:34.481728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6695): Launched 22:11:34.804112 run osmo-hlr_10.42.42.2(pid=6696): Launched 22:11:34.927781 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:35.485185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6698): Launched 22:11:35.808343 run osmo-stp_10.42.42.5(pid=6699): Launched 22:11:35.932130 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:36.488588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6701): Launched 22:11:36.611673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:36.882607 run patchelf(pid=6702): Launched 22:11:37.063590 run osmo-stp_10.42.42.5(pid=6699): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6699)] 22:11:37.200821 run osmo-stp_10.42.42.5(pid=6699): stdout: | (launched: 2022-12-13_22:11:35.748590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:37.339087 run osmo-stp_10.42.42.5(pid=6699): stderr: | 20221213221135940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221135941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221135941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221135941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221135944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221135944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221135944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:37.478042 run osmo-stp_10.42.42.5(pid=6699): stdout: | (launched: 2022-12-13_22:11:35.748590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:37.611376 run osmo-stp_10.42.42.5(pid=6699): stderr: | 20221213221135940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221135941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221135941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221135941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221135944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221135944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221135944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:37.769067 run patchelf(pid=6702): Terminating (SIGINT) 22:11:37.949945 run patchelf(pid=6702): Terminated: ok {rc=0} 22:11:38.080464 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6699): Process ended prematurely: osmo-stp_10.42.42.5(pid=6699) [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6699)] [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 22:11:38.090385 tst ping.py:22: Test FAILED (6.6 sec) 22:11:38.118657 run osmo-hlr_10.42.42.2(pid=6696): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6696)] 22:11:38.170882 run osmo-hlr_10.42.42.2(pid=6696): stdout: | (launched: 2022-12-13_22:11:34.746136) 22:11:38.223302 run osmo-hlr_10.42.42.2(pid=6696): stderr: | 20221213221134942 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221134942 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221134942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221134943 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221134943 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221134943 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221134955 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221134963 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221134963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221134963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:38.276223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6695): Terminating (SIGTERM) 22:11:38.318399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6698): Terminating (SIGTERM) 22:11:38.361014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6701): Terminating (SIGTERM) 22:11:38.403737 --- ParallelTerminationStrategy: PID 6695 died... 22:11:38.424915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6695): Terminated: ok {rc=0} 22:11:38.472323 --- ParallelTerminationStrategy: PID 6698 died... 22:11:38.492865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6698): Terminated: ok {rc=0} 22:11:38.539792 --- ParallelTerminationStrategy: PID 6701 died... 22:11:38.560010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6701): Terminated: ok {rc=0} 22:11:38.649792 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 22:11:39.738229 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:39.750981 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:11:39.807178 tst ping_idle_ping.py: using LAC 36562 22:11:39.934401 tst ping_idle_ping.py: using RAC 97 22:11:40.059834 tst ping_idle_ping.py: using CellId 36562 22:11:40.187575 tst ping_idle_ping.py: using BVCI 36563 22:11:40.304595 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:40.316566 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:40.328160 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:40.339850 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:40.351653 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:40.363586 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:40.375672 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:11:40.387574 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:11:40.509194 tst ping_idle_ping.py:24: start network... 22:11:40.726563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:41.228127 run create_hlr_db(pid=6703): Launched 22:11:41.351786 bus /gobi_6: Setting Powered False 22:11:42.415447 run create_hlr_db(pid=6703): Terminated: ok {rc=0} 22:11:42.846612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6705): Launched 22:11:43.148659 run osmo-hlr_10.42.42.2(pid=6706): Launched 22:11:43.263399 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:43.780456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6708): Launched 22:11:44.081657 run osmo-stp_10.42.42.5(pid=6709): Launched 22:11:44.197477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:44.716071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6711): Launched 22:11:44.831137 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:45.084243 run patchelf(pid=6712): Launched 22:11:45.251388 run osmo-stp_10.42.42.5(pid=6709): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6709)] 22:11:45.378229 run osmo-stp_10.42.42.5(pid=6709): stdout: | (launched: 2022-12-13_22:11:44.026343) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:45.507066 run osmo-stp_10.42.42.5(pid=6709): stderr: | 20221213221144196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221144196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221144196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221144197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221144199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221144199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221144199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:45.635907 run osmo-stp_10.42.42.5(pid=6709): stdout: | (launched: 2022-12-13_22:11:44.026343) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:45.758808 run osmo-stp_10.42.42.5(pid=6709): stderr: | 20221213221144196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221144196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221144196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221144197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221144199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221144199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221144199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:45.939033 run patchelf(pid=6712): Terminating (SIGINT) 22:11:46.118791 run patchelf(pid=6712): Terminated: ok {rc=0} 22:11:46.242297 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6709): Process ended prematurely: osmo-stp_10.42.42.5(pid=6709) [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6709)] [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 22:11:46.252020 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:11:46.279701 run osmo-hlr_10.42.42.2(pid=6706): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6706)] 22:11:46.328567 run osmo-hlr_10.42.42.2(pid=6706): stdout: | (launched: 2022-12-13_22:11:43.093405) 22:11:46.379207 run osmo-hlr_10.42.42.2(pid=6706): stderr: | 20221213221143272 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221143272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221143272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221143272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221143272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221143272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221143321 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221143331 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221143331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221143331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:46.430142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6705): Terminating (SIGTERM) 22:11:46.470978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6708): Terminating (SIGTERM) 22:11:46.511681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6711): Terminating (SIGTERM) 22:11:46.552665 --- ParallelTerminationStrategy: PID 6705 died... 22:11:46.572174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6705): Terminated: ok {rc=0} 22:11:46.617220 --- ParallelTerminationStrategy: PID 6708 died... 22:11:46.636691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6708): Terminated: ok {rc=0} 22:11:46.681854 --- ParallelTerminationStrategy: PID 6711 died... 22:11:46.701307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6711): Terminated: ok {rc=0} 22:11:46.787390 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:11:48.096883 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:11:48.104006 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:11:48.138409 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:11:48.172616 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:11:48.227632 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:11:48.262159 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:11:48.296745 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:11:48.851501 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2395 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:11:48.856658 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:48.868061 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:11:48.939282 tst switch_tch_pdch.py: using LAC 36563 22:11:49.061361 tst switch_tch_pdch.py: using RAC 98 22:11:49.185972 tst switch_tch_pdch.py: using CellId 36563 22:11:49.304412 tst switch_tch_pdch.py: using BVCI 36564 22:11:49.413389 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:49.424630 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:49.435597 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:49.446605 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:49.458047 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:49.469582 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:49.481147 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:11:49.492594 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:11:49.614793 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:11:49.733457 tst switch_tch_pdch.py:51: start network... 22:11:49.934824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:50.400023 run create_hlr_db(pid=6716): Launched 22:11:50.525627 bus /gobi_6: Setting Powered False 22:11:51.584581 run create_hlr_db(pid=6716): Terminated: ok {rc=0} 22:11:52.022355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6718): Launched 22:11:52.345394 run osmo-hlr_10.42.42.2(pid=6719): Launched 22:11:52.470894 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:53.023764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6721): Launched 22:11:53.344521 run osmo-stp_10.42.42.5(pid=6722): Launched 22:11:53.468088 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:54.023164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6724): Launched 22:11:54.147816 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:54.418833 run patchelf(pid=6725): Launched 22:11:54.598868 run osmo-stp_10.42.42.5(pid=6722): ERR: Terminated: ERROR {rc=1} [trial-2395↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6722)] 22:11:54.735334 run osmo-stp_10.42.42.5(pid=6722): stdout: | (launched: 2022-12-13_22:11:53.286433) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:54.873367 run osmo-stp_10.42.42.5(pid=6722): stderr: | 20221213221153478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221153478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221153479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221153479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221153481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221153481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221153482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:55.011123 run osmo-stp_10.42.42.5(pid=6722): stdout: | (launched: 2022-12-13_22:11:53.286433) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:55.143434 run osmo-stp_10.42.42.5(pid=6722): stderr: | 20221213221153478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221153478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221153479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221153479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221153481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221153481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221153482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:55.299853 run patchelf(pid=6725): Terminating (SIGINT) 22:11:55.479789 run patchelf(pid=6725): Terminated: ok {rc=0} 22:11:55.609784 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6722): Process ended prematurely: osmo-stp_10.42.42.5(pid=6722) [trial-2395↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6722)] [trial-2395↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:11:55.619516 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 22:11:55.647671 run osmo-hlr_10.42.42.2(pid=6719): ERR: Terminated: ERROR {rc=237} [trial-2395↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6719)] 22:11:55.698806 run osmo-hlr_10.42.42.2(pid=6719): stdout: | (launched: 2022-12-13_22:11:52.287341) 22:11:55.751474 run osmo-hlr_10.42.42.2(pid=6719): stderr: | 20221213221152485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221152485 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221152485 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221152485 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221152485 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221152485 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221152496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221152505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221152505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221152505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:55.804015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6718): Terminating (SIGTERM) 22:11:55.846350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6721): Terminating (SIGTERM) 22:11:55.889018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6724): Terminating (SIGTERM) 22:11:55.931763 --- ParallelTerminationStrategy: PID 6718 died... 22:11:55.952616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6718): Terminated: ok {rc=0} 22:11:55.999432 --- ParallelTerminationStrategy: PID 6721 died... 22:11:56.019682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6721): Terminated: ok {rc=0} 22:11:56.065977 --- ParallelTerminationStrategy: PID 6724 died... 22:11:56.086341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6724): Terminated: ok {rc=0} 22:11:56.175793 bus /gobi_0: Setting Powered False 22:11:57.274448 bus /gobi_0: Setting Powered False 22:11:58.389946 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:11:59.648191 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:11:59.655181 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:11:59.688225 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:11:59.723297 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:11:59.778261 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:11:59.811718 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:11:59.845766 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:12:00.399426 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2395 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:12:00.405060 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:12:00.416054 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:12:00.485643 tst switch_tch_pdch.py: using LAC 36564 22:12:00.606768 tst switch_tch_pdch.py: using RAC 99 22:12:00.725580 tst switch_tch_pdch.py: using CellId 36564 22:12:00.873415 tst switch_tch_pdch.py: using BVCI 36565 22:12:01.004195 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:12:01.016679 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:12:01.029057 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:12:01.041460 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:12:01.054645 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:12:01.067654 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:12:01.080731 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:12:01.093786 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:12:01.233189 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:12:01.368352 tst switch_tch_pdch.py:51: start network... 22:12:01.600095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:02.055684 run create_hlr_db(pid=6729): Launched 22:12:02.215959 bus /gobi_6: Setting Powered False 22:12:03.276531 run create_hlr_db(pid=6729): Terminated: ok {rc=0} 22:12:03.708426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6731): Launched 22:12:04.029140 run osmo-hlr_10.42.42.2(pid=6732): Launched 22:12:04.154069 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:04.679284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6734): Launched 22:12:04.982501 run osmo-stp_10.42.42.5(pid=6735): Launched 22:12:05.098615 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:12:05.588217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6737): Launched 22:12:05.702306 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:12:05.954242 run patchelf(pid=6738): Launched 22:12:06.122437 run osmo-stp_10.42.42.5(pid=6735): ERR: Terminated: ERROR {rc=1} [trial-2395↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6735)] 22:12:06.248739 run osmo-stp_10.42.42.5(pid=6735): stdout: | (launched: 2022-12-13_22:12:04.927717) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:06.377680 run osmo-stp_10.42.42.5(pid=6735): stderr: | 20221213221205099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221205099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221205100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221205100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221205101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221205101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221205101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:06.505695 run osmo-stp_10.42.42.5(pid=6735): stdout: | (launched: 2022-12-13_22:12:04.927717) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:06.627780 run osmo-stp_10.42.42.5(pid=6735): stderr: | 20221213221205099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221205099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221205100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221205100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221205101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221205101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221205101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:06.772776 run patchelf(pid=6738): Terminating (SIGINT) 22:12:06.939920 run patchelf(pid=6738): Terminated: ok {rc=0} 22:12:07.060127 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6735): Process ended prematurely: osmo-stp_10.42.42.5(pid=6735) [trial-2395↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6735)] [trial-2395↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:12:07.069120 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 22:12:07.095655 run osmo-hlr_10.42.42.2(pid=6732): ERR: Terminated: ERROR {rc=237} [trial-2395↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6732)] 22:12:07.143876 run osmo-hlr_10.42.42.2(pid=6732): stdout: | (launched: 2022-12-13_22:12:03.970972) 22:12:07.193634 run osmo-hlr_10.42.42.2(pid=6732): stderr: | 20221213221204167 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221204167 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221204167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221204167 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221204167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221204167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221204180 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221204189 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221204189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221204189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:07.243484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6731): Terminating (SIGTERM) 22:12:07.283433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6734): Terminating (SIGTERM) 22:12:07.323113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6737): Terminating (SIGTERM) 22:12:07.363057 --- ParallelTerminationStrategy: PID 6731 died... 22:12:07.382336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6731): Terminated: ok {rc=0} 22:12:07.426588 --- ParallelTerminationStrategy: PID 6734 died... 22:12:07.445372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6734): Terminated: ok {rc=0} 22:12:07.489124 --- ParallelTerminationStrategy: PID 6737 died... 22:12:07.507701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6737): Terminated: ok {rc=0} 22:12:07.590984 bus /gobi_0: Setting Powered False 22:12:08.689691 bus /gobi_0: Setting Powered False 22:12:09.808604 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 22:12:11.062645 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:11.066658 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:12:11.099885 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 22:12:11.107106 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 22:12:11.159839 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:12:11.193292 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 22:12:11.200240 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 22:12:11.741303 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 22:12:11.747331 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 22:12:11.759298 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:12:11.813036 tst mo_mt_sms.py: using LAC 36565 22:12:11.938862 tst mo_mt_sms.py: using RAC 100 22:12:12.071913 tst mo_mt_sms.py: using CellId 36565 22:12:12.196526 tst mo_mt_sms.py: using BVCI 36566 22:12:12.313475 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:12:12.427681 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:12:12.541058 tst mo_mt_sms.py:9: start nitb and bts... 22:12:12.743071 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:12:13.355578 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6743): Launched 22:12:13.654570 run osmo-nitb_10.42.42.2(pid=6744): Launched 22:12:13.821246 run osmo-nitb_10.42.42.2(pid=6744): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6744)] 22:12:13.955563 run osmo-nitb_10.42.42.2(pid=6744): stdout: | (launched: 2022-12-13_22:12:13.600208) 22:12:14.091077 run osmo-nitb_10.42.42.2(pid=6744): stderr: | (launched: 2022-12-13_22:12:13.644550) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:12:14.226775 run osmo-nitb_10.42.42.2(pid=6744): stdout: | (launched: 2022-12-13_22:12:13.600208) 22:12:14.358004 run osmo-nitb_10.42.42.2(pid=6744): stderr: | (launched: 2022-12-13_22:12:13.644550) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6744): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6744) [trial-2395↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6744)] 22:12:14.767998 tst osmo-nitb_10.42.42.2(pid=6744): stdout: | (launched: 2022-12-13_22:12:13.600208) 22:12:14.888620 tst osmo-nitb_10.42.42.2(pid=6744): stderr: | (launched: 2022-12-13_22:12:13.644550) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:12:15.031383 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=6744): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6744) [trial-2395↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6744)] [trial-2395↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 22:12:15.040136 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 22:12:15.046931 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6743): Terminating (SIGTERM) 22:12:15.255908 --- ParallelTerminationStrategy: PID 6743 died... 22:12:15.278337 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6743): Terminated: ok {rc=0} 22:12:15.365713 bus /sierra_3: Setting Powered False 22:12:16.483182 bus /sierra_3: Setting Powered False 22:12:17.616931 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 sms:trx-sysmocell5000 --------------------------------------------------------------------- 22:12:18.814285 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:18.818282 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:12:18.851620 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 22:12:18.878399 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 22:12:18.929654 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:12:18.963065 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 22:12:18.989502 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 22:12:19.537861 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 22:12:19.543005 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:19.553939 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:12:19.602072 tst mo_mt_sms.py: using LAC 36566 22:12:19.721366 tst mo_mt_sms.py: using RAC 101 22:12:19.838926 tst mo_mt_sms.py: using CellId 36566 22:12:19.958639 tst mo_mt_sms.py: using BVCI 36567 22:12:20.068244 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:20.078996 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:20.089583 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:20.099995 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:20.110515 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:20.121114 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:12:20.240685 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:12:20.356554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:20.822789 run create_hlr_db(pid=6748): Launched 22:12:20.946146 bus /sierra_2: Setting Powered False 22:12:22.006439 run create_hlr_db(pid=6748): Terminated: ok {rc=0} 22:12:22.428155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6750): Launched 22:12:22.728037 run osmo-hlr_10.42.42.2(pid=6751): Launched 22:12:22.841895 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:23.370587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6753): Launched 22:12:23.669909 run osmo-stp_10.42.42.5(pid=6754): Launched 22:12:23.784288 run osmo-msc_10.42.42.6: Starting osmo-msc 22:12:24.326021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6756): Launched 22:12:24.626599 run osmo-msc_10.42.42.6(pid=6757): Launched 22:12:24.794320 run osmo-stp_10.42.42.5(pid=6754): ERR: Terminated: ERROR {rc=1} [trial-2395↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6754)] 22:12:24.921215 run osmo-stp_10.42.42.5(pid=6754): stdout: | (launched: 2022-12-13_22:12:23.615210) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:25.047980 run osmo-stp_10.42.42.5(pid=6754): stderr: | 20221213221223785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221223785 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221223785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221223786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221223786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221223786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221223786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:25.173234 run osmo-stp_10.42.42.5(pid=6754): stdout: | (launched: 2022-12-13_22:12:23.615210) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:25.292861 run osmo-stp_10.42.42.5(pid=6754): stderr: | 20221213221223785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221223785 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221223785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221223786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221223786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221223786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221223786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:25.435789 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=6754): Process ended prematurely: osmo-stp_10.42.42.5(pid=6754) [trial-2395↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6754)] [trial-2395↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 22:12:25.444183 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 22:12:25.470349 run osmo-hlr_10.42.42.2(pid=6751): ERR: Terminated: ERROR {rc=237} [trial-2395↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6751)] 22:12:25.518363 run osmo-hlr_10.42.42.2(pid=6751): stdout: | (launched: 2022-12-13_22:12:22.672772) 22:12:25.567750 run osmo-hlr_10.42.42.2(pid=6751): stderr: | 20221213221222850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221222850 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221222850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221222850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221222850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221222850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221222862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221222871 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221222871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221222871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:25.636382 run osmo-msc_10.42.42.6(pid=6757): ERR: Terminated: ERROR {rc=2} [trial-2395↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6757)] 22:12:25.683818 run osmo-msc_10.42.42.6(pid=6757): stdout: | (launched: 2022-12-13_22:12:24.571671) 22:12:25.732890 run osmo-msc_10.42.42.6(pid=6757): stderr: | 20221213221224843 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221224843 DLGLOBAL DEBUG validating counter group 0x7fd485201c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221224843 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221224843 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221224843 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221224843 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221224845 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221224846 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221224846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221224846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:12:25.782701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6750): Terminating (SIGTERM) 22:12:25.822568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6753): Terminating (SIGTERM) 22:12:25.862259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6756): Terminating (SIGTERM) 22:12:25.902237 --- ParallelTerminationStrategy: PID 6750 died... 22:12:25.921687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6750): Terminated: ok {rc=0} 22:12:25.966007 --- ParallelTerminationStrategy: PID 6753 died... 22:12:25.984877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6753): Terminated: ok {rc=0} 22:12:26.029076 --- ParallelTerminationStrategy: PID 6756 died... 22:12:26.047978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6756): Terminated: ok {rc=0} 22:12:26.132592 bus /sierra_3: Setting Powered False 22:12:27.230640 bus /sierra_3: Setting Powered False 22:12:28.349384 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 22:12:29.579758 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:29.583612 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:12:29.616927 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 22:12:29.624133 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 22:12:29.660767 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:12:29.694388 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 22:12:29.701279 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 22:12:30.221634 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2395 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 22:12:30.226664 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 22:12:30.237775 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:12:30.287275 tst assert_extension.py: using LAC 36567 22:12:30.404566 tst assert_extension.py: using RAC 102 22:12:30.522855 tst assert_extension.py: using CellId 36567 22:12:30.642193 tst assert_extension.py: using BVCI 36568 22:12:30.750916 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 22:12:30.879253 tst assert_extension.py:10: start nitb and bts... 22:12:31.119882 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:12:31.790741 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6762): Launched 22:12:32.129524 run osmo-nitb_10.42.42.2(pid=6763): Launched 22:12:32.308756 run osmo-nitb_10.42.42.2(pid=6763): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6763)] 22:12:32.444754 run osmo-nitb_10.42.42.2(pid=6763): stdout: | (launched: 2022-12-13_22:12:32.069424) 22:12:32.581467 run osmo-nitb_10.42.42.2(pid=6763): stderr: | (launched: 2022-12-13_22:12:32.117670) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:12:32.717430 run osmo-nitb_10.42.42.2(pid=6763): stdout: | (launched: 2022-12-13_22:12:32.069424) 22:12:32.848364 run osmo-nitb_10.42.42.2(pid=6763): stderr: | (launched: 2022-12-13_22:12:32.117670) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6763): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6763) [trial-2395↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6763)] 22:12:33.255977 tst osmo-nitb_10.42.42.2(pid=6763): stdout: | (launched: 2022-12-13_22:12:32.069424) 22:12:33.377251 tst osmo-nitb_10.42.42.2(pid=6763): stderr: | (launched: 2022-12-13_22:12:32.117670) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:12:33.520069 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=6763): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6763) [trial-2395↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6763)] [trial-2395↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 22:12:33.528706 tst assert_extension.py:12: Test FAILED (3.3 sec) 22:12:33.535644 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6762): Terminating (SIGTERM) 22:12:33.744492 --- ParallelTerminationStrategy: PID 6762 died... 22:12:33.765349 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6762): Terminated: ok {rc=0} 22:12:33.851665 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 22:12:35.030663 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:35.034660 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:12:35.067770 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 22:12:35.094880 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 22:12:35.130412 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:12:35.164402 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 22:12:35.190970 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 22:12:35.723195 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2395 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 22:12:35.728665 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:35.739587 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:12:35.788198 tst assert_extension.py: using LAC 36568 22:12:35.905431 tst assert_extension.py: using RAC 103 22:12:36.031614 tst assert_extension.py: using CellId 36568 22:12:36.157128 tst assert_extension.py: using BVCI 36569 22:12:36.266580 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:36.277585 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:36.288376 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:36.299079 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:36.309947 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:12:36.320668 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 22:12:36.434956 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:36.898212 run create_hlr_db(pid=6767): Launched 22:12:37.022797 bus /sierra_2: Setting Powered False 22:12:38.082037 run create_hlr_db(pid=6767): Terminated: ok {rc=0} 22:12:38.520468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6769): Launched 22:12:38.842033 run osmo-hlr_10.42.42.2(pid=6770): Launched 22:12:38.967620 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:39.612641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6772): Launched 22:12:39.928445 run osmo-stp_10.42.42.5(pid=6773): Launched 22:12:40.050047 run osmo-msc_10.42.42.6: Starting osmo-msc 22:12:40.621922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6775): Launched 22:12:40.936553 run osmo-msc_10.42.42.6(pid=6776): Launched 22:12:41.113727 run osmo-stp_10.42.42.5(pid=6773): ERR: Terminated: ERROR {rc=1} [trial-2395↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6773)] 22:12:41.247733 run osmo-stp_10.42.42.5(pid=6773): stdout: | (launched: 2022-12-13_22:12:39.871417) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:41.382804 run osmo-stp_10.42.42.5(pid=6773): stderr: | 20221213221240064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221240064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221240064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221240065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221240065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221240065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221240065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:41.516528 run osmo-stp_10.42.42.5(pid=6773): stdout: | (launched: 2022-12-13_22:12:39.871417) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:41.642580 run osmo-stp_10.42.42.5(pid=6773): stderr: | 20221213221240064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221240064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221240064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221240065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221240065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221240065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221240065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:41.792930 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=6773): Process ended prematurely: osmo-stp_10.42.42.5(pid=6773) [trial-2395↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6773)] [trial-2395↪ussd:trx-sysmocell5000↪assert_extension.py:17] 22:12:41.801858 tst assert_extension.py:17: Test FAILED (6.1 sec) 22:12:41.828768 run osmo-hlr_10.42.42.2(pid=6770): ERR: Terminated: ERROR {rc=237} [trial-2395↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6770)] 22:12:41.879831 run osmo-hlr_10.42.42.2(pid=6770): stdout: | (launched: 2022-12-13_22:12:38.784060) 22:12:41.931515 run osmo-hlr_10.42.42.2(pid=6770): stderr: | 20221213221238982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221238982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221238982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221238982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221238982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221238982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221238994 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221239003 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221239003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221239003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:42.003140 run osmo-msc_10.42.42.6(pid=6776): ERR: Terminated: ERROR {rc=2} [trial-2395↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6776)] 22:12:42.052375 run osmo-msc_10.42.42.6(pid=6776): stdout: | (launched: 2022-12-13_22:12:40.879255) 22:12:42.104603 run osmo-msc_10.42.42.6(pid=6776): stderr: | 20221213221241200 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221241200 DLGLOBAL DEBUG validating counter group 0x7f06df7f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221241200 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221241200 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221241200 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221241200 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221241203 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221241204 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221241204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221241204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:12:42.156494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6769): Terminating (SIGTERM) 22:12:42.197785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6772): Terminating (SIGTERM) 22:12:42.239589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6775): Terminating (SIGTERM) 22:12:42.281377 --- ParallelTerminationStrategy: PID 6769 died... 22:12:42.301433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6769): Terminated: ok {rc=0} 22:12:42.347542 --- ParallelTerminationStrategy: PID 6772 died... 22:12:42.367028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6772): Terminated: ok {rc=0} 22:12:42.412856 --- ParallelTerminationStrategy: PID 6775 died... 22:12:42.432804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6775): Terminated: ok {rc=0} 22:12:42.519917 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:12:43.729697 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:43.736471 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:12:43.770410 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:12:43.796831 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:12:43.847876 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:12:43.881610 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:12:43.907837 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:12:44.462945 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:12:44.515740 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:44.527524 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:12:44.599936 tst mo_mt_call.py: using LAC 36569 22:12:44.727054 tst mo_mt_call.py: using RAC 104 22:12:44.851948 tst mo_mt_call.py: using CellId 36569 22:12:44.978876 tst mo_mt_call.py: using BVCI 36570 22:12:45.096466 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:45.108127 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:45.119491 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:45.131043 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:45.142849 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:45.154613 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:12:45.270230 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:12:45.390449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:45.897700 run create_hlr_db(pid=6781): Launched 22:12:46.060565 bus /sierra_2: Setting Powered False 22:12:47.138579 run create_hlr_db(pid=6781): Terminated: ok {rc=0} 22:12:47.569566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6783): Launched 22:12:47.873254 run osmo-hlr_10.42.42.2(pid=6784): Launched 22:12:47.990342 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:48.512671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6786): Launched 22:12:48.813079 run osmo-stp_10.42.42.5(pid=6787): Launched 22:12:48.927767 run osmo-msc_10.42.42.6: Starting osmo-msc 22:12:49.494051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6789): Launched 22:12:49.794773 run osmo-msc_10.42.42.6(pid=6790): Launched 22:12:49.963586 run osmo-stp_10.42.42.5(pid=6787): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6787)] 22:12:50.089989 run osmo-stp_10.42.42.5(pid=6787): stdout: | (launched: 2022-12-13_22:12:48.758888) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:50.217201 run osmo-stp_10.42.42.5(pid=6787): stderr: | 20221213221248927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221248927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221248927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221248927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221248930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221248930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221248930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:50.342741 run osmo-stp_10.42.42.5(pid=6787): stdout: | (launched: 2022-12-13_22:12:48.758888) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:50.462775 run osmo-stp_10.42.42.5(pid=6787): stderr: | 20221213221248927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221248927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221248927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221248927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221248930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221248930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221248930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:50.607292 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6787): Process ended prematurely: osmo-stp_10.42.42.5(pid=6787) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6787)] [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:12:50.616431 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:12:50.643129 run osmo-hlr_10.42.42.2(pid=6784): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6784)] 22:12:50.690714 run osmo-hlr_10.42.42.2(pid=6784): stdout: | (launched: 2022-12-13_22:12:47.818811) 22:12:50.739947 run osmo-hlr_10.42.42.2(pid=6784): stderr: | 20221213221247994 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221247994 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221247994 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221247994 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221247994 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221247994 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221248006 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221248015 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221248016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221248016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:50.808279 run osmo-msc_10.42.42.6(pid=6790): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6790)] 22:12:50.855785 run osmo-msc_10.42.42.6(pid=6790): stdout: | (launched: 2022-12-13_22:12:49.740275) 22:12:50.904675 run osmo-msc_10.42.42.6(pid=6790): stderr: | 20221213221250013 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221250013 DLGLOBAL DEBUG validating counter group 0x7fd7d51c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221250014 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221250014 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221250014 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221250014 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221250016 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221250016 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221250016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221250016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:12:50.953890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6783): Terminating (SIGTERM) 22:12:50.993367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6786): Terminating (SIGTERM) 22:12:51.033055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6789): Terminating (SIGTERM) 22:12:51.072798 --- ParallelTerminationStrategy: PID 6783 died... 22:12:51.091784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6783): Terminated: ok {rc=0} 22:12:51.135678 --- ParallelTerminationStrategy: PID 6786 died... 22:12:51.154428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6786): Terminated: ok {rc=0} 22:12:51.198197 --- ParallelTerminationStrategy: PID 6789 died... 22:12:51.216830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6789): Terminated: ok {rc=0} 22:12:51.302858 bus /sierra_3: Setting Powered False 22:12:52.400741 bus /sierra_3: Setting Powered False 22:12:53.515318 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:12:54.661665 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:54.673755 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:12:54.744490 tst mo_mt_call_osmux.py: using LAC 36570 22:12:54.862191 tst mo_mt_call_osmux.py: using RAC 105 22:12:54.986013 tst mo_mt_call_osmux.py: using CellId 36570 22:12:55.112761 tst mo_mt_call_osmux.py: using BVCI 36571 22:12:55.229971 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:55.241697 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:55.253498 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:55.264856 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:55.277438 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:12:55.289685 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:12:55.409571 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:12:55.531731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:56.033176 run create_hlr_db(pid=6792): Launched 22:12:56.156343 bus /sierra_2: Setting Powered False 22:12:57.220735 run create_hlr_db(pid=6792): Terminated: ok {rc=0} 22:12:57.671790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6794): Launched 22:12:57.995521 run osmo-hlr_10.42.42.2(pid=6795): Launched 22:12:58.122103 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:58.681043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6797): Launched 22:12:59.007201 run osmo-stp_10.42.42.5(pid=6798): Launched 22:12:59.132245 run osmo-msc_10.42.42.6: Starting osmo-msc 22:12:59.718275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6800): Launched 22:13:00.041427 run osmo-msc_10.42.42.6(pid=6801): Launched 22:13:00.223614 run osmo-stp_10.42.42.5(pid=6798): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6798)] 22:13:00.359833 run osmo-stp_10.42.42.5(pid=6798): stdout: | (launched: 2022-12-13_22:12:58.947552) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:00.497079 run osmo-stp_10.42.42.5(pid=6798): stderr: | 20221213221259138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221259138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221259139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221259139 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221259139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221259139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221259140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:00.633426 run osmo-stp_10.42.42.5(pid=6798): stdout: | (launched: 2022-12-13_22:12:58.947552) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:00.762605 run osmo-stp_10.42.42.5(pid=6798): stderr: | 20221213221259138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221259138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221259139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221259139 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221259139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221259139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221259140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:00.958492 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6798): Process ended prematurely: osmo-stp_10.42.42.5(pid=6798) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6798)] [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:13:00.968900 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:13:00.998016 run osmo-hlr_10.42.42.2(pid=6795): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6795)] 22:13:01.052125 run osmo-hlr_10.42.42.2(pid=6795): stdout: | (launched: 2022-12-13_22:12:57.936897) 22:13:01.106261 run osmo-hlr_10.42.42.2(pid=6795): stderr: | 20221213221258135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221258135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221258135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221258135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221258135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221258135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221258149 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221258158 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221258158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221258158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:01.181430 run osmo-msc_10.42.42.6(pid=6801): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6801)] 22:13:01.233762 run osmo-msc_10.42.42.6(pid=6801): stdout: | (launched: 2022-12-13_22:12:59.983246) 22:13:01.287599 run osmo-msc_10.42.42.6(pid=6801): stderr: | 20221213221300303 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221300304 DLGLOBAL DEBUG validating counter group 0x7f85b810fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221300304 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221300304 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221300304 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221300304 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221300306 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221300306 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221300306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221300306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:13:01.342294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6794): Terminating (SIGTERM) 22:13:01.385359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6797): Terminating (SIGTERM) 22:13:01.428889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6800): Terminating (SIGTERM) 22:13:01.472789 --- ParallelTerminationStrategy: PID 6794 died... 22:13:01.494530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6794): Terminated: ok {rc=0} 22:13:01.543073 --- ParallelTerminationStrategy: PID 6797 died... 22:13:01.563960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6797): Terminated: ok {rc=0} 22:13:01.612492 --- ParallelTerminationStrategy: PID 6800 died... 22:13:01.633571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6800): Terminated: ok {rc=0} 22:13:01.724821 bus /sierra_3: Setting Powered False 22:13:02.824419 bus /sierra_3: Setting Powered False 22:13:03.940036 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:13:05.194440 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:13:05.202628 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:13:05.238522 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:13:05.266024 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:13:05.319422 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:13:05.353004 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:13:05.379533 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:13:05.933396 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:13:05.981613 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:05.992831 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:13:06.063177 tst mo_mt_call.py: using LAC 36571 22:13:06.182788 tst mo_mt_call.py: using RAC 106 22:13:06.302656 tst mo_mt_call.py: using CellId 36571 22:13:06.426153 tst mo_mt_call.py: using BVCI 36572 22:13:06.536844 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:06.548232 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:06.559584 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:06.570842 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:06.582378 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:06.593725 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:13:06.713764 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:13:06.830775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:07.298142 run create_hlr_db(pid=6806): Launched 22:13:07.421271 bus /sierra_2: Setting Powered False 22:13:08.482068 run create_hlr_db(pid=6806): Terminated: ok {rc=0} 22:13:08.924544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6808): Launched 22:13:09.246717 run osmo-hlr_10.42.42.2(pid=6809): Launched 22:13:09.372031 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:09.928644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6811): Launched 22:13:10.251824 run osmo-stp_10.42.42.5(pid=6812): Launched 22:13:10.375652 run osmo-msc_10.42.42.6: Starting osmo-msc 22:13:10.966920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6814): Launched 22:13:11.291284 run osmo-msc_10.42.42.6(pid=6815): Launched 22:13:11.471808 run osmo-stp_10.42.42.5(pid=6812): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6812)] 22:13:11.608871 run osmo-stp_10.42.42.5(pid=6812): stdout: | (launched: 2022-12-13_22:13:10.192775) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:11.746024 run osmo-stp_10.42.42.5(pid=6812): stderr: | 20221213221310383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221310383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221310383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221310384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221310386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221310386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221310386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:11.881887 run osmo-stp_10.42.42.5(pid=6812): stdout: | (launched: 2022-12-13_22:13:10.192775) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:12.010888 run osmo-stp_10.42.42.5(pid=6812): stderr: | 20221213221310383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221310383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221310383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221310384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221310386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221310386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221310386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:12.165361 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6812): Process ended prematurely: osmo-stp_10.42.42.5(pid=6812) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6812)] [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:13:12.174876 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:13:12.202741 run osmo-hlr_10.42.42.2(pid=6809): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6809)] 22:13:12.254473 run osmo-hlr_10.42.42.2(pid=6809): stdout: | (launched: 2022-12-13_22:13:09.188432) 22:13:12.306438 run osmo-hlr_10.42.42.2(pid=6809): stderr: | 20221213221309386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221309386 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221309386 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221309386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221309386 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221309386 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221309414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221309423 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221309423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221309423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:12.378780 run osmo-msc_10.42.42.6(pid=6815): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6815)] 22:13:12.428820 run osmo-msc_10.42.42.6(pid=6815): stdout: | (launched: 2022-12-13_22:13:11.232401) 22:13:12.480627 run osmo-msc_10.42.42.6(pid=6815): stderr: | 20221213221311553 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221311553 DLGLOBAL DEBUG validating counter group 0x7f29e50edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221311553 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221311553 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221311553 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221311553 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221311555 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221311556 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221311556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221311556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:13:12.533977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6808): Terminating (SIGTERM) 22:13:12.575410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6811): Terminating (SIGTERM) 22:13:12.618181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6814): Terminating (SIGTERM) 22:13:12.660178 --- ParallelTerminationStrategy: PID 6808 died... 22:13:12.680511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6808): Terminated: ok {rc=0} 22:13:12.727255 --- ParallelTerminationStrategy: PID 6811 died... 22:13:12.746943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6811): Terminated: ok {rc=0} 22:13:12.793367 --- ParallelTerminationStrategy: PID 6814 died... 22:13:12.813316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6814): Terminated: ok {rc=0} 22:13:12.901786 bus /sierra_3: Setting Powered False 22:13:14.000755 bus /sierra_3: Setting Powered False 22:13:15.117763 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:13:16.266508 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:16.279821 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:13:16.355077 tst mo_mt_call_osmux.py: using LAC 36572 22:13:16.483707 tst mo_mt_call_osmux.py: using RAC 107 22:13:16.640844 tst mo_mt_call_osmux.py: using CellId 36572 22:13:16.808421 tst mo_mt_call_osmux.py: using BVCI 36573 22:13:16.974376 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:16.987006 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:16.999591 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:17.013172 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:17.026781 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:13:17.039906 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:13:17.165651 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:13:17.285455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:17.752298 run create_hlr_db(pid=6818): Launched 22:13:17.875652 bus /sierra_2: Setting Powered False 22:13:18.935517 run create_hlr_db(pid=6818): Terminated: ok {rc=0} 22:13:19.377215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6820): Launched 22:13:19.701740 run osmo-hlr_10.42.42.2(pid=6821): Launched 22:13:19.825275 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:20.386867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6823): Launched 22:13:20.710727 run osmo-stp_10.42.42.5(pid=6824): Launched 22:13:20.834399 run osmo-msc_10.42.42.6: Starting osmo-msc 22:13:21.421312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6826): Launched 22:13:21.745617 run osmo-msc_10.42.42.6(pid=6827): Launched 22:13:21.926004 run osmo-stp_10.42.42.5(pid=6824): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6824)] 22:13:22.062004 run osmo-stp_10.42.42.5(pid=6824): stdout: | (launched: 2022-12-13_22:13:20.651723) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:22.198715 run osmo-stp_10.42.42.5(pid=6824): stderr: | 20221213221320845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221320845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221320845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221320846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221320846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221320846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221320846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:22.334574 run osmo-stp_10.42.42.5(pid=6824): stdout: | (launched: 2022-12-13_22:13:20.651723) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:22.463422 run osmo-stp_10.42.42.5(pid=6824): stderr: | 20221213221320845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221320845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221320845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221320846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221320846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221320846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221320846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:22.617660 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6824): Process ended prematurely: osmo-stp_10.42.42.5(pid=6824) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6824)] [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:13:22.627408 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:13:22.654823 run osmo-hlr_10.42.42.2(pid=6821): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6821)] 22:13:22.704860 run osmo-hlr_10.42.42.2(pid=6821): stdout: | (launched: 2022-12-13_22:13:19.643093) 22:13:22.756479 run osmo-hlr_10.42.42.2(pid=6821): stderr: | 20221213221319843 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221319843 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221319843 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221319843 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221319843 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221319843 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221319856 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221319866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221319866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221319866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:22.828168 run osmo-msc_10.42.42.6(pid=6827): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6827)] 22:13:22.877488 run osmo-msc_10.42.42.6(pid=6827): stdout: | (launched: 2022-12-13_22:13:21.687319) 22:13:22.928871 run osmo-msc_10.42.42.6(pid=6827): stderr: | 20221213221322013 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221322013 DLGLOBAL DEBUG validating counter group 0x7f9268d34c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221322013 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221322013 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221322013 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221322014 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221322015 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221322016 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221322016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221322016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:13:22.980580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6820): Terminating (SIGTERM) 22:13:23.021779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6823): Terminating (SIGTERM) 22:13:23.063453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6826): Terminating (SIGTERM) 22:13:23.105134 --- ParallelTerminationStrategy: PID 6820 died... 22:13:23.125304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6820): Terminated: ok {rc=0} 22:13:23.171259 --- ParallelTerminationStrategy: PID 6823 died... 22:13:23.190897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6823): Terminated: ok {rc=0} 22:13:23.236527 --- ParallelTerminationStrategy: PID 6826 died... 22:13:23.256144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6826): Terminated: ok {rc=0} 22:13:23.344605 bus /sierra_3: Setting Powered False 22:13:24.443166 bus /sierra_3: Setting Powered False 22:13:25.560868 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:13:26.812249 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:13:26.818614 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:13:26.851752 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:13:26.878236 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:13:26.931194 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:13:26.965526 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:13:26.991892 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:13:27.542925 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:13:27.591313 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:27.602693 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:13:27.673333 tst mo_mt_call.py: using LAC 36573 22:13:27.793105 tst mo_mt_call.py: using RAC 108 22:13:27.910806 tst mo_mt_call.py: using CellId 36573 22:13:28.031130 tst mo_mt_call.py: using BVCI 36574 22:13:28.141676 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:28.152920 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:28.164081 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:28.175217 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:28.186256 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:28.197420 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:13:28.313443 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:13:28.433172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:28.936833 run create_hlr_db(pid=6832): Launched 22:13:29.062428 bus /sierra_2: Setting Powered False 22:13:30.126247 run create_hlr_db(pid=6832): Terminated: ok {rc=0} 22:13:30.558732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6834): Launched 22:13:30.862032 run osmo-hlr_10.42.42.2(pid=6835): Launched 22:13:31.124057 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:31.804817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6837): Launched 22:13:32.148110 run osmo-stp_10.42.42.5(pid=6838): Launched 22:13:32.358757 run osmo-msc_10.42.42.6: Starting osmo-msc 22:13:32.946811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6840): Launched 22:13:33.270153 run osmo-msc_10.42.42.6(pid=6841): Launched 22:13:33.450791 run osmo-stp_10.42.42.5(pid=6838): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6838)] 22:13:33.587308 run osmo-stp_10.42.42.5(pid=6838): stdout: | (launched: 2022-12-13_22:13:32.087792) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:33.723933 run osmo-stp_10.42.42.5(pid=6838): stderr: | 20221213221332381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221332381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221332381 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221332382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221332385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221332385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221332385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:33.859429 run osmo-stp_10.42.42.5(pid=6838): stdout: | (launched: 2022-12-13_22:13:32.087792) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:33.988509 run osmo-stp_10.42.42.5(pid=6838): stderr: | 20221213221332381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221332381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221332381 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221332382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221332385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221332385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221332385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:34.143197 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6838): Process ended prematurely: osmo-stp_10.42.42.5(pid=6838) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6838)] [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:13:34.152684 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 22:13:34.180273 run osmo-hlr_10.42.42.2(pid=6835): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6835)] 22:13:34.230384 run osmo-hlr_10.42.42.2(pid=6835): stdout: | (launched: 2022-12-13_22:13:30.804790) 22:13:34.282189 run osmo-hlr_10.42.42.2(pid=6835): stderr: | 20221213221331153 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221331153 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221331153 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221331153 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221331153 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221331153 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221331180 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221331199 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221331199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221331200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:34.353989 run osmo-msc_10.42.42.6(pid=6841): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6841)] 22:13:34.403683 run osmo-msc_10.42.42.6(pid=6841): stdout: | (launched: 2022-12-13_22:13:33.211802) 22:13:34.455547 run osmo-msc_10.42.42.6(pid=6841): stderr: | 20221213221333532 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221333533 DLGLOBAL DEBUG validating counter group 0x7fc6c23e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221333533 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221333533 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221333533 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221333533 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221333535 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221333535 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221333535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221333535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:13:34.507630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6834): Terminating (SIGTERM) 22:13:34.549134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6837): Terminating (SIGTERM) 22:13:34.590889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6840): Terminating (SIGTERM) 22:13:34.632904 --- ParallelTerminationStrategy: PID 6834 died... 22:13:34.653192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6834): Terminated: ok {rc=0} 22:13:34.699205 --- ParallelTerminationStrategy: PID 6837 died... 22:13:34.718961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6837): Terminated: ok {rc=0} 22:13:34.764720 --- ParallelTerminationStrategy: PID 6840 died... 22:13:34.784420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6840): Terminated: ok {rc=0} 22:13:34.872909 bus /sierra_3: Setting Powered False 22:13:35.971380 bus /sierra_3: Setting Powered False 22:13:37.088918 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:13:38.238072 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:38.250530 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:13:38.328856 tst mo_mt_call_osmux.py: using LAC 36574 22:13:38.454409 tst mo_mt_call_osmux.py: using RAC 109 22:13:38.580326 tst mo_mt_call_osmux.py: using CellId 36574 22:13:38.699683 tst mo_mt_call_osmux.py: using BVCI 36575 22:13:38.809632 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:38.820904 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:38.832221 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:38.843425 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:38.854877 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:13:38.866221 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:13:38.986471 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:13:39.109264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:39.612611 run create_hlr_db(pid=6843): Launched 22:13:39.736713 bus /sierra_2: Setting Powered False 22:13:40.800860 run create_hlr_db(pid=6843): Terminated: ok {rc=0} 22:13:41.236347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6845): Launched 22:13:41.539324 run osmo-hlr_10.42.42.2(pid=6846): Launched 22:13:41.656364 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:42.180003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6848): Launched 22:13:42.484349 run osmo-stp_10.42.42.5(pid=6849): Launched 22:13:42.600095 run osmo-msc_10.42.42.6: Starting osmo-msc 22:13:43.149836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6851): Launched 22:13:43.452353 run osmo-msc_10.42.42.6(pid=6852): Launched 22:13:43.621825 run osmo-stp_10.42.42.5(pid=6849): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6849)] 22:13:43.749991 run osmo-stp_10.42.42.5(pid=6849): stdout: | (launched: 2022-12-13_22:13:42.429636) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:43.878144 run osmo-stp_10.42.42.5(pid=6849): stderr: | 20221213221342602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221342603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221342603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221342603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221342605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221342605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221342605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:44.004444 run osmo-stp_10.42.42.5(pid=6849): stdout: | (launched: 2022-12-13_22:13:42.429636) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:44.127059 run osmo-stp_10.42.42.5(pid=6849): stderr: | 20221213221342602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221342603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221342603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221342603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221342605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221342605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221342605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:44.271476 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6849): Process ended prematurely: osmo-stp_10.42.42.5(pid=6849) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6849)] [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:13:44.280655 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:13:44.307185 run osmo-hlr_10.42.42.2(pid=6846): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6846)] 22:13:44.354718 run osmo-hlr_10.42.42.2(pid=6846): stdout: | (launched: 2022-12-13_22:13:41.484463) 22:13:44.403951 run osmo-hlr_10.42.42.2(pid=6846): stderr: | 20221213221341662 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221341662 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221341662 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221341662 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221341662 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221341662 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221341675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221341685 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221341685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221341685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:44.472491 run osmo-msc_10.42.42.6(pid=6852): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6852)] 22:13:44.519329 run osmo-msc_10.42.42.6(pid=6852): stdout: | (launched: 2022-12-13_22:13:43.397195) 22:13:44.567890 run osmo-msc_10.42.42.6(pid=6852): stderr: | 20221213221343671 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221343672 DLGLOBAL DEBUG validating counter group 0x7f2090187c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221343672 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221343672 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221343672 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221343672 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221343674 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221343674 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221343674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221343674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:13:44.616997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6845): Terminating (SIGTERM) 22:13:44.656263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6848): Terminating (SIGTERM) 22:13:44.695623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6851): Terminating (SIGTERM) 22:13:44.735316 --- ParallelTerminationStrategy: PID 6845 died... 22:13:44.754555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6845): Terminated: ok {rc=0} 22:13:44.798349 --- ParallelTerminationStrategy: PID 6848 died... 22:13:44.817144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6848): Terminated: ok {rc=0} 22:13:44.860532 --- ParallelTerminationStrategy: PID 6851 died... 22:13:44.879309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6851): Terminated: ok {rc=0} 22:13:44.966446 bus /sierra_3: Setting Powered False 22:13:46.064591 bus /sierra_3: Setting Powered False 22:13:47.190260 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:13:48.448508 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:13:48.455054 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:13:48.488315 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:13:48.515750 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:13:48.567264 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:13:48.601304 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:13:48.627831 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:13:49.189458 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:13:49.240230 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:49.251630 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:13:49.325201 tst mo_mt_call.py: using LAC 36575 22:13:49.443565 tst mo_mt_call.py: using RAC 110 22:13:49.571538 tst mo_mt_call.py: using CellId 36575 22:13:49.696544 tst mo_mt_call.py: using BVCI 36576 22:13:49.813436 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:49.824884 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:49.836403 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:49.847814 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:49.859627 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:49.871349 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:13:49.989146 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:13:50.106984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:50.575636 run create_hlr_db(pid=6857): Launched 22:13:50.700249 bus /sierra_2: Setting Powered False 22:13:51.761199 run create_hlr_db(pid=6857): Terminated: ok {rc=0} 22:13:52.202952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6859): Launched 22:13:52.527948 run osmo-hlr_10.42.42.2(pid=6860): Launched 22:13:52.652934 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:53.213228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6862): Launched 22:13:53.536116 run osmo-stp_10.42.42.5(pid=6863): Launched 22:13:53.660236 run osmo-msc_10.42.42.6: Starting osmo-msc 22:13:54.246240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6865): Launched 22:13:54.570853 run osmo-msc_10.42.42.6(pid=6866): Launched 22:13:54.751289 run osmo-stp_10.42.42.5(pid=6863): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6863)] 22:13:54.887499 run osmo-stp_10.42.42.5(pid=6863): stdout: | (launched: 2022-12-13_22:13:53.477624) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:55.024450 run osmo-stp_10.42.42.5(pid=6863): stderr: | 20221213221353670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221353670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221353670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221353671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221353671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221353671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221353671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:55.161327 run osmo-stp_10.42.42.5(pid=6863): stdout: | (launched: 2022-12-13_22:13:53.477624) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:55.290482 run osmo-stp_10.42.42.5(pid=6863): stderr: | 20221213221353670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221353670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221353670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221353671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221353671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221353671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221353671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:55.445161 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6863): Process ended prematurely: osmo-stp_10.42.42.5(pid=6863) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6863)] [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:13:55.454809 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:13:55.482476 run osmo-hlr_10.42.42.2(pid=6860): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6860)] 22:13:55.533599 run osmo-hlr_10.42.42.2(pid=6860): stdout: | (launched: 2022-12-13_22:13:52.468882) 22:13:55.585374 run osmo-hlr_10.42.42.2(pid=6860): stderr: | 20221213221352666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221352666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221352666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221352666 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221352666 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221352666 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221352678 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221352686 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221352687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221352687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:55.657705 run osmo-msc_10.42.42.6(pid=6866): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6866)] 22:13:55.707469 run osmo-msc_10.42.42.6(pid=6866): stdout: | (launched: 2022-12-13_22:13:54.512190) 22:13:55.759053 run osmo-msc_10.42.42.6(pid=6866): stderr: | 20221213221354835 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221354835 DLGLOBAL DEBUG validating counter group 0x7f28cab73c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221354835 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221354835 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221354835 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221354835 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221354837 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221354838 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221354838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221354838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:13:55.810783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6859): Terminating (SIGTERM) 22:13:55.852446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6862): Terminating (SIGTERM) 22:13:55.894171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6865): Terminating (SIGTERM) 22:13:55.936683 --- ParallelTerminationStrategy: PID 6859 died... 22:13:55.956897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6859): Terminated: ok {rc=0} 22:13:56.003077 --- ParallelTerminationStrategy: PID 6862 died... 22:13:56.022813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6862): Terminated: ok {rc=0} 22:13:56.068493 --- ParallelTerminationStrategy: PID 6865 died... 22:13:56.088279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6865): Terminated: ok {rc=0} 22:13:56.177526 bus /sierra_3: Setting Powered False 22:13:57.275916 bus /sierra_3: Setting Powered False 22:13:58.393904 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:13:59.540256 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:13:59.552101 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:13:59.622389 tst mo_mt_call_osmux.py: using LAC 36576 22:13:59.741114 tst mo_mt_call_osmux.py: using RAC 111 22:13:59.859350 tst mo_mt_call_osmux.py: using CellId 36576 22:13:59.979284 tst mo_mt_call_osmux.py: using BVCI 36577 22:14:00.087788 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:14:00.099026 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:14:00.110087 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:14:00.121140 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:14:00.132202 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:14:00.143205 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:14:00.258589 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:14:00.378409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:00.881738 run create_hlr_db(pid=6868): Launched 22:14:01.051892 bus /sierra_2: Setting Powered False 22:14:02.129805 run create_hlr_db(pid=6868): Terminated: ok {rc=0} 22:14:02.567309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6870): Launched 22:14:02.869700 run osmo-hlr_10.42.42.2(pid=6871): Launched 22:14:02.986019 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:03.507134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6873): Launched 22:14:03.810235 run osmo-stp_10.42.42.5(pid=6874): Launched 22:14:03.926325 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:04.474893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6876): Launched 22:14:04.777097 run osmo-msc_10.42.42.6(pid=6877): Launched 22:14:04.945928 run osmo-stp_10.42.42.5(pid=6874): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6874)] 22:14:05.074024 run osmo-stp_10.42.42.5(pid=6874): stdout: | (launched: 2022-12-13_22:14:03.754043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:05.201821 run osmo-stp_10.42.42.5(pid=6874): stderr: | 20221213221403923 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221403923 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221403923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221403924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221403926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221403926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221403926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:05.327805 run osmo-stp_10.42.42.5(pid=6874): stdout: | (launched: 2022-12-13_22:14:03.754043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:05.447642 run osmo-stp_10.42.42.5(pid=6874): stderr: | 20221213221403923 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221403923 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221403923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221403924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221403926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221403926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221403926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:05.591756 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6874): Process ended prematurely: osmo-stp_10.42.42.5(pid=6874) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6874)] [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:14:05.600690 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:14:05.626974 run osmo-hlr_10.42.42.2(pid=6871): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6871)] 22:14:05.673852 run osmo-hlr_10.42.42.2(pid=6871): stdout: | (launched: 2022-12-13_22:14:02.814400) 22:14:05.722570 run osmo-hlr_10.42.42.2(pid=6871): stderr: | 20221213221402989 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221402989 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221402989 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221402989 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221402989 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221402989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221403001 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221403012 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221403013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221403013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:05.790516 run osmo-msc_10.42.42.6(pid=6877): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6877)] 22:14:05.837357 run osmo-msc_10.42.42.6(pid=6877): stdout: | (launched: 2022-12-13_22:14:04.722205) 22:14:05.885859 run osmo-msc_10.42.42.6(pid=6877): stderr: | 20221213221404992 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221404992 DLGLOBAL DEBUG validating counter group 0x7fc13e7f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221404992 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221404993 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221404993 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221404993 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221404995 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221404995 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221404995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221404995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:05.934794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6870): Terminating (SIGTERM) 22:14:05.973779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6873): Terminating (SIGTERM) 22:14:06.012879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6876): Terminating (SIGTERM) 22:14:06.052072 --- ParallelTerminationStrategy: PID 6870 died... 22:14:06.070942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6870): Terminated: ok {rc=0} 22:14:06.114201 --- ParallelTerminationStrategy: PID 6873 died... 22:14:06.132529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6873): Terminated: ok {rc=0} 22:14:06.175599 --- ParallelTerminationStrategy: PID 6876 died... 22:14:06.193890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6876): Terminated: ok {rc=0} 22:14:06.276398 bus /sierra_3: Setting Powered False 22:14:07.374372 bus /sierra_3: Setting Powered False 22:14:08.490034 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:14:09.746989 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:14:09.754178 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:14:09.789565 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:14:09.817540 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:14:09.871659 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:14:09.907224 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:14:09.934950 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:14:10.486830 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:14:10.540450 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:10.552335 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:14:10.626111 tst mo_mt_call.py: using LAC 36577 22:14:10.754516 tst mo_mt_call.py: using RAC 112 22:14:10.883135 tst mo_mt_call.py: using CellId 36577 22:14:11.009641 tst mo_mt_call.py: using BVCI 36578 22:14:11.119284 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:11.130507 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:11.141566 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:11.152548 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:11.163695 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:11.174681 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:14:11.290646 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:14:11.410800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:11.881338 run create_hlr_db(pid=6882): Launched 22:14:12.037643 bus /sierra_2: Setting Powered False 22:14:13.098554 run create_hlr_db(pid=6882): Terminated: ok {rc=0} 22:14:13.542554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6884): Launched 22:14:13.867488 run osmo-hlr_10.42.42.2(pid=6885): Launched 22:14:13.992219 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:14.554282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6887): Launched 22:14:14.877857 run osmo-stp_10.42.42.5(pid=6888): Launched 22:14:15.003246 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:15.593842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6890): Launched 22:14:15.954996 run osmo-msc_10.42.42.6(pid=6891): Launched 22:14:16.329942 run osmo-stp_10.42.42.5(pid=6888): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6888)] 22:14:16.593145 run osmo-stp_10.42.42.5(pid=6888): stdout: | (launched: 2022-12-13_22:14:14.819728) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:16.740053 run osmo-stp_10.42.42.5(pid=6888): stderr: | 20221213221415013 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221415013 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221415014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221415014 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221415014 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221415014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221415015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:16.879831 run osmo-stp_10.42.42.5(pid=6888): stdout: | (launched: 2022-12-13_22:14:14.819728) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:17.014661 run osmo-stp_10.42.42.5(pid=6888): stderr: | 20221213221415013 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221415013 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221415014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221415014 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221415014 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221415014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221415015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:17.175887 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6888): Process ended prematurely: osmo-stp_10.42.42.5(pid=6888) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6888)] [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:14:17.185970 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 22:14:17.214226 run osmo-hlr_10.42.42.2(pid=6885): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6885)] 22:14:17.266222 run osmo-hlr_10.42.42.2(pid=6885): stdout: | (launched: 2022-12-13_22:14:13.808683) 22:14:17.318591 run osmo-hlr_10.42.42.2(pid=6885): stderr: | 20221213221414008 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221414008 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221414008 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221414008 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221414008 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221414008 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221414020 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221414028 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221414029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221414029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:17.391080 run osmo-msc_10.42.42.6(pid=6891): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6891)] 22:14:17.442230 run osmo-msc_10.42.42.6(pid=6891): stdout: | (launched: 2022-12-13_22:14:15.891869) 22:14:17.493900 run osmo-msc_10.42.42.6(pid=6891): stderr: | 20221213221416301 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221416301 DLGLOBAL DEBUG validating counter group 0x7fe7af447c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221416301 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221416301 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221416302 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221416302 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221416303 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221416304 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221416304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221416304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:17.546706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6884): Terminating (SIGTERM) 22:14:17.588566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6887): Terminating (SIGTERM) 22:14:17.630541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6890): Terminating (SIGTERM) 22:14:17.673009 --- ParallelTerminationStrategy: PID 6884 died... 22:14:17.693155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6884): Terminated: ok {rc=0} 22:14:17.739648 --- ParallelTerminationStrategy: PID 6887 died... 22:14:17.759674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6887): Terminated: ok {rc=0} 22:14:17.806073 --- ParallelTerminationStrategy: PID 6890 died... 22:14:17.826098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6890): Terminated: ok {rc=0} 22:14:17.914695 bus /sierra_3: Setting Powered False 22:14:19.013508 bus /sierra_3: Setting Powered False 22:14:20.131636 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:14:21.278473 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:21.290397 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:14:21.363926 tst mo_mt_call_osmux.py: using LAC 36578 22:14:21.481171 tst mo_mt_call_osmux.py: using RAC 113 22:14:21.598130 tst mo_mt_call_osmux.py: using CellId 36578 22:14:21.716675 tst mo_mt_call_osmux.py: using BVCI 36579 22:14:21.825661 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:21.836764 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:21.847865 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:21.858817 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:21.869973 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:14:21.880854 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:14:22.000602 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:14:22.121396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:22.625746 run create_hlr_db(pid=6893): Launched 22:14:22.751594 bus /sierra_2: Setting Powered False 22:14:23.816711 run create_hlr_db(pid=6893): Terminated: ok {rc=0} 22:14:24.268729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6895): Launched 22:14:24.595583 run osmo-hlr_10.42.42.2(pid=6896): Launched 22:14:24.720450 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:25.281989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6898): Launched 22:14:25.608230 run osmo-stp_10.42.42.5(pid=6899): Launched 22:14:25.732918 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:26.321436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6901): Launched 22:14:26.646584 run osmo-msc_10.42.42.6(pid=6902): Launched 22:14:26.828491 run osmo-stp_10.42.42.5(pid=6899): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6899)] 22:14:26.965833 run osmo-stp_10.42.42.5(pid=6899): stdout: | (launched: 2022-12-13_22:14:25.549318) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:27.103822 run osmo-stp_10.42.42.5(pid=6899): stderr: | 20221213221425744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221425744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221425744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221425745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221425745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221425745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221425745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:27.241054 run osmo-stp_10.42.42.5(pid=6899): stdout: | (launched: 2022-12-13_22:14:25.549318) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:27.371163 run osmo-stp_10.42.42.5(pid=6899): stderr: | 20221213221425744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221425744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221425744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221425745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221425745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221425745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221425745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:27.527322 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6899): Process ended prematurely: osmo-stp_10.42.42.5(pid=6899) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6899)] [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:14:27.537193 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:14:27.564939 run osmo-hlr_10.42.42.2(pid=6896): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6896)] 22:14:27.615714 run osmo-hlr_10.42.42.2(pid=6896): stdout: | (launched: 2022-12-13_22:14:24.536309) 22:14:27.667574 run osmo-hlr_10.42.42.2(pid=6896): stderr: | 20221213221424734 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221424734 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221424734 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221424734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221424734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221424734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221424749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221424758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221424758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221424758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:27.739916 run osmo-msc_10.42.42.6(pid=6902): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6902)] 22:14:27.789511 run osmo-msc_10.42.42.6(pid=6902): stdout: | (launched: 2022-12-13_22:14:26.587943) 22:14:27.841415 run osmo-msc_10.42.42.6(pid=6902): stderr: | 20221213221426910 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221426910 DLGLOBAL DEBUG validating counter group 0x7f8cefb2bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221426910 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221426910 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221426910 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221426910 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221426913 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221426913 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221426913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221426913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:27.893642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6895): Terminating (SIGTERM) 22:14:27.935055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6898): Terminating (SIGTERM) 22:14:27.977410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6901): Terminating (SIGTERM) 22:14:28.019549 --- ParallelTerminationStrategy: PID 6895 died... 22:14:28.039847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6895): Terminated: ok {rc=0} 22:14:28.086259 --- ParallelTerminationStrategy: PID 6898 died... 22:14:28.106047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6898): Terminated: ok {rc=0} 22:14:28.152189 --- ParallelTerminationStrategy: PID 6901 died... 22:14:28.171914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6901): Terminated: ok {rc=0} 22:14:28.260013 bus /sierra_3: Setting Powered False 22:14:29.359221 bus /sierra_3: Setting Powered False 22:14:30.476933 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:14:31.736885 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:14:31.748428 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:14:31.797159 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:14:31.833005 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:14:31.903642 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:14:31.951245 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:14:31.987767 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:14:32.514847 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:14:32.567618 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:32.579470 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:14:32.652053 tst mo_mt_call.py: using LAC 36579 22:14:32.779301 tst mo_mt_call.py: using RAC 114 22:14:32.906612 tst mo_mt_call.py: using CellId 36579 22:14:33.034197 tst mo_mt_call.py: using BVCI 36580 22:14:33.153104 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:33.164717 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:33.176345 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:33.187901 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:33.199804 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:33.211588 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:14:33.327791 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:14:33.448709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:33.951658 run create_hlr_db(pid=6908): Launched 22:14:34.075503 bus /sierra_2: Setting Powered False 22:14:35.140073 run create_hlr_db(pid=6908): Terminated: ok {rc=0} 22:14:35.592324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6910): Launched 22:14:35.915259 run osmo-hlr_10.42.42.2(pid=6911): Launched 22:14:36.040373 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:36.601190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6913): Launched 22:14:36.925522 run osmo-stp_10.42.42.5(pid=6914): Launched 22:14:37.050809 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:37.636554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6916): Launched 22:14:37.961074 run osmo-msc_10.42.42.6(pid=6917): Launched 22:14:38.143667 run osmo-stp_10.42.42.5(pid=6914): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6914)] 22:14:38.280544 run osmo-stp_10.42.42.5(pid=6914): stdout: | (launched: 2022-12-13_22:14:36.867242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:38.418226 run osmo-stp_10.42.42.5(pid=6914): stderr: | 20221213221437058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221437059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221437059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221437059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221437062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221437062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221437062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:38.555349 run osmo-stp_10.42.42.5(pid=6914): stdout: | (launched: 2022-12-13_22:14:36.867242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:38.684755 run osmo-stp_10.42.42.5(pid=6914): stderr: | 20221213221437058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221437059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221437059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221437059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221437062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221437062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221437062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:38.839928 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6914): Process ended prematurely: osmo-stp_10.42.42.5(pid=6914) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6914)] [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:14:38.849693 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:14:38.877197 run osmo-hlr_10.42.42.2(pid=6911): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6911)] 22:14:38.927476 run osmo-hlr_10.42.42.2(pid=6911): stdout: | (launched: 2022-12-13_22:14:35.856906) 22:14:38.979034 run osmo-hlr_10.42.42.2(pid=6911): stderr: | 20221213221436054 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221436054 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221436054 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221436054 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221436054 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221436054 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221436069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221436079 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221436079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221436079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:39.051336 run osmo-msc_10.42.42.6(pid=6917): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6917)] 22:14:39.100894 run osmo-msc_10.42.42.6(pid=6917): stdout: | (launched: 2022-12-13_22:14:37.902585) 22:14:39.152421 run osmo-msc_10.42.42.6(pid=6917): stderr: | 20221213221438225 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221438225 DLGLOBAL DEBUG validating counter group 0x7ffa27868c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221438226 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221438226 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221438226 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221438226 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221438228 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221438228 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221438228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221438228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:39.204576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6910): Terminating (SIGTERM) 22:14:39.245967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6913): Terminating (SIGTERM) 22:14:39.287935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6916): Terminating (SIGTERM) 22:14:39.329577 --- ParallelTerminationStrategy: PID 6910 died... 22:14:39.349623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6910): Terminated: ok {rc=0} 22:14:39.395796 --- ParallelTerminationStrategy: PID 6913 died... 22:14:39.415382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6913): Terminated: ok {rc=0} 22:14:39.461142 --- ParallelTerminationStrategy: PID 6916 died... 22:14:39.480657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6916): Terminated: ok {rc=0} 22:14:39.568445 bus /sierra_3: Setting Powered False 22:14:40.667045 bus /sierra_3: Setting Powered False 22:14:41.782669 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:14:42.928070 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:42.939961 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:14:43.013617 tst mo_mt_call_osmux.py: using LAC 36580 22:14:43.131783 tst mo_mt_call_osmux.py: using RAC 115 22:14:43.247988 tst mo_mt_call_osmux.py: using CellId 36580 22:14:43.368180 tst mo_mt_call_osmux.py: using BVCI 36581 22:14:43.478537 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:43.489952 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:43.501396 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:43.512564 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:43.523995 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:14:43.535017 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:14:43.651342 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:14:43.771369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:44.274800 run create_hlr_db(pid=6919): Launched 22:14:44.399554 bus /sierra_2: Setting Powered False 22:14:45.459713 run create_hlr_db(pid=6919): Terminated: ok {rc=0} 22:14:45.916648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6921): Launched 22:14:46.245253 run osmo-hlr_10.42.42.2(pid=6922): Launched 22:14:46.404516 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:46.999791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6924): Launched 22:14:47.337682 run osmo-stp_10.42.42.5(pid=6925): Launched 22:14:47.499897 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:48.053365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6927): Launched 22:14:48.355760 run osmo-msc_10.42.42.6(pid=6928): Launched 22:14:48.524666 run osmo-stp_10.42.42.5(pid=6925): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6925)] 22:14:48.652476 run osmo-stp_10.42.42.5(pid=6925): stdout: | (launched: 2022-12-13_22:14:47.279270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:48.779857 run osmo-stp_10.42.42.5(pid=6925): stderr: | 20221213221447528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221447528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221447528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221447529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221447529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221447529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221447529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:48.905647 run osmo-stp_10.42.42.5(pid=6925): stdout: | (launched: 2022-12-13_22:14:47.279270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:49.026101 run osmo-stp_10.42.42.5(pid=6925): stderr: | 20221213221447528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221447528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221447528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221447529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221447529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221447529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221447529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:49.170467 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6925): Process ended prematurely: osmo-stp_10.42.42.5(pid=6925) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6925)] [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:14:49.179359 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:14:49.205534 run osmo-hlr_10.42.42.2(pid=6922): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6922)] 22:14:49.252784 run osmo-hlr_10.42.42.2(pid=6922): stdout: | (launched: 2022-12-13_22:14:46.185113) 22:14:49.301423 run osmo-hlr_10.42.42.2(pid=6922): stderr: | 20221213221446567 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221446567 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221446567 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221446567 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221446567 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221446567 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221446591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221446601 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221446606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221446607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:49.368840 run osmo-msc_10.42.42.6(pid=6928): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6928)] 22:14:49.415699 run osmo-msc_10.42.42.6(pid=6928): stdout: | (launched: 2022-12-13_22:14:48.300549) 22:14:49.464013 run osmo-msc_10.42.42.6(pid=6928): stderr: | 20221213221448574 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221448574 DLGLOBAL DEBUG validating counter group 0x7fc432f06c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221448574 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221448574 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221448574 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221448574 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221448576 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221448576 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221448577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221448577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:14:49.512748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6921): Terminating (SIGTERM) 22:14:49.552052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6924): Terminating (SIGTERM) 22:14:49.591322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6927): Terminating (SIGTERM) 22:14:49.630486 --- ParallelTerminationStrategy: PID 6921 died... 22:14:49.649542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6921): Terminated: ok {rc=0} 22:14:49.692676 --- ParallelTerminationStrategy: PID 6924 died... 22:14:49.711001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6924): Terminated: ok {rc=0} 22:14:49.754151 --- ParallelTerminationStrategy: PID 6927 died... 22:14:49.772691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6927): Terminated: ok {rc=0} 22:14:49.857921 bus /sierra_3: Setting Powered False 22:14:50.956246 bus /sierra_3: Setting Powered False 22:14:52.067940 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:14:53.326142 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:14:53.332910 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:14:53.366151 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:14:53.392720 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:14:53.443683 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:14:53.477590 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:14:53.504455 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:14:54.057718 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:14:54.110570 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:54.122213 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:14:54.197343 tst mo_mt_call.py: using LAC 36581 22:14:54.328913 tst mo_mt_call.py: using RAC 116 22:14:54.454277 tst mo_mt_call.py: using CellId 36581 22:14:54.579116 tst mo_mt_call.py: using BVCI 36582 22:14:54.690460 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:54.701941 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:54.712894 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:54.723807 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:54.734989 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:14:54.745996 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:14:54.865698 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:14:54.986421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:55.489184 run create_hlr_db(pid=6933): Launched 22:14:55.615512 bus /sierra_2: Setting Powered False 22:14:56.679834 run create_hlr_db(pid=6933): Terminated: ok {rc=0} 22:14:57.112621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6935): Launched 22:14:57.415869 run osmo-hlr_10.42.42.2(pid=6936): Launched 22:14:57.532593 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:58.056606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6938): Launched 22:14:58.359265 run osmo-stp_10.42.42.5(pid=6939): Launched 22:14:58.475132 run osmo-msc_10.42.42.6: Starting osmo-msc 22:14:59.024335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6941): Launched 22:14:59.328240 run osmo-msc_10.42.42.6(pid=6942): Launched 22:14:59.499211 run osmo-stp_10.42.42.5(pid=6939): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6939)] 22:14:59.628586 run osmo-stp_10.42.42.5(pid=6939): stdout: | (launched: 2022-12-13_22:14:58.304056) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:59.757819 run osmo-stp_10.42.42.5(pid=6939): stderr: | 20221213221458476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221458476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221458476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221458477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221458477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221458477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221458477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:59.883938 run osmo-stp_10.42.42.5(pid=6939): stdout: | (launched: 2022-12-13_22:14:58.304056) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:00.004591 run osmo-stp_10.42.42.5(pid=6939): stderr: | 20221213221458476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221458476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221458476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221458477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221458477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221458477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221458477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:00.149341 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6939): Process ended prematurely: osmo-stp_10.42.42.5(pid=6939) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6939)] [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:15:00.158239 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:15:00.184444 run osmo-hlr_10.42.42.2(pid=6936): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6936)] 22:15:00.231551 run osmo-hlr_10.42.42.2(pid=6936): stdout: | (launched: 2022-12-13_22:14:57.360570) 22:15:00.280296 run osmo-hlr_10.42.42.2(pid=6936): stderr: | 20221213221457536 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221457536 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221457536 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221457536 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221457536 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221457536 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221457548 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221457557 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221457558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221457558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:00.348198 run osmo-msc_10.42.42.6(pid=6942): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6942)] 22:15:00.395196 run osmo-msc_10.42.42.6(pid=6942): stdout: | (launched: 2022-12-13_22:14:59.273244) 22:15:00.443861 run osmo-msc_10.42.42.6(pid=6942): stderr: | 20221213221459547 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221459547 DLGLOBAL DEBUG validating counter group 0x7fb983c70c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221459547 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221459547 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221459548 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221459548 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221459549 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221459550 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221459550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221459550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:15:00.493255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6935): Terminating (SIGTERM) 22:15:00.532504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6938): Terminating (SIGTERM) 22:15:00.571823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6941): Terminating (SIGTERM) 22:15:00.611277 --- ParallelTerminationStrategy: PID 6935 died... 22:15:00.630114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6935): Terminated: ok {rc=0} 22:15:00.673414 --- ParallelTerminationStrategy: PID 6938 died... 22:15:00.691645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6938): Terminated: ok {rc=0} 22:15:00.735080 --- ParallelTerminationStrategy: PID 6941 died... 22:15:00.753588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6941): Terminated: ok {rc=0} 22:15:00.852574 bus /sierra_3: Setting Powered False 22:15:01.968312 bus /sierra_3: Setting Powered False 22:15:03.095377 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:15:04.244506 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:15:04.257087 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:15:04.334213 tst mo_mt_call_osmux.py: using LAC 36582 22:15:04.463634 tst mo_mt_call_osmux.py: using RAC 117 22:15:04.590544 tst mo_mt_call_osmux.py: using CellId 36582 22:15:04.709737 tst mo_mt_call_osmux.py: using BVCI 36583 22:15:04.819685 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:15:04.831000 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:15:04.842380 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:15:04.853451 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:15:04.864511 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:15:04.875459 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:15:04.995112 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:15:05.116504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:05.619990 run create_hlr_db(pid=6947): Launched 22:15:05.743991 bus /sierra_2: Setting Powered False 22:15:06.808838 run create_hlr_db(pid=6947): Terminated: ok {rc=0} 22:15:07.243581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6949): Launched 22:15:07.548107 run osmo-hlr_10.42.42.2(pid=6950): Launched 22:15:07.665777 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:08.204033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6952): Launched 22:15:08.506353 run osmo-stp_10.42.42.5(pid=6953): Launched 22:15:08.623212 run osmo-msc_10.42.42.6: Starting osmo-msc 22:15:09.173466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6955): Launched 22:15:09.475750 run osmo-msc_10.42.42.6(pid=6956): Launched 22:15:09.646228 run osmo-stp_10.42.42.5(pid=6953): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6953)] 22:15:09.775122 run osmo-stp_10.42.42.5(pid=6953): stdout: | (launched: 2022-12-13_22:15:08.451184) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:09.902835 run osmo-stp_10.42.42.5(pid=6953): stderr: | 20221213221508624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221508624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221508624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221508625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221508625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221508625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221508625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:10.028880 run osmo-stp_10.42.42.5(pid=6953): stdout: | (launched: 2022-12-13_22:15:08.451184) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:10.149421 run osmo-stp_10.42.42.5(pid=6953): stderr: | 20221213221508624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221508624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221508624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221508625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221508625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221508625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221508625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:10.293911 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6953): Process ended prematurely: osmo-stp_10.42.42.5(pid=6953) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6953)] [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:15:10.302811 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:15:10.329156 run osmo-hlr_10.42.42.2(pid=6950): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6950)] 22:15:10.376559 run osmo-hlr_10.42.42.2(pid=6950): stdout: | (launched: 2022-12-13_22:15:07.492117) 22:15:10.425919 run osmo-hlr_10.42.42.2(pid=6950): stderr: | 20221213221507671 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221507671 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221507671 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221507671 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221507671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221507671 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221507684 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221507693 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221507693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221507693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:10.494308 run osmo-msc_10.42.42.6(pid=6956): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6956)] 22:15:10.541765 run osmo-msc_10.42.42.6(pid=6956): stdout: | (launched: 2022-12-13_22:15:09.421068) 22:15:10.590772 run osmo-msc_10.42.42.6(pid=6956): stderr: | 20221213221509693 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221509693 DLGLOBAL DEBUG validating counter group 0x7f162a8a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221509694 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221509694 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221509694 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221509694 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221509696 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221509696 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221509696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221509696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:15:10.639888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6949): Terminating (SIGTERM) 22:15:10.678934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6952): Terminating (SIGTERM) 22:15:10.717967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6955): Terminating (SIGTERM) 22:15:10.757477 --- ParallelTerminationStrategy: PID 6949 died... 22:15:10.776383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6949): Terminated: ok {rc=0} 22:15:10.820365 --- ParallelTerminationStrategy: PID 6952 died... 22:15:10.838801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6952): Terminated: ok {rc=0} 22:15:10.881963 --- ParallelTerminationStrategy: PID 6955 died... 22:15:10.900320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6955): Terminated: ok {rc=0} 22:15:10.985072 bus /sierra_3: Setting Powered False 22:15:12.082822 bus /sierra_3: Setting Powered False 22:15:13.194856 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 22:15:14.449151 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:15:14.454072 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:15:14.489643 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 22:15:14.517191 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 22:15:14.606510 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:15:14.641342 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 22:15:14.667973 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 22:15:15.253910 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2395 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 22:15:15.259037 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:15.270382 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:15:15.327930 tst emergency_mo_mt_call.py: using LAC 36583 22:15:15.451201 tst emergency_mo_mt_call.py: using RAC 118 22:15:15.587341 tst emergency_mo_mt_call.py: using CellId 36583 22:15:15.710193 tst emergency_mo_mt_call.py: using BVCI 36584 22:15:15.820008 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:15.835313 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:15.853708 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:15.865807 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:15.877434 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:15.893044 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:16.026281 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:16.152070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:16.655553 run create_hlr_db(pid=6961): Launched 22:15:16.814519 bus /sierra_2: Setting Powered False 22:15:17.874154 run create_hlr_db(pid=6961): Terminated: ok {rc=0} 22:15:18.288525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6963): Launched 22:15:18.585465 run osmo-hlr_10.42.42.2(pid=6964): Launched 22:15:18.698349 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:19.227604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6966): Launched 22:15:19.524689 run osmo-stp_10.42.42.5(pid=6967): Launched 22:15:19.648715 tst emergency_mo_mt_call.py: using MSISDN 8356 22:15:19.802082 run osmo-msc_10.42.42.6: Starting osmo-msc 22:15:20.339858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6969): Launched 22:15:20.637906 run osmo-msc_10.42.42.6(pid=6970): Launched 22:15:20.803848 run osmo-stp_10.42.42.5(pid=6967): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6967)] 22:15:20.928935 run osmo-stp_10.42.42.5(pid=6967): stdout: | (launched: 2022-12-13_22:15:19.470028) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:21.054589 run osmo-stp_10.42.42.5(pid=6967): stderr: | 20221213221519641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221519641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221519641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221519642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221519642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221519642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221519642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:21.178621 run osmo-stp_10.42.42.5(pid=6967): stdout: | (launched: 2022-12-13_22:15:19.470028) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:21.296157 run osmo-stp_10.42.42.5(pid=6967): stderr: | 20221213221519641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221519641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221519641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221519642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221519642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221519642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221519642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:21.437846 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=6967): Process ended prematurely: osmo-stp_10.42.42.5(pid=6967) [trial-2395↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6967)] [trial-2395↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 22:15:21.446300 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 22:15:21.472410 run osmo-hlr_10.42.42.2(pid=6964): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6964)] 22:15:21.520807 run osmo-hlr_10.42.42.2(pid=6964): stdout: | (launched: 2022-12-13_22:15:18.530603) 22:15:21.570707 run osmo-hlr_10.42.42.2(pid=6964): stderr: | 20221213221518709 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221518709 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221518709 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221518709 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221518709 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221518709 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221518722 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221518732 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221518733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221518733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:21.639639 run osmo-msc_10.42.42.6(pid=6970): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6970)] 22:15:21.687450 run osmo-msc_10.42.42.6(pid=6970): stdout: | (launched: 2022-12-13_22:15:20.583156) 22:15:21.736894 run osmo-msc_10.42.42.6(pid=6970): stderr: | 20221213221520856 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221520856 DLGLOBAL DEBUG validating counter group 0x7f9af45c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221520856 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221520856 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221520857 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221520857 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221520859 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221520859 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221520859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221520859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:15:21.786677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6963): Terminating (SIGTERM) 22:15:21.827090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6966): Terminating (SIGTERM) 22:15:21.867053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6969): Terminating (SIGTERM) 22:15:21.906978 --- ParallelTerminationStrategy: PID 6963 died... 22:15:21.926197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6963): Terminated: ok {rc=0} 22:15:21.970558 --- ParallelTerminationStrategy: PID 6966 died... 22:15:21.989262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6966): Terminated: ok {rc=0} 22:15:22.033250 --- ParallelTerminationStrategy: PID 6969 died... 22:15:22.052027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6969): Terminated: ok {rc=0} 22:15:22.135789 bus /sierra_3: Setting Powered False 22:15:23.234944 bus /sierra_3: Setting Powered False 22:15:24.352667 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 22:15:25.438495 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:25.450197 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:15:25.501754 tst emergency_preemptive_call.py: using LAC 36584 22:15:25.620057 tst emergency_preemptive_call.py: using RAC 119 22:15:25.737196 tst emergency_preemptive_call.py: using CellId 36584 22:15:25.853997 tst emergency_preemptive_call.py: using BVCI 36585 22:15:25.964092 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:25.975175 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:25.986023 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:25.996719 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:26.007845 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:15:26.019271 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:26.139969 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:26.258693 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:26.379377 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:26.494777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:26.956751 run create_hlr_db(pid=6972): Launched 22:15:27.079136 bus /sierra_2: Setting Powered False 22:15:28.139324 run create_hlr_db(pid=6972): Terminated: ok {rc=0} 22:15:28.557225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6974): Launched 22:15:28.855728 run osmo-hlr_10.42.42.2(pid=6975): Launched 22:15:28.970066 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:29.482465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6977): Launched 22:15:29.779104 run osmo-stp_10.42.42.5(pid=6978): Launched 22:15:29.904023 tst emergency_preemptive_call.py: using MSISDN 8357 22:15:30.056177 run osmo-msc_10.42.42.6: Starting osmo-msc 22:15:30.590189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6980): Launched 22:15:30.891420 run osmo-msc_10.42.42.6(pid=6981): Launched 22:15:31.188140 run osmo-stp_10.42.42.5(pid=6978): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6978)] 22:15:31.355478 run osmo-stp_10.42.42.5(pid=6978): stdout: | (launched: 2022-12-13_22:15:29.724735) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:31.526505 run osmo-stp_10.42.42.5(pid=6978): stderr: | 20221213221529895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221529895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221529896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221529896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221529897 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221529897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221529897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:31.759919 run osmo-stp_10.42.42.5(pid=6978): stdout: | (launched: 2022-12-13_22:15:29.724735) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:31.910354 run osmo-stp_10.42.42.5(pid=6978): stderr: | 20221213221529895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221529895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221529896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221529896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221529897 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221529897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221529897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:32.068816 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=6978): Process ended prematurely: osmo-stp_10.42.42.5(pid=6978) [trial-2395↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6978)] [trial-2395↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 22:15:32.079312 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 22:15:32.108254 run osmo-hlr_10.42.42.2(pid=6975): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6975)] 22:15:32.163359 run osmo-hlr_10.42.42.2(pid=6975): stdout: | (launched: 2022-12-13_22:15:28.800913) 22:15:32.219423 run osmo-hlr_10.42.42.2(pid=6975): stderr: | 20221213221528977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221528977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221528977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221528977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221528977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221528977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221528990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221528998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221528999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221528999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:32.296402 run osmo-msc_10.42.42.6(pid=6981): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6981)] 22:15:32.350885 run osmo-msc_10.42.42.6(pid=6981): stdout: | (launched: 2022-12-13_22:15:30.832288) 22:15:32.405660 run osmo-msc_10.42.42.6(pid=6981): stderr: | 20221213221531458 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213221531458 DLGLOBAL DEBUG validating counter group 0x7f534cbcdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213221531458 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213221531458 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213221531459 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213221531459 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213221531461 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213221531464 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213221531465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213221531465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:15:32.461315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6974): Terminating (SIGTERM) 22:15:32.503710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6977): Terminating (SIGTERM) 22:15:32.546767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6980): Terminating (SIGTERM) 22:15:32.590417 --- ParallelTerminationStrategy: PID 6974 died... 22:15:32.611316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6974): Terminated: ok {rc=0} 22:15:32.658725 --- ParallelTerminationStrategy: PID 6977 died... 22:15:32.679328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6977): Terminated: ok {rc=0} 22:15:32.726187 --- ParallelTerminationStrategy: PID 6980 died... 22:15:32.746357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6980): Terminated: ok {rc=0} 22:15:32.835419 bus /sierra_9: Setting Powered False 22:15:33.933860 bus /sierra_9: Setting Powered False 22:15:35.050030 bus /sierra_8: Setting Powered False 22:15:36.148005 bus /sierra_8: Setting Powered False 22:15:37.265361 bus /sierra_3: Setting Powered False 22:15:38.366252 bus /sierra_3: Setting Powered False 22:15:39.487482 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 22:15:40.767016 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:15:40.771175 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:15:40.804213 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 22:15:40.842366 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 22:15:40.928521 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:15:40.961658 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 22:15:40.999409 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 22:15:41.591309 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 22:15:41.640791 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:41.651516 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:15:41.701341 tst cs_paging_gprs_active.py: using LAC 36585 22:15:41.821487 tst cs_paging_gprs_active.py: using RAC 120 22:15:41.941461 tst cs_paging_gprs_active.py: using CellId 36585 22:15:42.062286 tst cs_paging_gprs_active.py: using BVCI 36586 22:15:42.173819 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:42.184426 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:42.194958 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:42.205473 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:42.215917 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:42.226373 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:42.237458 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:42.248161 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:42.259171 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:42.381305 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:42.501163 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:15:42.706414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:15:43.010951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6987): Launched 22:15:43.277601 run iperf3-srv_10.42.42.10(pid=6988): Launched 22:15:43.391784 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:15:43.595491 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:15:43.900759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6989): Launched 22:15:44.166982 run iperf3-srv_10.42.42.10(pid=6990): Launched 22:15:44.281277 tst cs_paging_gprs_active.py:38: start network... 22:15:44.485415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:44.957331 run create_hlr_db(pid=6991): Launched 22:15:45.083037 bus /sierra_2: Setting Powered False 22:15:46.145950 run create_hlr_db(pid=6991): Terminated: ok {rc=0} 22:15:46.577669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6993): Launched 22:15:46.930594 run osmo-hlr_10.42.42.2(pid=6994): Launched 22:15:47.195454 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:47.734830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6996): Launched 22:15:48.039738 run osmo-stp_10.42.42.5(pid=6997): Launched 22:15:48.158372 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:15:48.698439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6999): Launched 22:15:48.818166 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:15:49.075338 run patchelf(pid=7000): Launched 22:15:49.244715 run osmo-stp_10.42.42.5(pid=6997): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6997)] 22:15:49.373942 run osmo-stp_10.42.42.5(pid=6997): stdout: | (launched: 2022-12-13_22:15:47.984043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:49.504820 run osmo-stp_10.42.42.5(pid=6997): stderr: | 20221213221548154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221548154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221548155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221548155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221548155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221548155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221548156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:49.635652 run osmo-stp_10.42.42.5(pid=6997): stdout: | (launched: 2022-12-13_22:15:47.984043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:49.760571 run osmo-stp_10.42.42.5(pid=6997): stderr: | 20221213221548154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221548154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221548155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221548155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221548155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221548155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221548156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:49.908897 run patchelf(pid=7000): Terminating (SIGINT) 22:15:50.080903 run patchelf(pid=7000): Terminated: ok {rc=0} 22:15:50.204610 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6997): Process ended prematurely: osmo-stp_10.42.42.5(pid=6997) [trial-2395↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6997)] [trial-2395↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 22:15:50.214778 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:15:50.241949 run osmo-hlr_10.42.42.2(pid=6994): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6994)] 22:15:50.289835 run osmo-hlr_10.42.42.2(pid=6994): stdout: | (launched: 2022-12-13_22:15:46.871260) 22:15:50.339186 run osmo-hlr_10.42.42.2(pid=6994): stderr: | 20221213221547083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221547083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221547083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221547083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221547084 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221547084 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221547098 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221547119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221547120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221547120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:50.389311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6987): Terminating (SIGTERM) 22:15:50.429205 run iperf3-srv_10.42.42.10(pid=6988): Terminating (SIGTERM) 22:15:50.468905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6989): Terminating (SIGTERM) 22:15:50.508837 run iperf3-srv_10.42.42.10(pid=6990): Terminating (SIGTERM) 22:15:50.548602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6993): Terminating (SIGTERM) 22:15:50.588326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6996): Terminating (SIGTERM) 22:15:50.628118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6999): Terminating (SIGTERM) 22:15:50.667982 --- ParallelTerminationStrategy: PID 6987 died... 22:15:50.687327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6987): Terminated: ok {rc=0} 22:15:50.731619 --- ParallelTerminationStrategy: PID 6988 died... 22:15:50.750478 run iperf3-srv_10.42.42.10(pid=6988): Terminated {rc=256} 22:15:50.794168 --- ParallelTerminationStrategy: PID 6989 died... 22:15:50.812997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6989): Terminated: ok {rc=0} 22:15:50.856759 --- ParallelTerminationStrategy: PID 6990 died... 22:15:50.875552 run iperf3-srv_10.42.42.10(pid=6990): Terminated {rc=256} 22:15:50.919513 --- ParallelTerminationStrategy: PID 6993 died... 22:15:50.938431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6993): Terminated: ok {rc=0} 22:15:50.982317 --- ParallelTerminationStrategy: PID 6996 died... 22:15:51.001111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6996): Terminated: ok {rc=0} 22:15:51.044830 --- ParallelTerminationStrategy: PID 6999 died... 22:15:51.064104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6999): Terminated: ok {rc=0} 22:15:51.148321 bus /gobi_0: Setting Powered False 22:15:52.246585 bus /gobi_0: Setting Powered False 22:15:53.362444 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 22:15:54.512914 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:54.524751 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:15:54.579069 tst iperf3.py: using LAC 36586 22:15:54.707948 tst iperf3.py: using RAC 121 22:15:54.834413 tst iperf3.py: using CellId 36586 22:15:54.963058 tst iperf3.py: using BVCI 36587 22:15:55.080858 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:55.092297 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:55.103383 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:55.114467 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:55.125755 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:55.137006 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:55.148518 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:55.159831 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:15:55.171232 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:15:55.287875 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:15:55.492049 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:15:55.797252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7002): Launched 22:15:56.062549 run iperf3-srv_10.42.42.10(pid=7003): Launched 22:15:56.177835 tst iperf3.py:8: start network... 22:15:56.381838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:56.853760 run create_hlr_db(pid=7004): Launched 22:15:56.978551 bus /gobi_6: Setting Powered False 22:15:58.039281 run create_hlr_db(pid=7004): Terminated: ok {rc=0} 22:15:58.485566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7006): Launched 22:15:58.812049 run osmo-hlr_10.42.42.2(pid=7007): Launched 22:15:58.937677 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:59.503323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7009): Launched 22:15:59.828773 run osmo-stp_10.42.42.5(pid=7010): Launched 22:15:59.955243 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:16:00.518240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7012): Launched 22:16:00.643646 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:16:00.959688 run patchelf(pid=7013): Launched 22:16:01.146669 run osmo-stp_10.42.42.5(pid=7010): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7010)] 22:16:01.281632 run osmo-stp_10.42.42.5(pid=7010): stdout: | (launched: 2022-12-13_22:15:59.770097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:01.421262 run osmo-stp_10.42.42.5(pid=7010): stderr: | 20221213221559965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221559965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221559965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221559966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221559966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221559966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221559966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:01.557224 run osmo-stp_10.42.42.5(pid=7010): stdout: | (launched: 2022-12-13_22:15:59.770097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:01.688559 run osmo-stp_10.42.42.5(pid=7010): stderr: | 20221213221559965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221559965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221559965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221559966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221559966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221559966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221559966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:01.842049 run patchelf(pid=7013): Terminating (SIGINT) 22:16:02.022237 run patchelf(pid=7013): Terminated: ok {rc=0} 22:16:02.149231 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7010): Process ended prematurely: osmo-stp_10.42.42.5(pid=7010) [trial-2395↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7010)] [trial-2395↪gprs:trx-sysmocell5000↪iperf3.py:8] 22:16:02.159588 tst iperf3.py:8: Test FAILED (7.7 sec) 22:16:02.188323 run osmo-hlr_10.42.42.2(pid=7007): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7007)] 22:16:02.237063 run osmo-hlr_10.42.42.2(pid=7007): stdout: | (launched: 2022-12-13_22:15:58.753304) 22:16:02.286971 run osmo-hlr_10.42.42.2(pid=7007): stderr: | 20221213221558954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221558954 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221558954 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221558954 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221558954 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221558954 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221558966 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221558974 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221558974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221558974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:02.337604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7002): Terminating (SIGTERM) 22:16:02.378392 run iperf3-srv_10.42.42.10(pid=7003): Terminating (SIGTERM) 22:16:02.418417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7006): Terminating (SIGTERM) 22:16:02.458673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7009): Terminating (SIGTERM) 22:16:02.498786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7012): Terminating (SIGTERM) 22:16:02.539088 --- ParallelTerminationStrategy: PID 7002 died... 22:16:02.558307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7002): Terminated: ok {rc=0} 22:16:02.602674 --- ParallelTerminationStrategy: PID 7003 died... 22:16:02.621387 run iperf3-srv_10.42.42.10(pid=7003): Terminated {rc=256} 22:16:02.665297 --- ParallelTerminationStrategy: PID 7006 died... 22:16:02.684114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7006): Terminated: ok {rc=0} 22:16:02.728114 --- ParallelTerminationStrategy: PID 7009 died... 22:16:02.747009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7009): Terminated: ok {rc=0} 22:16:02.791212 --- ParallelTerminationStrategy: PID 7012 died... 22:16:02.810155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7012): Terminated: ok {rc=0} 22:16:02.896511 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 22:16:04.043685 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:04.055042 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:16:04.106186 tst iperf3m4.py: using LAC 36587 22:16:04.253832 tst iperf3m4.py: using RAC 122 22:16:04.386000 tst iperf3m4.py: using CellId 36587 22:16:04.504739 tst iperf3m4.py: using BVCI 36588 22:16:04.614176 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:04.625219 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:04.635877 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:04.646748 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:04.657368 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:04.668236 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:04.678881 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:04.689319 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:04.700634 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:16:04.822467 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:16:04.945326 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:16:05.062302 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:16:05.183034 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:16:05.402700 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:05.728877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7014): Launched 22:16:06.011159 run iperf3-srv_10.42.42.10(pid=7015): Launched 22:16:06.133512 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:16:06.353635 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:06.680285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7016): Launched 22:16:06.963275 run iperf3-srv_10.42.42.10(pid=7017): Launched 22:16:07.085733 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:16:07.304597 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:07.632153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7018): Launched 22:16:07.914863 run iperf3-srv_10.42.42.10(pid=7019): Launched 22:16:08.038562 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:16:08.258012 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:08.584940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7020): Launched 22:16:08.869364 run iperf3-srv_10.42.42.10(pid=7021): Launched 22:16:08.991198 tst iperf3m4.py:8: start network... 22:16:09.209938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:09.716916 run create_hlr_db(pid=7022): Launched 22:16:09.842598 bus /gobi_6: Setting Powered False 22:16:10.906679 run create_hlr_db(pid=7022): Terminated: ok {rc=0} 22:16:11.360609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7024): Launched 22:16:11.686247 run osmo-hlr_10.42.42.2(pid=7025): Launched 22:16:11.811914 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:12.376623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7027): Launched 22:16:12.705013 run osmo-stp_10.42.42.5(pid=7028): Launched 22:16:12.830739 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:16:13.394068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7030): Launched 22:16:13.520088 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:16:13.796343 run patchelf(pid=7031): Launched 22:16:13.978135 run osmo-stp_10.42.42.5(pid=7028): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7028)] 22:16:14.116296 run osmo-stp_10.42.42.5(pid=7028): stdout: | (launched: 2022-12-13_22:16:12.645865) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:14.255797 run osmo-stp_10.42.42.5(pid=7028): stderr: | 20221213221612837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221612837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221612838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221612838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221612840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221612840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221612841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:14.395961 run osmo-stp_10.42.42.5(pid=7028): stdout: | (launched: 2022-12-13_22:16:12.645865) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:14.529445 run osmo-stp_10.42.42.5(pid=7028): stderr: | 20221213221612837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221612837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221612838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221612838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221612840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221612840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221612841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:14.688279 run patchelf(pid=7031): Terminating (SIGINT) 22:16:14.871194 run patchelf(pid=7031): Terminated: ok {rc=0} 22:16:15.002840 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7028): Process ended prematurely: osmo-stp_10.42.42.5(pid=7028) [trial-2395↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7028)] [trial-2395↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 22:16:15.013334 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:16:15.042299 run osmo-hlr_10.42.42.2(pid=7025): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7025)] 22:16:15.093803 run osmo-hlr_10.42.42.2(pid=7025): stdout: | (launched: 2022-12-13_22:16:11.627270) 22:16:15.146275 run osmo-hlr_10.42.42.2(pid=7025): stderr: | 20221213221611823 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221611823 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221611823 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221611823 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221611823 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221611823 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221611839 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221611849 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221611850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221611850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:15.198835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7014): Terminating (SIGTERM) 22:16:15.240577 run iperf3-srv_10.42.42.10(pid=7015): Terminating (SIGTERM) 22:16:15.282563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7016): Terminating (SIGTERM) 22:16:15.324691 run iperf3-srv_10.42.42.10(pid=7017): Terminating (SIGTERM) 22:16:15.367344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7018): Terminating (SIGTERM) 22:16:15.409582 run iperf3-srv_10.42.42.10(pid=7019): Terminating (SIGTERM) 22:16:15.451552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7020): Terminating (SIGTERM) 22:16:15.494059 run iperf3-srv_10.42.42.10(pid=7021): Terminating (SIGTERM) 22:16:15.536287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7024): Terminating (SIGTERM) 22:16:15.578875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7027): Terminating (SIGTERM) 22:16:15.621409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7030): Terminating (SIGTERM) 22:16:15.663770 --- ParallelTerminationStrategy: PID 7014 died... 22:16:15.684220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7014): Terminated: ok {rc=0} 22:16:15.730893 --- ParallelTerminationStrategy: PID 7015 died... 22:16:15.750895 run iperf3-srv_10.42.42.10(pid=7015): Terminated {rc=256} 22:16:15.797102 --- ParallelTerminationStrategy: PID 7016 died... 22:16:15.817180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7016): Terminated: ok {rc=0} 22:16:15.886224 --- ParallelTerminationStrategy: PID 7017 died... 22:16:15.908054 run iperf3-srv_10.42.42.10(pid=7017): Terminated {rc=256} 22:16:15.964070 --- ParallelTerminationStrategy: PID 7018 died... 22:16:15.984060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7018): Terminated: ok {rc=0} 22:16:16.041186 --- ParallelTerminationStrategy: PID 7019 died... 22:16:16.060640 run iperf3-srv_10.42.42.10(pid=7019): Terminated {rc=256} 22:16:16.107298 --- ParallelTerminationStrategy: PID 7020 died... 22:16:16.127654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7020): Terminated: ok {rc=0} 22:16:16.173277 --- ParallelTerminationStrategy: PID 7021 died... 22:16:16.193124 run iperf3-srv_10.42.42.10(pid=7021): Terminated {rc=256} 22:16:16.239129 --- ParallelTerminationStrategy: PID 7024 died... 22:16:16.259694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7024): Terminated: ok {rc=0} 22:16:16.306521 --- ParallelTerminationStrategy: PID 7027 died... 22:16:16.326741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7027): Terminated: ok {rc=0} 22:16:16.381189 --- ParallelTerminationStrategy: PID 7030 died... 22:16:16.407562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7030): Terminated: ok {rc=0} 22:16:16.519918 bus /gobi_4: Setting Powered False 22:16:17.631465 bus /gobi_4: Setting Powered False 22:16:18.744366 bus /gobi_1: Setting Powered False 22:16:19.842424 bus /gobi_1: Setting Powered False 22:16:20.958459 bus /gobi_0: Setting Powered False 22:16:22.051980 bus /gobi_0: Setting Powered False 22:16:23.168808 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 22:16:24.272524 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:24.284084 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:16:24.334353 tst ping.py: using LAC 36588 22:16:24.452543 tst ping.py: using RAC 123 22:16:24.571394 tst ping.py: using CellId 36588 22:16:24.690186 tst ping.py: using BVCI 36589 22:16:24.800048 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:24.810862 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:24.821522 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:24.832018 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:24.842977 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:24.854158 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:24.865379 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:24.876413 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:16:24.996383 tst ping.py:19: start network... 22:16:25.212835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:25.706569 run create_hlr_db(pid=7032): Launched 22:16:25.830327 bus /gobi_6: Setting Powered False 22:16:26.893881 run create_hlr_db(pid=7032): Terminated: ok {rc=0} 22:16:27.319445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7034): Launched 22:16:27.617184 run osmo-hlr_10.42.42.2(pid=7035): Launched 22:16:27.730299 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:28.263769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7037): Launched 22:16:28.562447 run osmo-stp_10.42.42.5(pid=7038): Launched 22:16:28.676082 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:16:29.190373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7040): Launched 22:16:29.304465 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:16:29.555715 run patchelf(pid=7041): Launched 22:16:29.722169 run osmo-stp_10.42.42.5(pid=7038): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7038)] 22:16:29.848646 run osmo-stp_10.42.42.5(pid=7038): stdout: | (launched: 2022-12-13_22:16:28.507875) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:29.976125 run osmo-stp_10.42.42.5(pid=7038): stderr: | 20221213221628679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221628680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221628680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221628680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221628681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221628681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221628681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:30.103991 run osmo-stp_10.42.42.5(pid=7038): stdout: | (launched: 2022-12-13_22:16:28.507875) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:30.226117 run osmo-stp_10.42.42.5(pid=7038): stderr: | 20221213221628679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221628680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221628680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221628680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221628681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221628681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221628681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:30.371435 run patchelf(pid=7041): Terminating (SIGINT) 22:16:30.538369 run patchelf(pid=7041): Terminated: ok {rc=0} 22:16:30.658994 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7038): Process ended prematurely: osmo-stp_10.42.42.5(pid=7038) [trial-2395↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7038)] [trial-2395↪gprs:trx-sysmocell5000↪ping.py:22] 22:16:30.667761 tst ping.py:22: Test FAILED (6.4 sec) 22:16:30.694483 run osmo-hlr_10.42.42.2(pid=7035): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7035)] 22:16:30.741880 run osmo-hlr_10.42.42.2(pid=7035): stdout: | (launched: 2022-12-13_22:16:27.562690) 22:16:30.791075 run osmo-hlr_10.42.42.2(pid=7035): stderr: | 20221213221627741 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221627741 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221627741 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221627741 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221627741 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221627741 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221627756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221627764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221627764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221627764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:30.847349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7034): Terminating (SIGTERM) 22:16:30.906454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7037): Terminating (SIGTERM) 22:16:30.949251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7040): Terminating (SIGTERM) 22:16:30.991907 --- ParallelTerminationStrategy: PID 7034 died... 22:16:31.011480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7034): Terminated: ok {rc=0} 22:16:31.057116 --- ParallelTerminationStrategy: PID 7037 died... 22:16:31.076680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7037): Terminated: ok {rc=0} 22:16:31.121595 --- ParallelTerminationStrategy: PID 7040 died... 22:16:31.141439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7040): Terminated: ok {rc=0} 22:16:31.226924 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 22:16:32.311004 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:32.322433 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:16:32.372522 tst ping_idle_ping.py: using LAC 36589 22:16:32.500898 tst ping_idle_ping.py: using RAC 124 22:16:32.626567 tst ping_idle_ping.py: using CellId 36589 22:16:32.749361 tst ping_idle_ping.py: using BVCI 36590 22:16:32.865599 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:32.877512 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:32.888639 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:32.899892 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:32.911412 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:32.922950 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:32.934717 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:16:32.946313 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:16:33.062385 tst ping_idle_ping.py:24: start network... 22:16:33.263316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:33.729850 run create_hlr_db(pid=7042): Launched 22:16:33.853278 bus /gobi_6: Setting Powered False 22:16:34.913814 run create_hlr_db(pid=7042): Terminated: ok {rc=0} 22:16:35.352415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7044): Launched 22:16:35.676229 run osmo-hlr_10.42.42.2(pid=7045): Launched 22:16:35.799882 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:36.351328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7047): Launched 22:16:36.673310 run osmo-stp_10.42.42.5(pid=7048): Launched 22:16:36.795954 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:16:37.350195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7050): Launched 22:16:37.475006 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:16:37.746292 run patchelf(pid=7051): Launched 22:16:37.925581 run osmo-stp_10.42.42.5(pid=7048): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7048)] 22:16:38.061638 run osmo-stp_10.42.42.5(pid=7048): stdout: | (launched: 2022-12-13_22:16:36.615190) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:38.199297 run osmo-stp_10.42.42.5(pid=7048): stderr: | 20221213221636804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221636804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221636804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221636804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221636805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221636805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221636805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:38.337167 run osmo-stp_10.42.42.5(pid=7048): stdout: | (launched: 2022-12-13_22:16:36.615190) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:38.469744 run osmo-stp_10.42.42.5(pid=7048): stderr: | 20221213221636804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221636804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221636804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221636804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221636805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221636805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221636805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:38.626755 run patchelf(pid=7051): Terminating (SIGINT) 22:16:38.806298 run patchelf(pid=7051): Terminated: ok {rc=0} 22:16:38.935763 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7048): Process ended prematurely: osmo-stp_10.42.42.5(pid=7048) [trial-2395↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7048)] [trial-2395↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 22:16:38.945338 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:16:38.973233 run osmo-hlr_10.42.42.2(pid=7045): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7045)] 22:16:39.023698 run osmo-hlr_10.42.42.2(pid=7045): stdout: | (launched: 2022-12-13_22:16:35.617327) 22:16:39.076029 run osmo-hlr_10.42.42.2(pid=7045): stderr: | 20221213221635815 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221635815 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221635815 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221635815 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221635815 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221635815 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221635830 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221635839 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221635839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221635839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:39.128345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7044): Terminating (SIGTERM) 22:16:39.170228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7047): Terminating (SIGTERM) 22:16:39.212606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7050): Terminating (SIGTERM) 22:16:39.255205 --- ParallelTerminationStrategy: PID 7044 died... 22:16:39.275813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7044): Terminated: ok {rc=0} 22:16:39.322189 --- ParallelTerminationStrategy: PID 7047 died... 22:16:39.342153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7047): Terminated: ok {rc=0} 22:16:39.388203 --- ParallelTerminationStrategy: PID 7050 died... 22:16:39.408187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7050): Terminated: ok {rc=0} 22:16:39.496146 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 22:16:40.807373 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:16:40.813016 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:16:40.846513 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:16:40.885256 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:16:40.971134 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:16:41.004062 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:16:41.041883 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:16:41.642785 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:16:41.696240 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:41.707700 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:16:41.760468 tst cs_paging_gprs_active.py: using LAC 36590 22:16:41.890067 tst cs_paging_gprs_active.py: using RAC 125 22:16:42.009572 tst cs_paging_gprs_active.py: using CellId 36590 22:16:42.128331 tst cs_paging_gprs_active.py: using BVCI 36591 22:16:42.239540 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:42.250574 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:42.261251 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:42.272080 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:42.282819 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:42.294061 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:42.304924 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:42.315679 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:42.326723 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:16:42.449595 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:16:42.572263 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:16:42.792879 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:43.120202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7055): Launched 22:16:43.403474 run iperf3-srv_10.42.42.10(pid=7056): Launched 22:16:43.526404 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:16:43.747430 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:44.075809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7057): Launched 22:16:44.359923 run iperf3-srv_10.42.42.10(pid=7058): Launched 22:16:44.482538 tst cs_paging_gprs_active.py:38: start network... 22:16:44.703419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:45.210117 run create_hlr_db(pid=7060): Launched 22:16:45.335862 bus /gobi_6: Setting Powered False 22:16:46.398876 run create_hlr_db(pid=7060): Terminated: ok {rc=0} 22:16:46.869662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7062): Launched 22:16:47.213597 run osmo-hlr_10.42.42.2(pid=7063): Launched 22:16:47.342045 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:47.908517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7065): Launched 22:16:48.235121 run osmo-stp_10.42.42.5(pid=7066): Launched 22:16:48.361963 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:16:48.925746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7068): Launched 22:16:49.051878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:16:49.326367 run patchelf(pid=7069): Launched 22:16:49.509240 run osmo-stp_10.42.42.5(pid=7066): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7066)] 22:16:49.647493 run osmo-stp_10.42.42.5(pid=7066): stdout: | (launched: 2022-12-13_22:16:48.176024) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:49.787173 run osmo-stp_10.42.42.5(pid=7066): stderr: | 20221213221648368 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221648368 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221648369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221648369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221648369 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221648370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221648370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:49.926766 run osmo-stp_10.42.42.5(pid=7066): stdout: | (launched: 2022-12-13_22:16:48.176024) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:50.060515 run osmo-stp_10.42.42.5(pid=7066): stderr: | 20221213221648368 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221648368 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221648369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221648369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221648369 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221648370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221648370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:50.219174 run patchelf(pid=7069): Terminating (SIGINT) 22:16:50.401599 run patchelf(pid=7069): Terminated: ok {rc=0} 22:16:50.533301 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7066): Process ended prematurely: osmo-stp_10.42.42.5(pid=7066) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7066)] [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:16:50.543536 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 22:16:50.572068 run osmo-hlr_10.42.42.2(pid=7063): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7063)] 22:16:50.623057 run osmo-hlr_10.42.42.2(pid=7063): stdout: | (launched: 2022-12-13_22:16:47.154610) 22:16:50.674860 run osmo-hlr_10.42.42.2(pid=7063): stderr: | 20221213221647354 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221647354 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221647354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221647354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221647354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221647354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221647367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221647376 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221647376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221647376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:50.727126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7055): Terminating (SIGTERM) 22:16:50.769074 run iperf3-srv_10.42.42.10(pid=7056): Terminating (SIGTERM) 22:16:50.810651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7057): Terminating (SIGTERM) 22:16:50.853047 run iperf3-srv_10.42.42.10(pid=7058): Terminating (SIGTERM) 22:16:50.895151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7062): Terminating (SIGTERM) 22:16:50.937002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7065): Terminating (SIGTERM) 22:16:50.979086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7068): Terminating (SIGTERM) 22:16:51.021160 --- ParallelTerminationStrategy: PID 7055 died... 22:16:51.041390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7055): Terminated: ok {rc=0} 22:16:51.087449 --- ParallelTerminationStrategy: PID 7056 died... 22:16:51.107050 run iperf3-srv_10.42.42.10(pid=7056): Terminated {rc=256} 22:16:51.153161 --- ParallelTerminationStrategy: PID 7057 died... 22:16:51.172791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7057): Terminated: ok {rc=0} 22:16:51.218980 --- ParallelTerminationStrategy: PID 7058 died... 22:16:51.238595 run iperf3-srv_10.42.42.10(pid=7058): Terminated {rc=256} 22:16:51.284477 --- ParallelTerminationStrategy: PID 7062 died... 22:16:51.304210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7062): Terminated: ok {rc=0} 22:16:51.349999 --- ParallelTerminationStrategy: PID 7065 died... 22:16:51.369854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7065): Terminated: ok {rc=0} 22:16:51.415601 --- ParallelTerminationStrategy: PID 7068 died... 22:16:51.435280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7068): Terminated: ok {rc=0} 22:16:51.523180 bus /gobi_0: Setting Powered False 22:16:52.622292 bus /gobi_0: Setting Powered False 22:16:53.739493 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:16:54.885154 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:54.896833 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:16:54.954150 tst iperf3.py: using LAC 36591 22:16:55.075789 tst iperf3.py: using RAC 126 22:16:55.193552 tst iperf3.py: using CellId 36591 22:16:55.310358 tst iperf3.py: using BVCI 36592 22:16:55.419990 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:55.431082 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:55.442237 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:55.452913 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:55.463605 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:55.474332 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:55.485223 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:55.495827 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:16:55.506671 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:16:55.621545 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:16:55.824827 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:16:56.127759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7070): Launched 22:16:56.391788 run iperf3-srv_10.42.42.10(pid=7071): Launched 22:16:56.506160 tst iperf3.py:8: start network... 22:16:56.709970 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:57.178657 run create_hlr_db(pid=7072): Launched 22:16:57.302517 bus /gobi_6: Setting Powered False 22:16:58.363264 run create_hlr_db(pid=7072): Terminated: ok {rc=0} 22:16:58.786236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7074): Launched 22:16:59.088378 run osmo-hlr_10.42.42.2(pid=7075): Launched 22:16:59.203252 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:59.725473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7077): Launched 22:17:00.027376 run osmo-stp_10.42.42.5(pid=7078): Launched 22:17:00.143711 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:17:00.667733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7080): Launched 22:17:00.784408 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:17:01.070653 run patchelf(pid=7081): Launched 22:17:01.267667 run osmo-stp_10.42.42.5(pid=7078): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7078)] 22:17:01.410626 run osmo-stp_10.42.42.5(pid=7078): stdout: | (launched: 2022-12-13_22:16:59.972420) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:01.555449 run osmo-stp_10.42.42.5(pid=7078): stderr: | 20221213221700144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221700145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221700145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221700145 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221700146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221700146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221700146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:01.700508 run osmo-stp_10.42.42.5(pid=7078): stdout: | (launched: 2022-12-13_22:16:59.972420) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:01.850325 run osmo-stp_10.42.42.5(pid=7078): stderr: | 20221213221700144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221700145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221700145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221700145 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221700146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221700146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221700146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:02.015948 run patchelf(pid=7081): Terminating (SIGINT) 22:17:02.203397 run patchelf(pid=7081): Terminated: ok {rc=0} 22:17:02.335573 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7078): Process ended prematurely: osmo-stp_10.42.42.5(pid=7078) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7078)] [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 22:17:02.346206 tst iperf3.py:8: Test FAILED (7.5 sec) 22:17:02.375354 run osmo-hlr_10.42.42.2(pid=7075): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7075)] 22:17:02.426245 run osmo-hlr_10.42.42.2(pid=7075): stdout: | (launched: 2022-12-13_22:16:59.033589) 22:17:02.476679 run osmo-hlr_10.42.42.2(pid=7075): stderr: | 20221213221659210 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221659210 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221659210 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221659210 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221659210 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221659210 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221659222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221659231 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221659231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221659231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:02.526068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7070): Terminating (SIGTERM) 22:17:02.565739 run iperf3-srv_10.42.42.10(pid=7071): Terminating (SIGTERM) 22:17:02.605555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7074): Terminating (SIGTERM) 22:17:02.645247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7077): Terminating (SIGTERM) 22:17:02.689226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7080): Terminating (SIGTERM) 22:17:02.731915 --- ParallelTerminationStrategy: PID 7070 died... 22:17:02.752604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7070): Terminated: ok {rc=0} 22:17:02.799597 --- ParallelTerminationStrategy: PID 7071 died... 22:17:02.820000 run iperf3-srv_10.42.42.10(pid=7071): Terminated {rc=256} 22:17:02.867334 --- ParallelTerminationStrategy: PID 7074 died... 22:17:02.887811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7074): Terminated: ok {rc=0} 22:17:02.934642 --- ParallelTerminationStrategy: PID 7077 died... 22:17:02.955101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7077): Terminated: ok {rc=0} 22:17:03.001644 --- ParallelTerminationStrategy: PID 7080 died... 22:17:03.021969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7080): Terminated: ok {rc=0} 22:17:03.111535 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:17:04.262549 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:04.274855 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:17:04.328221 tst iperf3m4.py: using LAC 36592 22:17:04.456707 tst iperf3m4.py: using RAC 127 22:17:04.585379 tst iperf3m4.py: using CellId 36592 22:17:04.713888 tst iperf3m4.py: using BVCI 36593 22:17:04.833985 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:04.845728 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:04.856859 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:04.868195 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:04.880198 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:04.892342 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:04.904576 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:04.916575 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:04.928897 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:17:05.049589 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:17:05.172510 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:17:05.292232 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:17:05.413416 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:17:05.634879 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:05.962220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7085): Launched 22:17:06.245991 run iperf3-srv_10.42.42.10(pid=7086): Launched 22:17:06.370387 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:17:06.590673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:06.919280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7087): Launched 22:17:07.200912 run iperf3-srv_10.42.42.10(pid=7088): Launched 22:17:07.322680 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:17:07.540730 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:07.865345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7089): Launched 22:17:08.146371 run iperf3-srv_10.42.42.10(pid=7090): Launched 22:17:08.267240 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:17:08.485182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:08.810225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7091): Launched 22:17:09.091059 run iperf3-srv_10.42.42.10(pid=7092): Launched 22:17:09.212848 tst iperf3m4.py:8: start network... 22:17:09.431134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:09.934078 run create_hlr_db(pid=7093): Launched 22:17:10.057407 bus /gobi_6: Setting Powered False 22:17:11.121543 run create_hlr_db(pid=7093): Terminated: ok {rc=0} 22:17:11.554115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7095): Launched 22:17:11.856296 run osmo-hlr_10.42.42.2(pid=7096): Launched 22:17:11.972737 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:12.498245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7098): Launched 22:17:12.801442 run osmo-stp_10.42.42.5(pid=7099): Launched 22:17:12.916717 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:17:13.437723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7101): Launched 22:17:13.553926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:17:13.809750 run patchelf(pid=7102): Launched 22:17:13.978512 run osmo-stp_10.42.42.5(pid=7099): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7099)] 22:17:14.107027 run osmo-stp_10.42.42.5(pid=7099): stdout: | (launched: 2022-12-13_22:17:12.746046) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:14.236436 run osmo-stp_10.42.42.5(pid=7099): stderr: | 20221213221712915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221712916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221712916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221712916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221712917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221712917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221712917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:14.366164 run osmo-stp_10.42.42.5(pid=7099): stdout: | (launched: 2022-12-13_22:17:12.746046) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:14.489714 run osmo-stp_10.42.42.5(pid=7099): stderr: | 20221213221712915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221712916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221712916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221712916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221712917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221712917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221712917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:14.636222 run patchelf(pid=7102): Terminating (SIGINT) 22:17:14.806870 run patchelf(pid=7102): Terminated: ok {rc=0} 22:17:14.929531 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7099): Process ended prematurely: osmo-stp_10.42.42.5(pid=7099) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7099)] [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 22:17:14.939062 tst iperf3m4.py:8: Test FAILED (10.7 sec) 22:17:14.966461 run osmo-hlr_10.42.42.2(pid=7096): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7096)] 22:17:15.014241 run osmo-hlr_10.42.42.2(pid=7096): stdout: | (launched: 2022-12-13_22:17:11.801396) 22:17:15.063381 run osmo-hlr_10.42.42.2(pid=7096): stderr: | 20221213221711980 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221711980 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221711980 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221711980 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221711980 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221711980 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221711992 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221712001 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221712001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221712001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:15.113805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7085): Terminating (SIGTERM) 22:17:15.153593 run iperf3-srv_10.42.42.10(pid=7086): Terminating (SIGTERM) 22:17:15.193231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7087): Terminating (SIGTERM) 22:17:15.233818 run iperf3-srv_10.42.42.10(pid=7088): Terminating (SIGTERM) 22:17:15.273525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7089): Terminating (SIGTERM) 22:17:15.313307 run iperf3-srv_10.42.42.10(pid=7090): Terminating (SIGTERM) 22:17:15.352862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7091): Terminating (SIGTERM) 22:17:15.392468 run iperf3-srv_10.42.42.10(pid=7092): Terminating (SIGTERM) 22:17:15.431805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7095): Terminating (SIGTERM) 22:17:15.471598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7098): Terminating (SIGTERM) 22:17:15.511542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7101): Terminating (SIGTERM) 22:17:15.551506 --- ParallelTerminationStrategy: PID 7085 died... 22:17:15.570844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7085): Terminated: ok {rc=0} 22:17:15.614909 --- ParallelTerminationStrategy: PID 7086 died... 22:17:15.633633 run iperf3-srv_10.42.42.10(pid=7086): Terminated {rc=256} 22:17:15.677411 --- ParallelTerminationStrategy: PID 7087 died... 22:17:15.696099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7087): Terminated: ok {rc=0} 22:17:15.740030 --- ParallelTerminationStrategy: PID 7088 died... 22:17:15.758667 run iperf3-srv_10.42.42.10(pid=7088): Terminated {rc=256} 22:17:15.802148 --- ParallelTerminationStrategy: PID 7089 died... 22:17:15.820766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7089): Terminated: ok {rc=0} 22:17:15.889200 --- ParallelTerminationStrategy: PID 7090 died... 22:17:15.910072 run iperf3-srv_10.42.42.10(pid=7090): Terminated {rc=256} 22:17:15.959492 --- ParallelTerminationStrategy: PID 7091 died... 22:17:15.981041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7091): Terminated: ok {rc=0} 22:17:16.039212 --- ParallelTerminationStrategy: PID 7092 died... 22:17:16.059896 run iperf3-srv_10.42.42.10(pid=7092): Terminated {rc=256} 22:17:16.109581 --- ParallelTerminationStrategy: PID 7095 died... 22:17:16.131298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7095): Terminated: ok {rc=0} 22:17:16.180257 --- ParallelTerminationStrategy: PID 7098 died... 22:17:16.201998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7098): Terminated: ok {rc=0} 22:17:16.251221 --- ParallelTerminationStrategy: PID 7101 died... 22:17:16.274294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7101): Terminated: ok {rc=0} 22:17:16.368529 bus /gobi_4: Setting Powered False 22:17:17.469914 bus /gobi_4: Setting Powered False 22:17:18.585038 bus /gobi_1: Setting Powered False 22:17:19.685499 bus /gobi_1: Setting Powered False 22:17:20.802459 bus /gobi_0: Setting Powered False 22:17:21.897434 bus /gobi_0: Setting Powered False 22:17:23.011407 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 22:17:24.115507 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:24.126919 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:17:24.178012 tst ping.py: using LAC 36593 22:17:24.294823 tst ping.py: using RAC 128 22:17:24.411596 tst ping.py: using CellId 36593 22:17:24.536842 tst ping.py: using BVCI 36594 22:17:24.652716 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:24.664439 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:24.676161 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:24.687370 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:24.698789 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:24.710404 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:24.722096 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:24.733566 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:17:24.850464 tst ping.py:19: start network... 22:17:25.049330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:25.505678 run create_hlr_db(pid=7103): Launched 22:17:25.627134 bus /gobi_6: Setting Powered False 22:17:26.685909 run create_hlr_db(pid=7103): Terminated: ok {rc=0} 22:17:27.119611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7105): Launched 22:17:27.435918 run osmo-hlr_10.42.42.2(pid=7106): Launched 22:17:27.558792 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:28.106146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7108): Launched 22:17:28.421154 run osmo-stp_10.42.42.5(pid=7109): Launched 22:17:28.542438 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:17:29.089748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7111): Launched 22:17:29.210822 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:17:29.477568 run patchelf(pid=7112): Launched 22:17:29.652889 run osmo-stp_10.42.42.5(pid=7109): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7109)] 22:17:29.786806 run osmo-stp_10.42.42.5(pid=7109): stdout: | (launched: 2022-12-13_22:17:28.363900) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:29.922178 run osmo-stp_10.42.42.5(pid=7109): stderr: | 20221213221728553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221728553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221728553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221728554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221728556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221728556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221728556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:30.057803 run osmo-stp_10.42.42.5(pid=7109): stdout: | (launched: 2022-12-13_22:17:28.363900) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:30.187921 run osmo-stp_10.42.42.5(pid=7109): stderr: | 20221213221728553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221728553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221728553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221728554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221728556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221728556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221728556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:30.341772 run patchelf(pid=7112): Terminating (SIGINT) 22:17:30.518932 run patchelf(pid=7112): Terminated: ok {rc=0} 22:17:30.647126 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7109): Process ended prematurely: osmo-stp_10.42.42.5(pid=7109) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7109)] [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 22:17:30.656663 tst ping.py:22: Test FAILED (6.5 sec) 22:17:30.684924 run osmo-hlr_10.42.42.2(pid=7106): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7106)] 22:17:30.735689 run osmo-hlr_10.42.42.2(pid=7106): stdout: | (launched: 2022-12-13_22:17:27.378620) 22:17:30.787518 run osmo-hlr_10.42.42.2(pid=7106): stderr: | 20221213221727577 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221727577 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221727577 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221727577 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221727577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221727577 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221727595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221727605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221727605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221727605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:30.857366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7105): Terminating (SIGTERM) 22:17:30.916047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7108): Terminating (SIGTERM) 22:17:30.958838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7111): Terminating (SIGTERM) 22:17:31.002630 --- ParallelTerminationStrategy: PID 7105 died... 22:17:31.023991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7105): Terminated: ok {rc=0} 22:17:31.072486 --- ParallelTerminationStrategy: PID 7108 died... 22:17:31.094161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7108): Terminated: ok {rc=0} 22:17:31.142663 --- ParallelTerminationStrategy: PID 7111 died... 22:17:31.164336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7111): Terminated: ok {rc=0} 22:17:31.262882 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:17:32.365112 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:32.377097 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:17:32.431084 tst ping_idle_ping.py: using LAC 36594 22:17:32.555481 tst ping_idle_ping.py: using RAC 129 22:17:32.679383 tst ping_idle_ping.py: using CellId 36594 22:17:32.802696 tst ping_idle_ping.py: using BVCI 36595 22:17:32.917996 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:32.929467 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:32.940577 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:32.951782 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:32.963247 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:32.974740 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:32.986560 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:17:32.998109 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:17:33.114465 tst ping_idle_ping.py:24: start network... 22:17:33.313286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:33.774095 run create_hlr_db(pid=7113): Launched 22:17:33.896567 bus /gobi_6: Setting Powered False 22:17:34.956810 run create_hlr_db(pid=7113): Terminated: ok {rc=0} 22:17:35.391285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7115): Launched 22:17:35.711136 run osmo-hlr_10.42.42.2(pid=7116): Launched 22:17:35.833775 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:36.382661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7118): Launched 22:17:36.700711 run osmo-stp_10.42.42.5(pid=7119): Launched 22:17:36.822801 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:17:37.372839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7121): Launched 22:17:37.494934 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:17:37.764212 run patchelf(pid=7122): Launched 22:17:37.941747 run osmo-stp_10.42.42.5(pid=7119): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7119)] 22:17:38.076805 run osmo-stp_10.42.42.5(pid=7119): stdout: | (launched: 2022-12-13_22:17:36.643207) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:38.213302 run osmo-stp_10.42.42.5(pid=7119): stderr: | 20221213221736834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221736834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221736834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221736834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221736835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221736835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221736835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:38.349796 run osmo-stp_10.42.42.5(pid=7119): stdout: | (launched: 2022-12-13_22:17:36.643207) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:38.480750 run osmo-stp_10.42.42.5(pid=7119): stderr: | 20221213221736834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221736834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221736834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221736834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221736835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221736835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221736835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:38.635947 run patchelf(pid=7122): Terminating (SIGINT) 22:17:38.813981 run patchelf(pid=7122): Terminated: ok {rc=0} 22:17:38.942315 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7119): Process ended prematurely: osmo-stp_10.42.42.5(pid=7119) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7119)] [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 22:17:38.951818 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:17:38.979845 run osmo-hlr_10.42.42.2(pid=7116): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7116)] 22:17:39.030404 run osmo-hlr_10.42.42.2(pid=7116): stdout: | (launched: 2022-12-13_22:17:35.653451) 22:17:39.082703 run osmo-hlr_10.42.42.2(pid=7116): stderr: | 20221213221735850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221735850 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221735850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221735850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221735850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221735850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221735862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221735872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221735872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221735872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:39.134836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7115): Terminating (SIGTERM) 22:17:39.176444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7118): Terminating (SIGTERM) 22:17:39.219062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7121): Terminating (SIGTERM) 22:17:39.261642 --- ParallelTerminationStrategy: PID 7115 died... 22:17:39.282233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7115): Terminated: ok {rc=0} 22:17:39.329087 --- ParallelTerminationStrategy: PID 7118 died... 22:17:39.349369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7118): Terminated: ok {rc=0} 22:17:39.396095 --- ParallelTerminationStrategy: PID 7121 died... 22:17:39.416408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7121): Terminated: ok {rc=0} 22:17:39.505001 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:17:40.813174 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:17:40.819110 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:17:40.852024 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:17:40.890120 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:17:40.977112 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:17:41.009983 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:17:41.047480 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:17:41.642948 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:17:41.691160 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:41.702200 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:17:41.772396 tst cs_paging_gprs_active.py: using LAC 36595 22:17:41.892554 tst cs_paging_gprs_active.py: using RAC 130 22:17:42.011704 tst cs_paging_gprs_active.py: using CellId 36595 22:17:42.130901 tst cs_paging_gprs_active.py: using BVCI 36596 22:17:42.239673 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:42.250667 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:42.261613 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:42.272230 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:42.282848 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:42.293525 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:42.304318 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:42.314937 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:42.325769 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:17:42.447144 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:17:42.563337 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:17:42.766117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:43.068363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7126): Launched 22:17:43.350247 run iperf3-srv_10.42.42.10(pid=7127): Launched 22:17:43.471843 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:17:43.690793 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:44.014423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7128): Launched 22:17:44.294506 run iperf3-srv_10.42.42.10(pid=7129): Launched 22:17:44.415575 tst cs_paging_gprs_active.py:38: start network... 22:17:44.634498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:45.134867 run create_hlr_db(pid=7130): Launched 22:17:45.259166 bus /gobi_6: Setting Powered False 22:17:46.331474 run create_hlr_db(pid=7130): Terminated: ok {rc=0} 22:17:46.795577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7132): Launched 22:17:47.136711 run osmo-hlr_10.42.42.2(pid=7133): Launched 22:17:47.270154 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:47.788321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7135): Launched 22:17:48.088720 run osmo-stp_10.42.42.5(pid=7136): Launched 22:17:48.203946 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:17:48.721961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7138): Launched 22:17:48.837265 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:17:49.091929 run patchelf(pid=7139): Launched 22:17:49.259764 run osmo-stp_10.42.42.5(pid=7136): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7136)] 22:17:49.386966 run osmo-stp_10.42.42.5(pid=7136): stdout: | (launched: 2022-12-13_22:17:48.034395) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:49.516144 run osmo-stp_10.42.42.5(pid=7136): stderr: | 20221213221748204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221748204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221748205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221748205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221748206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221748206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221748206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:49.645976 run osmo-stp_10.42.42.5(pid=7136): stdout: | (launched: 2022-12-13_22:17:48.034395) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:49.768896 run osmo-stp_10.42.42.5(pid=7136): stderr: | 20221213221748204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221748204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221748205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221748205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221748206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221748206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221748206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:49.916759 run patchelf(pid=7139): Terminating (SIGINT) 22:17:50.085317 run patchelf(pid=7139): Terminated: ok {rc=0} 22:17:50.206687 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7136): Process ended prematurely: osmo-stp_10.42.42.5(pid=7136) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7136)] [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:17:50.216055 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:17:50.243103 run osmo-hlr_10.42.42.2(pid=7133): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7133)] 22:17:50.290331 run osmo-hlr_10.42.42.2(pid=7133): stdout: | (launched: 2022-12-13_22:17:47.074731) 22:17:50.339095 run osmo-hlr_10.42.42.2(pid=7133): stderr: | 20221213221747273 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221747273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221747273 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221747273 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221747273 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221747273 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221747285 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221747294 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221747294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221747294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:50.388321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7126): Terminating (SIGTERM) 22:17:50.427635 run iperf3-srv_10.42.42.10(pid=7127): Terminating (SIGTERM) 22:17:50.466716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7128): Terminating (SIGTERM) 22:17:50.506178 run iperf3-srv_10.42.42.10(pid=7129): Terminating (SIGTERM) 22:17:50.545473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7132): Terminating (SIGTERM) 22:17:50.584678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7135): Terminating (SIGTERM) 22:17:50.623745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7138): Terminating (SIGTERM) 22:17:50.663313 --- ParallelTerminationStrategy: PID 7126 died... 22:17:50.682354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7126): Terminated: ok {rc=0} 22:17:50.725904 --- ParallelTerminationStrategy: PID 7127 died... 22:17:50.744228 run iperf3-srv_10.42.42.10(pid=7127): Terminated {rc=256} 22:17:50.787460 --- ParallelTerminationStrategy: PID 7128 died... 22:17:50.806024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7128): Terminated: ok {rc=0} 22:17:50.849180 --- ParallelTerminationStrategy: PID 7129 died... 22:17:50.867654 run iperf3-srv_10.42.42.10(pid=7129): Terminated {rc=256} 22:17:50.910942 --- ParallelTerminationStrategy: PID 7132 died... 22:17:50.929475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7132): Terminated: ok {rc=0} 22:17:50.972758 --- ParallelTerminationStrategy: PID 7135 died... 22:17:50.991693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7135): Terminated: ok {rc=0} 22:17:51.035331 --- ParallelTerminationStrategy: PID 7138 died... 22:17:51.053928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7138): Terminated: ok {rc=0} 22:17:51.139346 bus /gobi_0: Setting Powered False 22:17:52.238624 bus /gobi_0: Setting Powered False 22:17:53.352584 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:17:54.497133 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:54.508643 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:17:54.581796 tst iperf3.py: using LAC 36596 22:17:54.701296 tst iperf3.py: using RAC 131 22:17:54.818738 tst iperf3.py: using CellId 36596 22:17:54.938383 tst iperf3.py: using BVCI 36597 22:17:55.050226 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:55.061261 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:55.071986 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:55.082721 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:55.093406 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:55.104021 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:55.114849 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:55.125536 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:17:55.136178 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:17:55.256687 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:17:55.475009 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:17:55.798341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7140): Launched 22:17:56.078346 run iperf3-srv_10.42.42.10(pid=7141): Launched 22:17:56.199148 tst iperf3.py:8: start network... 22:17:56.416444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:56.916017 run create_hlr_db(pid=7142): Launched 22:17:57.039305 bus /gobi_6: Setting Powered False 22:17:58.102958 run create_hlr_db(pid=7142): Terminated: ok {rc=0} 22:17:58.532423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7144): Launched 22:17:58.833233 run osmo-hlr_10.42.42.2(pid=7145): Launched 22:17:58.948852 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:59.472912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7147): Launched 22:17:59.772929 run osmo-stp_10.42.42.5(pid=7148): Launched 22:17:59.888862 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:18:00.407881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7150): Launched 22:18:00.523092 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:18:00.776266 run patchelf(pid=7151): Launched 22:18:00.967497 run osmo-stp_10.42.42.5(pid=7148): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7148)] 22:18:01.101231 run osmo-stp_10.42.42.5(pid=7148): stdout: | (launched: 2022-12-13_22:17:59.718176) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:01.233771 run osmo-stp_10.42.42.5(pid=7148): stderr: | 20221213221759890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221759890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221759890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221759891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221759891 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221759891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221759891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:01.367034 run osmo-stp_10.42.42.5(pid=7148): stdout: | (launched: 2022-12-13_22:17:59.718176) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:01.494029 run osmo-stp_10.42.42.5(pid=7148): stderr: | 20221213221759890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221759890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221759890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221759891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221759891 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221759891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221759891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:01.644473 run patchelf(pid=7151): Terminating (SIGINT) 22:18:01.818205 run patchelf(pid=7151): Terminated: ok {rc=0} 22:18:01.943809 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7148): Process ended prematurely: osmo-stp_10.42.42.5(pid=7148) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7148)] [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 22:18:01.953844 tst iperf3.py:8: Test FAILED (7.5 sec) 22:18:01.981664 run osmo-hlr_10.42.42.2(pid=7145): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7145)] 22:18:02.030403 run osmo-hlr_10.42.42.2(pid=7145): stdout: | (launched: 2022-12-13_22:17:58.778746) 22:18:02.081368 run osmo-hlr_10.42.42.2(pid=7145): stderr: | 20221213221758956 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221758956 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221758956 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221758956 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221758956 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221758956 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221758968 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221758977 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221758977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221758977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:02.132181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7140): Terminating (SIGTERM) 22:18:02.173328 run iperf3-srv_10.42.42.10(pid=7141): Terminating (SIGTERM) 22:18:02.213889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7144): Terminating (SIGTERM) 22:18:02.253154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7147): Terminating (SIGTERM) 22:18:02.292280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7150): Terminating (SIGTERM) 22:18:02.331802 --- ParallelTerminationStrategy: PID 7140 died... 22:18:02.350548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7140): Terminated: ok {rc=0} 22:18:02.393967 --- ParallelTerminationStrategy: PID 7141 died... 22:18:02.412181 run iperf3-srv_10.42.42.10(pid=7141): Terminated {rc=256} 22:18:02.455378 --- ParallelTerminationStrategy: PID 7144 died... 22:18:02.473755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7144): Terminated: ok {rc=0} 22:18:02.516802 --- ParallelTerminationStrategy: PID 7147 died... 22:18:02.535657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7147): Terminated: ok {rc=0} 22:18:02.579037 --- ParallelTerminationStrategy: PID 7150 died... 22:18:02.597393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7150): Terminated: ok {rc=0} 22:18:02.680566 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:18:03.828735 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:03.840869 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:18:03.914521 tst iperf3m4.py: using LAC 36597 22:18:04.033137 tst iperf3m4.py: using RAC 132 22:18:04.152274 tst iperf3m4.py: using CellId 36597 22:18:04.271707 tst iperf3m4.py: using BVCI 36598 22:18:04.381846 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:04.392589 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:04.403277 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:04.413924 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:04.424599 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:04.435342 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:04.446200 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:04.456791 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:04.467753 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:18:04.587505 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:18:04.707309 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:18:04.825158 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:18:04.946442 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:18:05.165940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:05.490516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7152): Launched 22:18:05.773300 run iperf3-srv_10.42.42.10(pid=7153): Launched 22:18:05.894841 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:18:06.112656 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:06.436174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7154): Launched 22:18:06.717606 run iperf3-srv_10.42.42.10(pid=7155): Launched 22:18:06.838324 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:18:07.055518 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:07.378293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7156): Launched 22:18:07.658623 run iperf3-srv_10.42.42.10(pid=7157): Launched 22:18:07.780790 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:18:07.998366 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:08.322157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7158): Launched 22:18:08.602517 run iperf3-srv_10.42.42.10(pid=7159): Launched 22:18:08.724370 tst iperf3m4.py:8: start network... 22:18:08.941872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:09.442916 run create_hlr_db(pid=7160): Launched 22:18:09.565640 bus /gobi_6: Setting Powered False 22:18:10.629368 run create_hlr_db(pid=7160): Terminated: ok {rc=0} 22:18:11.060696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7162): Launched 22:18:11.362945 run osmo-hlr_10.42.42.2(pid=7163): Launched 22:18:11.477341 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:12.035695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7165): Launched 22:18:12.357918 run osmo-stp_10.42.42.5(pid=7166): Launched 22:18:12.481527 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:18:13.037785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7168): Launched 22:18:13.161944 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:18:13.433950 run patchelf(pid=7169): Launched 22:18:13.613629 run osmo-stp_10.42.42.5(pid=7166): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7166)] 22:18:13.751431 run osmo-stp_10.42.42.5(pid=7166): stdout: | (launched: 2022-12-13_22:18:12.299662) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:13.889817 run osmo-stp_10.42.42.5(pid=7166): stderr: | 20221213221812491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221812491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221812491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221812492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221812492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221812492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221812492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:14.027811 run osmo-stp_10.42.42.5(pid=7166): stdout: | (launched: 2022-12-13_22:18:12.299662) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:14.160625 run osmo-stp_10.42.42.5(pid=7166): stderr: | 20221213221812491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221812491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221812491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221812492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221812492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221812492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221812492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:14.318131 run patchelf(pid=7169): Terminating (SIGINT) 22:18:14.499092 run patchelf(pid=7169): Terminated: ok {rc=0} 22:18:14.629901 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7166): Process ended prematurely: osmo-stp_10.42.42.5(pid=7166) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7166)] [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:18:14.640568 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:18:14.669548 run osmo-hlr_10.42.42.2(pid=7163): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7163)] 22:18:14.720582 run osmo-hlr_10.42.42.2(pid=7163): stdout: | (launched: 2022-12-13_22:18:11.307908) 22:18:14.772539 run osmo-hlr_10.42.42.2(pid=7163): stderr: | 20221213221811487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221811487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221811487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221811487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221811487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221811487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221811499 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221811508 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221811508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221811508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:14.824889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7152): Terminating (SIGTERM) 22:18:14.866427 run iperf3-srv_10.42.42.10(pid=7153): Terminating (SIGTERM) 22:18:14.908728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7154): Terminating (SIGTERM) 22:18:14.950720 run iperf3-srv_10.42.42.10(pid=7155): Terminating (SIGTERM) 22:18:14.992930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7156): Terminating (SIGTERM) 22:18:15.035074 run iperf3-srv_10.42.42.10(pid=7157): Terminating (SIGTERM) 22:18:15.076766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7158): Terminating (SIGTERM) 22:18:15.118614 run iperf3-srv_10.42.42.10(pid=7159): Terminating (SIGTERM) 22:18:15.160809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7162): Terminating (SIGTERM) 22:18:15.203226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7165): Terminating (SIGTERM) 22:18:15.245184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7168): Terminating (SIGTERM) 22:18:15.287862 --- ParallelTerminationStrategy: PID 7152 died... 22:18:15.308260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7152): Terminated: ok {rc=0} 22:18:15.354963 --- ParallelTerminationStrategy: PID 7153 died... 22:18:15.374773 run iperf3-srv_10.42.42.10(pid=7153): Terminated {rc=256} 22:18:15.420727 --- ParallelTerminationStrategy: PID 7154 died... 22:18:15.440516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7154): Terminated: ok {rc=0} 22:18:15.486744 --- ParallelTerminationStrategy: PID 7155 died... 22:18:15.506435 run iperf3-srv_10.42.42.10(pid=7155): Terminated {rc=256} 22:18:15.552428 --- ParallelTerminationStrategy: PID 7156 died... 22:18:15.572184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7156): Terminated: ok {rc=0} 22:18:15.618210 --- ParallelTerminationStrategy: PID 7157 died... 22:18:15.637893 run iperf3-srv_10.42.42.10(pid=7157): Terminated {rc=256} 22:18:15.684048 --- ParallelTerminationStrategy: PID 7158 died... 22:18:15.703953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7158): Terminated: ok {rc=0} 22:18:15.750042 --- ParallelTerminationStrategy: PID 7159 died... 22:18:15.769756 run iperf3-srv_10.42.42.10(pid=7159): Terminated {rc=256} 22:18:15.815832 --- ParallelTerminationStrategy: PID 7162 died... 22:18:15.844187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7162): Terminated: ok {rc=0} 22:18:15.903296 --- ParallelTerminationStrategy: PID 7165 died... 22:18:15.929543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7165): Terminated: ok {rc=0} 22:18:15.974614 --- ParallelTerminationStrategy: PID 7168 died... 22:18:15.994143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7168): Terminated: ok {rc=0} 22:18:16.095113 bus /gobi_4: Setting Powered False 22:18:17.198539 bus /gobi_4: Setting Powered False 22:18:18.321253 bus /gobi_1: Setting Powered False 22:18:19.421394 bus /gobi_1: Setting Powered False 22:18:20.537696 bus /gobi_0: Setting Powered False 22:18:21.636837 bus /gobi_0: Setting Powered False 22:18:22.755160 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:18:23.860270 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:23.872356 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:18:23.945428 tst ping.py: using LAC 36598 22:18:24.071370 tst ping.py: using RAC 133 22:18:24.197413 tst ping.py: using CellId 36598 22:18:24.322780 tst ping.py: using BVCI 36599 22:18:24.439348 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:24.450926 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:24.462268 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:24.473532 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:24.484996 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:24.496470 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:24.508139 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:24.519614 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:18:24.641672 tst ping.py:19: start network... 22:18:24.838674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:25.295336 run create_hlr_db(pid=7170): Launched 22:18:25.416579 bus /gobi_6: Setting Powered False 22:18:26.476363 run create_hlr_db(pid=7170): Terminated: ok {rc=0} 22:18:26.909832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7172): Launched 22:18:27.226693 run osmo-hlr_10.42.42.2(pid=7173): Launched 22:18:27.348431 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:27.896595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7175): Launched 22:18:28.212721 run osmo-stp_10.42.42.5(pid=7176): Launched 22:18:28.334222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:18:28.881630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7178): Launched 22:18:29.003092 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:18:29.269929 run patchelf(pid=7179): Launched 22:18:29.446711 run osmo-stp_10.42.42.5(pid=7176): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7176)] 22:18:29.580685 run osmo-stp_10.42.42.5(pid=7176): stdout: | (launched: 2022-12-13_22:18:28.155438) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:29.717096 run osmo-stp_10.42.42.5(pid=7176): stderr: | 20221213221828344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221828345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221828345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221828345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221828348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221828348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221828348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:29.852865 run osmo-stp_10.42.42.5(pid=7176): stdout: | (launched: 2022-12-13_22:18:28.155438) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:29.983190 run osmo-stp_10.42.42.5(pid=7176): stderr: | 20221213221828344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221828345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221828345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221828345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221828348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221828348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221828348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:30.137467 run patchelf(pid=7179): Terminating (SIGINT) 22:18:30.314506 run patchelf(pid=7179): Terminated: ok {rc=0} 22:18:30.442428 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7176): Process ended prematurely: osmo-stp_10.42.42.5(pid=7176) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7176)] [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 22:18:30.451909 tst ping.py:22: Test FAILED (6.6 sec) 22:18:30.480008 run osmo-hlr_10.42.42.2(pid=7173): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7173)] 22:18:30.530564 run osmo-hlr_10.42.42.2(pid=7173): stdout: | (launched: 2022-12-13_22:18:27.169438) 22:18:30.582684 run osmo-hlr_10.42.42.2(pid=7173): stderr: | 20221213221827366 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221827366 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221827366 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221827366 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221827366 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221827366 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221827420 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221827429 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221827429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221827430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:30.634644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7172): Terminating (SIGTERM) 22:18:30.676577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7175): Terminating (SIGTERM) 22:18:30.719076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7178): Terminating (SIGTERM) 22:18:30.761321 --- ParallelTerminationStrategy: PID 7172 died... 22:18:30.781593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7172): Terminated: ok {rc=0} 22:18:30.828812 --- ParallelTerminationStrategy: PID 7175 died... 22:18:30.852127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7175): Terminated: ok {rc=0} 22:18:30.915846 --- ParallelTerminationStrategy: PID 7178 died... 22:18:30.936862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7178): Terminated: ok {rc=0} 22:18:31.026639 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:18:32.126879 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:32.143764 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:18:32.232131 tst ping_idle_ping.py: using LAC 36599 22:18:32.361967 tst ping_idle_ping.py: using RAC 134 22:18:32.485269 tst ping_idle_ping.py: using CellId 36599 22:18:32.608543 tst ping_idle_ping.py: using BVCI 36600 22:18:32.723849 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:32.735325 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:32.746604 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:32.757880 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:32.769379 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:32.780899 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:32.792584 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:18:32.804087 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:18:32.922420 tst ping_idle_ping.py:24: start network... 22:18:33.136140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:33.635987 run create_hlr_db(pid=7180): Launched 22:18:33.758870 bus /gobi_6: Setting Powered False 22:18:34.822079 run create_hlr_db(pid=7180): Terminated: ok {rc=0} 22:18:35.246153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7182): Launched 22:18:35.543508 run osmo-hlr_10.42.42.2(pid=7183): Launched 22:18:35.657518 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:36.166313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7185): Launched 22:18:36.460542 run osmo-stp_10.42.42.5(pid=7186): Launched 22:18:36.573987 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:18:37.083654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7188): Launched 22:18:37.196858 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:18:37.446507 run patchelf(pid=7189): Launched 22:18:37.611314 run osmo-stp_10.42.42.5(pid=7186): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7186)] 22:18:37.736465 run osmo-stp_10.42.42.5(pid=7186): stdout: | (launched: 2022-12-13_22:18:36.406985) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:37.863190 run osmo-stp_10.42.42.5(pid=7186): stderr: | 20221213221836577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221836577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221836578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221836578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221836578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221836579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221836579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:37.989979 run osmo-stp_10.42.42.5(pid=7186): stdout: | (launched: 2022-12-13_22:18:36.406985) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:38.110844 run osmo-stp_10.42.42.5(pid=7186): stderr: | 20221213221836577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221836577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221836578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221836578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221836578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221836579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221836579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:38.254338 run patchelf(pid=7189): Terminating (SIGINT) 22:18:38.419347 run patchelf(pid=7189): Terminated: ok {rc=0} 22:18:38.538584 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7186): Process ended prematurely: osmo-stp_10.42.42.5(pid=7186) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7186)] [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:18:38.547286 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:18:38.573610 run osmo-hlr_10.42.42.2(pid=7183): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7183)] 22:18:38.620601 run osmo-hlr_10.42.42.2(pid=7183): stdout: | (launched: 2022-12-13_22:18:35.489599) 22:18:38.669471 run osmo-hlr_10.42.42.2(pid=7183): stderr: | 20221213221835663 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221835663 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221835663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221835663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221835663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221835663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221835675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221835684 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221835684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221835685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:38.718536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7182): Terminating (SIGTERM) 22:18:38.757747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7185): Terminating (SIGTERM) 22:18:38.797487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7188): Terminating (SIGTERM) 22:18:38.836778 --- ParallelTerminationStrategy: PID 7182 died... 22:18:38.855518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7182): Terminated: ok {rc=0} 22:18:38.898766 --- ParallelTerminationStrategy: PID 7185 died... 22:18:38.916854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7185): Terminated: ok {rc=0} 22:18:38.960521 --- ParallelTerminationStrategy: PID 7188 died... 22:18:38.978781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7188): Terminated: ok {rc=0} 22:18:39.063470 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:18:40.365891 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:18:40.371733 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:18:40.404735 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:18:40.443082 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:18:40.533453 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:18:40.566936 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:18:40.604660 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:18:41.196508 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:18:41.244772 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:41.255732 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:18:41.324192 tst cs_paging_gprs_active.py: using LAC 36600 22:18:41.441701 tst cs_paging_gprs_active.py: using RAC 135 22:18:41.558628 tst cs_paging_gprs_active.py: using CellId 36600 22:18:41.676141 tst cs_paging_gprs_active.py: using BVCI 36601 22:18:41.785352 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:41.796141 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:41.806927 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:41.817682 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:41.828331 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:41.839579 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:41.850394 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:41.861033 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:41.871880 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:18:41.995150 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:18:42.116483 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:18:42.336075 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:42.660188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7194): Launched 22:18:42.941918 run iperf3-srv_10.42.42.10(pid=7195): Launched 22:18:43.063394 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:18:43.282417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:43.606905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7196): Launched 22:18:43.889114 run iperf3-srv_10.42.42.10(pid=7197): Launched 22:18:44.010443 tst cs_paging_gprs_active.py:38: start network... 22:18:44.228594 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:44.728528 run create_hlr_db(pid=7198): Launched 22:18:44.851998 bus /gobi_6: Setting Powered False 22:18:45.916594 run create_hlr_db(pid=7198): Terminated: ok {rc=0} 22:18:46.354577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7200): Launched 22:18:46.683688 run osmo-hlr_10.42.42.2(pid=7201): Launched 22:18:46.951317 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:47.627461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7203): Launched 22:18:47.928578 run osmo-stp_10.42.42.5(pid=7204): Launched 22:18:48.043549 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:18:48.562001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7206): Launched 22:18:48.677578 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:18:48.931654 run patchelf(pid=7207): Launched 22:18:49.099610 run osmo-stp_10.42.42.5(pid=7204): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7204)] 22:18:49.226583 run osmo-stp_10.42.42.5(pid=7204): stdout: | (launched: 2022-12-13_22:18:47.874168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:49.355674 run osmo-stp_10.42.42.5(pid=7204): stderr: | 20221213221848043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221848044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221848044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221848044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221848045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221848045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221848045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:49.485663 run osmo-stp_10.42.42.5(pid=7204): stdout: | (launched: 2022-12-13_22:18:47.874168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:49.609156 run osmo-stp_10.42.42.5(pid=7204): stderr: | 20221213221848043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221848044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221848044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221848044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221848045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221848045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221848045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:49.755300 run patchelf(pid=7207): Terminating (SIGINT) 22:18:49.923733 run patchelf(pid=7207): Terminated: ok {rc=0} 22:18:50.045144 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7204): Process ended prematurely: osmo-stp_10.42.42.5(pid=7204) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7204)] [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:18:50.054530 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 22:18:50.081501 run osmo-hlr_10.42.42.2(pid=7201): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7201)] 22:18:50.129080 run osmo-hlr_10.42.42.2(pid=7201): stdout: | (launched: 2022-12-13_22:18:46.621594) 22:18:50.178283 run osmo-hlr_10.42.42.2(pid=7201): stderr: | 20221213221847021 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221847022 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221847023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221847023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221847023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221847023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221847056 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221847064 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221847071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221847071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:50.227990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7194): Terminating (SIGTERM) 22:18:50.267355 run iperf3-srv_10.42.42.10(pid=7195): Terminating (SIGTERM) 22:18:50.306766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7196): Terminating (SIGTERM) 22:18:50.346134 run iperf3-srv_10.42.42.10(pid=7197): Terminating (SIGTERM) 22:18:50.385281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7200): Terminating (SIGTERM) 22:18:50.425274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7203): Terminating (SIGTERM) 22:18:50.465436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7206): Terminating (SIGTERM) 22:18:50.505119 --- ParallelTerminationStrategy: PID 7194 died... 22:18:50.524133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7194): Terminated: ok {rc=0} 22:18:50.567842 --- ParallelTerminationStrategy: PID 7195 died... 22:18:50.586203 run iperf3-srv_10.42.42.10(pid=7195): Terminated {rc=256} 22:18:50.629289 --- ParallelTerminationStrategy: PID 7196 died... 22:18:50.647626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7196): Terminated: ok {rc=0} 22:18:50.690995 --- ParallelTerminationStrategy: PID 7197 died... 22:18:50.709331 run iperf3-srv_10.42.42.10(pid=7197): Terminated {rc=256} 22:18:50.752345 --- ParallelTerminationStrategy: PID 7200 died... 22:18:50.770721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7200): Terminated: ok {rc=0} 22:18:50.814188 --- ParallelTerminationStrategy: PID 7203 died... 22:18:50.832454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7203): Terminated: ok {rc=0} 22:18:50.876420 --- ParallelTerminationStrategy: PID 7206 died... 22:18:50.894895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7206): Terminated: ok {rc=0} 22:18:50.980404 bus /gobi_0: Setting Powered False 22:18:52.079614 bus /gobi_0: Setting Powered False 22:18:53.193628 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:18:54.339813 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:54.351568 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:18:54.424377 tst iperf3.py: using LAC 36601 22:18:54.543269 tst iperf3.py: using RAC 136 22:18:54.663097 tst iperf3.py: using CellId 36601 22:18:54.783313 tst iperf3.py: using BVCI 36602 22:18:54.892077 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:54.903174 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:54.913975 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:54.924654 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:54.935455 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:54.946290 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:54.957127 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:54.968058 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:18:54.978902 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:18:55.100310 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:18:55.319043 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:18:55.642452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7208): Launched 22:18:55.924417 run iperf3-srv_10.42.42.10(pid=7209): Launched 22:18:56.046073 tst iperf3.py:8: start network... 22:18:56.264314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:56.765551 run create_hlr_db(pid=7210): Launched 22:18:56.889646 bus /gobi_6: Setting Powered False 22:18:57.953606 run create_hlr_db(pid=7210): Terminated: ok {rc=0} 22:18:58.401509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7212): Launched 22:18:58.723278 run osmo-hlr_10.42.42.2(pid=7213): Launched 22:18:58.847220 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:59.404498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7215): Launched 22:18:59.727230 run osmo-stp_10.42.42.5(pid=7216): Launched 22:18:59.851385 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:00.408292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7218): Launched 22:19:00.532545 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:00.806075 run patchelf(pid=7219): Launched 22:19:01.026816 run osmo-stp_10.42.42.5(pid=7216): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7216)] 22:19:01.158835 run osmo-stp_10.42.42.5(pid=7216): stdout: | (launched: 2022-12-13_22:18:59.669135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:01.293479 run osmo-stp_10.42.42.5(pid=7216): stderr: | 20221213221859858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221859858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221859859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221859859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221859859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221859860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221859860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:01.427480 run osmo-stp_10.42.42.5(pid=7216): stdout: | (launched: 2022-12-13_22:18:59.669135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:01.561480 run osmo-stp_10.42.42.5(pid=7216): stderr: | 20221213221859858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221859858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221859859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221859859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221859859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221859860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221859860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:01.714185 run patchelf(pid=7219): Terminating (SIGINT) 22:19:01.892592 run patchelf(pid=7219): Terminated: ok {rc=0} 22:19:02.019452 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7216): Process ended prematurely: osmo-stp_10.42.42.5(pid=7216) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7216)] [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 22:19:02.029671 tst iperf3.py:8: Test FAILED (7.7 sec) 22:19:02.057767 run osmo-hlr_10.42.42.2(pid=7213): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7213)] 22:19:02.107496 run osmo-hlr_10.42.42.2(pid=7213): stdout: | (launched: 2022-12-13_22:18:58.665330) 22:19:02.157932 run osmo-hlr_10.42.42.2(pid=7213): stderr: | 20221213221858860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221858860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221858860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221858860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221858861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221858861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221858877 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221858885 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221858885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221858885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:02.208454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7208): Terminating (SIGTERM) 22:19:02.248485 run iperf3-srv_10.42.42.10(pid=7209): Terminating (SIGTERM) 22:19:02.288349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7212): Terminating (SIGTERM) 22:19:02.327976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7215): Terminating (SIGTERM) 22:19:02.367508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7218): Terminating (SIGTERM) 22:19:02.407401 --- ParallelTerminationStrategy: PID 7208 died... 22:19:02.426447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7208): Terminated: ok {rc=0} 22:19:02.470302 --- ParallelTerminationStrategy: PID 7209 died... 22:19:02.489064 run iperf3-srv_10.42.42.10(pid=7209): Terminated {rc=256} 22:19:02.532738 --- ParallelTerminationStrategy: PID 7212 died... 22:19:02.551271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7212): Terminated: ok {rc=0} 22:19:02.594871 --- ParallelTerminationStrategy: PID 7215 died... 22:19:02.613472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7215): Terminated: ok {rc=0} 22:19:02.657046 --- ParallelTerminationStrategy: PID 7218 died... 22:19:02.675547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7218): Terminated: ok {rc=0} 22:19:02.760642 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:19:03.907714 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:03.919214 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:19:03.994685 tst iperf3m4.py: using LAC 36602 22:19:04.113502 tst iperf3m4.py: using RAC 137 22:19:04.232025 tst iperf3m4.py: using CellId 36602 22:19:04.348368 tst iperf3m4.py: using BVCI 36603 22:19:04.466565 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:04.478071 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:04.489338 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:04.500534 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:04.512134 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:04.523680 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:04.535333 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:04.546764 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:04.558528 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:19:04.676621 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:19:04.798243 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:19:04.915905 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:19:05.036108 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:19:05.254660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:19:05.578119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7220): Launched 22:19:05.859819 run iperf3-srv_10.42.42.10(pid=7221): Launched 22:19:05.981195 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:19:06.199009 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:19:06.522116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7222): Launched 22:19:06.803245 run iperf3-srv_10.42.42.10(pid=7223): Launched 22:19:06.924256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:19:07.141730 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:19:07.464410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7224): Launched 22:19:07.745667 run iperf3-srv_10.42.42.10(pid=7225): Launched 22:19:07.866368 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:19:08.083170 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:19:08.405586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7226): Launched 22:19:08.685551 run iperf3-srv_10.42.42.10(pid=7227): Launched 22:19:08.806249 tst iperf3m4.py:8: start network... 22:19:09.022736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:09.521619 run create_hlr_db(pid=7228): Launched 22:19:09.645070 bus /gobi_6: Setting Powered False 22:19:10.709537 run create_hlr_db(pid=7228): Terminated: ok {rc=0} 22:19:11.158255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7230): Launched 22:19:11.480569 run osmo-hlr_10.42.42.2(pid=7231): Launched 22:19:11.604297 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:12.163321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7233): Launched 22:19:12.486069 run osmo-stp_10.42.42.5(pid=7234): Launched 22:19:12.609551 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:13.167849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7236): Launched 22:19:13.291841 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:13.564418 run patchelf(pid=7237): Launched 22:19:13.744556 run osmo-stp_10.42.42.5(pid=7234): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7234)] 22:19:13.881181 run osmo-stp_10.42.42.5(pid=7234): stdout: | (launched: 2022-12-13_22:19:12.427755) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:14.019060 run osmo-stp_10.42.42.5(pid=7234): stderr: | 20221213221912621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221912621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221912621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221912622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221912622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221912622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221912622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:14.157085 run osmo-stp_10.42.42.5(pid=7234): stdout: | (launched: 2022-12-13_22:19:12.427755) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:14.289363 run osmo-stp_10.42.42.5(pid=7234): stderr: | 20221213221912621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221912621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221912621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221912622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221912622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221912622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221912622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:14.446261 run patchelf(pid=7237): Terminating (SIGINT) 22:19:14.626732 run patchelf(pid=7237): Terminated: ok {rc=0} 22:19:14.757699 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7234): Process ended prematurely: osmo-stp_10.42.42.5(pid=7234) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7234)] [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:19:14.767953 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:19:14.796855 run osmo-hlr_10.42.42.2(pid=7231): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7231)] 22:19:14.847628 run osmo-hlr_10.42.42.2(pid=7231): stdout: | (launched: 2022-12-13_22:19:11.422326) 22:19:14.899812 run osmo-hlr_10.42.42.2(pid=7231): stderr: | 20221213221911624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221911624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221911624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221911624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221911624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221911624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221911636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221911644 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221911645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221911645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:14.952125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7220): Terminating (SIGTERM) 22:19:14.994204 run iperf3-srv_10.42.42.10(pid=7221): Terminating (SIGTERM) 22:19:15.036098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7222): Terminating (SIGTERM) 22:19:15.078304 run iperf3-srv_10.42.42.10(pid=7223): Terminating (SIGTERM) 22:19:15.120825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7224): Terminating (SIGTERM) 22:19:15.163216 run iperf3-srv_10.42.42.10(pid=7225): Terminating (SIGTERM) 22:19:15.205214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7226): Terminating (SIGTERM) 22:19:15.247759 run iperf3-srv_10.42.42.10(pid=7227): Terminating (SIGTERM) 22:19:15.289879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7230): Terminating (SIGTERM) 22:19:15.332472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7233): Terminating (SIGTERM) 22:19:15.374674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7236): Terminating (SIGTERM) 22:19:15.417421 --- ParallelTerminationStrategy: PID 7220 died... 22:19:15.437742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7220): Terminated: ok {rc=0} 22:19:15.484176 --- ParallelTerminationStrategy: PID 7221 died... 22:19:15.503898 run iperf3-srv_10.42.42.10(pid=7221): Terminated {rc=256} 22:19:15.549914 --- ParallelTerminationStrategy: PID 7222 died... 22:19:15.569851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7222): Terminated: ok {rc=0} 22:19:15.616252 --- ParallelTerminationStrategy: PID 7223 died... 22:19:15.636210 run iperf3-srv_10.42.42.10(pid=7223): Terminated {rc=256} 22:19:15.682806 --- ParallelTerminationStrategy: PID 7224 died... 22:19:15.702693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7224): Terminated: ok {rc=0} 22:19:15.749293 --- ParallelTerminationStrategy: PID 7225 died... 22:19:15.769210 run iperf3-srv_10.42.42.10(pid=7225): Terminated {rc=256} 22:19:15.815133 --- ParallelTerminationStrategy: PID 7226 died... 22:19:15.838028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7226): Terminated: ok {rc=0} 22:19:15.885396 --- ParallelTerminationStrategy: PID 7227 died... 22:19:15.905962 run iperf3-srv_10.42.42.10(pid=7227): Terminated {rc=256} 22:19:15.953270 --- ParallelTerminationStrategy: PID 7230 died... 22:19:15.973988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7230): Terminated: ok {rc=0} 22:19:16.020522 --- ParallelTerminationStrategy: PID 7233 died... 22:19:16.041562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7233): Terminated: ok {rc=0} 22:19:16.089308 --- ParallelTerminationStrategy: PID 7236 died... 22:19:16.110065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7236): Terminated: ok {rc=0} 22:19:16.199165 bus /gobi_4: Setting Powered False 22:19:17.296445 bus /gobi_4: Setting Powered False 22:19:18.412350 bus /gobi_1: Setting Powered False 22:19:19.512177 bus /gobi_1: Setting Powered False 22:19:20.628115 bus /gobi_0: Setting Powered False 22:19:21.727967 bus /gobi_0: Setting Powered False 22:19:22.845983 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:19:23.949187 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:23.960546 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:19:24.031237 tst ping.py: using LAC 36603 22:19:24.147356 tst ping.py: using RAC 138 22:19:24.264879 tst ping.py: using CellId 36603 22:19:24.380617 tst ping.py: using BVCI 36604 22:19:24.496651 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:24.508170 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:24.519443 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:24.530812 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:24.542425 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:24.554007 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:24.565838 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:24.577393 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:19:24.692085 tst ping.py:19: start network... 22:19:24.889053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:25.345232 run create_hlr_db(pid=7238): Launched 22:19:25.467222 bus /gobi_6: Setting Powered False 22:19:26.526161 run create_hlr_db(pid=7238): Terminated: ok {rc=0} 22:19:26.958418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7240): Launched 22:19:27.275923 run osmo-hlr_10.42.42.2(pid=7241): Launched 22:19:27.397997 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:27.953735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7243): Launched 22:19:28.268610 run osmo-stp_10.42.42.5(pid=7244): Launched 22:19:28.389370 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:28.934855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7246): Launched 22:19:29.055545 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:29.321622 run patchelf(pid=7249): Launched 22:19:29.497331 run osmo-stp_10.42.42.5(pid=7244): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7244)] 22:19:29.631218 run osmo-stp_10.42.42.5(pid=7244): stdout: | (launched: 2022-12-13_22:19:28.211421) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:29.767271 run osmo-stp_10.42.42.5(pid=7244): stderr: | 20221213221928405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221928405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221928405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221928406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221928406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221928406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221928406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:29.903065 run osmo-stp_10.42.42.5(pid=7244): stdout: | (launched: 2022-12-13_22:19:28.211421) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:30.032830 run osmo-stp_10.42.42.5(pid=7244): stderr: | 20221213221928405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221928405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221928405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221928406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221928406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221928406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221928406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:30.186634 run patchelf(pid=7249): Terminating (SIGINT) 22:19:30.363255 run patchelf(pid=7249): Terminated: ok {rc=0} 22:19:30.490546 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7244): Process ended prematurely: osmo-stp_10.42.42.5(pid=7244) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7244)] [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 22:19:30.500140 tst ping.py:22: Test FAILED (6.5 sec) 22:19:30.528339 run osmo-hlr_10.42.42.2(pid=7241): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7241)] 22:19:30.579067 run osmo-hlr_10.42.42.2(pid=7241): stdout: | (launched: 2022-12-13_22:19:27.218066) 22:19:30.631092 run osmo-hlr_10.42.42.2(pid=7241): stderr: | 20221213221927413 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221927413 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221927413 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221927413 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221927413 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221927413 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221927426 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221927436 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221927436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221927436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:30.683578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7240): Terminating (SIGTERM) 22:19:30.725571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7243): Terminating (SIGTERM) 22:19:30.767724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7246): Terminating (SIGTERM) 22:19:30.810407 --- ParallelTerminationStrategy: PID 7240 died... 22:19:30.840225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7240): Terminated: ok {rc=0} 22:19:30.889337 --- ParallelTerminationStrategy: PID 7243 died... 22:19:30.910208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7243): Terminated: ok {rc=0} 22:19:30.959788 --- ParallelTerminationStrategy: PID 7246 died... 22:19:30.980108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7246): Terminated: ok {rc=0} 22:19:31.069630 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:19:32.156656 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:32.170266 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:19:32.247634 tst ping_idle_ping.py: using LAC 36604 22:19:32.380673 tst ping_idle_ping.py: using RAC 139 22:19:32.503482 tst ping_idle_ping.py: using CellId 36604 22:19:32.625833 tst ping_idle_ping.py: using BVCI 36605 22:19:32.741462 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:32.752822 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:32.764213 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:32.775481 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:32.787110 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:32.798728 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:32.810542 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:19:32.822540 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:19:32.942565 tst ping_idle_ping.py:24: start network... 22:19:33.156420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:33.651204 run create_hlr_db(pid=7250): Launched 22:19:33.773445 bus /gobi_6: Setting Powered False 22:19:34.836464 run create_hlr_db(pid=7250): Terminated: ok {rc=0} 22:19:35.260153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7252): Launched 22:19:35.557177 run osmo-hlr_10.42.42.2(pid=7253): Launched 22:19:35.670791 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:36.181190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7255): Launched 22:19:36.477983 run osmo-stp_10.42.42.5(pid=7256): Launched 22:19:36.592000 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:37.103043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7258): Launched 22:19:37.216535 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:37.466703 run patchelf(pid=7259): Launched 22:19:37.631996 run osmo-stp_10.42.42.5(pid=7256): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7256)] 22:19:37.757499 run osmo-stp_10.42.42.5(pid=7256): stdout: | (launched: 2022-12-13_22:19:36.423954) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:37.885243 run osmo-stp_10.42.42.5(pid=7256): stderr: | 20221213221936592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221936592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221936592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221936593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221936593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221936593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221936594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:38.012095 run osmo-stp_10.42.42.5(pid=7256): stdout: | (launched: 2022-12-13_22:19:36.423954) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:38.134103 run osmo-stp_10.42.42.5(pid=7256): stderr: | 20221213221936592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221936592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221936592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221936593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221936593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221936593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221936594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:38.278335 run patchelf(pid=7259): Terminating (SIGINT) 22:19:38.445419 run patchelf(pid=7259): Terminated: ok {rc=0} 22:19:38.565677 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7256): Process ended prematurely: osmo-stp_10.42.42.5(pid=7256) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7256)] [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:19:38.574563 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:19:38.600624 run osmo-hlr_10.42.42.2(pid=7253): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7253)] 22:19:38.647831 run osmo-hlr_10.42.42.2(pid=7253): stdout: | (launched: 2022-12-13_22:19:35.503319) 22:19:38.696516 run osmo-hlr_10.42.42.2(pid=7253): stderr: | 20221213221935681 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221935681 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221935681 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221935681 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221935681 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221935681 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221935694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221935702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221935702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221935702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:38.745591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7252): Terminating (SIGTERM) 22:19:38.784908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7255): Terminating (SIGTERM) 22:19:38.824174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7258): Terminating (SIGTERM) 22:19:38.864036 --- ParallelTerminationStrategy: PID 7252 died... 22:19:38.883225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7252): Terminated: ok {rc=0} 22:19:38.926775 --- ParallelTerminationStrategy: PID 7255 died... 22:19:38.945061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7255): Terminated: ok {rc=0} 22:19:38.988390 --- ParallelTerminationStrategy: PID 7258 died... 22:19:39.006946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7258): Terminated: ok {rc=0} 22:19:39.091842 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:19:40.400434 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:19:40.409453 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:19:40.444553 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:19:40.479995 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:19:40.535107 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:19:40.568712 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:19:40.602487 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:19:41.165177 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2395 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:19:41.170437 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:41.182166 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:19:41.254477 tst switch_tch_pdch.py: using LAC 36605 22:19:41.379910 tst switch_tch_pdch.py: using RAC 140 22:19:41.502873 tst switch_tch_pdch.py: using CellId 36605 22:19:41.628714 tst switch_tch_pdch.py: using BVCI 36606 22:19:41.745510 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:41.757221 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:41.768672 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:41.780294 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:41.792193 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:41.804069 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:41.816038 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:19:41.827932 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:19:41.951357 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:19:42.068165 tst switch_tch_pdch.py:51: start network... 22:19:42.265903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:42.724632 run create_hlr_db(pid=7263): Launched 22:19:42.847259 bus /gobi_6: Setting Powered False 22:19:43.907674 run create_hlr_db(pid=7263): Terminated: ok {rc=0} 22:19:44.341686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7265): Launched 22:19:44.657654 run osmo-hlr_10.42.42.2(pid=7266): Launched 22:19:44.778971 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:45.325408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7268): Launched 22:19:45.641012 run osmo-stp_10.42.42.5(pid=7269): Launched 22:19:45.763267 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:46.392148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7271): Launched 22:19:46.529695 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:46.807407 run patchelf(pid=7272): Launched 22:19:46.989472 run osmo-stp_10.42.42.5(pid=7269): ERR: Terminated: ERROR {rc=1} [trial-2395↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7269)] 22:19:47.120214 run osmo-stp_10.42.42.5(pid=7269): stdout: | (launched: 2022-12-13_22:19:45.584066) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:47.250315 run osmo-stp_10.42.42.5(pid=7269): stderr: | 20221213221945774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221945774 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221945775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221945775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221945777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221945778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221945778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:47.378829 run osmo-stp_10.42.42.5(pid=7269): stdout: | (launched: 2022-12-13_22:19:45.584066) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:47.500817 run osmo-stp_10.42.42.5(pid=7269): stderr: | 20221213221945774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221945774 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221945775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221945775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221945777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221945778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221945778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:47.646120 run patchelf(pid=7272): Terminating (SIGINT) 22:19:47.813141 run patchelf(pid=7272): Terminated: ok {rc=0} 22:19:47.933855 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7269): Process ended prematurely: osmo-stp_10.42.42.5(pid=7269) [trial-2395↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7269)] [trial-2395↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:19:47.942753 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 22:19:47.969468 run osmo-hlr_10.42.42.2(pid=7266): ERR: Terminated: ERROR {rc=237} [trial-2395↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7266)] 22:19:48.018291 run osmo-hlr_10.42.42.2(pid=7266): stdout: | (launched: 2022-12-13_22:19:44.600653) 22:19:48.068223 run osmo-hlr_10.42.42.2(pid=7266): stderr: | 20221213221944796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221944796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221944796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221944796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221944797 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221944797 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221944808 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221944816 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221944817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221944817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:48.118566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7265): Terminating (SIGTERM) 22:19:48.158867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7268): Terminating (SIGTERM) 22:19:48.198911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7271): Terminating (SIGTERM) 22:19:48.239074 --- ParallelTerminationStrategy: PID 7265 died... 22:19:48.258653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7265): Terminated: ok {rc=0} 22:19:48.303192 --- ParallelTerminationStrategy: PID 7268 died... 22:19:48.322343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7268): Terminated: ok {rc=0} 22:19:48.366778 --- ParallelTerminationStrategy: PID 7271 died... 22:19:48.386053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7271): Terminated: ok {rc=0} 22:19:48.473086 bus /gobi_0: Setting Powered False 22:19:49.572450 bus /gobi_0: Setting Powered False 22:19:50.684790 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:19:51.941170 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:19:51.947833 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:19:51.984009 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:19:52.020101 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:19:52.076108 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:19:52.112915 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:19:52.149284 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:19:52.701912 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2395 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:19:52.707660 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:52.719276 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:19:52.794082 tst switch_tch_pdch.py: using LAC 36606 22:19:52.912642 tst switch_tch_pdch.py: using RAC 141 22:19:53.029357 tst switch_tch_pdch.py: using CellId 36606 22:19:53.145768 tst switch_tch_pdch.py: using BVCI 36607 22:19:53.263051 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:53.274687 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:53.286211 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:53.297770 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:53.309489 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:53.321384 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:53.333109 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:19:53.344741 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:19:53.463268 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:19:53.580344 tst switch_tch_pdch.py:51: start network... 22:19:53.777632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:54.210883 run create_hlr_db(pid=7276): Launched 22:19:54.334366 bus /gobi_6: Setting Powered False 22:19:55.393458 run create_hlr_db(pid=7276): Terminated: ok {rc=0} 22:19:55.801838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7278): Launched 22:19:56.119939 run osmo-hlr_10.42.42.2(pid=7279): Launched 22:19:56.241710 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:56.760410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7281): Launched 22:19:57.076844 run osmo-stp_10.42.42.5(pid=7282): Launched 22:19:57.198518 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:57.718437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7284): Launched 22:19:57.839939 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:58.106698 run patchelf(pid=7285): Launched 22:19:58.282810 run osmo-stp_10.42.42.5(pid=7282): ERR: Terminated: ERROR {rc=1} [trial-2395↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7282)] 22:19:58.417470 run osmo-stp_10.42.42.5(pid=7282): stdout: | (launched: 2022-12-13_22:19:57.019761) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:58.553732 run osmo-stp_10.42.42.5(pid=7282): stderr: | 20221213221957211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221957212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221957212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221957212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221957213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221957213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221957213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:58.690241 run osmo-stp_10.42.42.5(pid=7282): stdout: | (launched: 2022-12-13_22:19:57.019761) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:58.820745 run osmo-stp_10.42.42.5(pid=7282): stderr: | 20221213221957211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213221957212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213221957212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213221957212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213221957213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213221957213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213221957213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:58.975347 run patchelf(pid=7285): Terminating (SIGINT) 22:19:59.152735 run patchelf(pid=7285): Terminated: ok {rc=0} 22:19:59.280566 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7282): Process ended prematurely: osmo-stp_10.42.42.5(pid=7282) [trial-2395↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7282)] [trial-2395↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:19:59.290141 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 22:19:59.318020 run osmo-hlr_10.42.42.2(pid=7279): ERR: Terminated: ERROR {rc=237} [trial-2395↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7279)] 22:19:59.369077 run osmo-hlr_10.42.42.2(pid=7279): stdout: | (launched: 2022-12-13_22:19:56.062458) 22:19:59.421713 run osmo-hlr_10.42.42.2(pid=7279): stderr: | 20221213221956260 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213221956260 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213221956260 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213221956260 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213221956260 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213221956260 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213221956273 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213221956282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213221956282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213221956282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:59.474365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7278): Terminating (SIGTERM) 22:19:59.516344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7281): Terminating (SIGTERM) 22:19:59.558433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7284): Terminating (SIGTERM) 22:19:59.601251 --- ParallelTerminationStrategy: PID 7278 died... 22:19:59.621615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7278): Terminated: ok {rc=0} 22:19:59.668315 --- ParallelTerminationStrategy: PID 7281 died... 22:19:59.688315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7281): Terminated: ok {rc=0} 22:19:59.734828 --- ParallelTerminationStrategy: PID 7284 died... 22:19:59.754793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7284): Terminated: ok {rc=0} 22:19:59.843206 bus /gobi_0: Setting Powered False 22:20:00.947743 bus /gobi_0: Setting Powered False 22:20:02.069327 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_sms:trx-umtrx --------------------------------------------------------------------- 22:20:03.338724 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:03.343219 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:20:03.376421 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 22:20:03.384252 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 22:20:03.439116 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:20:03.470855 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 22:20:03.477637 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 22:20:04.014765 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 22:20:04.019636 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 22:20:04.030263 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 22:20:04.080152 tst mo_mt_sms.py: using LAC 36607 22:20:04.194664 tst mo_mt_sms.py: using RAC 142 22:20:04.308691 tst mo_mt_sms.py: using CellId 36607 22:20:04.422629 tst mo_mt_sms.py: using BVCI 36608 22:20:04.528735 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 22:20:04.648152 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 22:20:04.765349 tst mo_mt_sms.py:9: start nitb and bts... 22:20:04.980547 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:20:05.627103 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7292): Launched 22:20:05.945037 run osmo-nitb_10.42.42.2(pid=7293): Launched 22:20:06.121738 run osmo-nitb_10.42.42.2(pid=7293): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7293)] 22:20:06.264060 run osmo-nitb_10.42.42.2(pid=7293): stdout: | (launched: 2022-12-13_22:20:05.887372) 22:20:06.407855 run osmo-nitb_10.42.42.2(pid=7293): stderr: | (launched: 2022-12-13_22:20:05.934576) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:20:06.551665 run osmo-nitb_10.42.42.2(pid=7293): stdout: | (launched: 2022-12-13_22:20:05.887372) 22:20:06.690135 run osmo-nitb_10.42.42.2(pid=7293): stderr: | (launched: 2022-12-13_22:20:05.934576) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7293): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7293) [trial-2395↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7293)] 22:20:07.065274 tst osmo-nitb_10.42.42.2(pid=7293): stdout: | (launched: 2022-12-13_22:20:05.887372) 22:20:07.193583 tst osmo-nitb_10.42.42.2(pid=7293): stderr: | (launched: 2022-12-13_22:20:05.934576) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:20:07.345500 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=7293): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7293) [trial-2395↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7293)] [trial-2395↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 22:20:07.354714 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 22:20:07.362022 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7292): Terminating (SIGTERM) 22:20:07.573468 --- ParallelTerminationStrategy: PID 7292 died... 22:20:07.595185 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7292): Terminated: ok {rc=0} 22:20:07.684011 bus /sierra_3: Setting Powered False 22:20:08.780498 bus /sierra_3: Setting Powered False 22:20:09.896618 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 sms:trx-umtrx --------------------------------------------------------------------- 22:20:11.093437 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:11.097328 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:20:11.129084 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:20:11.155348 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 22:20:11.206110 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:20:11.238625 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:20:11.264849 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 22:20:11.810867 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 22:20:11.815767 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:11.826334 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 22:20:11.872350 tst mo_mt_sms.py: using LAC 36608 22:20:11.989472 tst mo_mt_sms.py: using RAC 143 22:20:12.105461 tst mo_mt_sms.py: using CellId 36608 22:20:12.232339 tst mo_mt_sms.py: using BVCI 36609 22:20:12.347503 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:12.358454 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:12.369311 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:12.379994 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:12.391675 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:12.403492 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 22:20:12.519349 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 22:20:12.636668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:13.127702 run create_hlr_db(pid=7297): Launched 22:20:13.250598 bus /sierra_2: Setting Powered False 22:20:14.313515 run create_hlr_db(pid=7297): Terminated: ok {rc=0} 22:20:14.736886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7299): Launched 22:20:15.031532 run osmo-hlr_10.42.42.2(pid=7300): Launched 22:20:15.144368 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:15.667726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7302): Launched 22:20:16.002266 run osmo-stp_10.42.42.5(pid=7303): Launched 22:20:16.134951 run osmo-msc_10.42.42.6: Starting osmo-msc 22:20:16.966247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7305): Launched 22:20:17.345720 run osmo-msc_10.42.42.6(pid=7306): Launched 22:20:17.520752 run osmo-stp_10.42.42.5(pid=7303): ERR: Terminated: ERROR {rc=1} [trial-2395↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7303)] 22:20:17.645343 run osmo-stp_10.42.42.5(pid=7303): stdout: | (launched: 2022-12-13_22:20:15.930698) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:17.772499 run osmo-stp_10.42.42.5(pid=7303): stderr: | 20221213222016291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222016291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222016291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222016291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222016292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222016292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222016292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:17.895562 run osmo-stp_10.42.42.5(pid=7303): stdout: | (launched: 2022-12-13_22:20:15.930698) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:18.012889 run osmo-stp_10.42.42.5(pid=7303): stderr: | 20221213222016291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222016291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222016291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222016291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222016292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222016292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222016292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:18.153570 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=7303): Process ended prematurely: osmo-stp_10.42.42.5(pid=7303) [trial-2395↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7303)] [trial-2395↪sms:trx-umtrx↪mo_mt_sms.py:16] 22:20:18.161964 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 22:20:18.188115 run osmo-hlr_10.42.42.2(pid=7300): ERR: Terminated: ERROR {rc=237} [trial-2395↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7300)] 22:20:18.235771 run osmo-hlr_10.42.42.2(pid=7300): stdout: | (launched: 2022-12-13_22:20:14.977536) 22:20:18.285244 run osmo-hlr_10.42.42.2(pid=7300): stderr: | 20221213222015155 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222015155 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222015155 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222015155 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222015155 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222015155 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222015169 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222015177 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222015177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222015177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:18.354230 run osmo-msc_10.42.42.6(pid=7306): ERR: Terminated: ERROR {rc=2} [trial-2395↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7306)] 22:20:18.401569 run osmo-msc_10.42.42.6(pid=7306): stdout: | (launched: 2022-12-13_22:20:17.273085) 22:20:18.450500 run osmo-msc_10.42.42.6(pid=7306): stderr: | 20221213222017631 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222017632 DLGLOBAL DEBUG validating counter group 0x7ff74f84dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222017632 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222017632 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222017632 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222017632 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222017634 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222017634 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222017634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222017634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:20:18.499755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7299): Terminating (SIGTERM) 22:20:18.539279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7302): Terminating (SIGTERM) 22:20:18.578732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7305): Terminating (SIGTERM) 22:20:18.618516 --- ParallelTerminationStrategy: PID 7299 died... 22:20:18.637492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7299): Terminated: ok {rc=0} 22:20:18.681259 --- ParallelTerminationStrategy: PID 7302 died... 22:20:18.699824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7302): Terminated: ok {rc=0} 22:20:18.743515 --- ParallelTerminationStrategy: PID 7305 died... 22:20:18.762121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7305): Terminated: ok {rc=0} 22:20:18.847628 bus /sierra_3: Setting Powered False 22:20:19.946133 bus /sierra_3: Setting Powered False 22:20:21.060466 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 22:20:22.288293 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:22.292202 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:20:22.324027 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 22:20:22.330748 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 22:20:22.366187 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:20:22.398653 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 22:20:22.405322 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 22:20:22.930925 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2395 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 22:20:22.936726 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 22:20:22.948313 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 22:20:22.997583 tst assert_extension.py: using LAC 36609 22:20:23.113157 tst assert_extension.py: using RAC 144 22:20:23.230769 tst assert_extension.py: using CellId 36609 22:20:23.346713 tst assert_extension.py: using BVCI 36610 22:20:23.453388 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 22:20:23.571326 tst assert_extension.py:10: start nitb and bts... 22:20:23.784645 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:20:24.430116 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7312): Launched 22:20:24.746278 run osmo-nitb_10.42.42.2(pid=7313): Launched 22:20:24.922237 run osmo-nitb_10.42.42.2(pid=7313): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7313)] 22:20:25.064417 run osmo-nitb_10.42.42.2(pid=7313): stdout: | (launched: 2022-12-13_22:20:24.688474) 22:20:25.208107 run osmo-nitb_10.42.42.2(pid=7313): stderr: | (launched: 2022-12-13_22:20:24.736360) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:20:25.352039 run osmo-nitb_10.42.42.2(pid=7313): stdout: | (launched: 2022-12-13_22:20:24.688474) 22:20:25.490443 run osmo-nitb_10.42.42.2(pid=7313): stderr: | (launched: 2022-12-13_22:20:24.736360) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7313): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7313) [trial-2395↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7313)] 22:20:25.866237 tst osmo-nitb_10.42.42.2(pid=7313): stdout: | (launched: 2022-12-13_22:20:24.688474) 22:20:25.994698 tst osmo-nitb_10.42.42.2(pid=7313): stderr: | (launched: 2022-12-13_22:20:24.736360) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:20:26.145408 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=7313): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7313) [trial-2395↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7313)] [trial-2395↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 22:20:26.154536 tst assert_extension.py:12: Test FAILED (3.2 sec) 22:20:26.161711 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7312): Terminating (SIGTERM) 22:20:26.373107 --- ParallelTerminationStrategy: PID 7312 died... 22:20:26.393899 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7312): Terminated: ok {rc=0} 22:20:26.482938 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 ussd:trx-umtrx --------------------------------------------------------------------- 22:20:27.660411 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:27.664528 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:20:27.696224 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:20:27.722368 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 22:20:27.755892 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:20:27.787979 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:20:27.814087 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 22:20:28.344660 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2395 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 22:20:28.349520 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:28.359805 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 22:20:28.406051 tst assert_extension.py: using LAC 36610 22:20:28.521932 tst assert_extension.py: using RAC 145 22:20:28.640036 tst assert_extension.py: using CellId 36610 22:20:28.755811 tst assert_extension.py: using BVCI 36611 22:20:28.862637 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:28.873123 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:28.883473 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:28.893763 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:28.904068 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:20:28.914382 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 22:20:29.032796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:29.523814 run create_hlr_db(pid=7317): Launched 22:20:29.646805 bus /sierra_2: Setting Powered False 22:20:30.710158 run create_hlr_db(pid=7317): Terminated: ok {rc=0} 22:20:31.212095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7319): Launched 22:20:31.541791 run osmo-hlr_10.42.42.2(pid=7320): Launched 22:20:31.790377 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:32.440215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7322): Launched 22:20:32.756077 run osmo-stp_10.42.42.5(pid=7323): Launched 22:20:32.878469 run osmo-msc_10.42.42.6: Starting osmo-msc 22:20:33.448592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7325): Launched 22:20:33.763320 run osmo-msc_10.42.42.6(pid=7326): Launched 22:20:33.941411 run osmo-stp_10.42.42.5(pid=7323): ERR: Terminated: ERROR {rc=1} [trial-2395↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7323)] 22:20:34.075588 run osmo-stp_10.42.42.5(pid=7323): stdout: | (launched: 2022-12-13_22:20:32.698698) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:34.210916 run osmo-stp_10.42.42.5(pid=7323): stderr: | 20221213222032889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222032889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222032890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222032890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222032890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222032890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222032890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:34.345794 run osmo-stp_10.42.42.5(pid=7323): stdout: | (launched: 2022-12-13_22:20:32.698698) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:34.471942 run osmo-stp_10.42.42.5(pid=7323): stderr: | 20221213222032889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222032889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222032890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222032890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222032890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222032890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222032890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:34.622749 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=7323): Process ended prematurely: osmo-stp_10.42.42.5(pid=7323) [trial-2395↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7323)] [trial-2395↪ussd:trx-umtrx↪assert_extension.py:17] 22:20:34.631529 tst assert_extension.py:17: Test FAILED (6.3 sec) 22:20:34.658702 run osmo-hlr_10.42.42.2(pid=7320): ERR: Terminated: ERROR {rc=237} [trial-2395↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7320)] 22:20:34.709470 run osmo-hlr_10.42.42.2(pid=7320): stdout: | (launched: 2022-12-13_22:20:31.477281) 22:20:34.761527 run osmo-hlr_10.42.42.2(pid=7320): stderr: | 20221213222031785 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222031785 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222031785 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222031785 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222031785 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222031785 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222031799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222031815 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222031815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222031816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:34.833554 run osmo-msc_10.42.42.6(pid=7326): ERR: Terminated: ERROR {rc=2} [trial-2395↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7326)] 22:20:34.883208 run osmo-msc_10.42.42.6(pid=7326): stdout: | (launched: 2022-12-13_22:20:33.706144) 22:20:34.934767 run osmo-msc_10.42.42.6(pid=7326): stderr: | 20221213222034025 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222034025 DLGLOBAL DEBUG validating counter group 0x7fdd9dd3fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222034026 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222034026 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222034026 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222034026 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222034028 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222034028 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222034028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222034028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:20:34.986735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7319): Terminating (SIGTERM) 22:20:35.028408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7322): Terminating (SIGTERM) 22:20:35.070143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7325): Terminating (SIGTERM) 22:20:35.112131 --- ParallelTerminationStrategy: PID 7319 died... 22:20:35.132436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7319): Terminated: ok {rc=0} 22:20:35.178507 --- ParallelTerminationStrategy: PID 7322 died... 22:20:35.198155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7322): Terminated: ok {rc=0} 22:20:35.244119 --- ParallelTerminationStrategy: PID 7325 died... 22:20:35.263851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7325): Terminated: ok {rc=0} 22:20:35.351650 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:20:36.560178 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:36.567192 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:20:36.599990 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:20:36.628414 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:20:36.681048 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:20:36.714390 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:20:36.741506 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:20:37.292890 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:20:37.345714 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:37.357177 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:20:37.427331 tst mo_mt_call.py: using LAC 36611 22:20:37.554800 tst mo_mt_call.py: using RAC 146 22:20:37.682620 tst mo_mt_call.py: using CellId 36611 22:20:37.808828 tst mo_mt_call.py: using BVCI 36612 22:20:37.926816 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:37.938310 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:37.949892 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:37.961192 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:37.972887 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:37.984544 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:20:38.101377 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:20:38.222342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:38.723076 run create_hlr_db(pid=7331): Launched 22:20:38.846296 bus /sierra_2: Setting Powered False 22:20:39.910647 run create_hlr_db(pid=7331): Terminated: ok {rc=0} 22:20:40.360310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7333): Launched 22:20:40.684931 run osmo-hlr_10.42.42.2(pid=7334): Launched 22:20:40.809964 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:41.369198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7336): Launched 22:20:41.691327 run osmo-stp_10.42.42.5(pid=7337): Launched 22:20:41.815583 run osmo-msc_10.42.42.6: Starting osmo-msc 22:20:42.433099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7339): Launched 22:20:42.734805 run osmo-msc_10.42.42.6(pid=7340): Launched 22:20:42.902720 run osmo-stp_10.42.42.5(pid=7337): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7337)] 22:20:43.030077 run osmo-stp_10.42.42.5(pid=7337): stdout: | (launched: 2022-12-13_22:20:41.633398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:43.157197 run osmo-stp_10.42.42.5(pid=7337): stderr: | 20221213222041822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222041822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222041822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222041823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222041825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222041825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222041826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:43.282432 run osmo-stp_10.42.42.5(pid=7337): stdout: | (launched: 2022-12-13_22:20:41.633398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:43.402178 run osmo-stp_10.42.42.5(pid=7337): stderr: | 20221213222041822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222041822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222041822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222041823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222041825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222041825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222041826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:43.545581 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7337): Process ended prematurely: osmo-stp_10.42.42.5(pid=7337) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7337)] [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:20:43.554392 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:20:43.580724 run osmo-hlr_10.42.42.2(pid=7334): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7334)] 22:20:43.628481 run osmo-hlr_10.42.42.2(pid=7334): stdout: | (launched: 2022-12-13_22:20:40.625059) 22:20:43.677809 run osmo-hlr_10.42.42.2(pid=7334): stderr: | 20221213222040824 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222040824 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222040824 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222040824 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222040824 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222040824 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222040836 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222040845 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222040845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222040845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:43.746708 run osmo-msc_10.42.42.6(pid=7340): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7340)] 22:20:43.794259 run osmo-msc_10.42.42.6(pid=7340): stdout: | (launched: 2022-12-13_22:20:42.679906) 22:20:43.843520 run osmo-msc_10.42.42.6(pid=7340): stderr: | 20221213222042950 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222042950 DLGLOBAL DEBUG validating counter group 0x7efc61b1fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222042950 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222042950 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222042950 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222042951 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222042952 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222042953 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222042953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222042953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:20:43.892912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7333): Terminating (SIGTERM) 22:20:43.932616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7336): Terminating (SIGTERM) 22:20:43.972613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7339): Terminating (SIGTERM) 22:20:44.012509 --- ParallelTerminationStrategy: PID 7333 died... 22:20:44.031560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7333): Terminated: ok {rc=0} 22:20:44.075590 --- ParallelTerminationStrategy: PID 7336 died... 22:20:44.094183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7336): Terminated: ok {rc=0} 22:20:44.138348 --- ParallelTerminationStrategy: PID 7339 died... 22:20:44.157068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7339): Terminated: ok {rc=0} 22:20:44.241031 bus /sierra_3: Setting Powered False 22:20:45.338284 bus /sierra_3: Setting Powered False 22:20:46.478893 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:20:47.643113 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:47.655124 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:20:47.726664 tst mo_mt_call_osmux.py: using LAC 36612 22:20:47.853476 tst mo_mt_call_osmux.py: using RAC 147 22:20:47.972640 tst mo_mt_call_osmux.py: using CellId 36612 22:20:48.091316 tst mo_mt_call_osmux.py: using BVCI 36613 22:20:48.201986 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:48.212883 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:48.223774 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:48.234598 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:48.246021 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:20:48.257605 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:20:48.378221 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:20:48.499052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:48.997132 run create_hlr_db(pid=7342): Launched 22:20:49.121405 bus /sierra_2: Setting Powered False 22:20:50.185237 run create_hlr_db(pid=7342): Terminated: ok {rc=0} 22:20:50.633118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7344): Launched 22:20:50.954452 run osmo-hlr_10.42.42.2(pid=7345): Launched 22:20:51.078047 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:51.629696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7347): Launched 22:20:51.955638 run osmo-stp_10.42.42.5(pid=7349): Launched 22:20:52.073709 run osmo-msc_10.42.42.6: Starting osmo-msc 22:20:52.622222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7351): Launched 22:20:52.923219 run osmo-msc_10.42.42.6(pid=7352): Launched 22:20:53.091979 run osmo-stp_10.42.42.5(pid=7349): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7349)] 22:20:53.218707 run osmo-stp_10.42.42.5(pid=7349): stdout: | (launched: 2022-12-13_22:20:51.894055) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:53.345698 run osmo-stp_10.42.42.5(pid=7349): stderr: | 20221213222052072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222052072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222052072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222052073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222052073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222052073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222052074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:53.471385 run osmo-stp_10.42.42.5(pid=7349): stdout: | (launched: 2022-12-13_22:20:51.894055) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:53.591175 run osmo-stp_10.42.42.5(pid=7349): stderr: | 20221213222052072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222052072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222052072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222052073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222052073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222052073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222052074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:53.734610 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7349): Process ended prematurely: osmo-stp_10.42.42.5(pid=7349) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7349)] [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:20:53.743293 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:20:53.769470 run osmo-hlr_10.42.42.2(pid=7345): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7345)] 22:20:53.817118 run osmo-hlr_10.42.42.2(pid=7345): stdout: | (launched: 2022-12-13_22:20:50.896610) 22:20:53.866188 run osmo-hlr_10.42.42.2(pid=7345): stderr: | 20221213222051093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222051093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222051093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222051093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222051093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222051093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222051105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222051113 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222051114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222051114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:53.934884 run osmo-msc_10.42.42.6(pid=7352): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7352)] 22:20:53.982244 run osmo-msc_10.42.42.6(pid=7352): stdout: | (launched: 2022-12-13_22:20:52.868381) 22:20:54.031167 run osmo-msc_10.42.42.6(pid=7352): stderr: | 20221213222053139 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222053139 DLGLOBAL DEBUG validating counter group 0x7f3b24cc5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222053139 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222053139 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222053139 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222053140 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222053141 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222053142 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222053142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222053142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:20:54.080584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7344): Terminating (SIGTERM) 22:20:54.119962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7347): Terminating (SIGTERM) 22:20:54.159377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7351): Terminating (SIGTERM) 22:20:54.199219 --- ParallelTerminationStrategy: PID 7344 died... 22:20:54.218422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7344): Terminated: ok {rc=0} 22:20:54.262146 --- ParallelTerminationStrategy: PID 7347 died... 22:20:54.280706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7347): Terminated: ok {rc=0} 22:20:54.324302 --- ParallelTerminationStrategy: PID 7351 died... 22:20:54.343042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7351): Terminated: ok {rc=0} 22:20:54.428362 bus /sierra_3: Setting Powered False 22:20:55.529030 bus /sierra_3: Setting Powered False 22:20:56.642441 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:20:57.896200 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:57.903265 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:20:57.936129 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:20:57.963859 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:20:58.018817 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:20:58.051873 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:20:58.078231 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:20:58.625922 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:20:58.680475 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:58.692138 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:20:58.762418 tst mo_mt_call.py: using LAC 36613 22:20:58.887280 tst mo_mt_call.py: using RAC 148 22:20:59.012928 tst mo_mt_call.py: using CellId 36613 22:20:59.138122 tst mo_mt_call.py: using BVCI 36614 22:20:59.254537 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:59.266054 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:59.277448 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:59.288625 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:59.300347 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:20:59.312029 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:20:59.429773 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:20:59.549373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:00.050401 run create_hlr_db(pid=7357): Launched 22:21:00.173788 bus /sierra_2: Setting Powered False 22:21:01.233748 run create_hlr_db(pid=7357): Terminated: ok {rc=0} 22:21:01.685990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7359): Launched 22:21:02.006142 run osmo-hlr_10.42.42.2(pid=7360): Launched 22:21:02.230023 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:02.805390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7362): Launched 22:21:03.127014 run osmo-stp_10.42.42.5(pid=7363): Launched 22:21:03.250144 run osmo-msc_10.42.42.6: Starting osmo-msc 22:21:03.833756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7365): Launched 22:21:04.154728 run osmo-msc_10.42.42.6(pid=7366): Launched 22:21:04.335090 run osmo-stp_10.42.42.5(pid=7363): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7363)] 22:21:04.475099 run osmo-stp_10.42.42.5(pid=7363): stdout: | (launched: 2022-12-13_22:21:03.069018) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:04.610008 run osmo-stp_10.42.42.5(pid=7363): stderr: | 20221213222103262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222103262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222103262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222103263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222103263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222103263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222103263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:04.743887 run osmo-stp_10.42.42.5(pid=7363): stdout: | (launched: 2022-12-13_22:21:03.069018) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:04.872286 run osmo-stp_10.42.42.5(pid=7363): stderr: | 20221213222103262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222103262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222103262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222103263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222103263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222103263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222103263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:05.026004 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7363): Process ended prematurely: osmo-stp_10.42.42.5(pid=7363) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7363)] [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:21:05.035780 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:21:05.064011 run osmo-hlr_10.42.42.2(pid=7360): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7360)] 22:21:05.115719 run osmo-hlr_10.42.42.2(pid=7360): stdout: | (launched: 2022-12-13_22:21:01.944173) 22:21:05.168354 run osmo-hlr_10.42.42.2(pid=7360): stderr: | 20221213222102210 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222102210 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222102210 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222102210 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222102210 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222102210 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222102235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222102258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222102258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222102258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:05.241152 run osmo-msc_10.42.42.6(pid=7366): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7366)] 22:21:05.291631 run osmo-msc_10.42.42.6(pid=7366): stdout: | (launched: 2022-12-13_22:21:04.096879) 22:21:05.343735 run osmo-msc_10.42.42.6(pid=7366): stderr: | 20221213222104416 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222104416 DLGLOBAL DEBUG validating counter group 0x7f4a2b7aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222104416 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222104416 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222104416 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222104417 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222104418 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222104419 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222104419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222104419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:05.396839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7359): Terminating (SIGTERM) 22:21:05.438731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7362): Terminating (SIGTERM) 22:21:05.481450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7365): Terminating (SIGTERM) 22:21:05.524544 --- ParallelTerminationStrategy: PID 7359 died... 22:21:05.545325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7359): Terminated: ok {rc=0} 22:21:05.592206 --- ParallelTerminationStrategy: PID 7362 died... 22:21:05.612366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7362): Terminated: ok {rc=0} 22:21:05.659300 --- ParallelTerminationStrategy: PID 7365 died... 22:21:05.679422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7365): Terminated: ok {rc=0} 22:21:05.768409 bus /sierra_3: Setting Powered False 22:21:06.867438 bus /sierra_3: Setting Powered False 22:21:07.987360 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:21:09.133992 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:09.145678 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:21:09.213922 tst mo_mt_call_osmux.py: using LAC 36614 22:21:09.332353 tst mo_mt_call_osmux.py: using RAC 149 22:21:09.450703 tst mo_mt_call_osmux.py: using CellId 36614 22:21:09.570345 tst mo_mt_call_osmux.py: using BVCI 36615 22:21:09.688605 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:09.700368 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:09.711659 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:09.723129 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:09.735447 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:21:09.747175 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:21:09.863766 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:21:09.988292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:10.489651 run create_hlr_db(pid=7368): Launched 22:21:10.612865 bus /sierra_2: Setting Powered False 22:21:11.676654 run create_hlr_db(pid=7368): Terminated: ok {rc=0} 22:21:12.126183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7370): Launched 22:21:12.447777 run osmo-hlr_10.42.42.2(pid=7371): Launched 22:21:12.572591 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:13.130454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7373): Launched 22:21:13.453166 run osmo-stp_10.42.42.5(pid=7374): Launched 22:21:13.577238 run osmo-msc_10.42.42.6: Starting osmo-msc 22:21:14.160910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7376): Launched 22:21:14.483064 run osmo-msc_10.42.42.6(pid=7377): Launched 22:21:14.663548 run osmo-stp_10.42.42.5(pid=7374): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7374)] 22:21:14.802848 run osmo-stp_10.42.42.5(pid=7374): stdout: | (launched: 2022-12-13_22:21:13.395218) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:14.940647 run osmo-stp_10.42.42.5(pid=7374): stderr: | 20221213222113585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222113585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222113585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222113586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222113586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222113586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222113586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:15.076611 run osmo-stp_10.42.42.5(pid=7374): stdout: | (launched: 2022-12-13_22:21:13.395218) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:15.205479 run osmo-stp_10.42.42.5(pid=7374): stderr: | 20221213222113585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222113585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222113585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222113586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222113586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222113586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222113586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:15.359408 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7374): Process ended prematurely: osmo-stp_10.42.42.5(pid=7374) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7374)] [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:21:15.368906 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:21:15.396476 run osmo-hlr_10.42.42.2(pid=7371): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7371)] 22:21:15.446770 run osmo-hlr_10.42.42.2(pid=7371): stdout: | (launched: 2022-12-13_22:21:12.390012) 22:21:15.498237 run osmo-hlr_10.42.42.2(pid=7371): stderr: | 20221213222112588 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222112588 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222112588 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222112588 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222112588 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222112588 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222112600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222112608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222112608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222112608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:15.570243 run osmo-msc_10.42.42.6(pid=7377): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7377)] 22:21:15.619974 run osmo-msc_10.42.42.6(pid=7377): stdout: | (launched: 2022-12-13_22:21:14.424650) 22:21:15.671511 run osmo-msc_10.42.42.6(pid=7377): stderr: | 20221213222114744 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222114744 DLGLOBAL DEBUG validating counter group 0x7f8d60cedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222114744 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222114744 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222114745 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222114745 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222114746 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222114747 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222114747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222114747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:15.723574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7370): Terminating (SIGTERM) 22:21:15.765584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7373): Terminating (SIGTERM) 22:21:15.807269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7376): Terminating (SIGTERM) 22:21:15.850362 --- ParallelTerminationStrategy: PID 7370 died... 22:21:15.875975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7370): Terminated: ok {rc=0} 22:21:15.930749 --- ParallelTerminationStrategy: PID 7373 died... 22:21:15.950576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7373): Terminated: ok {rc=0} 22:21:15.995091 --- ParallelTerminationStrategy: PID 7376 died... 22:21:16.014468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7376): Terminated: ok {rc=0} 22:21:16.100129 bus /sierra_3: Setting Powered False 22:21:17.196518 bus /sierra_3: Setting Powered False 22:21:18.313178 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:21:19.562782 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:21:19.569672 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:21:19.602631 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:21:19.630421 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:21:19.683954 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:21:19.717169 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:21:19.745222 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:21:20.295783 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:21:20.348192 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:20.359888 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:21:20.430127 tst mo_mt_call.py: using LAC 36615 22:21:20.557204 tst mo_mt_call.py: using RAC 150 22:21:20.683240 tst mo_mt_call.py: using CellId 36615 22:21:20.810617 tst mo_mt_call.py: using BVCI 36616 22:21:20.927257 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:20.938864 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:20.950327 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:20.961860 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:20.973841 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:20.985506 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:21:21.102940 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:21:21.222541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:21.721406 run create_hlr_db(pid=7382): Launched 22:21:21.845150 bus /sierra_2: Setting Powered False 22:21:22.908750 run create_hlr_db(pid=7382): Terminated: ok {rc=0} 22:21:23.339417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7384): Launched 22:21:23.640423 run osmo-hlr_10.42.42.2(pid=7385): Launched 22:21:23.756941 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:24.275261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7387): Launched 22:21:24.577042 run osmo-stp_10.42.42.5(pid=7388): Launched 22:21:24.693329 run osmo-msc_10.42.42.6: Starting osmo-msc 22:21:25.241913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7390): Launched 22:21:25.543100 run osmo-msc_10.42.42.6(pid=7391): Launched 22:21:25.712728 run osmo-stp_10.42.42.5(pid=7388): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7388)] 22:21:25.841239 run osmo-stp_10.42.42.5(pid=7388): stdout: | (launched: 2022-12-13_22:21:24.522429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:25.969253 run osmo-stp_10.42.42.5(pid=7388): stderr: | 20221213222124693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222124693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222124694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222124694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222124696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222124696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222124696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:26.095561 run osmo-stp_10.42.42.5(pid=7388): stdout: | (launched: 2022-12-13_22:21:24.522429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:26.215835 run osmo-stp_10.42.42.5(pid=7388): stderr: | 20221213222124693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222124693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222124694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222124694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222124696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222124696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222124696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:26.359927 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7388): Process ended prematurely: osmo-stp_10.42.42.5(pid=7388) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7388)] [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:21:26.368845 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:21:26.395180 run osmo-hlr_10.42.42.2(pid=7385): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7385)] 22:21:26.442951 run osmo-hlr_10.42.42.2(pid=7385): stdout: | (launched: 2022-12-13_22:21:23.586029) 22:21:26.491886 run osmo-hlr_10.42.42.2(pid=7385): stderr: | 20221213222123763 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222123763 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222123763 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222123763 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222123763 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222123763 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222123775 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222123784 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222123784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222123784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:26.560527 run osmo-msc_10.42.42.6(pid=7391): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7391)] 22:21:26.607851 run osmo-msc_10.42.42.6(pid=7391): stdout: | (launched: 2022-12-13_22:21:25.488226) 22:21:26.656926 run osmo-msc_10.42.42.6(pid=7391): stderr: | 20221213222125759 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222125759 DLGLOBAL DEBUG validating counter group 0x7f355d5c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222125759 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222125759 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222125759 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222125760 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222125761 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222125762 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222125762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222125762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:26.706386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7384): Terminating (SIGTERM) 22:21:26.745867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7387): Terminating (SIGTERM) 22:21:26.785198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7390): Terminating (SIGTERM) 22:21:26.825207 --- ParallelTerminationStrategy: PID 7384 died... 22:21:26.844078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7384): Terminated: ok {rc=0} 22:21:26.887626 --- ParallelTerminationStrategy: PID 7387 died... 22:21:26.906194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7387): Terminated: ok {rc=0} 22:21:26.949970 --- ParallelTerminationStrategy: PID 7390 died... 22:21:26.968530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7390): Terminated: ok {rc=0} 22:21:27.055149 bus /sierra_3: Setting Powered False 22:21:28.154944 bus /sierra_3: Setting Powered False 22:21:29.270906 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:21:30.416645 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:30.428227 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:21:30.506950 tst mo_mt_call_osmux.py: using LAC 36616 22:21:30.627339 tst mo_mt_call_osmux.py: using RAC 151 22:21:30.747475 tst mo_mt_call_osmux.py: using CellId 36616 22:21:30.879918 tst mo_mt_call_osmux.py: using BVCI 36617 22:21:31.015529 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:31.029850 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:31.041639 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:31.054372 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:31.067984 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:21:31.082702 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:21:31.205363 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:21:31.330194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:31.934360 run create_hlr_db(pid=7393): Launched 22:21:32.088681 bus /sierra_2: Setting Powered False 22:21:33.149590 run create_hlr_db(pid=7393): Terminated: ok {rc=0} 22:21:33.590479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7395): Launched 22:21:33.914924 run osmo-hlr_10.42.42.2(pid=7396): Launched 22:21:34.039583 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:34.598094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7398): Launched 22:21:34.921417 run osmo-stp_10.42.42.5(pid=7399): Launched 22:21:35.045198 run osmo-msc_10.42.42.6: Starting osmo-msc 22:21:35.630860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7401): Launched 22:21:35.954368 run osmo-msc_10.42.42.6(pid=7402): Launched 22:21:36.134838 run osmo-stp_10.42.42.5(pid=7399): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7399)] 22:21:36.270646 run osmo-stp_10.42.42.5(pid=7399): stdout: | (launched: 2022-12-13_22:21:34.863170) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:36.407859 run osmo-stp_10.42.42.5(pid=7399): stderr: | 20221213222135052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222135052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222135052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222135053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222135055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222135055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222135055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:36.543979 run osmo-stp_10.42.42.5(pid=7399): stdout: | (launched: 2022-12-13_22:21:34.863170) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:36.672757 run osmo-stp_10.42.42.5(pid=7399): stderr: | 20221213222135052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222135052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222135052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222135053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222135055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222135055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222135055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:36.827672 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7399): Process ended prematurely: osmo-stp_10.42.42.5(pid=7399) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7399)] [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:21:36.837345 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:21:36.865314 run osmo-hlr_10.42.42.2(pid=7396): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7396)] 22:21:36.916039 run osmo-hlr_10.42.42.2(pid=7396): stdout: | (launched: 2022-12-13_22:21:33.856785) 22:21:36.968003 run osmo-hlr_10.42.42.2(pid=7396): stderr: | 20221213222134054 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222134054 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222134054 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222134054 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222134055 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222134055 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222134067 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222134076 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222134076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222134076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:37.040657 run osmo-msc_10.42.42.6(pid=7402): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7402)] 22:21:37.090559 run osmo-msc_10.42.42.6(pid=7402): stdout: | (launched: 2022-12-13_22:21:35.895862) 22:21:37.142869 run osmo-msc_10.42.42.6(pid=7402): stderr: | 20221213222136216 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222136216 DLGLOBAL DEBUG validating counter group 0x7f06bfb87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222136216 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222136216 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222136216 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222136216 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222136218 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222136219 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222136219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222136219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:37.194922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7395): Terminating (SIGTERM) 22:21:37.236807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7398): Terminating (SIGTERM) 22:21:37.278940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7401): Terminating (SIGTERM) 22:21:37.321939 --- ParallelTerminationStrategy: PID 7395 died... 22:21:37.342953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7395): Terminated: ok {rc=0} 22:21:37.389514 --- ParallelTerminationStrategy: PID 7398 died... 22:21:37.409418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7398): Terminated: ok {rc=0} 22:21:37.455821 --- ParallelTerminationStrategy: PID 7401 died... 22:21:37.475810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7401): Terminated: ok {rc=0} 22:21:37.564357 bus /sierra_3: Setting Powered False 22:21:38.663119 bus /sierra_3: Setting Powered False 22:21:39.778059 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:21:41.025396 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:21:41.031978 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:21:41.063706 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:21:41.089962 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:21:41.140714 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:21:41.172663 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:21:41.199408 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:21:41.750233 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:21:41.799578 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:41.810854 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:21:41.879097 tst mo_mt_call.py: using LAC 36617 22:21:41.997622 tst mo_mt_call.py: using RAC 152 22:21:42.116572 tst mo_mt_call.py: using CellId 36617 22:21:42.239925 tst mo_mt_call.py: using BVCI 36618 22:21:42.350732 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:42.361791 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:42.372569 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:42.383328 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:42.394203 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:42.405618 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:21:42.526047 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:21:42.649141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:43.149852 run create_hlr_db(pid=7407): Launched 22:21:43.273757 bus /sierra_2: Setting Powered False 22:21:44.337662 run create_hlr_db(pid=7407): Terminated: ok {rc=0} 22:21:44.770261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7409): Launched 22:21:45.072217 run osmo-hlr_10.42.42.2(pid=7410): Launched 22:21:45.188233 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:45.708430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7412): Launched 22:21:46.056446 run osmo-stp_10.42.42.5(pid=7413): Launched 22:21:46.304381 run osmo-msc_10.42.42.6: Starting osmo-msc 22:21:46.997576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7415): Launched 22:21:47.315881 run osmo-msc_10.42.42.6(pid=7416): Launched 22:21:47.485580 run osmo-stp_10.42.42.5(pid=7413): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7413)] 22:21:47.613167 run osmo-stp_10.42.42.5(pid=7413): stdout: | (launched: 2022-12-13_22:21:45.992787) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:47.739784 run osmo-stp_10.42.42.5(pid=7413): stderr: | 20221213222146288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222146288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222146288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222146288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222146297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222146297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222146297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:47.865654 run osmo-stp_10.42.42.5(pid=7413): stdout: | (launched: 2022-12-13_22:21:45.992787) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:47.985650 run osmo-stp_10.42.42.5(pid=7413): stderr: | 20221213222146288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222146288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222146288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222146288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222146297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222146297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222146297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:48.129835 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7413): Process ended prematurely: osmo-stp_10.42.42.5(pid=7413) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7413)] [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:21:48.138794 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:21:48.165320 run osmo-hlr_10.42.42.2(pid=7410): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7410)] 22:21:48.213141 run osmo-hlr_10.42.42.2(pid=7410): stdout: | (launched: 2022-12-13_22:21:45.017519) 22:21:48.262237 run osmo-hlr_10.42.42.2(pid=7410): stderr: | 20221213222145196 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222145196 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222145196 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222145196 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222145196 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222145196 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222145209 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222145219 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222145219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222145219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:48.330624 run osmo-msc_10.42.42.6(pid=7416): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7416)] 22:21:48.378071 run osmo-msc_10.42.42.6(pid=7416): stdout: | (launched: 2022-12-13_22:21:47.260908) 22:21:48.426987 run osmo-msc_10.42.42.6(pid=7416): stderr: | 20221213222147533 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222147533 DLGLOBAL DEBUG validating counter group 0x7f442eccdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222147534 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222147534 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222147534 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222147534 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222147536 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222147536 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222147536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222147536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:48.476140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7409): Terminating (SIGTERM) 22:21:48.515560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7412): Terminating (SIGTERM) 22:21:48.554949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7415): Terminating (SIGTERM) 22:21:48.594875 --- ParallelTerminationStrategy: PID 7409 died... 22:21:48.614380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7409): Terminated: ok {rc=0} 22:21:48.658199 --- ParallelTerminationStrategy: PID 7412 died... 22:21:48.676771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7412): Terminated: ok {rc=0} 22:21:48.720808 --- ParallelTerminationStrategy: PID 7415 died... 22:21:48.740024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7415): Terminated: ok {rc=0} 22:21:48.825578 bus /sierra_3: Setting Powered False 22:21:49.927586 bus /sierra_3: Setting Powered False 22:21:51.043531 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:21:52.192903 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:52.204924 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:21:52.276526 tst mo_mt_call_osmux.py: using LAC 36618 22:21:52.402275 tst mo_mt_call_osmux.py: using RAC 153 22:21:52.530176 tst mo_mt_call_osmux.py: using CellId 36618 22:21:52.656027 tst mo_mt_call_osmux.py: using BVCI 36619 22:21:52.773520 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:52.784927 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:52.796479 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:52.807761 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:52.819500 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:21:52.831123 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:21:52.951365 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:21:53.071883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:53.572357 run create_hlr_db(pid=7419): Launched 22:21:53.695609 bus /sierra_2: Setting Powered False 22:21:54.759672 run create_hlr_db(pid=7419): Terminated: ok {rc=0} 22:21:55.191427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7421): Launched 22:21:55.492194 run osmo-hlr_10.42.42.2(pid=7422): Launched 22:21:55.609139 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:56.144155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7424): Launched 22:21:56.444763 run osmo-stp_10.42.42.5(pid=7425): Launched 22:21:56.560890 run osmo-msc_10.42.42.6: Starting osmo-msc 22:21:57.105758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7427): Launched 22:21:57.405665 run osmo-msc_10.42.42.6(pid=7428): Launched 22:21:57.576389 run osmo-stp_10.42.42.5(pid=7425): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7425)] 22:21:57.703417 run osmo-stp_10.42.42.5(pid=7425): stdout: | (launched: 2022-12-13_22:21:56.390316) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:57.830750 run osmo-stp_10.42.42.5(pid=7425): stderr: | 20221213222156558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222156558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222156558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222156559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222156561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222156561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222156561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:57.955815 run osmo-stp_10.42.42.5(pid=7425): stdout: | (launched: 2022-12-13_22:21:56.390316) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:58.075459 run osmo-stp_10.42.42.5(pid=7425): stderr: | 20221213222156558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222156558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222156558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222156559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222156561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222156561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222156561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:58.218997 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7425): Process ended prematurely: osmo-stp_10.42.42.5(pid=7425) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7425)] [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:21:58.227814 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:21:58.254083 run osmo-hlr_10.42.42.2(pid=7422): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7422)] 22:21:58.301290 run osmo-hlr_10.42.42.2(pid=7422): stdout: | (launched: 2022-12-13_22:21:55.437321) 22:21:58.349936 run osmo-hlr_10.42.42.2(pid=7422): stderr: | 20221213222155614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222155614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222155614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222155614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222155614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222155614 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222155627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222155638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222155638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222155638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:58.418243 run osmo-msc_10.42.42.6(pid=7428): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7428)] 22:21:58.465182 run osmo-msc_10.42.42.6(pid=7428): stdout: | (launched: 2022-12-13_22:21:57.350890) 22:21:58.513984 run osmo-msc_10.42.42.6(pid=7428): stderr: | 20221213222157621 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222157621 DLGLOBAL DEBUG validating counter group 0x7f57e5190c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222157621 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222157621 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222157621 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222157621 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222157623 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222157623 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222157624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222157624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:21:58.563098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7421): Terminating (SIGTERM) 22:21:58.602234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7424): Terminating (SIGTERM) 22:21:58.641363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7427): Terminating (SIGTERM) 22:21:58.681014 --- ParallelTerminationStrategy: PID 7421 died... 22:21:58.699968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7421): Terminated: ok {rc=0} 22:21:58.743321 --- ParallelTerminationStrategy: PID 7424 died... 22:21:58.761843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7424): Terminated: ok {rc=0} 22:21:58.805182 --- ParallelTerminationStrategy: PID 7427 died... 22:21:58.823608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7427): Terminated: ok {rc=0} 22:21:58.906050 bus /sierra_3: Setting Powered False 22:22:00.001141 bus /sierra_3: Setting Powered False 22:22:01.118658 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:22:02.383160 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:22:02.389817 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:22:02.421644 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:22:02.448079 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:22:02.499909 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:22:02.532373 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:22:02.559556 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:22:03.108026 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:22:03.162791 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:03.174499 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:22:03.248385 tst mo_mt_call.py: using LAC 36619 22:22:03.379846 tst mo_mt_call.py: using RAC 154 22:22:03.508853 tst mo_mt_call.py: using CellId 36619 22:22:03.634400 tst mo_mt_call.py: using BVCI 36620 22:22:03.751518 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:03.763012 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:03.774436 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:03.785761 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:03.797941 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:03.809800 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:22:03.925615 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:22:04.046259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:04.546667 run create_hlr_db(pid=7434): Launched 22:22:04.670437 bus /sierra_2: Setting Powered False 22:22:05.734705 run create_hlr_db(pid=7434): Terminated: ok {rc=0} 22:22:06.165759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7436): Launched 22:22:06.465340 run osmo-hlr_10.42.42.2(pid=7437): Launched 22:22:06.582166 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:07.117462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7439): Launched 22:22:07.417097 run osmo-stp_10.42.42.5(pid=7440): Launched 22:22:07.533188 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:08.077385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7442): Launched 22:22:08.377268 run osmo-msc_10.42.42.6(pid=7443): Launched 22:22:08.545993 run osmo-stp_10.42.42.5(pid=7440): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7440)] 22:22:08.673483 run osmo-stp_10.42.42.5(pid=7440): stdout: | (launched: 2022-12-13_22:22:07.362531) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:08.800231 run osmo-stp_10.42.42.5(pid=7440): stderr: | 20221213222207531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222207531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222207532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222207532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222207534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222207534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222207534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:08.925562 run osmo-stp_10.42.42.5(pid=7440): stdout: | (launched: 2022-12-13_22:22:07.362531) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:09.045826 run osmo-stp_10.42.42.5(pid=7440): stderr: | 20221213222207531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222207531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222207532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222207532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222207534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222207534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222207534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:09.189704 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7440): Process ended prematurely: osmo-stp_10.42.42.5(pid=7440) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7440)] [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:22:09.198739 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:22:09.225221 run osmo-hlr_10.42.42.2(pid=7437): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7437)] 22:22:09.272557 run osmo-hlr_10.42.42.2(pid=7437): stdout: | (launched: 2022-12-13_22:22:06.410775) 22:22:09.321777 run osmo-hlr_10.42.42.2(pid=7437): stderr: | 20221213222206588 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222206588 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222206588 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222206588 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222206588 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222206588 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222206601 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222206609 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222206610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222206610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:09.389923 run osmo-msc_10.42.42.6(pid=7443): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7443)] 22:22:09.437310 run osmo-msc_10.42.42.6(pid=7443): stdout: | (launched: 2022-12-13_22:22:08.322762) 22:22:09.486209 run osmo-msc_10.42.42.6(pid=7443): stderr: | 20221213222208594 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222208595 DLGLOBAL DEBUG validating counter group 0x7f86b8549c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222208595 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222208595 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222208595 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222208595 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222208597 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222208597 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222208597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222208598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:09.535334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7436): Terminating (SIGTERM) 22:22:09.574635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7439): Terminating (SIGTERM) 22:22:09.613992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7442): Terminating (SIGTERM) 22:22:09.653515 --- ParallelTerminationStrategy: PID 7436 died... 22:22:09.672379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7436): Terminated: ok {rc=0} 22:22:09.715831 --- ParallelTerminationStrategy: PID 7439 died... 22:22:09.734495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7439): Terminated: ok {rc=0} 22:22:09.778064 --- ParallelTerminationStrategy: PID 7442 died... 22:22:09.796615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7442): Terminated: ok {rc=0} 22:22:09.882441 bus /sierra_3: Setting Powered False 22:22:10.983034 bus /sierra_3: Setting Powered False 22:22:12.098931 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:22:13.245174 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:13.256816 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:22:13.325075 tst mo_mt_call_osmux.py: using LAC 36620 22:22:13.443352 tst mo_mt_call_osmux.py: using RAC 155 22:22:13.571392 tst mo_mt_call_osmux.py: using CellId 36620 22:22:13.697359 tst mo_mt_call_osmux.py: using BVCI 36621 22:22:13.814863 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:13.826577 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:13.838097 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:13.849637 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:13.861395 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:22:13.872758 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:22:13.990764 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:22:14.111668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:14.612652 run create_hlr_db(pid=7445): Launched 22:22:14.735982 bus /sierra_2: Setting Powered False 22:22:15.800787 run create_hlr_db(pid=7445): Terminated: ok {rc=0} 22:22:16.259878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7447): Launched 22:22:16.586045 run osmo-hlr_10.42.42.2(pid=7448): Launched 22:22:16.823970 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:17.542496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7450): Launched 22:22:17.843848 run osmo-stp_10.42.42.5(pid=7451): Launched 22:22:17.959912 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:18.506013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7453): Launched 22:22:18.807234 run osmo-msc_10.42.42.6(pid=7454): Launched 22:22:18.976006 run osmo-stp_10.42.42.5(pid=7451): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7451)] 22:22:19.112757 run osmo-stp_10.42.42.5(pid=7451): stdout: | (launched: 2022-12-13_22:22:17.789160) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:19.251909 run osmo-stp_10.42.42.5(pid=7451): stderr: | 20221213222217961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222217961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222217961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222217962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222217962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222217962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222217962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:19.387985 run osmo-stp_10.42.42.5(pid=7451): stdout: | (launched: 2022-12-13_22:22:17.789160) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:19.517186 run osmo-stp_10.42.42.5(pid=7451): stderr: | 20221213222217961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222217961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222217961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222217962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222217962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222217962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222217962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:19.671729 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7451): Process ended prematurely: osmo-stp_10.42.42.5(pid=7451) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7451)] [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:22:19.681590 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:22:19.709848 run osmo-hlr_10.42.42.2(pid=7448): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7448)] 22:22:19.761315 run osmo-hlr_10.42.42.2(pid=7448): stdout: | (launched: 2022-12-13_22:22:16.519357) 22:22:19.813536 run osmo-hlr_10.42.42.2(pid=7448): stderr: | 20221213222216867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222216867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222216867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222216867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222216867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222216867 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222216887 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222216903 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222216903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222216904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:19.886815 run osmo-msc_10.42.42.6(pid=7454): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7454)] 22:22:19.936865 run osmo-msc_10.42.42.6(pid=7454): stdout: | (launched: 2022-12-13_22:22:18.752525) 22:22:19.989452 run osmo-msc_10.42.42.6(pid=7454): stderr: | 20221213222219023 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222219023 DLGLOBAL DEBUG validating counter group 0x7f4490a8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222219023 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222219023 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222219023 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222219023 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222219027 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222219027 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222219027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222219027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:20.042221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7447): Terminating (SIGTERM) 22:22:20.084355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7450): Terminating (SIGTERM) 22:22:20.127165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7453): Terminating (SIGTERM) 22:22:20.169738 --- ParallelTerminationStrategy: PID 7447 died... 22:22:20.190339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7447): Terminated: ok {rc=0} 22:22:20.237262 --- ParallelTerminationStrategy: PID 7450 died... 22:22:20.257074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7450): Terminated: ok {rc=0} 22:22:20.303683 --- ParallelTerminationStrategy: PID 7453 died... 22:22:20.323643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7453): Terminated: ok {rc=0} 22:22:20.412127 bus /sierra_3: Setting Powered False 22:22:21.510864 bus /sierra_3: Setting Powered False 22:22:22.626122 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:22:23.881726 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:22:23.890627 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:22:23.924429 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:22:23.951688 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:22:24.005273 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:22:24.037254 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:22:24.064547 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:22:24.617034 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:22:24.670237 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:24.681929 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:22:24.752762 tst mo_mt_call.py: using LAC 36621 22:22:24.878920 tst mo_mt_call.py: using RAC 156 22:22:25.004673 tst mo_mt_call.py: using CellId 36621 22:22:25.133357 tst mo_mt_call.py: using BVCI 36622 22:22:25.243227 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:25.254542 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:25.265726 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:25.276614 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:25.287780 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:25.298788 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:22:25.412369 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:22:25.532130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:26.032029 run create_hlr_db(pid=7459): Launched 22:22:26.155585 bus /sierra_2: Setting Powered False 22:22:27.219647 run create_hlr_db(pid=7459): Terminated: ok {rc=0} 22:22:27.650069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7461): Launched 22:22:27.949967 run osmo-hlr_10.42.42.2(pid=7462): Launched 22:22:28.064917 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:28.582783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7464): Launched 22:22:28.883342 run osmo-stp_10.42.42.5(pid=7465): Launched 22:22:28.998343 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:29.577107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7467): Launched 22:22:29.900486 run osmo-msc_10.42.42.6(pid=7468): Launched 22:22:30.082451 run osmo-stp_10.42.42.5(pid=7465): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7465)] 22:22:30.218765 run osmo-stp_10.42.42.5(pid=7465): stdout: | (launched: 2022-12-13_22:22:28.828388) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:30.356332 run osmo-stp_10.42.42.5(pid=7465): stderr: | 20221213222228999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222228999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222228999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222229000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222229000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222229000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222229000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:30.492587 run osmo-stp_10.42.42.5(pid=7465): stdout: | (launched: 2022-12-13_22:22:28.828388) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:30.621210 run osmo-stp_10.42.42.5(pid=7465): stderr: | 20221213222228999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222228999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222228999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222229000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222229000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222229000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222229000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:30.776090 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7465): Process ended prematurely: osmo-stp_10.42.42.5(pid=7465) [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7465)] [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:22:30.785689 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:22:30.813313 run osmo-hlr_10.42.42.2(pid=7462): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7462)] 22:22:30.888500 run osmo-hlr_10.42.42.2(pid=7462): stdout: | (launched: 2022-12-13_22:22:27.894968) 22:22:30.940685 run osmo-hlr_10.42.42.2(pid=7462): stderr: | 20221213222228069 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222228069 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222228069 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222228069 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222228069 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222228069 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222228082 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222228091 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222228091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222228091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:31.013747 run osmo-msc_10.42.42.6(pid=7468): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7468)] 22:22:31.063049 run osmo-msc_10.42.42.6(pid=7468): stdout: | (launched: 2022-12-13_22:22:29.842289) 22:22:31.117150 run osmo-msc_10.42.42.6(pid=7468): stderr: | 20221213222230161 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222230161 DLGLOBAL DEBUG validating counter group 0x7f3f78f8bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222230161 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222230161 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222230161 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222230162 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222230163 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222230164 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222230164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222230164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:31.169574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7461): Terminating (SIGTERM) 22:22:31.210919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7464): Terminating (SIGTERM) 22:22:31.254270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7467): Terminating (SIGTERM) 22:22:31.298348 --- ParallelTerminationStrategy: PID 7461 died... 22:22:31.319510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7461): Terminated: ok {rc=0} 22:22:31.367749 --- ParallelTerminationStrategy: PID 7464 died... 22:22:31.388066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7464): Terminated: ok {rc=0} 22:22:31.434028 --- ParallelTerminationStrategy: PID 7467 died... 22:22:31.454130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7467): Terminated: ok {rc=0} 22:22:31.554115 bus /sierra_3: Setting Powered False 22:22:32.649525 bus /sierra_3: Setting Powered False 22:22:33.762513 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:22:34.911243 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:34.923577 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:22:34.999124 tst mo_mt_call_osmux.py: using LAC 36622 22:22:35.124831 tst mo_mt_call_osmux.py: using RAC 157 22:22:35.254237 tst mo_mt_call_osmux.py: using CellId 36622 22:22:35.379843 tst mo_mt_call_osmux.py: using BVCI 36623 22:22:35.498062 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:35.509798 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:35.521226 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:35.532540 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:35.544370 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:22:35.556161 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:22:35.672793 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:22:35.793397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:36.294484 run create_hlr_db(pid=7470): Launched 22:22:36.417812 bus /sierra_2: Setting Powered False 22:22:37.482620 run create_hlr_db(pid=7470): Terminated: ok {rc=0} 22:22:37.933654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7472): Launched 22:22:38.255696 run osmo-hlr_10.42.42.2(pid=7473): Launched 22:22:38.380336 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:38.900555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7475): Launched 22:22:39.200459 run osmo-stp_10.42.42.5(pid=7476): Launched 22:22:39.315385 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:39.858642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7478): Launched 22:22:40.160215 run osmo-msc_10.42.42.6(pid=7479): Launched 22:22:40.329518 run osmo-stp_10.42.42.5(pid=7476): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7476)] 22:22:40.457458 run osmo-stp_10.42.42.5(pid=7476): stdout: | (launched: 2022-12-13_22:22:39.145975) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:40.584792 run osmo-stp_10.42.42.5(pid=7476): stderr: | 20221213222239316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222239316 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222239317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222239317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222239318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222239318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222239318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:40.710510 run osmo-stp_10.42.42.5(pid=7476): stdout: | (launched: 2022-12-13_22:22:39.145975) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:40.830916 run osmo-stp_10.42.42.5(pid=7476): stderr: | 20221213222239316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222239316 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222239317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222239317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222239318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222239318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222239318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:40.974728 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7476): Process ended prematurely: osmo-stp_10.42.42.5(pid=7476) [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7476)] [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:22:40.983727 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:22:41.010001 run osmo-hlr_10.42.42.2(pid=7473): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7473)] 22:22:41.057254 run osmo-hlr_10.42.42.2(pid=7473): stdout: | (launched: 2022-12-13_22:22:38.197735) 22:22:41.106084 run osmo-hlr_10.42.42.2(pid=7473): stderr: | 20221213222238394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222238394 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222238394 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222238394 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222238394 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222238394 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222238407 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222238415 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222238415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222238415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:41.174478 run osmo-msc_10.42.42.6(pid=7479): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7479)] 22:22:41.221750 run osmo-msc_10.42.42.6(pid=7479): stdout: | (launched: 2022-12-13_22:22:40.105289) 22:22:41.270548 run osmo-msc_10.42.42.6(pid=7479): stderr: | 20221213222240377 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222240377 DLGLOBAL DEBUG validating counter group 0x7f91926d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222240377 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222240377 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222240377 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222240377 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222240379 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222240379 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222240380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222240380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:41.320190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7472): Terminating (SIGTERM) 22:22:41.359934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7475): Terminating (SIGTERM) 22:22:41.399401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7478): Terminating (SIGTERM) 22:22:41.439137 --- ParallelTerminationStrategy: PID 7472 died... 22:22:41.458451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7472): Terminated: ok {rc=0} 22:22:41.502185 --- ParallelTerminationStrategy: PID 7475 died... 22:22:41.520796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7475): Terminated: ok {rc=0} 22:22:41.564922 --- ParallelTerminationStrategy: PID 7478 died... 22:22:41.584097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7478): Terminated: ok {rc=0} 22:22:41.667930 bus /sierra_3: Setting Powered False 22:22:42.766472 bus /sierra_3: Setting Powered False 22:22:43.887593 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:22:45.135236 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:22:45.140622 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:22:45.172836 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:22:45.199598 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:22:45.251419 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:22:45.284897 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:22:45.312762 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:22:45.868625 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:22:45.927491 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:45.939737 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:22:46.016047 tst mo_mt_call.py: using LAC 36623 22:22:46.144507 tst mo_mt_call.py: using RAC 158 22:22:46.289873 tst mo_mt_call.py: using CellId 36623 22:22:46.409276 tst mo_mt_call.py: using BVCI 36624 22:22:46.522485 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:46.533976 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:46.545589 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:46.556698 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:46.568125 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:46.579671 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:22:46.696361 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:22:46.816603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:47.374219 run create_hlr_db(pid=7484): Launched 22:22:47.498444 bus /sierra_2: Setting Powered False 22:22:48.562829 run create_hlr_db(pid=7484): Terminated: ok {rc=0} 22:22:48.993483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7486): Launched 22:22:49.292930 run osmo-hlr_10.42.42.2(pid=7487): Launched 22:22:49.410278 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:49.932442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7489): Launched 22:22:50.232810 run osmo-stp_10.42.42.5(pid=7490): Launched 22:22:50.347991 run osmo-msc_10.42.42.6: Starting osmo-msc 22:22:50.892375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7492): Launched 22:22:51.192920 run osmo-msc_10.42.42.6(pid=7493): Launched 22:22:51.361891 run osmo-stp_10.42.42.5(pid=7490): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7490)] 22:22:51.490314 run osmo-stp_10.42.42.5(pid=7490): stdout: | (launched: 2022-12-13_22:22:50.178007) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:51.617208 run osmo-stp_10.42.42.5(pid=7490): stderr: | 20221213222250348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222250348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222250348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222250349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222250349 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222250349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222250350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:51.742300 run osmo-stp_10.42.42.5(pid=7490): stdout: | (launched: 2022-12-13_22:22:50.178007) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:51.861998 run osmo-stp_10.42.42.5(pid=7490): stderr: | 20221213222250348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222250348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222250348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222250349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222250349 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222250349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222250350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:52.031113 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7490): Process ended prematurely: osmo-stp_10.42.42.5(pid=7490) [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7490)] [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:22:52.039655 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:22:52.065911 run osmo-hlr_10.42.42.2(pid=7487): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7487)] 22:22:52.113903 run osmo-hlr_10.42.42.2(pid=7487): stdout: | (launched: 2022-12-13_22:22:49.238622) 22:22:52.162858 run osmo-hlr_10.42.42.2(pid=7487): stderr: | 20221213222249414 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222249414 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222249414 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222249414 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222249414 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222249414 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222249426 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222249435 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222249435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222249435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:52.231311 run osmo-msc_10.42.42.6(pid=7493): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7493)] 22:22:52.278521 run osmo-msc_10.42.42.6(pid=7493): stdout: | (launched: 2022-12-13_22:22:51.138332) 22:22:52.327798 run osmo-msc_10.42.42.6(pid=7493): stderr: | 20221213222251410 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222251410 DLGLOBAL DEBUG validating counter group 0x7f501ee97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222251410 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222251410 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222251410 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222251410 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222251414 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222251414 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222251414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222251414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:22:52.377017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7486): Terminating (SIGTERM) 22:22:52.416218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7489): Terminating (SIGTERM) 22:22:52.455494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7492): Terminating (SIGTERM) 22:22:52.495138 --- ParallelTerminationStrategy: PID 7486 died... 22:22:52.514101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7486): Terminated: ok {rc=0} 22:22:52.557774 --- ParallelTerminationStrategy: PID 7489 died... 22:22:52.576757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7489): Terminated: ok {rc=0} 22:22:52.620431 --- ParallelTerminationStrategy: PID 7492 died... 22:22:52.638984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7492): Terminated: ok {rc=0} 22:22:52.725290 bus /sierra_3: Setting Powered False 22:22:53.824727 bus /sierra_3: Setting Powered False 22:22:54.938427 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:22:56.088516 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:56.100745 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:22:56.172871 tst mo_mt_call_osmux.py: using LAC 36624 22:22:56.300855 tst mo_mt_call_osmux.py: using RAC 159 22:22:56.419416 tst mo_mt_call_osmux.py: using CellId 36624 22:22:56.537299 tst mo_mt_call_osmux.py: using BVCI 36625 22:22:56.646580 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:56.657497 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:56.668270 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:56.679005 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:56.689748 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:22:56.700823 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:22:56.816070 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:22:56.936613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:57.437835 run create_hlr_db(pid=7495): Launched 22:22:57.562471 bus /sierra_2: Setting Powered False 22:22:58.626458 run create_hlr_db(pid=7495): Terminated: ok {rc=0} 22:22:59.058218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7497): Launched 22:22:59.359196 run osmo-hlr_10.42.42.2(pid=7498): Launched 22:22:59.475523 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:00.011317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7500): Launched 22:23:00.313211 run osmo-stp_10.42.42.5(pid=7501): Launched 22:23:00.428436 run osmo-msc_10.42.42.6: Starting osmo-msc 22:23:01.017988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7503): Launched 22:23:01.373756 run osmo-msc_10.42.42.6(pid=7504): Launched 22:23:01.744283 run osmo-stp_10.42.42.5(pid=7501): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7501)] 22:23:02.024061 run osmo-stp_10.42.42.5(pid=7501): stdout: | (launched: 2022-12-13_22:23:00.258102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:02.195793 run osmo-stp_10.42.42.5(pid=7501): stderr: | 20221213222300429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222300430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222300430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222300430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222300431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222300431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222300431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:02.331197 run osmo-stp_10.42.42.5(pid=7501): stdout: | (launched: 2022-12-13_22:23:00.258102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:02.461141 run osmo-stp_10.42.42.5(pid=7501): stderr: | 20221213222300429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222300430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222300430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222300430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222300431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222300431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222300431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:02.616629 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7501): Process ended prematurely: osmo-stp_10.42.42.5(pid=7501) [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7501)] [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:23:02.626342 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 22:23:02.654615 run osmo-hlr_10.42.42.2(pid=7498): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7498)] 22:23:02.705670 run osmo-hlr_10.42.42.2(pid=7498): stdout: | (launched: 2022-12-13_22:22:59.304577) 22:23:02.757945 run osmo-hlr_10.42.42.2(pid=7498): stderr: | 20221213222259478 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222259478 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222259478 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222259478 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222259478 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222259478 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222259490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222259501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222259501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222259501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:02.831550 run osmo-msc_10.42.42.6(pid=7504): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7504)] 22:23:02.882104 run osmo-msc_10.42.42.6(pid=7504): stdout: | (launched: 2022-12-13_22:23:01.306223) 22:23:02.935056 run osmo-msc_10.42.42.6(pid=7504): stderr: | 20221213222301811 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222301812 DLGLOBAL DEBUG validating counter group 0x7f4bfe31dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222301812 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222301812 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222301812 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222301812 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222301814 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222301814 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222301814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222301814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:23:02.987960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7497): Terminating (SIGTERM) 22:23:03.030095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7500): Terminating (SIGTERM) 22:23:03.072618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7503): Terminating (SIGTERM) 22:23:03.115417 --- ParallelTerminationStrategy: PID 7497 died... 22:23:03.136036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7497): Terminated: ok {rc=0} 22:23:03.183347 --- ParallelTerminationStrategy: PID 7500 died... 22:23:03.203468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7500): Terminated: ok {rc=0} 22:23:03.250471 --- ParallelTerminationStrategy: PID 7503 died... 22:23:03.270603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7503): Terminated: ok {rc=0} 22:23:03.359878 bus /sierra_3: Setting Powered False 22:23:04.459609 bus /sierra_3: Setting Powered False 22:23:05.576722 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:23:06.825525 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:23:06.831870 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:23:06.864854 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 22:23:06.893403 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 22:23:06.946988 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:23:06.980865 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 22:23:07.008256 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 22:23:07.560006 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 22:23:07.612754 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:07.624732 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:23:07.678208 tst mo_mt_call.py: using LAC 36625 22:23:07.806109 tst mo_mt_call.py: using RAC 160 22:23:07.934304 tst mo_mt_call.py: using CellId 36625 22:23:08.062510 tst mo_mt_call.py: using BVCI 36626 22:23:08.179692 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:08.191350 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:08.202959 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:08.214499 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:08.226558 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:08.238365 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:23:08.354195 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:23:08.474916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:08.942032 run create_hlr_db(pid=7510): Launched 22:23:09.065686 bus /sierra_2: Setting Powered False 22:23:10.129636 run create_hlr_db(pid=7510): Terminated: ok {rc=0} 22:23:10.577932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7512): Launched 22:23:10.899585 run osmo-hlr_10.42.42.2(pid=7513): Launched 22:23:11.022748 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:11.580240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7515): Launched 22:23:11.902954 run osmo-stp_10.42.42.5(pid=7516): Launched 22:23:12.026062 run osmo-msc_10.42.42.6: Starting osmo-msc 22:23:12.608724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7518): Launched 22:23:12.931173 run osmo-msc_10.42.42.6(pid=7519): Launched 22:23:13.111275 run osmo-stp_10.42.42.5(pid=7516): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7516)] 22:23:13.251240 run osmo-stp_10.42.42.5(pid=7516): stdout: | (launched: 2022-12-13_22:23:11.844394) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:13.385999 run osmo-stp_10.42.42.5(pid=7516): stderr: | 20221213222312034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222312034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222312034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222312035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222312037 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222312037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222312037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:13.519919 run osmo-stp_10.42.42.5(pid=7516): stdout: | (launched: 2022-12-13_22:23:11.844394) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:13.648651 run osmo-stp_10.42.42.5(pid=7516): stderr: | 20221213222312034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222312034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222312034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222312035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222312037 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222312037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222312037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:13.802914 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7516): Process ended prematurely: osmo-stp_10.42.42.5(pid=7516) [trial-2395↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7516)] [trial-2395↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 22:23:13.812503 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:23:13.840572 run osmo-hlr_10.42.42.2(pid=7513): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7513)] 22:23:13.891320 run osmo-hlr_10.42.42.2(pid=7513): stdout: | (launched: 2022-12-13_22:23:10.841893) 22:23:13.943141 run osmo-hlr_10.42.42.2(pid=7513): stderr: | 20221213222311039 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222311039 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222311039 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222311039 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222311039 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222311040 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222311051 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222311060 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222311060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222311060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:14.015538 run osmo-msc_10.42.42.6(pid=7519): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7519)] 22:23:14.065271 run osmo-msc_10.42.42.6(pid=7519): stdout: | (launched: 2022-12-13_22:23:12.873164) 22:23:14.117608 run osmo-msc_10.42.42.6(pid=7519): stderr: | 20221213222313195 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222313195 DLGLOBAL DEBUG validating counter group 0x7f9fb635ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222313195 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222313195 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222313196 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222313196 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222313197 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222313198 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222313198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222313198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:23:14.169675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7512): Terminating (SIGTERM) 22:23:14.211223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7515): Terminating (SIGTERM) 22:23:14.252899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7518): Terminating (SIGTERM) 22:23:14.295672 --- ParallelTerminationStrategy: PID 7512 died... 22:23:14.316021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7512): Terminated: ok {rc=0} 22:23:14.362592 --- ParallelTerminationStrategy: PID 7515 died... 22:23:14.382421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7515): Terminated: ok {rc=0} 22:23:14.428559 --- ParallelTerminationStrategy: PID 7518 died... 22:23:14.448366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7518): Terminated: ok {rc=0} 22:23:14.537124 bus /sierra_3: Setting Powered False 22:23:15.635129 bus /sierra_3: Setting Powered False 22:23:16.758992 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 22:23:17.905208 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:17.917083 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:23:17.967599 tst mo_mt_call_osmux.py: using LAC 36626 22:23:18.086461 tst mo_mt_call_osmux.py: using RAC 161 22:23:18.206452 tst mo_mt_call_osmux.py: using CellId 36626 22:23:18.328090 tst mo_mt_call_osmux.py: using BVCI 36627 22:23:18.438573 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:18.449796 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:18.460736 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:18.471714 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:18.482835 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:23:18.493819 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:23:18.614368 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:23:18.733110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:19.201745 run create_hlr_db(pid=7521): Launched 22:23:19.325396 bus /sierra_2: Setting Powered False 22:23:20.386097 run create_hlr_db(pid=7521): Terminated: ok {rc=0} 22:23:20.828706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7523): Launched 22:23:21.152504 run osmo-hlr_10.42.42.2(pid=7524): Launched 22:23:21.276908 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:21.833454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7526): Launched 22:23:22.156607 run osmo-stp_10.42.42.5(pid=7527): Launched 22:23:22.281101 run osmo-msc_10.42.42.6: Starting osmo-msc 22:23:22.868009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7529): Launched 22:23:23.191973 run osmo-msc_10.42.42.6(pid=7530): Launched 22:23:23.374208 run osmo-stp_10.42.42.5(pid=7527): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7527)] 22:23:23.511295 run osmo-stp_10.42.42.5(pid=7527): stdout: | (launched: 2022-12-13_22:23:22.098350) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:23.648793 run osmo-stp_10.42.42.5(pid=7527): stderr: | 20221213222322291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222322292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222322292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222322292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222322293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222322293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222322293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:23.785283 run osmo-stp_10.42.42.5(pid=7527): stdout: | (launched: 2022-12-13_22:23:22.098350) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:23.914785 run osmo-stp_10.42.42.5(pid=7527): stderr: | 20221213222322291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222322292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222322292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222322292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222322293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222322293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222322293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:24.069220 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7527): Process ended prematurely: osmo-stp_10.42.42.5(pid=7527) [trial-2395↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7527)] [trial-2395↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 22:23:24.078890 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:23:24.106472 run osmo-hlr_10.42.42.2(pid=7524): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7524)] 22:23:24.156676 run osmo-hlr_10.42.42.2(pid=7524): stdout: | (launched: 2022-12-13_22:23:21.094363) 22:23:24.208815 run osmo-hlr_10.42.42.2(pid=7524): stderr: | 20221213222321294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222321294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222321295 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222321295 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222321295 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222321295 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222321308 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222321318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222321318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222321318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:24.280708 run osmo-msc_10.42.42.6(pid=7530): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7530)] 22:23:24.330409 run osmo-msc_10.42.42.6(pid=7530): stdout: | (launched: 2022-12-13_22:23:23.133308) 22:23:24.382431 run osmo-msc_10.42.42.6(pid=7530): stderr: | 20221213222323455 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222323455 DLGLOBAL DEBUG validating counter group 0x7f9e02ccec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222323455 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222323455 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222323456 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222323456 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222323458 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222323458 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222323458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222323458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:23:24.434503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7523): Terminating (SIGTERM) 22:23:24.476328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7526): Terminating (SIGTERM) 22:23:24.518392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7529): Terminating (SIGTERM) 22:23:24.560387 --- ParallelTerminationStrategy: PID 7523 died... 22:23:24.580757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7523): Terminated: ok {rc=0} 22:23:24.627293 --- ParallelTerminationStrategy: PID 7526 died... 22:23:24.647105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7526): Terminated: ok {rc=0} 22:23:24.693358 --- ParallelTerminationStrategy: PID 7529 died... 22:23:24.712903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7529): Terminated: ok {rc=0} 22:23:24.802234 bus /sierra_3: Setting Powered False 22:23:25.901150 bus /sierra_3: Setting Powered False 22:23:27.021240 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 emergency:trx-umtrx --------------------------------------------------------------------- 22:23:28.269480 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:23:28.273930 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:23:28.306013 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:23:28.332726 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 22:23:28.421634 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:23:28.454400 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:23:28.480639 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 22:23:29.057782 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2395 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 22:23:29.062849 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:29.073648 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 22:23:29.121379 tst emergency_mo_mt_call.py: using LAC 36627 22:23:29.237345 tst emergency_mo_mt_call.py: using RAC 162 22:23:29.361990 tst emergency_mo_mt_call.py: using CellId 36627 22:23:29.486438 tst emergency_mo_mt_call.py: using BVCI 36628 22:23:29.601540 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:29.612516 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:29.623323 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:29.634240 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:29.645482 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:29.656450 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:29.772680 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:29.890529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:30.349930 run create_hlr_db(pid=7535): Launched 22:23:30.472436 bus /sierra_2: Setting Powered False 22:23:31.535522 run create_hlr_db(pid=7535): Terminated: ok {rc=0} 22:23:31.997909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7537): Launched 22:23:32.331694 run osmo-hlr_10.42.42.2(pid=7538): Launched 22:23:32.455949 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:33.009176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7540): Launched 22:23:33.327790 run osmo-stp_10.42.42.5(pid=7541): Launched 22:23:33.460100 tst emergency_mo_mt_call.py: using MSISDN 8358 22:23:33.627199 run osmo-msc_10.42.42.6: Starting osmo-msc 22:23:34.199886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7543): Launched 22:23:34.517362 run osmo-msc_10.42.42.6(pid=7544): Launched 22:23:34.695587 run osmo-stp_10.42.42.5(pid=7541): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7541)] 22:23:34.830424 run osmo-stp_10.42.42.5(pid=7541): stdout: | (launched: 2022-12-13_22:23:33.270072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:34.965120 run osmo-stp_10.42.42.5(pid=7541): stderr: | 20221213222333461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222333462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222333462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222333462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222333464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222333465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222333465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:35.099322 run osmo-stp_10.42.42.5(pid=7541): stdout: | (launched: 2022-12-13_22:23:33.270072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:35.226173 run osmo-stp_10.42.42.5(pid=7541): stderr: | 20221213222333461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222333462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222333462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222333462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222333464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222333465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222333465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:35.377671 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7541): Process ended prematurely: osmo-stp_10.42.42.5(pid=7541) [trial-2395↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7541)] [trial-2395↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 22:23:35.386617 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 22:23:35.413775 run osmo-hlr_10.42.42.2(pid=7538): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7538)] 22:23:35.464283 run osmo-hlr_10.42.42.2(pid=7538): stdout: | (launched: 2022-12-13_22:23:32.273963) 22:23:35.516339 run osmo-hlr_10.42.42.2(pid=7538): stderr: | 20221213222332471 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222332472 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222332472 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222332472 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222332472 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222332472 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222332483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222332492 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222332493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222332493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:35.588762 run osmo-msc_10.42.42.6(pid=7544): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7544)] 22:23:35.638995 run osmo-msc_10.42.42.6(pid=7544): stdout: | (launched: 2022-12-13_22:23:34.459694) 22:23:35.690796 run osmo-msc_10.42.42.6(pid=7544): stderr: | 20221213222334781 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222334781 DLGLOBAL DEBUG validating counter group 0x7f5a745f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222334781 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222334781 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222334781 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222334781 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222334783 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222334784 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222334784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222334784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:23:35.743755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7537): Terminating (SIGTERM) 22:23:35.785384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7540): Terminating (SIGTERM) 22:23:35.827640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7543): Terminating (SIGTERM) 22:23:35.870046 --- ParallelTerminationStrategy: PID 7537 died... 22:23:35.890456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7537): Terminated: ok {rc=0} 22:23:35.936619 --- ParallelTerminationStrategy: PID 7540 died... 22:23:35.956434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7540): Terminated: ok {rc=0} 22:23:36.002523 --- ParallelTerminationStrategy: PID 7543 died... 22:23:36.022301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7543): Terminated: ok {rc=0} 22:23:36.109827 bus /sierra_3: Setting Powered False 22:23:37.209086 bus /sierra_3: Setting Powered False 22:23:38.324847 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 22:23:39.414486 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:39.426707 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 22:23:39.478376 tst emergency_preemptive_call.py: using LAC 36628 22:23:39.602101 tst emergency_preemptive_call.py: using RAC 163 22:23:39.729394 tst emergency_preemptive_call.py: using CellId 36628 22:23:39.854352 tst emergency_preemptive_call.py: using BVCI 36629 22:23:39.970734 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:39.982370 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:39.993484 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:40.004502 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:40.015866 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:23:40.026970 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:40.143588 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:40.264835 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:40.381028 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:40.495509 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:40.977683 run create_hlr_db(pid=7546): Launched 22:23:41.100554 bus /sierra_2: Setting Powered False 22:23:42.164310 run create_hlr_db(pid=7546): Terminated: ok {rc=0} 22:23:42.609752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7548): Launched 22:23:42.928779 run osmo-hlr_10.42.42.2(pid=7549): Launched 22:23:43.051869 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:43.604150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7551): Launched 22:23:43.924525 run osmo-stp_10.42.42.5(pid=7552): Launched 22:23:44.060500 tst emergency_preemptive_call.py: using MSISDN 8359 22:23:44.228094 run osmo-msc_10.42.42.6: Starting osmo-msc 22:23:44.800228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7554): Launched 22:23:45.118834 run osmo-msc_10.42.42.6(pid=7555): Launched 22:23:45.298133 run osmo-stp_10.42.42.5(pid=7552): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7552)] 22:23:45.433812 run osmo-stp_10.42.42.5(pid=7552): stdout: | (launched: 2022-12-13_22:23:43.866413) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:45.570019 run osmo-stp_10.42.42.5(pid=7552): stderr: | 20221213222344061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222344061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222344061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222344062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222344062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222344062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222344062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:45.704942 run osmo-stp_10.42.42.5(pid=7552): stdout: | (launched: 2022-12-13_22:23:43.866413) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:45.833645 run osmo-stp_10.42.42.5(pid=7552): stderr: | 20221213222344061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222344061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222344061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222344062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222344062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222344062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222344062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:45.989188 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7552): Process ended prematurely: osmo-stp_10.42.42.5(pid=7552) [trial-2395↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7552)] [trial-2395↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 22:23:45.998985 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 22:23:46.027953 run osmo-hlr_10.42.42.2(pid=7549): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7549)] 22:23:46.082126 run osmo-hlr_10.42.42.2(pid=7549): stdout: | (launched: 2022-12-13_22:23:42.871125) 22:23:46.136671 run osmo-hlr_10.42.42.2(pid=7549): stderr: | 20221213222343068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222343068 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222343068 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222343069 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222343069 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222343069 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222343081 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222343090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222343090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222343090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:46.212071 run osmo-msc_10.42.42.6(pid=7555): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7555)] 22:23:46.264605 run osmo-msc_10.42.42.6(pid=7555): stdout: | (launched: 2022-12-13_22:23:45.060843) 22:23:46.319109 run osmo-msc_10.42.42.6(pid=7555): stderr: | 20221213222345379 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222345379 DLGLOBAL DEBUG validating counter group 0x7f726c15dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222345379 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222345379 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222345379 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222345379 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222345381 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222345382 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222345382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222345382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:23:46.374135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7548): Terminating (SIGTERM) 22:23:46.417461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7551): Terminating (SIGTERM) 22:23:46.461900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7554): Terminating (SIGTERM) 22:23:46.507190 --- ParallelTerminationStrategy: PID 7548 died... 22:23:46.529372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7548): Terminated: ok {rc=0} 22:23:46.579497 --- ParallelTerminationStrategy: PID 7551 died... 22:23:46.600800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7551): Terminated: ok {rc=0} 22:23:46.650696 --- ParallelTerminationStrategy: PID 7554 died... 22:23:46.671451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7554): Terminated: ok {rc=0} 22:23:46.763115 bus /sierra_9: Setting Powered False 22:23:47.865011 bus /sierra_9: Setting Powered False 22:23:48.982244 bus /sierra_8: Setting Powered False 22:23:50.081351 bus /sierra_8: Setting Powered False 22:23:51.198058 bus /sierra_3: Setting Powered False 22:23:52.296917 bus /sierra_3: Setting Powered False 22:23:53.416158 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-umtrx --------------------------------------------------------------------- 22:23:54.698303 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:23:54.702947 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:23:54.735752 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 22:23:54.775827 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 22:23:54.866574 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:23:54.899961 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 22:23:54.939435 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 22:23:55.528127 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 22:23:55.581295 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:55.592135 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:23:55.641878 tst cs_paging_gprs_active.py: using LAC 36629 22:23:55.762466 tst cs_paging_gprs_active.py: using RAC 164 22:23:55.883678 tst cs_paging_gprs_active.py: using CellId 36629 22:23:56.004928 tst cs_paging_gprs_active.py: using BVCI 36630 22:23:56.114907 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:56.125693 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:56.136253 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:56.146740 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:56.157627 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:56.168457 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:56.179539 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:56.190202 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:23:56.201123 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:56.323159 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:23:56.440798 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:23:56.646712 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:23:56.952600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7560): Launched 22:23:57.216674 run iperf3-srv_10.42.42.10(pid=7561): Launched 22:23:57.330601 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:23:57.533980 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:23:57.838080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7562): Launched 22:23:58.103426 run iperf3-srv_10.42.42.10(pid=7563): Launched 22:23:58.217777 tst cs_paging_gprs_active.py:38: start network... 22:23:58.420755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:58.892570 run create_hlr_db(pid=7564): Launched 22:23:59.015771 bus /sierra_2: Setting Powered False 22:24:00.076658 run create_hlr_db(pid=7564): Terminated: ok {rc=0} 22:24:00.520086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7566): Launched 22:24:00.852032 run osmo-hlr_10.42.42.2(pid=7567): Launched 22:24:01.016266 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:01.817403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7605): Launched 22:24:02.182211 run osmo-stp_10.42.42.5(pid=7618): Launched 22:24:02.432075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:24:03.221004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7663): Launched 22:24:03.378052 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:24:03.697602 run patchelf(pid=7705): Launched 22:24:03.914359 run osmo-stp_10.42.42.5(pid=7618): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7618)] 22:24:04.075748 run osmo-stp_10.42.42.5(pid=7618): stdout: | (launched: 2022-12-13_22:24:02.120247) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:04.237224 run osmo-stp_10.42.42.5(pid=7618): stderr: | 20221213222402464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222402464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222402464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222402465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222402465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222402465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222402465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:04.395094 run osmo-stp_10.42.42.5(pid=7618): stdout: | (launched: 2022-12-13_22:24:02.120247) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:04.550826 run osmo-stp_10.42.42.5(pid=7618): stderr: | 20221213222402464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222402464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222402464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222402465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222402465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222402465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222402465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:04.731100 run patchelf(pid=7705): Terminating (SIGINT) 22:24:04.938512 run patchelf(pid=7705): Terminated: ok {rc=0} 22:24:05.066444 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7618): Process ended prematurely: osmo-stp_10.42.42.5(pid=7618) [trial-2395↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7618)] [trial-2395↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 22:24:05.076432 tst cs_paging_gprs_active.py:38: Test FAILED (9.5 sec) 22:24:05.106969 run osmo-hlr_10.42.42.2(pid=7567): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7567)] 22:24:05.155406 run osmo-hlr_10.42.42.2(pid=7567): stdout: | (launched: 2022-12-13_22:24:00.786146) 22:24:05.205593 run osmo-hlr_10.42.42.2(pid=7567): stderr: | 20221213222401147 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222401147 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222401147 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222401147 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222401147 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222401147 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222401173 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222401182 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222401182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222401183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:05.256811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7560): Terminating (SIGTERM) 22:24:05.298463 run iperf3-srv_10.42.42.10(pid=7561): Terminating (SIGTERM) 22:24:05.339451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7562): Terminating (SIGTERM) 22:24:05.381299 run iperf3-srv_10.42.42.10(pid=7563): Terminating (SIGTERM) 22:24:05.422274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7566): Terminating (SIGTERM) 22:24:05.463878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7605): Terminating (SIGTERM) 22:24:05.508178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7663): Terminating (SIGTERM) 22:24:05.552058 --- ParallelTerminationStrategy: PID 7560 died... 22:24:05.572702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7560): Terminated: ok {rc=0} 22:24:05.619965 --- ParallelTerminationStrategy: PID 7561 died... 22:24:05.639980 run iperf3-srv_10.42.42.10(pid=7561): Terminated {rc=256} 22:24:05.685482 --- ParallelTerminationStrategy: PID 7562 died... 22:24:05.706425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7562): Terminated: ok {rc=0} 22:24:05.752020 --- ParallelTerminationStrategy: PID 7563 died... 22:24:05.771977 run iperf3-srv_10.42.42.10(pid=7563): Terminated {rc=256} 22:24:05.817470 --- ParallelTerminationStrategy: PID 7566 died... 22:24:05.838081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7566): Terminated: ok {rc=0} 22:24:05.884454 --- ParallelTerminationStrategy: PID 7605 died... 22:24:05.905935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7605): Terminated: ok {rc=0} 22:24:05.951870 --- ParallelTerminationStrategy: PID 7663 died... 22:24:05.972786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7663): Terminated: ok {rc=0} 22:24:06.061122 bus /gobi_0: Setting Powered False 22:24:07.160241 bus /gobi_0: Setting Powered False 22:24:08.275468 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx iperf3.py ---------------------------------------------- 22:24:09.425956 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:09.438150 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:24:09.491828 tst iperf3.py: using LAC 36630 22:24:09.614165 tst iperf3.py: using RAC 165 22:24:09.737315 tst iperf3.py: using CellId 36630 22:24:09.859912 tst iperf3.py: using BVCI 36631 22:24:09.973210 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:09.984654 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:09.995982 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:10.006969 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:10.018638 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:10.030275 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:10.041940 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:10.053699 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:10.065486 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:10.188237 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:24:10.398359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:10.725782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7846): Launched 22:24:11.017800 run iperf3-srv_10.42.42.10(pid=7847): Launched 22:24:11.145356 tst iperf3.py:8: start network... 22:24:11.355418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:11.850072 run create_hlr_db(pid=7848): Launched 22:24:12.008113 bus /gobi_6: Setting Powered False 22:24:13.074535 run create_hlr_db(pid=7848): Terminated: ok {rc=0} 22:24:13.545898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7850): Launched 22:24:13.897468 run osmo-hlr_10.42.42.2(pid=7851): Launched 22:24:14.153507 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:14.839659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7853): Launched 22:24:15.188853 run osmo-stp_10.42.42.5(pid=7854): Launched 22:24:15.439712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:24:16.129757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7856): Launched 22:24:16.272358 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:24:16.635203 run patchelf(pid=7857): Launched 22:24:16.819591 run osmo-stp_10.42.42.5(pid=7854): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7854)] 22:24:16.949821 run osmo-stp_10.42.42.5(pid=7854): stdout: | (launched: 2022-12-13_22:24:15.125439) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:17.081561 run osmo-stp_10.42.42.5(pid=7854): stderr: | 20221213222415428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222415428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222415429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222415429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222415429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222415429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222415430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:17.214286 run osmo-stp_10.42.42.5(pid=7854): stdout: | (launched: 2022-12-13_22:24:15.125439) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:17.340846 run osmo-stp_10.42.42.5(pid=7854): stderr: | 20221213222415428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222415428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222415429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222415429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222415429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222415429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222415430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:17.491686 run patchelf(pid=7857): Terminating (SIGINT) 22:24:17.665727 run patchelf(pid=7857): Terminated: ok {rc=0} 22:24:17.790906 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7854): Process ended prematurely: osmo-stp_10.42.42.5(pid=7854) [trial-2395↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7854)] [trial-2395↪gprs:trx-umtrx↪iperf3.py:8] 22:24:17.801130 tst iperf3.py:8: Test FAILED (8.4 sec) 22:24:17.829836 run osmo-hlr_10.42.42.2(pid=7851): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7851)] 22:24:17.879223 run osmo-hlr_10.42.42.2(pid=7851): stdout: | (launched: 2022-12-13_22:24:13.832125) 22:24:17.929865 run osmo-hlr_10.42.42.2(pid=7851): stderr: | 20221213222414148 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222414148 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222414148 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222414148 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222414148 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222414148 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222414171 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222414179 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222414179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222414179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:17.980738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7846): Terminating (SIGTERM) 22:24:18.022001 run iperf3-srv_10.42.42.10(pid=7847): Terminating (SIGTERM) 22:24:18.066385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7850): Terminating (SIGTERM) 22:24:18.108460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7853): Terminating (SIGTERM) 22:24:18.149785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7856): Terminating (SIGTERM) 22:24:18.190587 --- ParallelTerminationStrategy: PID 7846 died... 22:24:18.209903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7846): Terminated: ok {rc=0} 22:24:18.254891 --- ParallelTerminationStrategy: PID 7847 died... 22:24:18.274357 run iperf3-srv_10.42.42.10(pid=7847): Terminated {rc=256} 22:24:18.318981 --- ParallelTerminationStrategy: PID 7850 died... 22:24:18.338605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7850): Terminated: ok {rc=0} 22:24:18.383451 --- ParallelTerminationStrategy: PID 7853 died... 22:24:18.402946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7853): Terminated: ok {rc=0} 22:24:18.447720 --- ParallelTerminationStrategy: PID 7856 died... 22:24:18.467142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7856): Terminated: ok {rc=0} 22:24:18.552611 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 22:24:19.704421 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:19.716716 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:24:19.765473 tst iperf3m4.py: using LAC 36631 22:24:19.892282 tst iperf3m4.py: using RAC 166 22:24:20.015049 tst iperf3m4.py: using CellId 36631 22:24:20.137212 tst iperf3m4.py: using BVCI 36632 22:24:20.251097 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:20.263041 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:20.274788 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:20.286311 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:20.298799 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:20.310371 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:20.322471 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:20.334532 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:20.346532 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:20.464069 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:20.590857 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:20.713865 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:20.835078 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:24:21.046781 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:21.369518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7858): Launched 22:24:21.662228 run iperf3-srv_10.42.42.10(pid=7859): Launched 22:24:21.797908 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:24:22.012169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:22.335015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7860): Launched 22:24:22.626904 run iperf3-srv_10.42.42.10(pid=7861): Launched 22:24:22.760202 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:24:22.970388 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:23.290133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7862): Launched 22:24:23.583268 run iperf3-srv_10.42.42.10(pid=7863): Launched 22:24:23.716663 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:24:23.927630 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:24.249847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7864): Launched 22:24:24.546309 run iperf3-srv_10.42.42.10(pid=7865): Launched 22:24:24.678283 tst iperf3m4.py:8: start network... 22:24:24.888796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:25.387437 run create_hlr_db(pid=7866): Launched 22:24:25.550911 bus /gobi_6: Setting Powered False 22:24:26.611462 run create_hlr_db(pid=7866): Terminated: ok {rc=0} 22:24:27.036427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7869): Launched 22:24:27.339659 run osmo-hlr_10.42.42.2(pid=7870): Launched 22:24:27.454888 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:27.978126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7872): Launched 22:24:28.282472 run osmo-stp_10.42.42.5(pid=7873): Launched 22:24:28.398348 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:24:28.920694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7875): Launched 22:24:29.037408 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:24:29.294404 run patchelf(pid=7876): Launched 22:24:29.462673 run osmo-stp_10.42.42.5(pid=7873): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7873)] 22:24:29.590949 run osmo-stp_10.42.42.5(pid=7873): stdout: | (launched: 2022-12-13_22:24:28.226833) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:29.720170 run osmo-stp_10.42.42.5(pid=7873): stderr: | 20221213222428399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222428399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222428399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222428400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222428400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222428400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222428400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:29.849597 run osmo-stp_10.42.42.5(pid=7873): stdout: | (launched: 2022-12-13_22:24:28.226833) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:29.973548 run osmo-stp_10.42.42.5(pid=7873): stderr: | 20221213222428399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222428399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222428399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222428400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222428400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222428400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222428400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:30.120546 run patchelf(pid=7876): Terminating (SIGINT) 22:24:30.291164 run patchelf(pid=7876): Terminated: ok {rc=0} 22:24:30.413323 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7873): Process ended prematurely: osmo-stp_10.42.42.5(pid=7873) [trial-2395↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7873)] [trial-2395↪gprs:trx-umtrx↪iperf3m4.py:8] 22:24:30.422745 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:24:30.449885 run osmo-hlr_10.42.42.2(pid=7870): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7870)] 22:24:30.497120 run osmo-hlr_10.42.42.2(pid=7870): stdout: | (launched: 2022-12-13_22:24:27.284429) 22:24:30.546011 run osmo-hlr_10.42.42.2(pid=7870): stderr: | 20221213222427462 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222427462 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222427462 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222427462 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222427462 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222427462 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222427475 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222427484 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222427484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222427484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:30.595157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7858): Terminating (SIGTERM) 22:24:30.634320 run iperf3-srv_10.42.42.10(pid=7859): Terminating (SIGTERM) 22:24:30.673566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7860): Terminating (SIGTERM) 22:24:30.713001 run iperf3-srv_10.42.42.10(pid=7861): Terminating (SIGTERM) 22:24:30.752297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7862): Terminating (SIGTERM) 22:24:30.791578 run iperf3-srv_10.42.42.10(pid=7863): Terminating (SIGTERM) 22:24:30.832359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7864): Terminating (SIGTERM) 22:24:30.874594 run iperf3-srv_10.42.42.10(pid=7865): Terminating (SIGTERM) 22:24:30.930711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7869): Terminating (SIGTERM) 22:24:30.971182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7872): Terminating (SIGTERM) 22:24:31.011721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7875): Terminating (SIGTERM) 22:24:31.054286 --- ParallelTerminationStrategy: PID 7858 died... 22:24:31.073802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7858): Terminated: ok {rc=0} 22:24:31.118622 --- ParallelTerminationStrategy: PID 7859 died... 22:24:31.137866 run iperf3-srv_10.42.42.10(pid=7859): Terminated {rc=256} 22:24:31.182380 --- ParallelTerminationStrategy: PID 7860 died... 22:24:31.201812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7860): Terminated: ok {rc=0} 22:24:31.246566 --- ParallelTerminationStrategy: PID 7861 died... 22:24:31.265736 run iperf3-srv_10.42.42.10(pid=7861): Terminated {rc=256} 22:24:31.310418 --- ParallelTerminationStrategy: PID 7862 died... 22:24:31.329772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7862): Terminated: ok {rc=0} 22:24:31.374994 --- ParallelTerminationStrategy: PID 7863 died... 22:24:31.394313 run iperf3-srv_10.42.42.10(pid=7863): Terminated {rc=256} 22:24:31.438823 --- ParallelTerminationStrategy: PID 7864 died... 22:24:31.458201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7864): Terminated: ok {rc=0} 22:24:31.502929 --- ParallelTerminationStrategy: PID 7865 died... 22:24:31.522209 run iperf3-srv_10.42.42.10(pid=7865): Terminated {rc=256} 22:24:31.567178 --- ParallelTerminationStrategy: PID 7869 died... 22:24:31.586978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7869): Terminated: ok {rc=0} 22:24:31.631599 --- ParallelTerminationStrategy: PID 7872 died... 22:24:31.650986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7872): Terminated: ok {rc=0} 22:24:31.695620 --- ParallelTerminationStrategy: PID 7875 died... 22:24:31.714544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7875): Terminated: ok {rc=0} 22:24:31.808929 bus /gobi_4: Setting Powered False 22:24:32.925923 bus /gobi_4: Setting Powered False 22:24:34.039913 bus /gobi_1: Setting Powered False 22:24:35.141668 bus /gobi_1: Setting Powered False 22:24:36.257145 bus /gobi_0: Setting Powered False 22:24:37.356903 bus /gobi_0: Setting Powered False 22:24:38.473791 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx ping.py ---------------------------------------------- 22:24:39.574406 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:39.585644 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:24:39.634323 tst ping.py: using LAC 36632 22:24:39.753089 tst ping.py: using RAC 167 22:24:39.869365 tst ping.py: using CellId 36632 22:24:39.986084 tst ping.py: using BVCI 36633 22:24:40.094785 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:40.105596 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:40.116392 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:40.126847 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:40.137346 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:40.147775 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:40.158360 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:40.168690 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:40.283609 tst ping.py:19: start network... 22:24:40.482495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:40.942174 run create_hlr_db(pid=7877): Launched 22:24:41.063423 bus /gobi_6: Setting Powered False 22:24:42.122904 run create_hlr_db(pid=7877): Terminated: ok {rc=0} 22:24:42.558345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7879): Launched 22:24:42.875977 run osmo-hlr_10.42.42.2(pid=7880): Launched 22:24:42.997889 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:43.547148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7882): Launched 22:24:43.865890 run osmo-stp_10.42.42.5(pid=7883): Launched 22:24:43.988501 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:24:44.539946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7885): Launched 22:24:44.662676 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:24:44.932613 run patchelf(pid=7886): Launched 22:24:45.110363 run osmo-stp_10.42.42.5(pid=7883): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7883)] 22:24:45.245595 run osmo-stp_10.42.42.5(pid=7883): stdout: | (launched: 2022-12-13_22:24:43.807737) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:45.382306 run osmo-stp_10.42.42.5(pid=7883): stderr: | 20221213222443998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222443999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222443999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222443999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222444002 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222444002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222444002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:45.519424 run osmo-stp_10.42.42.5(pid=7883): stdout: | (launched: 2022-12-13_22:24:43.807737) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:45.650850 run osmo-stp_10.42.42.5(pid=7883): stderr: | 20221213222443998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222443999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222443999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222443999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222444002 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222444002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222444002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:45.806093 run patchelf(pid=7886): Terminating (SIGINT) 22:24:46.011604 run patchelf(pid=7886): Terminated: ok {rc=0} 22:24:46.136228 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7883): Process ended prematurely: osmo-stp_10.42.42.5(pid=7883) [trial-2395↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7883)] [trial-2395↪gprs:trx-umtrx↪ping.py:22] 22:24:46.146261 tst ping.py:22: Test FAILED (6.6 sec) 22:24:46.173998 run osmo-hlr_10.42.42.2(pid=7880): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7880)] 22:24:46.224467 run osmo-hlr_10.42.42.2(pid=7880): stdout: | (launched: 2022-12-13_22:24:42.818095) 22:24:46.276201 run osmo-hlr_10.42.42.2(pid=7880): stderr: | 20221213222443016 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222443016 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222443016 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222443016 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222443016 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222443016 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222443028 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222443036 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222443036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222443036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:46.329695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7879): Terminating (SIGTERM) 22:24:46.371735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7882): Terminating (SIGTERM) 22:24:46.415620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7885): Terminating (SIGTERM) 22:24:46.459790 --- ParallelTerminationStrategy: PID 7879 died... 22:24:46.480122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7879): Terminated: ok {rc=0} 22:24:46.528382 --- ParallelTerminationStrategy: PID 7882 died... 22:24:46.548228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7882): Terminated: ok {rc=0} 22:24:46.594517 --- ParallelTerminationStrategy: PID 7885 died... 22:24:46.614456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7885): Terminated: ok {rc=0} 22:24:46.704537 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 22:24:47.803916 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:47.815489 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:24:47.865501 tst ping_idle_ping.py: using LAC 36633 22:24:47.993415 tst ping_idle_ping.py: using RAC 168 22:24:48.112465 tst ping_idle_ping.py: using CellId 36633 22:24:48.231674 tst ping_idle_ping.py: using BVCI 36634 22:24:48.349947 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:48.361620 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:48.372874 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:48.384243 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:48.396353 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:48.407985 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:48.419842 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:24:48.431560 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:24:48.548588 tst ping_idle_ping.py:24: start network... 22:24:48.748584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:49.212394 run create_hlr_db(pid=7887): Launched 22:24:49.336135 bus /gobi_6: Setting Powered False 22:24:50.397021 run create_hlr_db(pid=7887): Terminated: ok {rc=0} 22:24:50.815343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7889): Launched 22:24:51.113416 run osmo-hlr_10.42.42.2(pid=7890): Launched 22:24:51.226980 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:51.758700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7892): Launched 22:24:52.057050 run osmo-stp_10.42.42.5(pid=7893): Launched 22:24:52.170475 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:24:52.686068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7895): Launched 22:24:52.799800 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:24:53.050558 run patchelf(pid=7896): Launched 22:24:53.216069 run osmo-stp_10.42.42.5(pid=7893): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7893)] 22:24:53.342073 run osmo-stp_10.42.42.5(pid=7893): stdout: | (launched: 2022-12-13_22:24:52.002475) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:53.469410 run osmo-stp_10.42.42.5(pid=7893): stderr: | 20221213222452174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222452175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222452175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222452175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222452176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222452176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222452176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:53.596770 run osmo-stp_10.42.42.5(pid=7893): stdout: | (launched: 2022-12-13_22:24:52.002475) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:53.718784 run osmo-stp_10.42.42.5(pid=7893): stderr: | 20221213222452174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222452175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222452175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222452175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222452176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222452176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222452176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:53.863276 run patchelf(pid=7896): Terminating (SIGINT) 22:24:54.029556 run patchelf(pid=7896): Terminated: ok {rc=0} 22:24:54.149221 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7893): Process ended prematurely: osmo-stp_10.42.42.5(pid=7893) [trial-2395↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7893)] [trial-2395↪gprs:trx-umtrx↪ping_idle_ping.py:27] 22:24:54.158112 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 22:24:54.184497 run osmo-hlr_10.42.42.2(pid=7890): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7890)] 22:24:54.231861 run osmo-hlr_10.42.42.2(pid=7890): stdout: | (launched: 2022-12-13_22:24:51.058703) 22:24:54.280746 run osmo-hlr_10.42.42.2(pid=7890): stderr: | 20221213222451234 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222451234 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222451234 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222451234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222451235 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222451235 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222451247 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222451256 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222451256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222451256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:54.330086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7889): Terminating (SIGTERM) 22:24:54.370031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7892): Terminating (SIGTERM) 22:24:54.409433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7895): Terminating (SIGTERM) 22:24:54.449275 --- ParallelTerminationStrategy: PID 7889 died... 22:24:54.468509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7889): Terminated: ok {rc=0} 22:24:54.512447 --- ParallelTerminationStrategy: PID 7892 died... 22:24:54.531235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7892): Terminated: ok {rc=0} 22:24:54.574957 --- ParallelTerminationStrategy: PID 7895 died... 22:24:54.593698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7895): Terminated: ok {rc=0} 22:24:54.677529 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 22:24:55.981011 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:24:55.987290 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:24:56.021061 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:24:56.061755 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:24:56.150851 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:24:56.183712 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:24:56.223202 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:24:56.818389 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:24:56.871511 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:56.882731 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:24:56.933452 tst cs_paging_gprs_active.py: using LAC 36634 22:24:57.062209 tst cs_paging_gprs_active.py: using RAC 169 22:24:57.190883 tst cs_paging_gprs_active.py: using CellId 36634 22:24:57.317353 tst cs_paging_gprs_active.py: using BVCI 36635 22:24:57.435570 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:57.446844 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:57.457957 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:57.468920 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:57.480151 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:57.491473 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:57.503075 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:57.514420 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:24:57.525914 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:24:57.643811 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:24:57.764733 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:24:57.985389 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:58.311071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7903): Launched 22:24:58.594567 run iperf3-srv_10.42.42.10(pid=7904): Launched 22:24:58.716861 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:24:58.937295 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:24:59.263330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7905): Launched 22:24:59.546196 run iperf3-srv_10.42.42.10(pid=7906): Launched 22:24:59.668465 tst cs_paging_gprs_active.py:38: start network... 22:24:59.888642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:00.392093 run create_hlr_db(pid=7907): Launched 22:25:00.516181 bus /gobi_6: Setting Powered False 22:25:01.582923 run create_hlr_db(pid=7907): Terminated: ok {rc=0} 22:25:02.055843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7912): Launched 22:25:02.406846 run osmo-hlr_10.42.42.2(pid=7913): Launched 22:25:02.525591 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:03.067112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7915): Launched 22:25:03.369364 run osmo-stp_10.42.42.5(pid=7916): Launched 22:25:03.484862 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:25:04.007600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7918): Launched 22:25:04.124133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:25:04.379429 run patchelf(pid=7919): Launched 22:25:04.549585 run osmo-stp_10.42.42.5(pid=7916): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7916)] 22:25:04.677465 run osmo-stp_10.42.42.5(pid=7916): stdout: | (launched: 2022-12-13_22:25:03.314320) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:04.807171 run osmo-stp_10.42.42.5(pid=7916): stderr: | 20221213222503484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222503484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222503485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222503485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222503485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222503486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222503486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:04.936609 run osmo-stp_10.42.42.5(pid=7916): stdout: | (launched: 2022-12-13_22:25:03.314320) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:05.060114 run osmo-stp_10.42.42.5(pid=7916): stderr: | 20221213222503484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222503484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222503485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222503485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222503485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222503486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222503486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:05.208713 run patchelf(pid=7919): Terminating (SIGINT) 22:25:05.379085 run patchelf(pid=7919): Terminated: ok {rc=0} 22:25:05.501267 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7916): Process ended prematurely: osmo-stp_10.42.42.5(pid=7916) [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7916)] [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:25:05.510559 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:25:05.537653 run osmo-hlr_10.42.42.2(pid=7913): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7913)] 22:25:05.585008 run osmo-hlr_10.42.42.2(pid=7913): stdout: | (launched: 2022-12-13_22:25:02.351084) 22:25:05.633734 run osmo-hlr_10.42.42.2(pid=7913): stderr: | 20221213222502524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222502524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222502524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222502524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222502525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222502525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222502537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222502545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222502545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222502545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:05.682707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7903): Terminating (SIGTERM) 22:25:05.722183 run iperf3-srv_10.42.42.10(pid=7904): Terminating (SIGTERM) 22:25:05.761577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7905): Terminating (SIGTERM) 22:25:05.801127 run iperf3-srv_10.42.42.10(pid=7906): Terminating (SIGTERM) 22:25:05.840316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7912): Terminating (SIGTERM) 22:25:05.879818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7915): Terminating (SIGTERM) 22:25:05.919056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7918): Terminating (SIGTERM) 22:25:05.958614 --- ParallelTerminationStrategy: PID 7903 died... 22:25:05.977657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7903): Terminated: ok {rc=0} 22:25:06.021167 --- ParallelTerminationStrategy: PID 7904 died... 22:25:06.039572 run iperf3-srv_10.42.42.10(pid=7904): Terminated {rc=256} 22:25:06.082833 --- ParallelTerminationStrategy: PID 7905 died... 22:25:06.101371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7905): Terminated: ok {rc=0} 22:25:06.144613 --- ParallelTerminationStrategy: PID 7906 died... 22:25:06.163170 run iperf3-srv_10.42.42.10(pid=7906): Terminated {rc=256} 22:25:06.206509 --- ParallelTerminationStrategy: PID 7912 died... 22:25:06.225025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7912): Terminated: ok {rc=0} 22:25:06.268327 --- ParallelTerminationStrategy: PID 7915 died... 22:25:06.286828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7915): Terminated: ok {rc=0} 22:25:06.330114 --- ParallelTerminationStrategy: PID 7918 died... 22:25:06.348623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7918): Terminated: ok {rc=0} 22:25:06.434054 bus /gobi_0: Setting Powered False 22:25:07.531913 bus /gobi_0: Setting Powered False 22:25:08.647020 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:25:09.792058 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:09.803391 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:25:09.855066 tst iperf3.py: using LAC 36635 22:25:09.975757 tst iperf3.py: using RAC 170 22:25:10.096538 tst iperf3.py: using CellId 36635 22:25:10.216338 tst iperf3.py: using BVCI 36636 22:25:10.325787 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:10.336478 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:10.347171 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:10.357764 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:10.368220 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:10.378791 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:10.389476 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:10.399814 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:10.410862 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:10.529970 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:25:10.750352 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:11.075826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7920): Launched 22:25:11.358262 run iperf3-srv_10.42.42.10(pid=7921): Launched 22:25:11.480250 tst iperf3.py:8: start network... 22:25:11.699613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:12.203168 run create_hlr_db(pid=7922): Launched 22:25:12.327394 bus /gobi_6: Setting Powered False 22:25:13.391938 run create_hlr_db(pid=7922): Terminated: ok {rc=0} 22:25:13.840905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7924): Launched 22:25:14.164900 run osmo-hlr_10.42.42.2(pid=7925): Launched 22:25:14.290752 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:14.852296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7927): Launched 22:25:15.175693 run osmo-stp_10.42.42.5(pid=7928): Launched 22:25:15.300762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:25:15.885526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7930): Launched 22:25:16.027660 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:25:16.347140 run patchelf(pid=7931): Launched 22:25:16.520352 run osmo-stp_10.42.42.5(pid=7928): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7928)] 22:25:16.652392 run osmo-stp_10.42.42.5(pid=7928): stdout: | (launched: 2022-12-13_22:25:15.117384) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:16.785998 run osmo-stp_10.42.42.5(pid=7928): stderr: | 20221213222515309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222515310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222515310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222515310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222515311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222515311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222515311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:16.919859 run osmo-stp_10.42.42.5(pid=7928): stdout: | (launched: 2022-12-13_22:25:15.117384) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:17.046263 run osmo-stp_10.42.42.5(pid=7928): stderr: | 20221213222515309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222515310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222515310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222515310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222515311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222515311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222515311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:17.195867 run patchelf(pid=7931): Terminating (SIGINT) 22:25:17.367293 run patchelf(pid=7931): Terminated: ok {rc=0} 22:25:17.489302 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7928): Process ended prematurely: osmo-stp_10.42.42.5(pid=7928) [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7928)] [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 22:25:17.498666 tst iperf3.py:8: Test FAILED (7.7 sec) 22:25:17.525861 run osmo-hlr_10.42.42.2(pid=7925): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7925)] 22:25:17.573232 run osmo-hlr_10.42.42.2(pid=7925): stdout: | (launched: 2022-12-13_22:25:14.106221) 22:25:17.622136 run osmo-hlr_10.42.42.2(pid=7925): stderr: | 20221213222514302 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222514302 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222514302 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222514302 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222514302 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222514302 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222514314 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222514323 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222514323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222514323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:17.671630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7920): Terminating (SIGTERM) 22:25:17.710765 run iperf3-srv_10.42.42.10(pid=7921): Terminating (SIGTERM) 22:25:17.749846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7924): Terminating (SIGTERM) 22:25:17.788836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7927): Terminating (SIGTERM) 22:25:17.827915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7930): Terminating (SIGTERM) 22:25:17.867347 --- ParallelTerminationStrategy: PID 7920 died... 22:25:17.886363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7920): Terminated: ok {rc=0} 22:25:17.929705 --- ParallelTerminationStrategy: PID 7921 died... 22:25:17.948190 run iperf3-srv_10.42.42.10(pid=7921): Terminated {rc=256} 22:25:17.991432 --- ParallelTerminationStrategy: PID 7924 died... 22:25:18.009865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7924): Terminated: ok {rc=0} 22:25:18.053112 --- ParallelTerminationStrategy: PID 7927 died... 22:25:18.071453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7927): Terminated: ok {rc=0} 22:25:18.114660 --- ParallelTerminationStrategy: PID 7930 died... 22:25:18.133537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7930): Terminated: ok {rc=0} 22:25:18.218632 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:25:19.365147 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:19.376320 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:25:19.425877 tst iperf3m4.py: using LAC 36636 22:25:19.544067 tst iperf3m4.py: using RAC 171 22:25:19.664106 tst iperf3m4.py: using CellId 36636 22:25:19.784466 tst iperf3m4.py: using BVCI 36637 22:25:19.894575 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:19.905505 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:19.915999 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:19.926633 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:19.937092 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:19.947626 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:19.958701 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:19.969425 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:19.980099 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:20.096159 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:20.218935 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:20.340278 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:20.460127 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:25:20.664688 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:20.967750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7932): Launched 22:25:21.231704 run iperf3-srv_10.42.42.10(pid=7933): Launched 22:25:21.345982 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:25:21.548594 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:21.852629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7934): Launched 22:25:22.117203 run iperf3-srv_10.42.42.10(pid=7935): Launched 22:25:22.230890 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:25:22.433595 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:22.737682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7936): Launched 22:25:23.001371 run iperf3-srv_10.42.42.10(pid=7937): Launched 22:25:23.115365 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:25:23.318370 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:23.622618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7938): Launched 22:25:23.886370 run iperf3-srv_10.42.42.10(pid=7939): Launched 22:25:24.002179 tst iperf3m4.py:8: start network... 22:25:24.204611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:24.674622 run create_hlr_db(pid=7940): Launched 22:25:24.798631 bus /gobi_6: Setting Powered False 22:25:25.859567 run create_hlr_db(pid=7940): Terminated: ok {rc=0} 22:25:26.303183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7942): Launched 22:25:26.629332 run osmo-hlr_10.42.42.2(pid=7943): Launched 22:25:26.755643 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:27.316815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7945): Launched 22:25:27.641143 run osmo-stp_10.42.42.5(pid=7946): Launched 22:25:27.766173 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:25:28.333470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7948): Launched 22:25:28.457712 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:25:28.731572 run patchelf(pid=7949): Launched 22:25:28.912780 run osmo-stp_10.42.42.5(pid=7946): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7946)] 22:25:29.050423 run osmo-stp_10.42.42.5(pid=7946): stdout: | (launched: 2022-12-13_22:25:27.582268) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:29.189459 run osmo-stp_10.42.42.5(pid=7946): stderr: | 20221213222527776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222527776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222527777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222527777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222527777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222527778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222527778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:29.328526 run osmo-stp_10.42.42.5(pid=7946): stdout: | (launched: 2022-12-13_22:25:27.582268) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:29.461783 run osmo-stp_10.42.42.5(pid=7946): stderr: | 20221213222527776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222527776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222527777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222527777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222527777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222527778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222527778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:29.619971 run patchelf(pid=7949): Terminating (SIGINT) 22:25:29.801859 run patchelf(pid=7949): Terminated: ok {rc=0} 22:25:29.933782 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7946): Process ended prematurely: osmo-stp_10.42.42.5(pid=7946) [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7946)] [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 22:25:29.943812 tst iperf3m4.py:8: Test FAILED (10.6 sec) 22:25:29.972551 run osmo-hlr_10.42.42.2(pid=7943): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7943)] 22:25:30.022888 run osmo-hlr_10.42.42.2(pid=7943): stdout: | (launched: 2022-12-13_22:25:26.570179) 22:25:30.075068 run osmo-hlr_10.42.42.2(pid=7943): stderr: | 20221213222526768 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222526768 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222526768 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222526768 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222526768 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222526768 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222526780 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222526790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222526790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222526790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:30.126944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7932): Terminating (SIGTERM) 22:25:30.168001 run iperf3-srv_10.42.42.10(pid=7933): Terminating (SIGTERM) 22:25:30.210375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7934): Terminating (SIGTERM) 22:25:30.252066 run iperf3-srv_10.42.42.10(pid=7935): Terminating (SIGTERM) 22:25:30.294048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7936): Terminating (SIGTERM) 22:25:30.336329 run iperf3-srv_10.42.42.10(pid=7937): Terminating (SIGTERM) 22:25:30.378012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7938): Terminating (SIGTERM) 22:25:30.419905 run iperf3-srv_10.42.42.10(pid=7939): Terminating (SIGTERM) 22:25:30.461635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7942): Terminating (SIGTERM) 22:25:30.503413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7945): Terminating (SIGTERM) 22:25:30.545330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7948): Terminating (SIGTERM) 22:25:30.587461 --- ParallelTerminationStrategy: PID 7932 died... 22:25:30.607898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7932): Terminated: ok {rc=0} 22:25:30.654808 --- ParallelTerminationStrategy: PID 7933 died... 22:25:30.674585 run iperf3-srv_10.42.42.10(pid=7933): Terminated {rc=256} 22:25:30.720781 --- ParallelTerminationStrategy: PID 7934 died... 22:25:30.741176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7934): Terminated: ok {rc=0} 22:25:30.787497 --- ParallelTerminationStrategy: PID 7935 died... 22:25:30.807186 run iperf3-srv_10.42.42.10(pid=7935): Terminated {rc=256} 22:25:30.875956 --- ParallelTerminationStrategy: PID 7936 died... 22:25:30.895795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7936): Terminated: ok {rc=0} 22:25:30.943322 --- ParallelTerminationStrategy: PID 7937 died... 22:25:30.963941 run iperf3-srv_10.42.42.10(pid=7937): Terminated {rc=256} 22:25:31.010606 --- ParallelTerminationStrategy: PID 7938 died... 22:25:31.031114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7938): Terminated: ok {rc=0} 22:25:31.077642 --- ParallelTerminationStrategy: PID 7939 died... 22:25:31.099674 run iperf3-srv_10.42.42.10(pid=7939): Terminated {rc=256} 22:25:31.145762 --- ParallelTerminationStrategy: PID 7942 died... 22:25:31.166643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7942): Terminated: ok {rc=0} 22:25:31.213419 --- ParallelTerminationStrategy: PID 7945 died... 22:25:31.234154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7945): Terminated: ok {rc=0} 22:25:31.280843 --- ParallelTerminationStrategy: PID 7948 died... 22:25:31.302556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7948): Terminated: ok {rc=0} 22:25:31.391311 bus /gobi_4: Setting Powered False 22:25:32.486801 bus /gobi_4: Setting Powered False 22:25:33.602079 bus /gobi_1: Setting Powered False 22:25:34.700836 bus /gobi_1: Setting Powered False 22:25:35.815797 bus /gobi_0: Setting Powered False 22:25:36.916291 bus /gobi_0: Setting Powered False 22:25:38.034011 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 22:25:39.136482 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:39.147786 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:25:39.197497 tst ping.py: using LAC 36637 22:25:39.324391 tst ping.py: using RAC 172 22:25:39.449757 tst ping.py: using CellId 36637 22:25:39.573232 tst ping.py: using BVCI 36638 22:25:39.682347 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:39.693111 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:39.703591 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:39.714309 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:39.724793 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:39.735286 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:39.745948 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:39.756407 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:39.869760 tst ping.py:19: start network... 22:25:40.068478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:40.529379 run create_hlr_db(pid=7950): Launched 22:25:40.655753 bus /gobi_6: Setting Powered False 22:25:41.715521 run create_hlr_db(pid=7950): Terminated: ok {rc=0} 22:25:42.152920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7952): Launched 22:25:42.471893 run osmo-hlr_10.42.42.2(pid=7953): Launched 22:25:42.595335 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:43.147763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7955): Launched 22:25:43.465643 run osmo-stp_10.42.42.5(pid=7956): Launched 22:25:43.587901 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:25:44.137331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7958): Launched 22:25:44.259373 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:25:44.528298 run patchelf(pid=7959): Launched 22:25:44.705824 run osmo-stp_10.42.42.5(pid=7956): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7956)] 22:25:44.840632 run osmo-stp_10.42.42.5(pid=7956): stdout: | (launched: 2022-12-13_22:25:43.407767) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:44.977188 run osmo-stp_10.42.42.5(pid=7956): stderr: | 20221213222543599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222543599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222543599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222543599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222543602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222543602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222543602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:45.113892 run osmo-stp_10.42.42.5(pid=7956): stdout: | (launched: 2022-12-13_22:25:43.407767) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:45.244746 run osmo-stp_10.42.42.5(pid=7956): stderr: | 20221213222543599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222543599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222543599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222543599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222543602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222543602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222543602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:45.399497 run patchelf(pid=7959): Terminating (SIGINT) 22:25:45.577515 run patchelf(pid=7959): Terminated: ok {rc=0} 22:25:45.705743 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7956): Process ended prematurely: osmo-stp_10.42.42.5(pid=7956) [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7956)] [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 22:25:45.715275 tst ping.py:22: Test FAILED (6.6 sec) 22:25:45.743430 run osmo-hlr_10.42.42.2(pid=7953): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7953)] 22:25:45.794661 run osmo-hlr_10.42.42.2(pid=7953): stdout: | (launched: 2022-12-13_22:25:42.414008) 22:25:45.861982 run osmo-hlr_10.42.42.2(pid=7953): stderr: | 20221213222542610 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222542610 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222542610 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222542610 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222542610 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222542610 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222542623 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222542631 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222542632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222542632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:45.915898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7952): Terminating (SIGTERM) 22:25:45.957527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7955): Terminating (SIGTERM) 22:25:46.002041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7958): Terminating (SIGTERM) 22:25:46.049611 --- ParallelTerminationStrategy: PID 7952 died... 22:25:46.070949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7952): Terminated: ok {rc=0} 22:25:46.121853 --- ParallelTerminationStrategy: PID 7955 died... 22:25:46.142340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7955): Terminated: ok {rc=0} 22:25:46.190285 --- ParallelTerminationStrategy: PID 7958 died... 22:25:46.211295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7958): Terminated: ok {rc=0} 22:25:46.302471 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:25:47.388027 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:47.399825 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:25:47.452552 tst ping_idle_ping.py: using LAC 36638 22:25:47.581427 tst ping_idle_ping.py: using RAC 173 22:25:47.707788 tst ping_idle_ping.py: using CellId 36638 22:25:47.832650 tst ping_idle_ping.py: using BVCI 36639 22:25:47.948875 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:47.960440 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:47.971751 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:47.983023 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:47.994644 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:48.006213 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:48.018016 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:25:48.029620 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:25:48.152383 tst ping_idle_ping.py:24: start network... 22:25:48.367988 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:48.863898 run create_hlr_db(pid=7960): Launched 22:25:48.986915 bus /gobi_6: Setting Powered False 22:25:50.049094 run create_hlr_db(pid=7960): Terminated: ok {rc=0} 22:25:50.474878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7962): Launched 22:25:50.774177 run osmo-hlr_10.42.42.2(pid=7963): Launched 22:25:50.890108 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:51.403227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7965): Launched 22:25:51.701972 run osmo-stp_10.42.42.5(pid=7966): Launched 22:25:51.816845 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:25:52.361577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7970): Launched 22:25:52.484673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:25:52.753661 run patchelf(pid=7971): Launched 22:25:52.932851 run osmo-stp_10.42.42.5(pid=7966): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7966)] 22:25:53.067736 run osmo-stp_10.42.42.5(pid=7966): stdout: | (launched: 2022-12-13_22:25:51.646810) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:53.204605 run osmo-stp_10.42.42.5(pid=7966): stderr: | 20221213222551814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222551814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222551814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222551815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222551817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222551817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222551817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:53.341376 run osmo-stp_10.42.42.5(pid=7966): stdout: | (launched: 2022-12-13_22:25:51.646810) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:53.472456 run osmo-stp_10.42.42.5(pid=7966): stderr: | 20221213222551814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222551814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222551814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222551815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222551817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222551817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222551817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:53.627412 run patchelf(pid=7971): Terminating (SIGINT) 22:25:53.806258 run patchelf(pid=7971): Terminated: ok {rc=0} 22:25:53.936198 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7966): Process ended prematurely: osmo-stp_10.42.42.5(pid=7966) [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7966)] [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 22:25:53.945819 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:25:53.974182 run osmo-hlr_10.42.42.2(pid=7963): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7963)] 22:25:54.025285 run osmo-hlr_10.42.42.2(pid=7963): stdout: | (launched: 2022-12-13_22:25:50.719869) 22:25:54.077145 run osmo-hlr_10.42.42.2(pid=7963): stderr: | 20221213222550895 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222550895 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222550895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222550895 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222550895 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222550896 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222550925 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222550935 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222550935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222550935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:54.130040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7962): Terminating (SIGTERM) 22:25:54.171707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7965): Terminating (SIGTERM) 22:25:54.213898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7970): Terminating (SIGTERM) 22:25:54.256231 --- ParallelTerminationStrategy: PID 7962 died... 22:25:54.276426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7962): Terminated: ok {rc=0} 22:25:54.323061 --- ParallelTerminationStrategy: PID 7965 died... 22:25:54.343004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7965): Terminated: ok {rc=0} 22:25:54.389243 --- ParallelTerminationStrategy: PID 7970 died... 22:25:54.409139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7970): Terminated: ok {rc=0} 22:25:54.498337 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:25:55.802299 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:25:55.808772 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:25:55.841767 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:25:55.882128 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:25:55.971011 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:25:56.003738 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:25:56.042815 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:25:56.637804 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:25:56.690734 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:56.701982 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:25:56.772340 tst cs_paging_gprs_active.py: using LAC 36639 22:25:56.899769 tst cs_paging_gprs_active.py: using RAC 174 22:25:57.021502 tst cs_paging_gprs_active.py: using CellId 36639 22:25:57.142422 tst cs_paging_gprs_active.py: using BVCI 36640 22:25:57.254039 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:57.264834 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:57.275420 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:57.286013 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:57.296469 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:57.307638 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:57.318483 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:57.329160 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:25:57.339903 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:25:57.459558 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:25:57.574569 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:25:57.778575 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:58.082250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7975): Launched 22:25:58.345751 run iperf3-srv_10.42.42.10(pid=7976): Launched 22:25:58.458849 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:25:58.660823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:25:58.964565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7977): Launched 22:25:59.227743 run iperf3-srv_10.42.42.10(pid=7978): Launched 22:25:59.341263 tst cs_paging_gprs_active.py:38: start network... 22:25:59.543913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:00.012899 run create_hlr_db(pid=7979): Launched 22:26:00.138011 bus /gobi_6: Setting Powered False 22:26:01.201281 run create_hlr_db(pid=7979): Terminated: ok {rc=0} 22:26:01.676104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7981): Launched 22:26:02.028776 run osmo-hlr_10.42.42.2(pid=7982): Launched 22:26:02.184939 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:02.744057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7984): Launched 22:26:03.069875 run osmo-stp_10.42.42.5(pid=7985): Launched 22:26:03.194339 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:26:03.755474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7987): Launched 22:26:03.880429 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:26:04.162277 run patchelf(pid=7988): Launched 22:26:04.343987 run osmo-stp_10.42.42.5(pid=7985): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7985)] 22:26:04.481751 run osmo-stp_10.42.42.5(pid=7985): stdout: | (launched: 2022-12-13_22:26:03.011300) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:04.620768 run osmo-stp_10.42.42.5(pid=7985): stderr: | 20221213222603203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222603203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222603203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222603204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222603204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222603204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222603204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:04.760184 run osmo-stp_10.42.42.5(pid=7985): stdout: | (launched: 2022-12-13_22:26:03.011300) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:04.893859 run osmo-stp_10.42.42.5(pid=7985): stderr: | 20221213222603203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222603203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222603203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222603204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222603204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222603204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222603204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:05.052182 run patchelf(pid=7988): Terminating (SIGINT) 22:26:05.234386 run patchelf(pid=7988): Terminated: ok {rc=0} 22:26:05.365570 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7985): Process ended prematurely: osmo-stp_10.42.42.5(pid=7985) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7985)] [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:26:05.375696 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:26:05.404193 run osmo-hlr_10.42.42.2(pid=7982): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7982)] 22:26:05.454571 run osmo-hlr_10.42.42.2(pid=7982): stdout: | (launched: 2022-12-13_22:26:01.964906) 22:26:05.507169 run osmo-hlr_10.42.42.2(pid=7982): stderr: | 20221213222602243 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222602243 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222602243 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222602243 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222602243 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222602243 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222602255 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222602264 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222602264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222602264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:05.559402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7975): Terminating (SIGTERM) 22:26:05.600776 run iperf3-srv_10.42.42.10(pid=7976): Terminating (SIGTERM) 22:26:05.642502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7977): Terminating (SIGTERM) 22:26:05.684251 run iperf3-srv_10.42.42.10(pid=7978): Terminating (SIGTERM) 22:26:05.725893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7981): Terminating (SIGTERM) 22:26:05.767599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7984): Terminating (SIGTERM) 22:26:05.809307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7987): Terminating (SIGTERM) 22:26:05.851308 --- ParallelTerminationStrategy: PID 7975 died... 22:26:05.871866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7975): Terminated: ok {rc=0} 22:26:05.918110 --- ParallelTerminationStrategy: PID 7976 died... 22:26:05.938006 run iperf3-srv_10.42.42.10(pid=7976): Terminated {rc=256} 22:26:05.983989 --- ParallelTerminationStrategy: PID 7977 died... 22:26:06.003874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7977): Terminated: ok {rc=0} 22:26:06.049853 --- ParallelTerminationStrategy: PID 7978 died... 22:26:06.069641 run iperf3-srv_10.42.42.10(pid=7978): Terminated {rc=256} 22:26:06.115645 --- ParallelTerminationStrategy: PID 7981 died... 22:26:06.135439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7981): Terminated: ok {rc=0} 22:26:06.181393 --- ParallelTerminationStrategy: PID 7984 died... 22:26:06.201222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7984): Terminated: ok {rc=0} 22:26:06.247237 --- ParallelTerminationStrategy: PID 7987 died... 22:26:06.267001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7987): Terminated: ok {rc=0} 22:26:06.355036 bus /gobi_0: Setting Powered False 22:26:07.453671 bus /gobi_0: Setting Powered False 22:26:08.569865 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:26:09.718567 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:09.730424 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:26:09.801211 tst iperf3.py: using LAC 36640 22:26:09.930435 tst iperf3.py: using RAC 175 22:26:10.058687 tst iperf3.py: using CellId 36640 22:26:10.187537 tst iperf3.py: using BVCI 36641 22:26:10.299296 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:10.310145 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:10.321029 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:10.331747 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:10.342321 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:10.352889 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:10.363586 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:10.374166 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:10.384879 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:10.505601 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:26:10.725887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:11.051388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7989): Launched 22:26:11.333234 run iperf3-srv_10.42.42.10(pid=7990): Launched 22:26:11.455216 tst iperf3.py:8: start network... 22:26:11.674268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:12.179458 run create_hlr_db(pid=7991): Launched 22:26:12.302355 bus /gobi_6: Setting Powered False 22:26:13.366464 run create_hlr_db(pid=7991): Terminated: ok {rc=0} 22:26:13.816727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7993): Launched 22:26:14.140865 run osmo-hlr_10.42.42.2(pid=7994): Launched 22:26:14.265482 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:14.915836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7996): Launched 22:26:15.232524 run osmo-stp_10.42.42.5(pid=7997): Launched 22:26:15.353867 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:26:15.917324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7999): Launched 22:26:16.043320 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:26:16.323827 run patchelf(pid=8000): Launched 22:26:16.510191 run osmo-stp_10.42.42.5(pid=7997): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7997)] 22:26:16.648375 run osmo-stp_10.42.42.5(pid=7997): stdout: | (launched: 2022-12-13_22:26:15.175352) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:16.787950 run osmo-stp_10.42.42.5(pid=7997): stderr: | 20221213222615366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222615366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222615366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222615367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222615367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222615367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222615367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:16.928207 run osmo-stp_10.42.42.5(pid=7997): stdout: | (launched: 2022-12-13_22:26:15.175352) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:17.061972 run osmo-stp_10.42.42.5(pid=7997): stderr: | 20221213222615366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222615366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222615366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222615367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222615367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222615367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222615367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:17.221103 run patchelf(pid=8000): Terminating (SIGINT) 22:26:17.398652 run patchelf(pid=8000): Terminated: ok {rc=0} 22:26:17.527140 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7997): Process ended prematurely: osmo-stp_10.42.42.5(pid=7997) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7997)] [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 22:26:17.537317 tst iperf3.py:8: Test FAILED (7.9 sec) 22:26:17.565813 run osmo-hlr_10.42.42.2(pid=7994): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7994)] 22:26:17.616520 run osmo-hlr_10.42.42.2(pid=7994): stdout: | (launched: 2022-12-13_22:26:14.082229) 22:26:17.668342 run osmo-hlr_10.42.42.2(pid=7994): stderr: | 20221213222614281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222614281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222614281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222614281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222614281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222614281 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222614298 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222614308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222614308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222614308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:17.720424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7989): Terminating (SIGTERM) 22:26:17.761569 run iperf3-srv_10.42.42.10(pid=7990): Terminating (SIGTERM) 22:26:17.803021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7993): Terminating (SIGTERM) 22:26:17.844422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7996): Terminating (SIGTERM) 22:26:17.886310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7999): Terminating (SIGTERM) 22:26:17.928378 --- ParallelTerminationStrategy: PID 7989 died... 22:26:17.948709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7989): Terminated: ok {rc=0} 22:26:17.994934 --- ParallelTerminationStrategy: PID 7990 died... 22:26:18.014487 run iperf3-srv_10.42.42.10(pid=7990): Terminated {rc=256} 22:26:18.060722 --- ParallelTerminationStrategy: PID 7993 died... 22:26:18.080590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7993): Terminated: ok {rc=0} 22:26:18.126554 --- ParallelTerminationStrategy: PID 7996 died... 22:26:18.146229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7996): Terminated: ok {rc=0} 22:26:18.192078 --- ParallelTerminationStrategy: PID 7999 died... 22:26:18.211731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7999): Terminated: ok {rc=0} 22:26:18.299260 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:26:19.447017 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:19.458875 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:26:19.535739 tst iperf3m4.py: using LAC 36641 22:26:19.664921 tst iperf3m4.py: using RAC 176 22:26:19.788103 tst iperf3m4.py: using CellId 36641 22:26:19.910424 tst iperf3m4.py: using BVCI 36642 22:26:20.025678 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:20.037049 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:20.048092 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:20.059072 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:20.070348 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:20.081828 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:20.093313 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:20.104396 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:20.115870 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:20.235298 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:20.352319 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:20.471502 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:20.588939 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:26:20.786792 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:21.083316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8001): Launched 22:26:21.340176 run iperf3-srv_10.42.42.10(pid=8002): Launched 22:26:21.451244 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:26:21.648642 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:21.945180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8003): Launched 22:26:22.202264 run iperf3-srv_10.42.42.10(pid=8004): Launched 22:26:22.312696 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:26:22.509730 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:22.805479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8005): Launched 22:26:23.062163 run iperf3-srv_10.42.42.10(pid=8006): Launched 22:26:23.172753 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:26:23.369690 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:23.666710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8007): Launched 22:26:23.924322 run iperf3-srv_10.42.42.10(pid=8008): Launched 22:26:24.034780 tst iperf3m4.py:8: start network... 22:26:24.232178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:24.692340 run create_hlr_db(pid=8009): Launched 22:26:24.814659 bus /gobi_6: Setting Powered False 22:26:25.873672 run create_hlr_db(pid=8009): Terminated: ok {rc=0} 22:26:26.307772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8011): Launched 22:26:26.624660 run osmo-hlr_10.42.42.2(pid=8012): Launched 22:26:26.746616 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:27.293911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8014): Launched 22:26:27.610091 run osmo-stp_10.42.42.5(pid=8015): Launched 22:26:27.730527 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:26:28.276855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8017): Launched 22:26:28.398187 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:26:28.665928 run patchelf(pid=8018): Launched 22:26:28.842201 run osmo-stp_10.42.42.5(pid=8015): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8015)] 22:26:28.977856 run osmo-stp_10.42.42.5(pid=8015): stdout: | (launched: 2022-12-13_22:26:27.552826) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:29.113764 run osmo-stp_10.42.42.5(pid=8015): stderr: | 20221213222627744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222627744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222627744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222627745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222627745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222627745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222627745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:29.249795 run osmo-stp_10.42.42.5(pid=8015): stdout: | (launched: 2022-12-13_22:26:27.552826) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:29.379679 run osmo-stp_10.42.42.5(pid=8015): stderr: | 20221213222627744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222627744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222627744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222627745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222627745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222627745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222627745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:29.534151 run patchelf(pid=8018): Terminating (SIGINT) 22:26:29.711435 run patchelf(pid=8018): Terminated: ok {rc=0} 22:26:29.840079 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8015): Process ended prematurely: osmo-stp_10.42.42.5(pid=8015) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8015)] [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:26:29.850252 tst iperf3m4.py:8: Test FAILED (10.4 sec) 22:26:29.878788 run osmo-hlr_10.42.42.2(pid=8012): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8012)] 22:26:29.930171 run osmo-hlr_10.42.42.2(pid=8012): stdout: | (launched: 2022-12-13_22:26:26.567315) 22:26:29.981943 run osmo-hlr_10.42.42.2(pid=8012): stderr: | 20221213222626765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222626765 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222626765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222626765 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222626765 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222626765 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222626777 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222626785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222626786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222626786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:30.033634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8001): Terminating (SIGTERM) 22:26:30.075463 run iperf3-srv_10.42.42.10(pid=8002): Terminating (SIGTERM) 22:26:30.117444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8003): Terminating (SIGTERM) 22:26:30.159369 run iperf3-srv_10.42.42.10(pid=8004): Terminating (SIGTERM) 22:26:30.202476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8005): Terminating (SIGTERM) 22:26:30.245160 run iperf3-srv_10.42.42.10(pid=8006): Terminating (SIGTERM) 22:26:30.286901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8007): Terminating (SIGTERM) 22:26:30.328728 run iperf3-srv_10.42.42.10(pid=8008): Terminating (SIGTERM) 22:26:30.370489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8011): Terminating (SIGTERM) 22:26:30.412170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8014): Terminating (SIGTERM) 22:26:30.453741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8017): Terminating (SIGTERM) 22:26:30.495549 --- ParallelTerminationStrategy: PID 8001 died... 22:26:30.515699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8001): Terminated: ok {rc=0} 22:26:30.562035 --- ParallelTerminationStrategy: PID 8002 died... 22:26:30.581721 run iperf3-srv_10.42.42.10(pid=8002): Terminated {rc=256} 22:26:30.627818 --- ParallelTerminationStrategy: PID 8003 died... 22:26:30.647520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8003): Terminated: ok {rc=0} 22:26:30.693641 --- ParallelTerminationStrategy: PID 8004 died... 22:26:30.713368 run iperf3-srv_10.42.42.10(pid=8004): Terminated {rc=256} 22:26:30.759483 --- ParallelTerminationStrategy: PID 8005 died... 22:26:30.779427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8005): Terminated: ok {rc=0} 22:26:30.825574 --- ParallelTerminationStrategy: PID 8006 died... 22:26:30.846058 run iperf3-srv_10.42.42.10(pid=8006): Terminated {rc=256} 22:26:30.893333 --- ParallelTerminationStrategy: PID 8007 died... 22:26:30.913693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8007): Terminated: ok {rc=0} 22:26:30.961038 --- ParallelTerminationStrategy: PID 8008 died... 22:26:30.981174 run iperf3-srv_10.42.42.10(pid=8008): Terminated {rc=256} 22:26:31.028089 --- ParallelTerminationStrategy: PID 8011 died... 22:26:31.048355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8011): Terminated: ok {rc=0} 22:26:31.095520 --- ParallelTerminationStrategy: PID 8014 died... 22:26:31.116171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8014): Terminated: ok {rc=0} 22:26:31.163397 --- ParallelTerminationStrategy: PID 8017 died... 22:26:31.183858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8017): Terminated: ok {rc=0} 22:26:31.274295 bus /gobi_4: Setting Powered False 22:26:32.371098 bus /gobi_4: Setting Powered False 22:26:33.484505 bus /gobi_1: Setting Powered False 22:26:34.583189 bus /gobi_1: Setting Powered False 22:26:35.697579 bus /gobi_0: Setting Powered False 22:26:36.792710 bus /gobi_0: Setting Powered False 22:26:37.907552 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:26:39.011433 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:39.022890 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:26:39.094821 tst ping.py: using LAC 36642 22:26:39.209474 tst ping.py: using RAC 177 22:26:39.333617 tst ping.py: using CellId 36642 22:26:39.448433 tst ping.py: using BVCI 36643 22:26:39.554041 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:39.565055 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:39.575779 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:39.586417 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:39.596890 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:39.607574 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:39.618784 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:39.629431 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:39.747222 tst ping.py:19: start network... 22:26:39.959126 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:40.446469 run create_hlr_db(pid=8019): Launched 22:26:40.565934 bus /gobi_6: Setting Powered False 22:26:41.628609 run create_hlr_db(pid=8019): Terminated: ok {rc=0} 22:26:42.066556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8021): Launched 22:26:42.378970 run osmo-hlr_10.42.42.2(pid=8022): Launched 22:26:42.499178 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:43.039798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8024): Launched 22:26:43.353089 run osmo-stp_10.42.42.5(pid=8025): Launched 22:26:43.473707 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:26:44.014237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8027): Launched 22:26:44.133637 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:26:44.397326 run patchelf(pid=8028): Launched 22:26:44.571240 run osmo-stp_10.42.42.5(pid=8025): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8025)] 22:26:44.704072 run osmo-stp_10.42.42.5(pid=8025): stdout: | (launched: 2022-12-13_22:26:43.295975) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:44.838267 run osmo-stp_10.42.42.5(pid=8025): stderr: | 20221213222643485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222643485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222643485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222643486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222643486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222643486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222643486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:44.973501 run osmo-stp_10.42.42.5(pid=8025): stdout: | (launched: 2022-12-13_22:26:43.295975) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:45.102362 run osmo-stp_10.42.42.5(pid=8025): stderr: | 20221213222643485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222643485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222643485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222643486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222643486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222643486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222643486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:45.254898 run patchelf(pid=8028): Terminating (SIGINT) 22:26:45.430228 run patchelf(pid=8028): Terminated: ok {rc=0} 22:26:45.556797 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8025): Process ended prematurely: osmo-stp_10.42.42.5(pid=8025) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8025)] [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 22:26:45.566518 tst ping.py:22: Test FAILED (6.5 sec) 22:26:45.594485 run osmo-hlr_10.42.42.2(pid=8022): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8022)] 22:26:45.644856 run osmo-hlr_10.42.42.2(pid=8022): stdout: | (launched: 2022-12-13_22:26:42.322148) 22:26:45.697077 run osmo-hlr_10.42.42.2(pid=8022): stderr: | 20221213222642519 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222642519 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222642519 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222642519 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222642519 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222642519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222642532 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222642540 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222642540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222642540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:45.749440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8021): Terminating (SIGTERM) 22:26:45.790804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8024): Terminating (SIGTERM) 22:26:45.833093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8027): Terminating (SIGTERM) 22:26:45.875891 --- ParallelTerminationStrategy: PID 8021 died... 22:26:45.896010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8021): Terminated: ok {rc=0} 22:26:45.943513 --- ParallelTerminationStrategy: PID 8024 died... 22:26:45.963915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8024): Terminated: ok {rc=0} 22:26:46.010931 --- ParallelTerminationStrategy: PID 8027 died... 22:26:46.031355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8027): Terminated: ok {rc=0} 22:26:46.121692 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:26:47.209953 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:47.222549 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:26:47.305647 tst ping_idle_ping.py: using LAC 36643 22:26:47.426841 tst ping_idle_ping.py: using RAC 178 22:26:47.547943 tst ping_idle_ping.py: using CellId 36643 22:26:47.670188 tst ping_idle_ping.py: using BVCI 36644 22:26:47.783367 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:47.794668 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:47.805991 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:47.816897 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:47.828285 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:47.839686 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:47.851328 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:26:47.862712 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:26:47.979378 tst ping_idle_ping.py:24: start network... 22:26:48.175695 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:48.629754 run create_hlr_db(pid=8029): Launched 22:26:48.751484 bus /gobi_6: Setting Powered False 22:26:49.810694 run create_hlr_db(pid=8029): Terminated: ok {rc=0} 22:26:50.221475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8031): Launched 22:26:50.513787 run osmo-hlr_10.42.42.2(pid=8032): Launched 22:26:50.625923 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:51.143905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8034): Launched 22:26:51.438947 run osmo-stp_10.42.42.5(pid=8035): Launched 22:26:51.550506 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:26:52.055258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8037): Launched 22:26:52.167113 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:26:52.413688 run patchelf(pid=8038): Launched 22:26:52.576363 run osmo-stp_10.42.42.5(pid=8035): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8035)] 22:26:52.702586 run osmo-stp_10.42.42.5(pid=8035): stdout: | (launched: 2022-12-13_22:26:51.385412) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:52.828597 run osmo-stp_10.42.42.5(pid=8035): stderr: | 20221213222651555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222651555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222651555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222651555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222651556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222651556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222651556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:52.954961 run osmo-stp_10.42.42.5(pid=8035): stdout: | (launched: 2022-12-13_22:26:51.385412) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:53.075434 run osmo-stp_10.42.42.5(pid=8035): stderr: | 20221213222651555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222651555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222651555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222651555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222651556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222651556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222651556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:53.218375 run patchelf(pid=8038): Terminating (SIGINT) 22:26:53.383390 run patchelf(pid=8038): Terminated: ok {rc=0} 22:26:53.501911 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8035): Process ended prematurely: osmo-stp_10.42.42.5(pid=8035) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8035)] [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:26:53.510688 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 22:26:53.537226 run osmo-hlr_10.42.42.2(pid=8032): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8032)] 22:26:53.584407 run osmo-hlr_10.42.42.2(pid=8032): stdout: | (launched: 2022-12-13_22:26:50.460543) 22:26:53.633353 run osmo-hlr_10.42.42.2(pid=8032): stderr: | 20221213222650635 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222650635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222650635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222650635 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222650635 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222650635 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222650648 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222650656 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222650656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222650657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:53.682716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8031): Terminating (SIGTERM) 22:26:53.721977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8034): Terminating (SIGTERM) 22:26:53.761048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8037): Terminating (SIGTERM) 22:26:53.800335 --- ParallelTerminationStrategy: PID 8031 died... 22:26:53.819192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8031): Terminated: ok {rc=0} 22:26:53.862780 --- ParallelTerminationStrategy: PID 8034 died... 22:26:53.881212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8034): Terminated: ok {rc=0} 22:26:53.924754 --- ParallelTerminationStrategy: PID 8037 died... 22:26:53.943242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8037): Terminated: ok {rc=0} 22:26:54.028290 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:26:55.332013 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:26:55.337826 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:26:55.369672 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:26:55.407429 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:26:55.494546 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:26:55.526969 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:26:55.564771 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:26:56.158206 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:26:56.208064 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:56.218982 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:26:56.288238 tst cs_paging_gprs_active.py: using LAC 36644 22:26:56.406971 tst cs_paging_gprs_active.py: using RAC 179 22:26:56.525869 tst cs_paging_gprs_active.py: using CellId 36644 22:26:56.645091 tst cs_paging_gprs_active.py: using BVCI 36645 22:26:56.752935 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:56.763829 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:56.774423 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:56.785046 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:56.795506 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:56.806200 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:56.817039 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:56.827515 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:26:56.838272 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:26:56.952233 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:26:57.071126 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:26:57.272184 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:57.573387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8042): Launched 22:26:57.834282 run iperf3-srv_10.42.42.10(pid=8043): Launched 22:26:57.946717 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:26:58.147086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:26:58.447266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8044): Launched 22:26:58.708117 run iperf3-srv_10.42.42.10(pid=8045): Launched 22:26:58.820460 tst cs_paging_gprs_active.py:38: start network... 22:26:59.021245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:59.485123 run create_hlr_db(pid=8046): Launched 22:26:59.607473 bus /gobi_6: Setting Powered False 22:27:00.667815 run create_hlr_db(pid=8046): Terminated: ok {rc=0} 22:27:01.133861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8048): Launched 22:27:01.463365 run osmo-hlr_10.42.42.2(pid=8049): Launched 22:27:01.632704 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:02.467686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8051): Launched 22:27:02.765272 run osmo-stp_10.42.42.5(pid=8052): Launched 22:27:02.879218 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:27:03.393204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8054): Launched 22:27:03.507129 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:27:03.760514 run patchelf(pid=8055): Launched 22:27:03.926582 run osmo-stp_10.42.42.5(pid=8052): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8052)] 22:27:04.052390 run osmo-stp_10.42.42.5(pid=8052): stdout: | (launched: 2022-12-13_22:27:02.710952) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:04.180112 run osmo-stp_10.42.42.5(pid=8052): stderr: | 20221213222702883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222702883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222702883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222702884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222702884 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222702884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222702884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:04.307887 run osmo-stp_10.42.42.5(pid=8052): stdout: | (launched: 2022-12-13_22:27:02.710952) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:04.429506 run osmo-stp_10.42.42.5(pid=8052): stderr: | 20221213222702883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222702883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222702883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222702884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222702884 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222702884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222702884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:04.574192 run patchelf(pid=8055): Terminating (SIGINT) 22:27:04.741382 run patchelf(pid=8055): Terminated: ok {rc=0} 22:27:04.862052 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8052): Process ended prematurely: osmo-stp_10.42.42.5(pid=8052) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8052)] [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:27:04.871383 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:27:04.898162 run osmo-hlr_10.42.42.2(pid=8049): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8049)] 22:27:04.945161 run osmo-hlr_10.42.42.2(pid=8049): stdout: | (launched: 2022-12-13_22:27:01.403848) 22:27:04.993635 run osmo-hlr_10.42.42.2(pid=8049): stderr: | 20221213222701810 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222701810 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222701810 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222701810 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222701810 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222701810 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222701831 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222701839 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222701839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222701839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:05.042697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8042): Terminating (SIGTERM) 22:27:05.081902 run iperf3-srv_10.42.42.10(pid=8043): Terminating (SIGTERM) 22:27:05.120886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8044): Terminating (SIGTERM) 22:27:05.160084 run iperf3-srv_10.42.42.10(pid=8045): Terminating (SIGTERM) 22:27:05.198970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8048): Terminating (SIGTERM) 22:27:05.238130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8051): Terminating (SIGTERM) 22:27:05.277191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8054): Terminating (SIGTERM) 22:27:05.316327 --- ParallelTerminationStrategy: PID 8042 died... 22:27:05.335141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8042): Terminated: ok {rc=0} 22:27:05.378444 --- ParallelTerminationStrategy: PID 8043 died... 22:27:05.397064 run iperf3-srv_10.42.42.10(pid=8043): Terminated {rc=256} 22:27:05.440263 --- ParallelTerminationStrategy: PID 8044 died... 22:27:05.458522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8044): Terminated: ok {rc=0} 22:27:05.501678 --- ParallelTerminationStrategy: PID 8045 died... 22:27:05.519887 run iperf3-srv_10.42.42.10(pid=8045): Terminated {rc=256} 22:27:05.562880 --- ParallelTerminationStrategy: PID 8048 died... 22:27:05.581223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8048): Terminated: ok {rc=0} 22:27:05.624337 --- ParallelTerminationStrategy: PID 8051 died... 22:27:05.642654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8051): Terminated: ok {rc=0} 22:27:05.685721 --- ParallelTerminationStrategy: PID 8054 died... 22:27:05.703802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8054): Terminated: ok {rc=0} 22:27:05.788813 bus /gobi_0: Setting Powered False 22:27:06.887578 bus /gobi_0: Setting Powered False 22:27:08.003416 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:27:09.147808 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:09.159150 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:27:09.229625 tst iperf3.py: using LAC 36645 22:27:09.347375 tst iperf3.py: using RAC 180 22:27:09.466398 tst iperf3.py: using CellId 36645 22:27:09.584306 tst iperf3.py: using BVCI 36646 22:27:09.693724 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:09.704524 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:09.715147 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:09.725871 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:09.736346 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:09.746966 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:09.757653 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:09.768217 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:09.778948 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:09.896561 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:27:10.111998 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:10.430242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8057): Launched 22:27:10.707723 run iperf3-srv_10.42.42.10(pid=8058): Launched 22:27:10.827204 tst iperf3.py:8: start network... 22:27:11.041961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:11.535159 run create_hlr_db(pid=8059): Launched 22:27:11.656848 bus /gobi_6: Setting Powered False 22:27:12.720013 run create_hlr_db(pid=8059): Terminated: ok {rc=0} 22:27:13.162615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8061): Launched 22:27:13.480644 run osmo-hlr_10.42.42.2(pid=8062): Launched 22:27:13.603390 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:14.151920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8064): Launched 22:27:14.470076 run osmo-stp_10.42.42.5(pid=8065): Launched 22:27:14.592423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:27:15.142580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8067): Launched 22:27:15.265529 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:27:15.534217 run patchelf(pid=8068): Launched 22:27:15.711378 run osmo-stp_10.42.42.5(pid=8065): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8065)] 22:27:15.851629 run osmo-stp_10.42.42.5(pid=8065): stdout: | (launched: 2022-12-13_22:27:14.412407) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:15.999442 run osmo-stp_10.42.42.5(pid=8065): stderr: | 20221213222714603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222714603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222714603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222714604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222714604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222714604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222714604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:16.139922 run osmo-stp_10.42.42.5(pid=8065): stdout: | (launched: 2022-12-13_22:27:14.412407) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:16.273760 run osmo-stp_10.42.42.5(pid=8065): stderr: | 20221213222714603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222714603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222714603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222714604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222714604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222714604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222714604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:16.432788 run patchelf(pid=8068): Terminating (SIGINT) 22:27:16.614859 run patchelf(pid=8068): Terminated: ok {rc=0} 22:27:16.746672 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8065): Process ended prematurely: osmo-stp_10.42.42.5(pid=8065) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8065)] [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 22:27:16.758016 tst iperf3.py:8: Test FAILED (7.6 sec) 22:27:16.788608 run osmo-hlr_10.42.42.2(pid=8062): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8062)] 22:27:16.842179 run osmo-hlr_10.42.42.2(pid=8062): stdout: | (launched: 2022-12-13_22:27:13.423205) 22:27:16.896460 run osmo-hlr_10.42.42.2(pid=8062): stderr: | 20221213222713622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222713622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222713622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222713622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222713622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222713622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222713635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222713643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222713643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222713643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:16.952077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8057): Terminating (SIGTERM) 22:27:16.995482 run iperf3-srv_10.42.42.10(pid=8058): Terminating (SIGTERM) 22:27:17.042564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8061): Terminating (SIGTERM) 22:27:17.086872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8064): Terminating (SIGTERM) 22:27:17.131101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8067): Terminating (SIGTERM) 22:27:17.175221 --- ParallelTerminationStrategy: PID 8057 died... 22:27:17.196800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8057): Terminated: ok {rc=0} 22:27:17.245252 --- ParallelTerminationStrategy: PID 8058 died... 22:27:17.267120 run iperf3-srv_10.42.42.10(pid=8058): Terminated {rc=256} 22:27:17.315399 --- ParallelTerminationStrategy: PID 8061 died... 22:27:17.333932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8061): Terminated: ok {rc=0} 22:27:17.378173 --- ParallelTerminationStrategy: PID 8064 died... 22:27:17.396828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8064): Terminated: ok {rc=0} 22:27:17.440481 --- ParallelTerminationStrategy: PID 8067 died... 22:27:17.459047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8067): Terminated: ok {rc=0} 22:27:17.545332 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:27:18.691863 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:18.703397 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:27:18.772600 tst iperf3m4.py: using LAC 36646 22:27:18.889101 tst iperf3m4.py: using RAC 181 22:27:19.005928 tst iperf3m4.py: using CellId 36646 22:27:19.136437 tst iperf3m4.py: using BVCI 36647 22:27:19.245319 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:19.256084 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:19.266764 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:19.277336 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:19.287799 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:19.298497 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:19.309679 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:19.320159 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:19.330972 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:19.452306 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:19.571192 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:19.690131 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:19.807813 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:27:20.006609 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:20.304503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8069): Launched 22:27:20.564819 run iperf3-srv_10.42.42.10(pid=8070): Launched 22:27:20.676739 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:27:20.875311 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:21.173732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8071): Launched 22:27:21.433076 run iperf3-srv_10.42.42.10(pid=8072): Launched 22:27:21.544787 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:27:21.743086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:22.041284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8073): Launched 22:27:22.301438 run iperf3-srv_10.42.42.10(pid=8074): Launched 22:27:22.412707 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:27:22.610811 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:22.909060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8075): Launched 22:27:23.168691 run iperf3-srv_10.42.42.10(pid=8076): Launched 22:27:23.280389 tst iperf3m4.py:8: start network... 22:27:23.479197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:23.941924 run create_hlr_db(pid=8077): Launched 22:27:24.063743 bus /gobi_6: Setting Powered False 22:27:25.123756 run create_hlr_db(pid=8077): Terminated: ok {rc=0} 22:27:25.559685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8079): Launched 22:27:25.878463 run osmo-hlr_10.42.42.2(pid=8080): Launched 22:27:26.001294 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:26.553695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8082): Launched 22:27:26.872478 run osmo-stp_10.42.42.5(pid=8083): Launched 22:27:26.995124 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:27:27.546802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8085): Launched 22:27:27.670249 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:27:27.940091 run patchelf(pid=8086): Launched 22:27:28.118806 run osmo-stp_10.42.42.5(pid=8083): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8083)] 22:27:28.254339 run osmo-stp_10.42.42.5(pid=8083): stdout: | (launched: 2022-12-13_22:27:26.814761) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:28.391651 run osmo-stp_10.42.42.5(pid=8083): stderr: | 20221213222727010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222727010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222727010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222727011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222727011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222727011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222727011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:28.529294 run osmo-stp_10.42.42.5(pid=8083): stdout: | (launched: 2022-12-13_22:27:26.814761) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:28.660831 run osmo-stp_10.42.42.5(pid=8083): stderr: | 20221213222727010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222727010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222727010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222727011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222727011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222727011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222727011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:28.816496 run patchelf(pid=8086): Terminating (SIGINT) 22:27:28.996191 run patchelf(pid=8086): Terminated: ok {rc=0} 22:27:29.125478 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8083): Process ended prematurely: osmo-stp_10.42.42.5(pid=8083) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8083)] [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:27:29.135531 tst iperf3m4.py:8: Test FAILED (10.5 sec) 22:27:29.164244 run osmo-hlr_10.42.42.2(pid=8080): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8080)] 22:27:29.215100 run osmo-hlr_10.42.42.2(pid=8080): stdout: | (launched: 2022-12-13_22:27:25.820837) 22:27:29.267612 run osmo-hlr_10.42.42.2(pid=8080): stderr: | 20221213222726020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222726021 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222726021 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222726021 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222726021 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222726021 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222726034 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222726042 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222726042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222726042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:29.320195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8069): Terminating (SIGTERM) 22:27:29.362122 run iperf3-srv_10.42.42.10(pid=8070): Terminating (SIGTERM) 22:27:29.404412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8071): Terminating (SIGTERM) 22:27:29.446559 run iperf3-srv_10.42.42.10(pid=8072): Terminating (SIGTERM) 22:27:29.488584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8073): Terminating (SIGTERM) 22:27:29.530942 run iperf3-srv_10.42.42.10(pid=8074): Terminating (SIGTERM) 22:27:29.572714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8075): Terminating (SIGTERM) 22:27:29.615069 run iperf3-srv_10.42.42.10(pid=8076): Terminating (SIGTERM) 22:27:29.657015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8079): Terminating (SIGTERM) 22:27:29.699073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8082): Terminating (SIGTERM) 22:27:29.741078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8085): Terminating (SIGTERM) 22:27:29.783773 --- ParallelTerminationStrategy: PID 8069 died... 22:27:29.804161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8069): Terminated: ok {rc=0} 22:27:29.850883 --- ParallelTerminationStrategy: PID 8070 died... 22:27:29.870807 run iperf3-srv_10.42.42.10(pid=8070): Terminated {rc=256} 22:27:29.917455 --- ParallelTerminationStrategy: PID 8071 died... 22:27:29.937251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8071): Terminated: ok {rc=0} 22:27:29.983777 --- ParallelTerminationStrategy: PID 8072 died... 22:27:30.003744 run iperf3-srv_10.42.42.10(pid=8072): Terminated {rc=256} 22:27:30.050398 --- ParallelTerminationStrategy: PID 8073 died... 22:27:30.070374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8073): Terminated: ok {rc=0} 22:27:30.116746 --- ParallelTerminationStrategy: PID 8074 died... 22:27:30.136707 run iperf3-srv_10.42.42.10(pid=8074): Terminated {rc=256} 22:27:30.183168 --- ParallelTerminationStrategy: PID 8075 died... 22:27:30.203155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8075): Terminated: ok {rc=0} 22:27:30.249658 --- ParallelTerminationStrategy: PID 8076 died... 22:27:30.269551 run iperf3-srv_10.42.42.10(pid=8076): Terminated {rc=256} 22:27:30.316209 --- ParallelTerminationStrategy: PID 8079 died... 22:27:30.336236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8079): Terminated: ok {rc=0} 22:27:30.382744 --- ParallelTerminationStrategy: PID 8082 died... 22:27:30.402747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8082): Terminated: ok {rc=0} 22:27:30.449226 --- ParallelTerminationStrategy: PID 8085 died... 22:27:30.469218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8085): Terminated: ok {rc=0} 22:27:30.557889 bus /gobi_4: Setting Powered False 22:27:31.678719 bus /gobi_4: Setting Powered False 22:27:32.795598 bus /gobi_1: Setting Powered False 22:27:33.894351 bus /gobi_1: Setting Powered False 22:27:35.011353 bus /gobi_0: Setting Powered False 22:27:36.109709 bus /gobi_0: Setting Powered False 22:27:37.226792 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:27:38.329673 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:38.341752 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:27:38.414285 tst ping.py: using LAC 36647 22:27:38.539002 tst ping.py: using RAC 182 22:27:38.662240 tst ping.py: using CellId 36647 22:27:38.788164 tst ping.py: using BVCI 36648 22:27:38.902358 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:38.913772 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:38.925473 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:38.936615 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:38.948032 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:38.959517 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:38.971163 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:38.982669 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:39.097577 tst ping.py:19: start network... 22:27:39.292655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:39.746958 run create_hlr_db(pid=8087): Launched 22:27:39.860400 bus /gobi_6: Setting Powered False 22:27:40.919367 run create_hlr_db(pid=8087): Terminated: ok {rc=0} 22:27:41.329077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8089): Launched 22:27:41.622086 run osmo-hlr_10.42.42.2(pid=8090): Launched 22:27:41.735139 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:42.255890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8092): Launched 22:27:42.547291 run osmo-stp_10.42.42.5(pid=8093): Launched 22:27:42.657899 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:27:43.161705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8095): Launched 22:27:43.273565 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:27:43.520201 run patchelf(pid=8096): Launched 22:27:43.683145 run osmo-stp_10.42.42.5(pid=8093): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8093)] 22:27:43.808246 run osmo-stp_10.42.42.5(pid=8093): stdout: | (launched: 2022-12-13_22:27:42.494079) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:43.933741 run osmo-stp_10.42.42.5(pid=8093): stderr: | 20221213222742661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222742662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222742662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222742663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222742665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222742665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222742665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:44.059493 run osmo-stp_10.42.42.5(pid=8093): stdout: | (launched: 2022-12-13_22:27:42.494079) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:44.179571 run osmo-stp_10.42.42.5(pid=8093): stderr: | 20221213222742661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222742662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222742662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222742663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222742665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222742665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222742665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:44.321904 run patchelf(pid=8096): Terminating (SIGINT) 22:27:44.485689 run patchelf(pid=8096): Terminated: ok {rc=0} 22:27:44.603847 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8093): Process ended prematurely: osmo-stp_10.42.42.5(pid=8093) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8093)] [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 22:27:44.612580 tst ping.py:22: Test FAILED (6.3 sec) 22:27:44.639194 run osmo-hlr_10.42.42.2(pid=8090): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8090)] 22:27:44.686576 run osmo-hlr_10.42.42.2(pid=8090): stdout: | (launched: 2022-12-13_22:27:41.568083) 22:27:44.735310 run osmo-hlr_10.42.42.2(pid=8090): stderr: | 20221213222741744 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222741744 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222741744 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222741745 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222741745 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222741745 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222741757 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222741765 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222741766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222741766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:44.784661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8089): Terminating (SIGTERM) 22:27:44.824218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8092): Terminating (SIGTERM) 22:27:44.863531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8095): Terminating (SIGTERM) 22:27:44.902985 --- ParallelTerminationStrategy: PID 8089 died... 22:27:44.921969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8089): Terminated: ok {rc=0} 22:27:44.965530 --- ParallelTerminationStrategy: PID 8092 died... 22:27:44.984026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8092): Terminated: ok {rc=0} 22:27:45.027445 --- ParallelTerminationStrategy: PID 8095 died... 22:27:45.046010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8095): Terminated: ok {rc=0} 22:27:45.131986 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:27:46.218997 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:46.231492 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:27:46.315826 tst ping_idle_ping.py: using LAC 36648 22:27:46.435400 tst ping_idle_ping.py: using RAC 183 22:27:46.564465 tst ping_idle_ping.py: using CellId 36648 22:27:46.715123 tst ping_idle_ping.py: using BVCI 36649 22:27:46.835770 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:46.848083 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:46.859951 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:46.871890 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:46.884454 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:46.897354 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:46.910203 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:27:46.923174 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:27:47.069483 tst ping_idle_ping.py:24: start network... 22:27:47.289109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:47.776807 run create_hlr_db(pid=8097): Launched 22:27:47.897836 bus /gobi_6: Setting Powered False 22:27:48.961235 run create_hlr_db(pid=8097): Terminated: ok {rc=0} 22:27:49.383537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8099): Launched 22:27:49.678246 run osmo-hlr_10.42.42.2(pid=8100): Launched 22:27:49.791647 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:50.298167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8102): Launched 22:27:50.593769 run osmo-stp_10.42.42.5(pid=8103): Launched 22:27:50.706147 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:27:51.217223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8105): Launched 22:27:51.330473 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:27:51.578491 run patchelf(pid=8106): Launched 22:27:51.742151 run osmo-stp_10.42.42.5(pid=8103): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8103)] 22:27:51.867753 run osmo-stp_10.42.42.5(pid=8103): stdout: | (launched: 2022-12-13_22:27:50.539828) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:51.993897 run osmo-stp_10.42.42.5(pid=8103): stderr: | 20221213222750711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222750711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222750711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222750712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222750712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222750712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222750712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:52.119958 run osmo-stp_10.42.42.5(pid=8103): stdout: | (launched: 2022-12-13_22:27:50.539828) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:52.240317 run osmo-stp_10.42.42.5(pid=8103): stderr: | 20221213222750711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222750711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222750711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222750712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222750712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222750712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222750712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:52.382960 run patchelf(pid=8106): Terminating (SIGINT) 22:27:52.547494 run patchelf(pid=8106): Terminated: ok {rc=0} 22:27:52.666340 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8103): Process ended prematurely: osmo-stp_10.42.42.5(pid=8103) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8103)] [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:27:52.675073 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:27:52.701812 run osmo-hlr_10.42.42.2(pid=8100): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8100)] 22:27:52.749398 run osmo-hlr_10.42.42.2(pid=8100): stdout: | (launched: 2022-12-13_22:27:49.624473) 22:27:52.798551 run osmo-hlr_10.42.42.2(pid=8100): stderr: | 20221213222749800 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222749800 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222749800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222749800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222749801 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222749801 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222749812 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222749821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222749821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222749821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:52.848274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8099): Terminating (SIGTERM) 22:27:52.887701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8102): Terminating (SIGTERM) 22:27:52.926994 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8105): Terminating (SIGTERM) 22:27:52.966533 --- ParallelTerminationStrategy: PID 8099 died... 22:27:52.985200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8099): Terminated: ok {rc=0} 22:27:53.028762 --- ParallelTerminationStrategy: PID 8102 died... 22:27:53.047436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8102): Terminated: ok {rc=0} 22:27:53.091031 --- ParallelTerminationStrategy: PID 8105 died... 22:27:53.109668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8105): Terminated: ok {rc=0} 22:27:53.195223 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:27:54.497961 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:27:54.504383 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:27:54.536162 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 22:27:54.573974 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 22:27:54.661973 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:27:54.694189 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 22:27:54.731826 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 22:27:55.334916 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 22:27:55.382737 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:55.393935 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:27:55.446271 tst cs_paging_gprs_active.py: using LAC 36649 22:27:55.564917 tst cs_paging_gprs_active.py: using RAC 184 22:27:55.685506 tst cs_paging_gprs_active.py: using CellId 36649 22:27:55.802427 tst cs_paging_gprs_active.py: using BVCI 36650 22:27:55.912319 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:55.923507 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:55.934458 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:55.945466 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:55.956394 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:55.967263 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:55.978295 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:55.989229 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:27:56.000268 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:27:56.119423 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:27:56.235931 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:27:56.437589 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:56.737914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8110): Launched 22:27:56.998460 run iperf3-srv_10.42.42.10(pid=8111): Launched 22:27:57.111572 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:27:57.312326 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:27:57.612433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8112): Launched 22:27:57.874640 run iperf3-srv_10.42.42.10(pid=8113): Launched 22:27:57.987313 tst cs_paging_gprs_active.py:38: start network... 22:27:58.187390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:58.651341 run create_hlr_db(pid=8114): Launched 22:27:58.774337 bus /gobi_6: Setting Powered False 22:27:59.835055 run create_hlr_db(pid=8114): Terminated: ok {rc=0} 22:28:00.274372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8116): Launched 22:28:00.595591 run osmo-hlr_10.42.42.2(pid=8117): Launched 22:28:00.719556 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:01.369719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8119): Launched 22:28:01.699602 run osmo-stp_10.42.42.5(pid=8120): Launched 22:28:01.938615 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:02.615886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8122): Launched 22:28:02.731064 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:02.983041 run patchelf(pid=8123): Launched 22:28:03.150360 run osmo-stp_10.42.42.5(pid=8120): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8120)] 22:28:03.276397 run osmo-stp_10.42.42.5(pid=8120): stdout: | (launched: 2022-12-13_22:28:01.629648) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:03.404769 run osmo-stp_10.42.42.5(pid=8120): stderr: | 20221213222801962 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222801962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222801962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222801963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222801963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222801963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222801963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:03.532913 run osmo-stp_10.42.42.5(pid=8120): stdout: | (launched: 2022-12-13_22:28:01.629648) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:03.655537 run osmo-stp_10.42.42.5(pid=8120): stderr: | 20221213222801962 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222801962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222801962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222801963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222801963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222801963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222801963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:03.800918 run patchelf(pid=8123): Terminating (SIGINT) 22:28:03.969655 run patchelf(pid=8123): Terminated: ok {rc=0} 22:28:04.090559 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8120): Process ended prematurely: osmo-stp_10.42.42.5(pid=8120) [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8120)] [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 22:28:04.099871 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 22:28:04.126797 run osmo-hlr_10.42.42.2(pid=8117): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8117)] 22:28:04.174017 run osmo-hlr_10.42.42.2(pid=8117): stdout: | (launched: 2022-12-13_22:28:00.537852) 22:28:04.223090 run osmo-hlr_10.42.42.2(pid=8117): stderr: | 20221213222800737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222800737 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222800737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222800737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222800738 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222800738 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222800754 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222800764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222800764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222800764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:04.273942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8110): Terminating (SIGTERM) 22:28:04.313555 run iperf3-srv_10.42.42.10(pid=8111): Terminating (SIGTERM) 22:28:04.353018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8112): Terminating (SIGTERM) 22:28:04.393158 run iperf3-srv_10.42.42.10(pid=8113): Terminating (SIGTERM) 22:28:04.432559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8116): Terminating (SIGTERM) 22:28:04.471955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8119): Terminating (SIGTERM) 22:28:04.511417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8122): Terminating (SIGTERM) 22:28:04.551014 --- ParallelTerminationStrategy: PID 8110 died... 22:28:04.570056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8110): Terminated: ok {rc=0} 22:28:04.614713 --- ParallelTerminationStrategy: PID 8111 died... 22:28:04.633381 run iperf3-srv_10.42.42.10(pid=8111): Terminated {rc=256} 22:28:04.676791 --- ParallelTerminationStrategy: PID 8112 died... 22:28:04.695331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8112): Terminated: ok {rc=0} 22:28:04.738886 --- ParallelTerminationStrategy: PID 8113 died... 22:28:04.757405 run iperf3-srv_10.42.42.10(pid=8113): Terminated {rc=256} 22:28:04.800897 --- ParallelTerminationStrategy: PID 8116 died... 22:28:04.820045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8116): Terminated: ok {rc=0} 22:28:04.863538 --- ParallelTerminationStrategy: PID 8119 died... 22:28:04.881942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8119): Terminated: ok {rc=0} 22:28:04.925719 --- ParallelTerminationStrategy: PID 8122 died... 22:28:04.944360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8122): Terminated: ok {rc=0} 22:28:05.027910 bus /gobi_0: Setting Powered False 22:28:06.126645 bus /gobi_0: Setting Powered False 22:28:07.245905 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 22:28:08.391088 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:08.403030 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:28:08.458172 tst iperf3.py: using LAC 36650 22:28:08.576742 tst iperf3.py: using RAC 185 22:28:08.694387 tst iperf3.py: using CellId 36650 22:28:08.812904 tst iperf3.py: using BVCI 36651 22:28:08.931010 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:08.942947 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:08.954664 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:08.966463 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:08.978852 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:08.991350 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:09.003894 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:09.016000 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:09.028501 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:09.148481 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:28:09.365333 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:09.686100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8124): Launched 22:28:09.965749 run iperf3-srv_10.42.42.10(pid=8125): Launched 22:28:10.085922 tst iperf3.py:8: start network... 22:28:10.301927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:10.796609 run create_hlr_db(pid=8126): Launched 22:28:10.918301 bus /gobi_6: Setting Powered False 22:28:11.981991 run create_hlr_db(pid=8126): Terminated: ok {rc=0} 22:28:12.408530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8128): Launched 22:28:12.707548 run osmo-hlr_10.42.42.2(pid=8129): Launched 22:28:12.822115 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:13.335770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8131): Launched 22:28:13.633088 run osmo-stp_10.42.42.5(pid=8132): Launched 22:28:13.747689 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:14.262604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8134): Launched 22:28:14.376570 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:14.629060 run patchelf(pid=8135): Launched 22:28:14.795116 run osmo-stp_10.42.42.5(pid=8132): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8132)] 22:28:14.921668 run osmo-stp_10.42.42.5(pid=8132): stdout: | (launched: 2022-12-13_22:28:13.578796) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:15.049905 run osmo-stp_10.42.42.5(pid=8132): stderr: | 20221213222813747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222813747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222813748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222813748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222813750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222813751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222813751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:15.178529 run osmo-stp_10.42.42.5(pid=8132): stdout: | (launched: 2022-12-13_22:28:13.578796) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:15.301250 run osmo-stp_10.42.42.5(pid=8132): stderr: | 20221213222813747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222813747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222813748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222813748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222813750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222813751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222813751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:15.446729 run patchelf(pid=8135): Terminating (SIGINT) 22:28:15.614188 run patchelf(pid=8135): Terminated: ok {rc=0} 22:28:15.735332 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8132): Process ended prematurely: osmo-stp_10.42.42.5(pid=8132) [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8132)] [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 22:28:15.744634 tst iperf3.py:8: Test FAILED (7.4 sec) 22:28:15.771606 run osmo-hlr_10.42.42.2(pid=8129): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8129)] 22:28:15.819372 run osmo-hlr_10.42.42.2(pid=8129): stdout: | (launched: 2022-12-13_22:28:12.653128) 22:28:15.871149 run osmo-hlr_10.42.42.2(pid=8129): stderr: | 20221213222812825 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222812825 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222812825 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222812825 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222812825 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222812826 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222812838 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222812846 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222812846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222812846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:15.926390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8124): Terminating (SIGTERM) 22:28:15.968112 run iperf3-srv_10.42.42.10(pid=8125): Terminating (SIGTERM) 22:28:16.012027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8128): Terminating (SIGTERM) 22:28:16.054498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8131): Terminating (SIGTERM) 22:28:16.097970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8134): Terminating (SIGTERM) 22:28:16.140073 --- ParallelTerminationStrategy: PID 8124 died... 22:28:16.160219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8124): Terminated: ok {rc=0} 22:28:16.205390 --- ParallelTerminationStrategy: PID 8125 died... 22:28:16.224681 run iperf3-srv_10.42.42.10(pid=8125): Terminated {rc=256} 22:28:16.270598 --- ParallelTerminationStrategy: PID 8128 died... 22:28:16.290971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8128): Terminated: ok {rc=0} 22:28:16.336822 --- ParallelTerminationStrategy: PID 8131 died... 22:28:16.357281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8131): Terminated: ok {rc=0} 22:28:16.402283 --- ParallelTerminationStrategy: PID 8134 died... 22:28:16.421415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8134): Terminated: ok {rc=0} 22:28:16.506660 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 22:28:17.651530 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:17.663437 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:28:17.720577 tst iperf3m4.py: using LAC 36651 22:28:17.837512 tst iperf3m4.py: using RAC 186 22:28:17.964542 tst iperf3m4.py: using CellId 36651 22:28:18.090466 tst iperf3m4.py: using BVCI 36652 22:28:18.208272 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:18.220288 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:18.232010 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:18.243717 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:18.256266 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:18.268817 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:18.281638 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:18.294000 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:18.306709 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:18.426220 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:18.548455 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:18.665464 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:18.780737 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:28:18.980107 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:19.278968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8136): Launched 22:28:19.538735 run iperf3-srv_10.42.42.10(pid=8137): Launched 22:28:19.651072 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:28:19.850449 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:20.150595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8138): Launched 22:28:20.410750 run iperf3-srv_10.42.42.10(pid=8139): Launched 22:28:20.522562 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:28:20.722153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:21.021090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8140): Launched 22:28:21.280844 run iperf3-srv_10.42.42.10(pid=8141): Launched 22:28:21.392438 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:28:21.591423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:21.890549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8142): Launched 22:28:22.150639 run iperf3-srv_10.42.42.10(pid=8143): Launched 22:28:22.262276 tst iperf3m4.py:8: start network... 22:28:22.460826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:22.921306 run create_hlr_db(pid=8144): Launched 22:28:23.044078 bus /gobi_6: Setting Powered False 22:28:24.104474 run create_hlr_db(pid=8144): Terminated: ok {rc=0} 22:28:24.541554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8146): Launched 22:28:24.860185 run osmo-hlr_10.42.42.2(pid=8147): Launched 22:28:24.983091 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:25.538666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8149): Launched 22:28:25.857771 run osmo-stp_10.42.42.5(pid=8150): Launched 22:28:25.980654 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:26.530727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8152): Launched 22:28:26.653653 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:26.922599 run patchelf(pid=8153): Launched 22:28:27.100897 run osmo-stp_10.42.42.5(pid=8150): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8150)] 22:28:27.236405 run osmo-stp_10.42.42.5(pid=8150): stdout: | (launched: 2022-12-13_22:28:25.800211) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:27.373431 run osmo-stp_10.42.42.5(pid=8150): stderr: | 20221213222825991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222825991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222825992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222825992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222825993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222825993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222825993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:27.510597 run osmo-stp_10.42.42.5(pid=8150): stdout: | (launched: 2022-12-13_22:28:25.800211) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:27.641738 run osmo-stp_10.42.42.5(pid=8150): stderr: | 20221213222825991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222825991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222825992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222825992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222825993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222825993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222825993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:27.797295 run patchelf(pid=8153): Terminating (SIGINT) 22:28:27.976188 run patchelf(pid=8153): Terminated: ok {rc=0} 22:28:28.105772 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8150): Process ended prematurely: osmo-stp_10.42.42.5(pid=8150) [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8150)] [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 22:28:28.115992 tst iperf3m4.py:8: Test FAILED (10.5 sec) 22:28:28.145009 run osmo-hlr_10.42.42.2(pid=8147): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8147)] 22:28:28.195709 run osmo-hlr_10.42.42.2(pid=8147): stdout: | (launched: 2022-12-13_22:28:24.802719) 22:28:28.247932 run osmo-hlr_10.42.42.2(pid=8147): stderr: | 20221213222825001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222825001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222825001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222825001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222825001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222825001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222825014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222825022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222825022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222825023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:28.300868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8136): Terminating (SIGTERM) 22:28:28.342497 run iperf3-srv_10.42.42.10(pid=8137): Terminating (SIGTERM) 22:28:28.384849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8138): Terminating (SIGTERM) 22:28:28.427311 run iperf3-srv_10.42.42.10(pid=8139): Terminating (SIGTERM) 22:28:28.469610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8140): Terminating (SIGTERM) 22:28:28.512075 run iperf3-srv_10.42.42.10(pid=8141): Terminating (SIGTERM) 22:28:28.554217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8142): Terminating (SIGTERM) 22:28:28.596459 run iperf3-srv_10.42.42.10(pid=8143): Terminating (SIGTERM) 22:28:28.638428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8146): Terminating (SIGTERM) 22:28:28.680172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8149): Terminating (SIGTERM) 22:28:28.722523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8152): Terminating (SIGTERM) 22:28:28.765025 --- ParallelTerminationStrategy: PID 8136 died... 22:28:28.785324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8136): Terminated: ok {rc=0} 22:28:28.831558 --- ParallelTerminationStrategy: PID 8137 died... 22:28:28.851211 run iperf3-srv_10.42.42.10(pid=8137): Terminated {rc=256} 22:28:28.897195 --- ParallelTerminationStrategy: PID 8138 died... 22:28:28.916764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8138): Terminated: ok {rc=0} 22:28:28.963155 --- ParallelTerminationStrategy: PID 8139 died... 22:28:28.982761 run iperf3-srv_10.42.42.10(pid=8139): Terminated {rc=256} 22:28:29.028791 --- ParallelTerminationStrategy: PID 8140 died... 22:28:29.048938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8140): Terminated: ok {rc=0} 22:28:29.095057 --- ParallelTerminationStrategy: PID 8141 died... 22:28:29.114745 run iperf3-srv_10.42.42.10(pid=8141): Terminated {rc=256} 22:28:29.160592 --- ParallelTerminationStrategy: PID 8142 died... 22:28:29.180343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8142): Terminated: ok {rc=0} 22:28:29.226236 --- ParallelTerminationStrategy: PID 8143 died... 22:28:29.245802 run iperf3-srv_10.42.42.10(pid=8143): Terminated {rc=256} 22:28:29.291598 --- ParallelTerminationStrategy: PID 8146 died... 22:28:29.311290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8146): Terminated: ok {rc=0} 22:28:29.357486 --- ParallelTerminationStrategy: PID 8149 died... 22:28:29.377204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8149): Terminated: ok {rc=0} 22:28:29.423215 --- ParallelTerminationStrategy: PID 8152 died... 22:28:29.443085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8152): Terminated: ok {rc=0} 22:28:29.531127 bus /gobi_4: Setting Powered False 22:28:30.630132 bus /gobi_4: Setting Powered False 22:28:31.745750 bus /gobi_1: Setting Powered False 22:28:32.842092 bus /gobi_1: Setting Powered False 22:28:33.958496 bus /gobi_0: Setting Powered False 22:28:35.056641 bus /gobi_0: Setting Powered False 22:28:36.174486 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 22:28:37.278275 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:37.290300 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:28:37.342641 tst ping.py: using LAC 36652 22:28:37.458703 tst ping.py: using RAC 187 22:28:37.572814 tst ping.py: using CellId 36652 22:28:37.687929 tst ping.py: using BVCI 36653 22:28:37.793932 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:37.805466 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:37.816334 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:37.827612 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:37.838679 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:37.849919 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:37.861708 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:37.872867 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:37.986218 tst ping.py:19: start network... 22:28:38.182232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:38.632306 run create_hlr_db(pid=8154): Launched 22:28:38.752393 bus /gobi_6: Setting Powered False 22:28:39.811492 run create_hlr_db(pid=8154): Terminated: ok {rc=0} 22:28:40.240302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8156): Launched 22:28:40.553334 run osmo-hlr_10.42.42.2(pid=8157): Launched 22:28:40.674112 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:41.221791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8159): Launched 22:28:41.534546 run osmo-stp_10.42.42.5(pid=8160): Launched 22:28:41.655755 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:42.200377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8162): Launched 22:28:42.321527 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:42.586554 run patchelf(pid=8163): Launched 22:28:42.761608 run osmo-stp_10.42.42.5(pid=8160): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8160)] 22:28:42.895138 run osmo-stp_10.42.42.5(pid=8160): stdout: | (launched: 2022-12-13_22:28:41.477564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:43.030660 run osmo-stp_10.42.42.5(pid=8160): stderr: | 20221213222841670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222841670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222841670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222841671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222841671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222841671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222841671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:43.165855 run osmo-stp_10.42.42.5(pid=8160): stdout: | (launched: 2022-12-13_22:28:41.477564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:43.295143 run osmo-stp_10.42.42.5(pid=8160): stderr: | 20221213222841670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222841670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222841670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222841671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222841671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222841671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222841671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:43.448513 run patchelf(pid=8163): Terminating (SIGINT) 22:28:43.624202 run patchelf(pid=8163): Terminated: ok {rc=0} 22:28:43.750813 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8160): Process ended prematurely: osmo-stp_10.42.42.5(pid=8160) [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8160)] [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 22:28:43.760264 tst ping.py:22: Test FAILED (6.5 sec) 22:28:43.788151 run osmo-hlr_10.42.42.2(pid=8157): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8157)] 22:28:43.838823 run osmo-hlr_10.42.42.2(pid=8157): stdout: | (launched: 2022-12-13_22:28:40.496628) 22:28:43.890567 run osmo-hlr_10.42.42.2(pid=8157): stderr: | 20221213222840694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222840694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222840694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222840695 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222840695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222840695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222840708 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222840717 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222840717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222840717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:43.942802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8156): Terminating (SIGTERM) 22:28:43.984882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8159): Terminating (SIGTERM) 22:28:44.027189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8162): Terminating (SIGTERM) 22:28:44.069263 --- ParallelTerminationStrategy: PID 8156 died... 22:28:44.089813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8156): Terminated: ok {rc=0} 22:28:44.136483 --- ParallelTerminationStrategy: PID 8159 died... 22:28:44.156546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8159): Terminated: ok {rc=0} 22:28:44.203003 --- ParallelTerminationStrategy: PID 8162 died... 22:28:44.223023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8162): Terminated: ok {rc=0} 22:28:44.311589 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 22:28:45.398802 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:45.411706 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:28:45.467876 tst ping_idle_ping.py: using LAC 36653 22:28:45.592749 tst ping_idle_ping.py: using RAC 188 22:28:45.718653 tst ping_idle_ping.py: using CellId 36653 22:28:45.851263 tst ping_idle_ping.py: using BVCI 36654 22:28:45.985538 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:45.998151 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:46.011998 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:46.024284 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:46.036393 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:46.048138 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:46.059990 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:28:46.071699 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:28:46.218053 tst ping_idle_ping.py:24: start network... 22:28:46.427563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:46.905827 run create_hlr_db(pid=8164): Launched 22:28:47.072920 bus /gobi_6: Setting Powered False 22:28:48.131615 run create_hlr_db(pid=8164): Terminated: ok {rc=0} 22:28:48.564242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8166): Launched 22:28:48.878479 run osmo-hlr_10.42.42.2(pid=8167): Launched 22:28:48.998915 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:49.538749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8169): Launched 22:28:49.852271 run osmo-stp_10.42.42.5(pid=8170): Launched 22:28:49.973193 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:50.516480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8172): Launched 22:28:50.636859 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:50.902036 run patchelf(pid=8173): Launched 22:28:51.077325 run osmo-stp_10.42.42.5(pid=8170): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8170)] 22:28:51.210609 run osmo-stp_10.42.42.5(pid=8170): stdout: | (launched: 2022-12-13_22:28:49.795039) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:51.345433 run osmo-stp_10.42.42.5(pid=8170): stderr: | 20221213222849989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222849989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222849989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222849990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222849990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222849990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222849990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:51.480518 run osmo-stp_10.42.42.5(pid=8170): stdout: | (launched: 2022-12-13_22:28:49.795039) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:51.609993 run osmo-stp_10.42.42.5(pid=8170): stderr: | 20221213222849989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222849989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222849989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222849990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222849990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222849990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222849990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:51.762815 run patchelf(pid=8173): Terminating (SIGINT) 22:28:51.938416 run patchelf(pid=8173): Terminated: ok {rc=0} 22:28:52.065662 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8170): Process ended prematurely: osmo-stp_10.42.42.5(pid=8170) [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8170)] [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 22:28:52.075240 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 22:28:52.103160 run osmo-hlr_10.42.42.2(pid=8167): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8167)] 22:28:52.153684 run osmo-hlr_10.42.42.2(pid=8167): stdout: | (launched: 2022-12-13_22:28:48.821411) 22:28:52.205655 run osmo-hlr_10.42.42.2(pid=8167): stderr: | 20221213222849020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222849020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222849020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222849020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222849020 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222849020 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222849033 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222849041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222849041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222849041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:52.257839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8166): Terminating (SIGTERM) 22:28:52.299276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8169): Terminating (SIGTERM) 22:28:52.340929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8172): Terminating (SIGTERM) 22:28:52.382876 --- ParallelTerminationStrategy: PID 8166 died... 22:28:52.403146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8166): Terminated: ok {rc=0} 22:28:52.449408 --- ParallelTerminationStrategy: PID 8169 died... 22:28:52.469176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8169): Terminated: ok {rc=0} 22:28:52.515081 --- ParallelTerminationStrategy: PID 8172 died... 22:28:52.534913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8172): Terminated: ok {rc=0} 22:28:52.623260 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:28:53.934818 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:28:53.942158 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:28:53.977344 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:28:54.013581 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:28:54.069183 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:28:54.101662 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:28:54.135952 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:28:54.698799 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2395 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:28:54.704535 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:54.716041 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:28:54.784099 tst switch_tch_pdch.py: using LAC 36654 22:28:54.908383 tst switch_tch_pdch.py: using RAC 189 22:28:55.032089 tst switch_tch_pdch.py: using CellId 36654 22:28:55.154783 tst switch_tch_pdch.py: using BVCI 36655 22:28:55.268587 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:55.280294 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:55.291920 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:55.303324 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:55.315020 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:55.326761 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:55.338738 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:28:55.350432 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:28:55.466104 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:28:55.581636 tst switch_tch_pdch.py:51: start network... 22:28:55.777640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:56.230685 run create_hlr_db(pid=8177): Launched 22:28:56.352660 bus /gobi_6: Setting Powered False 22:28:57.411553 run create_hlr_db(pid=8177): Terminated: ok {rc=0} 22:28:57.841688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8179): Launched 22:28:58.155517 run osmo-hlr_10.42.42.2(pid=8180): Launched 22:28:58.276086 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:58.816846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8182): Launched 22:28:59.130295 run osmo-stp_10.42.42.5(pid=8183): Launched 22:28:59.249881 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:59.795103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8185): Launched 22:28:59.916157 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:29:00.181701 run patchelf(pid=8186): Launched 22:29:00.356889 run osmo-stp_10.42.42.5(pid=8183): ERR: Terminated: ERROR {rc=1} [trial-2395↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8183)] 22:29:00.489974 run osmo-stp_10.42.42.5(pid=8183): stdout: | (launched: 2022-12-13_22:28:59.073538) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:00.625024 run osmo-stp_10.42.42.5(pid=8183): stderr: | 20221213222859263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222859264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222859264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222859264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222859265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222859265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222859265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:00.759598 run osmo-stp_10.42.42.5(pid=8183): stdout: | (launched: 2022-12-13_22:28:59.073538) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:00.918853 run osmo-stp_10.42.42.5(pid=8183): stderr: | 20221213222859263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222859264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222859264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222859264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222859265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222859265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222859265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:01.075416 run patchelf(pid=8186): Terminating (SIGINT) 22:29:01.254785 run patchelf(pid=8186): Terminated: ok {rc=0} 22:29:01.386188 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8183): Process ended prematurely: osmo-stp_10.42.42.5(pid=8183) [trial-2395↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8183)] [trial-2395↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:29:01.396754 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 22:29:01.426139 run osmo-hlr_10.42.42.2(pid=8180): ERR: Terminated: ERROR {rc=237} [trial-2395↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8180)] 22:29:01.480659 run osmo-hlr_10.42.42.2(pid=8180): stdout: | (launched: 2022-12-13_22:28:58.098736) 22:29:01.534895 run osmo-hlr_10.42.42.2(pid=8180): stderr: | 20221213222858296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222858296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222858296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222858296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222858296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222858296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222858310 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222858320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222858320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222858320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:01.590084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8179): Terminating (SIGTERM) 22:29:01.633501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8182): Terminating (SIGTERM) 22:29:01.683720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8185): Terminating (SIGTERM) 22:29:01.735496 --- ParallelTerminationStrategy: PID 8179 died... 22:29:01.758031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8179): Terminated: ok {rc=0} 22:29:01.815251 --- ParallelTerminationStrategy: PID 8182 died... 22:29:01.839102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8182): Terminated: ok {rc=0} 22:29:01.897670 --- ParallelTerminationStrategy: PID 8185 died... 22:29:01.922342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8185): Terminated: ok {rc=0} 22:29:02.022953 bus /gobi_0: Setting Powered False 22:29:03.123389 bus /gobi_0: Setting Powered False 22:29:04.239018 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:29:05.494945 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:05.501268 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:29:05.534398 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:29:05.570380 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:29:05.625337 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:29:05.658374 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:29:05.693918 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:29:06.248714 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2395 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:29:06.254078 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:06.265541 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:29:06.336353 tst switch_tch_pdch.py: using LAC 36655 22:29:06.460453 tst switch_tch_pdch.py: using RAC 190 22:29:06.584050 tst switch_tch_pdch.py: using CellId 36655 22:29:06.706776 tst switch_tch_pdch.py: using BVCI 36656 22:29:06.819755 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:06.831025 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:06.842165 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:06.853305 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:06.864682 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:06.876228 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:06.887818 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:29:06.899251 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:29:07.016916 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:29:07.133662 tst switch_tch_pdch.py:51: start network... 22:29:07.328258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:07.755135 run create_hlr_db(pid=8190): Launched 22:29:07.875839 bus /gobi_6: Setting Powered False 22:29:08.935200 run create_hlr_db(pid=8190): Terminated: ok {rc=0} 22:29:09.336915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8192): Launched 22:29:09.650117 run osmo-hlr_10.42.42.2(pid=8193): Launched 22:29:09.770610 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:10.284269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8195): Launched 22:29:10.598001 run osmo-stp_10.42.42.5(pid=8196): Launched 22:29:10.718472 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:29:11.234554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8198): Launched 22:29:11.355084 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:29:11.618927 run patchelf(pid=8199): Launched 22:29:11.793201 run osmo-stp_10.42.42.5(pid=8196): ERR: Terminated: ERROR {rc=1} [trial-2395↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8196)] 22:29:11.926292 run osmo-stp_10.42.42.5(pid=8196): stdout: | (launched: 2022-12-13_22:29:10.541086) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:12.061766 run osmo-stp_10.42.42.5(pid=8196): stderr: | 20221213222910730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222910731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222910731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222910731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222910732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222910732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222910732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:12.196599 run osmo-stp_10.42.42.5(pid=8196): stdout: | (launched: 2022-12-13_22:29:10.541086) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:12.325921 run osmo-stp_10.42.42.5(pid=8196): stderr: | 20221213222910730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222910731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222910731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222910731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222910732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222910732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222910732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:12.479168 run patchelf(pid=8199): Terminating (SIGINT) 22:29:12.654654 run patchelf(pid=8199): Terminated: ok {rc=0} 22:29:12.781301 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8196): Process ended prematurely: osmo-stp_10.42.42.5(pid=8196) [trial-2395↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8196)] [trial-2395↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:29:12.791064 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 22:29:12.818676 run osmo-hlr_10.42.42.2(pid=8193): ERR: Terminated: ERROR {rc=237} [trial-2395↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8193)] 22:29:12.869098 run osmo-hlr_10.42.42.2(pid=8193): stdout: | (launched: 2022-12-13_22:29:09.593488) 22:29:12.920941 run osmo-hlr_10.42.42.2(pid=8193): stderr: | 20221213222909789 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222909789 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222909789 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222909789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222909789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222909789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222909801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222909809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222909810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222909810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:12.973517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8192): Terminating (SIGTERM) 22:29:13.014967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8195): Terminating (SIGTERM) 22:29:13.056680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8198): Terminating (SIGTERM) 22:29:13.098884 --- ParallelTerminationStrategy: PID 8192 died... 22:29:13.119394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8192): Terminated: ok {rc=0} 22:29:13.165786 --- ParallelTerminationStrategy: PID 8195 died... 22:29:13.185508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8195): Terminated: ok {rc=0} 22:29:13.231790 --- ParallelTerminationStrategy: PID 8198 died... 22:29:13.251634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8198): Terminated: ok {rc=0} 22:29:13.339543 bus /gobi_0: Setting Powered False 22:29:14.437438 bus /gobi_0: Setting Powered False 22:29:15.553441 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_sms:trx-lms --------------------------------------------------------------------- 22:29:16.836813 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:16.843235 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 22:29:16.886789 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 22:29:16.897108 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 22:29:16.971237 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 22:29:17.011241 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 22:29:17.018885 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 22:29:17.544623 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 22:29:17.549811 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 22:29:17.561085 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 22:29:17.609386 tst mo_mt_sms.py: using LAC 36656 22:29:17.731947 tst mo_mt_sms.py: using RAC 191 22:29:17.855329 tst mo_mt_sms.py: using CellId 36656 22:29:17.976925 tst mo_mt_sms.py: using BVCI 36657 22:29:18.090550 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 22:29:18.205954 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 22:29:18.317441 tst mo_mt_sms.py:9: start nitb and bts... 22:29:18.514871 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:29:19.112714 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8203): Launched 22:29:19.404922 run osmo-nitb_10.42.42.2(pid=8204): Launched 22:29:19.567700 run osmo-nitb_10.42.42.2(pid=8204): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8204)] 22:29:19.699656 run osmo-nitb_10.42.42.2(pid=8204): stdout: | (launched: 2022-12-13_22:29:19.351516) 22:29:19.832562 run osmo-nitb_10.42.42.2(pid=8204): stderr: | (launched: 2022-12-13_22:29:19.394898) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:29:19.965432 run osmo-nitb_10.42.42.2(pid=8204): stdout: | (launched: 2022-12-13_22:29:19.351516) 22:29:20.093562 run osmo-nitb_10.42.42.2(pid=8204): stderr: | (launched: 2022-12-13_22:29:19.394898) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8204): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8204) [trial-2395↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8204)] 22:29:20.516587 tst osmo-nitb_10.42.42.2(pid=8204): stdout: | (launched: 2022-12-13_22:29:19.351516) 22:29:20.634625 tst osmo-nitb_10.42.42.2(pid=8204): stderr: | (launched: 2022-12-13_22:29:19.394898) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:29:20.773462 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=8204): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8204) [trial-2395↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8204)] [trial-2395↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 22:29:20.781791 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 22:29:20.788301 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8203): Terminating (SIGTERM) 22:29:20.996231 --- ParallelTerminationStrategy: PID 8203 died... 22:29:21.016543 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8203): Terminated: ok {rc=0} 22:29:21.102832 bus /sierra_3: Setting Powered False 22:29:22.204080 bus /sierra_3: Setting Powered False 22:29:23.319116 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 sms:trx-lms --------------------------------------------------------------------- 22:29:24.512055 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:24.516187 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 22:29:24.548504 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 22:29:24.574679 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 22:29:24.627807 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 22:29:24.661883 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 22:29:24.689569 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 22:29:25.230154 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 22:29:25.235303 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:25.245938 tst sms:trx-lms: Using 1 x bts (candidates: 1) 22:29:25.292123 tst mo_mt_sms.py: using LAC 36657 22:29:25.406736 tst mo_mt_sms.py: using RAC 192 22:29:25.521016 tst mo_mt_sms.py: using CellId 36657 22:29:25.635797 tst mo_mt_sms.py: using BVCI 36658 22:29:25.741334 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:25.751650 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:25.761992 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:25.772183 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:25.782496 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:25.793293 tst sms:trx-lms: Using 1 x modem (candidates: 2) 22:29:25.905727 tst sms:trx-lms: Using 1 x modem (candidates: 2) 22:29:26.028415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:26.514248 run create_hlr_db(pid=8209): Launched 22:29:26.635492 bus /sierra_2: Setting Powered False 22:29:27.697579 run create_hlr_db(pid=8209): Terminated: ok {rc=0} 22:29:28.135817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8211): Launched 22:29:28.448791 run osmo-hlr_10.42.42.2(pid=8212): Launched 22:29:28.570516 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:29.113371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8214): Launched 22:29:29.426150 run osmo-stp_10.42.42.5(pid=8215): Launched 22:29:29.546938 run osmo-msc_10.42.42.6: Starting osmo-msc 22:29:30.116844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8217): Launched 22:29:30.429995 run osmo-msc_10.42.42.6(pid=8218): Launched 22:29:30.606385 run osmo-stp_10.42.42.5(pid=8215): ERR: Terminated: ERROR {rc=1} [trial-2395↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8215)] 22:29:30.739320 run osmo-stp_10.42.42.5(pid=8215): stdout: | (launched: 2022-12-13_22:29:29.369518) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:30.944690 run osmo-stp_10.42.42.5(pid=8215): stderr: | 20221213222929558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222929558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222929559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222929559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222929559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222929560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222929560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:31.096630 run osmo-stp_10.42.42.5(pid=8215): stdout: | (launched: 2022-12-13_22:29:29.369518) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:31.216642 run osmo-stp_10.42.42.5(pid=8215): stderr: | 20221213222929558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222929558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222929559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222929559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222929559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222929560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222929560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:31.362907 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=8215): Process ended prematurely: osmo-stp_10.42.42.5(pid=8215) [trial-2395↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8215)] [trial-2395↪sms:trx-lms↪mo_mt_sms.py:16] 22:29:31.371878 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 22:29:31.398792 run osmo-hlr_10.42.42.2(pid=8212): ERR: Terminated: ERROR {rc=237} [trial-2395↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8212)] 22:29:31.447338 run osmo-hlr_10.42.42.2(pid=8212): stdout: | (launched: 2022-12-13_22:29:28.391925) 22:29:31.497961 run osmo-hlr_10.42.42.2(pid=8212): stderr: | 20221213222928588 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222928588 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222928588 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222928588 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222928588 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222928588 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222928603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222928613 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222928613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222928613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:31.568874 run osmo-msc_10.42.42.6(pid=8218): ERR: Terminated: ERROR {rc=2} [trial-2395↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8218)] 22:29:31.617962 run osmo-msc_10.42.42.6(pid=8218): stdout: | (launched: 2022-12-13_22:29:30.373215) 22:29:31.668566 run osmo-msc_10.42.42.6(pid=8218): stderr: | 20221213222930695 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222930695 DLGLOBAL DEBUG validating counter group 0x7f9eee759c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222930695 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222930695 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222930695 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222930696 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222930697 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222930698 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222930698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222930698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:29:31.720566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8211): Terminating (SIGTERM) 22:29:31.761819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8214): Terminating (SIGTERM) 22:29:31.804732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8217): Terminating (SIGTERM) 22:29:31.847801 --- ParallelTerminationStrategy: PID 8211 died... 22:29:31.867399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8211): Terminated: ok {rc=0} 22:29:31.914875 --- ParallelTerminationStrategy: PID 8214 died... 22:29:31.934020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8214): Terminated: ok {rc=0} 22:29:31.978620 --- ParallelTerminationStrategy: PID 8217 died... 22:29:31.998030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8217): Terminated: ok {rc=0} 22:29:32.084769 bus /sierra_3: Setting Powered False 22:29:33.180930 bus /sierra_3: Setting Powered False 22:29:34.294855 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_ussd:trx-lms --------------------------------------------------------------------- 22:29:35.526755 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:35.530504 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 22:29:35.562846 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 22:29:35.569879 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 22:29:35.603592 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 22:29:35.635831 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 22:29:35.642401 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 22:29:36.163804 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2395 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 22:29:36.168543 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 22:29:36.179455 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 22:29:36.226910 tst assert_extension.py: using LAC 36658 22:29:36.340614 tst assert_extension.py: using RAC 193 22:29:36.469624 tst assert_extension.py: using CellId 36658 22:29:36.597366 tst assert_extension.py: using BVCI 36659 22:29:36.713339 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 22:29:36.827435 tst assert_extension.py:10: start nitb and bts... 22:29:37.023363 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:29:37.624377 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8223): Launched 22:29:37.918207 run osmo-nitb_10.42.42.2(pid=8224): Launched 22:29:38.081244 run osmo-nitb_10.42.42.2(pid=8224): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8224)] 22:29:38.213352 run osmo-nitb_10.42.42.2(pid=8224): stdout: | (launched: 2022-12-13_22:29:37.864443) 22:29:38.346351 run osmo-nitb_10.42.42.2(pid=8224): stderr: | (launched: 2022-12-13_22:29:37.908167) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:29:38.479520 run osmo-nitb_10.42.42.2(pid=8224): stdout: | (launched: 2022-12-13_22:29:37.864443) 22:29:38.607940 run osmo-nitb_10.42.42.2(pid=8224): stderr: | (launched: 2022-12-13_22:29:37.908167) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8224): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8224) [trial-2395↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8224)] 22:29:39.029097 tst osmo-nitb_10.42.42.2(pid=8224): stdout: | (launched: 2022-12-13_22:29:37.864443) 22:29:39.147488 tst osmo-nitb_10.42.42.2(pid=8224): stderr: | (launched: 2022-12-13_22:29:37.908167) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:29:39.287149 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=8224): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8224) [trial-2395↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8224)] [trial-2395↪nitb_ussd:trx-lms↪assert_extension.py:12] 22:29:39.295449 tst assert_extension.py:12: Test FAILED (3.1 sec) 22:29:39.302449 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8223): Terminating (SIGTERM) 22:29:39.511664 --- ParallelTerminationStrategy: PID 8223 died... 22:29:39.532239 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8223): Terminated: ok {rc=0} 22:29:39.619502 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 ussd:trx-lms --------------------------------------------------------------------- 22:29:40.800226 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:40.804314 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 22:29:40.837817 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 22:29:40.865917 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 22:29:40.902347 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 22:29:40.935956 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 22:29:40.963045 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 22:29:41.491683 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2395 ussd:trx-lms assert_extension.py ---------------------------------------------- 22:29:41.496798 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:41.507683 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 22:29:41.555900 tst assert_extension.py: using LAC 36659 22:29:41.679111 tst assert_extension.py: using RAC 194 22:29:41.801377 tst assert_extension.py: using CellId 36659 22:29:41.924323 tst assert_extension.py: using BVCI 36660 22:29:42.038349 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:42.049305 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:42.060118 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:42.070979 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:42.082168 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:29:42.093159 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 22:29:42.209465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:42.664745 run create_hlr_db(pid=8228): Launched 22:29:42.786750 bus /sierra_2: Setting Powered False 22:29:43.845885 run create_hlr_db(pid=8228): Terminated: ok {rc=0} 22:29:44.255611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8230): Launched 22:29:44.547755 run osmo-hlr_10.42.42.2(pid=8231): Launched 22:29:44.660169 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:45.181283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8233): Launched 22:29:45.473569 run osmo-stp_10.42.42.5(pid=8234): Launched 22:29:45.584909 run osmo-msc_10.42.42.6: Starting osmo-msc 22:29:46.139930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8236): Launched 22:29:46.455175 run osmo-msc_10.42.42.6(pid=8237): Launched 22:29:46.707013 run osmo-stp_10.42.42.5(pid=8234): ERR: Terminated: ERROR {rc=1} [trial-2395↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8234)] 22:29:47.054385 run osmo-stp_10.42.42.5(pid=8234): stdout: | (launched: 2022-12-13_22:29:45.419650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:47.320776 run osmo-stp_10.42.42.5(pid=8234): stderr: | 20221213222945589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222945589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222945590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222945590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222945592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222945592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222945592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:47.469628 run osmo-stp_10.42.42.5(pid=8234): stdout: | (launched: 2022-12-13_22:29:45.419650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:47.590178 run osmo-stp_10.42.42.5(pid=8234): stderr: | 20221213222945589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222945589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222945590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222945590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222945592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222945592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222945592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:47.729621 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=8234): Process ended prematurely: osmo-stp_10.42.42.5(pid=8234) [trial-2395↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8234)] [trial-2395↪ussd:trx-lms↪assert_extension.py:17] 22:29:47.738182 tst assert_extension.py:17: Test FAILED (6.2 sec) 22:29:47.763973 run osmo-hlr_10.42.42.2(pid=8231): ERR: Terminated: ERROR {rc=237} [trial-2395↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8231)] 22:29:47.811433 run osmo-hlr_10.42.42.2(pid=8231): stdout: | (launched: 2022-12-13_22:29:44.494149) 22:29:47.860614 run osmo-hlr_10.42.42.2(pid=8231): stderr: | 20221213222944670 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222944670 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222944671 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222944671 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222944671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222944671 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222944684 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222944692 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222944692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222944692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:47.929228 run osmo-msc_10.42.42.6(pid=8237): ERR: Terminated: ERROR {rc=2} [trial-2395↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8237)] 22:29:47.976528 run osmo-msc_10.42.42.6(pid=8237): stdout: | (launched: 2022-12-13_22:29:46.386989) 22:29:48.025646 run osmo-msc_10.42.42.6(pid=8237): stderr: | 20221213222946899 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222946899 DLGLOBAL DEBUG validating counter group 0x7f16c4ab4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222946899 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222946899 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222946899 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222946899 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222946902 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222946902 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222946903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222946903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:29:48.075027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8230): Terminating (SIGTERM) 22:29:48.114287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8233): Terminating (SIGTERM) 22:29:48.153673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8236): Terminating (SIGTERM) 22:29:48.193450 --- ParallelTerminationStrategy: PID 8230 died... 22:29:48.212556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8230): Terminated: ok {rc=0} 22:29:48.256734 --- ParallelTerminationStrategy: PID 8233 died... 22:29:48.275440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8233): Terminated: ok {rc=0} 22:29:48.319082 --- ParallelTerminationStrategy: PID 8236 died... 22:29:48.337788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8236): Terminated: ok {rc=0} 22:29:48.423486 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:29:49.634081 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:49.640795 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:29:49.674590 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:29:49.701413 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:29:49.753228 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:29:49.786301 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:29:49.813644 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:29:50.362915 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:29:50.411637 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:50.422601 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:29:50.492722 tst mo_mt_call.py: using LAC 36660 22:29:50.610274 tst mo_mt_call.py: using RAC 195 22:29:50.733827 tst mo_mt_call.py: using CellId 36660 22:29:50.851660 tst mo_mt_call.py: using BVCI 36661 22:29:50.959522 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:50.970505 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:50.981325 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:50.992042 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:51.003427 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:29:51.014721 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:29:51.135349 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:29:51.257338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:51.751660 run create_hlr_db(pid=8242): Launched 22:29:51.874211 bus /sierra_2: Setting Powered False 22:29:52.937579 run create_hlr_db(pid=8242): Terminated: ok {rc=0} 22:29:53.365311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8244): Launched 22:29:53.662136 run osmo-hlr_10.42.42.2(pid=8245): Launched 22:29:53.776326 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:54.289367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8247): Launched 22:29:54.587620 run osmo-stp_10.42.42.5(pid=8248): Launched 22:29:54.701890 run osmo-msc_10.42.42.6: Starting osmo-msc 22:29:55.241682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8250): Launched 22:29:55.538963 run osmo-msc_10.42.42.6(pid=8251): Launched 22:29:55.705840 run osmo-stp_10.42.42.5(pid=8248): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8248)] 22:29:55.831726 run osmo-stp_10.42.42.5(pid=8248): stdout: | (launched: 2022-12-13_22:29:54.532836) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:55.957894 run osmo-stp_10.42.42.5(pid=8248): stderr: | 20221213222954703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222954703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222954704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222954704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222954704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222954705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222954705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:56.081888 run osmo-stp_10.42.42.5(pid=8248): stdout: | (launched: 2022-12-13_22:29:54.532836) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:56.200335 run osmo-stp_10.42.42.5(pid=8248): stderr: | 20221213222954703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213222954703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213222954704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213222954704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213222954704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213222954705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213222954705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:56.342321 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8248): Process ended prematurely: osmo-stp_10.42.42.5(pid=8248) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8248)] [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:29:56.351440 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:29:56.377838 run osmo-hlr_10.42.42.2(pid=8245): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8245)] 22:29:56.425040 run osmo-hlr_10.42.42.2(pid=8245): stdout: | (launched: 2022-12-13_22:29:53.608086) 22:29:56.473835 run osmo-hlr_10.42.42.2(pid=8245): stderr: | 20221213222953784 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213222953784 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213222953784 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213222953784 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213222953784 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213222953784 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213222953796 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213222953805 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213222953805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213222953805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:56.541931 run osmo-msc_10.42.42.6(pid=8251): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8251)] 22:29:56.589094 run osmo-msc_10.42.42.6(pid=8251): stdout: | (launched: 2022-12-13_22:29:55.484381) 22:29:56.637909 run osmo-msc_10.42.42.6(pid=8251): stderr: | 20221213222955754 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213222955754 DLGLOBAL DEBUG validating counter group 0x7f6d20f29c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213222955754 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213222955754 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213222955754 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213222955754 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213222955756 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213222955756 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213222955757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213222955757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:29:56.687092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8244): Terminating (SIGTERM) 22:29:56.726055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8247): Terminating (SIGTERM) 22:29:56.765837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8250): Terminating (SIGTERM) 22:29:56.805479 --- ParallelTerminationStrategy: PID 8244 died... 22:29:56.824325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8244): Terminated: ok {rc=0} 22:29:56.868556 --- ParallelTerminationStrategy: PID 8247 died... 22:29:56.886978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8247): Terminated: ok {rc=0} 22:29:56.931184 --- ParallelTerminationStrategy: PID 8250 died... 22:29:56.949906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8250): Terminated: ok {rc=0} 22:29:57.033088 bus /sierra_3: Setting Powered False 22:29:58.130358 bus /sierra_3: Setting Powered False 22:29:59.247710 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:30:00.395501 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:30:00.407743 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:30:00.481269 tst mo_mt_call_osmux.py: using LAC 36661 22:30:00.608737 tst mo_mt_call_osmux.py: using RAC 196 22:30:00.733881 tst mo_mt_call_osmux.py: using CellId 36661 22:30:00.886602 tst mo_mt_call_osmux.py: using BVCI 36662 22:30:01.001991 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:30:01.019812 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:30:01.031684 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:30:01.045275 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:30:01.056673 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:30:01.068436 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:30:01.185532 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:30:01.307812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:01.792079 run create_hlr_db(pid=8253): Launched 22:30:01.951313 bus /sierra_2: Setting Powered False 22:30:03.012008 run create_hlr_db(pid=8253): Terminated: ok {rc=0} 22:30:03.460600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8258): Launched 22:30:03.779438 run osmo-hlr_10.42.42.2(pid=8259): Launched 22:30:03.901859 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:04.450700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8261): Launched 22:30:04.769936 run osmo-stp_10.42.42.5(pid=8262): Launched 22:30:04.892792 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:05.473335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8264): Launched 22:30:05.792241 run osmo-msc_10.42.42.6(pid=8265): Launched 22:30:05.970592 run osmo-stp_10.42.42.5(pid=8262): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8262)] 22:30:06.106767 run osmo-stp_10.42.42.5(pid=8262): stdout: | (launched: 2022-12-13_22:30:04.712359) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:06.242561 run osmo-stp_10.42.42.5(pid=8262): stderr: | 20221213223004902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223004902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223004902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223004902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223004905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223004906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223004906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:06.377866 run osmo-stp_10.42.42.5(pid=8262): stdout: | (launched: 2022-12-13_22:30:04.712359) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:06.505682 run osmo-stp_10.42.42.5(pid=8262): stderr: | 20221213223004902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223004902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223004902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223004902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223004905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223004906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223004906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:06.658407 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8262): Process ended prematurely: osmo-stp_10.42.42.5(pid=8262) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8262)] [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:30:06.668071 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:30:06.695899 run osmo-hlr_10.42.42.2(pid=8259): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8259)] 22:30:06.747320 run osmo-hlr_10.42.42.2(pid=8259): stdout: | (launched: 2022-12-13_22:30:03.722041) 22:30:06.799661 run osmo-hlr_10.42.42.2(pid=8259): stderr: | 20221213223003920 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223003920 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223003920 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223003920 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223003920 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223003921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223003933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223003941 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223003941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223003942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:06.872643 run osmo-msc_10.42.42.6(pid=8265): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8265)] 22:30:06.922603 run osmo-msc_10.42.42.6(pid=8265): stdout: | (launched: 2022-12-13_22:30:05.734409) 22:30:06.974948 run osmo-msc_10.42.42.6(pid=8265): stderr: | 20221213223006058 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223006058 DLGLOBAL DEBUG validating counter group 0x7f0c83fb0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223006058 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223006058 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223006058 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223006058 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223006060 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223006060 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223006060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223006061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:07.027699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8258): Terminating (SIGTERM) 22:30:07.069761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8261): Terminating (SIGTERM) 22:30:07.111982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8264): Terminating (SIGTERM) 22:30:07.154647 --- ParallelTerminationStrategy: PID 8258 died... 22:30:07.175181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8258): Terminated: ok {rc=0} 22:30:07.221912 --- ParallelTerminationStrategy: PID 8261 died... 22:30:07.241780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8261): Terminated: ok {rc=0} 22:30:07.288102 --- ParallelTerminationStrategy: PID 8264 died... 22:30:07.308124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8264): Terminated: ok {rc=0} 22:30:07.396389 bus /sierra_3: Setting Powered False 22:30:08.495405 bus /sierra_3: Setting Powered False 22:30:09.612719 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:30:10.864776 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:30:10.871861 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:30:10.905497 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:30:10.934062 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:30:10.991554 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:30:11.025651 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:30:11.053135 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:30:11.600746 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:30:11.653219 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:11.664761 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:30:11.735135 tst mo_mt_call.py: using LAC 36662 22:30:11.860099 tst mo_mt_call.py: using RAC 197 22:30:11.982482 tst mo_mt_call.py: using CellId 36662 22:30:12.106379 tst mo_mt_call.py: using BVCI 36663 22:30:12.221666 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:12.233105 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:12.244422 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:12.255744 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:12.267459 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:12.279100 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:30:12.398238 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:30:12.517077 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:12.980459 run create_hlr_db(pid=8270): Launched 22:30:13.103694 bus /sierra_2: Setting Powered False 22:30:14.163045 run create_hlr_db(pid=8270): Terminated: ok {rc=0} 22:30:14.578404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8272): Launched 22:30:14.877055 run osmo-hlr_10.42.42.2(pid=8273): Launched 22:30:14.992016 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:15.522272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8275): Launched 22:30:15.820268 run osmo-stp_10.42.42.5(pid=8276): Launched 22:30:16.031591 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:16.695098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8278): Launched 22:30:17.005730 run osmo-msc_10.42.42.6(pid=8279): Launched 22:30:17.316484 run osmo-stp_10.42.42.5(pid=8276): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8276)] 22:30:17.491708 run osmo-stp_10.42.42.5(pid=8276): stdout: | (launched: 2022-12-13_22:30:15.765748) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:17.630857 run osmo-stp_10.42.42.5(pid=8276): stderr: | 20221213223016055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223016055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223016055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223016056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223016056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223016056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223016056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:17.767196 run osmo-stp_10.42.42.5(pid=8276): stdout: | (launched: 2022-12-13_22:30:15.765748) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:17.894452 run osmo-stp_10.42.42.5(pid=8276): stderr: | 20221213223016055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223016055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223016055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223016056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223016056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223016056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223016056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:18.047568 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8276): Process ended prematurely: osmo-stp_10.42.42.5(pid=8276) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8276)] [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:30:18.057157 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:30:18.084863 run osmo-hlr_10.42.42.2(pid=8273): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8273)] 22:30:18.136155 run osmo-hlr_10.42.42.2(pid=8273): stdout: | (launched: 2022-12-13_22:30:14.822549) 22:30:18.188563 run osmo-hlr_10.42.42.2(pid=8273): stderr: | 20221213223014998 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223014998 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223014998 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223014998 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223014998 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223014998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223015010 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223015020 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223015020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223015020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:18.261062 run osmo-msc_10.42.42.6(pid=8279): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8279)] 22:30:18.311574 run osmo-msc_10.42.42.6(pid=8279): stdout: | (launched: 2022-12-13_22:30:16.946589) 22:30:18.363715 run osmo-msc_10.42.42.6(pid=8279): stderr: | 20221213223017535 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223017536 DLGLOBAL DEBUG validating counter group 0x7f8ee932bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223017536 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223017536 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223017536 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223017536 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223017538 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223017538 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223017538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223017538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:18.415903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8272): Terminating (SIGTERM) 22:30:18.458295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8275): Terminating (SIGTERM) 22:30:18.500691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8278): Terminating (SIGTERM) 22:30:18.543098 --- ParallelTerminationStrategy: PID 8272 died... 22:30:18.563480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8272): Terminated: ok {rc=0} 22:30:18.609993 --- ParallelTerminationStrategy: PID 8275 died... 22:30:18.629813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8275): Terminated: ok {rc=0} 22:30:18.676437 --- ParallelTerminationStrategy: PID 8278 died... 22:30:18.696309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8278): Terminated: ok {rc=0} 22:30:18.785229 bus /sierra_3: Setting Powered False 22:30:19.883680 bus /sierra_3: Setting Powered False 22:30:20.996474 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:30:22.144170 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:22.156130 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:30:22.228043 tst mo_mt_call_osmux.py: using LAC 36663 22:30:22.352405 tst mo_mt_call_osmux.py: using RAC 198 22:30:22.477676 tst mo_mt_call_osmux.py: using CellId 36663 22:30:22.604478 tst mo_mt_call_osmux.py: using BVCI 36664 22:30:22.719961 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:22.731380 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:22.742718 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:22.754123 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:22.765809 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:30:22.777503 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:30:22.895542 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:30:23.017402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:23.513336 run create_hlr_db(pid=8281): Launched 22:30:23.635036 bus /sierra_2: Setting Powered False 22:30:24.698372 run create_hlr_db(pid=8281): Terminated: ok {rc=0} 22:30:25.128070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8283): Launched 22:30:25.427497 run osmo-hlr_10.42.42.2(pid=8284): Launched 22:30:25.542205 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:26.074064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8286): Launched 22:30:26.372148 run osmo-stp_10.42.42.5(pid=8287): Launched 22:30:26.485640 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:27.027095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8289): Launched 22:30:27.325648 run osmo-msc_10.42.42.6(pid=8290): Launched 22:30:27.492871 run osmo-stp_10.42.42.5(pid=8287): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8287)] 22:30:27.619053 run osmo-stp_10.42.42.5(pid=8287): stdout: | (launched: 2022-12-13_22:30:26.317625) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:27.747616 run osmo-stp_10.42.42.5(pid=8287): stderr: | 20221213223026488 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223026488 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223026488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223026489 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223026489 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223026489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223026489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:27.872059 run osmo-stp_10.42.42.5(pid=8287): stdout: | (launched: 2022-12-13_22:30:26.317625) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:27.990589 run osmo-stp_10.42.42.5(pid=8287): stderr: | 20221213223026488 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223026488 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223026488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223026489 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223026489 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223026489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223026489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:28.132590 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8287): Process ended prematurely: osmo-stp_10.42.42.5(pid=8287) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8287)] [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:30:28.141716 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:30:28.167897 run osmo-hlr_10.42.42.2(pid=8284): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8284)] 22:30:28.215070 run osmo-hlr_10.42.42.2(pid=8284): stdout: | (launched: 2022-12-13_22:30:25.373232) 22:30:28.264103 run osmo-hlr_10.42.42.2(pid=8284): stderr: | 20221213223025550 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223025550 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223025550 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223025550 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223025550 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223025550 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223025562 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223025573 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223025573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223025573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:28.332716 run osmo-msc_10.42.42.6(pid=8290): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8290)] 22:30:28.379981 run osmo-msc_10.42.42.6(pid=8290): stdout: | (launched: 2022-12-13_22:30:27.271066) 22:30:28.428892 run osmo-msc_10.42.42.6(pid=8290): stderr: | 20221213223027542 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223027542 DLGLOBAL DEBUG validating counter group 0x7faa55fa7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223027542 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223027543 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223027543 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223027543 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223027545 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223027545 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223027545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223027545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:28.478265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8283): Terminating (SIGTERM) 22:30:28.517727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8286): Terminating (SIGTERM) 22:30:28.557347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8289): Terminating (SIGTERM) 22:30:28.597179 --- ParallelTerminationStrategy: PID 8283 died... 22:30:28.616149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8283): Terminated: ok {rc=0} 22:30:28.659884 --- ParallelTerminationStrategy: PID 8286 died... 22:30:28.678433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8286): Terminated: ok {rc=0} 22:30:28.721932 --- ParallelTerminationStrategy: PID 8289 died... 22:30:28.740357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8289): Terminated: ok {rc=0} 22:30:28.825678 bus /sierra_3: Setting Powered False 22:30:29.925578 bus /sierra_3: Setting Powered False 22:30:31.061184 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:30:32.314710 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:30:32.321096 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:30:32.353522 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:30:32.380377 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:30:32.433182 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:30:32.466711 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:30:32.493326 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:30:33.045459 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:30:33.098086 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:33.109759 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:30:33.181215 tst mo_mt_call.py: using LAC 36664 22:30:33.307431 tst mo_mt_call.py: using RAC 199 22:30:33.432552 tst mo_mt_call.py: using CellId 36664 22:30:33.558644 tst mo_mt_call.py: using BVCI 36665 22:30:33.674010 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:33.685498 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:33.696618 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:33.707827 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:33.719404 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:33.731048 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:30:33.847624 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:30:33.970531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:34.467985 run create_hlr_db(pid=8295): Launched 22:30:34.590363 bus /sierra_2: Setting Powered False 22:30:35.653642 run create_hlr_db(pid=8295): Terminated: ok {rc=0} 22:30:36.083634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8297): Launched 22:30:36.385334 run osmo-hlr_10.42.42.2(pid=8298): Launched 22:30:36.500628 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:37.018419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8300): Launched 22:30:37.317685 run osmo-stp_10.42.42.5(pid=8301): Launched 22:30:37.432793 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:37.974660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8303): Launched 22:30:38.274090 run osmo-msc_10.42.42.6(pid=8304): Launched 22:30:38.442381 run osmo-stp_10.42.42.5(pid=8301): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8301)] 22:30:38.569284 run osmo-stp_10.42.42.5(pid=8301): stdout: | (launched: 2022-12-13_22:30:37.263262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:38.696275 run osmo-stp_10.42.42.5(pid=8301): stderr: | 20221213223037432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223037432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223037432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223037433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223037433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223037433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223037433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:38.821236 run osmo-stp_10.42.42.5(pid=8301): stdout: | (launched: 2022-12-13_22:30:37.263262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:38.940712 run osmo-stp_10.42.42.5(pid=8301): stderr: | 20221213223037432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223037432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223037432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223037433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223037433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223037433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223037433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:39.084168 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8301): Process ended prematurely: osmo-stp_10.42.42.5(pid=8301) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8301)] [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:30:39.092917 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:30:39.119317 run osmo-hlr_10.42.42.2(pid=8298): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8298)] 22:30:39.167784 run osmo-hlr_10.42.42.2(pid=8298): stdout: | (launched: 2022-12-13_22:30:36.330455) 22:30:39.217365 run osmo-hlr_10.42.42.2(pid=8298): stderr: | 20221213223036505 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223036505 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223036505 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223036506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223036506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223036506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223036519 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223036529 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223036530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223036530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:39.286774 run osmo-msc_10.42.42.6(pid=8304): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8304)] 22:30:39.334079 run osmo-msc_10.42.42.6(pid=8304): stdout: | (launched: 2022-12-13_22:30:38.219493) 22:30:39.383610 run osmo-msc_10.42.42.6(pid=8304): stderr: | 20221213223038491 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223038492 DLGLOBAL DEBUG validating counter group 0x7f6824e97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223038492 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223038492 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223038492 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223038492 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223038494 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223038495 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223038495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223038495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:39.432920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8297): Terminating (SIGTERM) 22:30:39.472419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8300): Terminating (SIGTERM) 22:30:39.511818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8303): Terminating (SIGTERM) 22:30:39.551350 --- ParallelTerminationStrategy: PID 8297 died... 22:30:39.570410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8297): Terminated: ok {rc=0} 22:30:39.614163 --- ParallelTerminationStrategy: PID 8300 died... 22:30:39.632514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8300): Terminated: ok {rc=0} 22:30:39.676204 --- ParallelTerminationStrategy: PID 8303 died... 22:30:39.694720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8303): Terminated: ok {rc=0} 22:30:39.780455 bus /sierra_3: Setting Powered False 22:30:40.881465 bus /sierra_3: Setting Powered False 22:30:41.995274 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:30:43.144214 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:43.156208 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:30:43.226445 tst mo_mt_call_osmux.py: using LAC 36665 22:30:43.350219 tst mo_mt_call_osmux.py: using RAC 200 22:30:43.474909 tst mo_mt_call_osmux.py: using CellId 36665 22:30:43.598177 tst mo_mt_call_osmux.py: using BVCI 36666 22:30:43.715039 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:43.726616 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:43.737928 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:43.749143 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:43.760707 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:30:43.772275 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:30:43.888327 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:30:44.007621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:44.503172 run create_hlr_db(pid=8306): Launched 22:30:44.626001 bus /sierra_2: Setting Powered False 22:30:45.685929 run create_hlr_db(pid=8306): Terminated: ok {rc=0} 22:30:46.141489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8308): Launched 22:30:46.463430 run osmo-hlr_10.42.42.2(pid=8309): Launched 22:30:46.704389 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:47.450981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8311): Launched 22:30:47.748541 run osmo-stp_10.42.42.5(pid=8312): Launched 22:30:47.862584 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:48.402176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8314): Launched 22:30:48.700207 run osmo-msc_10.42.42.6(pid=8315): Launched 22:30:48.867294 run osmo-stp_10.42.42.5(pid=8312): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8312)] 22:30:48.993349 run osmo-stp_10.42.42.5(pid=8312): stdout: | (launched: 2022-12-13_22:30:47.694375) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:49.119992 run osmo-stp_10.42.42.5(pid=8312): stderr: | 20221213223047864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223047864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223047864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223047865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223047865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223047865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223047865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:49.245109 run osmo-stp_10.42.42.5(pid=8312): stdout: | (launched: 2022-12-13_22:30:47.694375) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:49.363812 run osmo-stp_10.42.42.5(pid=8312): stderr: | 20221213223047864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223047864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223047864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223047865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223047865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223047865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223047865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:49.506413 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8312): Process ended prematurely: osmo-stp_10.42.42.5(pid=8312) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8312)] [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:30:49.515162 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:30:49.541227 run osmo-hlr_10.42.42.2(pid=8309): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8309)] 22:30:49.588325 run osmo-hlr_10.42.42.2(pid=8309): stdout: | (launched: 2022-12-13_22:30:46.401761) 22:30:49.637438 run osmo-hlr_10.42.42.2(pid=8309): stderr: | 20221213223046743 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223046743 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223046743 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223046743 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223046743 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223046743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223046759 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223046767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223046767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223046767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:49.705368 run osmo-msc_10.42.42.6(pid=8315): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8315)] 22:30:49.752368 run osmo-msc_10.42.42.6(pid=8315): stdout: | (launched: 2022-12-13_22:30:48.645806) 22:30:49.801117 run osmo-msc_10.42.42.6(pid=8315): stderr: | 20221213223048920 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223048920 DLGLOBAL DEBUG validating counter group 0x7f58108aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223048920 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223048920 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223048920 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223048921 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223048922 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223048923 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223048923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223048923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:30:49.850115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8308): Terminating (SIGTERM) 22:30:49.889355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8311): Terminating (SIGTERM) 22:30:49.928384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8314): Terminating (SIGTERM) 22:30:49.967607 --- ParallelTerminationStrategy: PID 8308 died... 22:30:49.986507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8308): Terminated: ok {rc=0} 22:30:50.029985 --- ParallelTerminationStrategy: PID 8311 died... 22:30:50.048205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8311): Terminated: ok {rc=0} 22:30:50.091834 --- ParallelTerminationStrategy: PID 8314 died... 22:30:50.110183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8314): Terminated: ok {rc=0} 22:30:50.193487 bus /sierra_3: Setting Powered False 22:30:51.291172 bus /sierra_3: Setting Powered False 22:30:52.406570 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:30:53.658989 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:30:53.666129 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:30:53.700233 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:30:53.727672 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:30:53.780874 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:30:53.814419 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:30:53.841845 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:30:54.397402 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:30:54.450562 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:54.461989 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:30:54.531290 tst mo_mt_call.py: using LAC 36666 22:30:54.654432 tst mo_mt_call.py: using RAC 201 22:30:54.777039 tst mo_mt_call.py: using CellId 36666 22:30:54.899626 tst mo_mt_call.py: using BVCI 36667 22:30:55.015637 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:55.027195 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:55.038510 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:55.050002 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:55.061708 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:30:55.073624 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:30:55.190241 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:30:55.309882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:55.804437 run create_hlr_db(pid=8320): Launched 22:30:55.925906 bus /sierra_2: Setting Powered False 22:30:56.989361 run create_hlr_db(pid=8320): Terminated: ok {rc=0} 22:30:57.417933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8322): Launched 22:30:57.716750 run osmo-hlr_10.42.42.2(pid=8323): Launched 22:30:57.831689 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:58.345669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8325): Launched 22:30:58.643146 run osmo-stp_10.42.42.5(pid=8326): Launched 22:30:58.757378 run osmo-msc_10.42.42.6: Starting osmo-msc 22:30:59.298191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8328): Launched 22:30:59.595986 run osmo-msc_10.42.42.6(pid=8329): Launched 22:30:59.763539 run osmo-stp_10.42.42.5(pid=8326): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8326)] 22:30:59.889326 run osmo-stp_10.42.42.5(pid=8326): stdout: | (launched: 2022-12-13_22:30:58.588690) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:00.015142 run osmo-stp_10.42.42.5(pid=8326): stderr: | 20221213223058759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223058759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223058759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223058760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223058760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223058760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223058760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:00.139383 run osmo-stp_10.42.42.5(pid=8326): stdout: | (launched: 2022-12-13_22:30:58.588690) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:00.258098 run osmo-stp_10.42.42.5(pid=8326): stderr: | 20221213223058759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223058759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223058759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223058760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223058760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223058760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223058760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:00.400396 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8326): Process ended prematurely: osmo-stp_10.42.42.5(pid=8326) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8326)] [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:31:00.409170 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:31:00.435765 run osmo-hlr_10.42.42.2(pid=8323): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8323)] 22:31:00.483247 run osmo-hlr_10.42.42.2(pid=8323): stdout: | (launched: 2022-12-13_22:30:57.662307) 22:31:00.532668 run osmo-hlr_10.42.42.2(pid=8323): stderr: | 20221213223057835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223057835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223057835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223057835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223057835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223057835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223057847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223057858 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223057858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223057858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:00.601030 run osmo-msc_10.42.42.6(pid=8329): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8329)] 22:31:00.648468 run osmo-msc_10.42.42.6(pid=8329): stdout: | (launched: 2022-12-13_22:30:59.541570) 22:31:00.697393 run osmo-msc_10.42.42.6(pid=8329): stderr: | 20221213223059811 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223059811 DLGLOBAL DEBUG validating counter group 0x7ff0597d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223059811 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223059811 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223059811 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223059812 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223059813 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223059814 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223059814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223059814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:31:00.746790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8322): Terminating (SIGTERM) 22:31:00.786355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8325): Terminating (SIGTERM) 22:31:00.825828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8328): Terminating (SIGTERM) 22:31:00.887376 --- ParallelTerminationStrategy: PID 8322 died... 22:31:00.906545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8322): Terminated: ok {rc=0} 22:31:00.954334 --- ParallelTerminationStrategy: PID 8325 died... 22:31:00.973609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8325): Terminated: ok {rc=0} 22:31:01.018378 --- ParallelTerminationStrategy: PID 8328 died... 22:31:01.037858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8328): Terminated: ok {rc=0} 22:31:01.125376 bus /sierra_3: Setting Powered False 22:31:02.228605 bus /sierra_3: Setting Powered False 22:31:03.344822 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:31:04.494481 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:04.506663 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:31:04.578246 tst mo_mt_call_osmux.py: using LAC 36667 22:31:04.704806 tst mo_mt_call_osmux.py: using RAC 202 22:31:04.823368 tst mo_mt_call_osmux.py: using CellId 36667 22:31:04.941587 tst mo_mt_call_osmux.py: using BVCI 36668 22:31:05.049531 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:05.060653 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:05.071640 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:05.082528 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:05.093612 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:31:05.104345 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:31:05.217159 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:31:05.337940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:05.834280 run create_hlr_db(pid=8331): Launched 22:31:05.957162 bus /sierra_2: Setting Powered False 22:31:07.020656 run create_hlr_db(pid=8331): Terminated: ok {rc=0} 22:31:07.450643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8333): Launched 22:31:07.749815 run osmo-hlr_10.42.42.2(pid=8334): Launched 22:31:07.863306 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:08.376920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8336): Launched 22:31:08.675432 run osmo-stp_10.42.42.5(pid=8337): Launched 22:31:08.789634 run osmo-msc_10.42.42.6: Starting osmo-msc 22:31:09.329615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8339): Launched 22:31:09.628211 run osmo-msc_10.42.42.6(pid=8340): Launched 22:31:09.795481 run osmo-stp_10.42.42.5(pid=8337): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8337)] 22:31:09.921583 run osmo-stp_10.42.42.5(pid=8337): stdout: | (launched: 2022-12-13_22:31:08.620822) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:10.048768 run osmo-stp_10.42.42.5(pid=8337): stderr: | 20221213223108791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223108791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223108792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223108792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223108793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223108793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223108793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:10.173564 run osmo-stp_10.42.42.5(pid=8337): stdout: | (launched: 2022-12-13_22:31:08.620822) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:10.292448 run osmo-stp_10.42.42.5(pid=8337): stderr: | 20221213223108791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223108791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223108792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223108792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223108793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223108793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223108793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:10.435094 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8337): Process ended prematurely: osmo-stp_10.42.42.5(pid=8337) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8337)] [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:31:10.444120 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:31:10.470548 run osmo-hlr_10.42.42.2(pid=8334): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8334)] 22:31:10.517759 run osmo-hlr_10.42.42.2(pid=8334): stdout: | (launched: 2022-12-13_22:31:07.695372) 22:31:10.566650 run osmo-hlr_10.42.42.2(pid=8334): stderr: | 20221213223107872 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223107872 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223107872 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223107872 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223107872 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223107872 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223107931 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223107941 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223107941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223107941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:10.634710 run osmo-msc_10.42.42.6(pid=8340): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8340)] 22:31:10.681721 run osmo-msc_10.42.42.6(pid=8340): stdout: | (launched: 2022-12-13_22:31:09.573726) 22:31:10.730371 run osmo-msc_10.42.42.6(pid=8340): stderr: | 20221213223109847 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223109847 DLGLOBAL DEBUG validating counter group 0x7ffbbf49cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223109847 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223109847 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223109848 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223109848 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223109850 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223109850 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223109850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223109850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:31:10.779385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8333): Terminating (SIGTERM) 22:31:10.818704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8336): Terminating (SIGTERM) 22:31:10.857774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8339): Terminating (SIGTERM) 22:31:10.897503 --- ParallelTerminationStrategy: PID 8333 died... 22:31:10.916606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8333): Terminated: ok {rc=0} 22:31:10.960311 --- ParallelTerminationStrategy: PID 8336 died... 22:31:10.978764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8336): Terminated: ok {rc=0} 22:31:11.022423 --- ParallelTerminationStrategy: PID 8339 died... 22:31:11.040911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8339): Terminated: ok {rc=0} 22:31:11.126509 bus /sierra_3: Setting Powered False 22:31:12.227869 bus /sierra_3: Setting Powered False 22:31:13.345578 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:31:14.597954 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:31:14.604759 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:31:14.637381 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:31:14.664221 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:31:14.714508 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:31:14.747209 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:31:14.774196 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:31:15.325219 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:31:15.373885 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:15.385045 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:31:15.454551 tst mo_mt_call.py: using LAC 36668 22:31:15.572080 tst mo_mt_call.py: using RAC 203 22:31:15.691065 tst mo_mt_call.py: using CellId 36668 22:31:15.810585 tst mo_mt_call.py: using BVCI 36669 22:31:15.946546 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:15.958185 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:15.969507 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:15.980803 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:15.993135 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:16.005079 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:31:16.128788 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:31:16.254094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:16.749176 run create_hlr_db(pid=8345): Launched 22:31:16.902860 bus /sierra_2: Setting Powered False 22:31:17.962569 run create_hlr_db(pid=8345): Terminated: ok {rc=0} 22:31:18.379689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8347): Launched 22:31:18.678261 run osmo-hlr_10.42.42.2(pid=8348): Launched 22:31:18.792274 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:19.307484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8350): Launched 22:31:19.606552 run osmo-stp_10.42.42.5(pid=8351): Launched 22:31:19.720167 run osmo-msc_10.42.42.6: Starting osmo-msc 22:31:20.259610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8353): Launched 22:31:20.557885 run osmo-msc_10.42.42.6(pid=8354): Launched 22:31:20.725402 run osmo-stp_10.42.42.5(pid=8351): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8351)] 22:31:20.850940 run osmo-stp_10.42.42.5(pid=8351): stdout: | (launched: 2022-12-13_22:31:19.551984) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:20.977633 run osmo-stp_10.42.42.5(pid=8351): stderr: | 20221213223119724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223119724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223119724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223119724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223119725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223119725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223119725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:21.101872 run osmo-stp_10.42.42.5(pid=8351): stdout: | (launched: 2022-12-13_22:31:19.551984) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:21.220790 run osmo-stp_10.42.42.5(pid=8351): stderr: | 20221213223119724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223119724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223119724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223119724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223119725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223119725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223119725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:21.362817 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8351): Process ended prematurely: osmo-stp_10.42.42.5(pid=8351) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8351)] [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:31:21.371709 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:31:21.398076 run osmo-hlr_10.42.42.2(pid=8348): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8348)] 22:31:21.446294 run osmo-hlr_10.42.42.2(pid=8348): stdout: | (launched: 2022-12-13_22:31:18.624125) 22:31:21.495678 run osmo-hlr_10.42.42.2(pid=8348): stderr: | 20221213223118799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223118799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223118799 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223118799 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223118799 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223118799 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223118815 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223118825 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223118825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223118825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:21.564292 run osmo-msc_10.42.42.6(pid=8354): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8354)] 22:31:21.611527 run osmo-msc_10.42.42.6(pid=8354): stdout: | (launched: 2022-12-13_22:31:20.503923) 22:31:21.660500 run osmo-msc_10.42.42.6(pid=8354): stderr: | 20221213223120776 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223120776 DLGLOBAL DEBUG validating counter group 0x7ff6c1e26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223120777 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223120777 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223120777 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223120777 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223120779 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223120779 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223120779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223120779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:31:21.710016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8347): Terminating (SIGTERM) 22:31:21.749258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8350): Terminating (SIGTERM) 22:31:21.788597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8353): Terminating (SIGTERM) 22:31:21.828237 --- ParallelTerminationStrategy: PID 8347 died... 22:31:21.847169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8347): Terminated: ok {rc=0} 22:31:21.891094 --- ParallelTerminationStrategy: PID 8350 died... 22:31:21.910346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8350): Terminated: ok {rc=0} 22:31:21.954797 --- ParallelTerminationStrategy: PID 8353 died... 22:31:21.973437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8353): Terminated: ok {rc=0} 22:31:22.056748 bus /sierra_3: Setting Powered False 22:31:23.152902 bus /sierra_3: Setting Powered False 22:31:24.267756 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:31:25.413542 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:25.425285 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:31:25.495546 tst mo_mt_call_osmux.py: using LAC 36669 22:31:25.619483 tst mo_mt_call_osmux.py: using RAC 204 22:31:25.746629 tst mo_mt_call_osmux.py: using CellId 36669 22:31:25.873283 tst mo_mt_call_osmux.py: using BVCI 36670 22:31:25.990831 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:26.002453 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:26.013729 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:26.025255 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:26.037567 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:31:26.049271 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:31:26.166093 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:31:26.286408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:26.781456 run create_hlr_db(pid=8356): Launched 22:31:26.902598 bus /sierra_2: Setting Powered False 22:31:27.966330 run create_hlr_db(pid=8356): Terminated: ok {rc=0} 22:31:28.409889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8358): Launched 22:31:28.727787 run osmo-hlr_10.42.42.2(pid=8359): Launched 22:31:28.849807 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:29.400572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8361): Launched 22:31:29.718556 run osmo-stp_10.42.42.5(pid=8362): Launched 22:31:29.840506 run osmo-msc_10.42.42.6: Starting osmo-msc 22:31:30.417590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8364): Launched 22:31:30.735761 run osmo-msc_10.42.42.6(pid=8365): Launched 22:31:31.008620 run osmo-stp_10.42.42.5(pid=8362): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8362)] 22:31:31.176616 run osmo-stp_10.42.42.5(pid=8362): stdout: | (launched: 2022-12-13_22:31:29.661130) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:31.355694 run osmo-stp_10.42.42.5(pid=8362): stderr: | 20221213223129850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223129850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223129850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223129851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223129851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223129851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223129851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:31.574421 run osmo-stp_10.42.42.5(pid=8362): stdout: | (launched: 2022-12-13_22:31:29.661130) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:31.707113 run osmo-stp_10.42.42.5(pid=8362): stderr: | 20221213223129850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223129850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223129850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223129851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223129851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223129851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223129851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:31.865130 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8362): Process ended prematurely: osmo-stp_10.42.42.5(pid=8362) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8362)] [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:31:31.875877 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:31:31.905451 run osmo-hlr_10.42.42.2(pid=8359): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8359)] 22:31:31.959888 run osmo-hlr_10.42.42.2(pid=8359): stdout: | (launched: 2022-12-13_22:31:28.670006) 22:31:32.014820 run osmo-hlr_10.42.42.2(pid=8359): stderr: | 20221213223128867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223128867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223128867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223128867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223128867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223128867 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223128880 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223128888 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223128888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223128888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:32.090694 run osmo-msc_10.42.42.6(pid=8365): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8365)] 22:31:32.143086 run osmo-msc_10.42.42.6(pid=8365): stdout: | (launched: 2022-12-13_22:31:30.678170) 22:31:32.197390 run osmo-msc_10.42.42.6(pid=8365): stderr: | 20221213223131178 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223131178 DLGLOBAL DEBUG validating counter group 0x7f12226a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223131178 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223131178 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223131178 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223131179 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223131180 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223131185 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223131185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223131185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:31:32.251904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8358): Terminating (SIGTERM) 22:31:32.294296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8361): Terminating (SIGTERM) 22:31:32.336377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8364): Terminating (SIGTERM) 22:31:32.379018 --- ParallelTerminationStrategy: PID 8358 died... 22:31:32.399477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8358): Terminated: ok {rc=0} 22:31:32.446193 --- ParallelTerminationStrategy: PID 8361 died... 22:31:32.466203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8361): Terminated: ok {rc=0} 22:31:32.512473 --- ParallelTerminationStrategy: PID 8364 died... 22:31:32.532446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8364): Terminated: ok {rc=0} 22:31:32.620123 bus /sierra_3: Setting Powered False 22:31:33.718122 bus /sierra_3: Setting Powered False 22:31:34.833294 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:31:36.079152 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:31:36.085437 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:31:36.117972 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:31:36.144517 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:31:36.195929 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:31:36.229798 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:31:36.257597 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:31:36.805981 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:31:36.853955 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:36.865015 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:31:36.933776 tst mo_mt_call.py: using LAC 36670 22:31:37.056659 tst mo_mt_call.py: using RAC 205 22:31:37.173191 tst mo_mt_call.py: using CellId 36670 22:31:37.288560 tst mo_mt_call.py: using BVCI 36671 22:31:37.396467 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:37.407523 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:37.418342 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:37.429275 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:37.440191 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:37.450989 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:31:37.563373 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:31:37.683231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:38.180080 run create_hlr_db(pid=8371): Launched 22:31:38.303255 bus /sierra_2: Setting Powered False 22:31:39.366940 run create_hlr_db(pid=8371): Terminated: ok {rc=0} 22:31:39.797059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8373): Launched 22:31:40.095835 run osmo-hlr_10.42.42.2(pid=8374): Launched 22:31:40.209904 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:40.721869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8376): Launched 22:31:41.020427 run osmo-stp_10.42.42.5(pid=8377): Launched 22:31:41.135155 run osmo-msc_10.42.42.6: Starting osmo-msc 22:31:41.676603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8379): Launched 22:31:41.975047 run osmo-msc_10.42.42.6(pid=8380): Launched 22:31:42.143646 run osmo-stp_10.42.42.5(pid=8377): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8377)] 22:31:42.269394 run osmo-stp_10.42.42.5(pid=8377): stdout: | (launched: 2022-12-13_22:31:40.965904) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:42.396075 run osmo-stp_10.42.42.5(pid=8377): stderr: | 20221213223141138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223141138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223141138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223141138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223141140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223141141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223141141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:42.520618 run osmo-stp_10.42.42.5(pid=8377): stdout: | (launched: 2022-12-13_22:31:40.965904) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:42.639679 run osmo-stp_10.42.42.5(pid=8377): stderr: | 20221213223141138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223141138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223141138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223141138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223141140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223141141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223141141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:42.781868 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8377): Process ended prematurely: osmo-stp_10.42.42.5(pid=8377) [trial-2395↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8377)] [trial-2395↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:31:42.790763 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:31:42.817171 run osmo-hlr_10.42.42.2(pid=8374): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8374)] 22:31:42.864225 run osmo-hlr_10.42.42.2(pid=8374): stdout: | (launched: 2022-12-13_22:31:40.041158) 22:31:42.912818 run osmo-hlr_10.42.42.2(pid=8374): stderr: | 20221213223140218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223140218 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223140218 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223140218 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223140218 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223140218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223140229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223140238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223140238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223140238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:42.980732 run osmo-msc_10.42.42.6(pid=8380): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8380)] 22:31:43.028011 run osmo-msc_10.42.42.6(pid=8380): stdout: | (launched: 2022-12-13_22:31:41.920807) 22:31:43.076676 run osmo-msc_10.42.42.6(pid=8380): stderr: | 20221213223142195 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223142195 DLGLOBAL DEBUG validating counter group 0x7f0807b2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223142195 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223142196 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223142196 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223142196 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223142198 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223142198 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223142198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223142198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:31:43.125616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8373): Terminating (SIGTERM) 22:31:43.164600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8376): Terminating (SIGTERM) 22:31:43.203826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8379): Terminating (SIGTERM) 22:31:43.243093 --- ParallelTerminationStrategy: PID 8373 died... 22:31:43.262314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8373): Terminated: ok {rc=0} 22:31:43.306009 --- ParallelTerminationStrategy: PID 8376 died... 22:31:43.324606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8376): Terminated: ok {rc=0} 22:31:43.367997 --- ParallelTerminationStrategy: PID 8379 died... 22:31:43.386351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8379): Terminated: ok {rc=0} 22:31:43.470557 bus /sierra_3: Setting Powered False 22:31:44.570731 bus /sierra_3: Setting Powered False 22:31:45.687093 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:31:46.835867 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:46.849200 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:31:46.919524 tst mo_mt_call_osmux.py: using LAC 36671 22:31:47.038418 tst mo_mt_call_osmux.py: using RAC 206 22:31:47.156745 tst mo_mt_call_osmux.py: using CellId 36671 22:31:47.292811 tst mo_mt_call_osmux.py: using BVCI 36672 22:31:47.408736 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:47.420539 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:47.432066 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:47.443601 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:47.455855 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:31:47.467679 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:31:47.586338 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:31:47.708655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:48.174271 run create_hlr_db(pid=8382): Launched 22:31:48.297510 bus /sierra_2: Setting Powered False 22:31:49.357817 run create_hlr_db(pid=8382): Terminated: ok {rc=0} 22:31:49.795501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8384): Launched 22:31:50.116707 run osmo-hlr_10.42.42.2(pid=8385): Launched 22:31:50.240294 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:50.791292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8387): Launched 22:31:51.110985 run osmo-stp_10.42.42.5(pid=8388): Launched 22:31:51.233836 run osmo-msc_10.42.42.6: Starting osmo-msc 22:31:51.818700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8390): Launched 22:31:52.139914 run osmo-msc_10.42.42.6(pid=8391): Launched 22:31:52.319502 run osmo-stp_10.42.42.5(pid=8388): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8388)] 22:31:52.455453 run osmo-stp_10.42.42.5(pid=8388): stdout: | (launched: 2022-12-13_22:31:51.053249) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:52.591570 run osmo-stp_10.42.42.5(pid=8388): stderr: | 20221213223151243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223151243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223151244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223151244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223151246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223151246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223151247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:52.727107 run osmo-stp_10.42.42.5(pid=8388): stdout: | (launched: 2022-12-13_22:31:51.053249) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:52.855056 run osmo-stp_10.42.42.5(pid=8388): stderr: | 20221213223151243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223151243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223151244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223151244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223151246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223151246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223151247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:53.008185 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8388): Process ended prematurely: osmo-stp_10.42.42.5(pid=8388) [trial-2395↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8388)] [trial-2395↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:31:53.017972 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:31:53.045937 run osmo-hlr_10.42.42.2(pid=8385): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8385)] 22:31:53.097201 run osmo-hlr_10.42.42.2(pid=8385): stdout: | (launched: 2022-12-13_22:31:50.058677) 22:31:53.149197 run osmo-hlr_10.42.42.2(pid=8385): stderr: | 20221213223150257 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223150257 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223150257 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223150257 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223150257 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223150257 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223150270 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223150280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223150281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223150281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:53.221318 run osmo-msc_10.42.42.6(pid=8391): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8391)] 22:31:53.270721 run osmo-msc_10.42.42.6(pid=8391): stdout: | (launched: 2022-12-13_22:31:52.081913) 22:31:53.322765 run osmo-msc_10.42.42.6(pid=8391): stderr: | 20221213223152400 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223152400 DLGLOBAL DEBUG validating counter group 0x7f7ea4d91c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223152400 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223152400 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223152401 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223152401 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223152403 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223152403 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223152403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223152403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:31:53.374805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8384): Terminating (SIGTERM) 22:31:53.416260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8387): Terminating (SIGTERM) 22:31:53.458703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8390): Terminating (SIGTERM) 22:31:53.501199 --- ParallelTerminationStrategy: PID 8384 died... 22:31:53.521734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8384): Terminated: ok {rc=0} 22:31:53.568198 --- ParallelTerminationStrategy: PID 8387 died... 22:31:53.588023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8387): Terminated: ok {rc=0} 22:31:53.634138 --- ParallelTerminationStrategy: PID 8390 died... 22:31:53.654039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8390): Terminated: ok {rc=0} 22:31:53.742504 bus /sierra_3: Setting Powered False 22:31:54.842026 bus /sierra_3: Setting Powered False 22:31:55.956030 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:31:57.216323 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:31:57.222704 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:31:57.256941 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:31:57.285208 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:31:57.336127 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:31:57.370114 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:31:57.397467 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:31:57.949113 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:31:58.002106 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:58.013668 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:31:58.085392 tst mo_mt_call.py: using LAC 36672 22:31:58.203138 tst mo_mt_call.py: using RAC 207 22:31:58.321060 tst mo_mt_call.py: using CellId 36672 22:31:58.437924 tst mo_mt_call.py: using BVCI 36673 22:31:58.546316 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:58.557286 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:58.568182 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:58.578803 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:58.590012 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:31:58.600730 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:31:58.716311 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:31:58.836199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:59.333258 run create_hlr_db(pid=8396): Launched 22:31:59.455797 bus /sierra_2: Setting Powered False 22:32:00.518883 run create_hlr_db(pid=8396): Terminated: ok {rc=0} 22:32:00.977819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8398): Launched 22:32:01.305703 run osmo-hlr_10.42.42.2(pid=8399): Launched 22:32:01.549664 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:02.200082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8401): Launched 22:32:02.507042 run osmo-stp_10.42.42.5(pid=8402): Launched 22:32:02.622711 run osmo-msc_10.42.42.6: Starting osmo-msc 22:32:03.165637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8404): Launched 22:32:03.463477 run osmo-msc_10.42.42.6(pid=8405): Launched 22:32:03.632095 run osmo-stp_10.42.42.5(pid=8402): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8402)] 22:32:03.759938 run osmo-stp_10.42.42.5(pid=8402): stdout: | (launched: 2022-12-13_22:32:02.452684) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:03.887414 run osmo-stp_10.42.42.5(pid=8402): stderr: | 20221213223202623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223202623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223202623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223202624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223202624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223202624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223202624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:04.012671 run osmo-stp_10.42.42.5(pid=8402): stdout: | (launched: 2022-12-13_22:32:02.452684) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:04.132848 run osmo-stp_10.42.42.5(pid=8402): stderr: | 20221213223202623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223202623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223202623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223202624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223202624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223202624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223202624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:04.276270 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8402): Process ended prematurely: osmo-stp_10.42.42.5(pid=8402) [trial-2395↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8402)] [trial-2395↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:32:04.285441 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:32:04.311775 run osmo-hlr_10.42.42.2(pid=8399): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8399)] 22:32:04.359478 run osmo-hlr_10.42.42.2(pid=8399): stdout: | (launched: 2022-12-13_22:32:01.241949) 22:32:04.408832 run osmo-hlr_10.42.42.2(pid=8399): stderr: | 20221213223201465 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223201465 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223201465 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223201466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223201466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223201466 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223201487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223201496 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223201497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223201497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:04.477985 run osmo-msc_10.42.42.6(pid=8405): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8405)] 22:32:04.525314 run osmo-msc_10.42.42.6(pid=8405): stdout: | (launched: 2022-12-13_22:32:03.409548) 22:32:04.574348 run osmo-msc_10.42.42.6(pid=8405): stderr: | 20221213223203682 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223203682 DLGLOBAL DEBUG validating counter group 0x7fd0d2e81c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223203682 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223203682 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223203682 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223203682 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223203686 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223203686 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223203686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223203687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:32:04.623473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8398): Terminating (SIGTERM) 22:32:04.663366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8401): Terminating (SIGTERM) 22:32:04.703124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8404): Terminating (SIGTERM) 22:32:04.742692 --- ParallelTerminationStrategy: PID 8398 died... 22:32:04.761815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8398): Terminated: ok {rc=0} 22:32:04.806046 --- ParallelTerminationStrategy: PID 8401 died... 22:32:04.824697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8401): Terminated: ok {rc=0} 22:32:04.868501 --- ParallelTerminationStrategy: PID 8404 died... 22:32:04.887246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8404): Terminated: ok {rc=0} 22:32:04.973559 bus /sierra_3: Setting Powered False 22:32:06.072450 bus /sierra_3: Setting Powered False 22:32:07.186267 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:32:08.334371 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:08.346316 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:32:08.418719 tst mo_mt_call_osmux.py: using LAC 36673 22:32:08.546391 tst mo_mt_call_osmux.py: using RAC 208 22:32:08.665359 tst mo_mt_call_osmux.py: using CellId 36673 22:32:08.783845 tst mo_mt_call_osmux.py: using BVCI 36674 22:32:08.892367 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:08.903387 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:08.914209 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:08.924927 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:08.936145 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:32:08.947176 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:32:09.066445 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:32:09.183608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:09.648744 run create_hlr_db(pid=8407): Launched 22:32:09.772092 bus /sierra_2: Setting Powered False 22:32:10.833205 run create_hlr_db(pid=8407): Terminated: ok {rc=0} 22:32:11.273252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8409): Launched 22:32:11.593611 run osmo-hlr_10.42.42.2(pid=8410): Launched 22:32:11.715143 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:12.267594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8412): Launched 22:32:12.587821 run osmo-stp_10.42.42.5(pid=8413): Launched 22:32:12.710666 run osmo-msc_10.42.42.6: Starting osmo-msc 22:32:13.290690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8415): Launched 22:32:13.610622 run osmo-msc_10.42.42.6(pid=8416): Launched 22:32:13.790559 run osmo-stp_10.42.42.5(pid=8413): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8413)] 22:32:13.925946 run osmo-stp_10.42.42.5(pid=8413): stdout: | (launched: 2022-12-13_22:32:12.529914) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:14.062349 run osmo-stp_10.42.42.5(pid=8413): stderr: | 20221213223212723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223212723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223212724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223212724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223212724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223212725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223212725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:14.197523 run osmo-stp_10.42.42.5(pid=8413): stdout: | (launched: 2022-12-13_22:32:12.529914) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:14.325501 run osmo-stp_10.42.42.5(pid=8413): stderr: | 20221213223212723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223212723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223212724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223212724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223212724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223212725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223212725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:14.478947 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8413): Process ended prematurely: osmo-stp_10.42.42.5(pid=8413) [trial-2395↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8413)] [trial-2395↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:32:14.488355 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:32:14.516187 run osmo-hlr_10.42.42.2(pid=8410): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8410)] 22:32:14.566877 run osmo-hlr_10.42.42.2(pid=8410): stdout: | (launched: 2022-12-13_22:32:11.535119) 22:32:14.619646 run osmo-hlr_10.42.42.2(pid=8410): stderr: | 20221213223211732 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223211732 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223211732 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223211732 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223211732 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223211732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223211744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223211753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223211753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223211753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:14.691811 run osmo-msc_10.42.42.6(pid=8416): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8416)] 22:32:14.741494 run osmo-msc_10.42.42.6(pid=8416): stdout: | (launched: 2022-12-13_22:32:13.552376) 22:32:14.793357 run osmo-msc_10.42.42.6(pid=8416): stderr: | 20221213223213874 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223213874 DLGLOBAL DEBUG validating counter group 0x7f8b25f1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223213874 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223213875 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223213875 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223213875 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223213877 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223213877 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223213877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223213877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:32:14.845972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8409): Terminating (SIGTERM) 22:32:14.887431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8412): Terminating (SIGTERM) 22:32:14.929392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8415): Terminating (SIGTERM) 22:32:14.971480 --- ParallelTerminationStrategy: PID 8409 died... 22:32:14.991704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8409): Terminated: ok {rc=0} 22:32:15.037962 --- ParallelTerminationStrategy: PID 8412 died... 22:32:15.058042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8412): Terminated: ok {rc=0} 22:32:15.104781 --- ParallelTerminationStrategy: PID 8415 died... 22:32:15.125175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8415): Terminated: ok {rc=0} 22:32:15.214290 bus /sierra_3: Setting Powered False 22:32:16.311002 bus /sierra_3: Setting Powered False 22:32:17.433719 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 emergency:trx-lms --------------------------------------------------------------------- 22:32:18.680592 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:32:18.685030 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 22:32:18.717449 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 22:32:18.744279 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 22:32:18.828444 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 22:32:18.861084 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 22:32:18.887684 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 22:32:19.469373 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2395 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 22:32:19.474421 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:19.485158 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 22:32:19.534234 tst emergency_mo_mt_call.py: using LAC 36674 22:32:19.651714 tst emergency_mo_mt_call.py: using RAC 209 22:32:19.776339 tst emergency_mo_mt_call.py: using CellId 36674 22:32:19.900199 tst emergency_mo_mt_call.py: using BVCI 36675 22:32:20.015374 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:20.026497 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:20.037537 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:20.048281 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:20.059897 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:20.071090 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:20.183240 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:20.305716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:20.792825 run create_hlr_db(pid=8422): Launched 22:32:20.913040 bus /sierra_2: Setting Powered False 22:32:21.975676 run create_hlr_db(pid=8422): Terminated: ok {rc=0} 22:32:22.414515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8424): Launched 22:32:22.728239 run osmo-hlr_10.42.42.2(pid=8425): Launched 22:32:22.849241 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:23.393336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8427): Launched 22:32:23.707090 run osmo-stp_10.42.42.5(pid=8428): Launched 22:32:23.836614 tst emergency_mo_mt_call.py: using MSISDN 8360 22:32:23.998551 run osmo-msc_10.42.42.6: Starting osmo-msc 22:32:24.564571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8430): Launched 22:32:24.877646 run osmo-msc_10.42.42.6(pid=8431): Launched 22:32:25.053406 run osmo-stp_10.42.42.5(pid=8428): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8428)] 22:32:25.187265 run osmo-stp_10.42.42.5(pid=8428): stdout: | (launched: 2022-12-13_22:32:23.650111) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:25.321231 run osmo-stp_10.42.42.5(pid=8428): stderr: | 20221213223223840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223223840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223223841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223223841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223223843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223223843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223223843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:25.453553 run osmo-stp_10.42.42.5(pid=8428): stdout: | (launched: 2022-12-13_22:32:23.650111) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:25.578316 run osmo-stp_10.42.42.5(pid=8428): stderr: | 20221213223223840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223223840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223223841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223223841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223223843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223223843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223223843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:25.727563 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=8428): Process ended prematurely: osmo-stp_10.42.42.5(pid=8428) [trial-2395↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8428)] [trial-2395↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 22:32:25.736379 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 22:32:25.763469 run osmo-hlr_10.42.42.2(pid=8425): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8425)] 22:32:25.813822 run osmo-hlr_10.42.42.2(pid=8425): stdout: | (launched: 2022-12-13_22:32:22.671514) 22:32:25.865712 run osmo-hlr_10.42.42.2(pid=8425): stderr: | 20221213223222865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223222865 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223222865 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223222865 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223222865 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223222865 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223222878 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223222886 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223222886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223222886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:25.937134 run osmo-msc_10.42.42.6(pid=8431): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8431)] 22:32:25.986747 run osmo-msc_10.42.42.6(pid=8431): stdout: | (launched: 2022-12-13_22:32:24.820630) 22:32:26.038334 run osmo-msc_10.42.42.6(pid=8431): stderr: | 20221213223225141 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223225141 DLGLOBAL DEBUG validating counter group 0x7f61d8b79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223225141 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223225141 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223225141 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223225142 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223225145 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223225145 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223225145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223225145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:32:26.090750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8424): Terminating (SIGTERM) 22:32:26.131698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8427): Terminating (SIGTERM) 22:32:26.173688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8430): Terminating (SIGTERM) 22:32:26.215521 --- ParallelTerminationStrategy: PID 8424 died... 22:32:26.235668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8424): Terminated: ok {rc=0} 22:32:26.281774 --- ParallelTerminationStrategy: PID 8427 died... 22:32:26.301489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8427): Terminated: ok {rc=0} 22:32:26.347368 --- ParallelTerminationStrategy: PID 8430 died... 22:32:26.367096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8430): Terminated: ok {rc=0} 22:32:26.455119 bus /sierra_3: Setting Powered False 22:32:27.554393 bus /sierra_3: Setting Powered False 22:32:28.672362 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 22:32:29.759707 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:29.771486 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 22:32:29.824371 tst emergency_preemptive_call.py: using LAC 36675 22:32:29.948904 tst emergency_preemptive_call.py: using RAC 210 22:32:30.072644 tst emergency_preemptive_call.py: using CellId 36675 22:32:30.195484 tst emergency_preemptive_call.py: using BVCI 36676 22:32:30.311050 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:30.322382 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:30.333478 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:30.344452 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:30.355905 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:32:30.367056 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:30.483186 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:30.598831 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:30.716798 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:32:30.831411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:31.375208 run create_hlr_db(pid=8433): Launched 22:32:31.529395 bus /sierra_2: Setting Powered False 22:32:32.592244 run create_hlr_db(pid=8433): Terminated: ok {rc=0} 22:32:33.031842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8435): Launched 22:32:33.346261 run osmo-hlr_10.42.42.2(pid=8436): Launched 22:32:33.466420 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:34.005881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8438): Launched 22:32:34.319864 run osmo-stp_10.42.42.5(pid=8439): Launched 22:32:34.449653 tst emergency_preemptive_call.py: using MSISDN 8361 22:32:34.610869 run osmo-msc_10.42.42.6: Starting osmo-msc 22:32:35.175725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8441): Launched 22:32:35.490398 run osmo-msc_10.42.42.6(pid=8442): Launched 22:32:35.667530 run osmo-stp_10.42.42.5(pid=8439): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8439)] 22:32:35.800857 run osmo-stp_10.42.42.5(pid=8439): stdout: | (launched: 2022-12-13_22:32:34.262966) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:35.935175 run osmo-stp_10.42.42.5(pid=8439): stderr: | 20221213223234455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223234455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223234455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223234456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223234456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223234456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223234456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:36.069141 run osmo-stp_10.42.42.5(pid=8439): stdout: | (launched: 2022-12-13_22:32:34.262966) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:36.195428 run osmo-stp_10.42.42.5(pid=8439): stderr: | 20221213223234455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223234455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223234455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223234456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223234456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223234456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223234456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:36.345799 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=8439): Process ended prematurely: osmo-stp_10.42.42.5(pid=8439) [trial-2395↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8439)] [trial-2395↪emergency:trx-lms↪emergency_preemptive_call.py:32] 22:32:36.354903 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 22:32:36.382439 run osmo-hlr_10.42.42.2(pid=8436): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8436)] 22:32:36.433939 run osmo-hlr_10.42.42.2(pid=8436): stdout: | (launched: 2022-12-13_22:32:33.289507) 22:32:36.485784 run osmo-hlr_10.42.42.2(pid=8436): stderr: | 20221213223233486 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223233486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223233486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223233486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223233486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223233486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223233499 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223233507 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223233507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223233507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:36.558205 run osmo-msc_10.42.42.6(pid=8442): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8442)] 22:32:36.608408 run osmo-msc_10.42.42.6(pid=8442): stdout: | (launched: 2022-12-13_22:32:35.433365) 22:32:36.660161 run osmo-msc_10.42.42.6(pid=8442): stderr: | 20221213223235757 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223235758 DLGLOBAL DEBUG validating counter group 0x7fb4ff748c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223235758 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223235758 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223235758 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223235758 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223235760 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223235760 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223235760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223235761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:32:36.712147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8435): Terminating (SIGTERM) 22:32:36.753576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8438): Terminating (SIGTERM) 22:32:36.795402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8441): Terminating (SIGTERM) 22:32:36.837596 --- ParallelTerminationStrategy: PID 8435 died... 22:32:36.858014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8435): Terminated: ok {rc=0} 22:32:36.904199 --- ParallelTerminationStrategy: PID 8438 died... 22:32:36.924074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8438): Terminated: ok {rc=0} 22:32:36.970522 --- ParallelTerminationStrategy: PID 8441 died... 22:32:36.990362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8441): Terminated: ok {rc=0} 22:32:37.078086 bus /sierra_9: Setting Powered False 22:32:38.177060 bus /sierra_9: Setting Powered False 22:32:39.292669 bus /sierra_8: Setting Powered False 22:32:40.390818 bus /sierra_8: Setting Powered False 22:32:41.504760 bus /sierra_3: Setting Powered False 22:32:42.603361 bus /sierra_3: Setting Powered False 22:32:43.717857 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-lms --------------------------------------------------------------------- 22:32:44.988530 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:32:44.992783 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 22:32:45.025151 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 22:32:45.063180 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 22:32:45.148769 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 22:32:45.181305 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 22:32:45.219126 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 22:32:45.806710 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 22:32:45.861461 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:45.874539 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:32:45.924027 tst cs_paging_gprs_active.py: using LAC 36676 22:32:46.041146 tst cs_paging_gprs_active.py: using RAC 211 22:32:46.170403 tst cs_paging_gprs_active.py: using CellId 36676 22:32:46.296874 tst cs_paging_gprs_active.py: using BVCI 36677 22:32:46.410704 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:46.422429 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:46.433804 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:46.444941 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:46.456700 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:46.468614 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:46.480716 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:46.492487 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:46.504404 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:32:46.621222 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:32:46.738443 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:32:46.941900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:32:47.330380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8448): Launched 22:32:47.611291 run iperf3-srv_10.42.42.10(pid=8449): Launched 22:32:47.732181 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:32:47.948740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:32:48.270656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8450): Launched 22:32:48.549672 run iperf3-srv_10.42.42.10(pid=8451): Launched 22:32:48.670068 tst cs_paging_gprs_active.py:38: start network... 22:32:48.885801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:49.381717 run create_hlr_db(pid=8452): Launched 22:32:49.504306 bus /sierra_2: Setting Powered False 22:32:50.568250 run create_hlr_db(pid=8452): Terminated: ok {rc=0} 22:32:51.014407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8454): Launched 22:32:51.335584 run osmo-hlr_10.42.42.2(pid=8455): Launched 22:32:51.458852 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:51.977385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8457): Launched 22:32:52.277642 run osmo-stp_10.42.42.5(pid=8458): Launched 22:32:52.392188 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:32:52.908565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8460): Launched 22:32:53.023840 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:32:53.277312 run patchelf(pid=8461): Launched 22:32:53.444865 run osmo-stp_10.42.42.5(pid=8458): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8458)] 22:32:53.571564 run osmo-stp_10.42.42.5(pid=8458): stdout: | (launched: 2022-12-13_22:32:52.223094) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:53.700030 run osmo-stp_10.42.42.5(pid=8458): stderr: | 20221213223252394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223252395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223252395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223252395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223252396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223252396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223252396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:53.828802 run osmo-stp_10.42.42.5(pid=8458): stdout: | (launched: 2022-12-13_22:32:52.223094) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:53.951791 run osmo-stp_10.42.42.5(pid=8458): stderr: | 20221213223252394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223252395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223252395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223252395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223252396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223252396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223252396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:54.097442 run patchelf(pid=8461): Terminating (SIGINT) 22:32:54.266800 run patchelf(pid=8461): Terminated: ok {rc=0} 22:32:54.388265 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8458): Process ended prematurely: osmo-stp_10.42.42.5(pid=8458) [trial-2395↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8458)] [trial-2395↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 22:32:54.397962 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:32:54.424869 run osmo-hlr_10.42.42.2(pid=8455): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8455)] 22:32:54.472662 run osmo-hlr_10.42.42.2(pid=8455): stdout: | (launched: 2022-12-13_22:32:51.277601) 22:32:54.521845 run osmo-hlr_10.42.42.2(pid=8455): stderr: | 20221213223251474 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223251474 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223251474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223251474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223251474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223251474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223251488 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223251497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223251497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223251497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:54.571306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8448): Terminating (SIGTERM) 22:32:54.610781 run iperf3-srv_10.42.42.10(pid=8449): Terminating (SIGTERM) 22:32:54.650416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8450): Terminating (SIGTERM) 22:32:54.690282 run iperf3-srv_10.42.42.10(pid=8451): Terminating (SIGTERM) 22:32:54.729777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8454): Terminating (SIGTERM) 22:32:54.769498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8457): Terminating (SIGTERM) 22:32:54.808907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8460): Terminating (SIGTERM) 22:32:54.848790 --- ParallelTerminationStrategy: PID 8448 died... 22:32:54.868088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8448): Terminated: ok {rc=0} 22:32:54.912072 --- ParallelTerminationStrategy: PID 8449 died... 22:32:54.930755 run iperf3-srv_10.42.42.10(pid=8449): Terminated {rc=256} 22:32:54.974432 --- ParallelTerminationStrategy: PID 8450 died... 22:32:54.993122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8450): Terminated: ok {rc=0} 22:32:55.036851 --- ParallelTerminationStrategy: PID 8451 died... 22:32:55.055976 run iperf3-srv_10.42.42.10(pid=8451): Terminated {rc=256} 22:32:55.100038 --- ParallelTerminationStrategy: PID 8454 died... 22:32:55.118905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8454): Terminated: ok {rc=0} 22:32:55.162612 --- ParallelTerminationStrategy: PID 8457 died... 22:32:55.181362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8457): Terminated: ok {rc=0} 22:32:55.225234 --- ParallelTerminationStrategy: PID 8460 died... 22:32:55.243832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8460): Terminated: ok {rc=0} 22:32:55.330193 bus /gobi_0: Setting Powered False 22:32:56.429575 bus /gobi_0: Setting Powered False 22:32:57.544916 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms iperf3.py ---------------------------------------------- 22:32:58.691172 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:58.702445 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:32:58.753811 tst iperf3.py: using LAC 36677 22:32:58.872909 tst iperf3.py: using RAC 212 22:32:58.991032 tst iperf3.py: using CellId 36677 22:32:59.110861 tst iperf3.py: using BVCI 36678 22:32:59.220179 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:59.230792 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:59.241115 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:59.251350 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:59.261541 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:59.271739 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:59.282199 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:59.293063 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:32:59.304020 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:32:59.417860 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:32:59.619114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:32:59.920730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8462): Launched 22:33:00.183141 run iperf3-srv_10.42.42.10(pid=8463): Launched 22:33:00.297159 tst iperf3.py:8: start network... 22:33:00.498328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:00.994854 run create_hlr_db(pid=8464): Launched 22:33:01.168627 bus /gobi_6: Setting Powered False 22:33:02.234053 run create_hlr_db(pid=8464): Terminated: ok {rc=0} 22:33:02.677819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8467): Launched 22:33:02.977767 run osmo-hlr_10.42.42.2(pid=8468): Launched 22:33:03.092050 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:03.622892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8470): Launched 22:33:03.922397 run osmo-stp_10.42.42.5(pid=8471): Launched 22:33:04.035101 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:04.549226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8473): Launched 22:33:04.663545 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:04.915948 run patchelf(pid=8474): Launched 22:33:05.082831 run osmo-stp_10.42.42.5(pid=8471): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8471)] 22:33:05.209793 run osmo-stp_10.42.42.5(pid=8471): stdout: | (launched: 2022-12-13_22:33:03.866748) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:05.338030 run osmo-stp_10.42.42.5(pid=8471): stderr: | 20221213223304035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223304035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223304036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223304036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223304039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223304039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223304039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:05.466266 run osmo-stp_10.42.42.5(pid=8471): stdout: | (launched: 2022-12-13_22:33:03.866748) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:05.588741 run osmo-stp_10.42.42.5(pid=8471): stderr: | 20221213223304035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223304035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223304036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223304036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223304039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223304039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223304039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:05.734147 run patchelf(pid=8474): Terminating (SIGINT) 22:33:05.902018 run patchelf(pid=8474): Terminated: ok {rc=0} 22:33:06.023127 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8471): Process ended prematurely: osmo-stp_10.42.42.5(pid=8471) [trial-2395↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8471)] [trial-2395↪gprs:trx-lms↪iperf3.py:8] 22:33:06.032415 tst iperf3.py:8: Test FAILED (7.4 sec) 22:33:06.059480 run osmo-hlr_10.42.42.2(pid=8468): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8468)] 22:33:06.107048 run osmo-hlr_10.42.42.2(pid=8468): stdout: | (launched: 2022-12-13_22:33:02.922967) 22:33:06.155991 run osmo-hlr_10.42.42.2(pid=8468): stderr: | 20221213223303099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223303099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223303099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223303099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223303099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223303099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223303111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223303123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223303123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223303123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:06.205252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8462): Terminating (SIGTERM) 22:33:06.244686 run iperf3-srv_10.42.42.10(pid=8463): Terminating (SIGTERM) 22:33:06.284481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8467): Terminating (SIGTERM) 22:33:06.323726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8470): Terminating (SIGTERM) 22:33:06.364933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8473): Terminating (SIGTERM) 22:33:06.405331 --- ParallelTerminationStrategy: PID 8462 died... 22:33:06.424100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8462): Terminated: ok {rc=0} 22:33:06.467572 --- ParallelTerminationStrategy: PID 8463 died... 22:33:06.485964 run iperf3-srv_10.42.42.10(pid=8463): Terminated {rc=256} 22:33:06.529235 --- ParallelTerminationStrategy: PID 8467 died... 22:33:06.547526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8467): Terminated: ok {rc=0} 22:33:06.591001 --- ParallelTerminationStrategy: PID 8470 died... 22:33:06.609453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8470): Terminated: ok {rc=0} 22:33:06.652724 --- ParallelTerminationStrategy: PID 8473 died... 22:33:06.671225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8473): Terminated: ok {rc=0} 22:33:06.756020 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms iperf3m4.py ---------------------------------------------- 22:33:07.901286 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:07.912203 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:33:07.965185 tst iperf3m4.py: using LAC 36678 22:33:08.081881 tst iperf3m4.py: using RAC 213 22:33:08.206521 tst iperf3m4.py: using CellId 36678 22:33:08.330281 tst iperf3m4.py: using BVCI 36679 22:33:08.448275 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:08.459444 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:08.470299 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:08.481070 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:08.492033 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:08.503105 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:08.514413 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:08.525484 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:08.536495 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:08.653206 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:08.777937 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:08.894731 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:09.013572 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:33:09.231004 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:09.551612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8475): Launched 22:33:09.829349 run iperf3-srv_10.42.42.10(pid=8476): Launched 22:33:09.949417 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:33:10.165526 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:10.486540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8477): Launched 22:33:10.765407 run iperf3-srv_10.42.42.10(pid=8478): Launched 22:33:10.885271 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:33:11.100619 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:11.421185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8479): Launched 22:33:11.699850 run iperf3-srv_10.42.42.10(pid=8480): Launched 22:33:11.819663 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:33:12.035115 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:12.355960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8481): Launched 22:33:12.633743 run iperf3-srv_10.42.42.10(pid=8482): Launched 22:33:12.753823 tst iperf3m4.py:8: start network... 22:33:12.968874 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:13.465116 run create_hlr_db(pid=8483): Launched 22:33:13.587381 bus /gobi_6: Setting Powered False 22:33:14.650693 run create_hlr_db(pid=8483): Terminated: ok {rc=0} 22:33:15.096757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8485): Launched 22:33:15.416775 run osmo-hlr_10.42.42.2(pid=8486): Launched 22:33:15.539797 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:16.109943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8488): Launched 22:33:16.497781 run osmo-stp_10.42.42.5(pid=8489): Launched 22:33:16.750224 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:17.389456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8491): Launched 22:33:17.512039 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:17.781883 run patchelf(pid=8492): Launched 22:33:17.960707 run osmo-stp_10.42.42.5(pid=8489): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8489)] 22:33:18.097589 run osmo-stp_10.42.42.5(pid=8489): stdout: | (launched: 2022-12-13_22:33:16.434206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:18.235068 run osmo-stp_10.42.42.5(pid=8489): stderr: | 20221213223316735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223316735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223316735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223316736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223316736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223316736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223316736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:18.373307 run osmo-stp_10.42.42.5(pid=8489): stdout: | (launched: 2022-12-13_22:33:16.434206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:18.504748 run osmo-stp_10.42.42.5(pid=8489): stderr: | 20221213223316735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223316735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223316735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223316736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223316736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223316736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223316736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:18.660189 run patchelf(pid=8492): Terminating (SIGINT) 22:33:18.839168 run patchelf(pid=8492): Terminated: ok {rc=0} 22:33:18.968448 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8489): Process ended prematurely: osmo-stp_10.42.42.5(pid=8489) [trial-2395↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8489)] [trial-2395↪gprs:trx-lms↪iperf3m4.py:8] 22:33:18.978700 tst iperf3m4.py:8: Test FAILED (11.1 sec) 22:33:19.007521 run osmo-hlr_10.42.42.2(pid=8486): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8486)] 22:33:19.058214 run osmo-hlr_10.42.42.2(pid=8486): stdout: | (launched: 2022-12-13_22:33:15.358779) 22:33:19.110394 run osmo-hlr_10.42.42.2(pid=8486): stderr: | 20221213223315556 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223315556 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223315556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223315556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223315556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223315556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223315569 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223315577 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223315577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223315577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:19.162108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8475): Terminating (SIGTERM) 22:33:19.203775 run iperf3-srv_10.42.42.10(pid=8476): Terminating (SIGTERM) 22:33:19.245356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8477): Terminating (SIGTERM) 22:33:19.287296 run iperf3-srv_10.42.42.10(pid=8478): Terminating (SIGTERM) 22:33:19.329075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8479): Terminating (SIGTERM) 22:33:19.370997 run iperf3-srv_10.42.42.10(pid=8480): Terminating (SIGTERM) 22:33:19.412710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8481): Terminating (SIGTERM) 22:33:19.454464 run iperf3-srv_10.42.42.10(pid=8482): Terminating (SIGTERM) 22:33:19.496104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8485): Terminating (SIGTERM) 22:33:19.537977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8488): Terminating (SIGTERM) 22:33:19.579509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8491): Terminating (SIGTERM) 22:33:19.621393 --- ParallelTerminationStrategy: PID 8475 died... 22:33:19.641196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8475): Terminated: ok {rc=0} 22:33:19.687453 --- ParallelTerminationStrategy: PID 8476 died... 22:33:19.707130 run iperf3-srv_10.42.42.10(pid=8476): Terminated {rc=256} 22:33:19.753057 --- ParallelTerminationStrategy: PID 8477 died... 22:33:19.772847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8477): Terminated: ok {rc=0} 22:33:19.818944 --- ParallelTerminationStrategy: PID 8478 died... 22:33:19.838725 run iperf3-srv_10.42.42.10(pid=8478): Terminated {rc=256} 22:33:19.884750 --- ParallelTerminationStrategy: PID 8479 died... 22:33:19.904479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8479): Terminated: ok {rc=0} 22:33:19.950413 --- ParallelTerminationStrategy: PID 8480 died... 22:33:19.970089 run iperf3-srv_10.42.42.10(pid=8480): Terminated {rc=256} 22:33:20.016086 --- ParallelTerminationStrategy: PID 8481 died... 22:33:20.035791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8481): Terminated: ok {rc=0} 22:33:20.082055 --- ParallelTerminationStrategy: PID 8482 died... 22:33:20.101869 run iperf3-srv_10.42.42.10(pid=8482): Terminated {rc=256} 22:33:20.147796 --- ParallelTerminationStrategy: PID 8485 died... 22:33:20.167464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8485): Terminated: ok {rc=0} 22:33:20.213641 --- ParallelTerminationStrategy: PID 8488 died... 22:33:20.233353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8488): Terminated: ok {rc=0} 22:33:20.279659 --- ParallelTerminationStrategy: PID 8491 died... 22:33:20.299509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8491): Terminated: ok {rc=0} 22:33:20.387368 bus /gobi_4: Setting Powered False 22:33:21.487070 bus /gobi_4: Setting Powered False 22:33:22.602609 bus /gobi_1: Setting Powered False 22:33:23.701889 bus /gobi_1: Setting Powered False 22:33:24.816453 bus /gobi_0: Setting Powered False 22:33:25.913858 bus /gobi_0: Setting Powered False 22:33:27.030819 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms ping.py ---------------------------------------------- 22:33:28.133114 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:28.144826 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:33:28.195858 tst ping.py: using LAC 36679 22:33:28.319985 tst ping.py: using RAC 214 22:33:28.441926 tst ping.py: using CellId 36679 22:33:28.567052 tst ping.py: using BVCI 36680 22:33:28.680691 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:28.691710 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:28.702576 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:28.713359 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:28.724477 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:28.735515 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:28.746890 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:28.758206 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:28.872518 tst ping.py:19: start network... 22:33:29.068133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:29.521329 run create_hlr_db(pid=8493): Launched 22:33:29.643042 bus /gobi_6: Setting Powered False 22:33:30.702271 run create_hlr_db(pid=8493): Terminated: ok {rc=0} 22:33:31.161125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8495): Launched 22:33:31.495226 run osmo-hlr_10.42.42.2(pid=8496): Launched 22:33:31.739278 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:32.386332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8498): Launched 22:33:32.683535 run osmo-stp_10.42.42.5(pid=8499): Launched 22:33:32.794178 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:33.299212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8501): Launched 22:33:33.411069 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:33.657747 run patchelf(pid=8502): Launched 22:33:33.820676 run osmo-stp_10.42.42.5(pid=8499): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8499)] 22:33:33.944767 run osmo-stp_10.42.42.5(pid=8499): stdout: | (launched: 2022-12-13_22:33:32.629672) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:34.070604 run osmo-stp_10.42.42.5(pid=8499): stderr: | 20221213223332800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223332800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223332801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223332801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223332801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223332802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223332802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:34.196460 run osmo-stp_10.42.42.5(pid=8499): stdout: | (launched: 2022-12-13_22:33:32.629672) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:34.316506 run osmo-stp_10.42.42.5(pid=8499): stderr: | 20221213223332800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223332800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223332801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223332801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223332801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223332802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223332802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:34.458770 run patchelf(pid=8502): Terminating (SIGINT) 22:33:34.624423 run patchelf(pid=8502): Terminated: ok {rc=0} 22:33:34.742996 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8499): Process ended prematurely: osmo-stp_10.42.42.5(pid=8499) [trial-2395↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8499)] [trial-2395↪gprs:trx-lms↪ping.py:22] 22:33:34.751766 tst ping.py:22: Test FAILED (6.6 sec) 22:33:34.778387 run osmo-hlr_10.42.42.2(pid=8496): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8496)] 22:33:34.825966 run osmo-hlr_10.42.42.2(pid=8496): stdout: | (launched: 2022-12-13_22:33:31.436071) 22:33:34.875109 run osmo-hlr_10.42.42.2(pid=8496): stderr: | 20221213223331692 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223331692 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223331693 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223331693 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223331693 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223331694 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223331718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223331736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223331737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223331738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:34.924613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8495): Terminating (SIGTERM) 22:33:34.963894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8498): Terminating (SIGTERM) 22:33:35.003237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8501): Terminating (SIGTERM) 22:33:35.042951 --- ParallelTerminationStrategy: PID 8495 died... 22:33:35.061922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8495): Terminated: ok {rc=0} 22:33:35.105542 --- ParallelTerminationStrategy: PID 8498 died... 22:33:35.124069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8498): Terminated: ok {rc=0} 22:33:35.167349 --- ParallelTerminationStrategy: PID 8501 died... 22:33:35.185920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8501): Terminated: ok {rc=0} 22:33:35.268888 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 22:33:36.355097 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:36.366730 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:33:36.418489 tst ping_idle_ping.py: using LAC 36680 22:33:36.543983 tst ping_idle_ping.py: using RAC 215 22:33:36.673725 tst ping_idle_ping.py: using CellId 36680 22:33:36.798273 tst ping_idle_ping.py: using BVCI 36681 22:33:36.912389 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:36.923412 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:36.934351 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:36.945129 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:36.956559 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:36.968184 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:36.980576 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:33:36.992316 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:33:37.107006 tst ping_idle_ping.py:24: start network... 22:33:37.320398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:37.811077 run create_hlr_db(pid=8503): Launched 22:33:37.931996 bus /gobi_6: Setting Powered False 22:33:38.994368 run create_hlr_db(pid=8503): Terminated: ok {rc=0} 22:33:39.416190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8505): Launched 22:33:39.711011 run osmo-hlr_10.42.42.2(pid=8506): Launched 22:33:39.823797 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:40.330818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8508): Launched 22:33:40.625853 run osmo-stp_10.42.42.5(pid=8509): Launched 22:33:40.738553 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:41.249751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8511): Launched 22:33:41.371351 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:41.638029 run patchelf(pid=8512): Launched 22:33:41.813916 run osmo-stp_10.42.42.5(pid=8509): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8509)] 22:33:41.947946 run osmo-stp_10.42.42.5(pid=8509): stdout: | (launched: 2022-12-13_22:33:40.571293) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:42.083657 run osmo-stp_10.42.42.5(pid=8509): stderr: | 20221213223340740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223340741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223340741 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223340741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223340743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223340744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223340744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:42.220120 run osmo-stp_10.42.42.5(pid=8509): stdout: | (launched: 2022-12-13_22:33:40.571293) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:42.350096 run osmo-stp_10.42.42.5(pid=8509): stderr: | 20221213223340740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223340741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223340741 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223340741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223340743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223340744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223340744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:42.503948 run patchelf(pid=8512): Terminating (SIGINT) 22:33:42.680486 run patchelf(pid=8512): Terminated: ok {rc=0} 22:33:42.807390 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8509): Process ended prematurely: osmo-stp_10.42.42.5(pid=8509) [trial-2395↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8509)] [trial-2395↪gprs:trx-lms↪ping_idle_ping.py:27] 22:33:42.816714 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:33:42.844634 run osmo-hlr_10.42.42.2(pid=8506): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8506)] 22:33:42.894575 run osmo-hlr_10.42.42.2(pid=8506): stdout: | (launched: 2022-12-13_22:33:39.657107) 22:33:42.946453 run osmo-hlr_10.42.42.2(pid=8506): stderr: | 20221213223339832 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223339832 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223339833 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223339833 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223339833 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223339833 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223339845 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223339854 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223339854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223339854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:42.998462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8505): Terminating (SIGTERM) 22:33:43.039688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8508): Terminating (SIGTERM) 22:33:43.081672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8511): Terminating (SIGTERM) 22:33:43.123790 --- ParallelTerminationStrategy: PID 8505 died... 22:33:43.143944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8505): Terminated: ok {rc=0} 22:33:43.190488 --- ParallelTerminationStrategy: PID 8508 died... 22:33:43.210188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8508): Terminated: ok {rc=0} 22:33:43.255998 --- ParallelTerminationStrategy: PID 8511 died... 22:33:43.275611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8511): Terminated: ok {rc=0} 22:33:43.363073 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 22:33:44.662281 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:33:44.669644 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:33:44.704465 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:33:44.743682 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:33:44.833323 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:33:44.867722 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:33:44.907089 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:33:45.498778 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:33:45.550680 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:45.561884 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:33:45.614093 tst cs_paging_gprs_active.py: using LAC 36681 22:33:45.741206 tst cs_paging_gprs_active.py: using RAC 216 22:33:45.881524 tst cs_paging_gprs_active.py: using CellId 36681 22:33:46.013498 tst cs_paging_gprs_active.py: using BVCI 36682 22:33:46.128502 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:46.140243 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:46.151370 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:46.162954 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:46.174701 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:46.186163 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:46.197650 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:46.209492 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:46.220763 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:33:46.369428 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:33:46.498067 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:33:46.725127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:47.053845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8517): Launched 22:33:47.366685 run iperf3-srv_10.42.42.10(pid=8518): Launched 22:33:47.488009 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:33:47.705086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:48.027673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8519): Launched 22:33:48.308670 run iperf3-srv_10.42.42.10(pid=8520): Launched 22:33:48.430055 tst cs_paging_gprs_active.py:38: start network... 22:33:48.647401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:49.145340 run create_hlr_db(pid=8521): Launched 22:33:49.268115 bus /gobi_6: Setting Powered False 22:33:50.332268 run create_hlr_db(pid=8521): Terminated: ok {rc=0} 22:33:50.761477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8523): Launched 22:33:51.060589 run osmo-hlr_10.42.42.2(pid=8524): Launched 22:33:51.175615 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:51.705550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8526): Launched 22:33:52.003641 run osmo-stp_10.42.42.5(pid=8527): Launched 22:33:52.117826 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:52.634828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8529): Launched 22:33:52.749438 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:53.002187 run patchelf(pid=8530): Launched 22:33:53.170624 run osmo-stp_10.42.42.5(pid=8527): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8527)] 22:33:53.297523 run osmo-stp_10.42.42.5(pid=8527): stdout: | (launched: 2022-12-13_22:33:51.949129) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:53.426226 run osmo-stp_10.42.42.5(pid=8527): stderr: | 20221213223352117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223352118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223352118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223352118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223352119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223352119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223352119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:53.554708 run osmo-stp_10.42.42.5(pid=8527): stdout: | (launched: 2022-12-13_22:33:51.949129) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:53.677443 run osmo-stp_10.42.42.5(pid=8527): stderr: | 20221213223352117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223352118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223352118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223352118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223352119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223352119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223352119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:53.823302 run patchelf(pid=8530): Terminating (SIGINT) 22:33:53.991788 run patchelf(pid=8530): Terminated: ok {rc=0} 22:33:54.112665 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8527): Process ended prematurely: osmo-stp_10.42.42.5(pid=8527) [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8527)] [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:33:54.122074 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:33:54.148876 run osmo-hlr_10.42.42.2(pid=8524): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8524)] 22:33:54.196298 run osmo-hlr_10.42.42.2(pid=8524): stdout: | (launched: 2022-12-13_22:33:51.005861) 22:33:54.245859 run osmo-hlr_10.42.42.2(pid=8524): stderr: | 20221213223351182 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223351182 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223351182 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223351182 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223351182 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223351182 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223351194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223351205 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223351205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223351205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:54.295060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8517): Terminating (SIGTERM) 22:33:54.334554 run iperf3-srv_10.42.42.10(pid=8518): Terminating (SIGTERM) 22:33:54.373827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8519): Terminating (SIGTERM) 22:33:54.413113 run iperf3-srv_10.42.42.10(pid=8520): Terminating (SIGTERM) 22:33:54.452404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8523): Terminating (SIGTERM) 22:33:54.491877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8526): Terminating (SIGTERM) 22:33:54.531159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8529): Terminating (SIGTERM) 22:33:54.570828 --- ParallelTerminationStrategy: PID 8517 died... 22:33:54.590015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8517): Terminated: ok {rc=0} 22:33:54.634134 --- ParallelTerminationStrategy: PID 8518 died... 22:33:54.652891 run iperf3-srv_10.42.42.10(pid=8518): Terminated {rc=256} 22:33:54.696410 --- ParallelTerminationStrategy: PID 8519 died... 22:33:54.715153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8519): Terminated: ok {rc=0} 22:33:54.758558 --- ParallelTerminationStrategy: PID 8520 died... 22:33:54.777115 run iperf3-srv_10.42.42.10(pid=8520): Terminated {rc=256} 22:33:54.820348 --- ParallelTerminationStrategy: PID 8523 died... 22:33:54.839042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8523): Terminated: ok {rc=0} 22:33:54.882357 --- ParallelTerminationStrategy: PID 8526 died... 22:33:54.900820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8526): Terminated: ok {rc=0} 22:33:54.944005 --- ParallelTerminationStrategy: PID 8529 died... 22:33:54.962430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8529): Terminated: ok {rc=0} 22:33:55.045490 bus /gobi_0: Setting Powered False 22:33:56.143447 bus /gobi_0: Setting Powered False 22:33:57.262797 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:33:58.412930 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:58.424702 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:33:58.477227 tst iperf3.py: using LAC 36682 22:33:58.605357 tst iperf3.py: using RAC 217 22:33:58.731403 tst iperf3.py: using CellId 36682 22:33:58.856700 tst iperf3.py: using BVCI 36683 22:33:58.974598 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:58.985962 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:58.996921 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:59.007927 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:59.019172 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:59.030552 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:59.042086 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:59.053416 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:33:59.064737 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:33:59.184573 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:33:59.400591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:33:59.721181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8531): Launched 22:34:00.000191 run iperf3-srv_10.42.42.10(pid=8532): Launched 22:34:00.121482 tst iperf3.py:8: start network... 22:34:00.338340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:00.844776 run create_hlr_db(pid=8533): Launched 22:34:01.014518 bus /gobi_6: Setting Powered False 22:34:02.073559 run create_hlr_db(pid=8533): Terminated: ok {rc=0} 22:34:02.543127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8535): Launched 22:34:02.864239 run osmo-hlr_10.42.42.2(pid=8536): Launched 22:34:02.987257 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:03.539612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8538): Launched 22:34:03.860573 run osmo-stp_10.42.42.5(pid=8539): Launched 22:34:03.983879 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:34:04.538900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8541): Launched 22:34:04.658818 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:34:04.911378 run patchelf(pid=8542): Launched 22:34:05.078001 run osmo-stp_10.42.42.5(pid=8539): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8539)] 22:34:05.205396 run osmo-stp_10.42.42.5(pid=8539): stdout: | (launched: 2022-12-13_22:34:03.802511) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:05.333451 run osmo-stp_10.42.42.5(pid=8539): stderr: | 20221213223403994 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223403994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223403994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223403994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223403995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223403995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223403995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:05.461722 run osmo-stp_10.42.42.5(pid=8539): stdout: | (launched: 2022-12-13_22:34:03.802511) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:05.584246 run osmo-stp_10.42.42.5(pid=8539): stderr: | 20221213223403994 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223403994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223403994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223403994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223403995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223403995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223403995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:05.729335 run patchelf(pid=8542): Terminating (SIGINT) 22:34:05.896847 run patchelf(pid=8542): Terminated: ok {rc=0} 22:34:06.017564 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8539): Process ended prematurely: osmo-stp_10.42.42.5(pid=8539) [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8539)] [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 22:34:06.026826 tst iperf3.py:8: Test FAILED (7.7 sec) 22:34:06.053833 run osmo-hlr_10.42.42.2(pid=8536): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8536)] 22:34:06.101205 run osmo-hlr_10.42.42.2(pid=8536): stdout: | (launched: 2022-12-13_22:34:02.806249) 22:34:06.150242 run osmo-hlr_10.42.42.2(pid=8536): stderr: | 20221213223403005 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223403005 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223403005 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223403005 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223403005 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223403005 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223403018 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223403026 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223403026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223403026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:06.199688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8531): Terminating (SIGTERM) 22:34:06.238987 run iperf3-srv_10.42.42.10(pid=8532): Terminating (SIGTERM) 22:34:06.278468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8535): Terminating (SIGTERM) 22:34:06.317777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8538): Terminating (SIGTERM) 22:34:06.357605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8541): Terminating (SIGTERM) 22:34:06.397368 --- ParallelTerminationStrategy: PID 8531 died... 22:34:06.416293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8531): Terminated: ok {rc=0} 22:34:06.459796 --- ParallelTerminationStrategy: PID 8532 died... 22:34:06.478450 run iperf3-srv_10.42.42.10(pid=8532): Terminated {rc=256} 22:34:06.521701 --- ParallelTerminationStrategy: PID 8535 died... 22:34:06.540611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8535): Terminated: ok {rc=0} 22:34:06.584001 --- ParallelTerminationStrategy: PID 8538 died... 22:34:06.602407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8538): Terminated: ok {rc=0} 22:34:06.645890 --- ParallelTerminationStrategy: PID 8541 died... 22:34:06.664424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8541): Terminated: ok {rc=0} 22:34:06.747694 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:34:07.896841 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:07.908658 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:34:07.961822 tst iperf3m4.py: using LAC 36683 22:34:08.087782 tst iperf3m4.py: using RAC 218 22:34:08.213347 tst iperf3m4.py: using CellId 36683 22:34:08.339531 tst iperf3m4.py: using BVCI 36684 22:34:08.455166 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:08.466440 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:08.477592 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:08.488458 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:08.499634 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:08.510927 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:08.522483 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:08.533812 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:08.545264 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:08.661944 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:08.783733 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:08.902911 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:09.021311 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:34:09.221767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:09.521505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8543): Launched 22:34:09.782400 run iperf3-srv_10.42.42.10(pid=8544): Launched 22:34:09.894981 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:34:10.095119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:10.395685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8545): Launched 22:34:10.657548 run iperf3-srv_10.42.42.10(pid=8546): Launched 22:34:10.770850 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:34:10.971252 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:11.271288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8547): Launched 22:34:11.532520 run iperf3-srv_10.42.42.10(pid=8548): Launched 22:34:11.644821 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:34:11.845599 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:12.145769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8549): Launched 22:34:12.406517 run iperf3-srv_10.42.42.10(pid=8550): Launched 22:34:12.518576 tst iperf3m4.py:8: start network... 22:34:12.718882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:13.184407 run create_hlr_db(pid=8551): Launched 22:34:13.309156 bus /gobi_6: Setting Powered False 22:34:14.369936 run create_hlr_db(pid=8551): Terminated: ok {rc=0} 22:34:14.807336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8553): Launched 22:34:15.130215 run osmo-hlr_10.42.42.2(pid=8554): Launched 22:34:15.254238 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:15.805723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8556): Launched 22:34:16.173930 run osmo-stp_10.42.42.5(pid=8557): Launched 22:34:16.380538 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:34:17.131622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8559): Launched 22:34:17.263109 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:34:17.538934 run patchelf(pid=8560): Launched 22:34:17.718982 run osmo-stp_10.42.42.5(pid=8557): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8557)] 22:34:17.855954 run osmo-stp_10.42.42.5(pid=8557): stdout: | (launched: 2022-12-13_22:34:16.108834) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:17.994268 run osmo-stp_10.42.42.5(pid=8557): stderr: | 20221213223416465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223416466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223416466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223416466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223416467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223416467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223416467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:18.133211 run osmo-stp_10.42.42.5(pid=8557): stdout: | (launched: 2022-12-13_22:34:16.108834) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:18.265599 run osmo-stp_10.42.42.5(pid=8557): stderr: | 20221213223416465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223416466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223416466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223416466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223416467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223416467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223416467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:18.422165 run patchelf(pid=8560): Terminating (SIGINT) 22:34:18.602471 run patchelf(pid=8560): Terminated: ok {rc=0} 22:34:18.732320 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8557): Process ended prematurely: osmo-stp_10.42.42.5(pid=8557) [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8557)] [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 22:34:18.742454 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:34:18.771211 run osmo-hlr_10.42.42.2(pid=8554): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8554)] 22:34:18.821751 run osmo-hlr_10.42.42.2(pid=8554): stdout: | (launched: 2022-12-13_22:34:15.070762) 22:34:18.874363 run osmo-hlr_10.42.42.2(pid=8554): stderr: | 20221213223415270 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223415270 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223415270 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223415270 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223415270 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223415270 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223415283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223415291 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223415291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223415291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:18.926883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8543): Terminating (SIGTERM) 22:34:18.968755 run iperf3-srv_10.42.42.10(pid=8544): Terminating (SIGTERM) 22:34:19.011017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8545): Terminating (SIGTERM) 22:34:19.053245 run iperf3-srv_10.42.42.10(pid=8546): Terminating (SIGTERM) 22:34:19.095322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8547): Terminating (SIGTERM) 22:34:19.137715 run iperf3-srv_10.42.42.10(pid=8548): Terminating (SIGTERM) 22:34:19.179879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8549): Terminating (SIGTERM) 22:34:19.222173 run iperf3-srv_10.42.42.10(pid=8550): Terminating (SIGTERM) 22:34:19.264158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8553): Terminating (SIGTERM) 22:34:19.306567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8556): Terminating (SIGTERM) 22:34:19.348585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8559): Terminating (SIGTERM) 22:34:19.391420 --- ParallelTerminationStrategy: PID 8543 died... 22:34:19.411470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8543): Terminated: ok {rc=0} 22:34:19.457988 --- ParallelTerminationStrategy: PID 8544 died... 22:34:19.477974 run iperf3-srv_10.42.42.10(pid=8544): Terminated {rc=256} 22:34:19.524279 --- ParallelTerminationStrategy: PID 8545 died... 22:34:19.544319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8545): Terminated: ok {rc=0} 22:34:19.590292 --- ParallelTerminationStrategy: PID 8546 died... 22:34:19.610243 run iperf3-srv_10.42.42.10(pid=8546): Terminated {rc=256} 22:34:19.656494 --- ParallelTerminationStrategy: PID 8547 died... 22:34:19.676492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8547): Terminated: ok {rc=0} 22:34:19.722697 --- ParallelTerminationStrategy: PID 8548 died... 22:34:19.742642 run iperf3-srv_10.42.42.10(pid=8548): Terminated {rc=256} 22:34:19.788912 --- ParallelTerminationStrategy: PID 8549 died... 22:34:19.809077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8549): Terminated: ok {rc=0} 22:34:19.855242 --- ParallelTerminationStrategy: PID 8550 died... 22:34:19.875153 run iperf3-srv_10.42.42.10(pid=8550): Terminated {rc=256} 22:34:19.921478 --- ParallelTerminationStrategy: PID 8553 died... 22:34:19.941537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8553): Terminated: ok {rc=0} 22:34:19.987945 --- ParallelTerminationStrategy: PID 8556 died... 22:34:20.007930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8556): Terminated: ok {rc=0} 22:34:20.055097 --- ParallelTerminationStrategy: PID 8559 died... 22:34:20.075174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8559): Terminated: ok {rc=0} 22:34:20.163539 bus /gobi_4: Setting Powered False 22:34:21.263117 bus /gobi_4: Setting Powered False 22:34:22.379094 bus /gobi_1: Setting Powered False 22:34:23.477798 bus /gobi_1: Setting Powered False 22:34:24.594861 bus /gobi_0: Setting Powered False 22:34:25.693141 bus /gobi_0: Setting Powered False 22:34:26.810449 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 22:34:27.911058 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:27.922432 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:34:27.972534 tst ping.py: using LAC 36684 22:34:28.090218 tst ping.py: using RAC 219 22:34:28.207282 tst ping.py: using CellId 36684 22:34:28.323492 tst ping.py: using BVCI 36685 22:34:28.439410 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:28.450902 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:28.462062 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:28.473204 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:28.484925 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:28.497406 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:28.509626 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:28.521542 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:28.639581 tst ping.py:19: start network... 22:34:28.835282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:29.289521 run create_hlr_db(pid=8561): Launched 22:34:29.410528 bus /gobi_6: Setting Powered False 22:34:30.469982 run create_hlr_db(pid=8561): Terminated: ok {rc=0} 22:34:30.918689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8563): Launched 22:34:31.261211 run osmo-hlr_10.42.42.2(pid=8564): Launched 22:34:31.490403 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:32.143505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8566): Launched 22:34:32.488563 run osmo-stp_10.42.42.5(pid=8567): Launched 22:34:32.612026 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:34:33.158627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8569): Launched 22:34:33.280338 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:34:33.547810 run patchelf(pid=8570): Launched 22:34:33.724358 run osmo-stp_10.42.42.5(pid=8567): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8567)] 22:34:33.858319 run osmo-stp_10.42.42.5(pid=8567): stdout: | (launched: 2022-12-13_22:34:32.430564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:33.994053 run osmo-stp_10.42.42.5(pid=8567): stderr: | 20221213223432623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223432623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223432624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223432624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223432625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223432625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223432625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:34.130423 run osmo-stp_10.42.42.5(pid=8567): stdout: | (launched: 2022-12-13_22:34:32.430564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:34.260542 run osmo-stp_10.42.42.5(pid=8567): stderr: | 20221213223432623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223432623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223432624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223432624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223432625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223432625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223432625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:34.415022 run patchelf(pid=8570): Terminating (SIGINT) 22:34:34.591243 run patchelf(pid=8570): Terminated: ok {rc=0} 22:34:34.718369 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8567): Process ended prematurely: osmo-stp_10.42.42.5(pid=8567) [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8567)] [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 22:34:34.727821 tst ping.py:22: Test FAILED (6.8 sec) 22:34:34.755938 run osmo-hlr_10.42.42.2(pid=8564): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8564)] 22:34:34.806759 run osmo-hlr_10.42.42.2(pid=8564): stdout: | (launched: 2022-12-13_22:34:31.199427) 22:34:34.859315 run osmo-hlr_10.42.42.2(pid=8564): stderr: | 20221213223431396 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223431396 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223431396 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223431396 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223431396 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223431396 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223431411 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223431432 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223431432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223431432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:34.911547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8563): Terminating (SIGTERM) 22:34:34.953070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8566): Terminating (SIGTERM) 22:34:34.995161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8569): Terminating (SIGTERM) 22:34:35.037476 --- ParallelTerminationStrategy: PID 8563 died... 22:34:35.057871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8563): Terminated: ok {rc=0} 22:34:35.104280 --- ParallelTerminationStrategy: PID 8566 died... 22:34:35.124198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8566): Terminated: ok {rc=0} 22:34:35.170753 --- ParallelTerminationStrategy: PID 8569 died... 22:34:35.190589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8569): Terminated: ok {rc=0} 22:34:35.278760 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:34:36.366344 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:36.378399 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:34:36.433993 tst ping_idle_ping.py: using LAC 36685 22:34:36.556626 tst ping_idle_ping.py: using RAC 220 22:34:36.678639 tst ping_idle_ping.py: using CellId 36685 22:34:36.802443 tst ping_idle_ping.py: using BVCI 36686 22:34:36.916687 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:36.927968 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:36.939139 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:36.950695 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:36.962001 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:36.973402 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:36.984805 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:34:36.996234 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:34:37.113557 tst ping_idle_ping.py:24: start network... 22:34:37.312070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:37.771237 run create_hlr_db(pid=8571): Launched 22:34:37.893558 bus /gobi_6: Setting Powered False 22:34:38.952826 run create_hlr_db(pid=8571): Terminated: ok {rc=0} 22:34:39.386526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8573): Launched 22:34:39.702532 run osmo-hlr_10.42.42.2(pid=8574): Launched 22:34:39.824460 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:40.372737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8576): Launched 22:34:40.689228 run osmo-stp_10.42.42.5(pid=8577): Launched 22:34:40.810486 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:34:41.356132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8579): Launched 22:34:41.477563 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:34:41.743831 run patchelf(pid=8580): Launched 22:34:41.919930 run osmo-stp_10.42.42.5(pid=8577): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8577)] 22:34:42.053942 run osmo-stp_10.42.42.5(pid=8577): stdout: | (launched: 2022-12-13_22:34:40.630957) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:42.190087 run osmo-stp_10.42.42.5(pid=8577): stderr: | 20221213223440822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223440822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223440823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223440823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223440823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223440823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223440823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:42.325630 run osmo-stp_10.42.42.5(pid=8577): stdout: | (launched: 2022-12-13_22:34:40.630957) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:42.455231 run osmo-stp_10.42.42.5(pid=8577): stderr: | 20221213223440822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223440822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223440823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223440823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223440823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223440823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223440823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:42.609108 run patchelf(pid=8580): Terminating (SIGINT) 22:34:42.785802 run patchelf(pid=8580): Terminated: ok {rc=0} 22:34:42.913134 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8577): Process ended prematurely: osmo-stp_10.42.42.5(pid=8577) [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8577)] [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 22:34:42.922646 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:34:42.950787 run osmo-hlr_10.42.42.2(pid=8574): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8574)] 22:34:43.001607 run osmo-hlr_10.42.42.2(pid=8574): stdout: | (launched: 2022-12-13_22:34:39.645274) 22:34:43.053661 run osmo-hlr_10.42.42.2(pid=8574): stderr: | 20221213223439842 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223439842 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223439842 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223439842 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223439842 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223439842 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223439857 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223439865 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223439866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223439866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:43.106116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8573): Terminating (SIGTERM) 22:34:43.148034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8576): Terminating (SIGTERM) 22:34:43.190051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8579): Terminating (SIGTERM) 22:34:43.232317 --- ParallelTerminationStrategy: PID 8573 died... 22:34:43.252654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8573): Terminated: ok {rc=0} 22:34:43.299043 --- ParallelTerminationStrategy: PID 8576 died... 22:34:43.318740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8576): Terminated: ok {rc=0} 22:34:43.364561 --- ParallelTerminationStrategy: PID 8579 died... 22:34:43.384796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8579): Terminated: ok {rc=0} 22:34:43.472441 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:34:44.779342 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:34:44.786164 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:34:44.820734 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:34:44.860378 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:34:44.948850 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:34:44.982518 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:34:45.021861 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:34:45.616075 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:34:45.668531 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:45.679849 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:34:45.750454 tst cs_paging_gprs_active.py: using LAC 36686 22:34:45.880058 tst cs_paging_gprs_active.py: using RAC 221 22:34:46.014937 tst cs_paging_gprs_active.py: using CellId 36686 22:34:46.149419 tst cs_paging_gprs_active.py: using BVCI 36687 22:34:46.303598 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:46.319817 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:46.334844 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:46.350769 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:46.363927 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:46.376889 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:46.389607 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:46.402395 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:46.415168 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:34:46.535873 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:34:46.685516 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:34:46.917740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:47.284744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8585): Launched 22:34:47.573034 run iperf3-srv_10.42.42.10(pid=8586): Launched 22:34:47.694651 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:34:47.912363 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:34:48.236344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8587): Launched 22:34:48.516682 run iperf3-srv_10.42.42.10(pid=8588): Launched 22:34:48.637666 tst cs_paging_gprs_active.py:38: start network... 22:34:48.854459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:49.354099 run create_hlr_db(pid=8589): Launched 22:34:49.478249 bus /gobi_6: Setting Powered False 22:34:50.542219 run create_hlr_db(pid=8589): Terminated: ok {rc=0} 22:34:50.971952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8591): Launched 22:34:51.295959 run osmo-hlr_10.42.42.2(pid=8592): Launched 22:34:51.419840 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:51.973449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8594): Launched 22:34:52.294783 run osmo-stp_10.42.42.5(pid=8595): Launched 22:34:52.418971 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:34:52.971617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8597): Launched 22:34:53.095728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:34:53.375539 run patchelf(pid=8598): Launched 22:34:53.555390 run osmo-stp_10.42.42.5(pid=8595): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8595)] 22:34:53.692129 run osmo-stp_10.42.42.5(pid=8595): stdout: | (launched: 2022-12-13_22:34:52.236446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:53.830574 run osmo-stp_10.42.42.5(pid=8595): stderr: | 20221213223452429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223452429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223452429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223452430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223452430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223452430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223452430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:53.969047 run osmo-stp_10.42.42.5(pid=8595): stdout: | (launched: 2022-12-13_22:34:52.236446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:54.101711 run osmo-stp_10.42.42.5(pid=8595): stderr: | 20221213223452429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223452429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223452429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223452430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223452430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223452430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223452430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:54.259019 run patchelf(pid=8598): Terminating (SIGINT) 22:34:54.440121 run patchelf(pid=8598): Terminated: ok {rc=0} 22:34:54.570697 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8595): Process ended prematurely: osmo-stp_10.42.42.5(pid=8595) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8595)] [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:34:54.580787 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 22:34:54.609518 run osmo-hlr_10.42.42.2(pid=8592): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8592)] 22:34:54.660424 run osmo-hlr_10.42.42.2(pid=8592): stdout: | (launched: 2022-12-13_22:34:51.237716) 22:34:54.712487 run osmo-hlr_10.42.42.2(pid=8592): stderr: | 20221213223451435 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223451436 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223451436 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223451436 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223451436 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223451436 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223451447 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223451456 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223451456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223451456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:54.765233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8585): Terminating (SIGTERM) 22:34:54.807039 run iperf3-srv_10.42.42.10(pid=8586): Terminating (SIGTERM) 22:34:54.849256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8587): Terminating (SIGTERM) 22:34:54.891385 run iperf3-srv_10.42.42.10(pid=8588): Terminating (SIGTERM) 22:34:54.933261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8591): Terminating (SIGTERM) 22:34:54.975141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8594): Terminating (SIGTERM) 22:34:55.016899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8597): Terminating (SIGTERM) 22:34:55.058986 --- ParallelTerminationStrategy: PID 8585 died... 22:34:55.079406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8585): Terminated: ok {rc=0} 22:34:55.125846 --- ParallelTerminationStrategy: PID 8586 died... 22:34:55.146023 run iperf3-srv_10.42.42.10(pid=8586): Terminated {rc=256} 22:34:55.192172 --- ParallelTerminationStrategy: PID 8587 died... 22:34:55.212076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8587): Terminated: ok {rc=0} 22:34:55.258459 --- ParallelTerminationStrategy: PID 8588 died... 22:34:55.278256 run iperf3-srv_10.42.42.10(pid=8588): Terminated {rc=256} 22:34:55.324322 --- ParallelTerminationStrategy: PID 8591 died... 22:34:55.344162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8591): Terminated: ok {rc=0} 22:34:55.390229 --- ParallelTerminationStrategy: PID 8594 died... 22:34:55.410119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8594): Terminated: ok {rc=0} 22:34:55.456296 --- ParallelTerminationStrategy: PID 8597 died... 22:34:55.476184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8597): Terminated: ok {rc=0} 22:34:55.563989 bus /gobi_0: Setting Powered False 22:34:56.664448 bus /gobi_0: Setting Powered False 22:34:57.777260 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:34:58.925593 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:58.937531 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:34:59.011552 tst iperf3.py: using LAC 36687 22:34:59.129707 tst iperf3.py: using RAC 222 22:34:59.246968 tst iperf3.py: using CellId 36687 22:34:59.362533 tst iperf3.py: using BVCI 36688 22:34:59.472261 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:59.483362 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:59.494160 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:59.504638 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:59.515242 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:59.525868 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:59.536532 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:59.547010 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:34:59.558204 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:34:59.677018 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:34:59.894101 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:00.217222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8599): Launched 22:35:00.497185 run iperf3-srv_10.42.42.10(pid=8600): Launched 22:35:00.618197 tst iperf3.py:8: start network... 22:35:00.835466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:01.350044 run create_hlr_db(pid=8604): Launched 22:35:01.486759 bus /gobi_6: Setting Powered False 22:35:02.550105 run create_hlr_db(pid=8604): Terminated: ok {rc=0} 22:35:02.979775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8606): Launched 22:35:03.279772 run osmo-hlr_10.42.42.2(pid=8607): Launched 22:35:03.393974 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:03.926527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8609): Launched 22:35:04.226648 run osmo-stp_10.42.42.5(pid=8610): Launched 22:35:04.340667 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:35:04.856671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8612): Launched 22:35:04.971270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:35:05.224272 run patchelf(pid=8613): Launched 22:35:05.390876 run osmo-stp_10.42.42.5(pid=8610): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8610)] 22:35:05.517451 run osmo-stp_10.42.42.5(pid=8610): stdout: | (launched: 2022-12-13_22:35:04.171985) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:05.645689 run osmo-stp_10.42.42.5(pid=8610): stderr: | 20221213223504343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223504343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223504343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223504344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223504344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223504344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223504345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:05.773680 run osmo-stp_10.42.42.5(pid=8610): stdout: | (launched: 2022-12-13_22:35:04.171985) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:05.896062 run osmo-stp_10.42.42.5(pid=8610): stderr: | 20221213223504343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223504343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223504343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223504344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223504344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223504344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223504345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:06.040723 run patchelf(pid=8613): Terminating (SIGINT) 22:35:06.207970 run patchelf(pid=8613): Terminated: ok {rc=0} 22:35:06.328460 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8610): Process ended prematurely: osmo-stp_10.42.42.5(pid=8610) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8610)] [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 22:35:06.337867 tst iperf3.py:8: Test FAILED (7.5 sec) 22:35:06.364796 run osmo-hlr_10.42.42.2(pid=8607): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8607)] 22:35:06.412397 run osmo-hlr_10.42.42.2(pid=8607): stdout: | (launched: 2022-12-13_22:35:03.225102) 22:35:06.461192 run osmo-hlr_10.42.42.2(pid=8607): stderr: | 20221213223503399 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223503399 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223503400 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223503400 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223503400 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223503400 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223503415 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223503426 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223503426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223503426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:06.510494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8599): Terminating (SIGTERM) 22:35:06.549911 run iperf3-srv_10.42.42.10(pid=8600): Terminating (SIGTERM) 22:35:06.589218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8606): Terminating (SIGTERM) 22:35:06.628307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8609): Terminating (SIGTERM) 22:35:06.667580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8612): Terminating (SIGTERM) 22:35:06.707316 --- ParallelTerminationStrategy: PID 8599 died... 22:35:06.726518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8599): Terminated: ok {rc=0} 22:35:06.770198 --- ParallelTerminationStrategy: PID 8600 died... 22:35:06.788688 run iperf3-srv_10.42.42.10(pid=8600): Terminated {rc=256} 22:35:06.832320 --- ParallelTerminationStrategy: PID 8606 died... 22:35:06.850913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8606): Terminated: ok {rc=0} 22:35:06.894221 --- ParallelTerminationStrategy: PID 8609 died... 22:35:06.912790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8609): Terminated: ok {rc=0} 22:35:06.956204 --- ParallelTerminationStrategy: PID 8612 died... 22:35:06.974854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8612): Terminated: ok {rc=0} 22:35:07.059800 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:35:08.206043 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.217570 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:35:08.288336 tst iperf3m4.py: using LAC 36688 22:35:08.407468 tst iperf3m4.py: using RAC 223 22:35:08.526108 tst iperf3m4.py: using CellId 36688 22:35:08.643679 tst iperf3m4.py: using BVCI 36689 22:35:08.753526 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.764333 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.774914 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.785495 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.795978 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.806640 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.817404 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.827820 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:08.838492 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:08.958480 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:09.077349 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:09.198474 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:09.315922 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:35:09.516929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:09.817558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8614): Launched 22:35:10.079293 run iperf3-srv_10.42.42.10(pid=8615): Launched 22:35:10.191871 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:35:10.391354 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:10.691625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8616): Launched 22:35:10.953365 run iperf3-srv_10.42.42.10(pid=8617): Launched 22:35:11.065925 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:35:11.266926 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:11.567259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8618): Launched 22:35:11.828387 run iperf3-srv_10.42.42.10(pid=8619): Launched 22:35:11.941230 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:35:12.141614 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:12.441698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8620): Launched 22:35:12.702430 run iperf3-srv_10.42.42.10(pid=8621): Launched 22:35:12.814973 tst iperf3m4.py:8: start network... 22:35:13.015290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:13.480760 run create_hlr_db(pid=8622): Launched 22:35:13.603907 bus /gobi_6: Setting Powered False 22:35:14.663332 run create_hlr_db(pid=8622): Terminated: ok {rc=0} 22:35:15.100316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8624): Launched 22:35:15.422817 run osmo-hlr_10.42.42.2(pid=8625): Launched 22:35:15.545569 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:16.116181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8627): Launched 22:35:16.539280 run osmo-stp_10.42.42.5(pid=8628): Launched 22:35:16.881742 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:35:17.549263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8630): Launched 22:35:17.672279 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:35:17.942186 run patchelf(pid=8631): Launched 22:35:18.120167 run osmo-stp_10.42.42.5(pid=8628): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8628)] 22:35:18.256110 run osmo-stp_10.42.42.5(pid=8628): stdout: | (launched: 2022-12-13_22:35:16.463523) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:18.393173 run osmo-stp_10.42.42.5(pid=8628): stderr: | 20221213223516805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223516806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223516807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223516807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223516808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223516808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223516808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:18.529909 run osmo-stp_10.42.42.5(pid=8628): stdout: | (launched: 2022-12-13_22:35:16.463523) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:18.661210 run osmo-stp_10.42.42.5(pid=8628): stderr: | 20221213223516805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223516806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223516807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223516807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223516808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223516808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223516808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:18.817318 run patchelf(pid=8631): Terminating (SIGINT) 22:35:18.996402 run patchelf(pid=8631): Terminated: ok {rc=0} 22:35:19.126051 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8628): Process ended prematurely: osmo-stp_10.42.42.5(pid=8628) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8628)] [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:35:19.136255 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:35:19.165646 run osmo-hlr_10.42.42.2(pid=8625): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8625)] 22:35:19.216699 run osmo-hlr_10.42.42.2(pid=8625): stdout: | (launched: 2022-12-13_22:35:15.364596) 22:35:19.268748 run osmo-hlr_10.42.42.2(pid=8625): stderr: | 20221213223515563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223515563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223515563 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223515563 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223515563 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223515563 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223515600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223515609 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223515610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223515610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:19.321457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8614): Terminating (SIGTERM) 22:35:19.363423 run iperf3-srv_10.42.42.10(pid=8615): Terminating (SIGTERM) 22:35:19.405676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8616): Terminating (SIGTERM) 22:35:19.447950 run iperf3-srv_10.42.42.10(pid=8617): Terminating (SIGTERM) 22:35:19.489888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8618): Terminating (SIGTERM) 22:35:19.531997 run iperf3-srv_10.42.42.10(pid=8619): Terminating (SIGTERM) 22:35:19.573927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8620): Terminating (SIGTERM) 22:35:19.615921 run iperf3-srv_10.42.42.10(pid=8621): Terminating (SIGTERM) 22:35:19.657749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8624): Terminating (SIGTERM) 22:35:19.699803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8627): Terminating (SIGTERM) 22:35:19.741727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8630): Terminating (SIGTERM) 22:35:19.783889 --- ParallelTerminationStrategy: PID 8614 died... 22:35:19.804398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8614): Terminated: ok {rc=0} 22:35:19.851026 --- ParallelTerminationStrategy: PID 8615 died... 22:35:19.871050 run iperf3-srv_10.42.42.10(pid=8615): Terminated {rc=256} 22:35:19.917557 --- ParallelTerminationStrategy: PID 8616 died... 22:35:19.937686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8616): Terminated: ok {rc=0} 22:35:19.983933 --- ParallelTerminationStrategy: PID 8617 died... 22:35:20.003719 run iperf3-srv_10.42.42.10(pid=8617): Terminated {rc=256} 22:35:20.049975 --- ParallelTerminationStrategy: PID 8618 died... 22:35:20.069866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8618): Terminated: ok {rc=0} 22:35:20.116155 --- ParallelTerminationStrategy: PID 8619 died... 22:35:20.135935 run iperf3-srv_10.42.42.10(pid=8619): Terminated {rc=256} 22:35:20.182517 --- ParallelTerminationStrategy: PID 8620 died... 22:35:20.202590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8620): Terminated: ok {rc=0} 22:35:20.249036 --- ParallelTerminationStrategy: PID 8621 died... 22:35:20.269035 run iperf3-srv_10.42.42.10(pid=8621): Terminated {rc=256} 22:35:20.315346 --- ParallelTerminationStrategy: PID 8624 died... 22:35:20.335406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8624): Terminated: ok {rc=0} 22:35:20.381835 --- ParallelTerminationStrategy: PID 8627 died... 22:35:20.401758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8627): Terminated: ok {rc=0} 22:35:20.448159 --- ParallelTerminationStrategy: PID 8630 died... 22:35:20.468183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8630): Terminated: ok {rc=0} 22:35:20.555521 bus /gobi_4: Setting Powered False 22:35:21.655297 bus /gobi_4: Setting Powered False 22:35:22.770003 bus /gobi_1: Setting Powered False 22:35:23.869105 bus /gobi_1: Setting Powered False 22:35:24.989908 bus /gobi_0: Setting Powered False 22:35:26.089713 bus /gobi_0: Setting Powered False 22:35:27.204721 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:35:28.307228 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:28.318658 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:35:28.389425 tst ping.py: using LAC 36689 22:35:28.506820 tst ping.py: using RAC 224 22:35:28.627983 tst ping.py: using CellId 36689 22:35:28.743711 tst ping.py: using BVCI 36690 22:35:28.849855 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:28.860664 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:28.871315 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:28.882042 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:28.892531 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:28.903178 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:28.913930 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:28.924462 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:29.042107 tst ping.py:19: start network... 22:35:29.254999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:29.742994 run create_hlr_db(pid=8632): Launched 22:35:29.863343 bus /gobi_6: Setting Powered False 22:35:30.930549 run create_hlr_db(pid=8632): Terminated: ok {rc=0} 22:35:31.389957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8634): Launched 22:35:31.777913 run osmo-hlr_10.42.42.2(pid=8635): Launched 22:35:32.021791 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:32.611808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8637): Launched 22:35:32.906401 run osmo-stp_10.42.42.5(pid=8638): Launched 22:35:33.018221 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:35:33.527011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8640): Launched 22:35:33.639497 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:35:33.887576 run patchelf(pid=8641): Launched 22:35:34.051387 run osmo-stp_10.42.42.5(pid=8638): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8638)] 22:35:34.176104 run osmo-stp_10.42.42.5(pid=8638): stdout: | (launched: 2022-12-13_22:35:32.852150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:34.302237 run osmo-stp_10.42.42.5(pid=8638): stderr: | 20221213223533021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223533022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223533022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223533022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223533023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223533023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223533023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:34.428360 run osmo-stp_10.42.42.5(pid=8638): stdout: | (launched: 2022-12-13_22:35:32.852150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:34.548648 run osmo-stp_10.42.42.5(pid=8638): stderr: | 20221213223533021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223533022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223533022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223533022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223533023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223533023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223533023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:34.691570 run patchelf(pid=8641): Terminating (SIGINT) 22:35:34.856856 run patchelf(pid=8641): Terminated: ok {rc=0} 22:35:34.975709 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8638): Process ended prematurely: osmo-stp_10.42.42.5(pid=8638) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8638)] [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 22:35:34.984506 tst ping.py:22: Test FAILED (6.7 sec) 22:35:35.011186 run osmo-hlr_10.42.42.2(pid=8635): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8635)] 22:35:35.058541 run osmo-hlr_10.42.42.2(pid=8635): stdout: | (launched: 2022-12-13_22:35:31.708512) 22:35:35.107602 run osmo-hlr_10.42.42.2(pid=8635): stderr: | 20221213223531952 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223531952 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223531952 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223531952 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223531952 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223531952 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223531969 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223531992 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223531992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223531992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:35.157175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8634): Terminating (SIGTERM) 22:35:35.196490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8637): Terminating (SIGTERM) 22:35:35.235870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8640): Terminating (SIGTERM) 22:35:35.275446 --- ParallelTerminationStrategy: PID 8634 died... 22:35:35.294812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8634): Terminated: ok {rc=0} 22:35:35.338756 --- ParallelTerminationStrategy: PID 8637 died... 22:35:35.357530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8637): Terminated: ok {rc=0} 22:35:35.401248 --- ParallelTerminationStrategy: PID 8640 died... 22:35:35.419720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8640): Terminated: ok {rc=0} 22:35:35.504283 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:35:36.588103 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:36.599542 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:35:36.674333 tst ping_idle_ping.py: using LAC 36690 22:35:36.790315 tst ping_idle_ping.py: using RAC 225 22:35:36.904711 tst ping_idle_ping.py: using CellId 36690 22:35:37.029059 tst ping_idle_ping.py: using BVCI 36691 22:35:37.136685 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:37.147762 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:37.158561 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:37.169439 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:37.180183 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:37.190999 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:37.201853 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:35:37.212680 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:35:37.330689 tst ping_idle_ping.py:24: start network... 22:35:37.544493 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:38.037405 run create_hlr_db(pid=8642): Launched 22:35:38.159465 bus /gobi_6: Setting Powered False 22:35:39.222796 run create_hlr_db(pid=8642): Terminated: ok {rc=0} 22:35:39.666765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8644): Launched 22:35:39.984923 run osmo-hlr_10.42.42.2(pid=8645): Launched 22:35:40.107020 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:40.654698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8647): Launched 22:35:40.970804 run osmo-stp_10.42.42.5(pid=8648): Launched 22:35:41.092271 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:35:41.638819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8650): Launched 22:35:41.760068 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:35:42.028549 run patchelf(pid=8651): Launched 22:35:42.205802 run osmo-stp_10.42.42.5(pid=8648): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8648)] 22:35:42.340647 run osmo-stp_10.42.42.5(pid=8648): stdout: | (launched: 2022-12-13_22:35:40.913113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:42.477246 run osmo-stp_10.42.42.5(pid=8648): stderr: | 20221213223541103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223541103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223541103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223541104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223541104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223541104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223541105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:42.613635 run osmo-stp_10.42.42.5(pid=8648): stdout: | (launched: 2022-12-13_22:35:40.913113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:42.744606 run osmo-stp_10.42.42.5(pid=8648): stderr: | 20221213223541103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223541103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223541103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223541104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223541104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223541104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223541105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:42.899525 run patchelf(pid=8651): Terminating (SIGINT) 22:35:43.077101 run patchelf(pid=8651): Terminated: ok {rc=0} 22:35:43.205542 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8648): Process ended prematurely: osmo-stp_10.42.42.5(pid=8648) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8648)] [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:35:43.215087 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:35:43.243120 run osmo-hlr_10.42.42.2(pid=8645): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8645)] 22:35:43.294145 run osmo-hlr_10.42.42.2(pid=8645): stdout: | (launched: 2022-12-13_22:35:39.926387) 22:35:43.346306 run osmo-hlr_10.42.42.2(pid=8645): stderr: | 20221213223540123 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223540123 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223540123 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223540123 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223540123 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223540123 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223540139 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223540149 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223540149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223540149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:43.398792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8644): Terminating (SIGTERM) 22:35:43.440918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8647): Terminating (SIGTERM) 22:35:43.483417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8650): Terminating (SIGTERM) 22:35:43.526497 --- ParallelTerminationStrategy: PID 8644 died... 22:35:43.547162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8644): Terminated: ok {rc=0} 22:35:43.594027 --- ParallelTerminationStrategy: PID 8647 died... 22:35:43.614032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8647): Terminated: ok {rc=0} 22:35:43.660447 --- ParallelTerminationStrategy: PID 8650 died... 22:35:43.680434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8650): Terminated: ok {rc=0} 22:35:43.769689 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:35:45.069337 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:35:45.076875 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:35:45.111141 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:35:45.150955 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:35:45.240514 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:35:45.274144 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:35:45.313467 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:35:45.935652 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:35:45.988786 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:46.000709 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:35:46.086057 tst cs_paging_gprs_active.py: using LAC 36691 22:35:46.215756 tst cs_paging_gprs_active.py: using RAC 226 22:35:46.378615 tst cs_paging_gprs_active.py: using CellId 36691 22:35:46.499873 tst cs_paging_gprs_active.py: using BVCI 36692 22:35:46.647097 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:46.658985 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:46.671132 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:46.682840 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:46.695496 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:46.708225 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:46.720887 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:46.733577 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:46.747094 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:35:46.885624 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:35:47.033312 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:35:47.258428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:47.585437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8655): Launched 22:35:47.865351 run iperf3-srv_10.42.42.10(pid=8656): Launched 22:35:47.986228 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:35:48.204450 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:35:48.526952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8657): Launched 22:35:48.806182 run iperf3-srv_10.42.42.10(pid=8658): Launched 22:35:48.927011 tst cs_paging_gprs_active.py:38: start network... 22:35:49.144367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:49.643417 run create_hlr_db(pid=8659): Launched 22:35:49.767130 bus /gobi_6: Setting Powered False 22:35:50.831878 run create_hlr_db(pid=8659): Terminated: ok {rc=0} 22:35:51.261239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8661): Launched 22:35:51.561971 run osmo-hlr_10.42.42.2(pid=8662): Launched 22:35:51.677737 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:52.223130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8667): Launched 22:35:52.546372 run osmo-stp_10.42.42.5(pid=8668): Launched 22:35:52.670739 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:35:53.227983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8670): Launched 22:35:53.351609 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:35:53.623706 run patchelf(pid=8671): Launched 22:35:53.804329 run osmo-stp_10.42.42.5(pid=8668): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8668)] 22:35:53.940813 run osmo-stp_10.42.42.5(pid=8668): stdout: | (launched: 2022-12-13_22:35:52.488014) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:54.079115 run osmo-stp_10.42.42.5(pid=8668): stderr: | 20221213223552680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223552680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223552681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223552681 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223552682 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223552682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223552682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:54.217884 run osmo-stp_10.42.42.5(pid=8668): stdout: | (launched: 2022-12-13_22:35:52.488014) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:54.349963 run osmo-stp_10.42.42.5(pid=8668): stderr: | 20221213223552680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223552680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223552681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223552681 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223552682 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223552682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223552682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:54.506891 run patchelf(pid=8671): Terminating (SIGINT) 22:35:54.687427 run patchelf(pid=8671): Terminated: ok {rc=0} 22:35:54.817698 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8668): Process ended prematurely: osmo-stp_10.42.42.5(pid=8668) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8668)] [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:35:54.827772 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 22:35:54.856128 run osmo-hlr_10.42.42.2(pid=8662): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8662)] 22:35:54.906383 run osmo-hlr_10.42.42.2(pid=8662): stdout: | (launched: 2022-12-13_22:35:51.506329) 22:35:54.957990 run osmo-hlr_10.42.42.2(pid=8662): stderr: | 20221213223551683 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223551683 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223551683 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223551683 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223551683 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223551683 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223551695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223551704 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223551704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223551704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:55.009689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8655): Terminating (SIGTERM) 22:35:55.051328 run iperf3-srv_10.42.42.10(pid=8656): Terminating (SIGTERM) 22:35:55.092716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8657): Terminating (SIGTERM) 22:35:55.134646 run iperf3-srv_10.42.42.10(pid=8658): Terminating (SIGTERM) 22:35:55.177285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8661): Terminating (SIGTERM) 22:35:55.219295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8667): Terminating (SIGTERM) 22:35:55.261435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8670): Terminating (SIGTERM) 22:35:55.303253 --- ParallelTerminationStrategy: PID 8655 died... 22:35:55.323472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8655): Terminated: ok {rc=0} 22:35:55.369605 --- ParallelTerminationStrategy: PID 8656 died... 22:35:55.389353 run iperf3-srv_10.42.42.10(pid=8656): Terminated {rc=256} 22:35:55.434829 --- ParallelTerminationStrategy: PID 8657 died... 22:35:55.454521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8657): Terminated: ok {rc=0} 22:35:55.500383 --- ParallelTerminationStrategy: PID 8658 died... 22:35:55.519984 run iperf3-srv_10.42.42.10(pid=8658): Terminated {rc=256} 22:35:55.565535 --- ParallelTerminationStrategy: PID 8661 died... 22:35:55.585181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8661): Terminated: ok {rc=0} 22:35:55.631037 --- ParallelTerminationStrategy: PID 8667 died... 22:35:55.650906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8667): Terminated: ok {rc=0} 22:35:55.696732 --- ParallelTerminationStrategy: PID 8670 died... 22:35:55.716396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8670): Terminated: ok {rc=0} 22:35:55.803531 bus /gobi_0: Setting Powered False 22:35:56.901410 bus /gobi_0: Setting Powered False 22:35:58.016105 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:35:59.157722 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.169162 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:35:59.239824 tst iperf3.py: using LAC 36692 22:35:59.359682 tst iperf3.py: using RAC 227 22:35:59.477034 tst iperf3.py: using CellId 36692 22:35:59.595224 tst iperf3.py: using BVCI 36693 22:35:59.704700 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.715555 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.726132 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.736647 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.747156 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.757744 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.768393 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.779572 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:35:59.790437 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:35:59.903768 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:36:00.106124 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:36:00.407602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8672): Launched 22:36:00.671358 run iperf3-srv_10.42.42.10(pid=8673): Launched 22:36:00.784053 tst iperf3.py:8: start network... 22:36:01.024102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:01.549241 run create_hlr_db(pid=8674): Launched 22:36:01.714874 bus /gobi_6: Setting Powered False 22:36:02.775921 run create_hlr_db(pid=8674): Terminated: ok {rc=0} 22:36:03.198015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8676): Launched 22:36:03.498642 run osmo-hlr_10.42.42.2(pid=8677): Launched 22:36:03.612874 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:04.147640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8679): Launched 22:36:04.447462 run osmo-stp_10.42.42.5(pid=8680): Launched 22:36:04.561737 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:36:05.080132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8682): Launched 22:36:05.195559 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:36:05.450353 run patchelf(pid=8683): Launched 22:36:05.618692 run osmo-stp_10.42.42.5(pid=8680): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8680)] 22:36:05.746496 run osmo-stp_10.42.42.5(pid=8680): stdout: | (launched: 2022-12-13_22:36:04.392759) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:05.875511 run osmo-stp_10.42.42.5(pid=8680): stderr: | 20221213223604565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223604565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223604566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223604566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223604566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223604566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223604567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:06.004393 run osmo-stp_10.42.42.5(pid=8680): stdout: | (launched: 2022-12-13_22:36:04.392759) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:06.127929 run osmo-stp_10.42.42.5(pid=8680): stderr: | 20221213223604565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223604565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223604566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223604566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223604566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223604566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223604567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:06.274034 run patchelf(pid=8683): Terminating (SIGINT) 22:36:06.442549 run patchelf(pid=8683): Terminated: ok {rc=0} 22:36:06.563902 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8680): Process ended prematurely: osmo-stp_10.42.42.5(pid=8680) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8680)] [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 22:36:06.573222 tst iperf3.py:8: Test FAILED (7.5 sec) 22:36:06.600420 run osmo-hlr_10.42.42.2(pid=8677): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8677)] 22:36:06.647944 run osmo-hlr_10.42.42.2(pid=8677): stdout: | (launched: 2022-12-13_22:36:03.443809) 22:36:06.697085 run osmo-hlr_10.42.42.2(pid=8677): stderr: | 20221213223603623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223603623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223603623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223603623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223603623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223603623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223603637 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223603647 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223603647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223603647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:06.746476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8672): Terminating (SIGTERM) 22:36:06.786173 run iperf3-srv_10.42.42.10(pid=8673): Terminating (SIGTERM) 22:36:06.825754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8676): Terminating (SIGTERM) 22:36:06.865243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8679): Terminating (SIGTERM) 22:36:06.904856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8682): Terminating (SIGTERM) 22:36:06.944564 --- ParallelTerminationStrategy: PID 8672 died... 22:36:06.963786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8672): Terminated: ok {rc=0} 22:36:07.007461 --- ParallelTerminationStrategy: PID 8673 died... 22:36:07.026153 run iperf3-srv_10.42.42.10(pid=8673): Terminated {rc=256} 22:36:07.069639 --- ParallelTerminationStrategy: PID 8676 died... 22:36:07.088367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8676): Terminated: ok {rc=0} 22:36:07.132049 --- ParallelTerminationStrategy: PID 8679 died... 22:36:07.150930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8679): Terminated: ok {rc=0} 22:36:07.194770 --- ParallelTerminationStrategy: PID 8682 died... 22:36:07.213554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8682): Terminated: ok {rc=0} 22:36:07.296494 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:36:08.446734 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:08.458694 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:36:08.532069 tst iperf3m4.py: using LAC 36693 22:36:08.658264 tst iperf3m4.py: using RAC 228 22:36:08.785718 tst iperf3m4.py: using CellId 36693 22:36:08.912930 tst iperf3m4.py: using BVCI 36694 22:36:09.029888 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:09.041154 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:09.052224 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:09.063300 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:09.074700 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:09.086098 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:09.097696 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:09.108917 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:09.120638 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:09.238356 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:09.359054 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:09.476268 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:09.592421 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:36:09.794971 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:36:10.096590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8684): Launched 22:36:10.359526 run iperf3-srv_10.42.42.10(pid=8685): Launched 22:36:10.472202 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:36:10.673203 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:36:10.974516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8686): Launched 22:36:11.236863 run iperf3-srv_10.42.42.10(pid=8687): Launched 22:36:11.349659 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:36:11.550491 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:36:11.852531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8688): Launched 22:36:12.114838 run iperf3-srv_10.42.42.10(pid=8689): Launched 22:36:12.227520 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:36:12.427603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:36:12.729611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8690): Launched 22:36:12.991338 run iperf3-srv_10.42.42.10(pid=8691): Launched 22:36:13.103958 tst iperf3m4.py:8: start network... 22:36:13.304082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:13.770276 run create_hlr_db(pid=8692): Launched 22:36:13.894445 bus /gobi_6: Setting Powered False 22:36:14.954897 run create_hlr_db(pid=8692): Terminated: ok {rc=0} 22:36:15.399278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8699): Launched 22:36:15.721445 run osmo-hlr_10.42.42.2(pid=8700): Launched 22:36:15.866588 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:16.591554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8702): Launched 22:36:16.911759 run osmo-stp_10.42.42.5(pid=8703): Launched 22:36:17.149973 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:36:17.722970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8705): Launched 22:36:17.838761 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:36:18.092185 run patchelf(pid=8706): Launched 22:36:18.259211 run osmo-stp_10.42.42.5(pid=8703): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8703)] 22:36:18.386626 run osmo-stp_10.42.42.5(pid=8703): stdout: | (launched: 2022-12-13_22:36:16.843653) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:18.514807 run osmo-stp_10.42.42.5(pid=8703): stderr: | 20221213223617176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223617176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223617176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223617176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223617185 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223617185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223617185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:18.643273 run osmo-stp_10.42.42.5(pid=8703): stdout: | (launched: 2022-12-13_22:36:16.843653) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:18.766014 run osmo-stp_10.42.42.5(pid=8703): stderr: | 20221213223617176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223617176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223617176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223617176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223617185 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223617185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223617185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:18.911256 run patchelf(pid=8706): Terminating (SIGINT) 22:36:19.079351 run patchelf(pid=8706): Terminated: ok {rc=0} 22:36:19.200697 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8703): Process ended prematurely: osmo-stp_10.42.42.5(pid=8703) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8703)] [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:36:19.210139 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:36:19.237666 run osmo-hlr_10.42.42.2(pid=8700): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8700)] 22:36:19.285335 run osmo-hlr_10.42.42.2(pid=8700): stdout: | (launched: 2022-12-13_22:36:15.663179) 22:36:19.334578 run osmo-hlr_10.42.42.2(pid=8700): stderr: | 20221213223615909 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223615909 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223615909 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223615909 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223615909 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223615909 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223615931 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223615950 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223615951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223615951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:19.384486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8684): Terminating (SIGTERM) 22:36:19.423863 run iperf3-srv_10.42.42.10(pid=8685): Terminating (SIGTERM) 22:36:19.463130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8686): Terminating (SIGTERM) 22:36:19.502548 run iperf3-srv_10.42.42.10(pid=8687): Terminating (SIGTERM) 22:36:19.541888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8688): Terminating (SIGTERM) 22:36:19.581418 run iperf3-srv_10.42.42.10(pid=8689): Terminating (SIGTERM) 22:36:19.620696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8690): Terminating (SIGTERM) 22:36:19.660133 run iperf3-srv_10.42.42.10(pid=8691): Terminating (SIGTERM) 22:36:19.699387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8699): Terminating (SIGTERM) 22:36:19.738912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8702): Terminating (SIGTERM) 22:36:19.778328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8705): Terminating (SIGTERM) 22:36:19.818826 --- ParallelTerminationStrategy: PID 8684 died... 22:36:19.838052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8684): Terminated: ok {rc=0} 22:36:19.881723 --- ParallelTerminationStrategy: PID 8685 died... 22:36:19.900052 run iperf3-srv_10.42.42.10(pid=8685): Terminated {rc=256} 22:36:19.943568 --- ParallelTerminationStrategy: PID 8686 died... 22:36:19.962121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8686): Terminated: ok {rc=0} 22:36:20.005508 --- ParallelTerminationStrategy: PID 8687 died... 22:36:20.023810 run iperf3-srv_10.42.42.10(pid=8687): Terminated {rc=256} 22:36:20.067348 --- ParallelTerminationStrategy: PID 8688 died... 22:36:20.085865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8688): Terminated: ok {rc=0} 22:36:20.129360 --- ParallelTerminationStrategy: PID 8689 died... 22:36:20.147874 run iperf3-srv_10.42.42.10(pid=8689): Terminated {rc=256} 22:36:20.191351 --- ParallelTerminationStrategy: PID 8690 died... 22:36:20.210072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8690): Terminated: ok {rc=0} 22:36:20.253771 --- ParallelTerminationStrategy: PID 8691 died... 22:36:20.272374 run iperf3-srv_10.42.42.10(pid=8691): Terminated {rc=256} 22:36:20.315811 --- ParallelTerminationStrategy: PID 8699 died... 22:36:20.334456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8699): Terminated: ok {rc=0} 22:36:20.378136 --- ParallelTerminationStrategy: PID 8702 died... 22:36:20.396814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8702): Terminated: ok {rc=0} 22:36:20.440504 --- ParallelTerminationStrategy: PID 8705 died... 22:36:20.459287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8705): Terminated: ok {rc=0} 22:36:20.544731 bus /gobi_4: Setting Powered False 22:36:21.647536 bus /gobi_4: Setting Powered False 22:36:22.766837 bus /gobi_1: Setting Powered False 22:36:23.865200 bus /gobi_1: Setting Powered False 22:36:24.980196 bus /gobi_0: Setting Powered False 22:36:26.079607 bus /gobi_0: Setting Powered False 22:36:27.193717 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:36:28.293884 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:28.305459 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:36:28.376018 tst ping.py: using LAC 36694 22:36:28.492351 tst ping.py: using RAC 229 22:36:28.610033 tst ping.py: using CellId 36694 22:36:28.734612 tst ping.py: using BVCI 36695 22:36:28.849161 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:28.860570 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:28.871764 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:28.882843 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:28.894216 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:28.905681 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:28.917247 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:28.928423 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:29.043458 tst ping.py:19: start network... 22:36:29.241138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:29.698022 run create_hlr_db(pid=8707): Launched 22:36:29.819226 bus /gobi_6: Setting Powered False 22:36:30.886746 run create_hlr_db(pid=8707): Terminated: ok {rc=0} 22:36:31.363359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8709): Launched 22:36:31.705111 run osmo-hlr_10.42.42.2(pid=8710): Launched 22:36:31.989932 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:32.561706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8712): Launched 22:36:32.856434 run osmo-stp_10.42.42.5(pid=8713): Launched 22:36:32.968487 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:36:33.479564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8715): Launched 22:36:33.592877 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:36:33.842334 run patchelf(pid=8716): Launched 22:36:34.007556 run osmo-stp_10.42.42.5(pid=8713): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8713)] 22:36:34.132604 run osmo-stp_10.42.42.5(pid=8713): stdout: | (launched: 2022-12-13_22:36:32.801922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:34.259212 run osmo-stp_10.42.42.5(pid=8713): stderr: | 20221213223632972 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223632973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223632973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223632973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223632974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223632974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223632974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:34.386115 run osmo-stp_10.42.42.5(pid=8713): stdout: | (launched: 2022-12-13_22:36:32.801922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:34.507376 run osmo-stp_10.42.42.5(pid=8713): stderr: | 20221213223632972 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223632973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223632973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223632973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223632974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223632974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223632974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:34.650666 run patchelf(pid=8716): Terminating (SIGINT) 22:36:34.816508 run patchelf(pid=8716): Terminated: ok {rc=0} 22:36:34.936053 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8713): Process ended prematurely: osmo-stp_10.42.42.5(pid=8713) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8713)] [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 22:36:34.944834 tst ping.py:22: Test FAILED (6.6 sec) 22:36:34.971678 run osmo-hlr_10.42.42.2(pid=8710): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8710)] 22:36:35.019305 run osmo-hlr_10.42.42.2(pid=8710): stdout: | (launched: 2022-12-13_22:36:31.637574) 22:36:35.068621 run osmo-hlr_10.42.42.2(pid=8710): stderr: | 20221213223631861 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223631861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223631861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223631861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223631861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223631861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223631883 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223631891 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223631891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223631891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:35.118374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8709): Terminating (SIGTERM) 22:36:35.158106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8712): Terminating (SIGTERM) 22:36:35.197637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8715): Terminating (SIGTERM) 22:36:35.237629 --- ParallelTerminationStrategy: PID 8709 died... 22:36:35.256898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8709): Terminated: ok {rc=0} 22:36:35.300779 --- ParallelTerminationStrategy: PID 8712 died... 22:36:35.319577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8712): Terminated: ok {rc=0} 22:36:35.363412 --- ParallelTerminationStrategy: PID 8715 died... 22:36:35.382101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8715): Terminated: ok {rc=0} 22:36:35.467990 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:36:36.556299 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:36.567738 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:36:36.639003 tst ping_idle_ping.py: using LAC 36695 22:36:36.755729 tst ping_idle_ping.py: using RAC 230 22:36:36.872866 tst ping_idle_ping.py: using CellId 36695 22:36:36.998152 tst ping_idle_ping.py: using BVCI 36696 22:36:37.113611 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:37.124884 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:37.136047 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:37.147208 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:37.159022 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:37.171051 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:37.183392 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:36:37.195321 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:36:37.312732 tst ping_idle_ping.py:24: start network... 22:36:37.509590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:37.970835 run create_hlr_db(pid=8717): Launched 22:36:38.094395 bus /gobi_6: Setting Powered False 22:36:39.154717 run create_hlr_db(pid=8717): Terminated: ok {rc=0} 22:36:39.590052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8719): Launched 22:36:39.906711 run osmo-hlr_10.42.42.2(pid=8720): Launched 22:36:40.029684 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:40.574930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8722): Launched 22:36:40.892133 run osmo-stp_10.42.42.5(pid=8723): Launched 22:36:41.013462 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:36:41.561243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8725): Launched 22:36:41.682044 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:36:41.948877 run patchelf(pid=8726): Launched 22:36:42.125204 run osmo-stp_10.42.42.5(pid=8723): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8723)] 22:36:42.259734 run osmo-stp_10.42.42.5(pid=8723): stdout: | (launched: 2022-12-13_22:36:40.834062) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:42.395684 run osmo-stp_10.42.42.5(pid=8723): stderr: | 20221213223641024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223641024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223641024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223641025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223641025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223641025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223641025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:42.531500 run osmo-stp_10.42.42.5(pid=8723): stdout: | (launched: 2022-12-13_22:36:40.834062) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:42.661539 run osmo-stp_10.42.42.5(pid=8723): stderr: | 20221213223641024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223641024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223641024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223641025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223641025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223641025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223641025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:42.815378 run patchelf(pid=8726): Terminating (SIGINT) 22:36:42.992548 run patchelf(pid=8726): Terminated: ok {rc=0} 22:36:43.120408 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8723): Process ended prematurely: osmo-stp_10.42.42.5(pid=8723) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8723)] [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:36:43.129864 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:36:43.157925 run osmo-hlr_10.42.42.2(pid=8720): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8720)] 22:36:43.209483 run osmo-hlr_10.42.42.2(pid=8720): stdout: | (launched: 2022-12-13_22:36:39.848926) 22:36:43.262028 run osmo-hlr_10.42.42.2(pid=8720): stderr: | 20221213223640045 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223640045 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223640045 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223640046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223640046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223640046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223640061 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223640069 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223640069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223640069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:43.314723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8719): Terminating (SIGTERM) 22:36:43.356333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8722): Terminating (SIGTERM) 22:36:43.398385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8725): Terminating (SIGTERM) 22:36:43.441299 --- ParallelTerminationStrategy: PID 8719 died... 22:36:43.461683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8719): Terminated: ok {rc=0} 22:36:43.508350 --- ParallelTerminationStrategy: PID 8722 died... 22:36:43.528397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8722): Terminated: ok {rc=0} 22:36:43.574558 --- ParallelTerminationStrategy: PID 8725 died... 22:36:43.594402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8725): Terminated: ok {rc=0} 22:36:43.681966 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:36:44.984120 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:36:44.992750 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:36:45.027026 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:36:45.062378 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:36:45.116907 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:36:45.150044 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:36:45.184937 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:36:45.740127 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2395 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:36:45.745530 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:45.756672 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:36:45.827008 tst switch_tch_pdch.py: using LAC 36696 22:36:45.955102 tst switch_tch_pdch.py: using RAC 231 22:36:46.075143 tst switch_tch_pdch.py: using CellId 36696 22:36:46.236860 tst switch_tch_pdch.py: using BVCI 36697 22:36:46.357086 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:46.369631 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:46.382278 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:46.394694 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:46.407884 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:46.420880 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:46.434229 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:36:46.447472 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:36:46.576549 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:36:46.716656 tst switch_tch_pdch.py:51: start network... 22:36:46.972027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:47.466095 run create_hlr_db(pid=8730): Launched 22:36:47.588348 bus /gobi_6: Setting Powered False 22:36:48.651643 run create_hlr_db(pid=8730): Terminated: ok {rc=0} 22:36:49.094293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8732): Launched 22:36:49.410804 run osmo-hlr_10.42.42.2(pid=8733): Launched 22:36:49.532880 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:50.078368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8735): Launched 22:36:50.395236 run osmo-stp_10.42.42.5(pid=8736): Launched 22:36:50.517306 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:36:51.064922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8738): Launched 22:36:51.185896 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:36:51.452786 run patchelf(pid=8739): Launched 22:36:51.628781 run osmo-stp_10.42.42.5(pid=8736): ERR: Terminated: ERROR {rc=1} [trial-2395↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8736)] 22:36:51.762300 run osmo-stp_10.42.42.5(pid=8736): stdout: | (launched: 2022-12-13_22:36:50.337634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:51.897426 run osmo-stp_10.42.42.5(pid=8736): stderr: | 20221213223650527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223650527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223650527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223650527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223650528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223650528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223650528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:52.032683 run osmo-stp_10.42.42.5(pid=8736): stdout: | (launched: 2022-12-13_22:36:50.337634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:52.162886 run osmo-stp_10.42.42.5(pid=8736): stderr: | 20221213223650527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223650527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223650527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223650527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223650528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223650528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223650528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:52.316781 run patchelf(pid=8739): Terminating (SIGINT) 22:36:52.493531 run patchelf(pid=8739): Terminated: ok {rc=0} 22:36:52.620826 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8736): Process ended prematurely: osmo-stp_10.42.42.5(pid=8736) [trial-2395↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8736)] [trial-2395↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:36:52.630463 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 22:36:52.658478 run osmo-hlr_10.42.42.2(pid=8733): ERR: Terminated: ERROR {rc=237} [trial-2395↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8733)] 22:36:52.708899 run osmo-hlr_10.42.42.2(pid=8733): stdout: | (launched: 2022-12-13_22:36:49.353284) 22:36:52.760668 run osmo-hlr_10.42.42.2(pid=8733): stderr: | 20221213223649550 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223649550 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223649550 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223649550 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223649551 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223649551 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223649562 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223649570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223649571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223649571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:52.812721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8732): Terminating (SIGTERM) 22:36:52.854099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8735): Terminating (SIGTERM) 22:36:52.895934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8738): Terminating (SIGTERM) 22:36:52.938331 --- ParallelTerminationStrategy: PID 8732 died... 22:36:52.958494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8732): Terminated: ok {rc=0} 22:36:53.004621 --- ParallelTerminationStrategy: PID 8735 died... 22:36:53.024387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8735): Terminated: ok {rc=0} 22:36:53.070461 --- ParallelTerminationStrategy: PID 8738 died... 22:36:53.090194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8738): Terminated: ok {rc=0} 22:36:53.177154 bus /gobi_0: Setting Powered False 22:36:54.275482 bus /gobi_0: Setting Powered False 22:36:55.390240 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:36:56.640191 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:36:56.645829 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:36:56.677885 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:36:56.711730 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:36:56.762939 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:36:56.795388 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:36:56.829389 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:36:57.385816 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2395 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:36:57.390942 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:57.401839 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:36:57.470663 tst switch_tch_pdch.py: using LAC 36697 22:36:57.587577 tst switch_tch_pdch.py: using RAC 232 22:36:57.702730 tst switch_tch_pdch.py: using CellId 36697 22:36:57.820456 tst switch_tch_pdch.py: using BVCI 36698 22:36:57.926919 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:57.937780 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:57.948292 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:57.958952 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:57.969521 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:57.980075 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:57.990776 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:36:58.001336 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:36:58.120343 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:36:58.236528 tst switch_tch_pdch.py:51: start network... 22:36:58.433324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:58.862198 run create_hlr_db(pid=8743): Launched 22:36:58.983621 bus /gobi_6: Setting Powered False 22:37:00.042851 run create_hlr_db(pid=8743): Terminated: ok {rc=0} 22:37:00.449383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8745): Launched 22:37:00.766305 run osmo-hlr_10.42.42.2(pid=8746): Launched 22:37:00.933945 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:01.641849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8748): Launched 22:37:02.050099 run osmo-stp_10.42.42.5(pid=8749): Launched 22:37:02.178632 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:37:02.782418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8751): Launched 22:37:02.894814 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:37:03.143768 run patchelf(pid=8752): Launched 22:37:03.308041 run osmo-stp_10.42.42.5(pid=8749): ERR: Terminated: ERROR {rc=1} [trial-2395↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8749)] 22:37:03.432234 run osmo-stp_10.42.42.5(pid=8749): stdout: | (launched: 2022-12-13_22:37:01.976474) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:03.558471 run osmo-stp_10.42.42.5(pid=8749): stderr: | 20221213223702423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223702423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223702423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223702423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223702424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223702424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223702424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:03.684528 run osmo-stp_10.42.42.5(pid=8749): stdout: | (launched: 2022-12-13_22:37:01.976474) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:03.805327 run osmo-stp_10.42.42.5(pid=8749): stderr: | 20221213223702423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223702423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223702423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223702423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223702424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223702424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223702424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:03.948051 run patchelf(pid=8752): Terminating (SIGINT) 22:37:04.114357 run patchelf(pid=8752): Terminated: ok {rc=0} 22:37:04.234663 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8749): Process ended prematurely: osmo-stp_10.42.42.5(pid=8749) [trial-2395↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8749)] [trial-2395↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:37:04.243430 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 22:37:04.269933 run osmo-hlr_10.42.42.2(pid=8746): ERR: Terminated: ERROR {rc=237} [trial-2395↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8746)] 22:37:04.317291 run osmo-hlr_10.42.42.2(pid=8746): stdout: | (launched: 2022-12-13_22:37:00.708867) 22:37:04.366248 run osmo-hlr_10.42.42.2(pid=8746): stderr: | 20221213223700979 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223700979 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223700979 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223700979 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223700979 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223700979 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223700994 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223701007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223701008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223701008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:04.415499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8745): Terminating (SIGTERM) 22:37:04.454902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8748): Terminating (SIGTERM) 22:37:04.494433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8751): Terminating (SIGTERM) 22:37:04.534296 --- ParallelTerminationStrategy: PID 8745 died... 22:37:04.553258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8745): Terminated: ok {rc=0} 22:37:04.597337 --- ParallelTerminationStrategy: PID 8748 died... 22:37:04.615892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8748): Terminated: ok {rc=0} 22:37:04.659852 --- ParallelTerminationStrategy: PID 8751 died... 22:37:04.678449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8751): Terminated: ok {rc=0} 22:37:04.763900 bus /gobi_0: Setting Powered False 22:37:05.864299 bus /gobi_0: Setting Powered False 22:37:06.980323 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 22:37:08.230153 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:08.235086 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:37:08.265245 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 22:37:08.273418 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 22:37:08.327428 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:37:08.356778 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 22:37:08.363436 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 22:37:08.902738 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 22:37:08.908112 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 22:37:08.919591 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:37:08.964901 tst mo_mt_sms.py: using LAC 36698 22:37:09.082311 tst mo_mt_sms.py: using RAC 233 22:37:09.201178 tst mo_mt_sms.py: using CellId 36698 22:37:09.321429 tst mo_mt_sms.py: using BVCI 36699 22:37:09.429675 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 22:37:09.548398 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 22:37:09.663319 tst mo_mt_sms.py:9: start nitb and bts... 22:37:09.862207 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:37:10.466563 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8756): Launched 22:37:10.761452 run osmo-nitb_10.42.42.2(pid=8757): Launched 22:37:10.925753 run osmo-nitb_10.42.42.2(pid=8757): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8757)] 22:37:11.057959 run osmo-nitb_10.42.42.2(pid=8757): stdout: | (launched: 2022-12-13_22:37:10.707011) 22:37:11.191444 run osmo-nitb_10.42.42.2(pid=8757): stderr: | (launched: 2022-12-13_22:37:10.750933) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:37:11.325221 run osmo-nitb_10.42.42.2(pid=8757): stdout: | (launched: 2022-12-13_22:37:10.707011) 22:37:11.453427 run osmo-nitb_10.42.42.2(pid=8757): stderr: | (launched: 2022-12-13_22:37:10.750933) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8757): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8757) [trial-2395↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8757)] 22:37:11.873817 tst osmo-nitb_10.42.42.2(pid=8757): stdout: | (launched: 2022-12-13_22:37:10.707011) 22:37:11.992215 tst osmo-nitb_10.42.42.2(pid=8757): stderr: | (launched: 2022-12-13_22:37:10.750933) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:37:12.132803 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=8757): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8757) [trial-2395↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8757)] [trial-2395↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 22:37:12.141620 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 22:37:12.148338 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8756): Terminating (SIGTERM) 22:37:12.356678 --- ParallelTerminationStrategy: PID 8756 died... 22:37:12.377600 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8756): Terminated: ok {rc=0} 22:37:12.463909 bus /sierra_3: Setting Powered False 22:37:13.563706 bus /sierra_3: Setting Powered False 22:37:14.678691 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 22:37:15.903684 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:15.908334 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:37:15.938779 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 22:37:15.969366 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 22:37:16.031815 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:37:16.061947 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 22:37:16.093232 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 22:37:16.639294 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 22:37:16.648008 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:16.664547 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:37:16.720805 tst mo_mt_sms.py: using LAC 36699 22:37:16.874203 tst mo_mt_sms.py: using RAC 234 22:37:17.000441 tst mo_mt_sms.py: using CellId 36699 22:37:17.152027 tst mo_mt_sms.py: using BVCI 36700 22:37:17.272075 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:17.283954 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:17.295905 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:17.307502 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:17.319966 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:17.333062 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 22:37:17.450011 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 22:37:17.565710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:18.022317 run create_hlr_db(pid=8761): Launched 22:37:18.142834 bus /sierra_2: Setting Powered False 22:37:19.202895 run create_hlr_db(pid=8761): Terminated: ok {rc=0} 22:37:19.636597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8763): Launched 22:37:19.952731 run osmo-hlr_10.42.42.2(pid=8764): Launched 22:37:20.073795 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:20.618183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8766): Launched 22:37:20.934368 run osmo-stp_10.42.42.5(pid=8767): Launched 22:37:21.054968 run osmo-msc_10.42.42.6: Starting osmo-msc 22:37:21.631050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8769): Launched 22:37:21.948508 run osmo-msc_10.42.42.6(pid=8770): Launched 22:37:22.126450 run osmo-stp_10.42.42.5(pid=8767): ERR: Terminated: ERROR {rc=1} [trial-2395↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8767)] 22:37:22.261357 run osmo-stp_10.42.42.5(pid=8767): stdout: | (launched: 2022-12-13_22:37:20.876534) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:22.397580 run osmo-stp_10.42.42.5(pid=8767): stderr: | 20221213223721068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223721068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223721068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223721068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223721069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223721069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223721069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:22.531619 run osmo-stp_10.42.42.5(pid=8767): stdout: | (launched: 2022-12-13_22:37:20.876534) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:22.658309 run osmo-stp_10.42.42.5(pid=8767): stderr: | 20221213223721068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223721068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223721068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223721068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223721069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223721069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223721069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:22.809755 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=8767): Process ended prematurely: osmo-stp_10.42.42.5(pid=8767) [trial-2395↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8767)] [trial-2395↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 22:37:22.818695 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 22:37:22.846027 run osmo-hlr_10.42.42.2(pid=8764): ERR: Terminated: ERROR {rc=237} [trial-2395↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8764)] 22:37:22.896128 run osmo-hlr_10.42.42.2(pid=8764): stdout: | (launched: 2022-12-13_22:37:19.895233) 22:37:22.947720 run osmo-hlr_10.42.42.2(pid=8764): stderr: | 20221213223720091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223720091 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223720091 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223720091 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223720091 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223720092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223720109 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223720119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223720119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223720119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:23.020017 run osmo-msc_10.42.42.6(pid=8770): ERR: Terminated: ERROR {rc=2} [trial-2395↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8770)] 22:37:23.069497 run osmo-msc_10.42.42.6(pid=8770): stdout: | (launched: 2022-12-13_22:37:21.890528) 22:37:23.121504 run osmo-msc_10.42.42.6(pid=8770): stderr: | 20221213223722210 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223722210 DLGLOBAL DEBUG validating counter group 0x7f9343826c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223722210 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223722210 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223722210 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223722211 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223722212 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223722213 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223722213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223722213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:37:23.173493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8763): Terminating (SIGTERM) 22:37:23.215486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8766): Terminating (SIGTERM) 22:37:23.257932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8769): Terminating (SIGTERM) 22:37:23.300086 --- ParallelTerminationStrategy: PID 8763 died... 22:37:23.320456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8763): Terminated: ok {rc=0} 22:37:23.366720 --- ParallelTerminationStrategy: PID 8766 died... 22:37:23.386532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8766): Terminated: ok {rc=0} 22:37:23.432515 --- ParallelTerminationStrategy: PID 8769 died... 22:37:23.452451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8769): Terminated: ok {rc=0} 22:37:23.540024 bus /sierra_3: Setting Powered False 22:37:24.638940 bus /sierra_3: Setting Powered False 22:37:25.754869 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 22:37:26.979868 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:26.983866 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:37:27.012478 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 22:37:27.019340 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 22:37:27.058726 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:37:27.089495 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 22:37:27.096125 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 22:37:27.612153 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2395 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 22:37:27.618059 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 22:37:27.629042 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:37:27.673462 tst assert_extension.py: using LAC 36700 22:37:27.788786 tst assert_extension.py: using RAC 235 22:37:27.903605 tst assert_extension.py: using CellId 36700 22:37:28.018233 tst assert_extension.py: using BVCI 36701 22:37:28.125603 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 22:37:28.246079 tst assert_extension.py:10: start nitb and bts... 22:37:28.460212 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:37:29.108003 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8776): Launched 22:37:29.425092 run osmo-nitb_10.42.42.2(pid=8777): Launched 22:37:29.600890 run osmo-nitb_10.42.42.2(pid=8777): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8777)] 22:37:29.742747 run osmo-nitb_10.42.42.2(pid=8777): stdout: | (launched: 2022-12-13_22:37:29.367591) 22:37:29.887041 run osmo-nitb_10.42.42.2(pid=8777): stderr: | (launched: 2022-12-13_22:37:29.414518) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:37:30.030671 run osmo-nitb_10.42.42.2(pid=8777): stdout: | (launched: 2022-12-13_22:37:29.367591) 22:37:30.168649 run osmo-nitb_10.42.42.2(pid=8777): stderr: | (launched: 2022-12-13_22:37:29.414518) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8777): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8777) [trial-2395↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8777)] 22:37:30.545238 tst osmo-nitb_10.42.42.2(pid=8777): stdout: | (launched: 2022-12-13_22:37:29.367591) 22:37:30.672562 tst osmo-nitb_10.42.42.2(pid=8777): stderr: | (launched: 2022-12-13_22:37:29.414518) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:37:30.823196 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=8777): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8777) [trial-2395↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8777)] [trial-2395↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 22:37:30.832656 tst assert_extension.py:12: Test FAILED (3.2 sec) 22:37:30.840480 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8776): Terminating (SIGTERM) 22:37:31.053257 --- ParallelTerminationStrategy: PID 8776 died... 22:37:31.077185 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8776): Terminated: ok {rc=0} 22:37:31.185139 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 22:37:32.361258 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:32.365608 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:37:32.395397 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 22:37:32.423554 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 22:37:32.459481 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:37:32.489507 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 22:37:32.516999 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 22:37:33.046821 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2395 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 22:37:33.052304 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:33.063664 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:37:33.109552 tst assert_extension.py: using LAC 36701 22:37:33.232613 tst assert_extension.py: using RAC 236 22:37:33.356035 tst assert_extension.py: using CellId 36701 22:37:33.473847 tst assert_extension.py: using BVCI 36702 22:37:33.579758 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:33.590511 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:33.601039 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:33.611824 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:33.622327 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:37:33.632754 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 22:37:33.751011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:34.243193 run create_hlr_db(pid=8781): Launched 22:37:34.365534 bus /sierra_2: Setting Powered False 22:37:35.429527 run create_hlr_db(pid=8781): Terminated: ok {rc=0} 22:37:35.854088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8783): Launched 22:37:36.150483 run osmo-hlr_10.42.42.2(pid=8784): Launched 22:37:36.263117 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:36.775312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8786): Launched 22:37:37.070417 run osmo-stp_10.42.42.5(pid=8787): Launched 22:37:37.183421 run osmo-msc_10.42.42.6: Starting osmo-msc 22:37:37.716870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8789): Launched 22:37:38.011868 run osmo-msc_10.42.42.6(pid=8790): Launched 22:37:38.178470 run osmo-stp_10.42.42.5(pid=8787): ERR: Terminated: ERROR {rc=1} [trial-2395↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8787)] 22:37:38.310710 run osmo-stp_10.42.42.5(pid=8787): stdout: | (launched: 2022-12-13_22:37:37.015927) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:38.448760 run osmo-stp_10.42.42.5(pid=8787): stderr: | 20221213223737185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223737186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223737186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223737186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223737187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223737187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223737187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:38.581444 run osmo-stp_10.42.42.5(pid=8787): stdout: | (launched: 2022-12-13_22:37:37.015927) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:38.708231 run osmo-stp_10.42.42.5(pid=8787): stderr: | 20221213223737185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223737186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223737186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223737186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223737187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223737187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223737187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:38.858944 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=8787): Process ended prematurely: osmo-stp_10.42.42.5(pid=8787) [trial-2395↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8787)] [trial-2395↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 22:37:38.867968 tst assert_extension.py:17: Test FAILED (5.8 sec) 22:37:38.896245 run osmo-hlr_10.42.42.2(pid=8784): ERR: Terminated: ERROR {rc=237} [trial-2395↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8784)] 22:37:38.948186 run osmo-hlr_10.42.42.2(pid=8784): stdout: | (launched: 2022-12-13_22:37:36.095627) 22:37:39.001278 run osmo-hlr_10.42.42.2(pid=8784): stderr: | 20221213223736271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223736271 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223736271 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223736272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223736272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223736272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223736283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223736292 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223736292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223736292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:39.074528 run osmo-msc_10.42.42.6(pid=8790): ERR: Terminated: ERROR {rc=2} [trial-2395↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8790)] 22:37:39.124696 run osmo-msc_10.42.42.6(pid=8790): stdout: | (launched: 2022-12-13_22:37:37.957686) 22:37:39.176753 run osmo-msc_10.42.42.6(pid=8790): stderr: | 20221213223738229 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223738229 DLGLOBAL DEBUG validating counter group 0x7fb41424fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223738230 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223738230 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223738230 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223738230 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223738232 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223738232 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223738232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223738232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:37:39.229765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8783): Terminating (SIGTERM) 22:37:39.271430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8786): Terminating (SIGTERM) 22:37:39.313681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8789): Terminating (SIGTERM) 22:37:39.356231 --- ParallelTerminationStrategy: PID 8783 died... 22:37:39.376765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8783): Terminated: ok {rc=0} 22:37:39.423312 --- ParallelTerminationStrategy: PID 8786 died... 22:37:39.443468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8786): Terminated: ok {rc=0} 22:37:39.489634 --- ParallelTerminationStrategy: PID 8789 died... 22:37:39.509696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8789): Terminated: ok {rc=0} 22:37:39.598311 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:37:40.811115 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:40.818152 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:37:40.847667 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:37:40.876089 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:37:40.933836 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:37:40.963496 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:37:40.990318 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:37:41.543249 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:37:41.594030 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:41.605412 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:37:41.675130 tst mo_mt_call.py: using LAC 36702 22:37:41.793529 tst mo_mt_call.py: using RAC 237 22:37:41.912325 tst mo_mt_call.py: using CellId 36702 22:37:42.028486 tst mo_mt_call.py: using BVCI 36703 22:37:42.136599 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:42.147845 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:42.158905 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:42.169935 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:42.181019 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:42.192046 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:37:42.312892 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:37:42.433733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:42.933674 run create_hlr_db(pid=8795): Launched 22:37:43.057268 bus /sierra_2: Setting Powered False 22:37:44.121682 run create_hlr_db(pid=8795): Terminated: ok {rc=0} 22:37:44.571077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8797): Launched 22:37:44.893136 run osmo-hlr_10.42.42.2(pid=8798): Launched 22:37:45.017524 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:45.574168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8800): Launched 22:37:45.917693 run osmo-stp_10.42.42.5(pid=8801): Launched 22:37:46.085850 run osmo-msc_10.42.42.6: Starting osmo-msc 22:37:46.905073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8803): Launched 22:37:47.223337 run osmo-msc_10.42.42.6(pid=8804): Launched 22:37:47.517651 run osmo-stp_10.42.42.5(pid=8801): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8801)] 22:37:47.655111 run osmo-stp_10.42.42.5(pid=8801): stdout: | (launched: 2022-12-13_22:37:45.839445) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:47.793150 run osmo-stp_10.42.42.5(pid=8801): stderr: | 20221213223746190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223746190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223746191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223746192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223746193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223746193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223746194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:47.929811 run osmo-stp_10.42.42.5(pid=8801): stdout: | (launched: 2022-12-13_22:37:45.839445) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:48.058715 run osmo-stp_10.42.42.5(pid=8801): stderr: | 20221213223746190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223746190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223746191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223746192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223746193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223746193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223746194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:48.213126 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8801): Process ended prematurely: osmo-stp_10.42.42.5(pid=8801) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8801)] [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:37:48.223254 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 22:37:48.251385 run osmo-hlr_10.42.42.2(pid=8798): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8798)] 22:37:48.301956 run osmo-hlr_10.42.42.2(pid=8798): stdout: | (launched: 2022-12-13_22:37:44.835020) 22:37:48.353989 run osmo-hlr_10.42.42.2(pid=8798): stderr: | 20221213223745034 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223745034 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223745034 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223745034 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223745034 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223745034 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223745045 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223745054 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223745054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223745054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:48.426989 run osmo-msc_10.42.42.6(pid=8804): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8804)] 22:37:48.476796 run osmo-msc_10.42.42.6(pid=8804): stdout: | (launched: 2022-12-13_22:37:47.158970) 22:37:48.528842 run osmo-msc_10.42.42.6(pid=8804): stderr: | 20221213223747586 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223747586 DLGLOBAL DEBUG validating counter group 0x7fbe6f525c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223747586 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223747586 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223747586 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223747586 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223747588 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223747588 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223747589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223747589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:37:48.581079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8797): Terminating (SIGTERM) 22:37:48.623044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8800): Terminating (SIGTERM) 22:37:48.665724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8803): Terminating (SIGTERM) 22:37:48.708174 --- ParallelTerminationStrategy: PID 8797 died... 22:37:48.728539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8797): Terminated: ok {rc=0} 22:37:48.775310 --- ParallelTerminationStrategy: PID 8800 died... 22:37:48.795082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8800): Terminated: ok {rc=0} 22:37:48.841809 --- ParallelTerminationStrategy: PID 8803 died... 22:37:48.861880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8803): Terminated: ok {rc=0} 22:37:48.950407 bus /sierra_3: Setting Powered False 22:37:50.048473 bus /sierra_3: Setting Powered False 22:37:51.163417 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:37:52.314560 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:52.326784 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:37:52.395352 tst mo_mt_call_osmux.py: using LAC 36703 22:37:52.523055 tst mo_mt_call_osmux.py: using RAC 238 22:37:52.650799 tst mo_mt_call_osmux.py: using CellId 36703 22:37:52.775987 tst mo_mt_call_osmux.py: using BVCI 36704 22:37:52.892466 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:52.904208 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:52.915694 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:52.927216 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:52.939134 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:37:52.950983 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:37:53.070802 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:37:53.186971 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:53.654378 run create_hlr_db(pid=8806): Launched 22:37:53.778191 bus /sierra_2: Setting Powered False 22:37:54.842300 run create_hlr_db(pid=8806): Terminated: ok {rc=0} 22:37:55.292623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8808): Launched 22:37:55.614279 run osmo-hlr_10.42.42.2(pid=8809): Launched 22:37:55.737234 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:56.294759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8811): Launched 22:37:56.617319 run osmo-stp_10.42.42.5(pid=8812): Launched 22:37:56.741112 run osmo-msc_10.42.42.6: Starting osmo-msc 22:37:57.328857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8814): Launched 22:37:57.651157 run osmo-msc_10.42.42.6(pid=8815): Launched 22:37:57.831843 run osmo-stp_10.42.42.5(pid=8812): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8812)] 22:37:57.968142 run osmo-stp_10.42.42.5(pid=8812): stdout: | (launched: 2022-12-13_22:37:56.558369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:58.105204 run osmo-stp_10.42.42.5(pid=8812): stderr: | 20221213223756751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223756751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223756751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223756752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223756752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223756752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223756752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:58.241501 run osmo-stp_10.42.42.5(pid=8812): stdout: | (launched: 2022-12-13_22:37:56.558369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:58.370542 run osmo-stp_10.42.42.5(pid=8812): stderr: | 20221213223756751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223756751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223756751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223756752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223756752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223756752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223756752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:58.524914 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8812): Process ended prematurely: osmo-stp_10.42.42.5(pid=8812) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8812)] [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:37:58.534495 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:37:58.562423 run osmo-hlr_10.42.42.2(pid=8809): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8809)] 22:37:58.613623 run osmo-hlr_10.42.42.2(pid=8809): stdout: | (launched: 2022-12-13_22:37:55.555923) 22:37:58.665743 run osmo-hlr_10.42.42.2(pid=8809): stderr: | 20221213223755754 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223755754 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223755754 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223755754 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223755755 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223755755 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223755767 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223755778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223755778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223755778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:58.738551 run osmo-msc_10.42.42.6(pid=8815): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8815)] 22:37:58.788317 run osmo-msc_10.42.42.6(pid=8815): stdout: | (launched: 2022-12-13_22:37:57.592428) 22:37:58.840179 run osmo-msc_10.42.42.6(pid=8815): stderr: | 20221213223757912 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223757912 DLGLOBAL DEBUG validating counter group 0x7f9b84faac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223757912 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223757912 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223757912 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223757912 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223757914 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223757915 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223757915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223757915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:37:58.892418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8808): Terminating (SIGTERM) 22:37:58.934569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8811): Terminating (SIGTERM) 22:37:58.977122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8814): Terminating (SIGTERM) 22:37:59.019607 --- ParallelTerminationStrategy: PID 8808 died... 22:37:59.040084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8808): Terminated: ok {rc=0} 22:37:59.086725 --- ParallelTerminationStrategy: PID 8811 died... 22:37:59.106749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8811): Terminated: ok {rc=0} 22:37:59.153256 --- ParallelTerminationStrategy: PID 8814 died... 22:37:59.173209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8814): Terminated: ok {rc=0} 22:37:59.261190 bus /sierra_3: Setting Powered False 22:38:00.358395 bus /sierra_3: Setting Powered False 22:38:01.472686 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:38:02.739771 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:38:02.746791 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:38:02.776612 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:38:02.805488 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:38:02.859855 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:38:02.890794 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:38:02.918322 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:38:03.470847 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:38:03.523709 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:03.535493 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:38:03.601534 tst mo_mt_call.py: using LAC 36704 22:38:03.725561 tst mo_mt_call.py: using RAC 239 22:38:03.842985 tst mo_mt_call.py: using CellId 36704 22:38:03.961022 tst mo_mt_call.py: using BVCI 36705 22:38:04.069628 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:04.080681 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:04.091610 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:04.102776 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:04.114029 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:04.124891 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:38:04.245913 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:38:04.366985 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:04.868324 run create_hlr_db(pid=8821): Launched 22:38:04.991776 bus /sierra_2: Setting Powered False 22:38:06.056485 run create_hlr_db(pid=8821): Terminated: ok {rc=0} 22:38:06.487673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8823): Launched 22:38:06.789909 run osmo-hlr_10.42.42.2(pid=8824): Launched 22:38:06.904540 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:07.420314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8826): Launched 22:38:07.721501 run osmo-stp_10.42.42.5(pid=8827): Launched 22:38:07.836624 run osmo-msc_10.42.42.6: Starting osmo-msc 22:38:08.379789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8829): Launched 22:38:08.681848 run osmo-msc_10.42.42.6(pid=8830): Launched 22:38:08.850220 run osmo-stp_10.42.42.5(pid=8827): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8827)] 22:38:08.978194 run osmo-stp_10.42.42.5(pid=8827): stdout: | (launched: 2022-12-13_22:38:07.666619) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:09.105283 run osmo-stp_10.42.42.5(pid=8827): stderr: | 20221213223807839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223807839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223807840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223807840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223807841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223807841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223807841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:09.230203 run osmo-stp_10.42.42.5(pid=8827): stdout: | (launched: 2022-12-13_22:38:07.666619) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:09.349622 run osmo-stp_10.42.42.5(pid=8827): stderr: | 20221213223807839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223807839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223807840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223807840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223807841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223807841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223807841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:09.492473 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8827): Process ended prematurely: osmo-stp_10.42.42.5(pid=8827) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8827)] [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:38:09.501281 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:38:09.527587 run osmo-hlr_10.42.42.2(pid=8824): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8824)] 22:38:09.574674 run osmo-hlr_10.42.42.2(pid=8824): stdout: | (launched: 2022-12-13_22:38:06.735110) 22:38:09.623303 run osmo-hlr_10.42.42.2(pid=8824): stderr: | 20221213223806910 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223806910 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223806910 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223806910 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223806910 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223806911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223806923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223806933 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223806934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223806934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:09.691890 run osmo-msc_10.42.42.6(pid=8830): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8830)] 22:38:09.738709 run osmo-msc_10.42.42.6(pid=8830): stdout: | (launched: 2022-12-13_22:38:08.626168) 22:38:09.787249 run osmo-msc_10.42.42.6(pid=8830): stderr: | 20221213223808898 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223808899 DLGLOBAL DEBUG validating counter group 0x7fbd00acfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223808899 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223808899 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223808899 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223808899 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223808901 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223808901 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223808902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223808902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:38:09.836745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8823): Terminating (SIGTERM) 22:38:09.875888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8826): Terminating (SIGTERM) 22:38:09.914882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8829): Terminating (SIGTERM) 22:38:09.954268 --- ParallelTerminationStrategy: PID 8823 died... 22:38:09.973217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8823): Terminated: ok {rc=0} 22:38:10.016468 --- ParallelTerminationStrategy: PID 8826 died... 22:38:10.034898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8826): Terminated: ok {rc=0} 22:38:10.078028 --- ParallelTerminationStrategy: PID 8829 died... 22:38:10.096690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8829): Terminated: ok {rc=0} 22:38:10.181260 bus /sierra_3: Setting Powered False 22:38:11.281765 bus /sierra_3: Setting Powered False 22:38:12.397556 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:38:13.540230 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:13.553368 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:38:13.617700 tst mo_mt_call_osmux.py: using LAC 36705 22:38:13.741459 tst mo_mt_call_osmux.py: using RAC 240 22:38:13.859673 tst mo_mt_call_osmux.py: using CellId 36705 22:38:13.975808 tst mo_mt_call_osmux.py: using BVCI 36706 22:38:14.084083 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:14.095538 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:14.106582 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:14.117595 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:14.128641 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:38:14.139686 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:38:14.260592 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:38:14.381922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:14.883048 run create_hlr_db(pid=8832): Launched 22:38:15.006546 bus /sierra_2: Setting Powered False 22:38:16.075437 run create_hlr_db(pid=8832): Terminated: ok {rc=0} 22:38:16.513531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8834): Launched 22:38:16.845971 run osmo-hlr_10.42.42.2(pid=8835): Launched 22:38:17.085750 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:17.654970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8837): Launched 22:38:17.956352 run osmo-stp_10.42.42.5(pid=8838): Launched 22:38:18.071314 run osmo-msc_10.42.42.6: Starting osmo-msc 22:38:18.617573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8840): Launched 22:38:18.918722 run osmo-msc_10.42.42.6(pid=8841): Launched 22:38:19.086865 run osmo-stp_10.42.42.5(pid=8838): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8838)] 22:38:19.213642 run osmo-stp_10.42.42.5(pid=8838): stdout: | (launched: 2022-12-13_22:38:17.901167) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:19.340811 run osmo-stp_10.42.42.5(pid=8838): stderr: | 20221213223818070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223818071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223818071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223818071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223818072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223818072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223818072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:19.466235 run osmo-stp_10.42.42.5(pid=8838): stdout: | (launched: 2022-12-13_22:38:17.901167) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:19.585935 run osmo-stp_10.42.42.5(pid=8838): stderr: | 20221213223818070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223818071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223818071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223818071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223818072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223818072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223818072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:19.729479 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8838): Process ended prematurely: osmo-stp_10.42.42.5(pid=8838) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8838)] [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:38:19.738286 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:38:19.765057 run osmo-hlr_10.42.42.2(pid=8835): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8835)] 22:38:19.813278 run osmo-hlr_10.42.42.2(pid=8835): stdout: | (launched: 2022-12-13_22:38:16.779746) 22:38:19.862624 run osmo-hlr_10.42.42.2(pid=8835): stderr: | 20221213223817124 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223817124 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223817124 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223817124 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223817125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223817125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223817145 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223817164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223817164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223817174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:19.931743 run osmo-msc_10.42.42.6(pid=8841): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8841)] 22:38:19.979333 run osmo-msc_10.42.42.6(pid=8841): stdout: | (launched: 2022-12-13_22:38:18.863746) 22:38:20.028554 run osmo-msc_10.42.42.6(pid=8841): stderr: | 20221213223819136 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223819136 DLGLOBAL DEBUG validating counter group 0x7f9a1a4d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223819136 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223819136 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223819136 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223819137 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223819138 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223819139 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223819139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223819139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:38:20.078196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8834): Terminating (SIGTERM) 22:38:20.117964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8837): Terminating (SIGTERM) 22:38:20.157570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8840): Terminating (SIGTERM) 22:38:20.197570 --- ParallelTerminationStrategy: PID 8834 died... 22:38:20.216439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8834): Terminated: ok {rc=0} 22:38:20.260555 --- ParallelTerminationStrategy: PID 8837 died... 22:38:20.279385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8837): Terminated: ok {rc=0} 22:38:20.323338 --- ParallelTerminationStrategy: PID 8840 died... 22:38:20.342259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8840): Terminated: ok {rc=0} 22:38:20.428228 bus /sierra_3: Setting Powered False 22:38:21.528000 bus /sierra_3: Setting Powered False 22:38:22.646027 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:38:23.894684 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:38:23.902890 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:38:23.932691 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:38:23.961250 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:38:24.014115 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:38:24.044211 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:38:24.071685 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:38:24.625483 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:38:24.677512 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:24.689126 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:38:24.754888 tst mo_mt_call.py: using LAC 36706 22:38:24.881452 tst mo_mt_call.py: using RAC 241 22:38:24.999656 tst mo_mt_call.py: using CellId 36706 22:38:25.116631 tst mo_mt_call.py: using BVCI 36707 22:38:25.225097 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:25.236192 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:25.247173 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:25.258297 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:25.269519 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:25.280452 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:38:25.395944 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:38:25.515640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:26.017371 run create_hlr_db(pid=8846): Launched 22:38:26.142376 bus /sierra_2: Setting Powered False 22:38:27.207548 run create_hlr_db(pid=8846): Terminated: ok {rc=0} 22:38:27.639430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8848): Launched 22:38:27.939719 run osmo-hlr_10.42.42.2(pid=8849): Launched 22:38:28.054880 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:28.573366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8851): Launched 22:38:28.874631 run osmo-stp_10.42.42.5(pid=8852): Launched 22:38:28.989944 run osmo-msc_10.42.42.6: Starting osmo-msc 22:38:29.538044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8854): Launched 22:38:29.839137 run osmo-msc_10.42.42.6(pid=8855): Launched 22:38:30.007493 run osmo-stp_10.42.42.5(pid=8852): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8852)] 22:38:30.134245 run osmo-stp_10.42.42.5(pid=8852): stdout: | (launched: 2022-12-13_22:38:28.819010) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:30.261454 run osmo-stp_10.42.42.5(pid=8852): stderr: | 20221213223828992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223828992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223828992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223828993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223828993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223828993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223828993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:30.386906 run osmo-stp_10.42.42.5(pid=8852): stdout: | (launched: 2022-12-13_22:38:28.819010) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:30.506613 run osmo-stp_10.42.42.5(pid=8852): stderr: | 20221213223828992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223828992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223828992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223828993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223828993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223828993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223828993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:30.650890 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8852): Process ended prematurely: osmo-stp_10.42.42.5(pid=8852) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8852)] [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:38:30.659597 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:38:30.686346 run osmo-hlr_10.42.42.2(pid=8849): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8849)] 22:38:30.733916 run osmo-hlr_10.42.42.2(pid=8849): stdout: | (launched: 2022-12-13_22:38:27.885101) 22:38:30.782948 run osmo-hlr_10.42.42.2(pid=8849): stderr: | 20221213223828062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223828062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223828062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223828062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223828062 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223828063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223828075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223828084 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223828084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223828084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:30.852999 run osmo-msc_10.42.42.6(pid=8855): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8855)] 22:38:30.907028 run osmo-msc_10.42.42.6(pid=8855): stdout: | (launched: 2022-12-13_22:38:29.784066) 22:38:30.957254 run osmo-msc_10.42.42.6(pid=8855): stderr: | 20221213223830055 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223830056 DLGLOBAL DEBUG validating counter group 0x7fa849301c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223830056 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223830056 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223830056 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223830056 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223830058 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223830058 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223830058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223830059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:38:31.007462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8848): Terminating (SIGTERM) 22:38:31.048294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8851): Terminating (SIGTERM) 22:38:31.091512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8854): Terminating (SIGTERM) 22:38:31.132900 --- ParallelTerminationStrategy: PID 8848 died... 22:38:31.153429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8848): Terminated: ok {rc=0} 22:38:31.198131 --- ParallelTerminationStrategy: PID 8851 died... 22:38:31.217531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8851): Terminated: ok {rc=0} 22:38:31.262321 --- ParallelTerminationStrategy: PID 8854 died... 22:38:31.281677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8854): Terminated: ok {rc=0} 22:38:31.365357 bus /sierra_3: Setting Powered False 22:38:32.461279 bus /sierra_3: Setting Powered False 22:38:33.576149 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:38:34.721970 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:34.733902 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:38:34.798988 tst mo_mt_call_osmux.py: using LAC 36707 22:38:34.916720 tst mo_mt_call_osmux.py: using RAC 242 22:38:35.033048 tst mo_mt_call_osmux.py: using CellId 36707 22:38:35.149216 tst mo_mt_call_osmux.py: using BVCI 36708 22:38:35.257662 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:35.268803 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:35.279968 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:35.291016 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:35.302183 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:38:35.313235 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:38:35.433595 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:38:35.553819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:36.018694 run create_hlr_db(pid=8857): Launched 22:38:36.141786 bus /sierra_2: Setting Powered False 22:38:37.201971 run create_hlr_db(pid=8857): Terminated: ok {rc=0} 22:38:37.642916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8859): Launched 22:38:37.965505 run osmo-hlr_10.42.42.2(pid=8860): Launched 22:38:38.089483 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:38.646854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8862): Launched 22:38:38.970095 run osmo-stp_10.42.42.5(pid=8863): Launched 22:38:39.094636 run osmo-msc_10.42.42.6: Starting osmo-msc 22:38:39.680889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8865): Launched 22:38:40.003609 run osmo-msc_10.42.42.6(pid=8866): Launched 22:38:40.183652 run osmo-stp_10.42.42.5(pid=8863): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8863)] 22:38:40.320205 run osmo-stp_10.42.42.5(pid=8863): stdout: | (launched: 2022-12-13_22:38:38.911465) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:40.456921 run osmo-stp_10.42.42.5(pid=8863): stderr: | 20221213223839104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223839104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223839104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223839104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223839105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223839105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223839105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:40.592559 run osmo-stp_10.42.42.5(pid=8863): stdout: | (launched: 2022-12-13_22:38:38.911465) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:40.721811 run osmo-stp_10.42.42.5(pid=8863): stderr: | 20221213223839104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223839104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223839104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223839104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223839105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223839105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223839105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:40.876021 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8863): Process ended prematurely: osmo-stp_10.42.42.5(pid=8863) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8863)] [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:38:40.885558 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:38:40.913395 run osmo-hlr_10.42.42.2(pid=8860): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8860)] 22:38:40.963927 run osmo-hlr_10.42.42.2(pid=8860): stdout: | (launched: 2022-12-13_22:38:37.906923) 22:38:41.016226 run osmo-hlr_10.42.42.2(pid=8860): stderr: | 20221213223838104 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223838104 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223838104 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223838104 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223838104 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223838104 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223838117 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223838125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223838125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223838125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:41.088050 run osmo-msc_10.42.42.6(pid=8866): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8866)] 22:38:41.137737 run osmo-msc_10.42.42.6(pid=8866): stdout: | (launched: 2022-12-13_22:38:39.944786) 22:38:41.189178 run osmo-msc_10.42.42.6(pid=8866): stderr: | 20221213223840266 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223840266 DLGLOBAL DEBUG validating counter group 0x7fef7eb84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223840266 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223840266 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223840266 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223840266 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223840268 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223840268 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223840269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223840269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:38:41.240842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8859): Terminating (SIGTERM) 22:38:41.282618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8862): Terminating (SIGTERM) 22:38:41.324103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8865): Terminating (SIGTERM) 22:38:41.367336 --- ParallelTerminationStrategy: PID 8859 died... 22:38:41.387672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8859): Terminated: ok {rc=0} 22:38:41.434426 --- ParallelTerminationStrategy: PID 8862 died... 22:38:41.454478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8862): Terminated: ok {rc=0} 22:38:41.500618 --- ParallelTerminationStrategy: PID 8865 died... 22:38:41.520658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8865): Terminated: ok {rc=0} 22:38:41.609186 bus /sierra_3: Setting Powered False 22:38:42.707346 bus /sierra_3: Setting Powered False 22:38:43.824618 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:38:45.072603 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:38:45.079565 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:38:45.109407 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:38:45.138061 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:38:45.191091 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:38:45.220885 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:38:45.248841 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:38:45.800636 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:38:45.867497 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:45.887998 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:38:45.959920 tst mo_mt_call.py: using LAC 36708 22:38:46.087431 tst mo_mt_call.py: using RAC 243 22:38:46.209707 tst mo_mt_call.py: using CellId 36708 22:38:46.363410 tst mo_mt_call.py: using BVCI 36709 22:38:46.510222 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:46.522589 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:46.534970 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:46.547159 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:46.560372 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:46.572559 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:38:46.720089 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:38:46.876157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:47.382197 run create_hlr_db(pid=8873): Launched 22:38:47.510203 bus /sierra_2: Setting Powered False 22:38:48.574399 run create_hlr_db(pid=8873): Terminated: ok {rc=0} 22:38:49.024719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8875): Launched 22:38:49.347377 run osmo-hlr_10.42.42.2(pid=8876): Launched 22:38:49.472618 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:50.028668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8878): Launched 22:38:50.351150 run osmo-stp_10.42.42.5(pid=8879): Launched 22:38:50.474706 run osmo-msc_10.42.42.6: Starting osmo-msc 22:38:51.057509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8881): Launched 22:38:51.381422 run osmo-msc_10.42.42.6(pid=8882): Launched 22:38:51.562744 run osmo-stp_10.42.42.5(pid=8879): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8879)] 22:38:51.699283 run osmo-stp_10.42.42.5(pid=8879): stdout: | (launched: 2022-12-13_22:38:50.292369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:51.836624 run osmo-stp_10.42.42.5(pid=8879): stderr: | 20221213223850485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223850485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223850485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223850486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223850486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223850486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223850486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:51.972575 run osmo-stp_10.42.42.5(pid=8879): stdout: | (launched: 2022-12-13_22:38:50.292369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:52.101599 run osmo-stp_10.42.42.5(pid=8879): stderr: | 20221213223850485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223850485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223850485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223850486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223850486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223850486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223850486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:52.255848 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8879): Process ended prematurely: osmo-stp_10.42.42.5(pid=8879) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8879)] [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:38:52.265825 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 22:38:52.293812 run osmo-hlr_10.42.42.2(pid=8876): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8876)] 22:38:52.344281 run osmo-hlr_10.42.42.2(pid=8876): stdout: | (launched: 2022-12-13_22:38:49.288548) 22:38:52.396613 run osmo-hlr_10.42.42.2(pid=8876): stderr: | 20221213223849489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223849489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223849489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223849489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223849489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223849489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223849502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223849510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223849510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223849510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:52.468849 run osmo-msc_10.42.42.6(pid=8882): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8882)] 22:38:52.518265 run osmo-msc_10.42.42.6(pid=8882): stdout: | (launched: 2022-12-13_22:38:51.321367) 22:38:52.569809 run osmo-msc_10.42.42.6(pid=8882): stderr: | 20221213223851644 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223851644 DLGLOBAL DEBUG validating counter group 0x7f7b18abec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223851644 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223851644 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223851644 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223851645 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223851646 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223851647 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223851647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223851647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:38:52.621404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8875): Terminating (SIGTERM) 22:38:52.663230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8878): Terminating (SIGTERM) 22:38:52.705063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8881): Terminating (SIGTERM) 22:38:52.747594 --- ParallelTerminationStrategy: PID 8875 died... 22:38:52.767571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8875): Terminated: ok {rc=0} 22:38:52.813905 --- ParallelTerminationStrategy: PID 8878 died... 22:38:52.833797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8878): Terminated: ok {rc=0} 22:38:52.879674 --- ParallelTerminationStrategy: PID 8881 died... 22:38:52.899433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8881): Terminated: ok {rc=0} 22:38:52.987305 bus /sierra_3: Setting Powered False 22:38:54.087012 bus /sierra_3: Setting Powered False 22:38:55.203280 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:38:56.347545 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:56.359452 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:38:56.425503 tst mo_mt_call_osmux.py: using LAC 36709 22:38:56.545036 tst mo_mt_call_osmux.py: using RAC 244 22:38:56.663910 tst mo_mt_call_osmux.py: using CellId 36709 22:38:56.784128 tst mo_mt_call_osmux.py: using BVCI 36710 22:38:56.892665 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:56.903932 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:56.914930 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:56.926026 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:56.937176 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:38:56.948033 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:38:57.066627 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:38:57.186452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:57.653245 run create_hlr_db(pid=8884): Launched 22:38:57.776441 bus /sierra_2: Setting Powered False 22:38:58.837459 run create_hlr_db(pid=8884): Terminated: ok {rc=0} 22:38:59.257975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8886): Launched 22:38:59.558464 run osmo-hlr_10.42.42.2(pid=8887): Launched 22:38:59.673086 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:00.188503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8889): Launched 22:39:00.489868 run osmo-stp_10.42.42.5(pid=8890): Launched 22:39:00.605205 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:01.224027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8895): Launched 22:39:01.693720 run osmo-msc_10.42.42.6(pid=8929): Launched 22:39:02.063334 run osmo-stp_10.42.42.5(pid=8890): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8890)] 22:39:02.320495 run osmo-stp_10.42.42.5(pid=8890): stdout: | (launched: 2022-12-13_22:39:00.434432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:02.492659 run osmo-stp_10.42.42.5(pid=8890): stderr: | 20221213223900607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223900607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223900607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223900607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223900608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223900608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223900608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:02.770272 run osmo-stp_10.42.42.5(pid=8890): stdout: | (launched: 2022-12-13_22:39:00.434432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:02.931074 run osmo-stp_10.42.42.5(pid=8890): stderr: | 20221213223900607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223900607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223900607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223900607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223900608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223900608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223900608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:03.110277 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8890): Process ended prematurely: osmo-stp_10.42.42.5(pid=8890) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8890)] [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:39:03.121417 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 22:39:03.160699 run osmo-hlr_10.42.42.2(pid=8887): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8887)] 22:39:03.226442 run osmo-hlr_10.42.42.2(pid=8887): stdout: | (launched: 2022-12-13_22:38:59.503244) 22:39:03.290890 run osmo-hlr_10.42.42.2(pid=8887): stderr: | 20221213223859683 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223859683 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223859683 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223859683 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223859683 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223859683 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223859693 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223859703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223859703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223859703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:03.377353 run osmo-msc_10.42.42.6(pid=8929): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8929)] 22:39:03.435330 run osmo-msc_10.42.42.6(pid=8929): stdout: | (launched: 2022-12-13_22:39:01.620468) 22:39:03.502969 run osmo-msc_10.42.42.6(pid=8929): stderr: | 20221213223902144 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223902145 DLGLOBAL DEBUG validating counter group 0x7f300a941c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223902145 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223902145 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223902145 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223902145 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223902147 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223902147 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223902147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223902147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:39:03.571891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8886): Terminating (SIGTERM) 22:39:03.628211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8889): Terminating (SIGTERM) 22:39:03.682974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8895): Terminating (SIGTERM) 22:39:03.739513 --- ParallelTerminationStrategy: PID 8886 died... 22:39:03.764847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8886): Terminated: ok {rc=0} 22:39:03.828183 --- ParallelTerminationStrategy: PID 8889 died... 22:39:03.851121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8889): Terminated: ok {rc=0} 22:39:03.912123 --- ParallelTerminationStrategy: PID 8895 died... 22:39:03.934884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8895): Terminated: ok {rc=0} 22:39:04.047699 bus /sierra_3: Setting Powered False 22:39:05.154870 bus /sierra_3: Setting Powered False 22:39:06.273596 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:39:07.526831 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:39:07.534572 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:39:07.565378 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:39:07.597649 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:39:07.650422 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:39:07.681071 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:39:07.710521 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:39:08.268221 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:39:08.323859 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:08.336660 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:39:08.406501 tst mo_mt_call.py: using LAC 36710 22:39:08.536239 tst mo_mt_call.py: using RAC 245 22:39:08.666323 tst mo_mt_call.py: using CellId 36710 22:39:08.795071 tst mo_mt_call.py: using BVCI 36711 22:39:08.915725 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:08.928272 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:08.940817 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:08.953548 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:08.967081 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:08.981668 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:39:09.109415 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:39:09.234807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:09.758854 run create_hlr_db(pid=9169): Launched 22:39:09.925942 bus /sierra_2: Setting Powered False 22:39:10.992782 run create_hlr_db(pid=9169): Terminated: ok {rc=0} 22:39:11.464748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9171): Launched 22:39:11.814775 run osmo-hlr_10.42.42.2(pid=9172): Launched 22:39:12.064621 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:12.746349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9174): Launched 22:39:13.093335 run osmo-stp_10.42.42.5(pid=9175): Launched 22:39:13.348852 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:14.026029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9177): Launched 22:39:14.376264 run osmo-msc_10.42.42.6(pid=9178): Launched 22:39:14.794977 run osmo-stp_10.42.42.5(pid=9175): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9175)] 22:39:15.073679 run osmo-stp_10.42.42.5(pid=9175): stdout: | (launched: 2022-12-13_22:39:13.029644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:15.247819 run osmo-stp_10.42.42.5(pid=9175): stderr: | 20221213223913334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223913334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223913334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223913335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223913335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223913335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223913335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:15.389622 run osmo-stp_10.42.42.5(pid=9175): stdout: | (launched: 2022-12-13_22:39:13.029644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:15.524194 run osmo-stp_10.42.42.5(pid=9175): stderr: | 20221213223913334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223913334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223913334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223913335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223913335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223913335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223913335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:15.685767 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9175): Process ended prematurely: osmo-stp_10.42.42.5(pid=9175) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9175)] [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:39:15.696339 tst mo_mt_call.py:8: Test FAILED (7.4 sec) 22:39:15.726066 run osmo-hlr_10.42.42.2(pid=9172): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9172)] 22:39:15.781646 run osmo-hlr_10.42.42.2(pid=9172): stdout: | (launched: 2022-12-13_22:39:11.750032) 22:39:15.841739 run osmo-hlr_10.42.42.2(pid=9172): stderr: | 20221213223912066 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223912067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223912067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223912067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223912067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223912067 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223912083 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223912091 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223912091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223912092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:15.926523 run osmo-msc_10.42.42.6(pid=9178): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9178)] 22:39:15.995401 run osmo-msc_10.42.42.6(pid=9178): stdout: | (launched: 2022-12-13_22:39:14.310827) 22:39:16.049612 run osmo-msc_10.42.42.6(pid=9178): stderr: | 20221213223914863 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223914863 DLGLOBAL DEBUG validating counter group 0x7fde79e04c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223914863 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223914863 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223914864 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223914864 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223914867 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223914868 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223914868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223914868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:39:16.104838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9171): Terminating (SIGTERM) 22:39:16.149248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9174): Terminating (SIGTERM) 22:39:16.204887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9177): Terminating (SIGTERM) 22:39:16.276412 --- ParallelTerminationStrategy: PID 9171 died... 22:39:16.310286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9171): Terminated: ok {rc=0} 22:39:16.393174 --- ParallelTerminationStrategy: PID 9174 died... 22:39:16.418428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9174): Terminated: ok {rc=0} 22:39:16.476905 --- ParallelTerminationStrategy: PID 9177 died... 22:39:16.502559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9177): Terminated: ok {rc=0} 22:39:16.612497 bus /sierra_3: Setting Powered False 22:39:17.742772 bus /sierra_3: Setting Powered False 22:39:18.862533 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:39:20.022198 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:20.035487 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:39:20.110838 tst mo_mt_call_osmux.py: using LAC 36711 22:39:20.242157 tst mo_mt_call_osmux.py: using RAC 246 22:39:20.371487 tst mo_mt_call_osmux.py: using CellId 36711 22:39:20.502325 tst mo_mt_call_osmux.py: using BVCI 36712 22:39:20.626106 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:20.639104 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:20.652529 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:20.665677 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:20.679591 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:39:20.693676 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:39:20.822827 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:39:20.951714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:21.455588 run create_hlr_db(pid=9180): Launched 22:39:21.611647 bus /sierra_2: Setting Powered False 22:39:22.672357 run create_hlr_db(pid=9180): Terminated: ok {rc=0} 22:39:23.113946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9182): Launched 22:39:23.454784 run osmo-hlr_10.42.42.2(pid=9183): Launched 22:39:23.709882 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:24.433697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9185): Launched 22:39:24.764614 run osmo-stp_10.42.42.5(pid=9187): Launched 22:39:24.888304 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:25.474912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9189): Launched 22:39:25.797730 run osmo-msc_10.42.42.6(pid=9190): Launched 22:39:25.978209 run osmo-stp_10.42.42.5(pid=9187): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9187)] 22:39:26.114681 run osmo-stp_10.42.42.5(pid=9187): stdout: | (launched: 2022-12-13_22:39:24.705833) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:26.251731 run osmo-stp_10.42.42.5(pid=9187): stderr: | 20221213223924900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223924900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223924901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223924901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223924902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223924902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223924902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:26.388710 run osmo-stp_10.42.42.5(pid=9187): stdout: | (launched: 2022-12-13_22:39:24.705833) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:26.517862 run osmo-stp_10.42.42.5(pid=9187): stderr: | 20221213223924900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223924900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223924901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223924901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223924902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223924902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223924902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:26.671838 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9187): Process ended prematurely: osmo-stp_10.42.42.5(pid=9187) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9187)] [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:39:26.681608 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 22:39:26.709614 run osmo-hlr_10.42.42.2(pid=9183): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9183)] 22:39:26.760130 run osmo-hlr_10.42.42.2(pid=9183): stdout: | (launched: 2022-12-13_22:39:23.383720) 22:39:26.812048 run osmo-hlr_10.42.42.2(pid=9183): stderr: | 20221213223923741 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223923741 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223923741 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223923741 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223923741 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223923741 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223923757 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223923768 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223923768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223923768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:26.884205 run osmo-msc_10.42.42.6(pid=9190): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9190)] 22:39:26.933801 run osmo-msc_10.42.42.6(pid=9190): stdout: | (launched: 2022-12-13_22:39:25.739277) 22:39:26.985505 run osmo-msc_10.42.42.6(pid=9190): stderr: | 20221213223926059 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223926059 DLGLOBAL DEBUG validating counter group 0x7f6b46494c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223926059 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223926059 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223926060 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223926060 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223926063 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223926064 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223926064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223926064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:39:27.037159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9182): Terminating (SIGTERM) 22:39:27.078797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9185): Terminating (SIGTERM) 22:39:27.121184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9189): Terminating (SIGTERM) 22:39:27.163614 --- ParallelTerminationStrategy: PID 9182 died... 22:39:27.184128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9182): Terminated: ok {rc=0} 22:39:27.230721 --- ParallelTerminationStrategy: PID 9185 died... 22:39:27.250707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9185): Terminated: ok {rc=0} 22:39:27.297205 --- ParallelTerminationStrategy: PID 9189 died... 22:39:27.317381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9189): Terminated: ok {rc=0} 22:39:27.404411 bus /sierra_3: Setting Powered False 22:39:28.503267 bus /sierra_3: Setting Powered False 22:39:29.619358 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:39:30.879576 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:39:30.886920 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:39:30.921308 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:39:30.950875 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:39:31.023488 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:39:31.053667 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:39:31.082378 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:39:31.655465 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:39:31.731266 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:31.748042 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:39:31.831971 tst mo_mt_call.py: using LAC 36712 22:39:31.961481 tst mo_mt_call.py: using RAC 247 22:39:32.094244 tst mo_mt_call.py: using CellId 36712 22:39:32.258188 tst mo_mt_call.py: using BVCI 36713 22:39:32.378884 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:32.390867 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:32.402649 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:32.414539 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:32.427000 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:32.439125 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:39:32.556389 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:39:32.671402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:33.173240 run create_hlr_db(pid=9195): Launched 22:39:33.297272 bus /sierra_2: Setting Powered False 22:39:34.362573 run create_hlr_db(pid=9195): Terminated: ok {rc=0} 22:39:34.812422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9197): Launched 22:39:35.135469 run osmo-hlr_10.42.42.2(pid=9198): Launched 22:39:35.259222 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:35.818771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9200): Launched 22:39:36.141647 run osmo-stp_10.42.42.5(pid=9201): Launched 22:39:36.265092 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:36.849453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9203): Launched 22:39:37.172845 run osmo-msc_10.42.42.6(pid=9204): Launched 22:39:37.354255 run osmo-stp_10.42.42.5(pid=9201): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9201)] 22:39:37.490881 run osmo-stp_10.42.42.5(pid=9201): stdout: | (launched: 2022-12-13_22:39:36.082874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:37.627707 run osmo-stp_10.42.42.5(pid=9201): stderr: | 20221213223936274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223936274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223936274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223936274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223936277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223936277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223936277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:37.763763 run osmo-stp_10.42.42.5(pid=9201): stdout: | (launched: 2022-12-13_22:39:36.082874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:37.893126 run osmo-stp_10.42.42.5(pid=9201): stderr: | 20221213223936274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223936274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223936274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223936274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223936277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223936277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223936277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:38.047857 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9201): Process ended prematurely: osmo-stp_10.42.42.5(pid=9201) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9201)] [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:39:38.057732 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:39:38.085483 run osmo-hlr_10.42.42.2(pid=9198): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9198)] 22:39:38.136411 run osmo-hlr_10.42.42.2(pid=9198): stdout: | (launched: 2022-12-13_22:39:35.076704) 22:39:38.188291 run osmo-hlr_10.42.42.2(pid=9198): stderr: | 20221213223935275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223935275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223935275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223935275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223935276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223935276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223935288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223935297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223935297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223935297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:38.261008 run osmo-msc_10.42.42.6(pid=9204): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9204)] 22:39:38.310839 run osmo-msc_10.42.42.6(pid=9204): stdout: | (launched: 2022-12-13_22:39:37.114001) 22:39:38.362389 run osmo-msc_10.42.42.6(pid=9204): stderr: | 20221213223937438 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223937438 DLGLOBAL DEBUG validating counter group 0x7f536142bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223937438 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223937438 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223937438 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223937438 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223937440 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223937440 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223937440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223937441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:39:38.414795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9197): Terminating (SIGTERM) 22:39:38.456407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9200): Terminating (SIGTERM) 22:39:38.498565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9203): Terminating (SIGTERM) 22:39:38.540862 --- ParallelTerminationStrategy: PID 9197 died... 22:39:38.561423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9197): Terminated: ok {rc=0} 22:39:38.607872 --- ParallelTerminationStrategy: PID 9200 died... 22:39:38.627666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9200): Terminated: ok {rc=0} 22:39:38.674270 --- ParallelTerminationStrategy: PID 9203 died... 22:39:38.694391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9203): Terminated: ok {rc=0} 22:39:38.782880 bus /sierra_3: Setting Powered False 22:39:39.881486 bus /sierra_3: Setting Powered False 22:39:40.998410 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:39:42.147411 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:42.159950 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:39:42.228933 tst mo_mt_call_osmux.py: using LAC 36713 22:39:42.359149 tst mo_mt_call_osmux.py: using RAC 248 22:39:42.485184 tst mo_mt_call_osmux.py: using CellId 36713 22:39:42.610746 tst mo_mt_call_osmux.py: using BVCI 36714 22:39:42.729573 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:42.741476 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:42.753203 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:42.764783 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:42.777047 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:39:42.789143 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:39:42.906543 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:39:43.027095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:43.528838 run create_hlr_db(pid=9206): Launched 22:39:43.651729 bus /sierra_2: Setting Powered False 22:39:44.716743 run create_hlr_db(pid=9206): Terminated: ok {rc=0} 22:39:45.147544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9208): Launched 22:39:45.448368 run osmo-hlr_10.42.42.2(pid=9209): Launched 22:39:45.563014 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:46.131690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9211): Launched 22:39:46.474179 run osmo-stp_10.42.42.5(pid=9212): Launched 22:39:46.719555 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:47.379870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9214): Launched 22:39:47.704004 run osmo-msc_10.42.42.6(pid=9215): Launched 22:39:47.884826 run osmo-stp_10.42.42.5(pid=9212): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9212)] 22:39:48.020566 run osmo-stp_10.42.42.5(pid=9212): stdout: | (launched: 2022-12-13_22:39:46.410522) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:48.157418 run osmo-stp_10.42.42.5(pid=9212): stderr: | 20221213223946707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223946707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223946708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223946708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223946721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223946721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223946721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:48.294187 run osmo-stp_10.42.42.5(pid=9212): stdout: | (launched: 2022-12-13_22:39:46.410522) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:48.423529 run osmo-stp_10.42.42.5(pid=9212): stderr: | 20221213223946707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223946707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223946708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223946708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223946721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223946721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223946721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:48.577610 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9212): Process ended prematurely: osmo-stp_10.42.42.5(pid=9212) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9212)] [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:39:48.587359 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:39:48.615214 run osmo-hlr_10.42.42.2(pid=9209): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9209)] 22:39:48.665651 run osmo-hlr_10.42.42.2(pid=9209): stdout: | (launched: 2022-12-13_22:39:45.393066) 22:39:48.717383 run osmo-hlr_10.42.42.2(pid=9209): stderr: | 20221213223945567 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223945567 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223945568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223945568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223945568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223945568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223945580 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223945590 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223945590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223945590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:48.790304 run osmo-msc_10.42.42.6(pid=9215): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9215)] 22:39:48.840274 run osmo-msc_10.42.42.6(pid=9215): stdout: | (launched: 2022-12-13_22:39:47.645234) 22:39:48.891916 run osmo-msc_10.42.42.6(pid=9215): stderr: | 20221213223947965 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223947966 DLGLOBAL DEBUG validating counter group 0x7f8f5b257c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223947966 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223947966 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223947966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223947966 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223947968 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223947968 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223947968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223947968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:39:48.944094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9208): Terminating (SIGTERM) 22:39:48.985570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9211): Terminating (SIGTERM) 22:39:49.027586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9214): Terminating (SIGTERM) 22:39:49.070195 --- ParallelTerminationStrategy: PID 9208 died... 22:39:49.090758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9208): Terminated: ok {rc=0} 22:39:49.137143 --- ParallelTerminationStrategy: PID 9211 died... 22:39:49.157080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9211): Terminated: ok {rc=0} 22:39:49.203174 --- ParallelTerminationStrategy: PID 9214 died... 22:39:49.223017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9214): Terminated: ok {rc=0} 22:39:49.311545 bus /sierra_3: Setting Powered False 22:39:50.410179 bus /sierra_3: Setting Powered False 22:39:51.524892 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:39:52.782952 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:39:52.790098 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:39:52.819974 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:39:52.847887 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:39:52.900208 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:39:52.929421 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:39:52.955981 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:39:53.507568 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:39:53.556499 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:53.567568 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:39:53.633596 tst mo_mt_call.py: using LAC 36714 22:39:53.750662 tst mo_mt_call.py: using RAC 249 22:39:53.868864 tst mo_mt_call.py: using CellId 36714 22:39:53.985961 tst mo_mt_call.py: using BVCI 36715 22:39:54.095380 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:54.106456 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:54.117277 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:54.128044 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:54.139398 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:39:54.150718 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:39:54.270400 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:39:54.386120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:54.854142 run create_hlr_db(pid=9220): Launched 22:39:54.976584 bus /sierra_2: Setting Powered False 22:39:56.037661 run create_hlr_db(pid=9220): Terminated: ok {rc=0} 22:39:56.480843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9222): Launched 22:39:56.803972 run osmo-hlr_10.42.42.2(pid=9223): Launched 22:39:56.927762 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:57.487470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9225): Launched 22:39:57.810030 run osmo-stp_10.42.42.5(pid=9226): Launched 22:39:57.934018 run osmo-msc_10.42.42.6: Starting osmo-msc 22:39:58.520045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9228): Launched 22:39:58.843968 run osmo-msc_10.42.42.6(pid=9229): Launched 22:39:59.026279 run osmo-stp_10.42.42.5(pid=9226): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9226)] 22:39:59.162873 run osmo-stp_10.42.42.5(pid=9226): stdout: | (launched: 2022-12-13_22:39:57.751344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:59.300675 run osmo-stp_10.42.42.5(pid=9226): stderr: | 20221213223957943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223957943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223957943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223957944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223957944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223957944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223957944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:59.437663 run osmo-stp_10.42.42.5(pid=9226): stdout: | (launched: 2022-12-13_22:39:57.751344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:59.567150 run osmo-stp_10.42.42.5(pid=9226): stderr: | 20221213223957943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213223957943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213223957943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213223957944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213223957944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213223957944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213223957944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:59.721689 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9226): Process ended prematurely: osmo-stp_10.42.42.5(pid=9226) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9226)] [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:39:59.731099 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:39:59.758942 run osmo-hlr_10.42.42.2(pid=9223): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9223)] 22:39:59.809214 run osmo-hlr_10.42.42.2(pid=9223): stdout: | (launched: 2022-12-13_22:39:56.745654) 22:39:59.861159 run osmo-hlr_10.42.42.2(pid=9223): stderr: | 20221213223956942 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213223956942 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213223956942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213223956942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213223956942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213223956942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213223956953 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213223956961 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213223956962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213223956962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:59.933075 run osmo-msc_10.42.42.6(pid=9229): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9229)] 22:39:59.982828 run osmo-msc_10.42.42.6(pid=9229): stdout: | (launched: 2022-12-13_22:39:58.785069) 22:40:00.034869 run osmo-msc_10.42.42.6(pid=9229): stderr: | 20221213223959105 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213223959105 DLGLOBAL DEBUG validating counter group 0x7f10a1c5fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213223959105 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213223959105 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213223959106 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213223959106 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213223959107 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213223959108 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213223959108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213223959108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:40:00.087286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9222): Terminating (SIGTERM) 22:40:00.128491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9225): Terminating (SIGTERM) 22:40:00.170032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9228): Terminating (SIGTERM) 22:40:00.212286 --- ParallelTerminationStrategy: PID 9222 died... 22:40:00.232639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9222): Terminated: ok {rc=0} 22:40:00.279078 --- ParallelTerminationStrategy: PID 9225 died... 22:40:00.298945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9225): Terminated: ok {rc=0} 22:40:00.345441 --- ParallelTerminationStrategy: PID 9228 died... 22:40:00.365434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9228): Terminated: ok {rc=0} 22:40:00.453112 bus /sierra_3: Setting Powered False 22:40:01.552646 bus /sierra_3: Setting Powered False 22:40:02.673476 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:40:03.823529 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:03.835756 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:40:03.904772 tst mo_mt_call_osmux.py: using LAC 36715 22:40:04.034114 tst mo_mt_call_osmux.py: using RAC 250 22:40:04.159805 tst mo_mt_call_osmux.py: using CellId 36715 22:40:04.284722 tst mo_mt_call_osmux.py: using BVCI 36716 22:40:04.401577 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:04.413282 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:04.424517 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:04.435857 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:04.447650 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:40:04.459224 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:40:04.575948 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:40:04.691512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:05.157443 run create_hlr_db(pid=9234): Launched 22:40:05.281607 bus /sierra_2: Setting Powered False 22:40:06.342296 run create_hlr_db(pid=9234): Terminated: ok {rc=0} 22:40:06.783262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9236): Launched 22:40:07.105712 run osmo-hlr_10.42.42.2(pid=9237): Launched 22:40:07.229177 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:07.787223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9239): Launched 22:40:08.109847 run osmo-stp_10.42.42.5(pid=9240): Launched 22:40:08.233474 run osmo-msc_10.42.42.6: Starting osmo-msc 22:40:08.818977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9242): Launched 22:40:09.142591 run osmo-msc_10.42.42.6(pid=9243): Launched 22:40:09.324018 run osmo-stp_10.42.42.5(pid=9240): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9240)] 22:40:09.460480 run osmo-stp_10.42.42.5(pid=9240): stdout: | (launched: 2022-12-13_22:40:08.051175) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:09.597721 run osmo-stp_10.42.42.5(pid=9240): stderr: | 20221213224008243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224008243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224008243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224008243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224008246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224008246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224008246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:09.734512 run osmo-stp_10.42.42.5(pid=9240): stdout: | (launched: 2022-12-13_22:40:08.051175) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:09.863525 run osmo-stp_10.42.42.5(pid=9240): stderr: | 20221213224008243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224008243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224008243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224008243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224008246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224008246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224008246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:10.018211 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9240): Process ended prematurely: osmo-stp_10.42.42.5(pid=9240) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9240)] [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:40:10.027785 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:40:10.055880 run osmo-hlr_10.42.42.2(pid=9237): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9237)] 22:40:10.106471 run osmo-hlr_10.42.42.2(pid=9237): stdout: | (launched: 2022-12-13_22:40:07.047077) 22:40:10.158168 run osmo-hlr_10.42.42.2(pid=9237): stderr: | 20221213224007246 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224007246 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224007246 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224007246 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224007246 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224007246 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224007257 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224007265 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224007266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224007266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:10.230743 run osmo-msc_10.42.42.6(pid=9243): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9243)] 22:40:10.280419 run osmo-msc_10.42.42.6(pid=9243): stdout: | (launched: 2022-12-13_22:40:09.083672) 22:40:10.332710 run osmo-msc_10.42.42.6(pid=9243): stderr: | 20221213224009405 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224009406 DLGLOBAL DEBUG validating counter group 0x7ff3bf74fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224009406 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224009406 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224009406 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224009406 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224009408 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224009408 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224009408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224009408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:40:10.384912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9236): Terminating (SIGTERM) 22:40:10.426416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9239): Terminating (SIGTERM) 22:40:10.467998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9242): Terminating (SIGTERM) 22:40:10.510566 --- ParallelTerminationStrategy: PID 9236 died... 22:40:10.531004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9236): Terminated: ok {rc=0} 22:40:10.577355 --- ParallelTerminationStrategy: PID 9239 died... 22:40:10.597055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9239): Terminated: ok {rc=0} 22:40:10.643128 --- ParallelTerminationStrategy: PID 9242 died... 22:40:10.662948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9242): Terminated: ok {rc=0} 22:40:10.750642 bus /sierra_3: Setting Powered False 22:40:11.849238 bus /sierra_3: Setting Powered False 22:40:12.966196 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 22:40:14.212130 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:40:14.216810 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:40:14.246868 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 22:40:14.274968 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 22:40:14.366424 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:40:14.395220 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 22:40:14.422162 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 22:40:15.005583 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2395 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 22:40:15.010773 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:15.022103 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:40:15.068356 tst emergency_mo_mt_call.py: using LAC 36716 22:40:15.193487 tst emergency_mo_mt_call.py: using RAC 251 22:40:15.309469 tst emergency_mo_mt_call.py: using CellId 36716 22:40:15.426331 tst emergency_mo_mt_call.py: using BVCI 36717 22:40:15.532732 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:15.543698 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:15.554485 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:15.565274 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:15.575848 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:15.586401 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:15.701735 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:15.820499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:16.437818 run create_hlr_db(pid=9248): Launched 22:40:16.606492 bus /sierra_2: Setting Powered False 22:40:17.669792 run create_hlr_db(pid=9248): Terminated: ok {rc=0} 22:40:18.095675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9250): Launched 22:40:18.391465 run osmo-hlr_10.42.42.2(pid=9251): Launched 22:40:18.504131 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:19.025294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9253): Launched 22:40:19.320111 run osmo-stp_10.42.42.5(pid=9254): Launched 22:40:19.445745 tst emergency_mo_mt_call.py: using MSISDN 8362 22:40:19.596866 run osmo-msc_10.42.42.6: Starting osmo-msc 22:40:20.132152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9256): Launched 22:40:20.427865 run osmo-msc_10.42.42.6(pid=9257): Launched 22:40:20.595261 run osmo-stp_10.42.42.5(pid=9254): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9254)] 22:40:20.722149 run osmo-stp_10.42.42.5(pid=9254): stdout: | (launched: 2022-12-13_22:40:19.265726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:20.847104 run osmo-stp_10.42.42.5(pid=9254): stderr: | 20221213224019437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224019437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224019437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224019438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224019438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224019438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224019438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:20.970315 run osmo-stp_10.42.42.5(pid=9254): stdout: | (launched: 2022-12-13_22:40:19.265726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:21.087765 run osmo-stp_10.42.42.5(pid=9254): stderr: | 20221213224019437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224019437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224019437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224019438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224019438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224019438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224019438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:21.228877 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=9254): Process ended prematurely: osmo-stp_10.42.42.5(pid=9254) [trial-2395↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9254)] [trial-2395↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 22:40:21.237223 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 22:40:21.263494 run osmo-hlr_10.42.42.2(pid=9251): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9251)] 22:40:21.311532 run osmo-hlr_10.42.42.2(pid=9251): stdout: | (launched: 2022-12-13_22:40:18.337160) 22:40:21.361072 run osmo-hlr_10.42.42.2(pid=9251): stderr: | 20221213224018513 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224018513 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224018513 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224018513 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224018513 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224018513 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224018525 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224018535 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224018535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224018535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:21.429911 run osmo-msc_10.42.42.6(pid=9257): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9257)] 22:40:21.477267 run osmo-msc_10.42.42.6(pid=9257): stdout: | (launched: 2022-12-13_22:40:20.373793) 22:40:21.526409 run osmo-msc_10.42.42.6(pid=9257): stderr: | 20221213224020643 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224020643 DLGLOBAL DEBUG validating counter group 0x7f09e1949c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224020643 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224020643 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224020643 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224020643 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224020645 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224020646 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224020646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224020646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:40:21.577267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9250): Terminating (SIGTERM) 22:40:21.616610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9253): Terminating (SIGTERM) 22:40:21.655896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9256): Terminating (SIGTERM) 22:40:21.695575 --- ParallelTerminationStrategy: PID 9250 died... 22:40:21.714918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9250): Terminated: ok {rc=0} 22:40:21.758784 --- ParallelTerminationStrategy: PID 9253 died... 22:40:21.777514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9253): Terminated: ok {rc=0} 22:40:21.821077 --- ParallelTerminationStrategy: PID 9256 died... 22:40:21.839784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9256): Terminated: ok {rc=0} 22:40:21.921757 bus /sierra_3: Setting Powered False 22:40:23.019534 bus /sierra_3: Setting Powered False 22:40:24.138650 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 22:40:25.225718 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:25.237790 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:40:25.288334 tst emergency_preemptive_call.py: using LAC 36717 22:40:25.408603 tst emergency_preemptive_call.py: using RAC 252 22:40:25.526477 tst emergency_preemptive_call.py: using CellId 36717 22:40:25.644693 tst emergency_preemptive_call.py: using BVCI 36718 22:40:25.752211 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:25.763136 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:25.773783 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:25.784367 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:25.795573 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:40:25.806746 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:25.926619 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:26.042249 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:26.162511 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:26.277933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:26.737888 run create_hlr_db(pid=9259): Launched 22:40:26.859560 bus /sierra_2: Setting Powered False 22:40:27.919060 run create_hlr_db(pid=9259): Terminated: ok {rc=0} 22:40:28.333971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9261): Launched 22:40:28.630849 run osmo-hlr_10.42.42.2(pid=9262): Launched 22:40:28.743147 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:29.269668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9264): Launched 22:40:29.566305 run osmo-stp_10.42.42.5(pid=9265): Launched 22:40:29.689896 tst emergency_preemptive_call.py: using MSISDN 8363 22:40:29.854628 run osmo-msc_10.42.42.6: Starting osmo-msc 22:40:30.387588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9267): Launched 22:40:30.683191 run osmo-msc_10.42.42.6(pid=9268): Launched 22:40:30.853954 run osmo-stp_10.42.42.5(pid=9265): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9265)] 22:40:31.102649 run osmo-stp_10.42.42.5(pid=9265): stdout: | (launched: 2022-12-13_22:40:29.511448) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:31.242332 run osmo-stp_10.42.42.5(pid=9265): stderr: | 20221213224029683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224029683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224029683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224029684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224029684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224029684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224029684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:31.370394 run osmo-stp_10.42.42.5(pid=9265): stdout: | (launched: 2022-12-13_22:40:29.511448) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:31.492452 run osmo-stp_10.42.42.5(pid=9265): stderr: | 20221213224029683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224029683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224029683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224029684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224029684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224029684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224029684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:31.638612 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=9265): Process ended prematurely: osmo-stp_10.42.42.5(pid=9265) [trial-2395↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9265)] [trial-2395↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 22:40:31.647534 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 22:40:31.674501 run osmo-hlr_10.42.42.2(pid=9262): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9262)] 22:40:31.723402 run osmo-hlr_10.42.42.2(pid=9262): stdout: | (launched: 2022-12-13_22:40:28.576341) 22:40:31.774538 run osmo-hlr_10.42.42.2(pid=9262): stderr: | 20221213224028752 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224028752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224028752 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224028752 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224028752 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224028752 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224028765 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224028773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224028774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224028774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:31.846761 run osmo-msc_10.42.42.6(pid=9268): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9268)] 22:40:31.896138 run osmo-msc_10.42.42.6(pid=9268): stdout: | (launched: 2022-12-13_22:40:30.628624) 22:40:31.947241 run osmo-msc_10.42.42.6(pid=9268): stderr: | 20221213224030986 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224030986 DLGLOBAL DEBUG validating counter group 0x7f26ec9f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224030986 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224030986 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224030986 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224030986 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224030988 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224030989 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224030989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224030989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:40:31.998811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9261): Terminating (SIGTERM) 22:40:32.040896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9264): Terminating (SIGTERM) 22:40:32.084527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9267): Terminating (SIGTERM) 22:40:32.128220 --- ParallelTerminationStrategy: PID 9261 died... 22:40:32.148460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9261): Terminated: ok {rc=0} 22:40:32.194306 --- ParallelTerminationStrategy: PID 9264 died... 22:40:32.214554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9264): Terminated: ok {rc=0} 22:40:32.260000 --- ParallelTerminationStrategy: PID 9267 died... 22:40:32.279859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9267): Terminated: ok {rc=0} 22:40:32.367006 bus /sierra_9: Setting Powered False 22:40:33.465985 bus /sierra_9: Setting Powered False 22:40:34.584007 bus /sierra_8: Setting Powered False 22:40:35.683617 bus /sierra_8: Setting Powered False 22:40:36.798740 bus /sierra_3: Setting Powered False 22:40:37.896543 bus /sierra_3: Setting Powered False 22:40:39.012629 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 22:40:40.289422 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:40:40.294099 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:40:40.323801 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 22:40:40.363726 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 22:40:40.452241 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:40:40.482083 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 22:40:40.521471 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 22:40:41.115105 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 22:40:41.168431 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:41.179759 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:40:41.225376 tst cs_paging_gprs_active.py: using LAC 36718 22:40:41.353741 tst cs_paging_gprs_active.py: using RAC 253 22:40:41.482107 tst cs_paging_gprs_active.py: using CellId 36718 22:40:41.610578 tst cs_paging_gprs_active.py: using BVCI 36719 22:40:41.727799 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:41.739105 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:41.750234 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:41.761223 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:41.772353 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:41.783544 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:41.795042 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:41.806322 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:41.817823 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:41.934396 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:42.049922 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:40:42.253824 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:40:42.558322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9273): Launched 22:40:42.824592 run iperf3-srv_10.42.42.10(pid=9274): Launched 22:40:42.938055 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:40:43.141177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:40:43.444544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9275): Launched 22:40:43.707688 run iperf3-srv_10.42.42.10(pid=9276): Launched 22:40:43.821122 tst cs_paging_gprs_active.py:38: start network... 22:40:44.023394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:44.490807 run create_hlr_db(pid=9277): Launched 22:40:44.616017 bus /sierra_2: Setting Powered False 22:40:45.676809 run create_hlr_db(pid=9277): Terminated: ok {rc=0} 22:40:46.142127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9279): Launched 22:40:46.491423 run osmo-hlr_10.42.42.2(pid=9280): Launched 22:40:46.758538 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:47.378340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9282): Launched 22:40:47.680202 run osmo-stp_10.42.42.5(pid=9283): Launched 22:40:47.795930 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:40:48.317958 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9285): Launched 22:40:48.433710 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:40:48.689871 run patchelf(pid=9286): Launched 22:40:48.858496 run osmo-stp_10.42.42.5(pid=9283): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9283)] 22:40:48.986114 run osmo-stp_10.42.42.5(pid=9283): stdout: | (launched: 2022-12-13_22:40:47.624597) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:49.115842 run osmo-stp_10.42.42.5(pid=9283): stderr: | 20221213224047794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224047794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224047794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224047795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224047797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224047797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224047797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:49.245512 run osmo-stp_10.42.42.5(pid=9283): stdout: | (launched: 2022-12-13_22:40:47.624597) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:49.369563 run osmo-stp_10.42.42.5(pid=9283): stderr: | 20221213224047794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224047794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224047794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224047795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224047797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224047797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224047797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:49.515998 run patchelf(pid=9286): Terminating (SIGINT) 22:40:49.685767 run patchelf(pid=9286): Terminated: ok {rc=0} 22:40:49.807542 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9283): Process ended prematurely: osmo-stp_10.42.42.5(pid=9283) [trial-2395↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9283)] [trial-2395↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 22:40:49.817088 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:40:49.844209 run osmo-hlr_10.42.42.2(pid=9280): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9280)] 22:40:49.891143 run osmo-hlr_10.42.42.2(pid=9280): stdout: | (launched: 2022-12-13_22:40:46.428072) 22:40:49.940367 run osmo-hlr_10.42.42.2(pid=9280): stderr: | 20221213224046676 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224046676 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224046676 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224046676 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224046676 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224046676 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224046693 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224046710 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224046710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224046710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:49.989814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9273): Terminating (SIGTERM) 22:40:50.029332 run iperf3-srv_10.42.42.10(pid=9274): Terminating (SIGTERM) 22:40:50.068759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9275): Terminating (SIGTERM) 22:40:50.108225 run iperf3-srv_10.42.42.10(pid=9276): Terminating (SIGTERM) 22:40:50.147465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9279): Terminating (SIGTERM) 22:40:50.186815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9282): Terminating (SIGTERM) 22:40:50.226062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9285): Terminating (SIGTERM) 22:40:50.265912 --- ParallelTerminationStrategy: PID 9273 died... 22:40:50.284805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9273): Terminated: ok {rc=0} 22:40:50.328789 --- ParallelTerminationStrategy: PID 9274 died... 22:40:50.347453 run iperf3-srv_10.42.42.10(pid=9274): Terminated {rc=256} 22:40:50.390879 --- ParallelTerminationStrategy: PID 9275 died... 22:40:50.409509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9275): Terminated: ok {rc=0} 22:40:50.453180 --- ParallelTerminationStrategy: PID 9276 died... 22:40:50.471660 run iperf3-srv_10.42.42.10(pid=9276): Terminated {rc=256} 22:40:50.515342 --- ParallelTerminationStrategy: PID 9279 died... 22:40:50.533953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9279): Terminated: ok {rc=0} 22:40:50.577390 --- ParallelTerminationStrategy: PID 9282 died... 22:40:50.595927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9282): Terminated: ok {rc=0} 22:40:50.639462 --- ParallelTerminationStrategy: PID 9285 died... 22:40:50.658222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9285): Terminated: ok {rc=0} 22:40:50.743625 bus /gobi_0: Setting Powered False 22:40:51.842968 bus /gobi_0: Setting Powered False 22:40:52.957824 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 22:40:54.109386 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:54.121556 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:40:54.169946 tst iperf3.py: using LAC 36719 22:40:54.296885 tst iperf3.py: using RAC 254 22:40:54.423287 tst iperf3.py: using CellId 36719 22:40:54.551632 tst iperf3.py: using BVCI 36720 22:40:54.669600 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:54.681387 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:54.692430 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:54.703697 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:54.715214 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:54.726753 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:54.738783 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:54.750329 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:40:54.762198 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:40:54.880002 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:40:55.081828 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:40:55.385315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9287): Launched 22:40:55.649182 run iperf3-srv_10.42.42.10(pid=9288): Launched 22:40:55.762402 tst iperf3.py:8: start network... 22:40:55.963965 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:56.433415 run create_hlr_db(pid=9289): Launched 22:40:56.556284 bus /gobi_6: Setting Powered False 22:40:57.617612 run create_hlr_db(pid=9289): Terminated: ok {rc=0} 22:40:58.058597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9291): Launched 22:40:58.382437 run osmo-hlr_10.42.42.2(pid=9292): Launched 22:40:58.506065 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:59.064608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9294): Launched 22:40:59.388831 run osmo-stp_10.42.42.5(pid=9295): Launched 22:40:59.513130 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:00.073508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9297): Launched 22:41:00.198460 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:00.473054 run patchelf(pid=9298): Launched 22:41:00.654412 run osmo-stp_10.42.42.5(pid=9295): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9295)] 22:41:00.791887 run osmo-stp_10.42.42.5(pid=9295): stdout: | (launched: 2022-12-13_22:40:59.329824) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:00.950715 run osmo-stp_10.42.42.5(pid=9295): stderr: | 20221213224059522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224059522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224059522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224059522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224059523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224059523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224059523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:01.094540 run osmo-stp_10.42.42.5(pid=9295): stdout: | (launched: 2022-12-13_22:40:59.329824) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:01.222850 run osmo-stp_10.42.42.5(pid=9295): stderr: | 20221213224059522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224059522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224059522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224059522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224059523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224059523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224059523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:01.374558 run patchelf(pid=9298): Terminating (SIGINT) 22:41:01.549697 run patchelf(pid=9298): Terminated: ok {rc=0} 22:41:01.680446 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9295): Process ended prematurely: osmo-stp_10.42.42.5(pid=9295) [trial-2395↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9295)] [trial-2395↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 22:41:01.690668 tst iperf3.py:8: Test FAILED (7.6 sec) 22:41:01.719143 run osmo-hlr_10.42.42.2(pid=9292): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9292)] 22:41:01.769244 run osmo-hlr_10.42.42.2(pid=9292): stdout: | (launched: 2022-12-13_22:40:58.323666) 22:41:01.821589 run osmo-hlr_10.42.42.2(pid=9292): stderr: | 20221213224058522 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224058523 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224058523 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224058523 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224058523 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224058523 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224058535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224058543 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224058544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224058544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:01.873939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9287): Terminating (SIGTERM) 22:41:01.915317 run iperf3-srv_10.42.42.10(pid=9288): Terminating (SIGTERM) 22:41:01.959745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9291): Terminating (SIGTERM) 22:41:02.007485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9294): Terminating (SIGTERM) 22:41:02.062658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9297): Terminating (SIGTERM) 22:41:02.109556 --- ParallelTerminationStrategy: PID 9287 died... 22:41:02.130391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9287): Terminated: ok {rc=0} 22:41:02.178444 --- ParallelTerminationStrategy: PID 9288 died... 22:41:02.199849 run iperf3-srv_10.42.42.10(pid=9288): Terminated {rc=256} 22:41:02.246827 --- ParallelTerminationStrategy: PID 9291 died... 22:41:02.266912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9291): Terminated: ok {rc=0} 22:41:02.313908 --- ParallelTerminationStrategy: PID 9294 died... 22:41:02.334038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9294): Terminated: ok {rc=0} 22:41:02.380681 --- ParallelTerminationStrategy: PID 9297 died... 22:41:02.400832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9297): Terminated: ok {rc=0} 22:41:02.489634 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 22:41:03.639419 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:03.651279 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:41:03.697714 tst iperf3m4.py: using LAC 36720 22:41:03.828181 tst iperf3m4.py: using RAC 255 22:41:03.952592 tst iperf3m4.py: using CellId 36720 22:41:04.077194 tst iperf3m4.py: using BVCI 36721 22:41:04.194434 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:04.205745 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:04.216829 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:04.227944 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:04.239350 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:04.250729 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:04.262249 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:04.273597 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:04.285074 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:04.408526 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:04.526983 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:04.645708 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:04.766556 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:41:04.968439 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:05.270866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9299): Launched 22:41:05.534292 run iperf3-srv_10.42.42.10(pid=9300): Launched 22:41:05.647196 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:41:05.849305 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:06.152900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9301): Launched 22:41:06.415263 run iperf3-srv_10.42.42.10(pid=9302): Launched 22:41:06.527776 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:41:06.728607 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:07.030371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9303): Launched 22:41:07.293579 run iperf3-srv_10.42.42.10(pid=9304): Launched 22:41:07.406331 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:41:07.607126 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:07.909652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9305): Launched 22:41:08.172917 run iperf3-srv_10.42.42.10(pid=9306): Launched 22:41:08.285801 tst iperf3m4.py:8: start network... 22:41:08.487187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:08.953610 run create_hlr_db(pid=9307): Launched 22:41:09.077375 bus /gobi_6: Setting Powered False 22:41:10.138972 run create_hlr_db(pid=9307): Terminated: ok {rc=0} 22:41:10.581793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9309): Launched 22:41:10.911540 run osmo-hlr_10.42.42.2(pid=9310): Launched 22:41:11.035713 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:11.698854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9312): Launched 22:41:12.016013 run osmo-stp_10.42.42.5(pid=9313): Launched 22:41:12.138209 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:12.686755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9315): Launched 22:41:12.809274 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:13.077353 run patchelf(pid=9316): Launched 22:41:13.254080 run osmo-stp_10.42.42.5(pid=9313): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9313)] 22:41:13.389187 run osmo-stp_10.42.42.5(pid=9313): stdout: | (launched: 2022-12-13_22:41:11.958558) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:13.525216 run osmo-stp_10.42.42.5(pid=9313): stderr: | 20221213224112152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224112152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224112152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224112153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224112153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224112153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224112153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:13.661330 run osmo-stp_10.42.42.5(pid=9313): stdout: | (launched: 2022-12-13_22:41:11.958558) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:13.791527 run osmo-stp_10.42.42.5(pid=9313): stderr: | 20221213224112152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224112152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224112152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224112153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224112153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224112153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224112153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:13.946017 run patchelf(pid=9316): Terminating (SIGINT) 22:41:14.123833 run patchelf(pid=9316): Terminated: ok {rc=0} 22:41:14.252734 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9313): Process ended prematurely: osmo-stp_10.42.42.5(pid=9313) [trial-2395↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9313)] [trial-2395↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 22:41:14.262994 tst iperf3m4.py:8: Test FAILED (10.7 sec) 22:41:14.291804 run osmo-hlr_10.42.42.2(pid=9310): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9310)] 22:41:14.343120 run osmo-hlr_10.42.42.2(pid=9310): stdout: | (launched: 2022-12-13_22:41:10.852856) 22:41:14.394801 run osmo-hlr_10.42.42.2(pid=9310): stderr: | 20221213224111050 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224111050 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224111050 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224111050 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224111050 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224111050 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224111062 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224111072 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224111073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224111073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:14.447040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9299): Terminating (SIGTERM) 22:41:14.488745 run iperf3-srv_10.42.42.10(pid=9300): Terminating (SIGTERM) 22:41:14.530631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9301): Terminating (SIGTERM) 22:41:14.572888 run iperf3-srv_10.42.42.10(pid=9302): Terminating (SIGTERM) 22:41:14.614935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9303): Terminating (SIGTERM) 22:41:14.656854 run iperf3-srv_10.42.42.10(pid=9304): Terminating (SIGTERM) 22:41:14.698651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9305): Terminating (SIGTERM) 22:41:14.740752 run iperf3-srv_10.42.42.10(pid=9306): Terminating (SIGTERM) 22:41:14.782778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9309): Terminating (SIGTERM) 22:41:14.824613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9312): Terminating (SIGTERM) 22:41:14.866619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9315): Terminating (SIGTERM) 22:41:14.908745 --- ParallelTerminationStrategy: PID 9299 died... 22:41:14.929256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9299): Terminated: ok {rc=0} 22:41:14.975445 --- ParallelTerminationStrategy: PID 9300 died... 22:41:14.995199 run iperf3-srv_10.42.42.10(pid=9300): Terminated {rc=256} 22:41:15.041284 --- ParallelTerminationStrategy: PID 9301 died... 22:41:15.061322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9301): Terminated: ok {rc=0} 22:41:15.107493 --- ParallelTerminationStrategy: PID 9302 died... 22:41:15.127179 run iperf3-srv_10.42.42.10(pid=9302): Terminated {rc=256} 22:41:15.173293 --- ParallelTerminationStrategy: PID 9303 died... 22:41:15.193264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9303): Terminated: ok {rc=0} 22:41:15.239393 --- ParallelTerminationStrategy: PID 9304 died... 22:41:15.259265 run iperf3-srv_10.42.42.10(pid=9304): Terminated {rc=256} 22:41:15.305472 --- ParallelTerminationStrategy: PID 9305 died... 22:41:15.325626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9305): Terminated: ok {rc=0} 22:41:15.371793 --- ParallelTerminationStrategy: PID 9306 died... 22:41:15.391588 run iperf3-srv_10.42.42.10(pid=9306): Terminated {rc=256} 22:41:15.437494 --- ParallelTerminationStrategy: PID 9309 died... 22:41:15.457721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9309): Terminated: ok {rc=0} 22:41:15.503746 --- ParallelTerminationStrategy: PID 9312 died... 22:41:15.523535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9312): Terminated: ok {rc=0} 22:41:15.569591 --- ParallelTerminationStrategy: PID 9315 died... 22:41:15.589537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9315): Terminated: ok {rc=0} 22:41:15.677487 bus /gobi_4: Setting Powered False 22:41:16.779653 bus /gobi_4: Setting Powered False 22:41:17.897593 bus /gobi_1: Setting Powered False 22:41:18.997812 bus /gobi_1: Setting Powered False 22:41:20.114192 bus /gobi_0: Setting Powered False 22:41:21.211852 bus /gobi_0: Setting Powered False 22:41:22.324401 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 22:41:23.427456 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:23.439105 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:41:23.485195 tst ping.py: using LAC 36721 22:41:23.606535 tst ping.py: using RAC 1 22:41:23.730412 tst ping.py: using CellId 36721 22:41:23.852426 tst ping.py: using BVCI 36722 22:41:23.966991 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:23.978115 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:23.989243 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:24.000011 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:24.011205 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:24.022393 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:24.033777 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:24.044837 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:24.163070 tst ping.py:19: start network... 22:41:24.374919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:24.858179 run create_hlr_db(pid=9317): Launched 22:41:24.977599 bus /gobi_6: Setting Powered False 22:41:26.040063 run create_hlr_db(pid=9317): Terminated: ok {rc=0} 22:41:26.477458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9319): Launched 22:41:26.789892 run osmo-hlr_10.42.42.2(pid=9320): Launched 22:41:26.910142 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:27.453694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9322): Launched 22:41:27.768505 run osmo-stp_10.42.42.5(pid=9323): Launched 22:41:27.889561 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:28.431667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9325): Launched 22:41:28.551163 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:28.815010 run patchelf(pid=9326): Launched 22:41:28.989203 run osmo-stp_10.42.42.5(pid=9323): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9323)] 22:41:29.121401 run osmo-stp_10.42.42.5(pid=9323): stdout: | (launched: 2022-12-13_22:41:27.711218) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:29.255540 run osmo-stp_10.42.42.5(pid=9323): stderr: | 20221213224127903 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224127904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224127904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224127904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224127905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224127905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224127905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:29.390018 run osmo-stp_10.42.42.5(pid=9323): stdout: | (launched: 2022-12-13_22:41:27.711218) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:29.518277 run osmo-stp_10.42.42.5(pid=9323): stderr: | 20221213224127903 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224127904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224127904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224127904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224127905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224127905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224127905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:29.670150 run patchelf(pid=9326): Terminating (SIGINT) 22:41:29.844499 run patchelf(pid=9326): Terminated: ok {rc=0} 22:41:29.970628 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9323): Process ended prematurely: osmo-stp_10.42.42.5(pid=9323) [trial-2395↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9323)] [trial-2395↪gprs:trx-lms-limenet-micro↪ping.py:22] 22:41:29.980070 tst ping.py:22: Test FAILED (6.5 sec) 22:41:30.007904 run osmo-hlr_10.42.42.2(pid=9320): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9320)] 22:41:30.058609 run osmo-hlr_10.42.42.2(pid=9320): stdout: | (launched: 2022-12-13_22:41:26.732730) 22:41:30.110011 run osmo-hlr_10.42.42.2(pid=9320): stderr: | 20221213224126930 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224126930 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224126930 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224126930 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224126930 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224126930 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224126942 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224126952 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224126952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224126953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:30.162147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9319): Terminating (SIGTERM) 22:41:30.203766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9322): Terminating (SIGTERM) 22:41:30.245278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9325): Terminating (SIGTERM) 22:41:30.287528 --- ParallelTerminationStrategy: PID 9319 died... 22:41:30.307739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9319): Terminated: ok {rc=0} 22:41:30.354194 --- ParallelTerminationStrategy: PID 9322 died... 22:41:30.373880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9322): Terminated: ok {rc=0} 22:41:30.419858 --- ParallelTerminationStrategy: PID 9325 died... 22:41:30.439568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9325): Terminated: ok {rc=0} 22:41:30.527525 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 22:41:31.616147 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:31.628509 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:41:31.678952 tst ping_idle_ping.py: using LAC 36722 22:41:31.799631 tst ping_idle_ping.py: using RAC 2 22:41:31.917567 tst ping_idle_ping.py: using CellId 36722 22:41:32.077808 tst ping_idle_ping.py: using BVCI 36723 22:41:32.212216 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:32.223964 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:32.235577 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:32.247568 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:32.259849 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:32.272469 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:32.284789 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 22:41:32.296909 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 22:41:32.416852 tst ping_idle_ping.py:24: start network... 22:41:32.629335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:33.117782 run create_hlr_db(pid=9327): Launched 22:41:33.238506 bus /gobi_6: Setting Powered False 22:41:34.301312 run create_hlr_db(pid=9327): Terminated: ok {rc=0} 22:41:34.724051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9329): Launched 22:41:35.019362 run osmo-hlr_10.42.42.2(pid=9330): Launched 22:41:35.131849 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:35.640248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9332): Launched 22:41:35.934808 run osmo-stp_10.42.42.5(pid=9333): Launched 22:41:36.047269 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:36.555689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9335): Launched 22:41:36.668181 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:36.915961 run patchelf(pid=9336): Launched 22:41:37.080141 run osmo-stp_10.42.42.5(pid=9333): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9333)] 22:41:37.205083 run osmo-stp_10.42.42.5(pid=9333): stdout: | (launched: 2022-12-13_22:41:35.880933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:37.330897 run osmo-stp_10.42.42.5(pid=9333): stderr: | 20221213224136050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224136050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224136050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224136051 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224136051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224136051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224136051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:37.457295 run osmo-stp_10.42.42.5(pid=9333): stdout: | (launched: 2022-12-13_22:41:35.880933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:37.577895 run osmo-stp_10.42.42.5(pid=9333): stderr: | 20221213224136050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224136050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224136050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224136051 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224136051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224136051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224136051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:37.721269 run patchelf(pid=9336): Terminating (SIGINT) 22:41:37.886381 run patchelf(pid=9336): Terminated: ok {rc=0} 22:41:38.005088 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9333): Process ended prematurely: osmo-stp_10.42.42.5(pid=9333) [trial-2395↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9333)] [trial-2395↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 22:41:38.013830 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:41:38.040082 run osmo-hlr_10.42.42.2(pid=9330): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9330)] 22:41:38.087483 run osmo-hlr_10.42.42.2(pid=9330): stdout: | (launched: 2022-12-13_22:41:34.965582) 22:41:38.136262 run osmo-hlr_10.42.42.2(pid=9330): stderr: | 20221213224135139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224135139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224135139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224135139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224135139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224135139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224135151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224135160 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224135160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224135160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:38.185434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9329): Terminating (SIGTERM) 22:41:38.224526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9332): Terminating (SIGTERM) 22:41:38.263517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9335): Terminating (SIGTERM) 22:41:38.302668 --- ParallelTerminationStrategy: PID 9329 died... 22:41:38.321832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9329): Terminated: ok {rc=0} 22:41:38.367605 --- ParallelTerminationStrategy: PID 9332 died... 22:41:38.385965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9332): Terminated: ok {rc=0} 22:41:38.429003 --- ParallelTerminationStrategy: PID 9335 died... 22:41:38.447421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9335): Terminated: ok {rc=0} 22:41:38.529613 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 22:41:39.822075 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:41:39.827110 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:41:39.855556 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:41:39.895240 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:41:39.991481 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:41:40.022124 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:41:40.061432 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:41:40.651936 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:41:40.704656 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:40.716243 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:41:40.762427 tst cs_paging_gprs_active.py: using LAC 36723 22:41:40.887438 tst cs_paging_gprs_active.py: using RAC 3 22:41:41.024242 tst cs_paging_gprs_active.py: using CellId 36723 22:41:41.153536 tst cs_paging_gprs_active.py: using BVCI 36724 22:41:41.264161 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:41.275247 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:41.286191 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:41.296913 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:41.308222 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:41.319623 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:41.331009 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:41.342157 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:41.353484 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:41:41.475635 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:41:41.593995 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:41:41.795380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:42.095927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9340): Launched 22:41:42.357354 run iperf3-srv_10.42.42.10(pid=9341): Launched 22:41:42.470161 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:41:42.671114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:42.971302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9342): Launched 22:41:43.231898 run iperf3-srv_10.42.42.10(pid=9343): Launched 22:41:43.344272 tst cs_paging_gprs_active.py:38: start network... 22:41:43.545369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:44.009288 run create_hlr_db(pid=9344): Launched 22:41:44.132096 bus /gobi_6: Setting Powered False 22:41:45.191868 run create_hlr_db(pid=9344): Terminated: ok {rc=0} 22:41:45.610089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9346): Launched 22:41:45.919812 run osmo-hlr_10.42.42.2(pid=9347): Launched 22:41:46.166262 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:46.895962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9349): Launched 22:41:47.211012 run osmo-stp_10.42.42.5(pid=9350): Launched 22:41:47.440183 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:48.004794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9352): Launched 22:41:48.127672 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:48.400014 run patchelf(pid=9353): Launched 22:41:48.578603 run osmo-stp_10.42.42.5(pid=9350): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9350)] 22:41:48.714714 run osmo-stp_10.42.42.5(pid=9350): stdout: | (launched: 2022-12-13_22:41:47.148430) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:48.852720 run osmo-stp_10.42.42.5(pid=9350): stderr: | 20221213224147454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224147455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224147455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224147455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224147456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224147456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224147456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:48.990715 run osmo-stp_10.42.42.5(pid=9350): stdout: | (launched: 2022-12-13_22:41:47.148430) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:49.122824 run osmo-stp_10.42.42.5(pid=9350): stderr: | 20221213224147454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224147455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224147455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224147455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224147456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224147456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224147456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:49.279098 run patchelf(pid=9353): Terminating (SIGINT) 22:41:49.459471 run patchelf(pid=9353): Terminated: ok {rc=0} 22:41:49.589040 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9350): Process ended prematurely: osmo-stp_10.42.42.5(pid=9350) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9350)] [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:41:49.599147 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 22:41:49.627227 run osmo-hlr_10.42.42.2(pid=9347): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9347)] 22:41:49.677918 run osmo-hlr_10.42.42.2(pid=9347): stdout: | (launched: 2022-12-13_22:41:45.855364) 22:41:49.729961 run osmo-hlr_10.42.42.2(pid=9347): stderr: | 20221213224146110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224146111 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224146111 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224146111 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224146111 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224146111 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224146135 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224146158 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224146159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224146159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:49.782832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9340): Terminating (SIGTERM) 22:41:49.824376 run iperf3-srv_10.42.42.10(pid=9341): Terminating (SIGTERM) 22:41:49.866659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9342): Terminating (SIGTERM) 22:41:49.908834 run iperf3-srv_10.42.42.10(pid=9343): Terminating (SIGTERM) 22:41:49.950610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9346): Terminating (SIGTERM) 22:41:49.993054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9349): Terminating (SIGTERM) 22:41:50.035044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9352): Terminating (SIGTERM) 22:41:50.077053 --- ParallelTerminationStrategy: PID 9340 died... 22:41:50.097276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9340): Terminated: ok {rc=0} 22:41:50.143546 --- ParallelTerminationStrategy: PID 9341 died... 22:41:50.163383 run iperf3-srv_10.42.42.10(pid=9341): Terminated {rc=256} 22:41:50.209436 --- ParallelTerminationStrategy: PID 9342 died... 22:41:50.229370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9342): Terminated: ok {rc=0} 22:41:50.275384 --- ParallelTerminationStrategy: PID 9343 died... 22:41:50.295200 run iperf3-srv_10.42.42.10(pid=9343): Terminated {rc=256} 22:41:50.341447 --- ParallelTerminationStrategy: PID 9346 died... 22:41:50.361261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9346): Terminated: ok {rc=0} 22:41:50.407176 --- ParallelTerminationStrategy: PID 9349 died... 22:41:50.427189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9349): Terminated: ok {rc=0} 22:41:50.473576 --- ParallelTerminationStrategy: PID 9352 died... 22:41:50.493515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9352): Terminated: ok {rc=0} 22:41:50.581874 bus /gobi_0: Setting Powered False 22:41:51.680524 bus /gobi_0: Setting Powered False 22:41:52.796199 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:41:53.937954 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:53.949545 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:41:53.996564 tst iperf3.py: using LAC 36724 22:41:54.116231 tst iperf3.py: using RAC 4 22:41:54.239187 tst iperf3.py: using CellId 36724 22:41:54.355600 tst iperf3.py: using BVCI 36725 22:41:54.464455 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:54.475782 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:54.486774 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:54.497833 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:54.508810 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:54.519925 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:54.530887 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:54.541776 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:41:54.552670 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:41:54.670833 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:41:54.886697 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:41:55.207679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9354): Launched 22:41:55.485536 run iperf3-srv_10.42.42.10(pid=9355): Launched 22:41:55.605704 tst iperf3.py:8: start network... 22:41:55.820278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:56.314343 run create_hlr_db(pid=9356): Launched 22:41:56.439068 bus /gobi_6: Setting Powered False 22:41:57.502267 run create_hlr_db(pid=9356): Terminated: ok {rc=0} 22:41:57.929873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9358): Launched 22:41:58.228591 run osmo-hlr_10.42.42.2(pid=9359): Launched 22:41:58.343140 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:58.857705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9361): Launched 22:41:59.155619 run osmo-stp_10.42.42.5(pid=9362): Launched 22:41:59.269238 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:59.782608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9364): Launched 22:41:59.896615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:42:00.147835 run patchelf(pid=9365): Launched 22:42:00.314108 run osmo-stp_10.42.42.5(pid=9362): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9362)] 22:42:00.440736 run osmo-stp_10.42.42.5(pid=9362): stdout: | (launched: 2022-12-13_22:41:59.101440) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:00.569707 run osmo-stp_10.42.42.5(pid=9362): stderr: | 20221213224159271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224159271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224159271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224159272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224159272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224159272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224159272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:00.697945 run osmo-stp_10.42.42.5(pid=9362): stdout: | (launched: 2022-12-13_22:41:59.101440) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:00.820366 run osmo-stp_10.42.42.5(pid=9362): stderr: | 20221213224159271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224159271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224159271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224159272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224159272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224159272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224159272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:01.002170 run patchelf(pid=9365): Terminating (SIGINT) 22:42:01.259800 run patchelf(pid=9365): Terminated: ok {rc=0} 22:42:01.423292 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9362): Process ended prematurely: osmo-stp_10.42.42.5(pid=9362) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9362)] [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 22:42:01.435197 tst iperf3.py:8: Test FAILED (7.5 sec) 22:42:01.465558 run osmo-hlr_10.42.42.2(pid=9359): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9359)] 22:42:01.519702 run osmo-hlr_10.42.42.2(pid=9359): stdout: | (launched: 2022-12-13_22:41:58.174054) 22:42:01.574654 run osmo-hlr_10.42.42.2(pid=9359): stderr: | 20221213224158351 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224158351 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224158351 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224158351 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224158351 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224158351 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224158363 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224158373 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224158373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224158373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:01.635001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9354): Terminating (SIGTERM) 22:42:01.685703 run iperf3-srv_10.42.42.10(pid=9355): Terminating (SIGTERM) 22:42:01.740458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9358): Terminating (SIGTERM) 22:42:01.788310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9361): Terminating (SIGTERM) 22:42:01.836167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9364): Terminating (SIGTERM) 22:42:01.882393 --- ParallelTerminationStrategy: PID 9354 died... 22:42:01.906429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9354): Terminated: ok {rc=0} 22:42:01.957094 --- ParallelTerminationStrategy: PID 9355 died... 22:42:01.977460 run iperf3-srv_10.42.42.10(pid=9355): Terminated {rc=256} 22:42:02.026257 --- ParallelTerminationStrategy: PID 9358 died... 22:42:02.047279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9358): Terminated: ok {rc=0} 22:42:02.095121 --- ParallelTerminationStrategy: PID 9361 died... 22:42:02.116235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9361): Terminated: ok {rc=0} 22:42:02.164401 --- ParallelTerminationStrategy: PID 9364 died... 22:42:02.185512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9364): Terminated: ok {rc=0} 22:42:02.277268 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:42:03.421925 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:03.433555 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:42:03.480694 tst iperf3m4.py: using LAC 36725 22:42:03.597211 tst iperf3m4.py: using RAC 5 22:42:03.713782 tst iperf3m4.py: using CellId 36725 22:42:03.834201 tst iperf3m4.py: using BVCI 36726 22:42:03.943604 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:03.954868 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:03.965795 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:03.976629 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:03.987799 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:03.999177 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:04.010572 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:04.021766 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:04.033110 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:04.158841 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:04.275767 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:04.395346 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:04.512752 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:42:04.723961 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:05.043518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9368): Launched 22:42:05.321824 run iperf3-srv_10.42.42.10(pid=9369): Launched 22:42:05.442279 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:42:05.657885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:05.977834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9370): Launched 22:42:06.256101 run iperf3-srv_10.42.42.10(pid=9371): Launched 22:42:06.376685 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:42:06.592674 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:06.913456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9372): Launched 22:42:07.190991 run iperf3-srv_10.42.42.10(pid=9373): Launched 22:42:07.311250 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:42:07.527644 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:07.848009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9374): Launched 22:42:08.125644 run iperf3-srv_10.42.42.10(pid=9375): Launched 22:42:08.245177 tst iperf3m4.py:8: start network... 22:42:08.460334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:08.957967 run create_hlr_db(pid=9376): Launched 22:42:09.080345 bus /gobi_6: Setting Powered False 22:42:10.144175 run create_hlr_db(pid=9376): Terminated: ok {rc=0} 22:42:10.590095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9378): Launched 22:42:10.909118 run osmo-hlr_10.42.42.2(pid=9379): Launched 22:42:11.032493 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:11.586256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9381): Launched 22:42:11.906399 run osmo-stp_10.42.42.5(pid=9382): Launched 22:42:12.029310 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:42:12.581578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9384): Launched 22:42:12.704219 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:42:12.972847 run patchelf(pid=9385): Launched 22:42:13.150531 run osmo-stp_10.42.42.5(pid=9382): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9382)] 22:42:13.285850 run osmo-stp_10.42.42.5(pid=9382): stdout: | (launched: 2022-12-13_22:42:11.847932) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:13.423298 run osmo-stp_10.42.42.5(pid=9382): stderr: | 20221213224212040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224212040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224212041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224212041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224212041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224212041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224212042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:13.560112 run osmo-stp_10.42.42.5(pid=9382): stdout: | (launched: 2022-12-13_22:42:11.847932) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:13.691532 run osmo-stp_10.42.42.5(pid=9382): stderr: | 20221213224212040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224212040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224212041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224212041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224212041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224212041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224212042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:13.847315 run patchelf(pid=9385): Terminating (SIGINT) 22:42:14.026437 run patchelf(pid=9385): Terminated: ok {rc=0} 22:42:14.155332 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9382): Process ended prematurely: osmo-stp_10.42.42.5(pid=9382) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9382)] [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 22:42:14.165718 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:42:14.194261 run osmo-hlr_10.42.42.2(pid=9379): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9379)] 22:42:14.244402 run osmo-hlr_10.42.42.2(pid=9379): stdout: | (launched: 2022-12-13_22:42:10.850904) 22:42:14.296141 run osmo-hlr_10.42.42.2(pid=9379): stderr: | 20221213224211048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224211048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224211048 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224211048 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224211048 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224211048 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224211064 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224211074 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224211074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224211074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:14.348554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9368): Terminating (SIGTERM) 22:42:14.390404 run iperf3-srv_10.42.42.10(pid=9369): Terminating (SIGTERM) 22:42:14.432071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9370): Terminating (SIGTERM) 22:42:14.474230 run iperf3-srv_10.42.42.10(pid=9371): Terminating (SIGTERM) 22:42:14.516204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9372): Terminating (SIGTERM) 22:42:14.558425 run iperf3-srv_10.42.42.10(pid=9373): Terminating (SIGTERM) 22:42:14.600351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9374): Terminating (SIGTERM) 22:42:14.642344 run iperf3-srv_10.42.42.10(pid=9375): Terminating (SIGTERM) 22:42:14.684577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9378): Terminating (SIGTERM) 22:42:14.726360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9381): Terminating (SIGTERM) 22:42:14.767838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9384): Terminating (SIGTERM) 22:42:14.809959 --- ParallelTerminationStrategy: PID 9368 died... 22:42:14.830222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9368): Terminated: ok {rc=0} 22:42:14.876647 --- ParallelTerminationStrategy: PID 9369 died... 22:42:14.896333 run iperf3-srv_10.42.42.10(pid=9369): Terminated {rc=256} 22:42:14.942177 --- ParallelTerminationStrategy: PID 9370 died... 22:42:14.961752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9370): Terminated: ok {rc=0} 22:42:15.007670 --- ParallelTerminationStrategy: PID 9371 died... 22:42:15.027317 run iperf3-srv_10.42.42.10(pid=9371): Terminated {rc=256} 22:42:15.073142 --- ParallelTerminationStrategy: PID 9372 died... 22:42:15.092885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9372): Terminated: ok {rc=0} 22:42:15.138839 --- ParallelTerminationStrategy: PID 9373 died... 22:42:15.158464 run iperf3-srv_10.42.42.10(pid=9373): Terminated {rc=256} 22:42:15.204326 --- ParallelTerminationStrategy: PID 9374 died... 22:42:15.224145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9374): Terminated: ok {rc=0} 22:42:15.269917 --- ParallelTerminationStrategy: PID 9375 died... 22:42:15.289511 run iperf3-srv_10.42.42.10(pid=9375): Terminated {rc=256} 22:42:15.335175 --- ParallelTerminationStrategy: PID 9378 died... 22:42:15.355170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9378): Terminated: ok {rc=0} 22:42:15.400931 --- ParallelTerminationStrategy: PID 9381 died... 22:42:15.420708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9381): Terminated: ok {rc=0} 22:42:15.466842 --- ParallelTerminationStrategy: PID 9384 died... 22:42:15.486624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9384): Terminated: ok {rc=0} 22:42:15.574922 bus /gobi_4: Setting Powered False 22:42:16.671251 bus /gobi_4: Setting Powered False 22:42:17.784795 bus /gobi_1: Setting Powered False 22:42:18.880934 bus /gobi_1: Setting Powered False 22:42:19.996062 bus /gobi_0: Setting Powered False 22:42:21.095341 bus /gobi_0: Setting Powered False 22:42:22.214524 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 22:42:23.318348 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:23.329992 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:42:23.376698 tst ping.py: using LAC 36726 22:42:23.493344 tst ping.py: using RAC 6 22:42:23.608855 tst ping.py: using CellId 36726 22:42:23.723930 tst ping.py: using BVCI 36727 22:42:23.831976 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:23.843024 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:23.853814 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:23.864566 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:23.875289 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:23.886562 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:23.897645 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:23.908457 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:24.022764 tst ping.py:19: start network... 22:42:24.218769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:24.672525 run create_hlr_db(pid=9386): Launched 22:42:24.794492 bus /gobi_6: Setting Powered False 22:42:25.853292 run create_hlr_db(pid=9386): Terminated: ok {rc=0} 22:42:26.283709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9388): Launched 22:42:26.597107 run osmo-hlr_10.42.42.2(pid=9389): Launched 22:42:26.717463 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:27.261339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9391): Launched 22:42:27.575647 run osmo-stp_10.42.42.5(pid=9392): Launched 22:42:27.696270 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:42:28.238813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9394): Launched 22:42:28.359684 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:42:28.626007 run patchelf(pid=9395): Launched 22:42:28.801998 run osmo-stp_10.42.42.5(pid=9392): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9392)] 22:42:28.935527 run osmo-stp_10.42.42.5(pid=9392): stdout: | (launched: 2022-12-13_22:42:27.518327) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:29.070301 run osmo-stp_10.42.42.5(pid=9392): stderr: | 20221213224227710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224227710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224227711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224227711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224227711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224227711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224227711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:29.205505 run osmo-stp_10.42.42.5(pid=9392): stdout: | (launched: 2022-12-13_22:42:27.518327) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:29.334951 run osmo-stp_10.42.42.5(pid=9392): stderr: | 20221213224227710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224227710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224227711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224227711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224227711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224227711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224227711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:29.488614 run patchelf(pid=9395): Terminating (SIGINT) 22:42:29.664772 run patchelf(pid=9395): Terminated: ok {rc=0} 22:42:29.791667 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9392): Process ended prematurely: osmo-stp_10.42.42.5(pid=9392) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9392)] [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 22:42:29.801273 tst ping.py:22: Test FAILED (6.5 sec) 22:42:29.829362 run osmo-hlr_10.42.42.2(pid=9389): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9389)] 22:42:29.880538 run osmo-hlr_10.42.42.2(pid=9389): stdout: | (launched: 2022-12-13_22:42:26.540093) 22:42:29.932738 run osmo-hlr_10.42.42.2(pid=9389): stderr: | 20221213224226738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224226738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224226738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224226738 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224226738 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224226738 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224226755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224226764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224226764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224226764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:29.985676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9388): Terminating (SIGTERM) 22:42:30.027429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9391): Terminating (SIGTERM) 22:42:30.070152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9394): Terminating (SIGTERM) 22:42:30.112499 --- ParallelTerminationStrategy: PID 9388 died... 22:42:30.132939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9388): Terminated: ok {rc=0} 22:42:30.179617 --- ParallelTerminationStrategy: PID 9391 died... 22:42:30.199396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9391): Terminated: ok {rc=0} 22:42:30.245656 --- ParallelTerminationStrategy: PID 9394 died... 22:42:30.265471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9394): Terminated: ok {rc=0} 22:42:30.354580 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:42:31.446125 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:31.462328 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:42:31.518800 tst ping_idle_ping.py: using LAC 36727 22:42:31.682899 tst ping_idle_ping.py: using RAC 7 22:42:31.808511 tst ping_idle_ping.py: using CellId 36727 22:42:31.927251 tst ping_idle_ping.py: using BVCI 36728 22:42:32.075542 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:32.090832 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:32.103546 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:32.117300 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:32.131862 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:32.146607 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:32.161137 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:42:32.174430 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:42:32.292581 tst ping_idle_ping.py:24: start network... 22:42:32.507091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:32.998450 run create_hlr_db(pid=9396): Launched 22:42:33.120219 bus /gobi_6: Setting Powered False 22:42:34.183470 run create_hlr_db(pid=9396): Terminated: ok {rc=0} 22:42:34.605865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9398): Launched 22:42:34.902025 run osmo-hlr_10.42.42.2(pid=9399): Launched 22:42:35.014829 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:35.526839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9401): Launched 22:42:35.820815 run osmo-stp_10.42.42.5(pid=9402): Launched 22:42:35.933358 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:42:36.441314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9404): Launched 22:42:36.554034 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:42:36.803494 run patchelf(pid=9405): Launched 22:42:36.967284 run osmo-stp_10.42.42.5(pid=9402): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9402)] 22:42:37.091801 run osmo-stp_10.42.42.5(pid=9402): stdout: | (launched: 2022-12-13_22:42:35.766786) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:37.218143 run osmo-stp_10.42.42.5(pid=9402): stderr: | 20221213224235936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224235936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224235937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224235937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224235938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224235938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224235938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:37.344540 run osmo-stp_10.42.42.5(pid=9402): stdout: | (launched: 2022-12-13_22:42:35.766786) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:37.465294 run osmo-stp_10.42.42.5(pid=9402): stderr: | 20221213224235936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224235936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224235937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224235937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224235938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224235938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224235938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:37.608344 run patchelf(pid=9405): Terminating (SIGINT) 22:42:37.772891 run patchelf(pid=9405): Terminated: ok {rc=0} 22:42:37.891681 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9402): Process ended prematurely: osmo-stp_10.42.42.5(pid=9402) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9402)] [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 22:42:37.900560 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:42:37.927023 run osmo-hlr_10.42.42.2(pid=9399): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9399)] 22:42:37.974159 run osmo-hlr_10.42.42.2(pid=9399): stdout: | (launched: 2022-12-13_22:42:34.848183) 22:42:38.023098 run osmo-hlr_10.42.42.2(pid=9399): stderr: | 20221213224235022 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224235022 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224235022 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224235022 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224235022 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224235022 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224235035 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224235045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224235045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224235045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:38.072404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9398): Terminating (SIGTERM) 22:42:38.111873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9401): Terminating (SIGTERM) 22:42:38.150991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9404): Terminating (SIGTERM) 22:42:38.190691 --- ParallelTerminationStrategy: PID 9398 died... 22:42:38.209847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9398): Terminated: ok {rc=0} 22:42:38.253548 --- ParallelTerminationStrategy: PID 9401 died... 22:42:38.272083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9401): Terminated: ok {rc=0} 22:42:38.315648 --- ParallelTerminationStrategy: PID 9404 died... 22:42:38.334222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9404): Terminated: ok {rc=0} 22:42:38.418073 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:42:39.712693 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:42:39.718706 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:42:39.747170 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:42:39.785575 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:42:39.873975 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:42:39.902936 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:42:39.940809 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:42:40.534950 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:42:40.584142 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:40.595326 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:42:40.660724 tst cs_paging_gprs_active.py: using LAC 36728 22:42:40.784738 tst cs_paging_gprs_active.py: using RAC 8 22:42:40.911259 tst cs_paging_gprs_active.py: using CellId 36728 22:42:41.034564 tst cs_paging_gprs_active.py: using BVCI 36729 22:42:41.150781 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:41.162371 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:41.174061 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:41.185327 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:41.196882 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:41.208916 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:41.220763 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:41.232409 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:41.244151 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:42:41.361183 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:42:41.482329 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:42:41.699679 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:42.021209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9409): Launched 22:42:42.299978 run iperf3-srv_10.42.42.10(pid=9410): Launched 22:42:42.421470 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:42:42.637851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:42.959816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9411): Launched 22:42:43.239177 run iperf3-srv_10.42.42.10(pid=9412): Launched 22:42:43.359912 tst cs_paging_gprs_active.py:38: start network... 22:42:43.576784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:44.073769 run create_hlr_db(pid=9413): Launched 22:42:44.195403 bus /gobi_6: Setting Powered False 22:42:45.258944 run create_hlr_db(pid=9413): Terminated: ok {rc=0} 22:42:45.706484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9415): Launched 22:42:46.043835 run osmo-hlr_10.42.42.2(pid=9416): Launched 22:42:46.203368 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:46.918674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9418): Launched 22:42:47.264387 run osmo-stp_10.42.42.5(pid=9419): Launched 22:42:47.388209 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:42:47.931695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9421): Launched 22:42:48.047104 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:42:48.301155 run patchelf(pid=9422): Launched 22:42:48.468535 run osmo-stp_10.42.42.5(pid=9419): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9419)] 22:42:48.596032 run osmo-stp_10.42.42.5(pid=9419): stdout: | (launched: 2022-12-13_22:42:47.197231) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:48.725606 run osmo-stp_10.42.42.5(pid=9419): stderr: | 20221213224247488 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224247488 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224247488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224247488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224247491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224247491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224247491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:48.855143 run osmo-stp_10.42.42.5(pid=9419): stdout: | (launched: 2022-12-13_22:42:47.197231) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:48.979369 run osmo-stp_10.42.42.5(pid=9419): stderr: | 20221213224247488 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224247488 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224247488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224247488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224247491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224247491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224247491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:49.125725 run patchelf(pid=9422): Terminating (SIGINT) 22:42:49.294932 run patchelf(pid=9422): Terminated: ok {rc=0} 22:42:49.416750 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9419): Process ended prematurely: osmo-stp_10.42.42.5(pid=9419) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9419)] [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:42:49.426341 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 22:42:49.453429 run osmo-hlr_10.42.42.2(pid=9416): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9416)] 22:42:49.501077 run osmo-hlr_10.42.42.2(pid=9416): stdout: | (launched: 2022-12-13_22:42:45.980245) 22:42:49.550228 run osmo-hlr_10.42.42.2(pid=9416): stderr: | 20221213224246390 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224246390 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224246390 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224246392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224246393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224246393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224246419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224246436 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224246441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224246444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:49.599792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9409): Terminating (SIGTERM) 22:42:49.639363 run iperf3-srv_10.42.42.10(pid=9410): Terminating (SIGTERM) 22:42:49.679101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9411): Terminating (SIGTERM) 22:42:49.718842 run iperf3-srv_10.42.42.10(pid=9412): Terminating (SIGTERM) 22:42:49.758630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9415): Terminating (SIGTERM) 22:42:49.798385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9418): Terminating (SIGTERM) 22:42:49.838062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9421): Terminating (SIGTERM) 22:42:49.878078 --- ParallelTerminationStrategy: PID 9409 died... 22:42:49.897387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9409): Terminated: ok {rc=0} 22:42:49.941378 --- ParallelTerminationStrategy: PID 9410 died... 22:42:49.959954 run iperf3-srv_10.42.42.10(pid=9410): Terminated {rc=256} 22:42:50.003799 --- ParallelTerminationStrategy: PID 9411 died... 22:42:50.022584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9411): Terminated: ok {rc=0} 22:42:50.066186 --- ParallelTerminationStrategy: PID 9412 died... 22:42:50.084862 run iperf3-srv_10.42.42.10(pid=9412): Terminated {rc=256} 22:42:50.128633 --- ParallelTerminationStrategy: PID 9415 died... 22:42:50.147481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9415): Terminated: ok {rc=0} 22:42:50.191075 --- ParallelTerminationStrategy: PID 9418 died... 22:42:50.209962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9418): Terminated: ok {rc=0} 22:42:50.253698 --- ParallelTerminationStrategy: PID 9421 died... 22:42:50.272477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9421): Terminated: ok {rc=0} 22:42:50.358483 bus /gobi_0: Setting Powered False 22:42:51.458526 bus /gobi_0: Setting Powered False 22:42:52.572899 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:42:53.718717 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:53.730497 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:42:53.799234 tst iperf3.py: using LAC 36729 22:42:53.916758 tst iperf3.py: using RAC 9 22:42:54.035073 tst iperf3.py: using CellId 36729 22:42:54.155021 tst iperf3.py: using BVCI 36730 22:42:54.265660 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:54.276569 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:54.287349 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:54.298195 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:54.309088 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:54.320079 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:54.331148 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:54.342050 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:42:54.353304 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:42:54.472836 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:42:54.689283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:42:55.011503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9423): Launched 22:42:55.290843 run iperf3-srv_10.42.42.10(pid=9424): Launched 22:42:55.412320 tst iperf3.py:8: start network... 22:42:55.629373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:56.125411 run create_hlr_db(pid=9425): Launched 22:42:56.247635 bus /gobi_6: Setting Powered False 22:42:57.310822 run create_hlr_db(pid=9425): Terminated: ok {rc=0} 22:42:57.757526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9427): Launched 22:42:58.076492 run osmo-hlr_10.42.42.2(pid=9428): Launched 22:42:58.199263 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:58.760875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9430): Launched 22:42:59.080385 run osmo-stp_10.42.42.5(pid=9431): Launched 22:42:59.202884 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:42:59.754618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9433): Launched 22:42:59.877742 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:43:00.148549 run patchelf(pid=9434): Launched 22:43:00.326439 run osmo-stp_10.42.42.5(pid=9431): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9431)] 22:43:00.463066 run osmo-stp_10.42.42.5(pid=9431): stdout: | (launched: 2022-12-13_22:42:59.022514) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:00.600508 run osmo-stp_10.42.42.5(pid=9431): stderr: | 20221213224259214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224259214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224259214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224259214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224259215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224259215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224259215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:00.737896 run osmo-stp_10.42.42.5(pid=9431): stdout: | (launched: 2022-12-13_22:42:59.022514) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:00.883424 run osmo-stp_10.42.42.5(pid=9431): stderr: | 20221213224259214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224259214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224259214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224259214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224259215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224259215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224259215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:01.042949 run patchelf(pid=9434): Terminating (SIGINT) 22:43:01.225691 run patchelf(pid=9434): Terminated: ok {rc=0} 22:43:01.358239 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9431): Process ended prematurely: osmo-stp_10.42.42.5(pid=9431) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9431)] [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 22:43:01.369577 tst iperf3.py:8: Test FAILED (7.7 sec) 22:43:01.399260 run osmo-hlr_10.42.42.2(pid=9428): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9428)] 22:43:01.451349 run osmo-hlr_10.42.42.2(pid=9428): stdout: | (launched: 2022-12-13_22:42:58.018519) 22:43:01.503073 run osmo-hlr_10.42.42.2(pid=9428): stderr: | 20221213224258219 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224258219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224258219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224258219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224258219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224258219 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224258231 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224258240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224258240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224258240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:01.557100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9423): Terminating (SIGTERM) 22:43:01.599421 run iperf3-srv_10.42.42.10(pid=9424): Terminating (SIGTERM) 22:43:01.646256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9427): Terminating (SIGTERM) 22:43:01.690430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9430): Terminating (SIGTERM) 22:43:01.734971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9433): Terminating (SIGTERM) 22:43:01.779398 --- ParallelTerminationStrategy: PID 9423 died... 22:43:01.800604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9423): Terminated: ok {rc=0} 22:43:01.849031 --- ParallelTerminationStrategy: PID 9424 died... 22:43:01.869650 run iperf3-srv_10.42.42.10(pid=9424): Terminated {rc=256} 22:43:01.918594 --- ParallelTerminationStrategy: PID 9427 died... 22:43:01.938954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9427): Terminated: ok {rc=0} 22:43:01.984862 --- ParallelTerminationStrategy: PID 9430 died... 22:43:02.006628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9430): Terminated: ok {rc=0} 22:43:02.053504 --- ParallelTerminationStrategy: PID 9433 died... 22:43:02.074122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9433): Terminated: ok {rc=0} 22:43:02.161748 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:43:03.306779 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:03.318522 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:43:03.385383 tst iperf3m4.py: using LAC 36730 22:43:03.503524 tst iperf3m4.py: using RAC 10 22:43:03.623629 tst iperf3m4.py: using CellId 36730 22:43:03.743568 tst iperf3m4.py: using BVCI 36731 22:43:03.854170 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:03.865423 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:03.876392 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:03.887424 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:03.898961 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:03.910435 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:03.922041 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:03.933516 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:03.945128 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:04.066386 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:04.185138 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:04.305751 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:04.423212 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:43:04.625181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:04.926293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9435): Launched 22:43:05.189064 run iperf3-srv_10.42.42.10(pid=9436): Launched 22:43:05.302455 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:43:05.504510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:05.805985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9437): Launched 22:43:06.067033 run iperf3-srv_10.42.42.10(pid=9438): Launched 22:43:06.180104 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:43:06.381086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:06.681628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9439): Launched 22:43:06.942459 run iperf3-srv_10.42.42.10(pid=9440): Launched 22:43:07.055413 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:43:07.255430 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:07.555588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9441): Launched 22:43:07.817284 run iperf3-srv_10.42.42.10(pid=9442): Launched 22:43:07.929535 tst iperf3m4.py:8: start network... 22:43:08.129621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:08.591899 run create_hlr_db(pid=9443): Launched 22:43:08.713576 bus /gobi_6: Setting Powered False 22:43:09.773553 run create_hlr_db(pid=9443): Terminated: ok {rc=0} 22:43:10.190020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9445): Launched 22:43:10.488483 run osmo-hlr_10.42.42.2(pid=9446): Launched 22:43:10.604104 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:11.136644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9448): Launched 22:43:11.437751 run osmo-stp_10.42.42.5(pid=9449): Launched 22:43:11.552301 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:43:12.069157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9451): Launched 22:43:12.183928 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:43:12.437742 run patchelf(pid=9452): Launched 22:43:12.604199 run osmo-stp_10.42.42.5(pid=9449): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9449)] 22:43:12.730434 run osmo-stp_10.42.42.5(pid=9449): stdout: | (launched: 2022-12-13_22:43:11.382935) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:12.858783 run osmo-stp_10.42.42.5(pid=9449): stderr: | 20221213224311553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224311553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224311553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224311553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224311554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224311554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224311554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:12.986514 run osmo-stp_10.42.42.5(pid=9449): stdout: | (launched: 2022-12-13_22:43:11.382935) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:13.109547 run osmo-stp_10.42.42.5(pid=9449): stderr: | 20221213224311553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224311553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224311553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224311553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224311554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224311554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224311554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:13.254645 run patchelf(pid=9452): Terminating (SIGINT) 22:43:13.422100 run patchelf(pid=9452): Terminated: ok {rc=0} 22:43:13.542814 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9449): Process ended prematurely: osmo-stp_10.42.42.5(pid=9449) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9449)] [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:43:13.552172 tst iperf3m4.py:8: Test FAILED (10.3 sec) 22:43:13.579457 run osmo-hlr_10.42.42.2(pid=9446): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9446)] 22:43:13.626411 run osmo-hlr_10.42.42.2(pid=9446): stdout: | (launched: 2022-12-13_22:43:10.433871) 22:43:13.675282 run osmo-hlr_10.42.42.2(pid=9446): stderr: | 20221213224310609 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224310609 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224310609 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224310609 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224310609 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224310609 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224310621 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224310630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224310630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224310630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:13.724923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9435): Terminating (SIGTERM) 22:43:13.764245 run iperf3-srv_10.42.42.10(pid=9436): Terminating (SIGTERM) 22:43:13.803421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9437): Terminating (SIGTERM) 22:43:13.843293 run iperf3-srv_10.42.42.10(pid=9438): Terminating (SIGTERM) 22:43:13.882273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9439): Terminating (SIGTERM) 22:43:13.921591 run iperf3-srv_10.42.42.10(pid=9440): Terminating (SIGTERM) 22:43:13.960629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9441): Terminating (SIGTERM) 22:43:13.999725 run iperf3-srv_10.42.42.10(pid=9442): Terminating (SIGTERM) 22:43:14.038681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9445): Terminating (SIGTERM) 22:43:14.077669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9448): Terminating (SIGTERM) 22:43:14.116854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9451): Terminating (SIGTERM) 22:43:14.156269 --- ParallelTerminationStrategy: PID 9435 died... 22:43:14.175101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9435): Terminated: ok {rc=0} 22:43:14.218623 --- ParallelTerminationStrategy: PID 9436 died... 22:43:14.237095 run iperf3-srv_10.42.42.10(pid=9436): Terminated {rc=256} 22:43:14.280386 --- ParallelTerminationStrategy: PID 9437 died... 22:43:14.298825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9437): Terminated: ok {rc=0} 22:43:14.342272 --- ParallelTerminationStrategy: PID 9438 died... 22:43:14.360533 run iperf3-srv_10.42.42.10(pid=9438): Terminated {rc=256} 22:43:14.404087 --- ParallelTerminationStrategy: PID 9439 died... 22:43:14.422600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9439): Terminated: ok {rc=0} 22:43:14.465927 --- ParallelTerminationStrategy: PID 9440 died... 22:43:14.484349 run iperf3-srv_10.42.42.10(pid=9440): Terminated {rc=256} 22:43:14.527808 --- ParallelTerminationStrategy: PID 9441 died... 22:43:14.546434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9441): Terminated: ok {rc=0} 22:43:14.590090 --- ParallelTerminationStrategy: PID 9442 died... 22:43:14.608627 run iperf3-srv_10.42.42.10(pid=9442): Terminated {rc=256} 22:43:14.651972 --- ParallelTerminationStrategy: PID 9445 died... 22:43:14.670583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9445): Terminated: ok {rc=0} 22:43:14.714033 --- ParallelTerminationStrategy: PID 9448 died... 22:43:14.732566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9448): Terminated: ok {rc=0} 22:43:14.776021 --- ParallelTerminationStrategy: PID 9451 died... 22:43:14.794551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9451): Terminated: ok {rc=0} 22:43:14.879996 bus /gobi_4: Setting Powered False 22:43:15.981683 bus /gobi_4: Setting Powered False 22:43:17.119044 bus /gobi_1: Setting Powered False 22:43:18.224431 bus /gobi_1: Setting Powered False 22:43:19.339558 bus /gobi_0: Setting Powered False 22:43:20.438165 bus /gobi_0: Setting Powered False 22:43:21.553844 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:43:22.657465 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:22.669206 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:43:22.734759 tst ping.py: using LAC 36731 22:43:22.851649 tst ping.py: using RAC 11 22:43:22.968029 tst ping.py: using CellId 36731 22:43:23.083578 tst ping.py: using BVCI 36732 22:43:23.191319 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:23.202659 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:23.213679 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:23.224550 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:23.235483 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:23.246529 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:23.257647 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:23.268519 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:23.382236 tst ping.py:19: start network... 22:43:23.579368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:24.034286 run create_hlr_db(pid=9453): Launched 22:43:24.155089 bus /gobi_6: Setting Powered False 22:43:25.215071 run create_hlr_db(pid=9453): Terminated: ok {rc=0} 22:43:25.645965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9455): Launched 22:43:25.960507 run osmo-hlr_10.42.42.2(pid=9456): Launched 22:43:26.081473 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:26.625833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9458): Launched 22:43:26.940420 run osmo-stp_10.42.42.5(pid=9459): Launched 22:43:27.061252 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:43:27.605273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9461): Launched 22:43:27.718830 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:43:27.966499 run patchelf(pid=9462): Launched 22:43:28.130005 run osmo-stp_10.42.42.5(pid=9459): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9459)] 22:43:28.254736 run osmo-stp_10.42.42.5(pid=9459): stdout: | (launched: 2022-12-13_22:43:26.883102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:28.380573 run osmo-stp_10.42.42.5(pid=9459): stderr: | 20221213224327075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224327075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224327075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224327075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224327076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224327076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224327076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:28.507144 run osmo-stp_10.42.42.5(pid=9459): stdout: | (launched: 2022-12-13_22:43:26.883102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:28.627722 run osmo-stp_10.42.42.5(pid=9459): stderr: | 20221213224327075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224327075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224327075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224327075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224327076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224327076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224327076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:28.771051 run patchelf(pid=9462): Terminating (SIGINT) 22:43:28.936035 run patchelf(pid=9462): Terminated: ok {rc=0} 22:43:29.054686 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9459): Process ended prematurely: osmo-stp_10.42.42.5(pid=9459) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9459)] [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 22:43:29.063411 tst ping.py:22: Test FAILED (6.4 sec) 22:43:29.090018 run osmo-hlr_10.42.42.2(pid=9456): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9456)] 22:43:29.137245 run osmo-hlr_10.42.42.2(pid=9456): stdout: | (launched: 2022-12-13_22:43:25.903482) 22:43:29.186483 run osmo-hlr_10.42.42.2(pid=9456): stderr: | 20221213224326102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224326102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224326102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224326102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224326103 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224326103 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224326115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224326125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224326125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224326125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:29.236160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9455): Terminating (SIGTERM) 22:43:29.275551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9458): Terminating (SIGTERM) 22:43:29.314647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9461): Terminating (SIGTERM) 22:43:29.354078 --- ParallelTerminationStrategy: PID 9455 died... 22:43:29.373156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9455): Terminated: ok {rc=0} 22:43:29.417038 --- ParallelTerminationStrategy: PID 9458 died... 22:43:29.435860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9458): Terminated: ok {rc=0} 22:43:29.479187 --- ParallelTerminationStrategy: PID 9461 died... 22:43:29.497842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9461): Terminated: ok {rc=0} 22:43:29.580183 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:43:30.665928 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:30.678135 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:43:30.746823 tst ping_idle_ping.py: using LAC 36732 22:43:30.875796 tst ping_idle_ping.py: using RAC 12 22:43:30.999322 tst ping_idle_ping.py: using CellId 36732 22:43:31.118593 tst ping_idle_ping.py: using BVCI 36733 22:43:31.254940 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:31.267098 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:31.279245 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:31.291229 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:31.304072 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:31.317130 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:31.330213 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:43:31.342968 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:43:31.461831 tst ping_idle_ping.py:24: start network... 22:43:31.665700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:32.143929 run create_hlr_db(pid=9463): Launched 22:43:32.287910 bus /gobi_6: Setting Powered False 22:43:33.351443 run create_hlr_db(pid=9463): Terminated: ok {rc=0} 22:43:33.776656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9465): Launched 22:43:34.073765 run osmo-hlr_10.42.42.2(pid=9466): Launched 22:43:34.187193 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:34.701939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9468): Launched 22:43:34.997059 run osmo-stp_10.42.42.5(pid=9469): Launched 22:43:35.110820 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:43:35.622828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9471): Launched 22:43:35.735644 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:43:35.985273 run patchelf(pid=9472): Launched 22:43:36.150908 run osmo-stp_10.42.42.5(pid=9469): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9469)] 22:43:36.275869 run osmo-stp_10.42.42.5(pid=9469): stdout: | (launched: 2022-12-13_22:43:34.942915) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:36.402579 run osmo-stp_10.42.42.5(pid=9469): stderr: | 20221213224335112 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224335112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224335112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224335113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224335113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224335113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224335113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:36.529131 run osmo-stp_10.42.42.5(pid=9469): stdout: | (launched: 2022-12-13_22:43:34.942915) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:36.650328 run osmo-stp_10.42.42.5(pid=9469): stderr: | 20221213224335112 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224335112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224335112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224335113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224335113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224335113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224335113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:36.793948 run patchelf(pid=9472): Terminating (SIGINT) 22:43:36.959090 run patchelf(pid=9472): Terminated: ok {rc=0} 22:43:37.078166 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9469): Process ended prematurely: osmo-stp_10.42.42.5(pid=9469) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9469)] [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:43:37.086921 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:43:37.113396 run osmo-hlr_10.42.42.2(pid=9466): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9466)] 22:43:37.160560 run osmo-hlr_10.42.42.2(pid=9466): stdout: | (launched: 2022-12-13_22:43:34.019550) 22:43:37.209398 run osmo-hlr_10.42.42.2(pid=9466): stderr: | 20221213224334194 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224334194 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224334194 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224334194 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224334194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224334194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224334206 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224334215 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224334215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224334215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:37.258931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9465): Terminating (SIGTERM) 22:43:37.298704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9468): Terminating (SIGTERM) 22:43:37.337909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9471): Terminating (SIGTERM) 22:43:37.377582 --- ParallelTerminationStrategy: PID 9465 died... 22:43:37.396745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9465): Terminated: ok {rc=0} 22:43:37.440618 --- ParallelTerminationStrategy: PID 9468 died... 22:43:37.459272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9468): Terminated: ok {rc=0} 22:43:37.502798 --- ParallelTerminationStrategy: PID 9471 died... 22:43:37.521428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9471): Terminated: ok {rc=0} 22:43:37.606904 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:43:38.906348 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:43:38.912281 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:43:38.940726 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:43:38.979890 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:43:39.066987 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:43:39.095699 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:43:39.133830 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:43:39.734552 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:43:39.787998 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:39.799658 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:43:39.867363 tst cs_paging_gprs_active.py: using LAC 36733 22:43:39.994459 tst cs_paging_gprs_active.py: using RAC 13 22:43:40.120261 tst cs_paging_gprs_active.py: using CellId 36733 22:43:40.247515 tst cs_paging_gprs_active.py: using BVCI 36734 22:43:40.366357 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:40.378008 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:40.389674 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:40.401143 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:40.412932 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:40.424730 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:40.436664 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:40.448636 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:40.460380 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:43:40.577610 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:43:40.694175 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:43:40.896941 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:41.198778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9477): Launched 22:43:41.461703 run iperf3-srv_10.42.42.10(pid=9478): Launched 22:43:41.574440 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:43:41.775973 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:42.077623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9479): Launched 22:43:42.339135 run iperf3-srv_10.42.42.10(pid=9480): Launched 22:43:42.451451 tst cs_paging_gprs_active.py:38: start network... 22:43:42.652763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:43.118059 run create_hlr_db(pid=9481): Launched 22:43:43.242465 bus /gobi_6: Setting Powered False 22:43:44.302570 run create_hlr_db(pid=9481): Terminated: ok {rc=0} 22:43:44.742625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9483): Launched 22:43:45.064908 run osmo-hlr_10.42.42.2(pid=9484): Launched 22:43:45.189497 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:45.744361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9486): Launched 22:43:46.091705 run osmo-stp_10.42.42.5(pid=9487): Launched 22:43:46.284371 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:43:46.944407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9489): Launched 22:43:47.082169 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:43:47.351142 run patchelf(pid=9490): Launched 22:43:47.519553 run osmo-stp_10.42.42.5(pid=9487): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9487)] 22:43:47.646886 run osmo-stp_10.42.42.5(pid=9487): stdout: | (launched: 2022-12-13_22:43:46.021131) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:47.776061 run osmo-stp_10.42.42.5(pid=9487): stderr: | 20221213224346304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224346304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224346304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224346304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224346305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224346305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224346305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:47.904645 run osmo-stp_10.42.42.5(pid=9487): stdout: | (launched: 2022-12-13_22:43:46.021131) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:48.027790 run osmo-stp_10.42.42.5(pid=9487): stderr: | 20221213224346304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224346304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224346304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224346304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224346305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224346305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224346305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:48.174161 run patchelf(pid=9490): Terminating (SIGINT) 22:43:48.343495 run patchelf(pid=9490): Terminated: ok {rc=0} 22:43:48.465406 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9487): Process ended prematurely: osmo-stp_10.42.42.5(pid=9487) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9487)] [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:43:48.474896 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:43:48.502219 run osmo-hlr_10.42.42.2(pid=9484): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9484)] 22:43:48.549547 run osmo-hlr_10.42.42.2(pid=9484): stdout: | (launched: 2022-12-13_22:43:45.006583) 22:43:48.598701 run osmo-hlr_10.42.42.2(pid=9484): stderr: | 20221213224345205 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224345205 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224345205 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224345205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224345205 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224345205 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224345218 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224345228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224345228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224345229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:48.648302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9477): Terminating (SIGTERM) 22:43:48.687911 run iperf3-srv_10.42.42.10(pid=9478): Terminating (SIGTERM) 22:43:48.727309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9479): Terminating (SIGTERM) 22:43:48.766743 run iperf3-srv_10.42.42.10(pid=9480): Terminating (SIGTERM) 22:43:48.806218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9483): Terminating (SIGTERM) 22:43:48.845746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9486): Terminating (SIGTERM) 22:43:48.885337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9489): Terminating (SIGTERM) 22:43:48.925477 --- ParallelTerminationStrategy: PID 9477 died... 22:43:48.944424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9477): Terminated: ok {rc=0} 22:43:48.988227 --- ParallelTerminationStrategy: PID 9478 died... 22:43:49.006785 run iperf3-srv_10.42.42.10(pid=9478): Terminated {rc=256} 22:43:49.050219 --- ParallelTerminationStrategy: PID 9479 died... 22:43:49.068739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9479): Terminated: ok {rc=0} 22:43:49.112442 --- ParallelTerminationStrategy: PID 9480 died... 22:43:49.131091 run iperf3-srv_10.42.42.10(pid=9480): Terminated {rc=256} 22:43:49.174645 --- ParallelTerminationStrategy: PID 9483 died... 22:43:49.193234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9483): Terminated: ok {rc=0} 22:43:49.236625 --- ParallelTerminationStrategy: PID 9486 died... 22:43:49.255201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9486): Terminated: ok {rc=0} 22:43:49.298862 --- ParallelTerminationStrategy: PID 9489 died... 22:43:49.317325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9489): Terminated: ok {rc=0} 22:43:49.402899 bus /gobi_0: Setting Powered False 22:43:50.502075 bus /gobi_0: Setting Powered False 22:43:51.616597 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:43:52.766175 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:52.778492 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:43:52.849684 tst iperf3.py: using LAC 36734 22:43:52.977634 tst iperf3.py: using RAC 14 22:43:53.100702 tst iperf3.py: using CellId 36734 22:43:53.230247 tst iperf3.py: using BVCI 36735 22:43:53.348490 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:53.360053 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:53.371398 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:53.382945 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:53.394701 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:53.406772 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:53.418746 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:53.430454 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:43:53.442361 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:43:53.559479 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:43:53.759628 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:43:54.059593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9491): Launched 22:43:54.321513 run iperf3-srv_10.42.42.10(pid=9492): Launched 22:43:54.434046 tst iperf3.py:8: start network... 22:43:54.634113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:55.097818 run create_hlr_db(pid=9493): Launched 22:43:55.221733 bus /gobi_6: Setting Powered False 22:43:56.282113 run create_hlr_db(pid=9493): Terminated: ok {rc=0} 22:43:56.722099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9495): Launched 22:43:57.043080 run osmo-hlr_10.42.42.2(pid=9496): Launched 22:43:57.166468 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:57.723904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9498): Launched 22:43:58.045433 run osmo-stp_10.42.42.5(pid=9499): Launched 22:43:58.168481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:43:58.725560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9501): Launched 22:43:58.847926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:43:59.118746 run patchelf(pid=9502): Launched 22:43:59.297686 run osmo-stp_10.42.42.5(pid=9499): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9499)] 22:43:59.434494 run osmo-stp_10.42.42.5(pid=9499): stdout: | (launched: 2022-12-13_22:43:57.987169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:59.572322 run osmo-stp_10.42.42.5(pid=9499): stderr: | 20221213224358178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224358178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224358178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224358179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224358181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224358181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224358181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:59.710430 run osmo-stp_10.42.42.5(pid=9499): stdout: | (launched: 2022-12-13_22:43:57.987169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:59.842156 run osmo-stp_10.42.42.5(pid=9499): stderr: | 20221213224358178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224358178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224358178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224358179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224358181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224358181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224358181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:59.998397 run patchelf(pid=9502): Terminating (SIGINT) 22:44:00.178181 run patchelf(pid=9502): Terminated: ok {rc=0} 22:44:00.308210 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9499): Process ended prematurely: osmo-stp_10.42.42.5(pid=9499) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9499)] [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 22:44:00.318551 tst iperf3.py:8: Test FAILED (7.6 sec) 22:44:00.347100 run osmo-hlr_10.42.42.2(pid=9496): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9496)] 22:44:00.398180 run osmo-hlr_10.42.42.2(pid=9496): stdout: | (launched: 2022-12-13_22:43:56.984891) 22:44:00.450697 run osmo-hlr_10.42.42.2(pid=9496): stderr: | 20221213224357181 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224357181 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224357181 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224357181 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224357181 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224357181 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224357194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224357202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224357202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224357203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:00.503556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9491): Terminating (SIGTERM) 22:44:00.545381 run iperf3-srv_10.42.42.10(pid=9492): Terminating (SIGTERM) 22:44:00.587542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9495): Terminating (SIGTERM) 22:44:00.629973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9498): Terminating (SIGTERM) 22:44:00.672416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9501): Terminating (SIGTERM) 22:44:00.714886 --- ParallelTerminationStrategy: PID 9491 died... 22:44:00.735279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9491): Terminated: ok {rc=0} 22:44:00.782097 --- ParallelTerminationStrategy: PID 9492 died... 22:44:00.802096 run iperf3-srv_10.42.42.10(pid=9492): Terminated {rc=256} 22:44:00.857677 --- ParallelTerminationStrategy: PID 9495 died... 22:44:00.877614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9495): Terminated: ok {rc=0} 22:44:00.924270 --- ParallelTerminationStrategy: PID 9498 died... 22:44:00.945132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9498): Terminated: ok {rc=0} 22:44:00.991298 --- ParallelTerminationStrategy: PID 9501 died... 22:44:01.013077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9501): Terminated: ok {rc=0} 22:44:01.101579 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:44:02.265088 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:02.277601 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:44:02.346607 tst iperf3m4.py: using LAC 36735 22:44:02.474092 tst iperf3m4.py: using RAC 15 22:44:02.600314 tst iperf3m4.py: using CellId 36735 22:44:02.725320 tst iperf3m4.py: using BVCI 36736 22:44:02.835666 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:02.846859 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:02.858010 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:02.868911 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:02.880458 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:02.891994 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:02.903903 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:02.915416 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:02.927203 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:03.048545 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:03.167350 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:03.287110 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:03.406437 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:44:03.609622 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:44:03.910722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9503): Launched 22:44:04.173259 run iperf3-srv_10.42.42.10(pid=9504): Launched 22:44:04.285670 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:44:04.486708 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:44:04.787545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9505): Launched 22:44:05.048940 run iperf3-srv_10.42.42.10(pid=9506): Launched 22:44:05.161310 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:44:05.361483 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:44:05.663099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9507): Launched 22:44:05.923715 run iperf3-srv_10.42.42.10(pid=9508): Launched 22:44:06.035947 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:44:06.236218 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:44:06.537067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9509): Launched 22:44:06.799113 run iperf3-srv_10.42.42.10(pid=9510): Launched 22:44:06.911828 tst iperf3m4.py:8: start network... 22:44:07.111818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:07.577266 run create_hlr_db(pid=9511): Launched 22:44:07.700292 bus /gobi_6: Setting Powered False 22:44:08.760870 run create_hlr_db(pid=9511): Terminated: ok {rc=0} 22:44:09.200073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9513): Launched 22:44:09.522602 run osmo-hlr_10.42.42.2(pid=9514): Launched 22:44:09.646095 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:10.199683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9516): Launched 22:44:10.521468 run osmo-stp_10.42.42.5(pid=9517): Launched 22:44:10.645071 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:44:11.198902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9519): Launched 22:44:11.323309 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:44:11.596315 run patchelf(pid=9520): Launched 22:44:11.775324 run osmo-stp_10.42.42.5(pid=9517): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9517)] 22:44:11.911896 run osmo-stp_10.42.42.5(pid=9517): stdout: | (launched: 2022-12-13_22:44:10.463124) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:12.051883 run osmo-stp_10.42.42.5(pid=9517): stderr: | 20221213224410653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224410653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224410653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224410654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224410654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224410654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224410654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:12.189901 run osmo-stp_10.42.42.5(pid=9517): stdout: | (launched: 2022-12-13_22:44:10.463124) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:12.321908 run osmo-stp_10.42.42.5(pid=9517): stderr: | 20221213224410653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224410653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224410653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224410654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224410654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224410654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224410654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:12.479053 run patchelf(pid=9520): Terminating (SIGINT) 22:44:12.659316 run patchelf(pid=9520): Terminated: ok {rc=0} 22:44:12.789378 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9517): Process ended prematurely: osmo-stp_10.42.42.5(pid=9517) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9517)] [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:44:12.800021 tst iperf3m4.py:8: Test FAILED (10.6 sec) 22:44:12.829306 run osmo-hlr_10.42.42.2(pid=9514): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9514)] 22:44:12.880468 run osmo-hlr_10.42.42.2(pid=9514): stdout: | (launched: 2022-12-13_22:44:09.464279) 22:44:12.932713 run osmo-hlr_10.42.42.2(pid=9514): stderr: | 20221213224409663 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224409663 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224409663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224409663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224409663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224409663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224409675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224409683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224409683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224409683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:12.985559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9503): Terminating (SIGTERM) 22:44:13.027945 run iperf3-srv_10.42.42.10(pid=9504): Terminating (SIGTERM) 22:44:13.070757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9505): Terminating (SIGTERM) 22:44:13.112801 run iperf3-srv_10.42.42.10(pid=9506): Terminating (SIGTERM) 22:44:13.156479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9507): Terminating (SIGTERM) 22:44:13.198892 run iperf3-srv_10.42.42.10(pid=9508): Terminating (SIGTERM) 22:44:13.241303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9509): Terminating (SIGTERM) 22:44:13.283277 run iperf3-srv_10.42.42.10(pid=9510): Terminating (SIGTERM) 22:44:13.325665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9513): Terminating (SIGTERM) 22:44:13.367611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9516): Terminating (SIGTERM) 22:44:13.410277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9519): Terminating (SIGTERM) 22:44:13.452366 --- ParallelTerminationStrategy: PID 9503 died... 22:44:13.472759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9503): Terminated: ok {rc=0} 22:44:13.519396 --- ParallelTerminationStrategy: PID 9504 died... 22:44:13.539316 run iperf3-srv_10.42.42.10(pid=9504): Terminated {rc=256} 22:44:13.585557 --- ParallelTerminationStrategy: PID 9505 died... 22:44:13.605222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9505): Terminated: ok {rc=0} 22:44:13.651696 --- ParallelTerminationStrategy: PID 9506 died... 22:44:13.671564 run iperf3-srv_10.42.42.10(pid=9506): Terminated {rc=256} 22:44:13.717739 --- ParallelTerminationStrategy: PID 9507 died... 22:44:13.737613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9507): Terminated: ok {rc=0} 22:44:13.783801 --- ParallelTerminationStrategy: PID 9508 died... 22:44:13.803609 run iperf3-srv_10.42.42.10(pid=9508): Terminated {rc=256} 22:44:13.849893 --- ParallelTerminationStrategy: PID 9509 died... 22:44:13.869761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9509): Terminated: ok {rc=0} 22:44:13.916087 --- ParallelTerminationStrategy: PID 9510 died... 22:44:13.935883 run iperf3-srv_10.42.42.10(pid=9510): Terminated {rc=256} 22:44:13.982039 --- ParallelTerminationStrategy: PID 9513 died... 22:44:14.001930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9513): Terminated: ok {rc=0} 22:44:14.048005 --- ParallelTerminationStrategy: PID 9516 died... 22:44:14.067939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9516): Terminated: ok {rc=0} 22:44:14.114130 --- ParallelTerminationStrategy: PID 9519 died... 22:44:14.134055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9519): Terminated: ok {rc=0} 22:44:14.222379 bus /gobi_4: Setting Powered False 22:44:15.323297 bus /gobi_4: Setting Powered False 22:44:16.439263 bus /gobi_1: Setting Powered False 22:44:17.536480 bus /gobi_1: Setting Powered False 22:44:18.652070 bus /gobi_0: Setting Powered False 22:44:19.749067 bus /gobi_0: Setting Powered False 22:44:20.865354 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:44:21.967852 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:21.979908 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:44:22.049789 tst ping.py: using LAC 36736 22:44:22.174302 tst ping.py: using RAC 16 22:44:22.300164 tst ping.py: using CellId 36736 22:44:22.424321 tst ping.py: using BVCI 36737 22:44:22.538252 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:22.549787 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:22.561097 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:22.572468 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:22.584067 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:22.595660 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:22.607316 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:22.619100 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:22.734750 tst ping.py:19: start network... 22:44:22.931197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:23.385438 run create_hlr_db(pid=9523): Launched 22:44:23.507179 bus /gobi_6: Setting Powered False 22:44:24.566582 run create_hlr_db(pid=9523): Terminated: ok {rc=0} 22:44:24.997692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9525): Launched 22:44:25.313158 run osmo-hlr_10.42.42.2(pid=9526): Launched 22:44:25.434847 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:25.984284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9529): Launched 22:44:26.280704 run osmo-stp_10.42.42.5(pid=9530): Launched 22:44:26.394016 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:44:26.903838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9532): Launched 22:44:27.016294 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:44:27.264546 run patchelf(pid=9533): Launched 22:44:27.430317 run osmo-stp_10.42.42.5(pid=9530): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9530)] 22:44:27.554895 run osmo-stp_10.42.42.5(pid=9530): stdout: | (launched: 2022-12-13_22:44:26.226195) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:27.681529 run osmo-stp_10.42.42.5(pid=9530): stderr: | 20221213224426394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224426394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224426394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224426395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224426395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224426395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224426395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:27.807692 run osmo-stp_10.42.42.5(pid=9530): stdout: | (launched: 2022-12-13_22:44:26.226195) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:27.927988 run osmo-stp_10.42.42.5(pid=9530): stderr: | 20221213224426394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224426394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224426394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224426395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224426395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224426395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224426395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:28.070827 run patchelf(pid=9533): Terminating (SIGINT) 22:44:28.235829 run patchelf(pid=9533): Terminated: ok {rc=0} 22:44:28.354556 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9530): Process ended prematurely: osmo-stp_10.42.42.5(pid=9530) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9530)] [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 22:44:28.363304 tst ping.py:22: Test FAILED (6.4 sec) 22:44:28.389753 run osmo-hlr_10.42.42.2(pid=9526): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9526)] 22:44:28.437576 run osmo-hlr_10.42.42.2(pid=9526): stdout: | (launched: 2022-12-13_22:44:25.255858) 22:44:28.486513 run osmo-hlr_10.42.42.2(pid=9526): stderr: | 20221213224425452 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224425452 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224425452 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224425452 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224425452 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224425452 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224425464 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224425473 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224425473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224425473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:28.535925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9525): Terminating (SIGTERM) 22:44:28.575328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9529): Terminating (SIGTERM) 22:44:28.614720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9532): Terminating (SIGTERM) 22:44:28.654335 --- ParallelTerminationStrategy: PID 9525 died... 22:44:28.673604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9525): Terminated: ok {rc=0} 22:44:28.717469 --- ParallelTerminationStrategy: PID 9529 died... 22:44:28.735892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9529): Terminated: ok {rc=0} 22:44:28.779710 --- ParallelTerminationStrategy: PID 9532 died... 22:44:28.798219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9532): Terminated: ok {rc=0} 22:44:28.883854 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:44:29.971456 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:29.983096 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:44:30.050815 tst ping_idle_ping.py: using LAC 36737 22:44:30.167975 tst ping_idle_ping.py: using RAC 17 22:44:30.294835 tst ping_idle_ping.py: using CellId 36737 22:44:30.417952 tst ping_idle_ping.py: using BVCI 36738 22:44:30.526079 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:30.537065 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:30.547853 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:30.559114 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:30.570027 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:30.580805 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:30.591781 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:44:30.602657 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:44:30.722474 tst ping_idle_ping.py:24: start network... 22:44:30.956393 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:31.438773 run create_hlr_db(pid=9534): Launched 22:44:31.576132 bus /gobi_6: Setting Powered False 22:44:32.639384 run create_hlr_db(pid=9534): Terminated: ok {rc=0} 22:44:33.065881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9536): Launched 22:44:33.361649 run osmo-hlr_10.42.42.2(pid=9537): Launched 22:44:33.474095 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:33.982124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9539): Launched 22:44:34.276692 run osmo-stp_10.42.42.5(pid=9540): Launched 22:44:34.388773 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:44:34.896894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9542): Launched 22:44:35.010417 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:44:35.260096 run patchelf(pid=9543): Launched 22:44:35.424448 run osmo-stp_10.42.42.5(pid=9540): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9540)] 22:44:35.549391 run osmo-stp_10.42.42.5(pid=9540): stdout: | (launched: 2022-12-13_22:44:34.222628) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:35.675869 run osmo-stp_10.42.42.5(pid=9540): stderr: | 20221213224434393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224434393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224434393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224434393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224434394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224434394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224434394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:35.802831 run osmo-stp_10.42.42.5(pid=9540): stdout: | (launched: 2022-12-13_22:44:34.222628) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:35.923989 run osmo-stp_10.42.42.5(pid=9540): stderr: | 20221213224434393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224434393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224434393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224434393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224434394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224434394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224434394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:36.067401 run patchelf(pid=9543): Terminating (SIGINT) 22:44:36.232927 run patchelf(pid=9543): Terminated: ok {rc=0} 22:44:36.352453 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9540): Process ended prematurely: osmo-stp_10.42.42.5(pid=9540) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9540)] [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:44:36.361516 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:44:36.388183 run osmo-hlr_10.42.42.2(pid=9537): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9537)] 22:44:36.435448 run osmo-hlr_10.42.42.2(pid=9537): stdout: | (launched: 2022-12-13_22:44:33.306965) 22:44:36.484318 run osmo-hlr_10.42.42.2(pid=9537): stderr: | 20221213224433484 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224433484 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224433484 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224433484 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224433484 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224433484 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224433495 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224433504 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224433504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224433505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:36.533736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9536): Terminating (SIGTERM) 22:44:36.573041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9539): Terminating (SIGTERM) 22:44:36.612293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9542): Terminating (SIGTERM) 22:44:36.652007 --- ParallelTerminationStrategy: PID 9536 died... 22:44:36.671078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9536): Terminated: ok {rc=0} 22:44:36.714442 --- ParallelTerminationStrategy: PID 9539 died... 22:44:36.732723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9539): Terminated: ok {rc=0} 22:44:36.776459 --- ParallelTerminationStrategy: PID 9542 died... 22:44:36.794927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9542): Terminated: ok {rc=0} 22:44:36.879934 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:44:38.188601 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:44:38.195685 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:44:38.225244 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:44:38.262726 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:44:38.314857 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:44:38.343844 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:44:38.378376 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:44:38.938810 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2395 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:44:38.944102 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:38.955514 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:44:39.022570 tst switch_tch_pdch.py: using LAC 36738 22:44:39.140561 tst switch_tch_pdch.py: using RAC 18 22:44:39.257690 tst switch_tch_pdch.py: using CellId 36738 22:44:39.374257 tst switch_tch_pdch.py: using BVCI 36739 22:44:39.482262 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:39.493565 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:39.504628 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:39.515696 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:39.526808 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:39.537855 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:39.549055 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:44:39.560078 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:44:39.676574 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:44:39.792273 tst switch_tch_pdch.py:51: start network... 22:44:40.005001 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:40.460914 run create_hlr_db(pid=9548): Launched 22:44:40.581363 bus /gobi_6: Setting Powered False 22:44:41.640613 run create_hlr_db(pid=9548): Terminated: ok {rc=0} 22:44:42.054143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9550): Launched 22:44:42.349267 run osmo-hlr_10.42.42.2(pid=9551): Launched 22:44:42.462177 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:42.968010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9553): Launched 22:44:43.263253 run osmo-stp_10.42.42.5(pid=9554): Launched 22:44:43.375095 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:44:43.884243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9556): Launched 22:44:43.997436 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:44:44.246266 run patchelf(pid=9557): Launched 22:44:44.410085 run osmo-stp_10.42.42.5(pid=9554): ERR: Terminated: ERROR {rc=1} [trial-2395↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9554)] 22:44:44.534943 run osmo-stp_10.42.42.5(pid=9554): stdout: | (launched: 2022-12-13_22:44:43.209169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:44.660935 run osmo-stp_10.42.42.5(pid=9554): stderr: | 20221213224443376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224443376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224443376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224443377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224443379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224443379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224443379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:44.787826 run osmo-stp_10.42.42.5(pid=9554): stdout: | (launched: 2022-12-13_22:44:43.209169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:44.908432 run osmo-stp_10.42.42.5(pid=9554): stderr: | 20221213224443376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224443376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224443376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224443377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224443379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224443379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224443379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:45.051851 run patchelf(pid=9557): Terminating (SIGINT) 22:44:45.217582 run patchelf(pid=9557): Terminated: ok {rc=0} 22:44:45.336457 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9554): Process ended prematurely: osmo-stp_10.42.42.5(pid=9554) [trial-2395↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9554)] [trial-2395↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:44:45.345413 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 22:44:45.371853 run osmo-hlr_10.42.42.2(pid=9551): ERR: Terminated: ERROR {rc=237} [trial-2395↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9551)] 22:44:45.418668 run osmo-hlr_10.42.42.2(pid=9551): stdout: | (launched: 2022-12-13_22:44:42.294463) 22:44:45.467747 run osmo-hlr_10.42.42.2(pid=9551): stderr: | 20221213224442469 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224442469 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224442469 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224442469 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224442469 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224442469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224442487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224442497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224442497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224442497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:45.517182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9550): Terminating (SIGTERM) 22:44:45.556488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9553): Terminating (SIGTERM) 22:44:45.595847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9556): Terminating (SIGTERM) 22:44:45.635787 --- ParallelTerminationStrategy: PID 9550 died... 22:44:45.655065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9550): Terminated: ok {rc=0} 22:44:45.698869 --- ParallelTerminationStrategy: PID 9553 died... 22:44:45.717610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9553): Terminated: ok {rc=0} 22:44:45.761068 --- ParallelTerminationStrategy: PID 9556 died... 22:44:45.779732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9556): Terminated: ok {rc=0} 22:44:45.875960 bus /gobi_0: Setting Powered False 22:44:46.973630 bus /gobi_0: Setting Powered False 22:44:48.086436 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:44:49.337221 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:44:49.342738 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:44:49.371313 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:44:49.405367 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:44:49.457895 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:44:49.486594 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:44:49.520043 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:44:50.080874 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2395 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:44:50.086499 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:50.098239 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:44:50.165943 tst switch_tch_pdch.py: using LAC 36739 22:44:50.290666 tst switch_tch_pdch.py: using RAC 19 22:44:50.415514 tst switch_tch_pdch.py: using CellId 36739 22:44:50.532686 tst switch_tch_pdch.py: using BVCI 36740 22:44:50.639243 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:50.650369 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:50.661150 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:50.671926 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:50.682732 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:50.693591 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:50.704443 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:44:50.715270 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:44:50.836548 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:44:50.956692 tst switch_tch_pdch.py:51: start network... 22:44:51.169022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:51.629808 run create_hlr_db(pid=9561): Launched 22:44:51.751249 bus /gobi_6: Setting Powered False 22:44:52.813644 run create_hlr_db(pid=9561): Terminated: ok {rc=0} 22:44:53.211908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9563): Launched 22:44:53.507225 run osmo-hlr_10.42.42.2(pid=9564): Launched 22:44:53.621012 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:54.104620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9566): Launched 22:44:54.399124 run osmo-stp_10.42.42.5(pid=9567): Launched 22:44:54.511838 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:44:54.993753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9569): Launched 22:44:55.105841 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:44:55.353588 run patchelf(pid=9570): Launched 22:44:55.517252 run osmo-stp_10.42.42.5(pid=9567): ERR: Terminated: ERROR {rc=1} [trial-2395↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9567)] 22:44:55.641796 run osmo-stp_10.42.42.5(pid=9567): stdout: | (launched: 2022-12-13_22:44:54.344685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:55.767795 run osmo-stp_10.42.42.5(pid=9567): stderr: | 20221213224454516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224454516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224454517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224454517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224454518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224454518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224454518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:55.894215 run osmo-stp_10.42.42.5(pid=9567): stdout: | (launched: 2022-12-13_22:44:54.344685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:56.015203 run osmo-stp_10.42.42.5(pid=9567): stderr: | 20221213224454516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224454516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224454517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224454517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224454518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224454518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224454518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:56.157909 run patchelf(pid=9570): Terminating (SIGINT) 22:44:56.322541 run patchelf(pid=9570): Terminated: ok {rc=0} 22:44:56.441688 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9567): Process ended prematurely: osmo-stp_10.42.42.5(pid=9567) [trial-2395↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9567)] [trial-2395↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:44:56.450513 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 22:44:56.476823 run osmo-hlr_10.42.42.2(pid=9564): ERR: Terminated: ERROR {rc=237} [trial-2395↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9564)] 22:44:56.524157 run osmo-hlr_10.42.42.2(pid=9564): stdout: | (launched: 2022-12-13_22:44:53.453440) 22:44:56.573136 run osmo-hlr_10.42.42.2(pid=9564): stderr: | 20221213224453630 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224453630 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224453630 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224453630 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224453630 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224453630 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224453642 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224453653 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224453653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224453653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:56.622442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9563): Terminating (SIGTERM) 22:44:56.661783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9566): Terminating (SIGTERM) 22:44:56.701194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9569): Terminating (SIGTERM) 22:44:56.740903 --- ParallelTerminationStrategy: PID 9563 died... 22:44:56.759879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9563): Terminated: ok {rc=0} 22:44:56.803453 --- ParallelTerminationStrategy: PID 9566 died... 22:44:56.822041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9566): Terminated: ok {rc=0} 22:44:56.865411 --- ParallelTerminationStrategy: PID 9569 died... 22:44:56.883825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9569): Terminated: ok {rc=0} 22:44:56.967023 bus /gobi_0: Setting Powered False 22:44:58.064318 bus /gobi_0: Setting Powered False 22:44:59.180321 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_sms:nanobts --------------------------------------------------------------------- 22:45:00.428431 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:00.432927 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 22:45:00.457317 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 22:45:00.464284 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 22:45:00.519300 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 22:45:00.542833 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 22:45:00.549377 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 22:45:01.116934 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 22:45:01.126454 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 22:45:01.143007 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 22:45:01.189342 tst mo_mt_sms.py: using LAC 36740 22:45:01.341876 tst mo_mt_sms.py: using RAC 20 22:45:01.491465 tst mo_mt_sms.py: using CellId 36740 22:45:01.610329 tst mo_mt_sms.py: using BVCI 36741 22:45:01.719478 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 22:45:01.854445 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 22:45:01.985972 tst mo_mt_sms.py:9: start nitb and bts... 22:45:02.215949 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:45:02.822552 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9577): Launched 22:45:03.117894 run osmo-nitb_10.42.42.2(pid=9578): Launched 22:45:03.283369 run osmo-nitb_10.42.42.2(pid=9578): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9578)] 22:45:03.415920 run osmo-nitb_10.42.42.2(pid=9578): stdout: | (launched: 2022-12-13_22:45:03.064005) 22:45:03.549595 run osmo-nitb_10.42.42.2(pid=9578): stderr: | (launched: 2022-12-13_22:45:03.107820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:45:03.683241 run osmo-nitb_10.42.42.2(pid=9578): stdout: | (launched: 2022-12-13_22:45:03.064005) 22:45:03.811747 run osmo-nitb_10.42.42.2(pid=9578): stderr: | (launched: 2022-12-13_22:45:03.107820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9578): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9578) [trial-2395↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9578)] 22:45:04.231038 tst osmo-nitb_10.42.42.2(pid=9578): stdout: | (launched: 2022-12-13_22:45:03.064005) 22:45:04.350307 tst osmo-nitb_10.42.42.2(pid=9578): stderr: | (launched: 2022-12-13_22:45:03.107820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:45:04.490117 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9578): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9578) [trial-2395↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9578)] [trial-2395↪nitb_sms:nanobts↪mo_mt_sms.py:11] 22:45:04.498412 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 22:45:04.504860 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9577): Terminating (SIGTERM) 22:45:04.713314 --- ParallelTerminationStrategy: PID 9577 died... 22:45:04.733584 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9577): Terminated: ok {rc=0} 22:45:04.819466 bus /sierra_3: Setting Powered False 22:45:05.920208 bus /sierra_3: Setting Powered False 22:45:07.036443 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 sms:nanobts+band-1900 --------------------------------------------------------------------- 22:45:08.226054 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:08.231422 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 22:45:08.255617 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 22:45:08.284349 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 22:45:08.335774 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 22:45:08.360190 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 22:45:08.387546 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 22:45:08.934609 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 22:45:08.939746 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:08.950515 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:45:08.987607 tst mo_mt_sms.py: using LAC 36741 22:45:09.103085 tst mo_mt_sms.py: using RAC 21 22:45:09.218511 tst mo_mt_sms.py: using CellId 36741 22:45:09.339435 tst mo_mt_sms.py: using BVCI 36742 22:45:09.446340 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:09.457066 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:09.467496 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:09.477950 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:09.488333 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:09.498667 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 22:45:09.619156 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 22:45:09.737165 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:10.226786 run create_hlr_db(pid=9582): Launched 22:45:10.347767 bus /sierra_2: Setting Powered False 22:45:11.410537 run create_hlr_db(pid=9582): Terminated: ok {rc=0} 22:45:11.852250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9584): Launched 22:45:12.167972 run osmo-hlr_10.42.42.2(pid=9585): Launched 22:45:12.289848 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:12.832908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9587): Launched 22:45:13.148603 run osmo-stp_10.42.42.5(pid=9588): Launched 22:45:13.270142 run osmo-msc_10.42.42.6: Starting osmo-msc 22:45:13.842030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9590): Launched 22:45:14.158490 run osmo-msc_10.42.42.6(pid=9591): Launched 22:45:14.335628 run osmo-stp_10.42.42.5(pid=9588): ERR: Terminated: ERROR {rc=1} [trial-2395↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9588)] 22:45:14.469397 run osmo-stp_10.42.42.5(pid=9588): stdout: | (launched: 2022-12-13_22:45:13.091102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:14.603142 run osmo-stp_10.42.42.5(pid=9588): stderr: | 20221213224513282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224513282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224513282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224513283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224513285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224513285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224513285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:14.736497 run osmo-stp_10.42.42.5(pid=9588): stdout: | (launched: 2022-12-13_22:45:13.091102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:14.862738 run osmo-stp_10.42.42.5(pid=9588): stderr: | 20221213224513282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224513282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224513282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224513283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224513285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224513285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224513285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:15.013739 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9588): Process ended prematurely: osmo-stp_10.42.42.5(pid=9588) [trial-2395↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9588)] [trial-2395↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 22:45:15.022636 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 22:45:15.049767 run osmo-hlr_10.42.42.2(pid=9585): ERR: Terminated: ERROR {rc=237} [trial-2395↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9585)] 22:45:15.100169 run osmo-hlr_10.42.42.2(pid=9585): stdout: | (launched: 2022-12-13_22:45:12.110573) 22:45:15.151861 run osmo-hlr_10.42.42.2(pid=9585): stderr: | 20221213224512307 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224512307 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224512307 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224512307 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224512307 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224512308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224512320 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224512328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224512328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224512329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:45:15.223935 run osmo-msc_10.42.42.6(pid=9591): ERR: Terminated: ERROR {rc=2} [trial-2395↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9591)] 22:45:15.273363 run osmo-msc_10.42.42.6(pid=9591): stdout: | (launched: 2022-12-13_22:45:14.100785) 22:45:15.324773 run osmo-msc_10.42.42.6(pid=9591): stderr: | 20221213224514423 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224514423 DLGLOBAL DEBUG validating counter group 0x7f425a720c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224514424 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224514424 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224514424 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224514424 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224514426 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224514426 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224514426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224514426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:45:15.376732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9584): Terminating (SIGTERM) 22:45:15.418624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9587): Terminating (SIGTERM) 22:45:15.460819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9590): Terminating (SIGTERM) 22:45:15.503055 --- ParallelTerminationStrategy: PID 9584 died... 22:45:15.523558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9584): Terminated: ok {rc=0} 22:45:15.570188 --- ParallelTerminationStrategy: PID 9587 died... 22:45:15.590323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9587): Terminated: ok {rc=0} 22:45:15.636494 --- ParallelTerminationStrategy: PID 9590 died... 22:45:15.656480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9590): Terminated: ok {rc=0} 22:45:15.744705 bus /sierra_3: Setting Powered False 22:45:16.849288 bus /sierra_3: Setting Powered False 22:45:17.975483 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 22:45:19.201399 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:19.206776 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 22:45:19.230407 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 22:45:19.237068 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 22:45:19.273115 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 22:45:19.297246 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 22:45:19.303739 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 22:45:19.825148 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2395 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 22:45:19.830169 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 22:45:19.841079 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:45:19.877353 tst assert_extension.py: using LAC 36742 22:45:19.992802 tst assert_extension.py: using RAC 22 22:45:20.107295 tst assert_extension.py: using CellId 36742 22:45:20.221028 tst assert_extension.py: using BVCI 36743 22:45:20.327524 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 22:45:20.443778 tst assert_extension.py:10: start nitb and bts... 22:45:20.656565 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:45:21.300006 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9596): Launched 22:45:21.616428 run osmo-nitb_10.42.42.2(pid=9597): Launched 22:45:21.791943 run osmo-nitb_10.42.42.2(pid=9597): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9597)] 22:45:21.933824 run osmo-nitb_10.42.42.2(pid=9597): stdout: | (launched: 2022-12-13_22:45:21.559030) 22:45:22.077453 run osmo-nitb_10.42.42.2(pid=9597): stderr: | (launched: 2022-12-13_22:45:21.606113) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:45:22.221207 run osmo-nitb_10.42.42.2(pid=9597): stdout: | (launched: 2022-12-13_22:45:21.559030) 22:45:22.359203 run osmo-nitb_10.42.42.2(pid=9597): stderr: | (launched: 2022-12-13_22:45:21.606113) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9597): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9597) [trial-2395↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9597)] 22:45:22.736630 tst osmo-nitb_10.42.42.2(pid=9597): stdout: | (launched: 2022-12-13_22:45:21.559030) 22:45:22.864687 tst osmo-nitb_10.42.42.2(pid=9597): stderr: | (launched: 2022-12-13_22:45:21.606113) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:45:23.015256 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9597): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9597) [trial-2395↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9597)] [trial-2395↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 22:45:23.024235 tst assert_extension.py:12: Test FAILED (3.2 sec) 22:45:23.031256 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9596): Terminating (SIGTERM) 22:45:23.241762 --- ParallelTerminationStrategy: PID 9596 died... 22:45:23.263587 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9596): Terminated: ok {rc=0} 22:45:23.352795 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 ussd:nanobts+band-1900 --------------------------------------------------------------------- 22:45:24.523987 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:24.530134 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 22:45:24.556101 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 22:45:24.585748 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 22:45:24.624357 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 22:45:24.648424 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 22:45:24.674582 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 22:45:25.202472 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2395 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 22:45:25.208856 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:25.221358 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:45:25.261388 tst assert_extension.py: using LAC 36743 22:45:25.387961 tst assert_extension.py: using RAC 23 22:45:25.506354 tst assert_extension.py: using CellId 36743 22:45:25.624641 tst assert_extension.py: using BVCI 36744 22:45:25.731483 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:25.742291 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:25.752936 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:25.763604 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:25.774797 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:45:25.786192 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 22:45:25.903658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:26.393059 run create_hlr_db(pid=9601): Launched 22:45:26.515036 bus /sierra_2: Setting Powered False 22:45:27.577420 run create_hlr_db(pid=9601): Terminated: ok {rc=0} 22:45:27.999970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9603): Launched 22:45:28.296416 run osmo-hlr_10.42.42.2(pid=9604): Launched 22:45:28.410046 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:28.935825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9606): Launched 22:45:29.229730 run osmo-stp_10.42.42.5(pid=9607): Launched 22:45:29.341215 run osmo-msc_10.42.42.6: Starting osmo-msc 22:45:29.873107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9609): Launched 22:45:30.168633 run osmo-msc_10.42.42.6(pid=9610): Launched 22:45:30.334154 run osmo-stp_10.42.42.5(pid=9607): ERR: Terminated: ERROR {rc=1} [trial-2395↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9607)] 22:45:30.459674 run osmo-stp_10.42.42.5(pid=9607): stdout: | (launched: 2022-12-13_22:45:29.175667) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:30.585065 run osmo-stp_10.42.42.5(pid=9607): stderr: | 20221213224529346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224529346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224529346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224529346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224529347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224529347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224529347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:30.707841 run osmo-stp_10.42.42.5(pid=9607): stdout: | (launched: 2022-12-13_22:45:29.175667) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:30.824665 run osmo-stp_10.42.42.5(pid=9607): stderr: | 20221213224529346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224529346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224529346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224529346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224529347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224529347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224529347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:30.990967 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9607): Process ended prematurely: osmo-stp_10.42.42.5(pid=9607) [trial-2395↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9607)] [trial-2395↪ussd:nanobts+band-1900↪assert_extension.py:17] 22:45:30.999602 tst assert_extension.py:17: Test FAILED (5.8 sec) 22:45:31.027826 run osmo-hlr_10.42.42.2(pid=9604): ERR: Terminated: ERROR {rc=237} [trial-2395↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9604)] 22:45:31.083366 run osmo-hlr_10.42.42.2(pid=9604): stdout: | (launched: 2022-12-13_22:45:28.242349) 22:45:31.137834 run osmo-hlr_10.42.42.2(pid=9604): stderr: | 20221213224528419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224528419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224528420 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224528420 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224528420 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224528420 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224528432 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224528440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224528441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224528441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:45:31.214873 run osmo-msc_10.42.42.6(pid=9610): ERR: Terminated: ERROR {rc=2} [trial-2395↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9610)] 22:45:31.267941 run osmo-msc_10.42.42.6(pid=9610): stdout: | (launched: 2022-12-13_22:45:30.113743) 22:45:31.322973 run osmo-msc_10.42.42.6(pid=9610): stderr: | 20221213224530386 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224530387 DLGLOBAL DEBUG validating counter group 0x7f49bd6e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224530387 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224530387 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224530387 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224530387 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224530389 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224530389 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224530389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224530390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:45:31.377971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9603): Terminating (SIGTERM) 22:45:31.422955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9606): Terminating (SIGTERM) 22:45:31.469422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9609): Terminating (SIGTERM) 22:45:31.516012 --- ParallelTerminationStrategy: PID 9603 died... 22:45:31.538491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9603): Terminated: ok {rc=0} 22:45:31.588704 --- ParallelTerminationStrategy: PID 9606 died... 22:45:31.611434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9606): Terminated: ok {rc=0} 22:45:31.660638 --- ParallelTerminationStrategy: PID 9609 died... 22:45:31.682827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9609): Terminated: ok {rc=0} 22:45:31.774388 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:45:32.974953 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:32.982602 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:45:33.006224 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:45:33.034484 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:45:33.085673 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:45:33.108927 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:45:33.135473 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:45:33.687595 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:45:33.736868 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:33.748111 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:45:33.809466 tst mo_mt_call.py: using LAC 36744 22:45:33.926163 tst mo_mt_call.py: using RAC 24 22:45:34.046778 tst mo_mt_call.py: using CellId 36744 22:45:34.165076 tst mo_mt_call.py: using BVCI 36745 22:45:34.275762 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:34.286911 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:34.297735 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:34.308554 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:34.319611 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:34.330457 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:45:34.450170 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:45:34.567399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:35.031818 run create_hlr_db(pid=9615): Launched 22:45:35.154165 bus /sierra_2: Setting Powered False 22:45:36.214519 run create_hlr_db(pid=9615): Terminated: ok {rc=0} 22:45:36.654249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9617): Launched 22:45:36.975646 run osmo-hlr_10.42.42.2(pid=9618): Launched 22:45:37.099478 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:37.653766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9620): Launched 22:45:37.972850 run osmo-stp_10.42.42.5(pid=9621): Launched 22:45:38.095821 run osmo-msc_10.42.42.6: Starting osmo-msc 22:45:38.678644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9623): Launched 22:45:38.999348 run osmo-msc_10.42.42.6(pid=9624): Launched 22:45:39.178437 run osmo-stp_10.42.42.5(pid=9621): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9621)] 22:45:39.313682 run osmo-stp_10.42.42.5(pid=9621): stdout: | (launched: 2022-12-13_22:45:37.914909) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:39.449955 run osmo-stp_10.42.42.5(pid=9621): stderr: | 20221213224538105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224538106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224538106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224538106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224538108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224538109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224538109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:39.585525 run osmo-stp_10.42.42.5(pid=9621): stdout: | (launched: 2022-12-13_22:45:37.914909) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:39.713764 run osmo-stp_10.42.42.5(pid=9621): stderr: | 20221213224538105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224538106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224538106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224538106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224538108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224538109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224538109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:39.867011 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9621): Process ended prematurely: osmo-stp_10.42.42.5(pid=9621) [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9621)] [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:45:39.876436 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:45:39.904136 run osmo-hlr_10.42.42.2(pid=9618): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9618)] 22:45:39.954502 run osmo-hlr_10.42.42.2(pid=9618): stdout: | (launched: 2022-12-13_22:45:36.917704) 22:45:40.006004 run osmo-hlr_10.42.42.2(pid=9618): stderr: | 20221213224537118 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224537118 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224537118 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224537118 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224537118 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224537118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224537129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224537138 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224537138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224537138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:45:40.078403 run osmo-msc_10.42.42.6(pid=9624): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9624)] 22:45:40.127777 run osmo-msc_10.42.42.6(pid=9624): stdout: | (launched: 2022-12-13_22:45:38.941351) 22:45:40.179323 run osmo-msc_10.42.42.6(pid=9624): stderr: | 20221213224539261 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224539262 DLGLOBAL DEBUG validating counter group 0x7fd4a320ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224539262 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224539262 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224539262 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224539262 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224539264 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224539264 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224539264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224539264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:45:40.231123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9617): Terminating (SIGTERM) 22:45:40.273016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9620): Terminating (SIGTERM) 22:45:40.315185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9623): Terminating (SIGTERM) 22:45:40.357518 --- ParallelTerminationStrategy: PID 9617 died... 22:45:40.377952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9617): Terminated: ok {rc=0} 22:45:40.424350 --- ParallelTerminationStrategy: PID 9620 died... 22:45:40.444067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9620): Terminated: ok {rc=0} 22:45:40.490346 --- ParallelTerminationStrategy: PID 9623 died... 22:45:40.510270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9623): Terminated: ok {rc=0} 22:45:40.598554 bus /sierra_3: Setting Powered False 22:45:41.697262 bus /sierra_3: Setting Powered False 22:45:42.814279 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:45:43.959196 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:43.970891 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:45:44.030446 tst mo_mt_call_osmux.py: using LAC 36745 22:45:44.147374 tst mo_mt_call_osmux.py: using RAC 25 22:45:44.266166 tst mo_mt_call_osmux.py: using CellId 36745 22:45:44.395304 tst mo_mt_call_osmux.py: using BVCI 36746 22:45:44.505920 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:44.517074 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:44.528058 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:44.539038 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:44.550107 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:45:44.561068 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:45:44.676274 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:45:44.794982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:45.295021 run create_hlr_db(pid=9626): Launched 22:45:45.418673 bus /sierra_2: Setting Powered False 22:45:46.488933 run create_hlr_db(pid=9626): Terminated: ok {rc=0} 22:45:46.948855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9628): Launched 22:45:47.285191 run osmo-hlr_10.42.42.2(pid=9629): Launched 22:45:47.410319 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:47.965038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9631): Launched 22:45:48.287236 run osmo-stp_10.42.42.5(pid=9632): Launched 22:45:48.411207 run osmo-msc_10.42.42.6: Starting osmo-msc 22:45:48.993679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9634): Launched 22:45:49.313327 run osmo-msc_10.42.42.6(pid=9635): Launched 22:45:49.494857 run osmo-stp_10.42.42.5(pid=9632): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9632)] 22:45:49.631374 run osmo-stp_10.42.42.5(pid=9632): stdout: | (launched: 2022-12-13_22:45:48.228697) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:49.768180 run osmo-stp_10.42.42.5(pid=9632): stderr: | 20221213224548422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224548422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224548422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224548423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224548423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224548423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224548423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:49.903933 run osmo-stp_10.42.42.5(pid=9632): stdout: | (launched: 2022-12-13_22:45:48.228697) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:50.032224 run osmo-stp_10.42.42.5(pid=9632): stderr: | 20221213224548422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224548422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224548422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224548423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224548423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224548423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224548423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:50.185820 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9632): Process ended prematurely: osmo-stp_10.42.42.5(pid=9632) [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9632)] [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:45:50.195304 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:45:50.222987 run osmo-hlr_10.42.42.2(pid=9629): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9629)] 22:45:50.273329 run osmo-hlr_10.42.42.2(pid=9629): stdout: | (launched: 2022-12-13_22:45:47.226893) 22:45:50.324786 run osmo-hlr_10.42.42.2(pid=9629): stderr: | 20221213224547423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224547423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224547423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224547424 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224547424 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224547424 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224547436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224547444 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224547445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224547445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:45:50.396831 run osmo-msc_10.42.42.6(pid=9635): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9635)] 22:45:50.446988 run osmo-msc_10.42.42.6(pid=9635): stdout: | (launched: 2022-12-13_22:45:49.255050) 22:45:50.498661 run osmo-msc_10.42.42.6(pid=9635): stderr: | 20221213224549573 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224549573 DLGLOBAL DEBUG validating counter group 0x7f31c4865c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224549573 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224549574 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224549574 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224549574 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224549575 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224549576 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224549576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224549576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:45:50.550442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9628): Terminating (SIGTERM) 22:45:50.591937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9631): Terminating (SIGTERM) 22:45:50.633351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9634): Terminating (SIGTERM) 22:45:50.675545 --- ParallelTerminationStrategy: PID 9628 died... 22:45:50.695790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9628): Terminated: ok {rc=0} 22:45:50.741832 --- ParallelTerminationStrategy: PID 9631 died... 22:45:50.761576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9631): Terminated: ok {rc=0} 22:45:50.807326 --- ParallelTerminationStrategy: PID 9634 died... 22:45:50.827020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9634): Terminated: ok {rc=0} 22:45:50.913982 bus /sierra_3: Setting Powered False 22:45:52.013122 bus /sierra_3: Setting Powered False 22:45:53.127509 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:45:54.377967 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:54.387824 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:45:54.413262 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:45:54.441065 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:45:54.501007 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:45:54.526126 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:45:54.553479 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:45:55.099031 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:45:55.152870 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:55.164613 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:45:55.226783 tst mo_mt_call.py: using LAC 36746 22:45:55.352912 tst mo_mt_call.py: using RAC 26 22:45:55.477245 tst mo_mt_call.py: using CellId 36746 22:45:55.604159 tst mo_mt_call.py: using BVCI 36747 22:45:55.719756 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:55.731313 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:55.742705 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:55.754161 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:55.766105 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:45:55.777730 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:45:55.894066 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:45:56.013446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:56.511233 run create_hlr_db(pid=9640): Launched 22:45:56.633569 bus /sierra_2: Setting Powered False 22:45:57.696833 run create_hlr_db(pid=9640): Terminated: ok {rc=0} 22:45:58.126919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9642): Launched 22:45:58.427374 run osmo-hlr_10.42.42.2(pid=9643): Launched 22:45:58.542340 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:59.058643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9645): Launched 22:45:59.358215 run osmo-stp_10.42.42.5(pid=9646): Launched 22:45:59.474209 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:00.017112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9648): Launched 22:46:00.316935 run osmo-msc_10.42.42.6(pid=9649): Launched 22:46:00.486380 run osmo-stp_10.42.42.5(pid=9646): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9646)] 22:46:00.614145 run osmo-stp_10.42.42.5(pid=9646): stdout: | (launched: 2022-12-13_22:45:59.303641) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:00.741320 run osmo-stp_10.42.42.5(pid=9646): stderr: | 20221213224559474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224559475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224559475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224559475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224559476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224559476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224559476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:00.880818 run osmo-stp_10.42.42.5(pid=9646): stdout: | (launched: 2022-12-13_22:45:59.303641) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:01.013922 run osmo-stp_10.42.42.5(pid=9646): stderr: | 20221213224559474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224559475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224559475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224559475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224559476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224559476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224559476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:01.172314 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9646): Process ended prematurely: osmo-stp_10.42.42.5(pid=9646) [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9646)] [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:46:01.183065 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:46:01.213133 run osmo-hlr_10.42.42.2(pid=9643): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9643)] 22:46:01.268148 run osmo-hlr_10.42.42.2(pid=9643): stdout: | (launched: 2022-12-13_22:45:58.371798) 22:46:01.322391 run osmo-hlr_10.42.42.2(pid=9643): stderr: | 20221213224558548 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224558548 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224558548 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224558548 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224558548 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224558548 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224558560 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224558569 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224558569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224558569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:01.398630 run osmo-msc_10.42.42.6(pid=9649): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9649)] 22:46:01.451131 run osmo-msc_10.42.42.6(pid=9649): stdout: | (launched: 2022-12-13_22:46:00.261906) 22:46:01.506740 run osmo-msc_10.42.42.6(pid=9649): stderr: | 20221213224600535 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224600535 DLGLOBAL DEBUG validating counter group 0x7f926b0c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224600535 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224600535 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224600535 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224600535 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224600537 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224600538 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224600538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224600538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:01.561689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9642): Terminating (SIGTERM) 22:46:01.606993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9645): Terminating (SIGTERM) 22:46:01.653981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9648): Terminating (SIGTERM) 22:46:01.700729 --- ParallelTerminationStrategy: PID 9642 died... 22:46:01.722832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9642): Terminated: ok {rc=0} 22:46:01.772615 --- ParallelTerminationStrategy: PID 9645 died... 22:46:01.794166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9645): Terminated: ok {rc=0} 22:46:01.845846 --- ParallelTerminationStrategy: PID 9648 died... 22:46:01.866504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9648): Terminated: ok {rc=0} 22:46:01.961042 bus /sierra_3: Setting Powered False 22:46:03.057425 bus /sierra_3: Setting Powered False 22:46:04.172747 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:46:05.314420 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:05.326071 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:46:05.386502 tst mo_mt_call_osmux.py: using LAC 36747 22:46:05.504831 tst mo_mt_call_osmux.py: using RAC 27 22:46:05.624129 tst mo_mt_call_osmux.py: using CellId 36747 22:46:05.741273 tst mo_mt_call_osmux.py: using BVCI 36748 22:46:05.849616 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:05.860619 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:05.871752 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:05.882706 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:05.893768 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:46:05.904626 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:46:06.020552 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:46:06.140729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:06.614485 run create_hlr_db(pid=9651): Launched 22:46:06.737318 bus /sierra_2: Setting Powered False 22:46:07.797731 run create_hlr_db(pid=9651): Terminated: ok {rc=0} 22:46:08.236284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9653): Launched 22:46:08.558659 run osmo-hlr_10.42.42.2(pid=9654): Launched 22:46:08.682085 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:09.232878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9656): Launched 22:46:09.553939 run osmo-stp_10.42.42.5(pid=9657): Launched 22:46:09.676881 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:10.258532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9659): Launched 22:46:10.582088 run osmo-msc_10.42.42.6(pid=9660): Launched 22:46:10.762865 run osmo-stp_10.42.42.5(pid=9657): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9657)] 22:46:10.899652 run osmo-stp_10.42.42.5(pid=9657): stdout: | (launched: 2022-12-13_22:46:09.495969) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:11.037316 run osmo-stp_10.42.42.5(pid=9657): stderr: | 20221213224609689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224609689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224609690 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224609690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224609691 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224609691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224609691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:11.173385 run osmo-stp_10.42.42.5(pid=9657): stdout: | (launched: 2022-12-13_22:46:09.495969) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:11.301989 run osmo-stp_10.42.42.5(pid=9657): stderr: | 20221213224609689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224609689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224609690 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224609690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224609691 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224609691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224609691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:11.455679 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9657): Process ended prematurely: osmo-stp_10.42.42.5(pid=9657) [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9657)] [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:46:11.465292 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:46:11.493347 run osmo-hlr_10.42.42.2(pid=9654): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9654)] 22:46:11.543694 run osmo-hlr_10.42.42.2(pid=9654): stdout: | (launched: 2022-12-13_22:46:08.500184) 22:46:11.595045 run osmo-hlr_10.42.42.2(pid=9654): stderr: | 20221213224608697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224608697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224608697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224608697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224608697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224608697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224608728 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224608738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224608738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224608738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:11.666861 run osmo-msc_10.42.42.6(pid=9660): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9660)] 22:46:11.716228 run osmo-msc_10.42.42.6(pid=9660): stdout: | (launched: 2022-12-13_22:46:10.523554) 22:46:11.767879 run osmo-msc_10.42.42.6(pid=9660): stderr: | 20221213224610845 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224610846 DLGLOBAL DEBUG validating counter group 0x7fe306eafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224610846 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224610846 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224610846 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224610846 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224610850 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224610850 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224610850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224610850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:11.819379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9653): Terminating (SIGTERM) 22:46:11.860864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9656): Terminating (SIGTERM) 22:46:11.902339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9659): Terminating (SIGTERM) 22:46:11.944066 --- ParallelTerminationStrategy: PID 9653 died... 22:46:11.964304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9653): Terminated: ok {rc=0} 22:46:12.010623 --- ParallelTerminationStrategy: PID 9656 died... 22:46:12.030357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9656): Terminated: ok {rc=0} 22:46:12.076264 --- ParallelTerminationStrategy: PID 9659 died... 22:46:12.095989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9659): Terminated: ok {rc=0} 22:46:12.183406 bus /sierra_3: Setting Powered False 22:46:13.281255 bus /sierra_3: Setting Powered False 22:46:14.396629 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:46:15.640222 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:46:15.648399 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:46:15.673203 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:46:15.701092 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:46:15.755203 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:46:15.781066 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:46:15.808356 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:46:16.356896 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:46:16.425303 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:16.441727 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:46:16.517401 tst mo_mt_call.py: using LAC 36748 22:46:16.639979 tst mo_mt_call.py: using RAC 28 22:46:16.767201 tst mo_mt_call.py: using CellId 36748 22:46:16.891358 tst mo_mt_call.py: using BVCI 36749 22:46:17.039160 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:17.052598 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:17.064716 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:17.076915 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:17.089491 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:17.102056 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:46:17.223286 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:46:17.340034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:17.809206 run create_hlr_db(pid=9665): Launched 22:46:17.935824 bus /sierra_2: Setting Powered False 22:46:18.998937 run create_hlr_db(pid=9665): Terminated: ok {rc=0} 22:46:19.429060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9667): Launched 22:46:19.729538 run osmo-hlr_10.42.42.2(pid=9668): Launched 22:46:19.843456 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:20.360881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9670): Launched 22:46:20.661212 run osmo-stp_10.42.42.5(pid=9671): Launched 22:46:20.775800 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:21.318150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9673): Launched 22:46:21.618440 run osmo-msc_10.42.42.6(pid=9674): Launched 22:46:21.786597 run osmo-stp_10.42.42.5(pid=9671): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9671)] 22:46:21.985704 run osmo-stp_10.42.42.5(pid=9671): stdout: | (launched: 2022-12-13_22:46:20.606629) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:22.119748 run osmo-stp_10.42.42.5(pid=9671): stderr: | 20221213224620777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224620777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224620778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224620778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224620778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224620778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224620779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:22.253930 run osmo-stp_10.42.42.5(pid=9671): stdout: | (launched: 2022-12-13_22:46:20.606629) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:22.382678 run osmo-stp_10.42.42.5(pid=9671): stderr: | 20221213224620777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224620777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224620778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224620778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224620778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224620778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224620779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:22.536713 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9671): Process ended prematurely: osmo-stp_10.42.42.5(pid=9671) [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9671)] [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:46:22.546504 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:46:22.574365 run osmo-hlr_10.42.42.2(pid=9668): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9668)] 22:46:22.625264 run osmo-hlr_10.42.42.2(pid=9668): stdout: | (launched: 2022-12-13_22:46:19.675029) 22:46:22.677814 run osmo-hlr_10.42.42.2(pid=9668): stderr: | 20221213224619850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224619850 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224619850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224619850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224619850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224619850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224619866 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224619876 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224619877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224619877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:22.750488 run osmo-msc_10.42.42.6(pid=9674): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9674)] 22:46:22.800403 run osmo-msc_10.42.42.6(pid=9674): stdout: | (launched: 2022-12-13_22:46:21.563650) 22:46:22.852450 run osmo-msc_10.42.42.6(pid=9674): stderr: | 20221213224621834 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224621834 DLGLOBAL DEBUG validating counter group 0x7ff4463f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224621834 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224621834 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224621835 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224621835 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224621837 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224621837 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224621837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224621837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:22.905136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9667): Terminating (SIGTERM) 22:46:22.946529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9670): Terminating (SIGTERM) 22:46:22.988532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9673): Terminating (SIGTERM) 22:46:23.030856 --- ParallelTerminationStrategy: PID 9667 died... 22:46:23.051357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9667): Terminated: ok {rc=0} 22:46:23.097828 --- ParallelTerminationStrategy: PID 9670 died... 22:46:23.117804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9670): Terminated: ok {rc=0} 22:46:23.164140 --- ParallelTerminationStrategy: PID 9673 died... 22:46:23.183989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9673): Terminated: ok {rc=0} 22:46:23.272177 bus /sierra_3: Setting Powered False 22:46:24.370970 bus /sierra_3: Setting Powered False 22:46:25.487652 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:46:26.636687 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:26.649181 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:46:26.716756 tst mo_mt_call_osmux.py: using LAC 36749 22:46:26.841405 tst mo_mt_call_osmux.py: using RAC 29 22:46:26.965385 tst mo_mt_call_osmux.py: using CellId 36749 22:46:27.089604 tst mo_mt_call_osmux.py: using BVCI 36750 22:46:27.207805 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:27.219429 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:27.230993 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:27.242517 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:27.254435 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:46:27.266223 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:46:27.382825 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:46:27.497699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:27.961767 run create_hlr_db(pid=9676): Launched 22:46:28.084288 bus /sierra_2: Setting Powered False 22:46:29.144813 run create_hlr_db(pid=9676): Terminated: ok {rc=0} 22:46:29.562919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9678): Launched 22:46:29.862359 run osmo-hlr_10.42.42.2(pid=9679): Launched 22:46:29.976535 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:30.492513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9681): Launched 22:46:30.793757 run osmo-stp_10.42.42.5(pid=9682): Launched 22:46:31.027128 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:31.728332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9684): Launched 22:46:32.074930 run osmo-msc_10.42.42.6(pid=9685): Launched 22:46:32.280491 run osmo-stp_10.42.42.5(pid=9682): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9682)] 22:46:32.419862 run osmo-stp_10.42.42.5(pid=9682): stdout: | (launched: 2022-12-13_22:46:30.738449) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:32.558433 run osmo-stp_10.42.42.5(pid=9682): stderr: | 20221213224630991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224630991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224630991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224630991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224630992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224630992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224630992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:32.697457 run osmo-stp_10.42.42.5(pid=9682): stdout: | (launched: 2022-12-13_22:46:30.738449) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:32.826906 run osmo-stp_10.42.42.5(pid=9682): stderr: | 20221213224630991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224630991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224630991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224630991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224630992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224630992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224630992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:32.980820 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9682): Process ended prematurely: osmo-stp_10.42.42.5(pid=9682) [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9682)] [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:46:32.990567 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:46:33.018529 run osmo-hlr_10.42.42.2(pid=9679): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9679)] 22:46:33.069699 run osmo-hlr_10.42.42.2(pid=9679): stdout: | (launched: 2022-12-13_22:46:29.807803) 22:46:33.121893 run osmo-hlr_10.42.42.2(pid=9679): stderr: | 20221213224629982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224629982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224629982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224629982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224629982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224629983 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224629994 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224630003 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224630003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224630003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:33.194907 run osmo-msc_10.42.42.6(pid=9685): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9685)] 22:46:33.245098 run osmo-msc_10.42.42.6(pid=9685): stdout: | (launched: 2022-12-13_22:46:32.010860) 22:46:33.297285 run osmo-msc_10.42.42.6(pid=9685): stderr: | 20221213224632450 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224632450 DLGLOBAL DEBUG validating counter group 0x7fe15a763c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224632450 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224632451 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224632451 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224632451 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224632453 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224632453 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224632453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224632453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:33.349990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9678): Terminating (SIGTERM) 22:46:33.391832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9681): Terminating (SIGTERM) 22:46:33.434444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9684): Terminating (SIGTERM) 22:46:33.476891 --- ParallelTerminationStrategy: PID 9678 died... 22:46:33.497400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9678): Terminated: ok {rc=0} 22:46:33.544207 --- ParallelTerminationStrategy: PID 9681 died... 22:46:33.564173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9681): Terminated: ok {rc=0} 22:46:33.610743 --- ParallelTerminationStrategy: PID 9684 died... 22:46:33.630640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9684): Terminated: ok {rc=0} 22:46:33.719072 bus /sierra_3: Setting Powered False 22:46:34.817833 bus /sierra_3: Setting Powered False 22:46:35.933274 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:46:37.173763 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:46:37.181550 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:46:37.205595 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:46:37.233476 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:46:37.286083 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:46:37.310313 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:46:37.338560 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:46:37.889400 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:46:37.938256 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:37.949569 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:46:38.008835 tst mo_mt_call.py: using LAC 36750 22:46:38.136393 tst mo_mt_call.py: using RAC 30 22:46:38.263551 tst mo_mt_call.py: using CellId 36750 22:46:38.383802 tst mo_mt_call.py: using BVCI 36751 22:46:38.494096 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:38.505395 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:38.516499 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:38.527589 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:38.538758 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:38.549872 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:46:38.671908 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:46:38.787834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:39.253973 run create_hlr_db(pid=9690): Launched 22:46:39.376652 bus /sierra_2: Setting Powered False 22:46:40.437471 run create_hlr_db(pid=9690): Terminated: ok {rc=0} 22:46:40.856634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9692): Launched 22:46:41.156634 run osmo-hlr_10.42.42.2(pid=9693): Launched 22:46:41.270856 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:41.786588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9695): Launched 22:46:42.087393 run osmo-stp_10.42.42.5(pid=9696): Launched 22:46:42.202492 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:42.746106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9698): Launched 22:46:43.046585 run osmo-msc_10.42.42.6(pid=9699): Launched 22:46:43.214789 run osmo-stp_10.42.42.5(pid=9696): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9696)] 22:46:43.341633 run osmo-stp_10.42.42.5(pid=9696): stdout: | (launched: 2022-12-13_22:46:42.032647) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:43.468280 run osmo-stp_10.42.42.5(pid=9696): stderr: | 20221213224642201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224642201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224642201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224642202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224642204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224642204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224642204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:43.593685 run osmo-stp_10.42.42.5(pid=9696): stdout: | (launched: 2022-12-13_22:46:42.032647) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:43.713108 run osmo-stp_10.42.42.5(pid=9696): stderr: | 20221213224642201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224642201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224642201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224642202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224642204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224642204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224642204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:43.856113 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9696): Process ended prematurely: osmo-stp_10.42.42.5(pid=9696) [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9696)] [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:46:43.864883 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:46:43.891269 run osmo-hlr_10.42.42.2(pid=9693): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9693)] 22:46:43.938208 run osmo-hlr_10.42.42.2(pid=9693): stdout: | (launched: 2022-12-13_22:46:41.101923) 22:46:43.986811 run osmo-hlr_10.42.42.2(pid=9693): stderr: | 20221213224641276 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224641276 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224641276 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224641276 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224641276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224641276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224641288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224641298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224641298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224641298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:44.054896 run osmo-msc_10.42.42.6(pid=9699): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9699)] 22:46:44.101803 run osmo-msc_10.42.42.6(pid=9699): stdout: | (launched: 2022-12-13_22:46:42.991603) 22:46:44.150215 run osmo-msc_10.42.42.6(pid=9699): stderr: | 20221213224643264 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224643264 DLGLOBAL DEBUG validating counter group 0x7f9fd5b40c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224643264 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224643264 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224643265 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224643265 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224643266 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224643267 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224643267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224643267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:44.199061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9692): Terminating (SIGTERM) 22:46:44.238878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9695): Terminating (SIGTERM) 22:46:44.278572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9698): Terminating (SIGTERM) 22:46:44.318111 --- ParallelTerminationStrategy: PID 9692 died... 22:46:44.337270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9692): Terminated: ok {rc=0} 22:46:44.380930 --- ParallelTerminationStrategy: PID 9695 died... 22:46:44.399466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9695): Terminated: ok {rc=0} 22:46:44.442866 --- ParallelTerminationStrategy: PID 9698 died... 22:46:44.461383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9698): Terminated: ok {rc=0} 22:46:44.544525 bus /sierra_3: Setting Powered False 22:46:45.639092 bus /sierra_3: Setting Powered False 22:46:46.767665 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:46:47.933632 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:47.946142 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:46:48.008068 tst mo_mt_call_osmux.py: using LAC 36751 22:46:48.134672 tst mo_mt_call_osmux.py: using RAC 31 22:46:48.263497 tst mo_mt_call_osmux.py: using CellId 36751 22:46:48.388779 tst mo_mt_call_osmux.py: using BVCI 36752 22:46:48.505499 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:48.517179 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:48.528509 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:48.540038 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:48.551879 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:46:48.563624 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:46:48.679660 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:46:48.800515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:49.299475 run create_hlr_db(pid=9701): Launched 22:46:49.422042 bus /sierra_2: Setting Powered False 22:46:50.486089 run create_hlr_db(pid=9701): Terminated: ok {rc=0} 22:46:50.934204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9703): Launched 22:46:51.255925 run osmo-hlr_10.42.42.2(pid=9704): Launched 22:46:51.379869 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:51.934348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9706): Launched 22:46:52.256908 run osmo-stp_10.42.42.5(pid=9707): Launched 22:46:52.380818 run osmo-msc_10.42.42.6: Starting osmo-msc 22:46:52.965799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9709): Launched 22:46:53.288472 run osmo-msc_10.42.42.6(pid=9710): Launched 22:46:53.470614 run osmo-stp_10.42.42.5(pid=9707): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9707)] 22:46:53.608137 run osmo-stp_10.42.42.5(pid=9707): stdout: | (launched: 2022-12-13_22:46:52.198580) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:53.745560 run osmo-stp_10.42.42.5(pid=9707): stderr: | 20221213224652389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224652389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224652390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224652390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224652390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224652390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224652390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:53.881614 run osmo-stp_10.42.42.5(pid=9707): stdout: | (launched: 2022-12-13_22:46:52.198580) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:54.010435 run osmo-stp_10.42.42.5(pid=9707): stderr: | 20221213224652389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224652389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224652390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224652390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224652390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224652390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224652390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:54.164540 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9707): Process ended prematurely: osmo-stp_10.42.42.5(pid=9707) [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9707)] [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:46:54.174351 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:46:54.202221 run osmo-hlr_10.42.42.2(pid=9704): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9704)] 22:46:54.253390 run osmo-hlr_10.42.42.2(pid=9704): stdout: | (launched: 2022-12-13_22:46:51.197754) 22:46:54.305368 run osmo-hlr_10.42.42.2(pid=9704): stderr: | 20221213224651394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224651394 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224651394 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224651394 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224651394 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224651394 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224651405 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224651414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224651414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224651414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:54.378407 run osmo-msc_10.42.42.6(pid=9710): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9710)] 22:46:54.427988 run osmo-msc_10.42.42.6(pid=9710): stdout: | (launched: 2022-12-13_22:46:53.230061) 22:46:54.479830 run osmo-msc_10.42.42.6(pid=9710): stderr: | 20221213224653552 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224653552 DLGLOBAL DEBUG validating counter group 0x7fb135c6fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224653552 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224653552 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224653552 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224653552 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224653554 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224653554 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224653555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224653555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:46:54.532257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9703): Terminating (SIGTERM) 22:46:54.574382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9706): Terminating (SIGTERM) 22:46:54.616838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9709): Terminating (SIGTERM) 22:46:54.659453 --- ParallelTerminationStrategy: PID 9703 died... 22:46:54.680042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9703): Terminated: ok {rc=0} 22:46:54.726600 --- ParallelTerminationStrategy: PID 9706 died... 22:46:54.746631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9706): Terminated: ok {rc=0} 22:46:54.793132 --- ParallelTerminationStrategy: PID 9709 died... 22:46:54.813116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9709): Terminated: ok {rc=0} 22:46:54.901748 bus /sierra_3: Setting Powered False 22:46:55.999626 bus /sierra_3: Setting Powered False 22:46:57.115933 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:46:58.356226 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:46:58.363374 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:46:58.386791 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:46:58.413137 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:46:58.466619 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:46:58.491400 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:46:58.519087 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:46:59.066817 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:46:59.114905 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:46:59.126230 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:46:59.185715 tst mo_mt_call.py: using LAC 36752 22:46:59.303609 tst mo_mt_call.py: using RAC 32 22:46:59.422595 tst mo_mt_call.py: using CellId 36752 22:46:59.542120 tst mo_mt_call.py: using BVCI 36753 22:46:59.652466 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:46:59.663765 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:46:59.674759 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:46:59.685791 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:46:59.696809 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:46:59.707847 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:46:59.827380 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:46:59.944151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:00.409038 run create_hlr_db(pid=9715): Launched 22:47:00.531142 bus /sierra_2: Setting Powered False 22:47:01.606413 run create_hlr_db(pid=9715): Terminated: ok {rc=0} 22:47:02.117877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9717): Launched 22:47:02.447555 run osmo-hlr_10.42.42.2(pid=9718): Launched 22:47:02.572819 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:03.129629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9720): Launched 22:47:03.449372 run osmo-stp_10.42.42.5(pid=9721): Launched 22:47:03.573706 run osmo-msc_10.42.42.6: Starting osmo-msc 22:47:04.160165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9723): Launched 22:47:04.481709 run osmo-msc_10.42.42.6(pid=9724): Launched 22:47:04.662155 run osmo-stp_10.42.42.5(pid=9721): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9721)] 22:47:04.798323 run osmo-stp_10.42.42.5(pid=9721): stdout: | (launched: 2022-12-13_22:47:03.391260) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:04.935250 run osmo-stp_10.42.42.5(pid=9721): stderr: | 20221213224703584 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224703585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224703585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224703585 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224703586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224703586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224703586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:05.071167 run osmo-stp_10.42.42.5(pid=9721): stdout: | (launched: 2022-12-13_22:47:03.391260) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:05.199247 run osmo-stp_10.42.42.5(pid=9721): stderr: | 20221213224703584 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224703585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224703585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224703585 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224703586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224703586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224703586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:05.352698 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9721): Process ended prematurely: osmo-stp_10.42.42.5(pid=9721) [trial-2395↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9721)] [trial-2395↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:47:05.362369 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:47:05.390046 run osmo-hlr_10.42.42.2(pid=9718): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9718)] 22:47:05.440463 run osmo-hlr_10.42.42.2(pid=9718): stdout: | (launched: 2022-12-13_22:47:02.389150) 22:47:05.491983 run osmo-hlr_10.42.42.2(pid=9718): stderr: | 20221213224702587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224702587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224702587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224702587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224702587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224702587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224702599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224702610 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224702610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224702610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:05.564541 run osmo-msc_10.42.42.6(pid=9724): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9724)] 22:47:05.613999 run osmo-msc_10.42.42.6(pid=9724): stdout: | (launched: 2022-12-13_22:47:04.422977) 22:47:05.665333 run osmo-msc_10.42.42.6(pid=9724): stderr: | 20221213224704745 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224704745 DLGLOBAL DEBUG validating counter group 0x7f34da52dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224704745 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224704745 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224704745 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224704745 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224704747 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224704747 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224704747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224704748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:47:05.717337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9717): Terminating (SIGTERM) 22:47:05.758884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9720): Terminating (SIGTERM) 22:47:05.800418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9723): Terminating (SIGTERM) 22:47:05.842337 --- ParallelTerminationStrategy: PID 9717 died... 22:47:05.862630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9717): Terminated: ok {rc=0} 22:47:05.908799 --- ParallelTerminationStrategy: PID 9720 died... 22:47:05.928607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9720): Terminated: ok {rc=0} 22:47:05.974616 --- ParallelTerminationStrategy: PID 9723 died... 22:47:05.994410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9723): Terminated: ok {rc=0} 22:47:06.082083 bus /sierra_3: Setting Powered False 22:47:07.179614 bus /sierra_3: Setting Powered False 22:47:08.295730 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:47:09.437254 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:09.449108 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:47:09.511913 tst mo_mt_call_osmux.py: using LAC 36753 22:47:09.637768 tst mo_mt_call_osmux.py: using RAC 33 22:47:09.763963 tst mo_mt_call_osmux.py: using CellId 36753 22:47:09.888913 tst mo_mt_call_osmux.py: using BVCI 36754 22:47:10.004863 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:10.016487 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:10.027930 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:10.039397 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:10.051369 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:47:10.063328 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:47:10.181575 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:47:10.302871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:10.801731 run create_hlr_db(pid=9726): Launched 22:47:10.923971 bus /sierra_2: Setting Powered False 22:47:11.988537 run create_hlr_db(pid=9726): Terminated: ok {rc=0} 22:47:12.419429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9728): Launched 22:47:12.719483 run osmo-hlr_10.42.42.2(pid=9729): Launched 22:47:12.832861 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:13.365789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9731): Launched 22:47:13.665634 run osmo-stp_10.42.42.5(pid=9732): Launched 22:47:13.780158 run osmo-msc_10.42.42.6: Starting osmo-msc 22:47:14.325458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9734): Launched 22:47:14.626146 run osmo-msc_10.42.42.6(pid=9735): Launched 22:47:14.794333 run osmo-stp_10.42.42.5(pid=9732): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9732)] 22:47:14.921860 run osmo-stp_10.42.42.5(pid=9732): stdout: | (launched: 2022-12-13_22:47:13.610822) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:15.049611 run osmo-stp_10.42.42.5(pid=9732): stderr: | 20221213224713781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224713781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224713781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224713781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224713782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224713782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224713782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:15.174836 run osmo-stp_10.42.42.5(pid=9732): stdout: | (launched: 2022-12-13_22:47:13.610822) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:15.295033 run osmo-stp_10.42.42.5(pid=9732): stderr: | 20221213224713781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224713781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224713781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224713781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224713782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224713782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224713782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:15.438607 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9732): Process ended prematurely: osmo-stp_10.42.42.5(pid=9732) [trial-2395↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9732)] [trial-2395↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:47:15.447333 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:47:15.473760 run osmo-hlr_10.42.42.2(pid=9729): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9729)] 22:47:15.521266 run osmo-hlr_10.42.42.2(pid=9729): stdout: | (launched: 2022-12-13_22:47:12.664830) 22:47:15.570352 run osmo-hlr_10.42.42.2(pid=9729): stderr: | 20221213224712842 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224712842 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224712842 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224712842 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224712842 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224712843 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224712855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224712863 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224712864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224712864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:15.639020 run osmo-msc_10.42.42.6(pid=9735): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9735)] 22:47:15.686040 run osmo-msc_10.42.42.6(pid=9735): stdout: | (launched: 2022-12-13_22:47:14.570935) 22:47:15.734927 run osmo-msc_10.42.42.6(pid=9735): stderr: | 20221213224714843 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224714843 DLGLOBAL DEBUG validating counter group 0x7f0a9db31c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224714843 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224714843 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224714843 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224714843 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224714845 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224714846 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224714846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224714846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:47:15.784008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9728): Terminating (SIGTERM) 22:47:15.823248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9731): Terminating (SIGTERM) 22:47:15.884217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9734): Terminating (SIGTERM) 22:47:15.930051 --- ParallelTerminationStrategy: PID 9728 died... 22:47:15.951941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9728): Terminated: ok {rc=0} 22:47:16.001500 --- ParallelTerminationStrategy: PID 9731 died... 22:47:16.024284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9731): Terminated: ok {rc=0} 22:47:16.072715 --- ParallelTerminationStrategy: PID 9734 died... 22:47:16.094538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9734): Terminated: ok {rc=0} 22:47:16.187191 bus /sierra_3: Setting Powered False 22:47:17.290771 bus /sierra_3: Setting Powered False 22:47:18.407119 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 emergency:nanobts+band-1900 --------------------------------------------------------------------- 22:47:19.651397 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:47:19.657171 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 22:47:19.681493 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 22:47:19.710026 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 22:47:19.796415 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 22:47:19.820830 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 22:47:19.848287 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 22:47:20.434594 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2395 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 22:47:20.439846 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:20.451047 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:47:20.494164 tst emergency_mo_mt_call.py: using LAC 36754 22:47:20.610300 tst emergency_mo_mt_call.py: using RAC 34 22:47:20.724384 tst emergency_mo_mt_call.py: using CellId 36754 22:47:20.849398 tst emergency_mo_mt_call.py: using BVCI 36755 22:47:20.965331 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:20.976592 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:20.987700 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:20.998733 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:21.010125 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:21.021517 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:21.138261 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:21.256469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:21.745077 run create_hlr_db(pid=9740): Launched 22:47:21.866845 bus /sierra_2: Setting Powered False 22:47:22.929515 run create_hlr_db(pid=9740): Terminated: ok {rc=0} 22:47:23.370920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9742): Launched 22:47:23.687348 run osmo-hlr_10.42.42.2(pid=9743): Launched 22:47:23.809304 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:24.352614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9745): Launched 22:47:24.669439 run osmo-stp_10.42.42.5(pid=9746): Launched 22:47:24.800220 tst emergency_mo_mt_call.py: using MSISDN 8364 22:47:24.961271 run osmo-msc_10.42.42.6: Starting osmo-msc 22:47:25.530451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9748): Launched 22:47:25.846205 run osmo-msc_10.42.42.6(pid=9749): Launched 22:47:26.023526 run osmo-stp_10.42.42.5(pid=9746): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9746)] 22:47:26.156827 run osmo-stp_10.42.42.5(pid=9746): stdout: | (launched: 2022-12-13_22:47:24.611462) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:26.291339 run osmo-stp_10.42.42.5(pid=9746): stderr: | 20221213224724802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224724802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224724802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224724802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224724803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224724803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224724803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:26.425158 run osmo-stp_10.42.42.5(pid=9746): stdout: | (launched: 2022-12-13_22:47:24.611462) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:26.551202 run osmo-stp_10.42.42.5(pid=9746): stderr: | 20221213224724802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224724802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224724802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224724802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224724803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224724803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224724803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:26.701539 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=9746): Process ended prematurely: osmo-stp_10.42.42.5(pid=9746) [trial-2395↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9746)] [trial-2395↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 22:47:26.710403 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 22:47:26.737805 run osmo-hlr_10.42.42.2(pid=9743): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9743)] 22:47:26.788251 run osmo-hlr_10.42.42.2(pid=9743): stdout: | (launched: 2022-12-13_22:47:23.629864) 22:47:26.840210 run osmo-hlr_10.42.42.2(pid=9743): stderr: | 20221213224723826 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224723826 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224723826 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224723826 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224723826 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224723826 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224723839 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224723849 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224723849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224723849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:26.912737 run osmo-msc_10.42.42.6(pid=9749): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9749)] 22:47:26.962583 run osmo-msc_10.42.42.6(pid=9749): stdout: | (launched: 2022-12-13_22:47:25.788672) 22:47:27.014990 run osmo-msc_10.42.42.6(pid=9749): stderr: | 20221213224726108 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224726108 DLGLOBAL DEBUG validating counter group 0x7f90a071fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224726108 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224726108 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224726108 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224726109 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224726110 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224726111 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224726111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224726111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:47:27.066840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9742): Terminating (SIGTERM) 22:47:27.109018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9745): Terminating (SIGTERM) 22:47:27.150793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9748): Terminating (SIGTERM) 22:47:27.193039 --- ParallelTerminationStrategy: PID 9742 died... 22:47:27.213384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9742): Terminated: ok {rc=0} 22:47:27.259814 --- ParallelTerminationStrategy: PID 9745 died... 22:47:27.279589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9745): Terminated: ok {rc=0} 22:47:27.326112 --- ParallelTerminationStrategy: PID 9748 died... 22:47:27.346035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9748): Terminated: ok {rc=0} 22:47:27.433708 bus /sierra_3: Setting Powered False 22:47:28.534141 bus /sierra_3: Setting Powered False 22:47:29.650841 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 22:47:30.737511 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:30.749567 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:47:30.791969 tst emergency_preemptive_call.py: using LAC 36755 22:47:30.935761 tst emergency_preemptive_call.py: using RAC 35 22:47:31.062556 tst emergency_preemptive_call.py: using CellId 36755 22:47:31.217048 tst emergency_preemptive_call.py: using BVCI 36756 22:47:31.327730 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:31.338893 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:31.350006 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:31.361591 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:31.373243 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 22:47:31.384400 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:31.503488 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:31.621695 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:31.751191 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:31.890570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:32.360727 run create_hlr_db(pid=9751): Launched 22:47:32.483414 bus /sierra_2: Setting Powered False 22:47:33.543195 run create_hlr_db(pid=9751): Terminated: ok {rc=0} 22:47:33.977303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9753): Launched 22:47:34.293969 run osmo-hlr_10.42.42.2(pid=9754): Launched 22:47:34.415797 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:34.960541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9756): Launched 22:47:35.277719 run osmo-stp_10.42.42.5(pid=9757): Launched 22:47:35.408823 tst emergency_preemptive_call.py: using MSISDN 8365 22:47:35.572381 run osmo-msc_10.42.42.6: Starting osmo-msc 22:47:36.142794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9759): Launched 22:47:36.458334 run osmo-msc_10.42.42.6(pid=9760): Launched 22:47:36.636166 run osmo-stp_10.42.42.5(pid=9757): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9757)] 22:47:36.774105 run osmo-stp_10.42.42.5(pid=9757): stdout: | (launched: 2022-12-13_22:47:35.220053) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:36.905483 run osmo-stp_10.42.42.5(pid=9757): stderr: | 20221213224735416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224735416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224735416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224735416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224735417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224735417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224735417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:37.038127 run osmo-stp_10.42.42.5(pid=9757): stdout: | (launched: 2022-12-13_22:47:35.220053) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:37.164322 run osmo-stp_10.42.42.5(pid=9757): stderr: | 20221213224735416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224735416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224735416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224735416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224735417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224735417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224735417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:37.316216 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=9757): Process ended prematurely: osmo-stp_10.42.42.5(pid=9757) [trial-2395↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9757)] [trial-2395↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 22:47:37.325482 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 22:47:37.353191 run osmo-hlr_10.42.42.2(pid=9754): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9754)] 22:47:37.404175 run osmo-hlr_10.42.42.2(pid=9754): stdout: | (launched: 2022-12-13_22:47:34.236232) 22:47:37.457100 run osmo-hlr_10.42.42.2(pid=9754): stderr: | 20221213224734432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224734432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224734432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224734432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224734432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224734433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224734449 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224734457 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224734457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224734457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:37.530109 run osmo-msc_10.42.42.6(pid=9760): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9760)] 22:47:37.580259 run osmo-msc_10.42.42.6(pid=9760): stdout: | (launched: 2022-12-13_22:47:36.400694) 22:47:37.632224 run osmo-msc_10.42.42.6(pid=9760): stderr: | 20221213224736722 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213224736722 DLGLOBAL DEBUG validating counter group 0x7f8e0d500c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213224736722 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213224736722 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213224736723 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213224736723 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213224736725 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213224736725 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213224736725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213224736725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:47:37.685554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9753): Terminating (SIGTERM) 22:47:37.727202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9756): Terminating (SIGTERM) 22:47:37.769949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9759): Terminating (SIGTERM) 22:47:37.812654 --- ParallelTerminationStrategy: PID 9753 died... 22:47:37.833212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9753): Terminated: ok {rc=0} 22:47:37.880065 --- ParallelTerminationStrategy: PID 9756 died... 22:47:37.900064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9756): Terminated: ok {rc=0} 22:47:37.946597 --- ParallelTerminationStrategy: PID 9759 died... 22:47:37.966768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9759): Terminated: ok {rc=0} 22:47:38.055235 bus /sierra_9: Setting Powered False 22:47:39.152489 bus /sierra_9: Setting Powered False 22:47:40.268498 bus /sierra_8: Setting Powered False 22:47:41.367332 bus /sierra_8: Setting Powered False 22:47:42.485044 bus /sierra_3: Setting Powered False 22:47:43.583624 bus /sierra_3: Setting Powered False 22:47:44.696878 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:nanobts+band-1900 --------------------------------------------------------------------- 22:47:45.972093 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:47:45.977632 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 22:47:46.001899 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 22:47:46.041754 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 22:47:46.129985 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 22:47:46.161583 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 22:47:46.215093 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 22:47:46.781427 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 22:47:46.851583 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:46.865889 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:47:46.910570 tst cs_paging_gprs_active.py: using LAC 36756 22:47:47.041352 tst cs_paging_gprs_active.py: using RAC 36 22:47:47.171622 tst cs_paging_gprs_active.py: using CellId 36756 22:47:47.301350 tst cs_paging_gprs_active.py: using BVCI 36757 22:47:47.414812 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:47.425761 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:47.436244 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:47.446860 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:47.457508 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:47.468016 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:47.478788 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:47.489952 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:47.500694 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:47.618144 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:47:47.734884 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:47:47.937650 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:47:48.239376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9765): Launched 22:47:48.502154 run iperf3-srv_10.42.42.10(pid=9766): Launched 22:47:48.615313 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:47:48.817473 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:47:49.120631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9767): Launched 22:47:49.384919 run iperf3-srv_10.42.42.10(pid=9768): Launched 22:47:49.498056 tst cs_paging_gprs_active.py:38: start network... 22:47:49.699730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:50.167142 run create_hlr_db(pid=9769): Launched 22:47:50.290999 bus /sierra_2: Setting Powered False 22:47:51.351622 run create_hlr_db(pid=9769): Terminated: ok {rc=0} 22:47:51.792637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9771): Launched 22:47:52.117120 run osmo-hlr_10.42.42.2(pid=9772): Launched 22:47:52.242439 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:52.764346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9774): Launched 22:47:53.066610 run osmo-stp_10.42.42.5(pid=9775): Launched 22:47:53.181894 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:47:53.702605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9777): Launched 22:47:53.818270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:47:54.073466 run patchelf(pid=9778): Launched 22:47:54.241883 run osmo-stp_10.42.42.5(pid=9775): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9775)] 22:47:54.369762 run osmo-stp_10.42.42.5(pid=9775): stdout: | (launched: 2022-12-13_22:47:53.011464) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:54.499036 run osmo-stp_10.42.42.5(pid=9775): stderr: | 20221213224753182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224753182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224753182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224753182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224753183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224753183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224753183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:54.628336 run osmo-stp_10.42.42.5(pid=9775): stdout: | (launched: 2022-12-13_22:47:53.011464) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:54.751786 run osmo-stp_10.42.42.5(pid=9775): stderr: | 20221213224753182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224753182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224753182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224753182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224753183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224753183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224753183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:54.898595 run patchelf(pid=9778): Terminating (SIGINT) 22:47:55.068207 run patchelf(pid=9778): Terminated: ok {rc=0} 22:47:55.190216 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9775): Process ended prematurely: osmo-stp_10.42.42.5(pid=9775) [trial-2395↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9775)] [trial-2395↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 22:47:55.199545 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 22:47:55.226681 run osmo-hlr_10.42.42.2(pid=9772): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9772)] 22:47:55.274720 run osmo-hlr_10.42.42.2(pid=9772): stdout: | (launched: 2022-12-13_22:47:52.058159) 22:47:55.324911 run osmo-hlr_10.42.42.2(pid=9772): stderr: | 20221213224752257 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224752257 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224752257 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224752257 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224752257 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224752257 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224752270 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224752278 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224752278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224752278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:55.375202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9765): Terminating (SIGTERM) 22:47:55.415240 run iperf3-srv_10.42.42.10(pid=9766): Terminating (SIGTERM) 22:47:55.455052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9767): Terminating (SIGTERM) 22:47:55.494984 run iperf3-srv_10.42.42.10(pid=9768): Terminating (SIGTERM) 22:47:55.535028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9771): Terminating (SIGTERM) 22:47:55.575023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9774): Terminating (SIGTERM) 22:47:55.614646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9777): Terminating (SIGTERM) 22:47:55.654586 --- ParallelTerminationStrategy: PID 9765 died... 22:47:55.673926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9765): Terminated: ok {rc=0} 22:47:55.718165 --- ParallelTerminationStrategy: PID 9766 died... 22:47:55.736704 run iperf3-srv_10.42.42.10(pid=9766): Terminated {rc=256} 22:47:55.780424 --- ParallelTerminationStrategy: PID 9767 died... 22:47:55.799010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9767): Terminated: ok {rc=0} 22:47:55.842884 --- ParallelTerminationStrategy: PID 9768 died... 22:47:55.861554 run iperf3-srv_10.42.42.10(pid=9768): Terminated {rc=256} 22:47:55.905384 --- ParallelTerminationStrategy: PID 9771 died... 22:47:55.924067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9771): Terminated: ok {rc=0} 22:47:55.967753 --- ParallelTerminationStrategy: PID 9774 died... 22:47:55.986367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9774): Terminated: ok {rc=0} 22:47:56.029943 --- ParallelTerminationStrategy: PID 9777 died... 22:47:56.048404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9777): Terminated: ok {rc=0} 22:47:56.134202 bus /gobi_0: Setting Powered False 22:47:57.234060 bus /gobi_0: Setting Powered False 22:47:58.349062 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 22:47:59.497136 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:47:59.509109 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:47:59.549790 tst iperf3.py: using LAC 36757 22:47:59.675769 tst iperf3.py: using RAC 37 22:47:59.801404 tst iperf3.py: using CellId 36757 22:47:59.928850 tst iperf3.py: using BVCI 36758 22:48:00.045688 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:00.056882 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:00.068020 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:00.079037 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:00.090226 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:00.101442 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:00.112787 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:00.124072 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:00.135479 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:00.252807 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:48:00.454531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:00.755845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9779): Launched 22:48:01.056582 run iperf3-srv_10.42.42.10(pid=9780): Launched 22:48:01.214891 tst iperf3.py:8: start network... 22:48:01.455205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:01.979069 run create_hlr_db(pid=9781): Launched 22:48:02.139183 bus /gobi_6: Setting Powered False 22:48:03.199117 run create_hlr_db(pid=9781): Terminated: ok {rc=0} 22:48:03.644085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9783): Launched 22:48:03.965653 run osmo-hlr_10.42.42.2(pid=9784): Launched 22:48:04.088624 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:04.642964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9786): Launched 22:48:04.964892 run osmo-stp_10.42.42.5(pid=9787): Launched 22:48:05.089105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:05.647890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9789): Launched 22:48:05.771485 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:06.044309 run patchelf(pid=9790): Launched 22:48:06.223613 run osmo-stp_10.42.42.5(pid=9787): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9787)] 22:48:06.360274 run osmo-stp_10.42.42.5(pid=9787): stdout: | (launched: 2022-12-13_22:48:04.906693) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:06.498291 run osmo-stp_10.42.42.5(pid=9787): stderr: | 20221213224805099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224805099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224805099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224805099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224805100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224805100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224805100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:06.637122 run osmo-stp_10.42.42.5(pid=9787): stdout: | (launched: 2022-12-13_22:48:04.906693) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:06.769537 run osmo-stp_10.42.42.5(pid=9787): stderr: | 20221213224805099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224805099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224805099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224805099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224805100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224805100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224805100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:06.926448 run patchelf(pid=9790): Terminating (SIGINT) 22:48:07.107442 run patchelf(pid=9790): Terminated: ok {rc=0} 22:48:07.238170 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9787): Process ended prematurely: osmo-stp_10.42.42.5(pid=9787) [trial-2395↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9787)] [trial-2395↪gprs:nanobts+band-1900↪iperf3.py:8] 22:48:07.248328 tst iperf3.py:8: Test FAILED (7.8 sec) 22:48:07.276898 run osmo-hlr_10.42.42.2(pid=9784): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9784)] 22:48:07.327547 run osmo-hlr_10.42.42.2(pid=9784): stdout: | (launched: 2022-12-13_22:48:03.907064) 22:48:07.379476 run osmo-hlr_10.42.42.2(pid=9784): stderr: | 20221213224804106 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224804106 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224804106 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224804106 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224804107 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224804107 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224804119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224804128 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224804128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224804128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:07.432020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9779): Terminating (SIGTERM) 22:48:07.474218 run iperf3-srv_10.42.42.10(pid=9780): Terminating (SIGTERM) 22:48:07.516689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9783): Terminating (SIGTERM) 22:48:07.559011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9786): Terminating (SIGTERM) 22:48:07.600911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9789): Terminating (SIGTERM) 22:48:07.643152 --- ParallelTerminationStrategy: PID 9779 died... 22:48:07.663496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9779): Terminated: ok {rc=0} 22:48:07.710067 --- ParallelTerminationStrategy: PID 9780 died... 22:48:07.730007 run iperf3-srv_10.42.42.10(pid=9780): Terminated {rc=256} 22:48:07.776173 --- ParallelTerminationStrategy: PID 9783 died... 22:48:07.796004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9783): Terminated: ok {rc=0} 22:48:07.842686 --- ParallelTerminationStrategy: PID 9786 died... 22:48:07.862595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9786): Terminated: ok {rc=0} 22:48:07.908768 --- ParallelTerminationStrategy: PID 9789 died... 22:48:07.928737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9789): Terminated: ok {rc=0} 22:48:08.017110 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 22:48:09.165090 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.176202 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:48:09.214987 tst iperf3m4.py: using LAC 36758 22:48:09.339460 tst iperf3m4.py: using RAC 38 22:48:09.458408 tst iperf3m4.py: using CellId 36758 22:48:09.576646 tst iperf3m4.py: using BVCI 36759 22:48:09.685635 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.696173 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.706740 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.717270 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.727604 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.738016 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.748448 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.758848 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:09.769407 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:09.885079 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:10.008287 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:10.126018 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:10.246337 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:48:10.463896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:10.788004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9791): Launched 22:48:11.066388 run iperf3-srv_10.42.42.10(pid=9792): Launched 22:48:11.186991 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:48:11.403178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:11.726332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9793): Launched 22:48:12.006038 run iperf3-srv_10.42.42.10(pid=9794): Launched 22:48:12.126477 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:48:12.343172 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:12.666088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9795): Launched 22:48:12.945479 run iperf3-srv_10.42.42.10(pid=9796): Launched 22:48:13.065683 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:48:13.281773 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:13.604294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9797): Launched 22:48:13.884090 run iperf3-srv_10.42.42.10(pid=9798): Launched 22:48:14.004811 tst iperf3m4.py:8: start network... 22:48:14.220745 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:14.720244 run create_hlr_db(pid=9799): Launched 22:48:14.842855 bus /gobi_6: Setting Powered False 22:48:15.909313 run create_hlr_db(pid=9799): Terminated: ok {rc=0} 22:48:16.382835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9801): Launched 22:48:16.726607 run osmo-hlr_10.42.42.2(pid=9802): Launched 22:48:16.909217 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:17.609074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9804): Launched 22:48:17.931860 run osmo-stp_10.42.42.5(pid=9805): Launched 22:48:18.055766 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:18.613663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9807): Launched 22:48:18.736754 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:19.007675 run patchelf(pid=9808): Launched 22:48:19.189224 run osmo-stp_10.42.42.5(pid=9805): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9805)] 22:48:19.325503 run osmo-stp_10.42.42.5(pid=9805): stdout: | (launched: 2022-12-13_22:48:17.873323) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:19.463306 run osmo-stp_10.42.42.5(pid=9805): stderr: | 20221213224818065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224818065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224818065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224818066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224818066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224818066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224818066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:19.602356 run osmo-stp_10.42.42.5(pid=9805): stdout: | (launched: 2022-12-13_22:48:17.873323) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:19.734270 run osmo-stp_10.42.42.5(pid=9805): stderr: | 20221213224818065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224818065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224818065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224818066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224818066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224818066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224818066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:19.890944 run patchelf(pid=9808): Terminating (SIGINT) 22:48:20.071473 run patchelf(pid=9808): Terminated: ok {rc=0} 22:48:20.201857 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9805): Process ended prematurely: osmo-stp_10.42.42.5(pid=9805) [trial-2395↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9805)] [trial-2395↪gprs:nanobts+band-1900↪iperf3m4.py:8] 22:48:20.212080 tst iperf3m4.py:8: Test FAILED (11.1 sec) 22:48:20.240591 run osmo-hlr_10.42.42.2(pid=9802): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9802)] 22:48:20.290794 run osmo-hlr_10.42.42.2(pid=9802): stdout: | (launched: 2022-12-13_22:48:16.659639) 22:48:20.342523 run osmo-hlr_10.42.42.2(pid=9802): stderr: | 20221213224816992 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224816992 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224816992 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224816992 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224816992 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224816992 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224817010 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224817027 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224817027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224817027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:20.394596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9791): Terminating (SIGTERM) 22:48:20.435958 run iperf3-srv_10.42.42.10(pid=9792): Terminating (SIGTERM) 22:48:20.477642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9793): Terminating (SIGTERM) 22:48:20.519393 run iperf3-srv_10.42.42.10(pid=9794): Terminating (SIGTERM) 22:48:20.561747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9795): Terminating (SIGTERM) 22:48:20.603773 run iperf3-srv_10.42.42.10(pid=9796): Terminating (SIGTERM) 22:48:20.645818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9797): Terminating (SIGTERM) 22:48:20.688070 run iperf3-srv_10.42.42.10(pid=9798): Terminating (SIGTERM) 22:48:20.729653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9801): Terminating (SIGTERM) 22:48:20.772320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9804): Terminating (SIGTERM) 22:48:20.813950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9807): Terminating (SIGTERM) 22:48:20.856361 --- ParallelTerminationStrategy: PID 9791 died... 22:48:20.876777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9791): Terminated: ok {rc=0} 22:48:20.923112 --- ParallelTerminationStrategy: PID 9792 died... 22:48:20.942928 run iperf3-srv_10.42.42.10(pid=9792): Terminated {rc=256} 22:48:20.989100 --- ParallelTerminationStrategy: PID 9793 died... 22:48:21.008819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9793): Terminated: ok {rc=0} 22:48:21.055085 --- ParallelTerminationStrategy: PID 9794 died... 22:48:21.074929 run iperf3-srv_10.42.42.10(pid=9794): Terminated {rc=256} 22:48:21.120923 --- ParallelTerminationStrategy: PID 9795 died... 22:48:21.141195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9795): Terminated: ok {rc=0} 22:48:21.187276 --- ParallelTerminationStrategy: PID 9796 died... 22:48:21.207054 run iperf3-srv_10.42.42.10(pid=9796): Terminated {rc=256} 22:48:21.253074 --- ParallelTerminationStrategy: PID 9797 died... 22:48:21.272809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9797): Terminated: ok {rc=0} 22:48:21.319024 --- ParallelTerminationStrategy: PID 9798 died... 22:48:21.338883 run iperf3-srv_10.42.42.10(pid=9798): Terminated {rc=256} 22:48:21.385050 --- ParallelTerminationStrategy: PID 9801 died... 22:48:21.404906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9801): Terminated: ok {rc=0} 22:48:21.450997 --- ParallelTerminationStrategy: PID 9804 died... 22:48:21.470878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9804): Terminated: ok {rc=0} 22:48:21.516825 --- ParallelTerminationStrategy: PID 9807 died... 22:48:21.536833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9807): Terminated: ok {rc=0} 22:48:21.624820 bus /gobi_4: Setting Powered False 22:48:22.724014 bus /gobi_4: Setting Powered False 22:48:23.838476 bus /gobi_1: Setting Powered False 22:48:24.936585 bus /gobi_1: Setting Powered False 22:48:26.048101 bus /gobi_0: Setting Powered False 22:48:27.144522 bus /gobi_0: Setting Powered False 22:48:28.262294 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 22:48:29.363860 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:29.375089 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:48:29.413370 tst ping.py: using LAC 36759 22:48:29.531769 tst ping.py: using RAC 39 22:48:29.649074 tst ping.py: using CellId 36759 22:48:29.766539 tst ping.py: using BVCI 36760 22:48:29.874943 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:29.885636 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:29.896154 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:29.906656 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:29.917009 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:29.927842 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:29.938907 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:29.949472 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:30.063427 tst ping.py:19: start network... 22:48:30.260700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:30.716227 run create_hlr_db(pid=9810): Launched 22:48:30.829677 bus /gobi_6: Setting Powered False 22:48:31.914138 run create_hlr_db(pid=9810): Terminated: ok {rc=0} 22:48:32.407680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9812): Launched 22:48:32.725998 run osmo-hlr_10.42.42.2(pid=9813): Launched 22:48:32.846317 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:33.392887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9815): Launched 22:48:33.710157 run osmo-stp_10.42.42.5(pid=9816): Launched 22:48:33.831355 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:34.378144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9818): Launched 22:48:34.499022 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:34.766760 run patchelf(pid=9819): Launched 22:48:34.943160 run osmo-stp_10.42.42.5(pid=9816): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9816)] 22:48:35.077437 run osmo-stp_10.42.42.5(pid=9816): stdout: | (launched: 2022-12-13_22:48:33.652311) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:35.213780 run osmo-stp_10.42.42.5(pid=9816): stderr: | 20221213224833845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224833845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224833845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224833846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224833846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224833846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224833846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:35.350126 run osmo-stp_10.42.42.5(pid=9816): stdout: | (launched: 2022-12-13_22:48:33.652311) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:35.480517 run osmo-stp_10.42.42.5(pid=9816): stderr: | 20221213224833845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224833845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224833845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224833846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224833846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224833846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224833846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:35.635492 run patchelf(pid=9819): Terminating (SIGINT) 22:48:35.813528 run patchelf(pid=9819): Terminated: ok {rc=0} 22:48:35.941291 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9816): Process ended prematurely: osmo-stp_10.42.42.5(pid=9816) [trial-2395↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9816)] [trial-2395↪gprs:nanobts+band-1900↪ping.py:22] 22:48:35.950800 tst ping.py:22: Test FAILED (6.6 sec) 22:48:35.978794 run osmo-hlr_10.42.42.2(pid=9813): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9813)] 22:48:36.029333 run osmo-hlr_10.42.42.2(pid=9813): stdout: | (launched: 2022-12-13_22:48:32.668378) 22:48:36.081502 run osmo-hlr_10.42.42.2(pid=9813): stderr: | 20221213224832867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224832867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224832867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224832867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224832867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224832867 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224832879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224832889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224832889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224832889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:36.133103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9812): Terminating (SIGTERM) 22:48:36.174618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9815): Terminating (SIGTERM) 22:48:36.216382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9818): Terminating (SIGTERM) 22:48:36.258369 --- ParallelTerminationStrategy: PID 9812 died... 22:48:36.278585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9812): Terminated: ok {rc=0} 22:48:36.325168 --- ParallelTerminationStrategy: PID 9815 died... 22:48:36.345151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9815): Terminated: ok {rc=0} 22:48:36.391106 --- ParallelTerminationStrategy: PID 9818 died... 22:48:36.410910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9818): Terminated: ok {rc=0} 22:48:36.498083 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 22:48:37.586618 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:37.598356 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 22:48:37.638627 tst ping_idle_ping.py: using LAC 36760 22:48:37.761088 tst ping_idle_ping.py: using RAC 40 22:48:37.878501 tst ping_idle_ping.py: using CellId 36760 22:48:37.995565 tst ping_idle_ping.py: using BVCI 36761 22:48:38.103100 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:38.113817 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:38.124386 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:38.135017 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:38.145475 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:38.155844 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:38.166356 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 22:48:38.176772 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 22:48:38.295471 tst ping_idle_ping.py:24: start network... 22:48:38.510149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:39.005660 run create_hlr_db(pid=9820): Launched 22:48:39.128142 bus /gobi_6: Setting Powered False 22:48:40.192270 run create_hlr_db(pid=9820): Terminated: ok {rc=0} 22:48:40.618152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9822): Launched 22:48:40.914872 run osmo-hlr_10.42.42.2(pid=9823): Launched 22:48:41.028192 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:41.552417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9825): Launched 22:48:41.850151 run osmo-stp_10.42.42.5(pid=9826): Launched 22:48:41.963422 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:42.476154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9828): Launched 22:48:42.590086 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:42.841178 run patchelf(pid=9829): Launched 22:48:43.006831 run osmo-stp_10.42.42.5(pid=9826): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9826)] 22:48:43.132411 run osmo-stp_10.42.42.5(pid=9826): stdout: | (launched: 2022-12-13_22:48:41.795649) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:43.259558 run osmo-stp_10.42.42.5(pid=9826): stderr: | 20221213224841967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224841967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224841968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224841968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224841968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224841969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224841969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:43.386716 run osmo-stp_10.42.42.5(pid=9826): stdout: | (launched: 2022-12-13_22:48:41.795649) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:43.508742 run osmo-stp_10.42.42.5(pid=9826): stderr: | 20221213224841967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224841967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224841968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224841968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224841968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224841969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224841969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:43.653373 run patchelf(pid=9829): Terminating (SIGINT) 22:48:43.820910 run patchelf(pid=9829): Terminated: ok {rc=0} 22:48:43.940905 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9826): Process ended prematurely: osmo-stp_10.42.42.5(pid=9826) [trial-2395↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9826)] [trial-2395↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 22:48:43.949840 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:48:43.976445 run osmo-hlr_10.42.42.2(pid=9823): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9823)] 22:48:44.023561 run osmo-hlr_10.42.42.2(pid=9823): stdout: | (launched: 2022-12-13_22:48:40.860200) 22:48:44.072484 run osmo-hlr_10.42.42.2(pid=9823): stderr: | 20221213224841036 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224841036 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224841036 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224841036 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224841036 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224841036 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224841048 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224841059 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224841059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224841059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:44.121667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9822): Terminating (SIGTERM) 22:48:44.161097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9825): Terminating (SIGTERM) 22:48:44.200433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9828): Terminating (SIGTERM) 22:48:44.240262 --- ParallelTerminationStrategy: PID 9822 died... 22:48:44.258879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9822): Terminated: ok {rc=0} 22:48:44.302330 --- ParallelTerminationStrategy: PID 9825 died... 22:48:44.320870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9825): Terminated: ok {rc=0} 22:48:44.364298 --- ParallelTerminationStrategy: PID 9828 died... 22:48:44.382866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9828): Terminated: ok {rc=0} 22:48:44.467910 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 22:48:45.766070 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:48:45.771992 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:48:45.795263 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:48:45.849349 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:48:45.958910 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:48:45.993295 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:48:46.042916 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:48:46.614142 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:48:46.665881 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:46.677805 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:48:46.719172 tst cs_paging_gprs_active.py: using LAC 36761 22:48:46.868879 tst cs_paging_gprs_active.py: using RAC 41 22:48:46.998712 tst cs_paging_gprs_active.py: using CellId 36761 22:48:47.127156 tst cs_paging_gprs_active.py: using BVCI 36762 22:48:47.266057 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:47.277860 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:47.290135 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:47.301957 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:47.314226 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:47.326344 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:47.338000 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:47.348433 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:47.359203 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:48:47.481569 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:48:47.600341 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:48:47.803275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:48.105644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9834): Launched 22:48:48.368315 run iperf3-srv_10.42.42.10(pid=9835): Launched 22:48:48.481928 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:48:48.684538 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:48.988055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9836): Launched 22:48:49.252052 run iperf3-srv_10.42.42.10(pid=9837): Launched 22:48:49.365105 tst cs_paging_gprs_active.py:38: start network... 22:48:49.567632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:50.035572 run create_hlr_db(pid=9838): Launched 22:48:50.160144 bus /gobi_6: Setting Powered False 22:48:51.221103 run create_hlr_db(pid=9838): Terminated: ok {rc=0} 22:48:51.662101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9840): Launched 22:48:51.984523 run osmo-hlr_10.42.42.2(pid=9841): Launched 22:48:52.108907 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:52.666946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9843): Launched 22:48:52.973753 run osmo-stp_10.42.42.5(pid=9844): Launched 22:48:53.088379 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:53.607671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9846): Launched 22:48:53.723338 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:53.978911 run patchelf(pid=9847): Launched 22:48:54.146916 run osmo-stp_10.42.42.5(pid=9844): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9844)] 22:48:54.274228 run osmo-stp_10.42.42.5(pid=9844): stdout: | (launched: 2022-12-13_22:48:52.918539) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:54.403573 run osmo-stp_10.42.42.5(pid=9844): stderr: | 20221213224853090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224853090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224853090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224853090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224853091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224853091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224853091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:54.532544 run osmo-stp_10.42.42.5(pid=9844): stdout: | (launched: 2022-12-13_22:48:52.918539) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:54.656568 run osmo-stp_10.42.42.5(pid=9844): stderr: | 20221213224853090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224853090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224853090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224853090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224853091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224853091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224853091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:54.802924 run patchelf(pid=9847): Terminating (SIGINT) 22:48:54.971824 run patchelf(pid=9847): Terminated: ok {rc=0} 22:48:55.093425 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9844): Process ended prematurely: osmo-stp_10.42.42.5(pid=9844) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9844)] [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:48:55.102785 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 22:48:55.129724 run osmo-hlr_10.42.42.2(pid=9841): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9841)] 22:48:55.176519 run osmo-hlr_10.42.42.2(pid=9841): stdout: | (launched: 2022-12-13_22:48:51.926137) 22:48:55.225446 run osmo-hlr_10.42.42.2(pid=9841): stderr: | 20221213224852124 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224852124 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224852124 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224852124 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224852124 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224852124 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224852137 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224852145 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224852145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224852146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:55.274610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9834): Terminating (SIGTERM) 22:48:55.314199 run iperf3-srv_10.42.42.10(pid=9835): Terminating (SIGTERM) 22:48:55.353199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9836): Terminating (SIGTERM) 22:48:55.392201 run iperf3-srv_10.42.42.10(pid=9837): Terminating (SIGTERM) 22:48:55.431225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9840): Terminating (SIGTERM) 22:48:55.470345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9843): Terminating (SIGTERM) 22:48:55.509279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9846): Terminating (SIGTERM) 22:48:55.548557 --- ParallelTerminationStrategy: PID 9834 died... 22:48:55.567722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9834): Terminated: ok {rc=0} 22:48:55.611182 --- ParallelTerminationStrategy: PID 9835 died... 22:48:55.630118 run iperf3-srv_10.42.42.10(pid=9835): Terminated {rc=256} 22:48:55.673337 --- ParallelTerminationStrategy: PID 9836 died... 22:48:55.691822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9836): Terminated: ok {rc=0} 22:48:55.735085 --- ParallelTerminationStrategy: PID 9837 died... 22:48:55.753412 run iperf3-srv_10.42.42.10(pid=9837): Terminated {rc=256} 22:48:55.796826 --- ParallelTerminationStrategy: PID 9840 died... 22:48:55.816122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9840): Terminated: ok {rc=0} 22:48:55.859517 --- ParallelTerminationStrategy: PID 9843 died... 22:48:55.877974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9843): Terminated: ok {rc=0} 22:48:55.921323 --- ParallelTerminationStrategy: PID 9846 died... 22:48:55.939546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9846): Terminated: ok {rc=0} 22:48:56.024470 bus /gobi_0: Setting Powered False 22:48:57.123894 bus /gobi_0: Setting Powered False 22:48:58.239056 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:48:59.383667 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.395089 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:48:59.441533 tst iperf3.py: using LAC 36762 22:48:59.567662 tst iperf3.py: using RAC 42 22:48:59.686217 tst iperf3.py: using CellId 36762 22:48:59.807779 tst iperf3.py: using BVCI 36763 22:48:59.919305 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.930266 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.940913 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.951626 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.962185 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.972704 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.983489 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:48:59.994096 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:00.005277 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:00.124689 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:49:00.342643 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:00.665859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9848): Launched 22:49:00.960025 run iperf3-srv_10.42.42.10(pid=9849): Launched 22:49:01.093690 tst iperf3.py:8: start network... 22:49:01.314772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:01.827491 run create_hlr_db(pid=9850): Launched 22:49:01.990134 bus /gobi_6: Setting Powered False 22:49:03.055365 run create_hlr_db(pid=9850): Terminated: ok {rc=0} 22:49:03.487650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9852): Launched 22:49:03.791890 run osmo-hlr_10.42.42.2(pid=9853): Launched 22:49:03.907769 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:04.428121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9855): Launched 22:49:04.729641 run osmo-stp_10.42.42.5(pid=9856): Launched 22:49:04.844431 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:05.364806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9858): Launched 22:49:05.480650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:05.736366 run patchelf(pid=9859): Launched 22:49:05.905439 run osmo-stp_10.42.42.5(pid=9856): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9856)] 22:49:06.033359 run osmo-stp_10.42.42.5(pid=9856): stdout: | (launched: 2022-12-13_22:49:04.674436) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:06.162824 run osmo-stp_10.42.42.5(pid=9856): stderr: | 20221213224904846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224904846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224904847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224904847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224904847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224904848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224904848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:06.291958 run osmo-stp_10.42.42.5(pid=9856): stdout: | (launched: 2022-12-13_22:49:04.674436) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:06.415562 run osmo-stp_10.42.42.5(pid=9856): stderr: | 20221213224904846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224904846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224904847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224904847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224904847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224904848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224904848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:06.562271 run patchelf(pid=9859): Terminating (SIGINT) 22:49:06.731373 run patchelf(pid=9859): Terminated: ok {rc=0} 22:49:06.852886 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9856): Process ended prematurely: osmo-stp_10.42.42.5(pid=9856) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9856)] [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 22:49:06.862359 tst iperf3.py:8: Test FAILED (7.5 sec) 22:49:06.889461 run osmo-hlr_10.42.42.2(pid=9853): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9853)] 22:49:06.936736 run osmo-hlr_10.42.42.2(pid=9853): stdout: | (launched: 2022-12-13_22:49:03.735301) 22:49:06.985987 run osmo-hlr_10.42.42.2(pid=9853): stderr: | 20221213224903914 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224903914 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224903914 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224903914 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224903914 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224903914 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224903929 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224903941 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224903941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224903941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:07.035479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9848): Terminating (SIGTERM) 22:49:07.075040 run iperf3-srv_10.42.42.10(pid=9849): Terminating (SIGTERM) 22:49:07.114332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9852): Terminating (SIGTERM) 22:49:07.153824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9855): Terminating (SIGTERM) 22:49:07.193063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9858): Terminating (SIGTERM) 22:49:07.233043 --- ParallelTerminationStrategy: PID 9848 died... 22:49:07.252145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9848): Terminated: ok {rc=0} 22:49:07.295785 --- ParallelTerminationStrategy: PID 9849 died... 22:49:07.314490 run iperf3-srv_10.42.42.10(pid=9849): Terminated {rc=256} 22:49:07.357875 --- ParallelTerminationStrategy: PID 9852 died... 22:49:07.376410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9852): Terminated: ok {rc=0} 22:49:07.419608 --- ParallelTerminationStrategy: PID 9855 died... 22:49:07.438188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9855): Terminated: ok {rc=0} 22:49:07.481667 --- ParallelTerminationStrategy: PID 9858 died... 22:49:07.500697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9858): Terminated: ok {rc=0} 22:49:07.586374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:49:08.732599 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:08.744141 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:49:08.785505 tst iperf3m4.py: using LAC 36763 22:49:08.908182 tst iperf3m4.py: using RAC 43 22:49:09.026564 tst iperf3m4.py: using CellId 36763 22:49:09.144611 tst iperf3m4.py: using BVCI 36764 22:49:09.253371 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:09.264345 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:09.275163 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:09.286013 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:09.296574 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:09.307264 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:09.318203 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:09.328822 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:09.339704 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:09.454788 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:09.573349 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:09.689365 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:09.812920 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:49:10.033419 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:10.358726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9860): Launched 22:49:10.641445 run iperf3-srv_10.42.42.10(pid=9861): Launched 22:49:10.762980 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:49:10.980198 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:11.302955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9862): Launched 22:49:11.585390 run iperf3-srv_10.42.42.10(pid=9863): Launched 22:49:11.706829 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:49:11.924893 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:12.249419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9864): Launched 22:49:12.530243 run iperf3-srv_10.42.42.10(pid=9865): Launched 22:49:12.651638 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:49:12.869082 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:13.193119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9866): Launched 22:49:13.474790 run iperf3-srv_10.42.42.10(pid=9867): Launched 22:49:13.596691 tst iperf3m4.py:8: start network... 22:49:13.814742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:14.317178 run create_hlr_db(pid=9868): Launched 22:49:14.441410 bus /gobi_6: Setting Powered False 22:49:15.506034 run create_hlr_db(pid=9868): Terminated: ok {rc=0} 22:49:15.967721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9870): Launched 22:49:16.307721 run osmo-hlr_10.42.42.2(pid=9871): Launched 22:49:16.550286 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:17.249934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9873): Launched 22:49:17.555346 run osmo-stp_10.42.42.5(pid=9874): Launched 22:49:17.671400 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:18.193205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9876): Launched 22:49:18.308434 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:18.563549 run patchelf(pid=9877): Launched 22:49:18.731736 run osmo-stp_10.42.42.5(pid=9874): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9874)] 22:49:18.859615 run osmo-stp_10.42.42.5(pid=9874): stdout: | (launched: 2022-12-13_22:49:17.499843) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:18.988501 run osmo-stp_10.42.42.5(pid=9874): stderr: | 20221213224917671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224917671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224917671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224917671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224917672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224917672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224917672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:19.117812 run osmo-stp_10.42.42.5(pid=9874): stdout: | (launched: 2022-12-13_22:49:17.499843) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:19.241621 run osmo-stp_10.42.42.5(pid=9874): stderr: | 20221213224917671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224917671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224917671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224917671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224917672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224917672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224917672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:19.387773 run patchelf(pid=9877): Terminating (SIGINT) 22:49:19.556650 run patchelf(pid=9877): Terminated: ok {rc=0} 22:49:19.678990 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9874): Process ended prematurely: osmo-stp_10.42.42.5(pid=9874) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9874)] [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 22:49:19.688398 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:49:19.715724 run osmo-hlr_10.42.42.2(pid=9871): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9871)] 22:49:19.762842 run osmo-hlr_10.42.42.2(pid=9871): stdout: | (launched: 2022-12-13_22:49:16.242453) 22:49:19.811448 run osmo-hlr_10.42.42.2(pid=9871): stderr: | 20221213224916594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224916594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224916594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224916594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224916594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224916594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224916607 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224916626 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224916627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224916627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:19.860722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9860): Terminating (SIGTERM) 22:49:19.900392 run iperf3-srv_10.42.42.10(pid=9861): Terminating (SIGTERM) 22:49:19.939778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9862): Terminating (SIGTERM) 22:49:19.979648 run iperf3-srv_10.42.42.10(pid=9863): Terminating (SIGTERM) 22:49:20.019137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9864): Terminating (SIGTERM) 22:49:20.058430 run iperf3-srv_10.42.42.10(pid=9865): Terminating (SIGTERM) 22:49:20.097507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9866): Terminating (SIGTERM) 22:49:20.136782 run iperf3-srv_10.42.42.10(pid=9867): Terminating (SIGTERM) 22:49:20.175881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9870): Terminating (SIGTERM) 22:49:20.215106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9873): Terminating (SIGTERM) 22:49:20.254306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9876): Terminating (SIGTERM) 22:49:20.293843 --- ParallelTerminationStrategy: PID 9860 died... 22:49:20.312695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9860): Terminated: ok {rc=0} 22:49:20.356762 --- ParallelTerminationStrategy: PID 9861 died... 22:49:20.375351 run iperf3-srv_10.42.42.10(pid=9861): Terminated {rc=256} 22:49:20.418610 --- ParallelTerminationStrategy: PID 9862 died... 22:49:20.437207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9862): Terminated: ok {rc=0} 22:49:20.480670 --- ParallelTerminationStrategy: PID 9863 died... 22:49:20.499155 run iperf3-srv_10.42.42.10(pid=9863): Terminated {rc=256} 22:49:20.542515 --- ParallelTerminationStrategy: PID 9864 died... 22:49:20.561041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9864): Terminated: ok {rc=0} 22:49:20.604429 --- ParallelTerminationStrategy: PID 9865 died... 22:49:20.622881 run iperf3-srv_10.42.42.10(pid=9865): Terminated {rc=256} 22:49:20.666320 --- ParallelTerminationStrategy: PID 9866 died... 22:49:20.684917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9866): Terminated: ok {rc=0} 22:49:20.728570 --- ParallelTerminationStrategy: PID 9867 died... 22:49:20.747161 run iperf3-srv_10.42.42.10(pid=9867): Terminated {rc=256} 22:49:20.790430 --- ParallelTerminationStrategy: PID 9870 died... 22:49:20.808919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9870): Terminated: ok {rc=0} 22:49:20.852460 --- ParallelTerminationStrategy: PID 9873 died... 22:49:20.871016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9873): Terminated: ok {rc=0} 22:49:20.914512 --- ParallelTerminationStrategy: PID 9876 died... 22:49:20.933142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9876): Terminated: ok {rc=0} 22:49:21.018651 bus /gobi_4: Setting Powered False 22:49:22.117333 bus /gobi_4: Setting Powered False 22:49:23.232325 bus /gobi_1: Setting Powered False 22:49:24.330069 bus /gobi_1: Setting Powered False 22:49:25.444560 bus /gobi_0: Setting Powered False 22:49:26.544071 bus /gobi_0: Setting Powered False 22:49:27.660030 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 22:49:28.761699 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:28.773252 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:49:28.813548 tst ping.py: using LAC 36764 22:49:28.928403 tst ping.py: using RAC 44 22:49:29.052920 tst ping.py: using CellId 36764 22:49:29.176131 tst ping.py: using BVCI 36765 22:49:29.291128 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:29.302704 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:29.314184 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:29.325622 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:29.337123 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:29.348593 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:29.360284 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:29.371896 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:29.486831 tst ping.py:19: start network... 22:49:29.681484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:30.136595 run create_hlr_db(pid=9878): Launched 22:49:30.259075 bus /gobi_6: Setting Powered False 22:49:31.347833 run create_hlr_db(pid=9878): Terminated: ok {rc=0} 22:49:31.839322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9880): Launched 22:49:32.171891 run osmo-hlr_10.42.42.2(pid=9881): Launched 22:49:32.298670 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:32.853586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9883): Launched 22:49:33.168783 run osmo-stp_10.42.42.5(pid=9884): Launched 22:49:33.290647 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:33.838060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9886): Launched 22:49:33.959367 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:34.226832 run patchelf(pid=9888): Launched 22:49:34.403589 run osmo-stp_10.42.42.5(pid=9884): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9884)] 22:49:34.537957 run osmo-stp_10.42.42.5(pid=9884): stdout: | (launched: 2022-12-13_22:49:33.111569) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:34.674286 run osmo-stp_10.42.42.5(pid=9884): stderr: | 20221213224933302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224933302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224933302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224933302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224933303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224933303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224933303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:34.810318 run osmo-stp_10.42.42.5(pid=9884): stdout: | (launched: 2022-12-13_22:49:33.111569) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:34.940693 run osmo-stp_10.42.42.5(pid=9884): stderr: | 20221213224933302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224933302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224933302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224933302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224933303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224933303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224933303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:35.095065 run patchelf(pid=9888): Terminating (SIGINT) 22:49:35.272193 run patchelf(pid=9888): Terminated: ok {rc=0} 22:49:35.399919 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9884): Process ended prematurely: osmo-stp_10.42.42.5(pid=9884) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9884)] [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 22:49:35.409502 tst ping.py:22: Test FAILED (6.6 sec) 22:49:35.437443 run osmo-hlr_10.42.42.2(pid=9881): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9881)] 22:49:35.487695 run osmo-hlr_10.42.42.2(pid=9881): stdout: | (launched: 2022-12-13_22:49:32.108610) 22:49:35.539739 run osmo-hlr_10.42.42.2(pid=9881): stderr: | 20221213224932339 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224932339 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224932339 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224932339 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224932339 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224932339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224932352 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224932362 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224932362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224932362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:35.592528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9880): Terminating (SIGTERM) 22:49:35.634628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9883): Terminating (SIGTERM) 22:49:35.676642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9886): Terminating (SIGTERM) 22:49:35.719268 --- ParallelTerminationStrategy: PID 9880 died... 22:49:35.739787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9880): Terminated: ok {rc=0} 22:49:35.786567 --- ParallelTerminationStrategy: PID 9883 died... 22:49:35.806673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9883): Terminated: ok {rc=0} 22:49:35.853029 --- ParallelTerminationStrategy: PID 9886 died... 22:49:35.873031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9886): Terminated: ok {rc=0} 22:49:35.961580 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:49:37.048096 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:37.060574 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:49:37.107951 tst ping_idle_ping.py: using LAC 36765 22:49:37.224099 tst ping_idle_ping.py: using RAC 45 22:49:37.347548 tst ping_idle_ping.py: using CellId 36765 22:49:37.472083 tst ping_idle_ping.py: using BVCI 36766 22:49:37.589346 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:37.601007 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:37.612470 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:37.623996 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:37.636071 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:37.647682 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:37.659787 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:49:37.671402 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:49:37.787690 tst ping_idle_ping.py:24: start network... 22:49:37.986052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:38.453549 run create_hlr_db(pid=9889): Launched 22:49:38.575336 bus /gobi_6: Setting Powered False 22:49:39.635877 run create_hlr_db(pid=9889): Terminated: ok {rc=0} 22:49:40.072775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9891): Launched 22:49:40.391609 run osmo-hlr_10.42.42.2(pid=9892): Launched 22:49:40.514584 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:41.063311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9894): Launched 22:49:41.365601 run osmo-stp_10.42.42.5(pid=9895): Launched 22:49:41.479450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:41.990759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9897): Launched 22:49:42.104060 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:42.355070 run patchelf(pid=9898): Launched 22:49:42.519915 run osmo-stp_10.42.42.5(pid=9895): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9895)] 22:49:42.645297 run osmo-stp_10.42.42.5(pid=9895): stdout: | (launched: 2022-12-13_22:49:41.311103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:42.772344 run osmo-stp_10.42.42.5(pid=9895): stderr: | 20221213224941482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224941482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224941482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224941483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224941483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224941483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224941483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:42.899243 run osmo-stp_10.42.42.5(pid=9895): stdout: | (launched: 2022-12-13_22:49:41.311103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:43.020871 run osmo-stp_10.42.42.5(pid=9895): stderr: | 20221213224941482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224941482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224941482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224941483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224941483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224941483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224941483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:43.164890 run patchelf(pid=9898): Terminating (SIGINT) 22:49:43.330817 run patchelf(pid=9898): Terminated: ok {rc=0} 22:49:43.450729 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9895): Process ended prematurely: osmo-stp_10.42.42.5(pid=9895) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9895)] [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 22:49:43.459493 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:49:43.486102 run osmo-hlr_10.42.42.2(pid=9892): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9892)] 22:49:43.533389 run osmo-hlr_10.42.42.2(pid=9892): stdout: | (launched: 2022-12-13_22:49:40.333842) 22:49:43.582087 run osmo-hlr_10.42.42.2(pid=9892): stderr: | 20221213224940530 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224940530 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224940530 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224940530 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224940530 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224940530 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224940542 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224940550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224940551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224940551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:43.630979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9891): Terminating (SIGTERM) 22:49:43.670215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9894): Terminating (SIGTERM) 22:49:43.709400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9897): Terminating (SIGTERM) 22:49:43.749375 --- ParallelTerminationStrategy: PID 9891 died... 22:49:43.768185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9891): Terminated: ok {rc=0} 22:49:43.811565 --- ParallelTerminationStrategy: PID 9894 died... 22:49:43.830587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9894): Terminated: ok {rc=0} 22:49:43.873816 --- ParallelTerminationStrategy: PID 9897 died... 22:49:43.892187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9897): Terminated: ok {rc=0} 22:49:43.977832 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:49:45.272875 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:49:45.279703 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:49:45.302997 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:49:45.341550 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:49:45.429110 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:49:45.453170 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:49:45.490926 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:49:46.135799 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:49:46.193804 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.206494 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:49:46.270899 tst cs_paging_gprs_active.py: using LAC 36766 22:49:46.425303 tst cs_paging_gprs_active.py: using RAC 46 22:49:46.558362 tst cs_paging_gprs_active.py: using CellId 36766 22:49:46.721123 tst cs_paging_gprs_active.py: using BVCI 36767 22:49:46.840803 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.852523 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.864086 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.875552 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.887022 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.898664 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.910411 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.921931 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:46.933592 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:49:47.074763 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:49:47.214287 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:49:47.438134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:47.763234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9902): Launched 22:49:48.044705 run iperf3-srv_10.42.42.10(pid=9903): Launched 22:49:48.166493 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:49:48.384855 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:48.709711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9904): Launched 22:49:48.990602 run iperf3-srv_10.42.42.10(pid=9905): Launched 22:49:49.111897 tst cs_paging_gprs_active.py:38: start network... 22:49:49.329747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:49.830417 run create_hlr_db(pid=9906): Launched 22:49:49.954429 bus /gobi_6: Setting Powered False 22:49:51.018320 run create_hlr_db(pid=9906): Terminated: ok {rc=0} 22:49:51.449383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9908): Launched 22:49:51.751711 run osmo-hlr_10.42.42.2(pid=9909): Launched 22:49:51.867178 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:52.386336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9911): Launched 22:49:52.688283 run osmo-stp_10.42.42.5(pid=9912): Launched 22:49:52.804473 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:53.326226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9914): Launched 22:49:53.442061 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:53.697484 run patchelf(pid=9915): Launched 22:49:53.865892 run osmo-stp_10.42.42.5(pid=9912): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9912)] 22:49:53.993723 run osmo-stp_10.42.42.5(pid=9912): stdout: | (launched: 2022-12-13_22:49:52.633212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:54.123308 run osmo-stp_10.42.42.5(pid=9912): stderr: | 20221213224952801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224952802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224952802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224952802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224952805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224952805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224952805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:54.253117 run osmo-stp_10.42.42.5(pid=9912): stdout: | (launched: 2022-12-13_22:49:52.633212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:54.376937 run osmo-stp_10.42.42.5(pid=9912): stderr: | 20221213224952801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213224952802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213224952802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213224952802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213224952805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213224952805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213224952805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:54.523342 run patchelf(pid=9915): Terminating (SIGINT) 22:49:54.692708 run patchelf(pid=9915): Terminated: ok {rc=0} 22:49:54.815210 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9912): Process ended prematurely: osmo-stp_10.42.42.5(pid=9912) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9912)] [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:49:54.824585 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:49:54.851584 run osmo-hlr_10.42.42.2(pid=9909): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9909)] 22:49:54.898968 run osmo-hlr_10.42.42.2(pid=9909): stdout: | (launched: 2022-12-13_22:49:51.696672) 22:49:54.948070 run osmo-hlr_10.42.42.2(pid=9909): stderr: | 20221213224951876 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213224951876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213224951876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213224951876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213224951876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213224951876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213224951888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213224951899 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213224951899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213224951899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:54.997829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9902): Terminating (SIGTERM) 22:49:55.037237 run iperf3-srv_10.42.42.10(pid=9903): Terminating (SIGTERM) 22:49:55.076623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9904): Terminating (SIGTERM) 22:49:55.116004 run iperf3-srv_10.42.42.10(pid=9905): Terminating (SIGTERM) 22:49:55.156656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9908): Terminating (SIGTERM) 22:49:55.196591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9911): Terminating (SIGTERM) 22:49:55.236133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9914): Terminating (SIGTERM) 22:49:55.275978 --- ParallelTerminationStrategy: PID 9902 died... 22:49:55.295408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9902): Terminated: ok {rc=0} 22:49:55.339220 --- ParallelTerminationStrategy: PID 9903 died... 22:49:55.357940 run iperf3-srv_10.42.42.10(pid=9903): Terminated {rc=256} 22:49:55.401703 --- ParallelTerminationStrategy: PID 9904 died... 22:49:55.420349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9904): Terminated: ok {rc=0} 22:49:55.463882 --- ParallelTerminationStrategy: PID 9905 died... 22:49:55.482532 run iperf3-srv_10.42.42.10(pid=9905): Terminated {rc=256} 22:49:55.526015 --- ParallelTerminationStrategy: PID 9908 died... 22:49:55.544711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9908): Terminated: ok {rc=0} 22:49:55.588194 --- ParallelTerminationStrategy: PID 9911 died... 22:49:55.607058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9911): Terminated: ok {rc=0} 22:49:55.650950 --- ParallelTerminationStrategy: PID 9914 died... 22:49:55.669767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9914): Terminated: ok {rc=0} 22:49:55.753887 bus /gobi_0: Setting Powered False 22:49:56.850101 bus /gobi_0: Setting Powered False 22:49:57.965008 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:49:59.108765 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.120491 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:49:59.183699 tst iperf3.py: using LAC 36767 22:49:59.301904 tst iperf3.py: using RAC 47 22:49:59.420108 tst iperf3.py: using CellId 36767 22:49:59.540688 tst iperf3.py: using BVCI 36768 22:49:59.651699 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.662673 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.674126 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.684845 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.695660 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.706688 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.717665 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.728571 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:49:59.739571 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:49:59.858691 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:50:00.076906 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:50:00.401953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9916): Launched 22:50:00.684211 run iperf3-srv_10.42.42.10(pid=9917): Launched 22:50:00.806185 tst iperf3.py:8: start network... 22:50:01.050189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:01.548748 run create_hlr_db(pid=9921): Launched 22:50:01.704913 bus /gobi_6: Setting Powered False 22:50:02.766169 run create_hlr_db(pid=9921): Terminated: ok {rc=0} 22:50:03.207023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9923): Launched 22:50:03.530871 run osmo-hlr_10.42.42.2(pid=9924): Launched 22:50:03.655187 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:04.212183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9926): Launched 22:50:04.533848 run osmo-stp_10.42.42.5(pid=9927): Launched 22:50:04.658114 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:05.219378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9929): Launched 22:50:05.343320 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:05.616062 run patchelf(pid=9930): Launched 22:50:05.795378 run osmo-stp_10.42.42.5(pid=9927): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9927)] 22:50:05.932411 run osmo-stp_10.42.42.5(pid=9927): stdout: | (launched: 2022-12-13_22:50:04.475622) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:06.070789 run osmo-stp_10.42.42.5(pid=9927): stderr: | 20221213225004667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225004667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225004667 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225004668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225004670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225004670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225004670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:06.209324 run osmo-stp_10.42.42.5(pid=9927): stdout: | (launched: 2022-12-13_22:50:04.475622) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:06.342131 run osmo-stp_10.42.42.5(pid=9927): stderr: | 20221213225004667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225004667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225004667 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225004668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225004670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225004670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225004670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:06.499360 run patchelf(pid=9930): Terminating (SIGINT) 22:50:06.680440 run patchelf(pid=9930): Terminated: ok {rc=0} 22:50:06.810634 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9927): Process ended prematurely: osmo-stp_10.42.42.5(pid=9927) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9927)] [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 22:50:06.821306 tst iperf3.py:8: Test FAILED (7.7 sec) 22:50:06.849986 run osmo-hlr_10.42.42.2(pid=9924): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9924)] 22:50:06.900729 run osmo-hlr_10.42.42.2(pid=9924): stdout: | (launched: 2022-12-13_22:50:03.472113) 22:50:06.953248 run osmo-hlr_10.42.42.2(pid=9924): stderr: | 20221213225003671 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225003671 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225003672 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225003672 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225003672 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225003672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225003683 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225003691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225003691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225003691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:07.005925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9916): Terminating (SIGTERM) 22:50:07.047553 run iperf3-srv_10.42.42.10(pid=9917): Terminating (SIGTERM) 22:50:07.090013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9923): Terminating (SIGTERM) 22:50:07.132004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9926): Terminating (SIGTERM) 22:50:07.173884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9929): Terminating (SIGTERM) 22:50:07.216519 --- ParallelTerminationStrategy: PID 9916 died... 22:50:07.236906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9916): Terminated: ok {rc=0} 22:50:07.283329 --- ParallelTerminationStrategy: PID 9917 died... 22:50:07.303126 run iperf3-srv_10.42.42.10(pid=9917): Terminated {rc=256} 22:50:07.349294 --- ParallelTerminationStrategy: PID 9923 died... 22:50:07.369046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9923): Terminated: ok {rc=0} 22:50:07.415110 --- ParallelTerminationStrategy: PID 9926 died... 22:50:07.435116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9926): Terminated: ok {rc=0} 22:50:07.481351 --- ParallelTerminationStrategy: PID 9929 died... 22:50:07.501276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9929): Terminated: ok {rc=0} 22:50:07.589846 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:50:08.740743 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:08.752774 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:50:08.814698 tst iperf3m4.py: using LAC 36768 22:50:08.936687 tst iperf3m4.py: using RAC 48 22:50:09.056814 tst iperf3m4.py: using CellId 36768 22:50:09.175384 tst iperf3m4.py: using BVCI 36769 22:50:09.286837 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:09.297967 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:09.308886 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:09.319775 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:09.330955 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:09.342302 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:09.353870 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:09.365083 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:09.376376 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:09.498485 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:09.621594 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:09.738534 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:09.858631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:50:10.077287 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:50:10.402403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9931): Launched 22:50:10.684933 run iperf3-srv_10.42.42.10(pid=9932): Launched 22:50:10.806677 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:50:11.024786 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:50:11.349244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9933): Launched 22:50:11.631585 run iperf3-srv_10.42.42.10(pid=9934): Launched 22:50:11.753521 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:50:11.971687 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:50:12.295115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9935): Launched 22:50:12.575819 run iperf3-srv_10.42.42.10(pid=9936): Launched 22:50:12.697763 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:50:12.914740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:50:13.238355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9937): Launched 22:50:13.518574 run iperf3-srv_10.42.42.10(pid=9938): Launched 22:50:13.639743 tst iperf3m4.py:8: start network... 22:50:13.856856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:14.356333 run create_hlr_db(pid=9939): Launched 22:50:14.479001 bus /gobi_6: Setting Powered False 22:50:15.542530 run create_hlr_db(pid=9939): Terminated: ok {rc=0} 22:50:16.014303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9941): Launched 22:50:16.345130 run osmo-hlr_10.42.42.2(pid=9942): Launched 22:50:16.521656 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:17.201198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9944): Launched 22:50:17.514337 run osmo-stp_10.42.42.5(pid=9945): Launched 22:50:17.630472 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:18.150016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9947): Launched 22:50:18.265252 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:18.519854 run patchelf(pid=9948): Launched 22:50:18.687295 run osmo-stp_10.42.42.5(pid=9945): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9945)] 22:50:18.814351 run osmo-stp_10.42.42.5(pid=9945): stdout: | (launched: 2022-12-13_22:50:17.458827) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:18.943157 run osmo-stp_10.42.42.5(pid=9945): stderr: | 20221213225017631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225017631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225017631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225017631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225017632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225017632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225017632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:19.071773 run osmo-stp_10.42.42.5(pid=9945): stdout: | (launched: 2022-12-13_22:50:17.458827) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:19.195110 run osmo-stp_10.42.42.5(pid=9945): stderr: | 20221213225017631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225017631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225017631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225017631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225017632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225017632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225017632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:19.340850 run patchelf(pid=9948): Terminating (SIGINT) 22:50:19.509149 run patchelf(pid=9948): Terminated: ok {rc=0} 22:50:19.630761 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9945): Process ended prematurely: osmo-stp_10.42.42.5(pid=9945) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9945)] [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:50:19.640234 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:50:19.667541 run osmo-hlr_10.42.42.2(pid=9942): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9942)] 22:50:19.714648 run osmo-hlr_10.42.42.2(pid=9942): stdout: | (launched: 2022-12-13_22:50:16.276070) 22:50:19.763367 run osmo-hlr_10.42.42.2(pid=9942): stderr: | 20221213225016644 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225016644 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225016644 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225016644 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225016644 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225016644 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225016669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225016693 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225016693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225016693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:19.812714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9931): Terminating (SIGTERM) 22:50:19.852239 run iperf3-srv_10.42.42.10(pid=9932): Terminating (SIGTERM) 22:50:19.891394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9933): Terminating (SIGTERM) 22:50:19.930687 run iperf3-srv_10.42.42.10(pid=9934): Terminating (SIGTERM) 22:50:19.969804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9935): Terminating (SIGTERM) 22:50:20.009086 run iperf3-srv_10.42.42.10(pid=9936): Terminating (SIGTERM) 22:50:20.048352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9937): Terminating (SIGTERM) 22:50:20.087710 run iperf3-srv_10.42.42.10(pid=9938): Terminating (SIGTERM) 22:50:20.127002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9941): Terminating (SIGTERM) 22:50:20.166450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9944): Terminating (SIGTERM) 22:50:20.205810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9947): Terminating (SIGTERM) 22:50:20.245707 --- ParallelTerminationStrategy: PID 9931 died... 22:50:20.265011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9931): Terminated: ok {rc=0} 22:50:20.308808 --- ParallelTerminationStrategy: PID 9932 died... 22:50:20.327899 run iperf3-srv_10.42.42.10(pid=9932): Terminated {rc=256} 22:50:20.371656 --- ParallelTerminationStrategy: PID 9933 died... 22:50:20.390262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9933): Terminated: ok {rc=0} 22:50:20.433567 --- ParallelTerminationStrategy: PID 9934 died... 22:50:20.452151 run iperf3-srv_10.42.42.10(pid=9934): Terminated {rc=256} 22:50:20.495923 --- ParallelTerminationStrategy: PID 9935 died... 22:50:20.514601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9935): Terminated: ok {rc=0} 22:50:20.557967 --- ParallelTerminationStrategy: PID 9936 died... 22:50:20.576482 run iperf3-srv_10.42.42.10(pid=9936): Terminated {rc=256} 22:50:20.620813 --- ParallelTerminationStrategy: PID 9937 died... 22:50:20.640060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9937): Terminated: ok {rc=0} 22:50:20.683638 --- ParallelTerminationStrategy: PID 9938 died... 22:50:20.702216 run iperf3-srv_10.42.42.10(pid=9938): Terminated {rc=256} 22:50:20.745557 --- ParallelTerminationStrategy: PID 9941 died... 22:50:20.764222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9941): Terminated: ok {rc=0} 22:50:20.807605 --- ParallelTerminationStrategy: PID 9944 died... 22:50:20.826217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9944): Terminated: ok {rc=0} 22:50:20.869838 --- ParallelTerminationStrategy: PID 9947 died... 22:50:20.888377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9947): Terminated: ok {rc=0} 22:50:20.973984 bus /gobi_4: Setting Powered False 22:50:22.074157 bus /gobi_4: Setting Powered False 22:50:23.191222 bus /gobi_1: Setting Powered False 22:50:24.289539 bus /gobi_1: Setting Powered False 22:50:25.407029 bus /gobi_0: Setting Powered False 22:50:26.506405 bus /gobi_0: Setting Powered False 22:50:27.621768 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:50:28.724090 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:28.736244 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:50:28.799676 tst ping.py: using LAC 36769 22:50:28.924152 tst ping.py: using RAC 49 22:50:29.043354 tst ping.py: using CellId 36769 22:50:29.160128 tst ping.py: using BVCI 36770 22:50:29.277421 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:29.289251 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:29.300640 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:29.312131 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:29.323942 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:29.335675 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:29.347400 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:29.359039 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:29.474844 tst ping.py:19: start network... 22:50:29.673065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:30.131791 run create_hlr_db(pid=9949): Launched 22:50:30.255310 bus /gobi_6: Setting Powered False 22:50:31.329601 run create_hlr_db(pid=9949): Terminated: ok {rc=0} 22:50:31.800515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9951): Launched 22:50:32.127725 run osmo-hlr_10.42.42.2(pid=9952): Launched 22:50:32.253434 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:32.787449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9954): Launched 22:50:33.082836 run osmo-stp_10.42.42.5(pid=9955): Launched 22:50:33.195322 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:33.705555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9957): Launched 22:50:33.818573 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:34.067294 run patchelf(pid=9958): Launched 22:50:34.231623 run osmo-stp_10.42.42.5(pid=9955): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9955)] 22:50:34.356508 run osmo-stp_10.42.42.5(pid=9955): stdout: | (launched: 2022-12-13_22:50:33.028589) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:34.483303 run osmo-stp_10.42.42.5(pid=9955): stderr: | 20221213225033196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225033196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225033196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225033197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225033197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225033197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225033197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:34.610512 run osmo-stp_10.42.42.5(pid=9955): stdout: | (launched: 2022-12-13_22:50:33.028589) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:34.731953 run osmo-stp_10.42.42.5(pid=9955): stderr: | 20221213225033196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225033196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225033196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225033197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225033197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225033197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225033197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:34.875354 run patchelf(pid=9958): Terminating (SIGINT) 22:50:35.040882 run patchelf(pid=9958): Terminated: ok {rc=0} 22:50:35.160022 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9955): Process ended prematurely: osmo-stp_10.42.42.5(pid=9955) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9955)] [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 22:50:35.168772 tst ping.py:22: Test FAILED (6.4 sec) 22:50:35.195263 run osmo-hlr_10.42.42.2(pid=9952): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9952)] 22:50:35.242581 run osmo-hlr_10.42.42.2(pid=9952): stdout: | (launched: 2022-12-13_22:50:32.059245) 22:50:35.291263 run osmo-hlr_10.42.42.2(pid=9952): stderr: | 20221213225032330 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225032330 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225032330 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225032330 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225032330 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225032330 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225032342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225032352 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225032352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225032353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:35.340828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9951): Terminating (SIGTERM) 22:50:35.379840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9954): Terminating (SIGTERM) 22:50:35.418914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9957): Terminating (SIGTERM) 22:50:35.458275 --- ParallelTerminationStrategy: PID 9951 died... 22:50:35.477220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9951): Terminated: ok {rc=0} 22:50:35.520619 --- ParallelTerminationStrategy: PID 9954 died... 22:50:35.539138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9954): Terminated: ok {rc=0} 22:50:35.582386 --- ParallelTerminationStrategy: PID 9957 died... 22:50:35.600843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9957): Terminated: ok {rc=0} 22:50:35.683810 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:50:36.770407 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:36.782965 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:50:36.846618 tst ping_idle_ping.py: using LAC 36770 22:50:36.971344 tst ping_idle_ping.py: using RAC 50 22:50:37.095573 tst ping_idle_ping.py: using CellId 36770 22:50:37.218835 tst ping_idle_ping.py: using BVCI 36771 22:50:37.333576 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:37.345178 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:37.356381 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:37.367682 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:37.379137 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:37.390719 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:37.402357 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:50:37.413899 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:50:37.529990 tst ping_idle_ping.py:24: start network... 22:50:37.729248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:38.191364 run create_hlr_db(pid=9959): Launched 22:50:38.314309 bus /gobi_6: Setting Powered False 22:50:39.374254 run create_hlr_db(pid=9959): Terminated: ok {rc=0} 22:50:39.789387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9961): Launched 22:50:40.087193 run osmo-hlr_10.42.42.2(pid=9962): Launched 22:50:40.200096 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:40.730270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9964): Launched 22:50:41.026987 run osmo-stp_10.42.42.5(pid=9965): Launched 22:50:41.141587 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:41.653251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9967): Launched 22:50:41.766626 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:42.016936 run patchelf(pid=9968): Launched 22:50:42.181792 run osmo-stp_10.42.42.5(pid=9965): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9965)] 22:50:42.307079 run osmo-stp_10.42.42.5(pid=9965): stdout: | (launched: 2022-12-13_22:50:40.971777) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:42.434245 run osmo-stp_10.42.42.5(pid=9965): stderr: | 20221213225041141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225041141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225041141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225041142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225041144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225041144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225041144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:42.560795 run osmo-stp_10.42.42.5(pid=9965): stdout: | (launched: 2022-12-13_22:50:40.971777) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:42.683217 run osmo-stp_10.42.42.5(pid=9965): stderr: | 20221213225041141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225041141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225041141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225041142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225041144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225041144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225041144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:42.827075 run patchelf(pid=9968): Terminating (SIGINT) 22:50:42.993508 run patchelf(pid=9968): Terminated: ok {rc=0} 22:50:43.113666 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9965): Process ended prematurely: osmo-stp_10.42.42.5(pid=9965) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9965)] [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:50:43.122528 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 22:50:43.149170 run osmo-hlr_10.42.42.2(pid=9962): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9962)] 22:50:43.196344 run osmo-hlr_10.42.42.2(pid=9962): stdout: | (launched: 2022-12-13_22:50:40.032118) 22:50:43.245319 run osmo-hlr_10.42.42.2(pid=9962): stderr: | 20221213225040208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225040208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225040208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225040208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225040208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225040209 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225040221 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225040230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225040230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225040230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:43.294591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9961): Terminating (SIGTERM) 22:50:43.333850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9964): Terminating (SIGTERM) 22:50:43.373607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9967): Terminating (SIGTERM) 22:50:43.413194 --- ParallelTerminationStrategy: PID 9961 died... 22:50:43.432090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9961): Terminated: ok {rc=0} 22:50:43.475639 --- ParallelTerminationStrategy: PID 9964 died... 22:50:43.494150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9964): Terminated: ok {rc=0} 22:50:43.537549 --- ParallelTerminationStrategy: PID 9967 died... 22:50:43.556035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9967): Terminated: ok {rc=0} 22:50:43.639515 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 22:50:44.938621 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:50:44.946815 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:50:44.971011 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:50:45.007245 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:50:45.063209 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:50:45.088109 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:50:45.121899 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:50:45.680781 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2395 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:50:45.685796 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:45.697225 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:50:45.757253 tst switch_tch_pdch.py: using LAC 36771 22:50:45.879262 tst switch_tch_pdch.py: using RAC 51 22:50:46.021422 tst switch_tch_pdch.py: using CellId 36771 22:50:46.192540 tst switch_tch_pdch.py: using BVCI 36772 22:50:46.303136 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:46.315247 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:46.327396 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:46.339406 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:46.351378 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:46.363200 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:46.375458 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:46.387484 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:50:46.505767 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:50:46.624921 tst switch_tch_pdch.py:51: start network... 22:50:46.830371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:47.301557 run create_hlr_db(pid=9972): Launched 22:50:47.424596 bus /gobi_6: Setting Powered False 22:50:48.485145 run create_hlr_db(pid=9972): Terminated: ok {rc=0} 22:50:48.917894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9974): Launched 22:50:49.234490 run osmo-hlr_10.42.42.2(pid=9975): Launched 22:50:49.356604 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:49.906087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9977): Launched 22:50:50.222292 run osmo-stp_10.42.42.5(pid=9978): Launched 22:50:50.344265 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:50.892775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9980): Launched 22:50:51.014022 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:51.281423 run patchelf(pid=9981): Launched 22:50:51.458842 run osmo-stp_10.42.42.5(pid=9978): ERR: Terminated: ERROR {rc=1} [trial-2395↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9978)] 22:50:51.592740 run osmo-stp_10.42.42.5(pid=9978): stdout: | (launched: 2022-12-13_22:50:50.164411) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:51.729059 run osmo-stp_10.42.42.5(pid=9978): stderr: | 20221213225050354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225050355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225050355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225050355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225050358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225050358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225050358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:51.864589 run osmo-stp_10.42.42.5(pid=9978): stdout: | (launched: 2022-12-13_22:50:50.164411) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:51.997250 run osmo-stp_10.42.42.5(pid=9978): stderr: | 20221213225050354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225050355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225050355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225050355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225050358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225050358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225050358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:52.152325 run patchelf(pid=9981): Terminating (SIGINT) 22:50:52.330298 run patchelf(pid=9981): Terminated: ok {rc=0} 22:50:52.458386 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9978): Process ended prematurely: osmo-stp_10.42.42.5(pid=9978) [trial-2395↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9978)] [trial-2395↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:50:52.467998 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 22:50:52.496325 run osmo-hlr_10.42.42.2(pid=9975): ERR: Terminated: ERROR {rc=237} [trial-2395↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9975)] 22:50:52.546703 run osmo-hlr_10.42.42.2(pid=9975): stdout: | (launched: 2022-12-13_22:50:49.176663) 22:50:52.598736 run osmo-hlr_10.42.42.2(pid=9975): stderr: | 20221213225049374 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225049374 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225049374 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225049374 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225049374 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225049374 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225049387 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225049395 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225049395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225049395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:52.651092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9974): Terminating (SIGTERM) 22:50:52.693101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9977): Terminating (SIGTERM) 22:50:52.735637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9980): Terminating (SIGTERM) 22:50:52.777939 --- ParallelTerminationStrategy: PID 9974 died... 22:50:52.798351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9974): Terminated: ok {rc=0} 22:50:52.844450 --- ParallelTerminationStrategy: PID 9977 died... 22:50:52.864431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9977): Terminated: ok {rc=0} 22:50:52.910291 --- ParallelTerminationStrategy: PID 9980 died... 22:50:52.930143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9980): Terminated: ok {rc=0} 22:50:53.018231 bus /gobi_0: Setting Powered False 22:50:54.116199 bus /gobi_0: Setting Powered False 22:50:55.232313 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 sms:nanobts+band-900 --------------------------------------------------------------------- 22:50:56.481238 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:50:56.486408 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 22:50:56.518996 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 22:50:56.546747 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 22:50:56.599864 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 22:50:56.633375 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 22:50:56.660815 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 22:50:57.208079 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 22:50:57.214150 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:57.225439 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 22:50:57.270528 tst mo_mt_sms.py: using LAC 36772 22:50:57.389558 tst mo_mt_sms.py: using RAC 52 22:50:57.505095 tst mo_mt_sms.py: using CellId 36772 22:50:57.620024 tst mo_mt_sms.py: using BVCI 36773 22:50:57.726833 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:57.737453 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:57.747863 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:57.758221 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:57.768544 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:50:57.778958 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 22:50:57.899570 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 22:50:58.019391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:58.511187 run create_hlr_db(pid=9988): Launched 22:50:58.634533 bus /gobi_6: Setting Powered False 22:50:59.697517 run create_hlr_db(pid=9988): Terminated: ok {rc=0} 22:51:00.138523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9990): Launched 22:51:00.454805 run osmo-hlr_10.42.42.2(pid=9991): Launched 22:51:00.577465 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:01.162533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9993): Launched 22:51:01.485057 run osmo-stp_10.42.42.5(pid=9994): Launched 22:51:01.793440 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:02.353957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9996): Launched 22:51:02.649817 run osmo-msc_10.42.42.6(pid=9997): Launched 22:51:02.816490 run osmo-stp_10.42.42.5(pid=9994): ERR: Terminated: ERROR {rc=1} [trial-2395↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9994)] 22:51:02.941328 run osmo-stp_10.42.42.5(pid=9994): stdout: | (launched: 2022-12-13_22:51:01.419994) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:03.066244 run osmo-stp_10.42.42.5(pid=9994): stderr: | 20221213225101635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225101636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225101636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225101636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225101637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225101638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225101638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:03.189742 run osmo-stp_10.42.42.5(pid=9994): stdout: | (launched: 2022-12-13_22:51:01.419994) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:03.307465 run osmo-stp_10.42.42.5(pid=9994): stderr: | 20221213225101635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225101636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225101636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225101636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225101637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225101638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225101638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:03.448616 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9994): Process ended prematurely: osmo-stp_10.42.42.5(pid=9994) [trial-2395↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9994)] [trial-2395↪sms:nanobts+band-900↪mo_mt_sms.py:16] 22:51:03.456931 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 22:51:03.482951 run osmo-hlr_10.42.42.2(pid=9991): ERR: Terminated: ERROR {rc=237} [trial-2395↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9991)] 22:51:03.530276 run osmo-hlr_10.42.42.2(pid=9991): stdout: | (launched: 2022-12-13_22:51:00.397373) 22:51:03.579335 run osmo-hlr_10.42.42.2(pid=9991): stderr: | 20221213225100595 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225100595 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225100595 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225100595 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225100595 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225100595 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225100607 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225100616 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225100616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225100616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:03.647499 run osmo-msc_10.42.42.6(pid=9997): ERR: Terminated: ERROR {rc=2} [trial-2395↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9997)] 22:51:03.694599 run osmo-msc_10.42.42.6(pid=9997): stdout: | (launched: 2022-12-13_22:51:02.595400) 22:51:03.743157 run osmo-msc_10.42.42.6(pid=9997): stderr: | 20221213225102866 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225102866 DLGLOBAL DEBUG validating counter group 0x7f9e2257fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225102866 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225102866 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225102866 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225102867 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225102868 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225102869 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225102869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225102869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:03.792190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9990): Terminating (SIGTERM) 22:51:03.831538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9993): Terminating (SIGTERM) 22:51:03.870957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9996): Terminating (SIGTERM) 22:51:03.910817 --- ParallelTerminationStrategy: PID 9990 died... 22:51:03.930057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9990): Terminated: ok {rc=0} 22:51:03.973879 --- ParallelTerminationStrategy: PID 9993 died... 22:51:03.992421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9993): Terminated: ok {rc=0} 22:51:04.036159 --- ParallelTerminationStrategy: PID 9996 died... 22:51:04.054861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9996): Terminated: ok {rc=0} 22:51:04.140179 bus /sierra_3: Setting Powered False 22:51:05.240047 bus /sierra_3: Setting Powered False 22:51:06.351861 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 22:51:07.590142 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:51:07.595555 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 22:51:07.628537 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 22:51:07.636026 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 22:51:07.671224 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 22:51:07.702962 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 22:51:07.709717 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 22:51:08.230521 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2395 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 22:51:08.235636 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 22:51:08.246604 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 22:51:08.292341 tst assert_extension.py: using LAC 36773 22:51:08.410871 tst assert_extension.py: using RAC 53 22:51:08.525420 tst assert_extension.py: using CellId 36773 22:51:08.641862 tst assert_extension.py: using BVCI 36774 22:51:08.748319 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 22:51:08.864780 tst assert_extension.py:10: start nitb and bts... 22:51:09.078169 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:51:09.724217 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10002): Launched 22:51:10.040607 run osmo-nitb_10.42.42.2(pid=10003): Launched 22:51:10.216569 run osmo-nitb_10.42.42.2(pid=10003): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10003)] 22:51:10.359005 run osmo-nitb_10.42.42.2(pid=10003): stdout: | (launched: 2022-12-13_22:51:09.982945) 22:51:10.502505 run osmo-nitb_10.42.42.2(pid=10003): stderr: | (launched: 2022-12-13_22:51:10.030284) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:51:10.646529 run osmo-nitb_10.42.42.2(pid=10003): stdout: | (launched: 2022-12-13_22:51:09.982945) 22:51:10.784709 run osmo-nitb_10.42.42.2(pid=10003): stderr: | (launched: 2022-12-13_22:51:10.030284) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10003): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10003) [trial-2395↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10003)] 22:51:11.160605 tst osmo-nitb_10.42.42.2(pid=10003): stdout: | (launched: 2022-12-13_22:51:09.982945) 22:51:11.288016 tst osmo-nitb_10.42.42.2(pid=10003): stderr: | (launched: 2022-12-13_22:51:10.030284) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:51:11.438771 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=10003): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10003) [trial-2395↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10003)] [trial-2395↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 22:51:11.447938 tst assert_extension.py:12: Test FAILED (3.2 sec) 22:51:11.455164 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10002): Terminating (SIGTERM) 22:51:11.666112 --- ParallelTerminationStrategy: PID 10002 died... 22:51:11.688064 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10002): Terminated: ok {rc=0} 22:51:11.775305 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 ussd:nanobts+band-900 --------------------------------------------------------------------- 22:51:12.951291 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:51:12.955900 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 22:51:12.987394 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 22:51:13.013580 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 22:51:13.047319 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 22:51:13.078969 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 22:51:13.105107 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 22:51:13.636045 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2395 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 22:51:13.640871 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:13.651489 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 22:51:13.697575 tst assert_extension.py: using LAC 36774 22:51:13.812123 tst assert_extension.py: using RAC 54 22:51:13.926135 tst assert_extension.py: using CellId 36774 22:51:14.040524 tst assert_extension.py: using BVCI 36775 22:51:14.147138 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:14.157751 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:14.168198 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:14.178650 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:14.189152 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:51:14.199941 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 22:51:14.315607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:14.772471 run create_hlr_db(pid=10007): Launched 22:51:14.895145 bus /sierra_2: Setting Powered False 22:51:15.966153 run create_hlr_db(pid=10007): Terminated: ok {rc=0} 22:51:16.404216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10009): Launched 22:51:16.723412 run osmo-hlr_10.42.42.2(pid=10010): Launched 22:51:17.071212 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:17.732648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10012): Launched 22:51:18.050093 run osmo-stp_10.42.42.5(pid=10013): Launched 22:51:18.171489 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:18.742238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10015): Launched 22:51:19.058777 run osmo-msc_10.42.42.6(pid=10016): Launched 22:51:19.236514 run osmo-stp_10.42.42.5(pid=10013): ERR: Terminated: ERROR {rc=1} [trial-2395↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10013)] 22:51:19.370584 run osmo-stp_10.42.42.5(pid=10013): stdout: | (launched: 2022-12-13_22:51:17.992404) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:19.505429 run osmo-stp_10.42.42.5(pid=10013): stderr: | 20221213225118182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225118182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225118182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225118182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225118185 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225118185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225118185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:19.640004 run osmo-stp_10.42.42.5(pid=10013): stdout: | (launched: 2022-12-13_22:51:17.992404) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:19.766545 run osmo-stp_10.42.42.5(pid=10013): stderr: | 20221213225118182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225118182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225118182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225118182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225118185 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225118185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225118185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:19.917885 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=10013): Process ended prematurely: osmo-stp_10.42.42.5(pid=10013) [trial-2395↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10013)] [trial-2395↪ussd:nanobts+band-900↪assert_extension.py:17] 22:51:19.926847 tst assert_extension.py:17: Test FAILED (6.3 sec) 22:51:19.954114 run osmo-hlr_10.42.42.2(pid=10010): ERR: Terminated: ERROR {rc=237} [trial-2395↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10010)] 22:51:20.004340 run osmo-hlr_10.42.42.2(pid=10010): stdout: | (launched: 2022-12-13_22:51:16.663800) 22:51:20.055907 run osmo-hlr_10.42.42.2(pid=10010): stderr: | 20221213225116980 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225116980 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225116980 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225116980 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225116980 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225116980 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225117011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225117020 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225117021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225117021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:20.128370 run osmo-msc_10.42.42.6(pid=10016): ERR: Terminated: ERROR {rc=2} [trial-2395↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10016)] 22:51:20.177965 run osmo-msc_10.42.42.6(pid=10016): stdout: | (launched: 2022-12-13_22:51:19.000851) 22:51:20.229601 run osmo-msc_10.42.42.6(pid=10016): stderr: | 20221213225119320 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225119320 DLGLOBAL DEBUG validating counter group 0x7f4e44f3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225119321 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225119321 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225119321 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225119321 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225119323 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225119323 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225119323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225119323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:20.281677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10009): Terminating (SIGTERM) 22:51:20.323190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10012): Terminating (SIGTERM) 22:51:20.364728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10015): Terminating (SIGTERM) 22:51:20.407299 --- ParallelTerminationStrategy: PID 10009 died... 22:51:20.427579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10009): Terminated: ok {rc=0} 22:51:20.473894 --- ParallelTerminationStrategy: PID 10012 died... 22:51:20.493668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10012): Terminated: ok {rc=0} 22:51:20.539481 --- ParallelTerminationStrategy: PID 10015 died... 22:51:20.559308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10015): Terminated: ok {rc=0} 22:51:20.647389 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:51:21.862789 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:51:21.870739 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:51:21.903875 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:51:21.932789 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:51:21.984611 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:51:22.016912 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:51:22.043578 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:51:22.597873 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:51:22.653177 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:22.665063 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:51:22.732205 tst mo_mt_call.py: using LAC 36775 22:51:22.855447 tst mo_mt_call.py: using RAC 55 22:51:22.982659 tst mo_mt_call.py: using CellId 36775 22:51:23.107703 tst mo_mt_call.py: using BVCI 36776 22:51:23.223862 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:23.235490 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:23.246955 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:23.258408 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:23.270258 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:23.282109 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:51:23.399398 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:51:23.520913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:24.021056 run create_hlr_db(pid=10021): Launched 22:51:24.143701 bus /sierra_2: Setting Powered False 22:51:25.203690 run create_hlr_db(pid=10021): Terminated: ok {rc=0} 22:51:25.654736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10023): Launched 22:51:25.978311 run osmo-hlr_10.42.42.2(pid=10024): Launched 22:51:26.102655 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:26.658287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10026): Launched 22:51:26.981684 run osmo-stp_10.42.42.5(pid=10027): Launched 22:51:27.106703 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:27.691019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10029): Launched 22:51:28.015193 run osmo-msc_10.42.42.6(pid=10030): Launched 22:51:28.196054 run osmo-stp_10.42.42.5(pid=10027): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10027)] 22:51:28.332411 run osmo-stp_10.42.42.5(pid=10027): stdout: | (launched: 2022-12-13_22:51:26.923056) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:28.469088 run osmo-stp_10.42.42.5(pid=10027): stderr: | 20221213225127115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225127116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225127116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225127116 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225127117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225127117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225127117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:28.605024 run osmo-stp_10.42.42.5(pid=10027): stdout: | (launched: 2022-12-13_22:51:26.923056) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:28.734350 run osmo-stp_10.42.42.5(pid=10027): stderr: | 20221213225127115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225127116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225127116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225127116 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225127117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225127117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225127117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:28.888494 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10027): Process ended prematurely: osmo-stp_10.42.42.5(pid=10027) [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10027)] [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:51:28.898142 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:51:28.926037 run osmo-hlr_10.42.42.2(pid=10024): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10024)] 22:51:28.976610 run osmo-hlr_10.42.42.2(pid=10024): stdout: | (launched: 2022-12-13_22:51:25.919607) 22:51:29.029248 run osmo-hlr_10.42.42.2(pid=10024): stderr: | 20221213225126119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225126119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225126119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225126119 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225126119 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225126119 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225126131 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225126139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225126140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225126140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:29.101746 run osmo-msc_10.42.42.6(pid=10030): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10030)] 22:51:29.152201 run osmo-msc_10.42.42.6(pid=10030): stdout: | (launched: 2022-12-13_22:51:27.956365) 22:51:29.204169 run osmo-msc_10.42.42.6(pid=10030): stderr: | 20221213225128279 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225128279 DLGLOBAL DEBUG validating counter group 0x7eff093bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225128279 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225128279 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225128279 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225128280 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225128281 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225128282 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225128282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225128282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:29.256304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10023): Terminating (SIGTERM) 22:51:29.298193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10026): Terminating (SIGTERM) 22:51:29.340067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10029): Terminating (SIGTERM) 22:51:29.382636 --- ParallelTerminationStrategy: PID 10023 died... 22:51:29.403028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10023): Terminated: ok {rc=0} 22:51:29.449422 --- ParallelTerminationStrategy: PID 10026 died... 22:51:29.469296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10026): Terminated: ok {rc=0} 22:51:29.515420 --- ParallelTerminationStrategy: PID 10029 died... 22:51:29.535287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10029): Terminated: ok {rc=0} 22:51:29.623286 bus /sierra_3: Setting Powered False 22:51:30.722666 bus /sierra_3: Setting Powered False 22:51:31.844126 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:51:32.996712 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:33.008638 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:51:33.076727 tst mo_mt_call_osmux.py: using LAC 36776 22:51:33.200919 tst mo_mt_call_osmux.py: using RAC 56 22:51:33.318552 tst mo_mt_call_osmux.py: using CellId 36776 22:51:33.434046 tst mo_mt_call_osmux.py: using BVCI 36777 22:51:33.542795 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:33.554034 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:33.565155 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:33.575990 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:33.587109 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:33.598040 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:51:33.719918 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:51:33.836574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:34.301359 run create_hlr_db(pid=10032): Launched 22:51:34.423843 bus /sierra_2: Setting Powered False 22:51:35.484859 run create_hlr_db(pid=10032): Terminated: ok {rc=0} 22:51:35.927040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10034): Launched 22:51:36.250420 run osmo-hlr_10.42.42.2(pid=10035): Launched 22:51:36.375018 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:36.932329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10037): Launched 22:51:37.256223 run osmo-stp_10.42.42.5(pid=10038): Launched 22:51:37.380752 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:37.967052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10040): Launched 22:51:38.290130 run osmo-msc_10.42.42.6(pid=10041): Launched 22:51:38.471743 run osmo-stp_10.42.42.5(pid=10038): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10038)] 22:51:38.608747 run osmo-stp_10.42.42.5(pid=10038): stdout: | (launched: 2022-12-13_22:51:37.197610) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:38.746530 run osmo-stp_10.42.42.5(pid=10038): stderr: | 20221213225137390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225137390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225137390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225137391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225137393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225137393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225137393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:38.882777 run osmo-stp_10.42.42.5(pid=10038): stdout: | (launched: 2022-12-13_22:51:37.197610) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:39.012216 run osmo-stp_10.42.42.5(pid=10038): stderr: | 20221213225137390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225137390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225137390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225137391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225137393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225137393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225137393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:39.167848 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10038): Process ended prematurely: osmo-stp_10.42.42.5(pid=10038) [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10038)] [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:51:39.177617 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:51:39.205451 run osmo-hlr_10.42.42.2(pid=10035): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10035)] 22:51:39.256015 run osmo-hlr_10.42.42.2(pid=10035): stdout: | (launched: 2022-12-13_22:51:36.191924) 22:51:39.308069 run osmo-hlr_10.42.42.2(pid=10035): stderr: | 20221213225136389 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225136389 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225136389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225136389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225136389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225136389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225136402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225136410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225136410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225136410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:39.380332 run osmo-msc_10.42.42.6(pid=10041): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10041)] 22:51:39.429930 run osmo-msc_10.42.42.6(pid=10041): stdout: | (launched: 2022-12-13_22:51:38.231639) 22:51:39.481661 run osmo-msc_10.42.42.6(pid=10041): stderr: | 20221213225138554 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225138554 DLGLOBAL DEBUG validating counter group 0x7fa715bb8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225138554 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225138554 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225138554 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225138554 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225138556 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225138556 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225138557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225138557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:39.533817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10034): Terminating (SIGTERM) 22:51:39.575690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10037): Terminating (SIGTERM) 22:51:39.617570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10040): Terminating (SIGTERM) 22:51:39.660169 --- ParallelTerminationStrategy: PID 10034 died... 22:51:39.680663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10034): Terminated: ok {rc=0} 22:51:39.726834 --- ParallelTerminationStrategy: PID 10037 died... 22:51:39.746637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10037): Terminated: ok {rc=0} 22:51:39.792682 --- ParallelTerminationStrategy: PID 10040 died... 22:51:39.812498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10040): Terminated: ok {rc=0} 22:51:39.900573 bus /sierra_3: Setting Powered False 22:51:40.999117 bus /sierra_3: Setting Powered False 22:51:42.117779 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:51:43.373757 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:51:43.381846 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:51:43.414296 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:51:43.442607 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:51:43.494977 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:51:43.527469 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:51:43.554737 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:51:44.108163 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:51:44.161630 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:44.173417 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:51:44.242678 tst mo_mt_call.py: using LAC 36777 22:51:44.372924 tst mo_mt_call.py: using RAC 57 22:51:44.498557 tst mo_mt_call.py: using CellId 36777 22:51:44.622095 tst mo_mt_call.py: using BVCI 36778 22:51:44.739029 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:44.750735 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:44.762294 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:44.773902 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:44.785811 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:44.797527 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:51:44.914504 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:51:45.029544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:45.496576 run create_hlr_db(pid=10046): Launched 22:51:45.621981 bus /sierra_2: Setting Powered False 22:51:46.685357 run create_hlr_db(pid=10046): Terminated: ok {rc=0} 22:51:47.153834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10048): Launched 22:51:47.485976 run osmo-hlr_10.42.42.2(pid=10049): Launched 22:51:47.610980 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:48.166251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10051): Launched 22:51:48.489611 run osmo-stp_10.42.42.5(pid=10052): Launched 22:51:48.614059 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:49.199429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10054): Launched 22:51:49.522517 run osmo-msc_10.42.42.6(pid=10055): Launched 22:51:49.704071 run osmo-stp_10.42.42.5(pid=10052): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10052)] 22:51:49.840348 run osmo-stp_10.42.42.5(pid=10052): stdout: | (launched: 2022-12-13_22:51:48.430640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:49.977213 run osmo-stp_10.42.42.5(pid=10052): stderr: | 20221213225148622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225148622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225148622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225148622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225148625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225148625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225148625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:50.113881 run osmo-stp_10.42.42.5(pid=10052): stdout: | (launched: 2022-12-13_22:51:48.430640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:50.242791 run osmo-stp_10.42.42.5(pid=10052): stderr: | 20221213225148622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225148622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225148622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225148622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225148625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225148625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225148625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:50.397460 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10052): Process ended prematurely: osmo-stp_10.42.42.5(pid=10052) [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10052)] [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:51:50.407323 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:51:50.435328 run osmo-hlr_10.42.42.2(pid=10049): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10049)] 22:51:50.485833 run osmo-hlr_10.42.42.2(pid=10049): stdout: | (launched: 2022-12-13_22:51:47.426652) 22:51:50.537958 run osmo-hlr_10.42.42.2(pid=10049): stderr: | 20221213225147623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225147623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225147623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225147623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225147623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225147623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225147636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225147645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225147645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225147645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:50.610444 run osmo-msc_10.42.42.6(pid=10055): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10055)] 22:51:50.660626 run osmo-msc_10.42.42.6(pid=10055): stdout: | (launched: 2022-12-13_22:51:49.463976) 22:51:50.712211 run osmo-msc_10.42.42.6(pid=10055): stderr: | 20221213225149784 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225149784 DLGLOBAL DEBUG validating counter group 0x7f0c02f8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225149784 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225149785 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225149785 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225149785 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225149787 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225149787 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225149788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225149788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:50.764481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10048): Terminating (SIGTERM) 22:51:50.806071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10051): Terminating (SIGTERM) 22:51:50.847932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10054): Terminating (SIGTERM) 22:51:50.890737 --- ParallelTerminationStrategy: PID 10048 died... 22:51:50.911404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10048): Terminated: ok {rc=0} 22:51:50.957965 --- ParallelTerminationStrategy: PID 10051 died... 22:51:50.977987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10051): Terminated: ok {rc=0} 22:51:51.024506 --- ParallelTerminationStrategy: PID 10054 died... 22:51:51.044593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10054): Terminated: ok {rc=0} 22:51:51.132318 bus /sierra_3: Setting Powered False 22:51:52.231688 bus /sierra_3: Setting Powered False 22:51:53.344662 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:51:54.493849 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:54.506194 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:51:54.575691 tst mo_mt_call_osmux.py: using LAC 36778 22:51:54.702760 tst mo_mt_call_osmux.py: using RAC 58 22:51:54.827680 tst mo_mt_call_osmux.py: using CellId 36778 22:51:54.953365 tst mo_mt_call_osmux.py: using BVCI 36779 22:51:55.071835 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:55.083402 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:55.094832 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:55.106377 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:55.118360 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:55.130047 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:51:55.248398 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:51:55.370093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:55.872041 run create_hlr_db(pid=10057): Launched 22:51:55.994935 bus /sierra_2: Setting Powered False 22:51:57.058432 run create_hlr_db(pid=10057): Terminated: ok {rc=0} 22:51:57.509004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10059): Launched 22:51:57.832216 run osmo-hlr_10.42.42.2(pid=10060): Launched 22:51:57.955592 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:58.512173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10062): Launched 22:51:58.836629 run osmo-stp_10.42.42.5(pid=10063): Launched 22:51:58.961089 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:59.547659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10065): Launched 22:51:59.871823 run osmo-msc_10.42.42.6(pid=10066): Launched 22:52:00.053068 run osmo-stp_10.42.42.5(pid=10063): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10063)] 22:52:00.189810 run osmo-stp_10.42.42.5(pid=10063): stdout: | (launched: 2022-12-13_22:51:58.776815) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:00.327013 run osmo-stp_10.42.42.5(pid=10063): stderr: | 20221213225158969 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225158970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225158970 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225158970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225158971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225158971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225158971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:00.463664 run osmo-stp_10.42.42.5(pid=10063): stdout: | (launched: 2022-12-13_22:51:58.776815) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:00.592665 run osmo-stp_10.42.42.5(pid=10063): stderr: | 20221213225158969 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225158970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225158970 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225158970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225158971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225158971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225158971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:00.748187 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10063): Process ended prematurely: osmo-stp_10.42.42.5(pid=10063) [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10063)] [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:52:00.757770 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:52:00.785333 run osmo-hlr_10.42.42.2(pid=10060): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10060)] 22:52:00.836208 run osmo-hlr_10.42.42.2(pid=10060): stdout: | (launched: 2022-12-13_22:51:57.773503) 22:52:00.898519 run osmo-hlr_10.42.42.2(pid=10060): stderr: | 20221213225157972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225157972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225157972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225157972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225157972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225157972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225157984 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225157993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225157993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225157993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:00.972005 run osmo-msc_10.42.42.6(pid=10066): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10066)] 22:52:01.022413 run osmo-msc_10.42.42.6(pid=10066): stdout: | (launched: 2022-12-13_22:51:59.813140) 22:52:01.074671 run osmo-msc_10.42.42.6(pid=10066): stderr: | 20221213225200135 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225200135 DLGLOBAL DEBUG validating counter group 0x7fbd4036dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225200135 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225200135 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225200135 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225200135 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225200137 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225200138 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225200138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225200138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:01.127780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10059): Terminating (SIGTERM) 22:52:01.170888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10062): Terminating (SIGTERM) 22:52:01.215715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10065): Terminating (SIGTERM) 22:52:01.260747 --- ParallelTerminationStrategy: PID 10059 died... 22:52:01.281635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10059): Terminated: ok {rc=0} 22:52:01.330232 --- ParallelTerminationStrategy: PID 10062 died... 22:52:01.350855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10062): Terminated: ok {rc=0} 22:52:01.398103 --- ParallelTerminationStrategy: PID 10065 died... 22:52:01.418484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10065): Terminated: ok {rc=0} 22:52:01.507543 bus /sierra_3: Setting Powered False 22:52:02.607312 bus /sierra_3: Setting Powered False 22:52:03.726233 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:52:04.973618 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:52:04.980619 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:52:05.012462 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:52:05.038786 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:52:05.089911 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:52:05.121733 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:52:05.147929 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:52:05.699769 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:52:05.749083 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:05.760233 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:52:05.828104 tst mo_mt_call.py: using LAC 36779 22:52:05.946932 tst mo_mt_call.py: using RAC 59 22:52:06.067515 tst mo_mt_call.py: using CellId 36779 22:52:06.187890 tst mo_mt_call.py: using BVCI 36780 22:52:06.298555 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:06.309687 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:06.320581 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:06.331499 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:06.342663 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:06.353911 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:52:06.475642 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:52:06.592619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:07.061040 run create_hlr_db(pid=10071): Launched 22:52:07.184624 bus /sierra_2: Setting Powered False 22:52:08.245690 run create_hlr_db(pid=10071): Terminated: ok {rc=0} 22:52:08.668481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10073): Launched 22:52:08.970493 run osmo-hlr_10.42.42.2(pid=10074): Launched 22:52:09.085451 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:09.603962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10076): Launched 22:52:09.906396 run osmo-stp_10.42.42.5(pid=10077): Launched 22:52:10.022373 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:10.568622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10079): Launched 22:52:10.870455 run osmo-msc_10.42.42.6(pid=10080): Launched 22:52:11.040247 run osmo-stp_10.42.42.5(pid=10077): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10077)] 22:52:11.167742 run osmo-stp_10.42.42.5(pid=10077): stdout: | (launched: 2022-12-13_22:52:09.850776) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:11.295228 run osmo-stp_10.42.42.5(pid=10077): stderr: | 20221213225210021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225210021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225210022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225210022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225210023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225210023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225210023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:11.421320 run osmo-stp_10.42.42.5(pid=10077): stdout: | (launched: 2022-12-13_22:52:09.850776) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:11.540835 run osmo-stp_10.42.42.5(pid=10077): stderr: | 20221213225210021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225210021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225210022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225210022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225210023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225210023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225210023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:11.684309 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10077): Process ended prematurely: osmo-stp_10.42.42.5(pid=10077) [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10077)] [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:52:11.693215 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:52:11.719592 run osmo-hlr_10.42.42.2(pid=10074): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10074)] 22:52:11.767389 run osmo-hlr_10.42.42.2(pid=10074): stdout: | (launched: 2022-12-13_22:52:08.915581) 22:52:11.816269 run osmo-hlr_10.42.42.2(pid=10074): stderr: | 20221213225209093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225209093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225209093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225209094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225209094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225209094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225209110 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225209119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225209119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225209119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:11.884936 run osmo-msc_10.42.42.6(pid=10080): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10080)] 22:52:11.931942 run osmo-msc_10.42.42.6(pid=10080): stdout: | (launched: 2022-12-13_22:52:10.815163) 22:52:11.980854 run osmo-msc_10.42.42.6(pid=10080): stderr: | 20221213225211088 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225211088 DLGLOBAL DEBUG validating counter group 0x7fa9b241cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225211088 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225211088 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225211088 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225211089 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225211090 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225211091 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225211091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225211091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:12.029864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10073): Terminating (SIGTERM) 22:52:12.069092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10076): Terminating (SIGTERM) 22:52:12.108573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10079): Terminating (SIGTERM) 22:52:12.148282 --- ParallelTerminationStrategy: PID 10073 died... 22:52:12.167238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10073): Terminated: ok {rc=0} 22:52:12.210731 --- ParallelTerminationStrategy: PID 10076 died... 22:52:12.229209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10076): Terminated: ok {rc=0} 22:52:12.272562 --- ParallelTerminationStrategy: PID 10079 died... 22:52:12.291298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10079): Terminated: ok {rc=0} 22:52:12.376611 bus /sierra_3: Setting Powered False 22:52:13.476071 bus /sierra_3: Setting Powered False 22:52:14.589452 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:52:15.737663 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:15.749921 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:52:15.819468 tst mo_mt_call_osmux.py: using LAC 36780 22:52:15.968015 tst mo_mt_call_osmux.py: using RAC 60 22:52:16.097560 tst mo_mt_call_osmux.py: using CellId 36780 22:52:16.246335 tst mo_mt_call_osmux.py: using BVCI 36781 22:52:16.366849 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:16.379436 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:16.391986 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:16.404548 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:16.418129 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:16.431674 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:52:16.555848 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:52:16.720464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:17.213159 run create_hlr_db(pid=10082): Launched 22:52:17.367945 bus /sierra_2: Setting Powered False 22:52:18.428014 run create_hlr_db(pid=10082): Terminated: ok {rc=0} 22:52:18.873707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10084): Launched 22:52:19.197620 run osmo-hlr_10.42.42.2(pid=10085): Launched 22:52:19.321639 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:19.882857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10087): Launched 22:52:20.205759 run osmo-stp_10.42.42.5(pid=10088): Launched 22:52:20.330011 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:20.914523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10090): Launched 22:52:21.238670 run osmo-msc_10.42.42.6(pid=10091): Launched 22:52:21.419497 run osmo-stp_10.42.42.5(pid=10088): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10088)] 22:52:21.557226 run osmo-stp_10.42.42.5(pid=10088): stdout: | (launched: 2022-12-13_22:52:20.147276) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:21.695919 run osmo-stp_10.42.42.5(pid=10088): stderr: | 20221213225220340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225220340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225220340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225220341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225220341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225220341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225220341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:21.831969 run osmo-stp_10.42.42.5(pid=10088): stdout: | (launched: 2022-12-13_22:52:20.147276) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:21.961710 run osmo-stp_10.42.42.5(pid=10088): stderr: | 20221213225220340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225220340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225220340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225220341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225220341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225220341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225220341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:22.116397 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10088): Process ended prematurely: osmo-stp_10.42.42.5(pid=10088) [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10088)] [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:52:22.126025 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:52:22.153864 run osmo-hlr_10.42.42.2(pid=10085): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10085)] 22:52:22.204439 run osmo-hlr_10.42.42.2(pid=10085): stdout: | (launched: 2022-12-13_22:52:19.139106) 22:52:22.256386 run osmo-hlr_10.42.42.2(pid=10085): stderr: | 20221213225219338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225219338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225219338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225219338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225219338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225219338 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225219349 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225219357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225219357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225219357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:22.328913 run osmo-msc_10.42.42.6(pid=10091): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10091)] 22:52:22.378720 run osmo-msc_10.42.42.6(pid=10091): stdout: | (launched: 2022-12-13_22:52:21.179603) 22:52:22.430294 run osmo-msc_10.42.42.6(pid=10091): stderr: | 20221213225221499 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225221499 DLGLOBAL DEBUG validating counter group 0x7fdda6ca5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225221499 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225221499 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225221500 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225221500 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225221503 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225221504 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225221504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225221504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:22.482217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10084): Terminating (SIGTERM) 22:52:22.524287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10087): Terminating (SIGTERM) 22:52:22.566233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10090): Terminating (SIGTERM) 22:52:22.608837 --- ParallelTerminationStrategy: PID 10084 died... 22:52:22.629162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10084): Terminated: ok {rc=0} 22:52:22.675656 --- ParallelTerminationStrategy: PID 10087 died... 22:52:22.695514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10087): Terminated: ok {rc=0} 22:52:22.741963 --- ParallelTerminationStrategy: PID 10090 died... 22:52:22.761769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10090): Terminated: ok {rc=0} 22:52:22.850314 bus /sierra_3: Setting Powered False 22:52:23.948400 bus /sierra_3: Setting Powered False 22:52:25.063888 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:52:26.315398 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:52:26.323144 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:52:26.356000 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:52:26.385080 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:52:26.437108 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:52:26.470181 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:52:26.498038 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:52:27.050937 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:52:27.103813 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:27.115382 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:52:27.185300 tst mo_mt_call.py: using LAC 36781 22:52:27.311566 tst mo_mt_call.py: using RAC 61 22:52:27.437434 tst mo_mt_call.py: using CellId 36781 22:52:27.565542 tst mo_mt_call.py: using BVCI 36782 22:52:27.685040 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:27.696586 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:27.708164 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:27.719642 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:27.732050 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:27.744148 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:52:27.863682 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:52:27.979189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:28.447155 run create_hlr_db(pid=10097): Launched 22:52:28.570921 bus /sierra_2: Setting Powered False 22:52:29.631061 run create_hlr_db(pid=10097): Terminated: ok {rc=0} 22:52:30.070813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10099): Launched 22:52:30.393608 run osmo-hlr_10.42.42.2(pid=10100): Launched 22:52:30.517806 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:31.106902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10102): Launched 22:52:31.445788 run osmo-stp_10.42.42.5(pid=10103): Launched 22:52:31.619407 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:32.470836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10105): Launched 22:52:32.772405 run osmo-msc_10.42.42.6(pid=10106): Launched 22:52:32.941258 run osmo-stp_10.42.42.5(pid=10103): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10103)] 22:52:33.068217 run osmo-stp_10.42.42.5(pid=10103): stdout: | (launched: 2022-12-13_22:52:31.381893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:33.196211 run osmo-stp_10.42.42.5(pid=10103): stderr: | 20221213225231730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225231731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225231732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225231733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225231733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225231733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225231733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:33.322101 run osmo-stp_10.42.42.5(pid=10103): stdout: | (launched: 2022-12-13_22:52:31.381893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:33.442353 run osmo-stp_10.42.42.5(pid=10103): stderr: | 20221213225231730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225231731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225231732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225231733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225231733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225231733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225231733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:33.586939 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10103): Process ended prematurely: osmo-stp_10.42.42.5(pid=10103) [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10103)] [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:52:33.595579 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 22:52:33.622043 run osmo-hlr_10.42.42.2(pid=10100): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10100)] 22:52:33.669167 run osmo-hlr_10.42.42.2(pid=10100): stdout: | (launched: 2022-12-13_22:52:30.335280) 22:52:33.718529 run osmo-hlr_10.42.42.2(pid=10100): stderr: | 20221213225230534 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225230534 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225230534 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225230534 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225230534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225230534 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225230546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225230554 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225230555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225230555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:33.786951 run osmo-msc_10.42.42.6(pid=10106): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10106)] 22:52:33.833809 run osmo-msc_10.42.42.6(pid=10106): stdout: | (launched: 2022-12-13_22:52:32.717366) 22:52:33.882380 run osmo-msc_10.42.42.6(pid=10106): stderr: | 20221213225232989 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225232989 DLGLOBAL DEBUG validating counter group 0x7f3437748c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225232989 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225232989 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225232990 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225232990 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225232991 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225232992 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225232992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225232992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:33.931179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10099): Terminating (SIGTERM) 22:52:33.970386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10102): Terminating (SIGTERM) 22:52:34.009525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10105): Terminating (SIGTERM) 22:52:34.049208 --- ParallelTerminationStrategy: PID 10099 died... 22:52:34.068121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10099): Terminated: ok {rc=0} 22:52:34.111641 --- ParallelTerminationStrategy: PID 10102 died... 22:52:34.130633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10102): Terminated: ok {rc=0} 22:52:34.173901 --- ParallelTerminationStrategy: PID 10105 died... 22:52:34.192460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10105): Terminated: ok {rc=0} 22:52:34.277298 bus /sierra_3: Setting Powered False 22:52:35.376530 bus /sierra_3: Setting Powered False 22:52:36.492258 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:52:37.639329 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:37.651153 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:52:37.717963 tst mo_mt_call_osmux.py: using LAC 36782 22:52:37.837726 tst mo_mt_call_osmux.py: using RAC 62 22:52:37.955585 tst mo_mt_call_osmux.py: using CellId 36782 22:52:38.075673 tst mo_mt_call_osmux.py: using BVCI 36783 22:52:38.186095 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:38.197346 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:38.208375 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:38.219338 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:38.230489 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:38.241544 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:52:38.357791 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:52:38.478320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:38.980067 run create_hlr_db(pid=10108): Launched 22:52:39.104373 bus /sierra_2: Setting Powered False 22:52:40.169166 run create_hlr_db(pid=10108): Terminated: ok {rc=0} 22:52:40.601746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10110): Launched 22:52:40.904442 run osmo-hlr_10.42.42.2(pid=10111): Launched 22:52:41.021387 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:41.558350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10113): Launched 22:52:41.861165 run osmo-stp_10.42.42.5(pid=10114): Launched 22:52:41.978335 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:42.524072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10116): Launched 22:52:42.825677 run osmo-msc_10.42.42.6(pid=10117): Launched 22:52:42.995331 run osmo-stp_10.42.42.5(pid=10114): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10114)] 22:52:43.123195 run osmo-stp_10.42.42.5(pid=10114): stdout: | (launched: 2022-12-13_22:52:41.805609) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:43.250575 run osmo-stp_10.42.42.5(pid=10114): stderr: | 20221213225241977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225241977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225241978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225241978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225241979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225241979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225241979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:43.375762 run osmo-stp_10.42.42.5(pid=10114): stdout: | (launched: 2022-12-13_22:52:41.805609) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:43.495618 run osmo-stp_10.42.42.5(pid=10114): stderr: | 20221213225241977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225241977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225241978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225241978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225241979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225241979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225241979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:43.639875 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10114): Process ended prematurely: osmo-stp_10.42.42.5(pid=10114) [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10114)] [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:52:43.648642 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:52:43.675044 run osmo-hlr_10.42.42.2(pid=10111): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10111)] 22:52:43.722594 run osmo-hlr_10.42.42.2(pid=10111): stdout: | (launched: 2022-12-13_22:52:40.849505) 22:52:43.771448 run osmo-hlr_10.42.42.2(pid=10111): stderr: | 20221213225241026 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225241026 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225241026 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225241026 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225241026 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225241026 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225241038 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225241048 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225241048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225241048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:43.839997 run osmo-msc_10.42.42.6(pid=10117): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10117)] 22:52:43.887273 run osmo-msc_10.42.42.6(pid=10117): stdout: | (launched: 2022-12-13_22:52:42.770562) 22:52:43.936521 run osmo-msc_10.42.42.6(pid=10117): stderr: | 20221213225243043 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225243043 DLGLOBAL DEBUG validating counter group 0x7fc10134fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225243043 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225243043 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225243043 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225243043 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225243045 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225243046 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225243046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225243046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:43.986373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10110): Terminating (SIGTERM) 22:52:44.025727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10113): Terminating (SIGTERM) 22:52:44.065093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10116): Terminating (SIGTERM) 22:52:44.104596 --- ParallelTerminationStrategy: PID 10110 died... 22:52:44.123734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10110): Terminated: ok {rc=0} 22:52:44.167464 --- ParallelTerminationStrategy: PID 10113 died... 22:52:44.185994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10113): Terminated: ok {rc=0} 22:52:44.229330 --- ParallelTerminationStrategy: PID 10116 died... 22:52:44.247926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10116): Terminated: ok {rc=0} 22:52:44.333926 bus /sierra_3: Setting Powered False 22:52:45.431691 bus /sierra_3: Setting Powered False 22:52:46.547698 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:52:47.812071 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:52:47.819566 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:52:47.851176 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:52:47.877489 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:52:47.929349 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:52:47.962482 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:52:47.990132 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:52:48.539382 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:52:48.587620 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:48.598924 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:52:48.668805 tst mo_mt_call.py: using LAC 36783 22:52:48.786679 tst mo_mt_call.py: using RAC 63 22:52:48.904227 tst mo_mt_call.py: using CellId 36783 22:52:49.020815 tst mo_mt_call.py: using BVCI 36784 22:52:49.129626 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:49.140813 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:49.151778 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:49.162782 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:49.173877 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:49.184773 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:52:49.304024 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:52:49.422511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:49.890489 run create_hlr_db(pid=10122): Launched 22:52:50.015911 bus /sierra_2: Setting Powered False 22:52:51.080532 run create_hlr_db(pid=10122): Terminated: ok {rc=0} 22:52:51.511956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10124): Launched 22:52:51.815177 run osmo-hlr_10.42.42.2(pid=10125): Launched 22:52:51.972658 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:52.489705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10127): Launched 22:52:52.791338 run osmo-stp_10.42.42.5(pid=10128): Launched 22:52:52.906514 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:53.452671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10130): Launched 22:52:53.754673 run osmo-msc_10.42.42.6(pid=10131): Launched 22:52:53.923230 run osmo-stp_10.42.42.5(pid=10128): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10128)] 22:52:54.050834 run osmo-stp_10.42.42.5(pid=10128): stdout: | (launched: 2022-12-13_22:52:52.736095) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:54.178246 run osmo-stp_10.42.42.5(pid=10128): stderr: | 20221213225252907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225252907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225252907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225252907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225252910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225252910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225252910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:54.305299 run osmo-stp_10.42.42.5(pid=10128): stdout: | (launched: 2022-12-13_22:52:52.736095) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:54.424782 run osmo-stp_10.42.42.5(pid=10128): stderr: | 20221213225252907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225252907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225252907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225252907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225252910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225252910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225252910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:54.567925 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10128): Process ended prematurely: osmo-stp_10.42.42.5(pid=10128) [trial-2395↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10128)] [trial-2395↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:52:54.576811 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:52:54.603162 run osmo-hlr_10.42.42.2(pid=10125): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10125)] 22:52:54.650424 run osmo-hlr_10.42.42.2(pid=10125): stdout: | (launched: 2022-12-13_22:52:51.760161) 22:52:54.699557 run osmo-hlr_10.42.42.2(pid=10125): stderr: | 20221213225251936 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225251936 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225251936 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225251936 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225251936 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225251936 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225251970 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225251979 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225251979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225251979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:54.768587 run osmo-msc_10.42.42.6(pid=10131): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10131)] 22:52:54.815947 run osmo-msc_10.42.42.6(pid=10131): stdout: | (launched: 2022-12-13_22:52:53.699403) 22:52:54.864843 run osmo-msc_10.42.42.6(pid=10131): stderr: | 20221213225253973 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225253973 DLGLOBAL DEBUG validating counter group 0x7f6d3d684c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225253973 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225253973 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225253973 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225253973 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225253975 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225253975 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225253976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225253976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:54.914150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10124): Terminating (SIGTERM) 22:52:54.953590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10127): Terminating (SIGTERM) 22:52:54.992781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10130): Terminating (SIGTERM) 22:52:55.032291 --- ParallelTerminationStrategy: PID 10124 died... 22:52:55.051401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10124): Terminated: ok {rc=0} 22:52:55.095251 --- ParallelTerminationStrategy: PID 10127 died... 22:52:55.113740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10127): Terminated: ok {rc=0} 22:52:55.157172 --- ParallelTerminationStrategy: PID 10130 died... 22:52:55.175654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10130): Terminated: ok {rc=0} 22:52:55.261027 bus /sierra_3: Setting Powered False 22:52:56.360502 bus /sierra_3: Setting Powered False 22:52:57.479202 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:52:58.623908 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:58.635634 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:52:58.703277 tst mo_mt_call_osmux.py: using LAC 36784 22:52:58.821807 tst mo_mt_call_osmux.py: using RAC 64 22:52:58.941090 tst mo_mt_call_osmux.py: using CellId 36784 22:52:59.061101 tst mo_mt_call_osmux.py: using BVCI 36785 22:52:59.171157 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:59.182329 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:59.193378 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:59.204340 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:59.215500 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:52:59.226532 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:52:59.343268 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:52:59.465854 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:59.967186 run create_hlr_db(pid=10133): Launched 22:53:00.091707 bus /sierra_2: Setting Powered False 22:53:01.153597 run create_hlr_db(pid=10133): Terminated: ok {rc=0} 22:53:01.615323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10135): Launched 22:53:01.959244 run osmo-hlr_10.42.42.2(pid=10136): Launched 22:53:02.145591 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:02.701261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10138): Launched 22:53:03.024531 run osmo-stp_10.42.42.5(pid=10139): Launched 22:53:03.147419 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:03.736547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10141): Launched 22:53:04.060502 run osmo-msc_10.42.42.6(pid=10142): Launched 22:53:04.240708 run osmo-stp_10.42.42.5(pid=10139): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10139)] 22:53:04.377545 run osmo-stp_10.42.42.5(pid=10139): stdout: | (launched: 2022-12-13_22:53:02.965843) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:04.515922 run osmo-stp_10.42.42.5(pid=10139): stderr: | 20221213225303160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225303161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225303161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225303161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225303162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225303162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225303162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:04.652458 run osmo-stp_10.42.42.5(pid=10139): stdout: | (launched: 2022-12-13_22:53:02.965843) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:04.782491 run osmo-stp_10.42.42.5(pid=10139): stderr: | 20221213225303160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225303161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225303161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225303161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225303162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225303162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225303162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:04.937445 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10139): Process ended prematurely: osmo-stp_10.42.42.5(pid=10139) [trial-2395↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10139)] [trial-2395↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:53:04.947084 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:53:04.975226 run osmo-hlr_10.42.42.2(pid=10136): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10136)] 22:53:05.026268 run osmo-hlr_10.42.42.2(pid=10136): stdout: | (launched: 2022-12-13_22:53:01.893911) 22:53:05.078871 run osmo-hlr_10.42.42.2(pid=10136): stderr: | 20221213225302180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225302180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225302180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225302180 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225302180 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225302180 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225302199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225302207 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225302208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225302208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:05.151384 run osmo-msc_10.42.42.6(pid=10142): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10142)] 22:53:05.201191 run osmo-msc_10.42.42.6(pid=10142): stdout: | (launched: 2022-12-13_22:53:04.001435) 22:53:05.252915 run osmo-msc_10.42.42.6(pid=10142): stderr: | 20221213225304323 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225304323 DLGLOBAL DEBUG validating counter group 0x7f38c0388c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225304323 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225304323 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225304324 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225304324 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225304325 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225304326 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225304326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225304326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:05.305129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10135): Terminating (SIGTERM) 22:53:05.346977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10138): Terminating (SIGTERM) 22:53:05.388747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10141): Terminating (SIGTERM) 22:53:05.430939 --- ParallelTerminationStrategy: PID 10135 died... 22:53:05.451469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10135): Terminated: ok {rc=0} 22:53:05.497617 --- ParallelTerminationStrategy: PID 10138 died... 22:53:05.517283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10138): Terminated: ok {rc=0} 22:53:05.563434 --- ParallelTerminationStrategy: PID 10141 died... 22:53:05.583377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10141): Terminated: ok {rc=0} 22:53:05.670208 bus /sierra_3: Setting Powered False 22:53:06.768091 bus /sierra_3: Setting Powered False 22:53:07.886229 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:53:09.139034 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:53:09.146463 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:53:09.180881 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 22:53:09.208374 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 22:53:09.261206 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:53:09.293917 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 22:53:09.321408 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 22:53:09.876055 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 22:53:09.929429 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:09.941640 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:53:09.993291 tst mo_mt_call.py: using LAC 36785 22:53:10.121429 tst mo_mt_call.py: using RAC 65 22:53:10.249353 tst mo_mt_call.py: using CellId 36785 22:53:10.369033 tst mo_mt_call.py: using BVCI 36786 22:53:10.479778 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:10.491112 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:10.502266 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:10.513334 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:10.524529 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:10.535615 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:53:10.657278 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:53:10.780536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:11.279963 run create_hlr_db(pid=10147): Launched 22:53:11.404367 bus /sierra_2: Setting Powered False 22:53:12.469035 run create_hlr_db(pid=10147): Terminated: ok {rc=0} 22:53:12.900408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10149): Launched 22:53:13.203105 run osmo-hlr_10.42.42.2(pid=10150): Launched 22:53:13.319264 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:13.838902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10152): Launched 22:53:14.141767 run osmo-stp_10.42.42.5(pid=10153): Launched 22:53:14.257933 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:14.805111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10155): Launched 22:53:15.107680 run osmo-msc_10.42.42.6(pid=10156): Launched 22:53:15.278178 run osmo-stp_10.42.42.5(pid=10153): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10153)] 22:53:15.406527 run osmo-stp_10.42.42.5(pid=10153): stdout: | (launched: 2022-12-13_22:53:14.086583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:15.534651 run osmo-stp_10.42.42.5(pid=10153): stderr: | 20221213225314258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225314258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225314258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225314258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225314259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225314259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225314259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:15.660510 run osmo-stp_10.42.42.5(pid=10153): stdout: | (launched: 2022-12-13_22:53:14.086583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:15.780842 run osmo-stp_10.42.42.5(pid=10153): stderr: | 20221213225314258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225314258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225314258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225314258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225314259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225314259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225314259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:15.954554 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10153): Process ended prematurely: osmo-stp_10.42.42.5(pid=10153) [trial-2395↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10153)] [trial-2395↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 22:53:15.963967 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:53:15.991034 run osmo-hlr_10.42.42.2(pid=10150): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10150)] 22:53:16.043362 run osmo-hlr_10.42.42.2(pid=10150): stdout: | (launched: 2022-12-13_22:53:13.147724) 22:53:16.093278 run osmo-hlr_10.42.42.2(pid=10150): stderr: | 20221213225313323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225313323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225313323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225313323 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225313323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225313323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225313335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225313344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225313345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225313345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:16.163897 run osmo-msc_10.42.42.6(pid=10156): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10156)] 22:53:16.212079 run osmo-msc_10.42.42.6(pid=10156): stdout: | (launched: 2022-12-13_22:53:15.052165) 22:53:16.262252 run osmo-msc_10.42.42.6(pid=10156): stderr: | 20221213225315326 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225315326 DLGLOBAL DEBUG validating counter group 0x7fa58fb57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225315326 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225315326 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225315326 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225315326 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225315328 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225315328 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225315329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225315329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:16.313835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10149): Terminating (SIGTERM) 22:53:16.354353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10152): Terminating (SIGTERM) 22:53:16.395708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10155): Terminating (SIGTERM) 22:53:16.438500 --- ParallelTerminationStrategy: PID 10149 died... 22:53:16.458491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10149): Terminated: ok {rc=0} 22:53:16.504035 --- ParallelTerminationStrategy: PID 10152 died... 22:53:16.523869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10152): Terminated: ok {rc=0} 22:53:16.569167 --- ParallelTerminationStrategy: PID 10155 died... 22:53:16.589292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10155): Terminated: ok {rc=0} 22:53:16.683430 bus /sierra_3: Setting Powered False 22:53:17.799400 bus /sierra_3: Setting Powered False 22:53:18.916256 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 22:53:20.065009 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:20.077472 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:53:20.129152 tst mo_mt_call_osmux.py: using LAC 36786 22:53:20.249625 tst mo_mt_call_osmux.py: using RAC 66 22:53:20.368561 tst mo_mt_call_osmux.py: using CellId 36786 22:53:20.487834 tst mo_mt_call_osmux.py: using BVCI 36787 22:53:20.598795 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:20.610380 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:20.621681 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:20.632921 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:20.644353 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:53:20.655926 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:53:20.774582 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:53:20.891166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:21.358926 run create_hlr_db(pid=10158): Launched 22:53:21.482342 bus /sierra_2: Setting Powered False 22:53:22.543382 run create_hlr_db(pid=10158): Terminated: ok {rc=0} 22:53:22.984461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10160): Launched 22:53:23.308123 run osmo-hlr_10.42.42.2(pid=10161): Launched 22:53:23.432774 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:23.991591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10163): Launched 22:53:24.314871 run osmo-stp_10.42.42.5(pid=10164): Launched 22:53:24.439097 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:25.027362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10166): Launched 22:53:25.352556 run osmo-msc_10.42.42.6(pid=10167): Launched 22:53:25.534278 run osmo-stp_10.42.42.5(pid=10164): ERR: Terminated: ERROR {rc=1} [trial-2395↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10164)] 22:53:25.671374 run osmo-stp_10.42.42.5(pid=10164): stdout: | (launched: 2022-12-13_22:53:24.255994) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:25.809490 run osmo-stp_10.42.42.5(pid=10164): stderr: | 20221213225324450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225324450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225324450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225324451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225324451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225324451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225324451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:25.945917 run osmo-stp_10.42.42.5(pid=10164): stdout: | (launched: 2022-12-13_22:53:24.255994) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:26.075531 run osmo-stp_10.42.42.5(pid=10164): stderr: | 20221213225324450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225324450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225324450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225324451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225324451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225324451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225324451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:26.230149 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10164): Process ended prematurely: osmo-stp_10.42.42.5(pid=10164) [trial-2395↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10164)] [trial-2395↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 22:53:26.239669 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:53:26.267625 run osmo-hlr_10.42.42.2(pid=10161): ERR: Terminated: ERROR {rc=237} [trial-2395↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10161)] 22:53:26.318161 run osmo-hlr_10.42.42.2(pid=10161): stdout: | (launched: 2022-12-13_22:53:23.249470) 22:53:26.370564 run osmo-hlr_10.42.42.2(pid=10161): stderr: | 20221213225323450 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225323450 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225323450 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225323450 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225323450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225323450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225323462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225323471 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225323471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225323471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:26.443013 run osmo-msc_10.42.42.6(pid=10167): ERR: Terminated: ERROR {rc=2} [trial-2395↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10167)] 22:53:26.493399 run osmo-msc_10.42.42.6(pid=10167): stdout: | (launched: 2022-12-13_22:53:25.293130) 22:53:26.545744 run osmo-msc_10.42.42.6(pid=10167): stderr: | 20221213225325614 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225325615 DLGLOBAL DEBUG validating counter group 0x7facc301fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225325615 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225325615 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225325615 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225325615 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225325617 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225325617 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225325617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225325618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:26.598463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10160): Terminating (SIGTERM) 22:53:26.640354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10163): Terminating (SIGTERM) 22:53:26.682631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10166): Terminating (SIGTERM) 22:53:26.725653 --- ParallelTerminationStrategy: PID 10160 died... 22:53:26.746278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10160): Terminated: ok {rc=0} 22:53:26.793196 --- ParallelTerminationStrategy: PID 10163 died... 22:53:26.813163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10163): Terminated: ok {rc=0} 22:53:26.859772 --- ParallelTerminationStrategy: PID 10166 died... 22:53:26.879841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10166): Terminated: ok {rc=0} 22:53:26.969418 bus /sierra_3: Setting Powered False 22:53:28.068710 bus /sierra_3: Setting Powered False 22:53:29.186002 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 emergency:nanobts+band-900 --------------------------------------------------------------------- 22:53:30.448060 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:53:30.453637 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 22:53:30.486271 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 22:53:30.514591 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 22:53:30.601768 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 22:53:30.634286 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 22:53:30.662538 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 22:53:31.248073 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2395 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 22:53:31.257054 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:31.271851 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 22:53:31.331135 tst emergency_mo_mt_call.py: using LAC 36787 22:53:31.455135 tst emergency_mo_mt_call.py: using RAC 67 22:53:31.578489 tst emergency_mo_mt_call.py: using CellId 36787 22:53:31.698989 tst emergency_mo_mt_call.py: using BVCI 36788 22:53:31.846663 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:31.861330 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:31.876490 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:31.892470 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:31.906440 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:31.922546 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:32.074579 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:32.207978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:32.703805 run create_hlr_db(pid=10172): Launched 22:53:32.826105 bus /sierra_2: Setting Powered False 22:53:33.889181 run create_hlr_db(pid=10172): Terminated: ok {rc=0} 22:53:34.314109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10174): Launched 22:53:34.610971 run osmo-hlr_10.42.42.2(pid=10175): Launched 22:53:34.724736 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:35.239741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10177): Launched 22:53:35.535719 run osmo-stp_10.42.42.5(pid=10178): Launched 22:53:35.667402 tst emergency_mo_mt_call.py: using MSISDN 8366 22:53:35.819488 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:36.353346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10180): Launched 22:53:36.651077 run osmo-msc_10.42.42.6(pid=10181): Launched 22:53:36.817184 run osmo-stp_10.42.42.5(pid=10178): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10178)] 22:53:36.942209 run osmo-stp_10.42.42.5(pid=10178): stdout: | (launched: 2022-12-13_22:53:35.481308) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:37.067962 run osmo-stp_10.42.42.5(pid=10178): stderr: | 20221213225335653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225335653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225335654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225335654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225335654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225335655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225335655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:37.191852 run osmo-stp_10.42.42.5(pid=10178): stdout: | (launched: 2022-12-13_22:53:35.481308) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:37.310184 run osmo-stp_10.42.42.5(pid=10178): stderr: | 20221213225335653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225335653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225335654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225335654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225335654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225335655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225335655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:37.451480 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10178): Process ended prematurely: osmo-stp_10.42.42.5(pid=10178) [trial-2395↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10178)] [trial-2395↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 22:53:37.459795 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 22:53:37.486010 run osmo-hlr_10.42.42.2(pid=10175): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10175)] 22:53:37.533877 run osmo-hlr_10.42.42.2(pid=10175): stdout: | (launched: 2022-12-13_22:53:34.556173) 22:53:37.583335 run osmo-hlr_10.42.42.2(pid=10175): stderr: | 20221213225334735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225334735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225334735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225334735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225334735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225334735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225334748 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225334758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225334758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225334758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:37.652105 run osmo-msc_10.42.42.6(pid=10181): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10181)] 22:53:37.699812 run osmo-msc_10.42.42.6(pid=10181): stdout: | (launched: 2022-12-13_22:53:36.595612) 22:53:37.748750 run osmo-msc_10.42.42.6(pid=10181): stderr: | 20221213225336868 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225336868 DLGLOBAL DEBUG validating counter group 0x7f95e4c80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225336868 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225336868 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225336869 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225336869 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225336872 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225336873 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225336873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225336873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:37.798153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10174): Terminating (SIGTERM) 22:53:37.837531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10177): Terminating (SIGTERM) 22:53:37.876719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10180): Terminating (SIGTERM) 22:53:37.916246 --- ParallelTerminationStrategy: PID 10174 died... 22:53:37.935515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10174): Terminated: ok {rc=0} 22:53:37.979334 --- ParallelTerminationStrategy: PID 10177 died... 22:53:37.998144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10177): Terminated: ok {rc=0} 22:53:38.042665 --- ParallelTerminationStrategy: PID 10180 died... 22:53:38.061648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10180): Terminated: ok {rc=0} 22:53:38.148074 bus /sierra_3: Setting Powered False 22:53:39.248385 bus /sierra_3: Setting Powered False 22:53:40.365290 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 22:53:41.453525 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:41.464886 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 22:53:41.514773 tst emergency_preemptive_call.py: using LAC 36788 22:53:41.632238 tst emergency_preemptive_call.py: using RAC 68 22:53:41.751404 tst emergency_preemptive_call.py: using CellId 36788 22:53:41.868820 tst emergency_preemptive_call.py: using BVCI 36789 22:53:41.976459 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:41.987375 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:41.998238 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:42.008860 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:42.020356 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 22:53:42.031452 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:42.150924 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:42.271145 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:42.386234 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:42.504768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:42.998102 run create_hlr_db(pid=10183): Launched 22:53:43.120217 bus /sierra_2: Setting Powered False 22:53:44.184000 run create_hlr_db(pid=10183): Terminated: ok {rc=0} 22:53:44.610237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10185): Launched 22:53:44.909217 run osmo-hlr_10.42.42.2(pid=10186): Launched 22:53:45.023745 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:45.537968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10188): Launched 22:53:45.849713 run osmo-stp_10.42.42.5(pid=10189): Launched 22:53:46.111306 tst emergency_preemptive_call.py: using MSISDN 8367 22:53:46.291715 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:46.886650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10191): Launched 22:53:47.230530 run osmo-msc_10.42.42.6(pid=10192): Launched 22:53:47.444373 run osmo-stp_10.42.42.5(pid=10189): ERR: Terminated: ERROR {rc=1} [trial-2395↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10189)] 22:53:47.583878 run osmo-stp_10.42.42.5(pid=10189): stdout: | (launched: 2022-12-13_22:53:45.779739) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:47.723216 run osmo-stp_10.42.42.5(pid=10189): stderr: | 20221213225346031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225346031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225346031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225346032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225346032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225346032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225346032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:47.858537 run osmo-stp_10.42.42.5(pid=10189): stdout: | (launched: 2022-12-13_22:53:45.779739) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:47.986629 run osmo-stp_10.42.42.5(pid=10189): stderr: | 20221213225346031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225346031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225346031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225346032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225346032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225346032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225346032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:48.139785 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10189): Process ended prematurely: osmo-stp_10.42.42.5(pid=10189) [trial-2395↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10189)] [trial-2395↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 22:53:48.149034 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 22:53:48.176705 run osmo-hlr_10.42.42.2(pid=10186): ERR: Terminated: ERROR {rc=237} [trial-2395↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10186)] 22:53:48.229555 run osmo-hlr_10.42.42.2(pid=10186): stdout: | (launched: 2022-12-13_22:53:44.854301) 22:53:48.282642 run osmo-hlr_10.42.42.2(pid=10186): stderr: | 20221213225345029 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225345029 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225345029 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225345029 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225345029 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225345029 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225345041 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225345051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225345051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225345051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:48.356658 run osmo-msc_10.42.42.6(pid=10192): ERR: Terminated: ERROR {rc=2} [trial-2395↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10192)] 22:53:48.406987 run osmo-msc_10.42.42.6(pid=10192): stdout: | (launched: 2022-12-13_22:53:47.166255) 22:53:48.460381 run osmo-msc_10.42.42.6(pid=10192): stderr: | 20221213225347517 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225347517 DLGLOBAL DEBUG validating counter group 0x7faf2c880c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225347517 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225347517 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225347517 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225347517 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225347519 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225347520 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225347520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225347520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:48.513678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10185): Terminating (SIGTERM) 22:53:48.555657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10188): Terminating (SIGTERM) 22:53:48.598764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10191): Terminating (SIGTERM) 22:53:48.641872 --- ParallelTerminationStrategy: PID 10185 died... 22:53:48.663027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10185): Terminated: ok {rc=0} 22:53:48.710672 --- ParallelTerminationStrategy: PID 10188 died... 22:53:48.731228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10188): Terminated: ok {rc=0} 22:53:48.778715 --- ParallelTerminationStrategy: PID 10191 died... 22:53:48.799335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10191): Terminated: ok {rc=0} 22:53:48.889603 bus /sierra_9: Setting Powered False 22:53:49.989272 bus /sierra_9: Setting Powered False 22:53:51.106314 bus /sierra_8: Setting Powered False 22:53:52.205466 bus /sierra_8: Setting Powered False 22:53:53.324165 bus /sierra_3: Setting Powered False 22:53:54.424298 bus /sierra_3: Setting Powered False 22:53:55.541209 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:nanobts+band-900 --------------------------------------------------------------------- 22:53:56.820204 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:53:56.825892 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 22:53:56.858580 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 22:53:56.898793 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 22:53:56.988100 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 22:53:57.022133 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 22:53:57.061113 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 22:53:57.648314 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 22:53:57.698392 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:53:57.709212 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 22:53:57.759430 tst cs_paging_gprs_active.py: using LAC 36789 22:53:57.876857 tst cs_paging_gprs_active.py: using RAC 69 22:53:57.993269 tst cs_paging_gprs_active.py: using CellId 36789 22:53:58.111488 tst cs_paging_gprs_active.py: using BVCI 36790 22:53:58.221386 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:53:58.232102 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:53:58.242655 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:53:58.252933 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:53:58.263274 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:53:58.274127 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:53:58.284609 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:53:58.295041 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:53:58.306045 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:58.427883 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:53:58.551525 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:53:58.771992 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:53:59.097538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10197): Launched 22:53:59.379967 run iperf3-srv_10.42.42.10(pid=10198): Launched 22:53:59.502676 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:53:59.722599 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:00.048560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10199): Launched 22:54:00.331605 run iperf3-srv_10.42.42.10(pid=10200): Launched 22:54:00.454064 tst cs_paging_gprs_active.py:38: start network... 22:54:00.673364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:01.191093 run create_hlr_db(pid=10201): Launched 22:54:01.405981 bus /sierra_2: Setting Powered False 22:54:02.505905 run create_hlr_db(pid=10201): Terminated: ok {rc=0} 22:54:03.088127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10339): Launched 22:54:03.493049 run osmo-hlr_10.42.42.2(pid=10372): Launched 22:54:03.791679 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:04.619866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10476): Launched 22:54:04.965701 run osmo-stp_10.42.42.5(pid=10477): Launched 22:54:05.209560 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:05.929728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10479): Launched 22:54:06.058461 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:06.328743 run patchelf(pid=10481): Launched 22:54:06.514604 run osmo-stp_10.42.42.5(pid=10477): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10477)] 22:54:06.654286 run osmo-stp_10.42.42.5(pid=10477): stdout: | (launched: 2022-12-13_22:54:04.895678) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:06.795998 run osmo-stp_10.42.42.5(pid=10477): stderr: | 20221213225405236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225405236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225405236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225405236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225405237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225405237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225405237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:06.939151 run osmo-stp_10.42.42.5(pid=10477): stdout: | (launched: 2022-12-13_22:54:04.895678) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:07.076433 run osmo-stp_10.42.42.5(pid=10477): stderr: | 20221213225405236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225405236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225405236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225405236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225405237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225405237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225405237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:07.236504 run patchelf(pid=10481): Terminating (SIGINT) 22:54:07.421287 run patchelf(pid=10481): Terminated: ok {rc=0} 22:54:07.554708 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10477): Process ended prematurely: osmo-stp_10.42.42.5(pid=10477) [trial-2395↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10477)] [trial-2395↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 22:54:07.565939 tst cs_paging_gprs_active.py:38: Test FAILED (9.9 sec) 22:54:07.595687 run osmo-hlr_10.42.42.2(pid=10372): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10372)] 22:54:07.649949 run osmo-hlr_10.42.42.2(pid=10372): stdout: | (launched: 2022-12-13_22:54:03.416578) 22:54:07.704211 run osmo-hlr_10.42.42.2(pid=10372): stderr: | 20221213225403786 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225403786 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225403786 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225403786 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225403786 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225403786 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225403807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225403820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225403820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225403820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:07.760020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10197): Terminating (SIGTERM) 22:54:07.803745 run iperf3-srv_10.42.42.10(pid=10198): Terminating (SIGTERM) 22:54:07.850481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10199): Terminating (SIGTERM) 22:54:07.895230 run iperf3-srv_10.42.42.10(pid=10200): Terminating (SIGTERM) 22:54:07.941998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10339): Terminating (SIGTERM) 22:54:07.986682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10476): Terminating (SIGTERM) 22:54:08.032553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10479): Terminating (SIGTERM) 22:54:08.078193 --- ParallelTerminationStrategy: PID 10197 died... 22:54:08.100289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10197): Terminated: ok {rc=0} 22:54:08.148686 --- ParallelTerminationStrategy: PID 10198 died... 22:54:08.170220 run iperf3-srv_10.42.42.10(pid=10198): Terminated {rc=256} 22:54:08.218375 --- ParallelTerminationStrategy: PID 10199 died... 22:54:08.239630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10199): Terminated: ok {rc=0} 22:54:08.288744 --- ParallelTerminationStrategy: PID 10200 died... 22:54:08.309327 run iperf3-srv_10.42.42.10(pid=10200): Terminated {rc=256} 22:54:08.357617 --- ParallelTerminationStrategy: PID 10339 died... 22:54:08.378811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10339): Terminated: ok {rc=0} 22:54:08.426992 --- ParallelTerminationStrategy: PID 10476 died... 22:54:08.448251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10476): Terminated: ok {rc=0} 22:54:08.496399 --- ParallelTerminationStrategy: PID 10479 died... 22:54:08.517878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10479): Terminated: ok {rc=0} 22:54:08.610466 bus /gobi_0: Setting Powered False 22:54:09.713086 bus /gobi_0: Setting Powered False 22:54:10.835657 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 22:54:11.995032 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:12.008229 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 22:54:12.062528 tst iperf3.py: using LAC 36790 22:54:12.192130 tst iperf3.py: using RAC 70 22:54:12.325442 tst iperf3.py: using CellId 36790 22:54:12.456879 tst iperf3.py: using BVCI 36791 22:54:12.579409 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:12.591585 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:12.603712 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:12.615685 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:12.628713 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:12.641832 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:12.655096 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:12.668453 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:12.681188 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:12.807495 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:54:13.033515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:13.374850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10483): Launched 22:54:13.681564 run iperf3-srv_10.42.42.10(pid=10484): Launched 22:54:13.821971 tst iperf3.py:8: start network... 22:54:14.047803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:14.572630 run create_hlr_db(pid=10485): Launched 22:54:14.740551 bus /gobi_6: Setting Powered False 22:54:15.806288 run create_hlr_db(pid=10485): Terminated: ok {rc=0} 22:54:16.325835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10487): Launched 22:54:16.679419 run osmo-hlr_10.42.42.2(pid=10488): Launched 22:54:16.876732 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:17.682154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10490): Launched 22:54:18.022125 run osmo-stp_10.42.42.5(pid=10491): Launched 22:54:18.276540 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:18.934420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10493): Launched 22:54:19.075049 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:19.363400 run patchelf(pid=10494): Launched 22:54:19.564738 run osmo-stp_10.42.42.5(pid=10491): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10491)] 22:54:19.708297 run osmo-stp_10.42.42.5(pid=10491): stdout: | (launched: 2022-12-13_22:54:17.960653) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:19.853817 run osmo-stp_10.42.42.5(pid=10491): stderr: | 20221213225418259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225418259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225418260 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225418260 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225418262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225418262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225418263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:19.998839 run osmo-stp_10.42.42.5(pid=10491): stdout: | (launched: 2022-12-13_22:54:17.960653) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:20.137859 run osmo-stp_10.42.42.5(pid=10491): stderr: | 20221213225418259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225418259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225418260 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225418260 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225418262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225418262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225418263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:20.303729 run patchelf(pid=10494): Terminating (SIGINT) 22:54:20.494322 run patchelf(pid=10494): Terminated: ok {rc=0} 22:54:20.630165 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10491): Process ended prematurely: osmo-stp_10.42.42.5(pid=10491) [trial-2395↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10491)] [trial-2395↪gprs:nanobts+band-900↪iperf3.py:8] 22:54:20.641950 tst iperf3.py:8: Test FAILED (8.7 sec) 22:54:20.675288 run osmo-hlr_10.42.42.2(pid=10488): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10488)] 22:54:20.731393 run osmo-hlr_10.42.42.2(pid=10488): stdout: | (launched: 2022-12-13_22:54:16.607575) 22:54:20.786568 run osmo-hlr_10.42.42.2(pid=10488): stderr: | 20221213225416968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225416968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225416968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225416968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225416968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225416968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225416993 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225417012 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225417012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225417012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:20.842457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10483): Terminating (SIGTERM) 22:54:20.887627 run iperf3-srv_10.42.42.10(pid=10484): Terminating (SIGTERM) 22:54:20.935497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10487): Terminating (SIGTERM) 22:54:20.982028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10490): Terminating (SIGTERM) 22:54:21.029009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10493): Terminating (SIGTERM) 22:54:21.077423 --- ParallelTerminationStrategy: PID 10483 died... 22:54:21.099918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10483): Terminated: ok {rc=0} 22:54:21.151708 --- ParallelTerminationStrategy: PID 10484 died... 22:54:21.172532 run iperf3-srv_10.42.42.10(pid=10484): Terminated {rc=256} 22:54:21.223748 --- ParallelTerminationStrategy: PID 10487 died... 22:54:21.245957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10487): Terminated: ok {rc=0} 22:54:21.296905 --- ParallelTerminationStrategy: PID 10490 died... 22:54:21.318152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10490): Terminated: ok {rc=0} 22:54:21.369698 --- ParallelTerminationStrategy: PID 10493 died... 22:54:21.390908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10493): Terminated: ok {rc=0} 22:54:21.486309 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 22:54:22.646218 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:22.659840 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 22:54:22.712221 tst iperf3m4.py: using LAC 36791 22:54:22.845401 tst iperf3m4.py: using RAC 71 22:54:22.977155 tst iperf3m4.py: using CellId 36791 22:54:23.111140 tst iperf3m4.py: using BVCI 36792 22:54:23.234269 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.246461 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.259678 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.272151 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.285426 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.298259 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.311227 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.324319 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:23.337232 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:23.465723 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:23.596280 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:23.724492 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:23.851610 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:54:24.080795 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:24.423136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10495): Launched 22:54:24.733648 run iperf3-srv_10.42.42.10(pid=10496): Launched 22:54:24.874771 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:54:25.103962 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:25.413725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10497): Launched 22:54:25.677275 run iperf3-srv_10.42.42.10(pid=10498): Launched 22:54:25.790358 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:54:25.991859 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:26.294255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10499): Launched 22:54:26.558277 run iperf3-srv_10.42.42.10(pid=10500): Launched 22:54:26.671314 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:54:26.873463 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:27.177202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10501): Launched 22:54:27.440922 run iperf3-srv_10.42.42.10(pid=10502): Launched 22:54:27.554469 tst iperf3m4.py:8: start network... 22:54:27.756088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:28.227401 run create_hlr_db(pid=10503): Launched 22:54:28.350847 bus /gobi_6: Setting Powered False 22:54:29.411713 run create_hlr_db(pid=10503): Terminated: ok {rc=0} 22:54:29.833181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10505): Launched 22:54:30.136645 run osmo-hlr_10.42.42.2(pid=10506): Launched 22:54:30.252453 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:30.790944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10508): Launched 22:54:31.124005 run osmo-stp_10.42.42.5(pid=10509): Launched 22:54:31.276820 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:31.965087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10511): Launched 22:54:32.094811 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:32.356318 run patchelf(pid=10512): Launched 22:54:32.526345 run osmo-stp_10.42.42.5(pid=10509): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10509)] 22:54:32.654473 run osmo-stp_10.42.42.5(pid=10509): stdout: | (launched: 2022-12-13_22:54:31.060680) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:32.784359 run osmo-stp_10.42.42.5(pid=10509): stderr: | 20221213225431400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225431400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225431409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225431409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225431412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225431412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225431412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:32.914244 run osmo-stp_10.42.42.5(pid=10509): stdout: | (launched: 2022-12-13_22:54:31.060680) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:33.038562 run osmo-stp_10.42.42.5(pid=10509): stderr: | 20221213225431400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225431400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225431409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225431409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225431412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225431412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225431412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:33.185646 run patchelf(pid=10512): Terminating (SIGINT) 22:54:33.355341 run patchelf(pid=10512): Terminated: ok {rc=0} 22:54:33.477652 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10509): Process ended prematurely: osmo-stp_10.42.42.5(pid=10509) [trial-2395↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10509)] [trial-2395↪gprs:nanobts+band-900↪iperf3m4.py:8] 22:54:33.487146 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:54:33.514707 run osmo-hlr_10.42.42.2(pid=10506): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10506)] 22:54:33.562410 run osmo-hlr_10.42.42.2(pid=10506): stdout: | (launched: 2022-12-13_22:54:30.080923) 22:54:33.611632 run osmo-hlr_10.42.42.2(pid=10506): stderr: | 20221213225430258 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225430258 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225430258 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225430258 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225430258 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225430258 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225430271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225430280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225430280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225430280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:33.661527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10495): Terminating (SIGTERM) 22:54:33.701344 run iperf3-srv_10.42.42.10(pid=10496): Terminating (SIGTERM) 22:54:33.740863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10497): Terminating (SIGTERM) 22:54:33.780526 run iperf3-srv_10.42.42.10(pid=10498): Terminating (SIGTERM) 22:54:33.819929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10499): Terminating (SIGTERM) 22:54:33.859485 run iperf3-srv_10.42.42.10(pid=10500): Terminating (SIGTERM) 22:54:33.898777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10501): Terminating (SIGTERM) 22:54:33.938205 run iperf3-srv_10.42.42.10(pid=10502): Terminating (SIGTERM) 22:54:33.977511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10505): Terminating (SIGTERM) 22:54:34.016855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10508): Terminating (SIGTERM) 22:54:34.056267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10511): Terminating (SIGTERM) 22:54:34.096177 --- ParallelTerminationStrategy: PID 10495 died... 22:54:34.115234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10495): Terminated: ok {rc=0} 22:54:34.159443 --- ParallelTerminationStrategy: PID 10496 died... 22:54:34.178020 run iperf3-srv_10.42.42.10(pid=10496): Terminated {rc=256} 22:54:34.221681 --- ParallelTerminationStrategy: PID 10497 died... 22:54:34.240253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10497): Terminated: ok {rc=0} 22:54:34.283989 --- ParallelTerminationStrategy: PID 10498 died... 22:54:34.302531 run iperf3-srv_10.42.42.10(pid=10498): Terminated {rc=256} 22:54:34.346091 --- ParallelTerminationStrategy: PID 10499 died... 22:54:34.364637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10499): Terminated: ok {rc=0} 22:54:34.408142 --- ParallelTerminationStrategy: PID 10500 died... 22:54:34.426676 run iperf3-srv_10.42.42.10(pid=10500): Terminated {rc=256} 22:54:34.470093 --- ParallelTerminationStrategy: PID 10501 died... 22:54:34.489182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10501): Terminated: ok {rc=0} 22:54:34.533105 --- ParallelTerminationStrategy: PID 10502 died... 22:54:34.551699 run iperf3-srv_10.42.42.10(pid=10502): Terminated {rc=256} 22:54:34.595299 --- ParallelTerminationStrategy: PID 10505 died... 22:54:34.613945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10505): Terminated: ok {rc=0} 22:54:34.657597 --- ParallelTerminationStrategy: PID 10508 died... 22:54:34.676187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10508): Terminated: ok {rc=0} 22:54:34.719824 --- ParallelTerminationStrategy: PID 10511 died... 22:54:34.738499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10511): Terminated: ok {rc=0} 22:54:34.824252 bus /gobi_4: Setting Powered False 22:54:35.924928 bus /gobi_4: Setting Powered False 22:54:37.041276 bus /gobi_1: Setting Powered False 22:54:38.139934 bus /gobi_1: Setting Powered False 22:54:39.256132 bus /gobi_0: Setting Powered False 22:54:40.354607 bus /gobi_0: Setting Powered False 22:54:41.471694 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-900 ping.py ---------------------------------------------- 22:54:42.574624 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:42.586432 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 22:54:42.635970 tst ping.py: using LAC 36792 22:54:42.754824 tst ping.py: using RAC 72 22:54:42.870541 tst ping.py: using CellId 36792 22:54:42.987302 tst ping.py: using BVCI 36793 22:54:43.095292 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.106006 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.116650 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.127214 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.137630 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.148034 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.158553 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:43.168929 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:43.281985 tst ping.py:19: start network... 22:54:43.480535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:43.940325 run create_hlr_db(pid=10514): Launched 22:54:44.062244 bus /gobi_6: Setting Powered False 22:54:45.121948 run create_hlr_db(pid=10514): Terminated: ok {rc=0} 22:54:45.537500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10516): Launched 22:54:45.841022 run osmo-hlr_10.42.42.2(pid=10517): Launched 22:54:46.059012 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:46.656503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10519): Launched 22:54:46.978376 run osmo-stp_10.42.42.5(pid=10520): Launched 22:54:47.242297 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:47.854400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10522): Launched 22:54:47.976399 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:48.246806 run patchelf(pid=10523): Launched 22:54:48.424285 run osmo-stp_10.42.42.5(pid=10520): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10520)] 22:54:48.559584 run osmo-stp_10.42.42.5(pid=10520): stdout: | (launched: 2022-12-13_22:54:46.917187) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:48.696893 run osmo-stp_10.42.42.5(pid=10520): stderr: | 20221213225447173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225447173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225447173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225447174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225447174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225447174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225447174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:48.834422 run osmo-stp_10.42.42.5(pid=10520): stdout: | (launched: 2022-12-13_22:54:46.917187) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:48.965505 run osmo-stp_10.42.42.5(pid=10520): stderr: | 20221213225447173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225447173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225447173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225447174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225447174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225447174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225447174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:49.120663 run patchelf(pid=10523): Terminating (SIGINT) 22:54:49.299528 run patchelf(pid=10523): Terminated: ok {rc=0} 22:54:49.428196 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10520): Process ended prematurely: osmo-stp_10.42.42.5(pid=10520) [trial-2395↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10520)] [trial-2395↪gprs:nanobts+band-900↪ping.py:22] 22:54:49.437773 tst ping.py:22: Test FAILED (6.9 sec) 22:54:49.465888 run osmo-hlr_10.42.42.2(pid=10517): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10517)] 22:54:49.516532 run osmo-hlr_10.42.42.2(pid=10517): stdout: | (launched: 2022-12-13_22:54:45.779963) 22:54:49.568423 run osmo-hlr_10.42.42.2(pid=10517): stderr: | 20221213225446053 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225446053 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225446053 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225446053 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225446053 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225446053 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225446073 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225446092 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225446092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225446092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:49.621542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10516): Terminating (SIGTERM) 22:54:49.663482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10519): Terminating (SIGTERM) 22:54:49.705386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10522): Terminating (SIGTERM) 22:54:49.748205 --- ParallelTerminationStrategy: PID 10516 died... 22:54:49.768369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10516): Terminated: ok {rc=0} 22:54:49.814985 --- ParallelTerminationStrategy: PID 10519 died... 22:54:49.834868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10519): Terminated: ok {rc=0} 22:54:49.880727 --- ParallelTerminationStrategy: PID 10522 died... 22:54:49.900549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10522): Terminated: ok {rc=0} 22:54:49.988049 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 22:54:51.078087 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.089782 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 22:54:51.138405 tst ping_idle_ping.py: using LAC 36793 22:54:51.266683 tst ping_idle_ping.py: using RAC 73 22:54:51.391823 tst ping_idle_ping.py: using CellId 36793 22:54:51.517387 tst ping_idle_ping.py: using BVCI 36794 22:54:51.635946 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.647207 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.658281 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.669248 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.680888 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.692652 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.704574 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 22:54:51.716553 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 22:54:51.838673 tst ping_idle_ping.py:24: start network... 22:54:52.054665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:52.552293 run create_hlr_db(pid=10524): Launched 22:54:52.674963 bus /gobi_6: Setting Powered False 22:54:53.738242 run create_hlr_db(pid=10524): Terminated: ok {rc=0} 22:54:54.166367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10526): Launched 22:54:54.464540 run osmo-hlr_10.42.42.2(pid=10527): Launched 22:54:54.580240 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:55.095319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10529): Launched 22:54:55.394621 run osmo-stp_10.42.42.5(pid=10530): Launched 22:54:55.508805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:56.025989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10532): Launched 22:54:56.140358 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:56.392699 run patchelf(pid=10533): Launched 22:54:56.559705 run osmo-stp_10.42.42.5(pid=10530): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10530)] 22:54:56.686524 run osmo-stp_10.42.42.5(pid=10530): stdout: | (launched: 2022-12-13_22:54:55.339507) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:56.814487 run osmo-stp_10.42.42.5(pid=10530): stderr: | 20221213225455510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225455510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225455511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225455511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225455511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225455511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225455512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:56.943281 run osmo-stp_10.42.42.5(pid=10530): stdout: | (launched: 2022-12-13_22:54:55.339507) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:57.065610 run osmo-stp_10.42.42.5(pid=10530): stderr: | 20221213225455510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225455510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225455511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225455511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225455511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225455511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225455512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:57.210816 run patchelf(pid=10533): Terminating (SIGINT) 22:54:57.378496 run patchelf(pid=10533): Terminated: ok {rc=0} 22:54:57.498740 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10530): Process ended prematurely: osmo-stp_10.42.42.5(pid=10530) [trial-2395↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10530)] [trial-2395↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 22:54:57.507577 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:54:57.534650 run osmo-hlr_10.42.42.2(pid=10527): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10527)] 22:54:57.582185 run osmo-hlr_10.42.42.2(pid=10527): stdout: | (launched: 2022-12-13_22:54:54.409873) 22:54:57.631246 run osmo-hlr_10.42.42.2(pid=10527): stderr: | 20221213225454586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225454586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225454586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225454586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225454586 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225454586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225454598 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225454608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225454608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225454608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:57.681549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10526): Terminating (SIGTERM) 22:54:57.721574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10529): Terminating (SIGTERM) 22:54:57.761591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10532): Terminating (SIGTERM) 22:54:57.802375 --- ParallelTerminationStrategy: PID 10526 died... 22:54:57.821897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10526): Terminated: ok {rc=0} 22:54:57.866489 --- ParallelTerminationStrategy: PID 10529 died... 22:54:57.885572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10529): Terminated: ok {rc=0} 22:54:57.929590 --- ParallelTerminationStrategy: PID 10532 died... 22:54:57.948311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10532): Terminated: ok {rc=0} 22:54:58.040680 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 22:54:59.346001 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:54:59.352395 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:54:59.385150 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:54:59.425358 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:54:59.514479 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:54:59.547226 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:54:59.586660 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:55:00.188227 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:55:00.238446 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:00.249374 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:00.295680 tst cs_paging_gprs_active.py: using LAC 36794 22:55:00.414332 tst cs_paging_gprs_active.py: using RAC 74 22:55:00.531570 tst cs_paging_gprs_active.py: using CellId 36794 22:55:00.649398 tst cs_paging_gprs_active.py: using BVCI 36795 22:55:00.771223 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:00.782682 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:00.793937 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:00.805182 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:00.817208 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:00.829452 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:00.849733 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:00.862181 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:00.874828 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:01.015722 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:01.141262 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:55:01.382378 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:01.725539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10542): Launched 22:55:02.034070 run iperf3-srv_10.42.42.10(pid=10543): Launched 22:55:02.191707 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:55:02.419950 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:02.726257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10544): Launched 22:55:02.991997 run iperf3-srv_10.42.42.10(pid=10545): Launched 22:55:03.106115 tst cs_paging_gprs_active.py:38: start network... 22:55:03.309491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:03.779425 run create_hlr_db(pid=10546): Launched 22:55:03.903156 bus /gobi_6: Setting Powered False 22:55:04.963365 run create_hlr_db(pid=10546): Terminated: ok {rc=0} 22:55:05.385980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10548): Launched 22:55:05.689372 run osmo-hlr_10.42.42.2(pid=10549): Launched 22:55:05.805863 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:06.327366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10551): Launched 22:55:06.630673 run osmo-stp_10.42.42.5(pid=10552): Launched 22:55:06.748095 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:07.273771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10554): Launched 22:55:07.391491 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:07.648801 run patchelf(pid=10555): Launched 22:55:07.818318 run osmo-stp_10.42.42.5(pid=10552): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10552)] 22:55:07.946410 run osmo-stp_10.42.42.5(pid=10552): stdout: | (launched: 2022-12-13_22:55:06.575341) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:08.076463 run osmo-stp_10.42.42.5(pid=10552): stderr: | 20221213225506748 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225506748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225506749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225506749 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225506750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225506750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225506750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:08.206772 run osmo-stp_10.42.42.5(pid=10552): stdout: | (launched: 2022-12-13_22:55:06.575341) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:08.330951 run osmo-stp_10.42.42.5(pid=10552): stderr: | 20221213225506748 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225506748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225506749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225506749 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225506750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225506750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225506750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:08.478985 run patchelf(pid=10555): Terminating (SIGINT) 22:55:08.648812 run patchelf(pid=10555): Terminated: ok {rc=0} 22:55:08.771932 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10552): Process ended prematurely: osmo-stp_10.42.42.5(pid=10552) [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10552)] [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:55:08.781456 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:55:08.808753 run osmo-hlr_10.42.42.2(pid=10549): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10549)] 22:55:08.856530 run osmo-hlr_10.42.42.2(pid=10549): stdout: | (launched: 2022-12-13_22:55:05.633368) 22:55:08.905816 run osmo-hlr_10.42.42.2(pid=10549): stderr: | 20221213225505812 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225505812 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225505812 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225505812 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225505812 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225505812 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225505824 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225505834 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225505835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225505835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:08.955473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10542): Terminating (SIGTERM) 22:55:08.995074 run iperf3-srv_10.42.42.10(pid=10543): Terminating (SIGTERM) 22:55:09.034546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10544): Terminating (SIGTERM) 22:55:09.074004 run iperf3-srv_10.42.42.10(pid=10545): Terminating (SIGTERM) 22:55:09.113429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10548): Terminating (SIGTERM) 22:55:09.152894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10551): Terminating (SIGTERM) 22:55:09.192486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10554): Terminating (SIGTERM) 22:55:09.232242 --- ParallelTerminationStrategy: PID 10542 died... 22:55:09.251490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10542): Terminated: ok {rc=0} 22:55:09.296027 --- ParallelTerminationStrategy: PID 10543 died... 22:55:09.314649 run iperf3-srv_10.42.42.10(pid=10543): Terminated {rc=256} 22:55:09.358297 --- ParallelTerminationStrategy: PID 10544 died... 22:55:09.377113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10544): Terminated: ok {rc=0} 22:55:09.421110 --- ParallelTerminationStrategy: PID 10545 died... 22:55:09.439753 run iperf3-srv_10.42.42.10(pid=10545): Terminated {rc=256} 22:55:09.483525 --- ParallelTerminationStrategy: PID 10548 died... 22:55:09.502192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10548): Terminated: ok {rc=0} 22:55:09.546197 --- ParallelTerminationStrategy: PID 10551 died... 22:55:09.565000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10551): Terminated: ok {rc=0} 22:55:09.608937 --- ParallelTerminationStrategy: PID 10554 died... 22:55:09.627720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10554): Terminated: ok {rc=0} 22:55:09.713479 bus /gobi_0: Setting Powered False 22:55:10.814747 bus /gobi_0: Setting Powered False 22:55:11.931082 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:55:13.075135 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.086542 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:13.142466 tst iperf3.py: using LAC 36795 22:55:13.261348 tst iperf3.py: using RAC 75 22:55:13.378279 tst iperf3.py: using CellId 36795 22:55:13.497028 tst iperf3.py: using BVCI 36796 22:55:13.606864 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.617883 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.628494 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.639113 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.649731 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.660423 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.671204 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.681762 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.692433 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:13.807264 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:55:14.011640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:14.316411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10556): Launched 22:55:14.581654 run iperf3-srv_10.42.42.10(pid=10557): Launched 22:55:14.695482 tst iperf3.py:8: start network... 22:55:14.899512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:15.370391 run create_hlr_db(pid=10558): Launched 22:55:15.495158 bus /gobi_6: Setting Powered False 22:55:16.574231 run create_hlr_db(pid=10558): Terminated: ok {rc=0} 22:55:17.091996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10560): Launched 22:55:17.429721 run osmo-hlr_10.42.42.2(pid=10561): Launched 22:55:17.558720 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:18.122210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10563): Launched 22:55:18.447206 run osmo-stp_10.42.42.5(pid=10564): Launched 22:55:18.572471 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:19.132513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10566): Launched 22:55:19.256703 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:19.530261 run patchelf(pid=10567): Launched 22:55:19.711305 run osmo-stp_10.42.42.5(pid=10564): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10564)] 22:55:19.849448 run osmo-stp_10.42.42.5(pid=10564): stdout: | (launched: 2022-12-13_22:55:18.388232) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:19.988191 run osmo-stp_10.42.42.5(pid=10564): stderr: | 20221213225518582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225518582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225518583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225518583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225518583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225518583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225518584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:20.127188 run osmo-stp_10.42.42.5(pid=10564): stdout: | (launched: 2022-12-13_22:55:18.388232) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:20.260655 run osmo-stp_10.42.42.5(pid=10564): stderr: | 20221213225518582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225518582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225518583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225518583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225518583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225518583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225518584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:20.418557 run patchelf(pid=10567): Terminating (SIGINT) 22:55:20.600640 run patchelf(pid=10567): Terminated: ok {rc=0} 22:55:20.732178 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10564): Process ended prematurely: osmo-stp_10.42.42.5(pid=10564) [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10564)] [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 22:55:20.742736 tst iperf3.py:8: Test FAILED (7.7 sec) 22:55:20.771503 run osmo-hlr_10.42.42.2(pid=10561): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10561)] 22:55:20.822032 run osmo-hlr_10.42.42.2(pid=10561): stdout: | (launched: 2022-12-13_22:55:17.370838) 22:55:20.874142 run osmo-hlr_10.42.42.2(pid=10561): stderr: | 20221213225517571 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225517571 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225517571 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225517571 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225517571 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225517571 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225517582 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225517590 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225517590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225517590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:20.926420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10556): Terminating (SIGTERM) 22:55:20.967874 run iperf3-srv_10.42.42.10(pid=10557): Terminating (SIGTERM) 22:55:21.009700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10560): Terminating (SIGTERM) 22:55:21.051375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10563): Terminating (SIGTERM) 22:55:21.093103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10566): Terminating (SIGTERM) 22:55:21.135160 --- ParallelTerminationStrategy: PID 10556 died... 22:55:21.155503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10556): Terminated: ok {rc=0} 22:55:21.202033 --- ParallelTerminationStrategy: PID 10557 died... 22:55:21.221824 run iperf3-srv_10.42.42.10(pid=10557): Terminated {rc=256} 22:55:21.267923 --- ParallelTerminationStrategy: PID 10560 died... 22:55:21.287760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10560): Terminated: ok {rc=0} 22:55:21.334094 --- ParallelTerminationStrategy: PID 10563 died... 22:55:21.353946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10563): Terminated: ok {rc=0} 22:55:21.400134 --- ParallelTerminationStrategy: PID 10566 died... 22:55:21.420100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10566): Terminated: ok {rc=0} 22:55:21.508142 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:55:22.658550 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:22.670796 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:22.720531 tst iperf3m4.py: using LAC 36796 22:55:22.847078 tst iperf3m4.py: using RAC 76 22:55:22.974567 tst iperf3m4.py: using CellId 36796 22:55:23.102768 tst iperf3m4.py: using BVCI 36797 22:55:23.220239 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.231753 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.243008 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.254240 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.265692 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.277518 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.289214 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.300605 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:23.312307 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:23.433389 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:23.556259 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:23.675478 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:23.797108 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:55:24.002177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:24.306654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10568): Launched 22:55:24.571698 run iperf3-srv_10.42.42.10(pid=10569): Launched 22:55:24.685729 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:55:24.889266 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:25.193532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10570): Launched 22:55:25.456857 run iperf3-srv_10.42.42.10(pid=10571): Launched 22:55:25.570469 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:55:25.772942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:26.076826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10572): Launched 22:55:26.341208 run iperf3-srv_10.42.42.10(pid=10573): Launched 22:55:26.455082 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:55:26.657916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:26.979311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10574): Launched 22:55:27.262661 run iperf3-srv_10.42.42.10(pid=10575): Launched 22:55:27.385348 tst iperf3m4.py:8: start network... 22:55:27.604708 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:28.109327 run create_hlr_db(pid=10576): Launched 22:55:28.233363 bus /gobi_6: Setting Powered False 22:55:29.297926 run create_hlr_db(pid=10576): Terminated: ok {rc=0} 22:55:29.749811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10578): Launched 22:55:30.075678 run osmo-hlr_10.42.42.2(pid=10579): Launched 22:55:30.200457 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:30.762050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10581): Launched 22:55:31.095207 run osmo-stp_10.42.42.5(pid=10582): Launched 22:55:31.308767 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:32.024555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10584): Launched 22:55:32.153860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:32.420720 run patchelf(pid=10585): Launched 22:55:32.601485 run osmo-stp_10.42.42.5(pid=10582): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10582)] 22:55:32.738642 run osmo-stp_10.42.42.5(pid=10582): stdout: | (launched: 2022-12-13_22:55:31.031794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:32.877489 run osmo-stp_10.42.42.5(pid=10582): stderr: | 20221213225531351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225531351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225531351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225531352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225531356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225531356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225531356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:33.016405 run osmo-stp_10.42.42.5(pid=10582): stdout: | (launched: 2022-12-13_22:55:31.031794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:33.149453 run osmo-stp_10.42.42.5(pid=10582): stderr: | 20221213225531351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225531351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225531351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225531352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225531356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225531356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225531356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:33.307259 run patchelf(pid=10585): Terminating (SIGINT) 22:55:33.488353 run patchelf(pid=10585): Terminated: ok {rc=0} 22:55:33.619175 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10582): Process ended prematurely: osmo-stp_10.42.42.5(pid=10582) [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10582)] [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 22:55:33.629481 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:55:33.658448 run osmo-hlr_10.42.42.2(pid=10579): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10579)] 22:55:33.708848 run osmo-hlr_10.42.42.2(pid=10579): stdout: | (launched: 2022-12-13_22:55:30.015426) 22:55:33.761449 run osmo-hlr_10.42.42.2(pid=10579): stderr: | 20221213225530214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225530214 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225530214 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225530214 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225530214 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225530214 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225530226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225530235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225530235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225530235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:33.813953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10568): Terminating (SIGTERM) 22:55:33.855449 run iperf3-srv_10.42.42.10(pid=10569): Terminating (SIGTERM) 22:55:33.897912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10570): Terminating (SIGTERM) 22:55:33.939891 run iperf3-srv_10.42.42.10(pid=10571): Terminating (SIGTERM) 22:55:33.982255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10572): Terminating (SIGTERM) 22:55:34.024025 run iperf3-srv_10.42.42.10(pid=10573): Terminating (SIGTERM) 22:55:34.065776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10574): Terminating (SIGTERM) 22:55:34.107626 run iperf3-srv_10.42.42.10(pid=10575): Terminating (SIGTERM) 22:55:34.149385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10578): Terminating (SIGTERM) 22:55:34.191130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10581): Terminating (SIGTERM) 22:55:34.232861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10584): Terminating (SIGTERM) 22:55:34.274982 --- ParallelTerminationStrategy: PID 10568 died... 22:55:34.295020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10568): Terminated: ok {rc=0} 22:55:34.341541 --- ParallelTerminationStrategy: PID 10569 died... 22:55:34.361438 run iperf3-srv_10.42.42.10(pid=10569): Terminated {rc=256} 22:55:34.407161 --- ParallelTerminationStrategy: PID 10570 died... 22:55:34.426908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10570): Terminated: ok {rc=0} 22:55:34.472797 --- ParallelTerminationStrategy: PID 10571 died... 22:55:34.492907 run iperf3-srv_10.42.42.10(pid=10571): Terminated {rc=256} 22:55:34.538729 --- ParallelTerminationStrategy: PID 10572 died... 22:55:34.558557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10572): Terminated: ok {rc=0} 22:55:34.604602 --- ParallelTerminationStrategy: PID 10573 died... 22:55:34.624412 run iperf3-srv_10.42.42.10(pid=10573): Terminated {rc=256} 22:55:34.670362 --- ParallelTerminationStrategy: PID 10574 died... 22:55:34.690102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10574): Terminated: ok {rc=0} 22:55:34.736028 --- ParallelTerminationStrategy: PID 10575 died... 22:55:34.755967 run iperf3-srv_10.42.42.10(pid=10575): Terminated {rc=256} 22:55:34.802111 --- ParallelTerminationStrategy: PID 10578 died... 22:55:34.821905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10578): Terminated: ok {rc=0} 22:55:34.868041 --- ParallelTerminationStrategy: PID 10581 died... 22:55:34.887487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10581): Terminated: ok {rc=0} 22:55:34.934088 --- ParallelTerminationStrategy: PID 10584 died... 22:55:34.954080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10584): Terminated: ok {rc=0} 22:55:35.042438 bus /gobi_4: Setting Powered False 22:55:36.140839 bus /gobi_4: Setting Powered False 22:55:37.257736 bus /gobi_1: Setting Powered False 22:55:38.355399 bus /gobi_1: Setting Powered False 22:55:39.470613 bus /gobi_0: Setting Powered False 22:55:40.566067 bus /gobi_0: Setting Powered False 22:55:41.680785 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 22:55:42.780274 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:42.791653 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:42.840617 tst ping.py: using LAC 36797 22:55:42.966277 tst ping.py: using RAC 77 22:55:43.092417 tst ping.py: using CellId 36797 22:55:43.216240 tst ping.py: using BVCI 36798 22:55:43.333357 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.344825 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.356024 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.367221 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.378655 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.390161 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.401842 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:43.413401 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:43.527883 tst ping.py:19: start network... 22:55:43.725991 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:44.184413 run create_hlr_db(pid=10586): Launched 22:55:44.306165 bus /gobi_6: Setting Powered False 22:55:45.366086 run create_hlr_db(pid=10586): Terminated: ok {rc=0} 22:55:45.802691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10588): Launched 22:55:46.153734 run osmo-hlr_10.42.42.2(pid=10589): Launched 22:55:46.390006 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:47.018449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10591): Launched 22:55:47.360389 run osmo-stp_10.42.42.5(pid=10592): Launched 22:55:47.484344 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:47.999782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10594): Launched 22:55:48.114221 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:48.365706 run patchelf(pid=10595): Launched 22:55:48.530934 run osmo-stp_10.42.42.5(pid=10592): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10592)] 22:55:48.655972 run osmo-stp_10.42.42.5(pid=10592): stdout: | (launched: 2022-12-13_22:55:47.293861) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:48.782925 run osmo-stp_10.42.42.5(pid=10592): stderr: | 20221213225547466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225547466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225547467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225547467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225547468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225547468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225547468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:48.910152 run osmo-stp_10.42.42.5(pid=10592): stdout: | (launched: 2022-12-13_22:55:47.293861) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:49.031862 run osmo-stp_10.42.42.5(pid=10592): stderr: | 20221213225547466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225547466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225547467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225547467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225547468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225547468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225547468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:49.177010 run patchelf(pid=10595): Terminating (SIGINT) 22:55:49.343171 run patchelf(pid=10595): Terminated: ok {rc=0} 22:55:49.463045 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10592): Process ended prematurely: osmo-stp_10.42.42.5(pid=10592) [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10592)] [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 22:55:49.471841 tst ping.py:22: Test FAILED (6.7 sec) 22:55:49.498575 run osmo-hlr_10.42.42.2(pid=10589): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10589)] 22:55:49.545764 run osmo-hlr_10.42.42.2(pid=10589): stdout: | (launched: 2022-12-13_22:55:46.090145) 22:55:49.594713 run osmo-hlr_10.42.42.2(pid=10589): stderr: | 20221213225546361 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225546361 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225546361 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225546361 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225546361 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225546361 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225546377 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225546392 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225546394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225546398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:49.643816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10588): Terminating (SIGTERM) 22:55:49.682937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10591): Terminating (SIGTERM) 22:55:49.722049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10594): Terminating (SIGTERM) 22:55:49.761620 --- ParallelTerminationStrategy: PID 10588 died... 22:55:49.780019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10588): Terminated: ok {rc=0} 22:55:49.823702 --- ParallelTerminationStrategy: PID 10591 died... 22:55:49.842173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10591): Terminated: ok {rc=0} 22:55:49.885453 --- ParallelTerminationStrategy: PID 10594 died... 22:55:49.903958 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10594): Terminated: ok {rc=0} 22:55:49.988367 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:55:51.076078 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:51.087870 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:51.137319 tst ping_idle_ping.py: using LAC 36798 22:55:51.253193 tst ping_idle_ping.py: using RAC 78 22:55:51.369358 tst ping_idle_ping.py: using CellId 36798 22:55:51.485863 tst ping_idle_ping.py: using BVCI 36799 22:55:51.593104 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:51.603996 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:51.614669 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:51.625345 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:51.635990 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:51.646681 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:51.657553 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:51.668175 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:51.788432 tst ping_idle_ping.py:24: start network... 22:55:52.006554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:52.503889 run create_hlr_db(pid=10600): Launched 22:55:52.627301 bus /gobi_6: Setting Powered False 22:55:53.690442 run create_hlr_db(pid=10600): Terminated: ok {rc=0} 22:55:54.117774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10602): Launched 22:55:54.415797 run osmo-hlr_10.42.42.2(pid=10603): Launched 22:55:54.529784 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:55.060012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10605): Launched 22:55:55.360274 run osmo-stp_10.42.42.5(pid=10606): Launched 22:55:55.473979 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:55.990247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10608): Launched 22:55:56.104358 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:56.356027 run patchelf(pid=10609): Launched 22:55:56.522431 run osmo-stp_10.42.42.5(pid=10606): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10606)] 22:55:56.648108 run osmo-stp_10.42.42.5(pid=10606): stdout: | (launched: 2022-12-13_22:55:55.305527) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:56.775695 run osmo-stp_10.42.42.5(pid=10606): stderr: | 20221213225555479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225555479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225555479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225555480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225555480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225555480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225555480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:56.903174 run osmo-stp_10.42.42.5(pid=10606): stdout: | (launched: 2022-12-13_22:55:55.305527) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:57.024893 run osmo-stp_10.42.42.5(pid=10606): stderr: | 20221213225555479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225555479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225555479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225555480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225555480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225555480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225555480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:57.170135 run patchelf(pid=10609): Terminating (SIGINT) 22:55:57.337298 run patchelf(pid=10609): Terminated: ok {rc=0} 22:55:57.457280 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10606): Process ended prematurely: osmo-stp_10.42.42.5(pid=10606) [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10606)] [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 22:55:57.466074 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:55:57.492763 run osmo-hlr_10.42.42.2(pid=10603): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10603)] 22:55:57.539650 run osmo-hlr_10.42.42.2(pid=10603): stdout: | (launched: 2022-12-13_22:55:54.360843) 22:55:57.588403 run osmo-hlr_10.42.42.2(pid=10603): stderr: | 20221213225554537 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225554537 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225554537 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225554537 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225554537 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225554537 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225554549 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225554558 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225554559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225554559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:57.637602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10602): Terminating (SIGTERM) 22:55:57.676757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10605): Terminating (SIGTERM) 22:55:57.715811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10608): Terminating (SIGTERM) 22:55:57.755230 --- ParallelTerminationStrategy: PID 10602 died... 22:55:57.774273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10602): Terminated: ok {rc=0} 22:55:57.818049 --- ParallelTerminationStrategy: PID 10605 died... 22:55:57.836549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10605): Terminated: ok {rc=0} 22:55:57.879968 --- ParallelTerminationStrategy: PID 10608 died... 22:55:57.898563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10608): Terminated: ok {rc=0} 22:55:57.983528 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:55:59.292736 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:55:59.300070 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:55:59.333880 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:55:59.373276 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:55:59.463146 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:55:59.494781 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:55:59.532495 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:56:00.130561 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:56:00.183703 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:00.195094 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:00.263118 tst cs_paging_gprs_active.py: using LAC 36799 22:56:00.389728 tst cs_paging_gprs_active.py: using RAC 79 22:56:00.509889 tst cs_paging_gprs_active.py: using CellId 36799 22:56:00.630991 tst cs_paging_gprs_active.py: using BVCI 36800 22:56:00.743111 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:00.754170 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:00.764856 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:00.775805 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:00.786874 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:00.798061 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:00.809534 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:00.820613 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:00.840107 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:00.990836 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:01.121845 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:56:01.361658 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:01.679317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10613): Launched 22:56:01.971031 run iperf3-srv_10.42.42.10(pid=10614): Launched 22:56:02.096668 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:56:02.303194 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:02.608528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10615): Launched 22:56:02.873408 run iperf3-srv_10.42.42.10(pid=10616): Launched 22:56:02.995262 tst cs_paging_gprs_active.py:38: start network... 22:56:03.214658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:03.718644 run create_hlr_db(pid=10617): Launched 22:56:03.844155 bus /gobi_6: Setting Powered False 22:56:04.908385 run create_hlr_db(pid=10617): Terminated: ok {rc=0} 22:56:05.360882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10619): Launched 22:56:05.686159 run osmo-hlr_10.42.42.2(pid=10620): Launched 22:56:05.811678 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:06.371935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10622): Launched 22:56:06.697447 run osmo-stp_10.42.42.5(pid=10623): Launched 22:56:06.822550 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:07.383133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10625): Launched 22:56:07.508138 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:07.783943 run patchelf(pid=10626): Launched 22:56:07.965375 run osmo-stp_10.42.42.5(pid=10623): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10623)] 22:56:08.102733 run osmo-stp_10.42.42.5(pid=10623): stdout: | (launched: 2022-12-13_22:56:06.638332) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:08.242239 run osmo-stp_10.42.42.5(pid=10623): stderr: | 20221213225606829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225606829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225606829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225606830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225606832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225606832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225606832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:08.381741 run osmo-stp_10.42.42.5(pid=10623): stdout: | (launched: 2022-12-13_22:56:06.638332) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:08.515429 run osmo-stp_10.42.42.5(pid=10623): stderr: | 20221213225606829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225606829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225606829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225606830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225606832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225606832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225606832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:08.673837 run patchelf(pid=10626): Terminating (SIGINT) 22:56:08.856748 run patchelf(pid=10626): Terminated: ok {rc=0} 22:56:08.988088 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10623): Process ended prematurely: osmo-stp_10.42.42.5(pid=10623) [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10623)] [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:56:08.998262 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 22:56:09.026684 run osmo-hlr_10.42.42.2(pid=10620): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10620)] 22:56:09.077146 run osmo-hlr_10.42.42.2(pid=10620): stdout: | (launched: 2022-12-13_22:56:05.627005) 22:56:09.129092 run osmo-hlr_10.42.42.2(pid=10620): stderr: | 20221213225605826 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225605826 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225605826 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225605826 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225605826 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225605827 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225605840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225605850 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225605850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225605850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:09.181201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10613): Terminating (SIGTERM) 22:56:09.222509 run iperf3-srv_10.42.42.10(pid=10614): Terminating (SIGTERM) 22:56:09.264377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10615): Terminating (SIGTERM) 22:56:09.306684 run iperf3-srv_10.42.42.10(pid=10616): Terminating (SIGTERM) 22:56:09.348855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10619): Terminating (SIGTERM) 22:56:09.390683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10622): Terminating (SIGTERM) 22:56:09.432332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10625): Terminating (SIGTERM) 22:56:09.474501 --- ParallelTerminationStrategy: PID 10613 died... 22:56:09.494772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10613): Terminated: ok {rc=0} 22:56:09.541049 --- ParallelTerminationStrategy: PID 10614 died... 22:56:09.560755 run iperf3-srv_10.42.42.10(pid=10614): Terminated {rc=256} 22:56:09.606725 --- ParallelTerminationStrategy: PID 10615 died... 22:56:09.626539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10615): Terminated: ok {rc=0} 22:56:09.672614 --- ParallelTerminationStrategy: PID 10616 died... 22:56:09.692419 run iperf3-srv_10.42.42.10(pid=10616): Terminated {rc=256} 22:56:09.738464 --- ParallelTerminationStrategy: PID 10619 died... 22:56:09.758137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10619): Terminated: ok {rc=0} 22:56:09.804574 --- ParallelTerminationStrategy: PID 10622 died... 22:56:09.824523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10622): Terminated: ok {rc=0} 22:56:09.870500 --- ParallelTerminationStrategy: PID 10625 died... 22:56:09.890252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10625): Terminated: ok {rc=0} 22:56:09.977670 bus /gobi_0: Setting Powered False 22:56:11.077242 bus /gobi_0: Setting Powered False 22:56:12.188188 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:56:13.336926 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.349156 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:13.420363 tst iperf3.py: using LAC 36800 22:56:13.548403 tst iperf3.py: using RAC 80 22:56:13.675858 tst iperf3.py: using CellId 36800 22:56:13.795975 tst iperf3.py: using BVCI 36801 22:56:13.910087 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.920916 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.931870 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.943044 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.953848 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.964622 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.975578 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.986419 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.997368 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:14.116588 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:56:14.321697 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:14.626686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10627): Launched 22:56:14.891701 run iperf3-srv_10.42.42.10(pid=10628): Launched 22:56:15.005401 tst iperf3.py:8: start network... 22:56:15.208400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:15.679644 run create_hlr_db(pid=10629): Launched 22:56:15.803995 bus /gobi_6: Setting Powered False 22:56:16.863024 run create_hlr_db(pid=10629): Terminated: ok {rc=0} 22:56:17.290839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10631): Launched 22:56:17.594252 run osmo-hlr_10.42.42.2(pid=10632): Launched 22:56:17.710599 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:18.230837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10634): Launched 22:56:18.532092 run osmo-stp_10.42.42.5(pid=10635): Launched 22:56:18.648260 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:19.172368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10637): Launched 22:56:19.288619 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:19.545461 run patchelf(pid=10638): Launched 22:56:19.713989 run osmo-stp_10.42.42.5(pid=10635): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10635)] 22:56:19.841370 run osmo-stp_10.42.42.5(pid=10635): stdout: | (launched: 2022-12-13_22:56:18.476536) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:19.970109 run osmo-stp_10.42.42.5(pid=10635): stderr: | 20221213225618647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225618647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225618647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225618648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225618648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225618649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225618649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:20.099131 run osmo-stp_10.42.42.5(pid=10635): stdout: | (launched: 2022-12-13_22:56:18.476536) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:20.222833 run osmo-stp_10.42.42.5(pid=10635): stderr: | 20221213225618647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225618647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225618647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225618648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225618648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225618649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225618649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:20.368901 run patchelf(pid=10638): Terminating (SIGINT) 22:56:20.538487 run patchelf(pid=10638): Terminated: ok {rc=0} 22:56:20.660798 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10635): Process ended prematurely: osmo-stp_10.42.42.5(pid=10635) [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10635)] [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 22:56:20.670288 tst iperf3.py:8: Test FAILED (7.4 sec) 22:56:20.697510 run osmo-hlr_10.42.42.2(pid=10632): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10632)] 22:56:20.744689 run osmo-hlr_10.42.42.2(pid=10632): stdout: | (launched: 2022-12-13_22:56:17.538640) 22:56:20.793499 run osmo-hlr_10.42.42.2(pid=10632): stderr: | 20221213225617717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225617717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225617717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225617717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225617717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225617717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225617730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225617739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225617739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225617739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:20.842602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10627): Terminating (SIGTERM) 22:56:20.881545 run iperf3-srv_10.42.42.10(pid=10628): Terminating (SIGTERM) 22:56:20.920411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10631): Terminating (SIGTERM) 22:56:20.959334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10634): Terminating (SIGTERM) 22:56:20.998476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10637): Terminating (SIGTERM) 22:56:21.037967 --- ParallelTerminationStrategy: PID 10627 died... 22:56:21.057171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10627): Terminated: ok {rc=0} 22:56:21.102609 --- ParallelTerminationStrategy: PID 10628 died... 22:56:21.124304 run iperf3-srv_10.42.42.10(pid=10628): Terminated {rc=256} 22:56:21.186738 --- ParallelTerminationStrategy: PID 10631 died... 22:56:21.206283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10631): Terminated: ok {rc=0} 22:56:21.250132 --- ParallelTerminationStrategy: PID 10634 died... 22:56:21.268761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10634): Terminated: ok {rc=0} 22:56:21.321100 --- ParallelTerminationStrategy: PID 10637 died... 22:56:21.341479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10637): Terminated: ok {rc=0} 22:56:21.430522 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:56:22.575846 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:22.587348 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:22.655303 tst iperf3m4.py: using LAC 36801 22:56:22.775565 tst iperf3m4.py: using RAC 81 22:56:22.896574 tst iperf3m4.py: using CellId 36801 22:56:23.017246 tst iperf3m4.py: using BVCI 36802 22:56:23.128091 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.139076 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.149790 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.160531 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.171277 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.182038 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.192741 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.203369 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:23.214188 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:23.329795 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:23.452687 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:23.574538 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:23.690889 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:56:23.894945 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:24.200595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10643): Launched 22:56:24.465598 run iperf3-srv_10.42.42.10(pid=10644): Launched 22:56:24.579540 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:56:24.782387 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:25.087731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10645): Launched 22:56:25.351889 run iperf3-srv_10.42.42.10(pid=10646): Launched 22:56:25.466449 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:56:25.669003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:25.973272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10647): Launched 22:56:26.241712 run iperf3-srv_10.42.42.10(pid=10648): Launched 22:56:26.364851 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:56:26.584860 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:26.912858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10649): Launched 22:56:27.195909 run iperf3-srv_10.42.42.10(pid=10650): Launched 22:56:27.318215 tst iperf3m4.py:8: start network... 22:56:27.538747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:28.043164 run create_hlr_db(pid=10651): Launched 22:56:28.168253 bus /gobi_6: Setting Powered False 22:56:29.232053 run create_hlr_db(pid=10651): Terminated: ok {rc=0} 22:56:29.666241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10653): Launched 22:56:29.970508 run osmo-hlr_10.42.42.2(pid=10654): Launched 22:56:30.086477 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:30.626788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10656): Launched 22:56:30.949721 run osmo-stp_10.42.42.5(pid=10657): Launched 22:56:31.221969 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:31.909869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10659): Launched 22:56:32.031413 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:32.311590 run patchelf(pid=10660): Launched 22:56:32.485740 run osmo-stp_10.42.42.5(pid=10657): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10657)] 22:56:32.613824 run osmo-stp_10.42.42.5(pid=10657): stdout: | (launched: 2022-12-13_22:56:30.876043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:32.743460 run osmo-stp_10.42.42.5(pid=10657): stderr: | 20221213225631195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225631195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225631195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225631199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225631200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225631200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225631200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:32.872685 run osmo-stp_10.42.42.5(pid=10657): stdout: | (launched: 2022-12-13_22:56:30.876043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:32.996425 run osmo-stp_10.42.42.5(pid=10657): stderr: | 20221213225631195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225631195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225631195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225631199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225631200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225631200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225631200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:33.143236 run patchelf(pid=10660): Terminating (SIGINT) 22:56:33.312661 run patchelf(pid=10660): Terminated: ok {rc=0} 22:56:33.435793 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10657): Process ended prematurely: osmo-stp_10.42.42.5(pid=10657) [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10657)] [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:56:33.445497 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:56:33.472867 run osmo-hlr_10.42.42.2(pid=10654): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10654)] 22:56:33.521048 run osmo-hlr_10.42.42.2(pid=10654): stdout: | (launched: 2022-12-13_22:56:29.914656) 22:56:33.570199 run osmo-hlr_10.42.42.2(pid=10654): stderr: | 20221213225630093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225630093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225630093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225630093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225630093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225630093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225630104 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225630113 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225630113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225630113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:33.619685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10643): Terminating (SIGTERM) 22:56:33.659201 run iperf3-srv_10.42.42.10(pid=10644): Terminating (SIGTERM) 22:56:33.698631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10645): Terminating (SIGTERM) 22:56:33.737993 run iperf3-srv_10.42.42.10(pid=10646): Terminating (SIGTERM) 22:56:33.777275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10647): Terminating (SIGTERM) 22:56:33.816868 run iperf3-srv_10.42.42.10(pid=10648): Terminating (SIGTERM) 22:56:33.856305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10649): Terminating (SIGTERM) 22:56:33.895762 run iperf3-srv_10.42.42.10(pid=10650): Terminating (SIGTERM) 22:56:33.934961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10653): Terminating (SIGTERM) 22:56:33.974319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10656): Terminating (SIGTERM) 22:56:34.013631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10659): Terminating (SIGTERM) 22:56:34.053454 --- ParallelTerminationStrategy: PID 10643 died... 22:56:34.072480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10643): Terminated: ok {rc=0} 22:56:34.116124 --- ParallelTerminationStrategy: PID 10644 died... 22:56:34.134764 run iperf3-srv_10.42.42.10(pid=10644): Terminated {rc=256} 22:56:34.178217 --- ParallelTerminationStrategy: PID 10645 died... 22:56:34.196711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10645): Terminated: ok {rc=0} 22:56:34.240509 --- ParallelTerminationStrategy: PID 10646 died... 22:56:34.259154 run iperf3-srv_10.42.42.10(pid=10646): Terminated {rc=256} 22:56:34.302634 --- ParallelTerminationStrategy: PID 10647 died... 22:56:34.321228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10647): Terminated: ok {rc=0} 22:56:34.365492 --- ParallelTerminationStrategy: PID 10648 died... 22:56:34.384095 run iperf3-srv_10.42.42.10(pid=10648): Terminated {rc=256} 22:56:34.427762 --- ParallelTerminationStrategy: PID 10649 died... 22:56:34.446478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10649): Terminated: ok {rc=0} 22:56:34.490081 --- ParallelTerminationStrategy: PID 10650 died... 22:56:34.508626 run iperf3-srv_10.42.42.10(pid=10650): Terminated {rc=256} 22:56:34.552332 --- ParallelTerminationStrategy: PID 10653 died... 22:56:34.571102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10653): Terminated: ok {rc=0} 22:56:34.614767 --- ParallelTerminationStrategy: PID 10656 died... 22:56:34.633420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10656): Terminated: ok {rc=0} 22:56:34.677068 --- ParallelTerminationStrategy: PID 10659 died... 22:56:34.695744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10659): Terminated: ok {rc=0} 22:56:34.781375 bus /gobi_4: Setting Powered False 22:56:35.881769 bus /gobi_4: Setting Powered False 22:56:36.996883 bus /gobi_1: Setting Powered False 22:56:38.093733 bus /gobi_1: Setting Powered False 22:56:39.205424 bus /gobi_0: Setting Powered False 22:56:40.303402 bus /gobi_0: Setting Powered False 22:56:41.421256 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:56:42.523495 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:42.535648 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:42.605410 tst ping.py: using LAC 36802 22:56:42.735437 tst ping.py: using RAC 82 22:56:42.851862 tst ping.py: using CellId 36802 22:56:42.967329 tst ping.py: using BVCI 36803 22:56:43.074989 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:43.086107 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:43.096889 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:43.107660 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:43.118426 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:43.129281 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:43.140089 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:43.150890 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:43.264568 tst ping.py:19: start network... 22:56:43.462903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:43.923374 run create_hlr_db(pid=10661): Launched 22:56:44.045899 bus /gobi_6: Setting Powered False 22:56:45.106249 run create_hlr_db(pid=10661): Terminated: ok {rc=0} 22:56:45.543966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10663): Launched 22:56:45.908437 run osmo-hlr_10.42.42.2(pid=10664): Launched 22:56:46.179660 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:46.851846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10666): Launched 22:56:47.189353 run osmo-stp_10.42.42.5(pid=10667): Launched 22:56:47.359052 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:47.875585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10669): Launched 22:56:47.989682 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:48.241700 run patchelf(pid=10670): Launched 22:56:48.407346 run osmo-stp_10.42.42.5(pid=10667): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10667)] 22:56:48.532819 run osmo-stp_10.42.42.5(pid=10667): stdout: | (launched: 2022-12-13_22:56:47.125813) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:48.660061 run osmo-stp_10.42.42.5(pid=10667): stderr: | 20221213225647352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225647353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225647353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225647353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225647354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225647354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225647354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:48.787267 run osmo-stp_10.42.42.5(pid=10667): stdout: | (launched: 2022-12-13_22:56:47.125813) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:48.909298 run osmo-stp_10.42.42.5(pid=10667): stderr: | 20221213225647352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225647353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225647353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225647353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225647354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225647354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225647354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:49.053513 run patchelf(pid=10670): Terminating (SIGINT) 22:56:49.221080 run patchelf(pid=10670): Terminated: ok {rc=0} 22:56:49.341596 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10667): Process ended prematurely: osmo-stp_10.42.42.5(pid=10667) [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10667)] [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 22:56:49.350450 tst ping.py:22: Test FAILED (6.8 sec) 22:56:49.377312 run osmo-hlr_10.42.42.2(pid=10664): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10664)] 22:56:49.424722 run osmo-hlr_10.42.42.2(pid=10664): stdout: | (launched: 2022-12-13_22:56:45.806628) 22:56:49.473796 run osmo-hlr_10.42.42.2(pid=10664): stderr: | 20221213225646237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225646238 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225646238 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225646238 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225646238 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225646240 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225646265 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225646280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225646280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225646280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:49.523357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10663): Terminating (SIGTERM) 22:56:49.563477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10666): Terminating (SIGTERM) 22:56:49.603149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10669): Terminating (SIGTERM) 22:56:49.642969 --- ParallelTerminationStrategy: PID 10663 died... 22:56:49.662240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10663): Terminated: ok {rc=0} 22:56:49.706311 --- ParallelTerminationStrategy: PID 10666 died... 22:56:49.726093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10666): Terminated: ok {rc=0} 22:56:49.770003 --- ParallelTerminationStrategy: PID 10669 died... 22:56:49.788709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10669): Terminated: ok {rc=0} 22:56:49.874910 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:56:50.964506 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:50.976424 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:51.044908 tst ping_idle_ping.py: using LAC 36803 22:56:51.164378 tst ping_idle_ping.py: using RAC 83 22:56:51.283435 tst ping_idle_ping.py: using CellId 36803 22:56:51.402686 tst ping_idle_ping.py: using BVCI 36804 22:56:51.512869 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:51.523906 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:51.534645 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:51.545401 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:51.556040 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:51.567167 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:51.578156 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:51.589032 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:51.706547 tst ping_idle_ping.py:24: start network... 22:56:51.907097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:52.372998 run create_hlr_db(pid=10671): Launched 22:56:52.495727 bus /gobi_6: Setting Powered False 22:56:53.555515 run create_hlr_db(pid=10671): Terminated: ok {rc=0} 22:56:53.975274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10673): Launched 22:56:54.274652 run osmo-hlr_10.42.42.2(pid=10674): Launched 22:56:54.388553 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:54.917062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10676): Launched 22:56:55.215603 run osmo-stp_10.42.42.5(pid=10677): Launched 22:56:55.330418 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:55.847117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10679): Launched 22:56:55.961306 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:56.213310 run patchelf(pid=10680): Launched 22:56:56.379767 run osmo-stp_10.42.42.5(pid=10677): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10677)] 22:56:56.505900 run osmo-stp_10.42.42.5(pid=10677): stdout: | (launched: 2022-12-13_22:56:55.160448) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:56.633580 run osmo-stp_10.42.42.5(pid=10677): stderr: | 20221213225655329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225655330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225655330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225655330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225655331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225655331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225655331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:56.761123 run osmo-stp_10.42.42.5(pid=10677): stdout: | (launched: 2022-12-13_22:56:55.160448) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:56.883287 run osmo-stp_10.42.42.5(pid=10677): stderr: | 20221213225655329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225655330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225655330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225655330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225655331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225655331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225655331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:57.027735 run patchelf(pid=10680): Terminating (SIGINT) 22:56:57.195030 run patchelf(pid=10680): Terminated: ok {rc=0} 22:56:57.315339 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10677): Process ended prematurely: osmo-stp_10.42.42.5(pid=10677) [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10677)] [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:56:57.324306 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:56:57.351292 run osmo-hlr_10.42.42.2(pid=10674): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10674)] 22:56:57.398739 run osmo-hlr_10.42.42.2(pid=10674): stdout: | (launched: 2022-12-13_22:56:54.219419) 22:56:57.447852 run osmo-hlr_10.42.42.2(pid=10674): stderr: | 20221213225654399 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225654399 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225654399 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225654399 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225654399 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225654399 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225654412 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225654420 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225654421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225654421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:57.497411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10673): Terminating (SIGTERM) 22:56:57.536907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10676): Terminating (SIGTERM) 22:56:57.576593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10679): Terminating (SIGTERM) 22:56:57.616814 --- ParallelTerminationStrategy: PID 10673 died... 22:56:57.636120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10673): Terminated: ok {rc=0} 22:56:57.679789 --- ParallelTerminationStrategy: PID 10676 died... 22:56:57.698318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10676): Terminated: ok {rc=0} 22:56:57.741761 --- ParallelTerminationStrategy: PID 10679 died... 22:56:57.760223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10679): Terminated: ok {rc=0} 22:56:57.843601 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:56:59.160412 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:56:59.170311 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:56:59.204739 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 22:56:59.243847 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 22:56:59.330653 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:56:59.363596 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 22:56:59.403846 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 22:57:00.007179 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 22:57:00.059118 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:00.070811 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:57:00.119615 tst cs_paging_gprs_active.py: using LAC 36804 22:57:00.236602 tst cs_paging_gprs_active.py: using RAC 84 22:57:00.353263 tst cs_paging_gprs_active.py: using CellId 36804 22:57:00.469267 tst cs_paging_gprs_active.py: using BVCI 36805 22:57:00.578338 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:00.590041 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:00.601204 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:00.612309 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:00.624071 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:00.635774 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:00.647595 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:00.659234 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:00.671255 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:00.792453 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:00.919395 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:57:01.170755 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:01.507806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10684): Launched 22:57:01.808942 run iperf3-srv_10.42.42.10(pid=10685): Launched 22:57:01.948136 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:57:02.169354 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:02.491542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10686): Launched 22:57:02.769717 run iperf3-srv_10.42.42.10(pid=10687): Launched 22:57:02.890314 tst cs_paging_gprs_active.py:38: start network... 22:57:03.105276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:03.625544 run create_hlr_db(pid=10688): Launched 22:57:03.751938 bus /gobi_6: Setting Powered False 22:57:04.812911 run create_hlr_db(pid=10688): Terminated: ok {rc=0} 22:57:05.251874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10690): Launched 22:57:05.572462 run osmo-hlr_10.42.42.2(pid=10691): Launched 22:57:05.695389 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:06.250107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10693): Launched 22:57:06.570342 run osmo-stp_10.42.42.5(pid=10694): Launched 22:57:06.694237 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:07.248484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10696): Launched 22:57:07.371698 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:07.642376 run patchelf(pid=10697): Launched 22:57:07.821224 run osmo-stp_10.42.42.5(pid=10694): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10694)] 22:57:07.957056 run osmo-stp_10.42.42.5(pid=10694): stdout: | (launched: 2022-12-13_22:57:06.512496) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:08.094681 run osmo-stp_10.42.42.5(pid=10694): stderr: | 20221213225706703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225706703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225706703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225706703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225706706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225706706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225706706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:08.231895 run osmo-stp_10.42.42.5(pid=10694): stdout: | (launched: 2022-12-13_22:57:06.512496) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:08.363418 run osmo-stp_10.42.42.5(pid=10694): stderr: | 20221213225706703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225706703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225706703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225706703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225706706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225706706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225706706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:08.519362 run patchelf(pid=10697): Terminating (SIGINT) 22:57:08.698775 run patchelf(pid=10697): Terminated: ok {rc=0} 22:57:08.828854 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10694): Process ended prematurely: osmo-stp_10.42.42.5(pid=10694) [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10694)] [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 22:57:08.839268 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 22:57:08.867707 run osmo-hlr_10.42.42.2(pid=10691): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10691)] 22:57:08.918716 run osmo-hlr_10.42.42.2(pid=10691): stdout: | (launched: 2022-12-13_22:57:05.514733) 22:57:08.970992 run osmo-hlr_10.42.42.2(pid=10691): stderr: | 20221213225705714 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225705714 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225705714 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225705714 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225705714 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225705714 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225705726 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225705736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225705737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225705737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:09.023305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10684): Terminating (SIGTERM) 22:57:09.065201 run iperf3-srv_10.42.42.10(pid=10685): Terminating (SIGTERM) 22:57:09.107036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10686): Terminating (SIGTERM) 22:57:09.150006 run iperf3-srv_10.42.42.10(pid=10687): Terminating (SIGTERM) 22:57:09.191958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10690): Terminating (SIGTERM) 22:57:09.234260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10693): Terminating (SIGTERM) 22:57:09.276161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10696): Terminating (SIGTERM) 22:57:09.319014 --- ParallelTerminationStrategy: PID 10684 died... 22:57:09.339781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10684): Terminated: ok {rc=0} 22:57:09.386142 --- ParallelTerminationStrategy: PID 10685 died... 22:57:09.405936 run iperf3-srv_10.42.42.10(pid=10685): Terminated {rc=256} 22:57:09.451775 --- ParallelTerminationStrategy: PID 10686 died... 22:57:09.471365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10686): Terminated: ok {rc=0} 22:57:09.517316 --- ParallelTerminationStrategy: PID 10687 died... 22:57:09.536754 run iperf3-srv_10.42.42.10(pid=10687): Terminated {rc=256} 22:57:09.582664 --- ParallelTerminationStrategy: PID 10690 died... 22:57:09.602451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10690): Terminated: ok {rc=0} 22:57:09.648683 --- ParallelTerminationStrategy: PID 10693 died... 22:57:09.668378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10693): Terminated: ok {rc=0} 22:57:09.714392 --- ParallelTerminationStrategy: PID 10696 died... 22:57:09.734276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10696): Terminated: ok {rc=0} 22:57:09.822974 bus /gobi_0: Setting Powered False 22:57:10.920462 bus /gobi_0: Setting Powered False 22:57:12.036478 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 22:57:13.186584 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:13.198978 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:57:13.251249 tst iperf3.py: using LAC 36805 22:57:13.383240 tst iperf3.py: using RAC 85 22:57:13.506803 tst iperf3.py: using CellId 36805 22:57:13.630152 tst iperf3.py: using BVCI 36806 22:57:13.747204 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:13.759306 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:13.771165 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:13.783031 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:13.795718 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:13.808555 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:13.821299 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:13.833842 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:13.846632 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:13.968470 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:57:14.168842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:14.467616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10698): Launched 22:57:14.727987 run iperf3-srv_10.42.42.10(pid=10699): Launched 22:57:14.839934 tst iperf3.py:8: start network... 22:57:15.038545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:15.503071 run create_hlr_db(pid=10700): Launched 22:57:15.626249 bus /gobi_6: Setting Powered False 22:57:16.705135 run create_hlr_db(pid=10700): Terminated: ok {rc=0} 22:57:17.224303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10702): Launched 22:57:17.530204 run osmo-hlr_10.42.42.2(pid=10703): Launched 22:57:17.643442 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:18.157382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10705): Launched 22:57:18.454292 run osmo-stp_10.42.42.5(pid=10706): Launched 22:57:18.568263 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:19.083843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10708): Launched 22:57:19.198914 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:19.451370 run patchelf(pid=10709): Launched 22:57:19.617906 run osmo-stp_10.42.42.5(pid=10706): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10706)] 22:57:19.744425 run osmo-stp_10.42.42.5(pid=10706): stdout: | (launched: 2022-12-13_22:57:18.400156) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:19.873604 run osmo-stp_10.42.42.5(pid=10706): stderr: | 20221213225718569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225718569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225718570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225718570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225718572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225718572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225718572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:20.001845 run osmo-stp_10.42.42.5(pid=10706): stdout: | (launched: 2022-12-13_22:57:18.400156) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:20.124196 run osmo-stp_10.42.42.5(pid=10706): stderr: | 20221213225718569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225718569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225718570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225718570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225718572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225718572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225718572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:20.268942 run patchelf(pid=10709): Terminating (SIGINT) 22:57:20.437124 run patchelf(pid=10709): Terminated: ok {rc=0} 22:57:20.557700 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10706): Process ended prematurely: osmo-stp_10.42.42.5(pid=10706) [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10706)] [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 22:57:20.567105 tst iperf3.py:8: Test FAILED (7.4 sec) 22:57:20.593909 run osmo-hlr_10.42.42.2(pid=10703): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10703)] 22:57:20.641255 run osmo-hlr_10.42.42.2(pid=10703): stdout: | (launched: 2022-12-13_22:57:17.475703) 22:57:20.690177 run osmo-hlr_10.42.42.2(pid=10703): stderr: | 20221213225717652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225717652 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225717652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225717652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225717652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225717652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225717664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225717672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225717673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225717673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:20.739617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10698): Terminating (SIGTERM) 22:57:20.778656 run iperf3-srv_10.42.42.10(pid=10699): Terminating (SIGTERM) 22:57:20.817760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10702): Terminating (SIGTERM) 22:57:20.856817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10705): Terminating (SIGTERM) 22:57:20.895869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10708): Terminating (SIGTERM) 22:57:20.935026 --- ParallelTerminationStrategy: PID 10698 died... 22:57:20.953806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10698): Terminated: ok {rc=0} 22:57:20.997111 --- ParallelTerminationStrategy: PID 10699 died... 22:57:21.015347 run iperf3-srv_10.42.42.10(pid=10699): Terminated {rc=256} 22:57:21.058201 --- ParallelTerminationStrategy: PID 10702 died... 22:57:21.076499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10702): Terminated: ok {rc=0} 22:57:21.120499 --- ParallelTerminationStrategy: PID 10705 died... 22:57:21.138915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10705): Terminated: ok {rc=0} 22:57:21.182050 --- ParallelTerminationStrategy: PID 10708 died... 22:57:21.200396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10708): Terminated: ok {rc=0} 22:57:21.289690 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 22:57:22.435647 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:22.447513 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:57:22.499814 tst iperf3m4.py: using LAC 36806 22:57:22.616670 tst iperf3m4.py: using RAC 86 22:57:22.733893 tst iperf3m4.py: using CellId 36806 22:57:22.850573 tst iperf3m4.py: using BVCI 36807 22:57:22.960589 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:22.971912 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:22.983050 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:22.994209 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:23.005378 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:23.016437 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:23.027685 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:23.038787 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:23.050162 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:23.166339 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:23.287899 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:23.406669 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:23.526180 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:57:23.745055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:24.067623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10710): Launched 22:57:24.346915 run iperf3-srv_10.42.42.10(pid=10711): Launched 22:57:24.468074 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:57:24.684417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:25.006601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10712): Launched 22:57:25.285782 run iperf3-srv_10.42.42.10(pid=10713): Launched 22:57:25.406256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:57:25.622313 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:25.944169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10714): Launched 22:57:26.223834 run iperf3-srv_10.42.42.10(pid=10715): Launched 22:57:26.344674 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:57:26.560823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:26.882349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10716): Launched 22:57:27.162265 run iperf3-srv_10.42.42.10(pid=10717): Launched 22:57:27.282134 tst iperf3m4.py:8: start network... 22:57:27.497724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:27.995397 run create_hlr_db(pid=10718): Launched 22:57:28.117678 bus /gobi_6: Setting Powered False 22:57:29.181605 run create_hlr_db(pid=10718): Terminated: ok {rc=0} 22:57:29.611078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10720): Launched 22:57:29.911195 run osmo-hlr_10.42.42.2(pid=10721): Launched 22:57:30.025379 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:30.555924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10723): Launched 22:57:30.860696 run osmo-stp_10.42.42.5(pid=10724): Launched 22:57:31.050033 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:31.757840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10726): Launched 22:57:31.921562 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:32.214804 run patchelf(pid=10727): Launched 22:57:32.410516 run osmo-stp_10.42.42.5(pid=10724): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10724)] 22:57:32.547782 run osmo-stp_10.42.42.5(pid=10724): stdout: | (launched: 2022-12-13_22:57:30.801845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:32.686021 run osmo-stp_10.42.42.5(pid=10724): stderr: | 20221213225731165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225731165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225731166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225731166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225731168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225731168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225731169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:32.824585 run osmo-stp_10.42.42.5(pid=10724): stdout: | (launched: 2022-12-13_22:57:30.801845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:32.956753 run osmo-stp_10.42.42.5(pid=10724): stderr: | 20221213225731165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225731165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225731166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225731166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225731168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225731168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225731169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:33.113688 run patchelf(pid=10727): Terminating (SIGINT) 22:57:33.293844 run patchelf(pid=10727): Terminated: ok {rc=0} 22:57:33.424075 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10724): Process ended prematurely: osmo-stp_10.42.42.5(pid=10724) [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10724)] [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 22:57:33.434521 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:57:33.463380 run osmo-hlr_10.42.42.2(pid=10721): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10721)] 22:57:33.514271 run osmo-hlr_10.42.42.2(pid=10721): stdout: | (launched: 2022-12-13_22:57:29.855928) 22:57:33.566548 run osmo-hlr_10.42.42.2(pid=10721): stderr: | 20221213225730030 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225730030 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225730030 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225730030 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225730030 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225730031 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225730043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225730053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225730053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225730053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:33.619719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10710): Terminating (SIGTERM) 22:57:33.661462 run iperf3-srv_10.42.42.10(pid=10711): Terminating (SIGTERM) 22:57:33.703507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10712): Terminating (SIGTERM) 22:57:33.746295 run iperf3-srv_10.42.42.10(pid=10713): Terminating (SIGTERM) 22:57:33.788601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10714): Terminating (SIGTERM) 22:57:33.831425 run iperf3-srv_10.42.42.10(pid=10715): Terminating (SIGTERM) 22:57:33.873435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10716): Terminating (SIGTERM) 22:57:33.915712 run iperf3-srv_10.42.42.10(pid=10717): Terminating (SIGTERM) 22:57:33.957455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10720): Terminating (SIGTERM) 22:57:33.999364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10723): Terminating (SIGTERM) 22:57:34.040930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10726): Terminating (SIGTERM) 22:57:34.083116 --- ParallelTerminationStrategy: PID 10710 died... 22:57:34.102996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10710): Terminated: ok {rc=0} 22:57:34.149360 --- ParallelTerminationStrategy: PID 10711 died... 22:57:34.169118 run iperf3-srv_10.42.42.10(pid=10711): Terminated {rc=256} 22:57:34.215160 --- ParallelTerminationStrategy: PID 10712 died... 22:57:34.234882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10712): Terminated: ok {rc=0} 22:57:34.280939 --- ParallelTerminationStrategy: PID 10713 died... 22:57:34.300491 run iperf3-srv_10.42.42.10(pid=10713): Terminated {rc=256} 22:57:34.347113 --- ParallelTerminationStrategy: PID 10714 died... 22:57:34.366995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10714): Terminated: ok {rc=0} 22:57:34.413239 --- ParallelTerminationStrategy: PID 10715 died... 22:57:34.432919 run iperf3-srv_10.42.42.10(pid=10715): Terminated {rc=256} 22:57:34.479106 --- ParallelTerminationStrategy: PID 10716 died... 22:57:34.498892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10716): Terminated: ok {rc=0} 22:57:34.545199 --- ParallelTerminationStrategy: PID 10717 died... 22:57:34.565068 run iperf3-srv_10.42.42.10(pid=10717): Terminated {rc=256} 22:57:34.611164 --- ParallelTerminationStrategy: PID 10720 died... 22:57:34.631098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10720): Terminated: ok {rc=0} 22:57:34.677565 --- ParallelTerminationStrategy: PID 10723 died... 22:57:34.697462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10723): Terminated: ok {rc=0} 22:57:34.743685 --- ParallelTerminationStrategy: PID 10726 died... 22:57:34.763702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10726): Terminated: ok {rc=0} 22:57:34.853090 bus /gobi_4: Setting Powered False 22:57:35.952990 bus /gobi_4: Setting Powered False 22:57:37.069531 bus /gobi_1: Setting Powered False 22:57:38.168445 bus /gobi_1: Setting Powered False 22:57:39.287048 bus /gobi_0: Setting Powered False 22:57:40.383948 bus /gobi_0: Setting Powered False 22:57:41.497888 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 22:57:42.600494 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:42.612891 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:57:42.665277 tst ping.py: using LAC 36807 22:57:42.789599 tst ping.py: using RAC 87 22:57:42.906429 tst ping.py: using CellId 36807 22:57:43.024085 tst ping.py: using BVCI 36808 22:57:43.130800 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:43.142414 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:43.153722 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:43.164803 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:43.175848 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:43.186948 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:43.198237 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:43.209423 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:43.322675 tst ping.py:19: start network... 22:57:43.519110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:43.976098 run create_hlr_db(pid=10728): Launched 22:57:44.097966 bus /gobi_6: Setting Powered False 22:57:45.157786 run create_hlr_db(pid=10728): Terminated: ok {rc=0} 22:57:45.590915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10730): Launched 22:57:45.921688 run osmo-hlr_10.42.42.2(pid=10731): Launched 22:57:46.122001 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:46.881874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10733): Launched 22:57:47.195914 run osmo-stp_10.42.42.5(pid=10734): Launched 22:57:47.345510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:47.895654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10736): Launched 22:57:48.017195 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:48.284088 run patchelf(pid=10737): Launched 22:57:48.460482 run osmo-stp_10.42.42.5(pid=10734): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10734)] 22:57:48.594546 run osmo-stp_10.42.42.5(pid=10734): stdout: | (launched: 2022-12-13_22:57:47.133093) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:48.730234 run osmo-stp_10.42.42.5(pid=10734): stderr: | 20221213225747399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225747399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225747399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225747400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225747402 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225747403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225747403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:48.866413 run osmo-stp_10.42.42.5(pid=10734): stdout: | (launched: 2022-12-13_22:57:47.133093) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:48.996611 run osmo-stp_10.42.42.5(pid=10734): stderr: | 20221213225747399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225747399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225747399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225747400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225747402 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225747403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225747403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:49.150718 run patchelf(pid=10737): Terminating (SIGINT) 22:57:49.327517 run patchelf(pid=10737): Terminated: ok {rc=0} 22:57:49.455023 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10734): Process ended prematurely: osmo-stp_10.42.42.5(pid=10734) [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10734)] [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 22:57:49.464488 tst ping.py:22: Test FAILED (6.9 sec) 22:57:49.492823 run osmo-hlr_10.42.42.2(pid=10731): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10731)] 22:57:49.544078 run osmo-hlr_10.42.42.2(pid=10731): stdout: | (launched: 2022-12-13_22:57:45.852758) 22:57:49.596710 run osmo-hlr_10.42.42.2(pid=10731): stderr: | 20221213225746246 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225746246 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225746246 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225746246 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225746246 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225746246 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225746270 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225746296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225746296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225746296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:49.649630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10730): Terminating (SIGTERM) 22:57:49.691357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10733): Terminating (SIGTERM) 22:57:49.734016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10736): Terminating (SIGTERM) 22:57:49.776677 --- ParallelTerminationStrategy: PID 10730 died... 22:57:49.797115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10730): Terminated: ok {rc=0} 22:57:49.844103 --- ParallelTerminationStrategy: PID 10733 died... 22:57:49.864065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10733): Terminated: ok {rc=0} 22:57:49.910663 --- ParallelTerminationStrategy: PID 10736 died... 22:57:49.930683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10736): Terminated: ok {rc=0} 22:57:50.019305 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 22:57:51.106745 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:51.119363 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:57:51.171207 tst ping_idle_ping.py: using LAC 36808 22:57:51.296674 tst ping_idle_ping.py: using RAC 88 22:57:51.419364 tst ping_idle_ping.py: using CellId 36808 22:57:51.544261 tst ping_idle_ping.py: using BVCI 36809 22:57:51.658972 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:51.671017 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:51.682797 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:51.694426 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:51.706332 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:51.718394 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:51.730457 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:57:51.742451 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:57:51.862625 tst ping_idle_ping.py:24: start network... 22:57:52.076922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:52.569553 run create_hlr_db(pid=10738): Launched 22:57:52.691098 bus /gobi_6: Setting Powered False 22:57:53.753647 run create_hlr_db(pid=10738): Terminated: ok {rc=0} 22:57:54.178707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10740): Launched 22:57:54.476018 run osmo-hlr_10.42.42.2(pid=10741): Launched 22:57:54.591014 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:55.102580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10743): Launched 22:57:55.399043 run osmo-stp_10.42.42.5(pid=10744): Launched 22:57:55.514047 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:56.026951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10746): Launched 22:57:56.141362 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:56.392234 run patchelf(pid=10747): Launched 22:57:56.557668 run osmo-stp_10.42.42.5(pid=10744): ERR: Terminated: ERROR {rc=1} [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10744)] 22:57:56.683676 run osmo-stp_10.42.42.5(pid=10744): stdout: | (launched: 2022-12-13_22:57:55.344733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:56.811585 run osmo-stp_10.42.42.5(pid=10744): stderr: | 20221213225755515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225755515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225755515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225755516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225755516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225755516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225755516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:56.939315 run osmo-stp_10.42.42.5(pid=10744): stdout: | (launched: 2022-12-13_22:57:55.344733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:57.061815 run osmo-stp_10.42.42.5(pid=10744): stderr: | 20221213225755515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225755515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225755515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225755516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225755516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225755516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225755516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:57.206679 run patchelf(pid=10747): Terminating (SIGINT) 22:57:57.373220 run patchelf(pid=10747): Terminated: ok {rc=0} 22:57:57.493194 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10744): Process ended prematurely: osmo-stp_10.42.42.5(pid=10744) [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10744)] [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 22:57:57.502093 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:57:57.528890 run osmo-hlr_10.42.42.2(pid=10741): ERR: Terminated: ERROR {rc=237} [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10741)] 22:57:57.577825 run osmo-hlr_10.42.42.2(pid=10741): stdout: | (launched: 2022-12-13_22:57:54.421905) 22:57:57.627583 run osmo-hlr_10.42.42.2(pid=10741): stderr: | 20221213225754599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225754599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225754599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225754599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225754599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225754599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225754611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225754620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225754620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225754620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:57.677673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10740): Terminating (SIGTERM) 22:57:57.717935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10743): Terminating (SIGTERM) 22:57:57.758233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10746): Terminating (SIGTERM) 22:57:57.798826 --- ParallelTerminationStrategy: PID 10740 died... 22:57:57.818588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10740): Terminated: ok {rc=0} 22:57:57.862970 --- ParallelTerminationStrategy: PID 10743 died... 22:57:57.882079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10743): Terminated: ok {rc=0} 22:57:57.926401 --- ParallelTerminationStrategy: PID 10746 died... 22:57:57.945576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10746): Terminated: ok {rc=0} 22:57:58.032086 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 22:57:59.349629 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:57:59.356719 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:57:59.388185 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:57:59.422089 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:57:59.475153 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:57:59.506990 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:57:59.540665 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:58:00.101302 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2395 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:58:00.106682 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:00.118258 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:58:00.185035 tst switch_tch_pdch.py: using LAC 36809 22:58:00.304102 tst switch_tch_pdch.py: using RAC 89 22:58:00.420077 tst switch_tch_pdch.py: using CellId 36809 22:58:00.534149 tst switch_tch_pdch.py: using BVCI 36810 22:58:00.641190 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:00.652606 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:00.664015 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:00.675225 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:00.686474 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:00.697794 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:00.709262 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:00.720755 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:58:00.845965 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:58:00.983566 tst switch_tch_pdch.py:51: start network... 22:58:01.208254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:01.716086 run create_hlr_db(pid=10753): Launched 22:58:01.863532 bus /gobi_6: Setting Powered False 22:58:02.923182 run create_hlr_db(pid=10753): Terminated: ok {rc=0} 22:58:03.356096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10755): Launched 22:58:03.671202 run osmo-hlr_10.42.42.2(pid=10756): Launched 22:58:03.792479 run osmo-stp_10.42.42.5: Starting osmo-stp 22:58:04.338081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10758): Launched 22:58:04.654169 run osmo-stp_10.42.42.5(pid=10759): Launched 22:58:04.774885 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:58:05.321634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10761): Launched 22:58:05.442668 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:58:05.709787 run patchelf(pid=10762): Launched 22:58:05.886239 run osmo-stp_10.42.42.5(pid=10759): ERR: Terminated: ERROR {rc=1} [trial-2395↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10759)] 22:58:06.019856 run osmo-stp_10.42.42.5(pid=10759): stdout: | (launched: 2022-12-13_22:58:04.596864) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:06.156181 run osmo-stp_10.42.42.5(pid=10759): stderr: | 20221213225804789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225804790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225804790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225804790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225804791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225804791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225804791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:06.292262 run osmo-stp_10.42.42.5(pid=10759): stdout: | (launched: 2022-12-13_22:58:04.596864) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:06.422502 run osmo-stp_10.42.42.5(pid=10759): stderr: | 20221213225804789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225804790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225804790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225804790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225804791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225804791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225804791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:06.576598 run patchelf(pid=10762): Terminating (SIGINT) 22:58:06.753593 run patchelf(pid=10762): Terminated: ok {rc=0} 22:58:06.881537 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10759): Process ended prematurely: osmo-stp_10.42.42.5(pid=10759) [trial-2395↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10759)] [trial-2395↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:58:06.891213 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 22:58:06.919012 run osmo-hlr_10.42.42.2(pid=10756): ERR: Terminated: ERROR {rc=237} [trial-2395↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10756)] 22:58:06.969826 run osmo-hlr_10.42.42.2(pid=10756): stdout: | (launched: 2022-12-13_22:58:03.614211) 22:58:07.022212 run osmo-hlr_10.42.42.2(pid=10756): stderr: | 20221213225803809 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225803809 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225803809 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225803809 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225803809 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225803809 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225803821 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225803829 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225803829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225803829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:07.074224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10755): Terminating (SIGTERM) 22:58:07.116290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10758): Terminating (SIGTERM) 22:58:07.158160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10761): Terminating (SIGTERM) 22:58:07.200891 --- ParallelTerminationStrategy: PID 10755 died... 22:58:07.221470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10755): Terminated: ok {rc=0} 22:58:07.268220 --- ParallelTerminationStrategy: PID 10758 died... 22:58:07.288285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10758): Terminated: ok {rc=0} 22:58:07.334594 --- ParallelTerminationStrategy: PID 10761 died... 22:58:07.354747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10761): Terminated: ok {rc=0} 22:58:07.443773 bus /gobi_0: Setting Powered False 22:58:08.540866 bus /gobi_0: Setting Powered False 22:58:09.659540 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2395 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 nitb_smpp --------------------------------------------------------------------- 22:58:10.912589 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:58:10.915336 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 22:58:10.935489 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 22:58:10.941993 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 22:58:10.975454 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 22:58:10.995781 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 22:58:11.002404 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 22:58:11.522806 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2395 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 22:58:11.527998 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 22:58:11.546834 tst esme_connect_policy_acceptall.py: using MSISDN 8368 22:58:11.678267 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:58:12.243057 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10766): Launched 22:58:12.545195 run osmo-nitb_10.42.42.2(pid=10767): Launched 22:58:12.713635 run osmo-nitb_10.42.42.2(pid=10767): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10767)] 22:58:12.849332 run osmo-nitb_10.42.42.2(pid=10767): stdout: | (launched: 2022-12-13_22:58:12.490302) 22:58:12.985907 run osmo-nitb_10.42.42.2(pid=10767): stderr: | (launched: 2022-12-13_22:58:12.535267) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:13.122560 run osmo-nitb_10.42.42.2(pid=10767): stdout: | (launched: 2022-12-13_22:58:12.490302) 22:58:13.253710 run osmo-nitb_10.42.42.2(pid=10767): stderr: | (launched: 2022-12-13_22:58:12.535267) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10767): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10767) [trial-2395↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10767)] 22:58:13.660115 tst osmo-nitb_10.42.42.2(pid=10767): stdout: | (launched: 2022-12-13_22:58:12.490302) 22:58:13.782103 tst osmo-nitb_10.42.42.2(pid=10767): stderr: | (launched: 2022-12-13_22:58:12.535267) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:13.926248 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=10767): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10767) [trial-2395↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10767)] [trial-2395↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 22:58:13.934555 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 22:58:13.941232 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10766): Terminating (SIGTERM) 22:58:14.149868 --- ParallelTerminationStrategy: PID 10766 died... 22:58:14.170804 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10766): Terminated: ok {rc=0} ---------------------------------------------- trial-2395 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 22:58:14.219042 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 22:58:14.239767 tst esme_connect_policy_closed.py: using MSISDN 8369 22:58:14.362138 tst esme_connect_policy_closed.py: using MSISDN 8370 22:58:14.473910 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:58:15.037745 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10768): Launched 22:58:15.340726 run osmo-nitb_10.42.42.2(pid=10769): Launched 22:58:15.504208 run osmo-nitb_10.42.42.2(pid=10769): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10769)] 22:58:15.628829 run osmo-nitb_10.42.42.2(pid=10769): stdout: | (launched: 2022-12-13_22:58:15.285405) 22:58:15.755358 run osmo-nitb_10.42.42.2(pid=10769): stderr: | (launched: 2022-12-13_22:58:15.330552) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:15.889964 run osmo-nitb_10.42.42.2(pid=10769): stdout: | (launched: 2022-12-13_22:58:15.285405) 22:58:16.016893 run osmo-nitb_10.42.42.2(pid=10769): stderr: | (launched: 2022-12-13_22:58:15.330552) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:16.163608 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=10769): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10769) [trial-2395↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10769)] [trial-2395↪nitb_smpp↪esme_connect_policy_closed.py:24] 22:58:16.172199 tst esme_connect_policy_closed.py:24: Test FAILED (1.9 sec) 22:58:16.178935 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10768): Terminating (SIGTERM) 22:58:16.387350 --- ParallelTerminationStrategy: PID 10768 died... 22:58:16.409583 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10768): Terminated: ok {rc=0} ---------------------------------------------- trial-2395 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 22:58:16.466477 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 22:58:16.478575 tst nitb_smpp: Using 1 x bts (candidates: 1) 22:58:16.517438 tst esme_ms_sms_storeforward.py: using LAC 36810 22:58:16.694047 tst esme_ms_sms_storeforward.py: using RAC 90 22:58:16.823471 tst esme_ms_sms_storeforward.py: using CellId 36810 22:58:16.945855 tst esme_ms_sms_storeforward.py: using BVCI 36811 22:58:17.060842 tst nitb_smpp: Using 1 x modem (candidates: 1) 22:58:17.192752 tst esme_ms_sms_storeforward.py: using MSISDN 8371 22:58:17.327598 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 22:58:17.534692 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:58:18.158075 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10770): Launched 22:58:18.464126 run osmo-nitb_10.42.42.2(pid=10771): Launched 22:58:18.629368 run osmo-nitb_10.42.42.2(pid=10771): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10771)] 22:58:18.754794 run osmo-nitb_10.42.42.2(pid=10771): stdout: | (launched: 2022-12-13_22:58:18.408681) 22:58:18.881724 run osmo-nitb_10.42.42.2(pid=10771): stderr: | (launched: 2022-12-13_22:58:18.454267) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:19.008376 run osmo-nitb_10.42.42.2(pid=10771): stdout: | (launched: 2022-12-13_22:58:18.408681) 22:58:19.129909 run osmo-nitb_10.42.42.2(pid=10771): stderr: | (launched: 2022-12-13_22:58:18.454267) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:19.275182 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=10771): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10771) [trial-2395↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10771)] [trial-2395↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 22:58:19.283513 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.8 sec) 22:58:19.290144 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10770): Terminating (SIGTERM) 22:58:19.498277 --- ParallelTerminationStrategy: PID 10770 died... 22:58:19.519175 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10770): Terminated: ok {rc=0} 22:58:19.604396 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 22:58:20.692676 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 22:58:20.703907 tst nitb_smpp: Using 1 x bts (candidates: 1) 22:58:20.739274 tst esme_ms_sms_transaction.py: using LAC 36811 22:58:20.861863 tst esme_ms_sms_transaction.py: using RAC 91 22:58:20.990868 tst esme_ms_sms_transaction.py: using CellId 36811 22:58:21.119979 tst esme_ms_sms_transaction.py: using BVCI 36812 22:58:21.238433 tst nitb_smpp: Using 1 x modem (candidates: 1) 22:58:21.369181 tst esme_ms_sms_transaction.py: using MSISDN 8372 22:58:21.489512 tst esme_ms_sms_transaction.py:18: start nitb and bts... 22:58:21.709643 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:58:22.371627 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10772): Launched 22:58:22.703250 run osmo-nitb_10.42.42.2(pid=10773): Launched 22:58:22.884690 run osmo-nitb_10.42.42.2(pid=10773): ERR: Terminated: ERROR {rc=2} [trial-2395↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10773)] 22:58:23.030309 run osmo-nitb_10.42.42.2(pid=10773): stdout: | (launched: 2022-12-13_22:58:22.637226) 22:58:23.177061 run osmo-nitb_10.42.42.2(pid=10773): stderr: | (launched: 2022-12-13_22:58:22.685469) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:23.323847 run osmo-nitb_10.42.42.2(pid=10773): stdout: | (launched: 2022-12-13_22:58:22.637226) 22:58:23.464782 run osmo-nitb_10.42.42.2(pid=10773): stderr: | (launched: 2022-12-13_22:58:22.685469) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10773): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10773) [trial-2395↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10773)] 22:58:23.827580 tst osmo-nitb_10.42.42.2(pid=10773): stdout: | (launched: 2022-12-13_22:58:22.637226) 22:58:23.959804 tst osmo-nitb_10.42.42.2(pid=10773): stderr: | (launched: 2022-12-13_22:58:22.685469) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:24.114948 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=10773): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10773) [trial-2395↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10773)] [trial-2395↪nitb_smpp↪esme_ms_sms_transaction.py:21] 22:58:24.124055 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 22:58:24.131440 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10772): Terminating (SIGTERM) 22:58:24.342614 --- ParallelTerminationStrategy: PID 10772 died... 22:58:24.364379 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10772): Terminated: ok {rc=0} 22:58:24.454960 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 smpp --------------------------------------------------------------------- 22:58:25.623674 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:58:25.626700 tst smpp: Verifying 1 x bts (candidates: 11) 22:58:25.647856 tst smpp: Verifying 6 x ip_address (candidates: 9) 22:58:25.677057 tst smpp: Verifying 1 x modem (candidates: 12) 22:58:25.713522 tst smpp: Reserving 1 x bts (candidates: 11) 22:58:25.735419 tst smpp: Reserving 6 x ip_address (candidates: 9) 22:58:25.762981 tst smpp: Reserving 1 x modem (candidates: 12) 22:58:26.290269 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2395 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 22:58:26.295730 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:26.306771 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:26.317760 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:26.328520 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:26.350963 tst esme_connect_policy_acceptall.py: using MSISDN 8373 22:58:26.472453 run osmo-stp_10.42.42.4: Starting osmo-stp 22:58:27.024096 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10777): Launched 22:58:27.348610 run osmo-stp_10.42.42.4(pid=10778): Launched 22:58:27.473397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:27.979969 run create_hlr_db(pid=10779): Launched 22:58:28.105274 bus /sierra_2: Setting Powered False 22:58:29.169270 run create_hlr_db(pid=10779): Terminated: ok {rc=0} 22:58:29.604463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10781): Launched 22:58:29.908927 run osmo-hlr_10.42.42.2(pid=10782): Launched 22:58:30.025492 run osmo-msc_10.42.42.5: Starting osmo-msc 22:58:30.577944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10784): Launched 22:58:30.919115 run osmo-msc_10.42.42.5(pid=10785): Launched 22:58:31.157320 run osmo-hlr_10.42.42.2(pid=10782): ERR: Terminated: ERROR {rc=237} [trial-2395↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10782)] 22:58:31.458378 run osmo-hlr_10.42.42.2(pid=10782): stdout: | (launched: 2022-12-13_22:58:29.853578) 22:58:31.833655 run osmo-hlr_10.42.42.2(pid=10782): stderr: | 20221213225830027 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225830027 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225830027 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225830027 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225830027 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225830027 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225830040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225830048 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225830049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225830049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:32.168711 run osmo-hlr_10.42.42.2(pid=10782): stdout: | (launched: 2022-12-13_22:58:29.853578) 22:58:32.412020 run osmo-hlr_10.42.42.2(pid=10782): stderr: | 20221213225830027 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225830027 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225830027 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225830027 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225830027 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225830027 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225830040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225830048 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225830049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225830049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:32.569651 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=10782): Process ended prematurely: osmo-hlr_10.42.42.2(pid=10782) [trial-2395↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10782)] [trial-2395↪smpp↪esme_connect_policy_acceptall.py:23] 22:58:32.578882 tst esme_connect_policy_acceptall.py:23: Test FAILED (6.3 sec) 22:58:32.606489 run osmo-msc_10.42.42.5(pid=10785): ERR: Terminated: ERROR {rc=9} [trial-2395↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=10785)] 22:58:32.657885 run osmo-msc_10.42.42.5(pid=10785): stdout: | (launched: 2022-12-13_22:58:30.826809) 22:58:32.710895 run osmo-msc_10.42.42.5(pid=10785): stderr: | 20221213225831785 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221213225831785 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221213225831787 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225831787 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221213225831787 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221213225831787 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221213225831787 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221213225831787 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221213225831787 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 22:58:32.763855 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10777): Terminating (SIGTERM) 22:58:32.806771 run osmo-stp_10.42.42.4(pid=10778): Terminating (SIGTERM) 22:58:32.849664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10781): Terminating (SIGTERM) 22:58:32.892866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10784): Terminating (SIGTERM) 22:58:32.936599 --- ParallelTerminationStrategy: PID 10777 died... 22:58:32.957390 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10777): Terminated: ok {rc=0} 22:58:33.006283 --- ParallelTerminationStrategy: PID 10778 died... 22:58:33.026545 run osmo-stp_10.42.42.4(pid=10778): Terminated: ok {rc=0} 22:58:33.073427 --- ParallelTerminationStrategy: PID 10781 died... 22:58:33.093735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10781): Terminated: ok {rc=0} 22:58:33.140854 --- ParallelTerminationStrategy: PID 10784 died... 22:58:33.161218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10784): Terminated: ok {rc=0} ---------------------------------------------- trial-2395 smpp esme_connect_policy_closed.py ---------------------------------------------- 22:58:33.213822 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:33.225294 tst smpp: Using 1 x bts (candidates: 1) 22:58:33.264617 tst esme_connect_policy_closed.py: using LAC 36812 22:58:33.385976 tst esme_connect_policy_closed.py: using RAC 92 22:58:33.505847 tst esme_connect_policy_closed.py: using CellId 36812 22:58:33.623623 tst esme_connect_policy_closed.py: using BVCI 36813 22:58:33.733948 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:33.744349 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:33.754833 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:33.773212 tst esme_connect_policy_closed.py: using MSISDN 8374 22:58:33.892214 tst esme_connect_policy_closed.py: using MSISDN 8375 22:58:34.003592 run osmo-stp_10.42.42.4: Starting osmo-stp 22:58:34.521391 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10788): Launched 22:58:34.824571 run osmo-stp_10.42.42.4(pid=10789): Launched 22:58:34.941961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:35.414478 run create_hlr_db(pid=10790): Launched 22:58:36.594253 run create_hlr_db(pid=10790): Terminated: ok {rc=0} 22:58:36.915200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10792): Launched 22:58:37.221457 run osmo-hlr_10.42.42.2(pid=10793): Launched 22:58:37.339494 run osmo-msc_10.42.42.5: Starting osmo-msc 22:58:37.892501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10795): Launched 22:58:38.197953 run osmo-msc_10.42.42.5(pid=10796): Launched 22:58:38.368382 run osmo-hlr_10.42.42.2(pid=10793): ERR: Terminated: ERROR {rc=237} [trial-2395↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10793)] 22:58:38.499043 run osmo-hlr_10.42.42.2(pid=10793): stdout: | (launched: 2022-12-13_22:58:37.165413) 22:58:38.628108 run osmo-hlr_10.42.42.2(pid=10793): stderr: | 20221213225837342 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225837342 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225837342 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225837342 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225837342 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225837342 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225837355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225837364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225837364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225837364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:38.754893 run osmo-hlr_10.42.42.2(pid=10793): stdout: | (launched: 2022-12-13_22:58:37.165413) 22:58:38.875875 run osmo-hlr_10.42.42.2(pid=10793): stderr: | 20221213225837342 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225837342 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225837342 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225837342 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225837342 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225837342 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225837355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225837364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225837364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225837364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:39.021900 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=10793): Process ended prematurely: osmo-hlr_10.42.42.2(pid=10793) [trial-2395↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10793)] [trial-2395↪smpp↪esme_connect_policy_closed.py:31] 22:58:39.029942 tst esme_connect_policy_closed.py:31: Test FAILED (5.8 sec) 22:58:39.056045 run osmo-msc_10.42.42.5(pid=10796): ERR: Terminated: ERROR {rc=9} [trial-2395↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=10796)] 22:58:39.104566 run osmo-msc_10.42.42.5(pid=10796): stdout: | (launched: 2022-12-13_22:58:38.142111) 22:58:39.153998 run osmo-msc_10.42.42.5(pid=10796): stderr: | 20221213225838461 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221213225838461 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221213225838461 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225838461 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221213225838461 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221213225838461 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221213225838462 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221213225838462 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221213225838462 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 22:58:39.203757 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10788): Terminating (SIGTERM) 22:58:39.243406 run osmo-stp_10.42.42.4(pid=10789): Terminating (SIGTERM) 22:58:39.282968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10792): Terminating (SIGTERM) 22:58:39.323824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10795): Terminating (SIGTERM) 22:58:39.364517 --- ParallelTerminationStrategy: PID 10788 died... 22:58:39.383714 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10788): Terminated: ok {rc=0} 22:58:39.427799 --- ParallelTerminationStrategy: PID 10789 died... 22:58:39.446292 run osmo-stp_10.42.42.4(pid=10789): Terminated: ok {rc=0} 22:58:39.489894 --- ParallelTerminationStrategy: PID 10792 died... 22:58:39.508413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10792): Terminated: ok {rc=0} 22:58:39.551970 --- ParallelTerminationStrategy: PID 10795 died... 22:58:39.570464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10795): Terminated: ok {rc=0} ---------------------------------------------- trial-2395 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 22:58:39.618516 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:39.629578 tst smpp: Using 1 x bts (candidates: 1) 22:58:39.665020 tst esme_ms_sms_storeforward.py: using LAC 36813 22:58:39.785675 tst esme_ms_sms_storeforward.py: using RAC 93 22:58:39.910776 tst esme_ms_sms_storeforward.py: using CellId 36813 22:58:40.030249 tst esme_ms_sms_storeforward.py: using BVCI 36814 22:58:40.142440 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:40.152815 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:40.163078 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:40.173280 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:40.183480 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:40.193823 tst smpp: Using 1 x modem (candidates: 1) 22:58:40.326130 tst esme_ms_sms_storeforward.py: using MSISDN 8376 22:58:40.445313 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:40.949829 run create_hlr_db(pid=10799): Launched 22:58:42.132574 run create_hlr_db(pid=10799): Terminated: ok {rc=0} 22:58:42.475798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10801): Launched 22:58:42.801735 run osmo-hlr_10.42.42.2(pid=10802): Launched 22:58:42.927523 run osmo-stp_10.42.42.5: Starting osmo-stp 22:58:43.493288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10804): Launched 22:58:43.820708 run osmo-stp_10.42.42.5(pid=10805): Launched 22:58:43.947428 run osmo-msc_10.42.42.6: Starting osmo-msc 22:58:44.537422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10807): Launched 22:58:44.863036 run osmo-msc_10.42.42.6(pid=10808): Launched 22:58:45.046833 run osmo-stp_10.42.42.5(pid=10805): ERR: Terminated: ERROR {rc=1} [trial-2395↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10805)] 22:58:45.185064 run osmo-stp_10.42.42.5(pid=10805): stdout: | (launched: 2022-12-13_22:58:43.761400) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:45.324044 run osmo-stp_10.42.42.5(pid=10805): stderr: | 20221213225843954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225843954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225843954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225843955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225843957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225843957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225843957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:45.462069 run osmo-stp_10.42.42.5(pid=10805): stdout: | (launched: 2022-12-13_22:58:43.761400) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:45.592672 run osmo-stp_10.42.42.5(pid=10805): stderr: | 20221213225843954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225843954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225843954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225843955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225843957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225843957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225843957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:45.748336 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=10805): Process ended prematurely: osmo-stp_10.42.42.5(pid=10805) [trial-2395↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10805)] [trial-2395↪smpp↪esme_ms_sms_storeforward.py:30] 22:58:45.757516 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.1 sec) 22:58:45.784926 run osmo-hlr_10.42.42.2(pid=10802): ERR: Terminated: ERROR {rc=237} [trial-2395↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10802)] 22:58:45.836263 run osmo-hlr_10.42.42.2(pid=10802): stdout: | (launched: 2022-12-13_22:58:42.742618) 22:58:45.903140 run osmo-hlr_10.42.42.2(pid=10802): stderr: | 20221213225842941 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225842941 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225842941 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225842941 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225842941 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225842942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225842955 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225842965 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225842965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225842965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:45.977949 run osmo-msc_10.42.42.6(pid=10808): ERR: Terminated: ERROR {rc=2} [trial-2395↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10808)] 22:58:46.030218 run osmo-msc_10.42.42.6(pid=10808): stdout: | (launched: 2022-12-13_22:58:44.803886) 22:58:46.095805 run osmo-msc_10.42.42.6(pid=10808): stderr: | 20221213225845124 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225845124 DLGLOBAL DEBUG validating counter group 0x7fe2b335bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225845124 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225845124 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225845125 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225845125 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225845127 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225845127 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225845127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225845127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:58:46.165133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10801): Terminating (SIGTERM) 22:58:46.222914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10804): Terminating (SIGTERM) 22:58:46.282003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10807): Terminating (SIGTERM) 22:58:46.341494 --- ParallelTerminationStrategy: PID 10801 died... 22:58:46.367610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10801): Terminated: ok {rc=0} 22:58:46.429815 --- ParallelTerminationStrategy: PID 10804 died... 22:58:46.455952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10804): Terminated: ok {rc=0} 22:58:46.519012 --- ParallelTerminationStrategy: PID 10807 died... 22:58:46.542607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10807): Terminated: ok {rc=0} 22:58:46.650991 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 smpp esme_ms_sms_transaction.py ---------------------------------------------- 22:58:47.736441 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:47.747999 tst smpp: Using 1 x bts (candidates: 1) 22:58:47.784591 tst esme_ms_sms_transaction.py: using LAC 36814 22:58:47.914456 tst esme_ms_sms_transaction.py: using RAC 94 22:58:48.042573 tst esme_ms_sms_transaction.py: using CellId 36814 22:58:48.170683 tst esme_ms_sms_transaction.py: using BVCI 36815 22:58:48.288388 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:48.299322 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:48.310549 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:48.321361 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:48.333125 tst smpp: Using 1 x ip_address (candidates: 6) 22:58:48.344560 tst smpp: Using 1 x modem (candidates: 1) 22:58:48.477310 tst esme_ms_sms_transaction.py: using MSISDN 8377 22:58:48.597321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:49.103475 run create_hlr_db(pid=10810): Launched 22:58:49.229502 bus /sierra_2: Setting Powered False 22:58:50.290285 run create_hlr_db(pid=10810): Terminated: ok {rc=0} 22:58:50.715751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10812): Launched 22:58:51.021673 run osmo-hlr_10.42.42.2(pid=10813): Launched 22:58:51.138593 run osmo-stp_10.42.42.5: Starting osmo-stp 22:58:51.675311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10815): Launched 22:58:51.979064 run osmo-stp_10.42.42.5(pid=10816): Launched 22:58:52.096009 run osmo-msc_10.42.42.6: Starting osmo-msc 22:58:52.646190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10818): Launched 22:58:52.950697 run osmo-msc_10.42.42.6(pid=10819): Launched 22:58:53.121268 run osmo-stp_10.42.42.5(pid=10816): ERR: Terminated: ERROR {rc=1} [trial-2395↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10816)] 22:58:53.250041 run osmo-stp_10.42.42.5(pid=10816): stdout: | (launched: 2022-12-13_22:58:51.923517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:53.378795 run osmo-stp_10.42.42.5(pid=10816): stderr: | 20221213225852094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225852094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225852094 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225852095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225852095 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225852095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225852095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:53.505419 run osmo-stp_10.42.42.5(pid=10816): stdout: | (launched: 2022-12-13_22:58:51.923517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:53.626403 run osmo-stp_10.42.42.5(pid=10816): stderr: | 20221213225852094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225852094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225852094 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225852095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225852095 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225852095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225852095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:53.771337 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=10816): Process ended prematurely: osmo-stp_10.42.42.5(pid=10816) [trial-2395↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10816)] [trial-2395↪smpp↪esme_ms_sms_transaction.py:28] 22:58:53.779495 tst esme_ms_sms_transaction.py:28: Test FAILED (6.0 sec) 22:58:53.805330 run osmo-hlr_10.42.42.2(pid=10813): ERR: Terminated: ERROR {rc=237} [trial-2395↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10813)] 22:58:53.853567 run osmo-hlr_10.42.42.2(pid=10813): stdout: | (launched: 2022-12-13_22:58:50.965831) 22:58:53.902631 run osmo-hlr_10.42.42.2(pid=10813): stderr: | 20221213225851141 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225851142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225851142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225851142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225851142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225851142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225851154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225851165 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225851165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225851165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:53.971126 run osmo-msc_10.42.42.6(pid=10819): ERR: Terminated: ERROR {rc=2} [trial-2395↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10819)] 22:58:54.018277 run osmo-msc_10.42.42.6(pid=10819): stdout: | (launched: 2022-12-13_22:58:52.894851) 22:58:54.066998 run osmo-msc_10.42.42.6(pid=10819): stderr: | 20221213225853166 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225853166 DLGLOBAL DEBUG validating counter group 0x7f9a3d1ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225853166 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225853166 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225853166 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225853167 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225853168 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225853169 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225853169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225853169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:58:54.115981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10812): Terminating (SIGTERM) 22:58:54.155382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10815): Terminating (SIGTERM) 22:58:54.194727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10818): Terminating (SIGTERM) 22:58:54.234287 --- ParallelTerminationStrategy: PID 10812 died... 22:58:54.253295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10812): Terminated: ok {rc=0} 22:58:54.296738 --- ParallelTerminationStrategy: PID 10815 died... 22:58:54.315166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10815): Terminated: ok {rc=0} 22:58:54.358468 --- ParallelTerminationStrategy: PID 10818 died... 22:58:54.376803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10818): Terminated: ok {rc=0} 22:58:54.459657 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 encryption --------------------------------------------------------------------- 22:58:55.651421 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:58:55.654743 tst encryption: Verifying 1 x bts (candidates: 11) 22:58:55.675599 tst encryption: Verifying 6 x ip_address (candidates: 9) 22:58:55.702950 tst encryption: Verifying 1 x modem (candidates: 12) 22:58:55.738379 tst encryption: Reserving 1 x bts (candidates: 11) 22:58:55.759614 tst encryption: Reserving 6 x ip_address (candidates: 9) 22:58:55.786418 tst encryption: Reserving 1 x modem (candidates: 12) 22:58:56.313473 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2395 encryption register_a5_0_authopt.py ---------------------------------------------- 22:58:56.365337 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:56.375859 tst encryption: Using 1 x bts (candidates: 1) 22:58:56.411118 tst register_a5_0_authopt.py: using LAC 36815 22:58:56.535144 tst register_a5_0_authopt.py: using RAC 95 22:58:56.658405 tst register_a5_0_authopt.py: using CellId 36815 22:58:56.781341 tst register_a5_0_authopt.py: using BVCI 36816 22:58:56.893322 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:56.903578 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:56.913869 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:56.924069 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:56.934303 tst encryption: Using 1 x ip_address (candidates: 6) 22:58:56.945027 tst encryption: Using 1 x modem (candidates: 1) 22:58:57.060258 tst register_a5_0_authopt.py:8: start network... 22:58:57.266794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:57.743662 run create_hlr_db(pid=10824): Launched 22:58:57.870713 bus /sierra_2: Setting Powered False 22:58:58.932661 run create_hlr_db(pid=10824): Terminated: ok {rc=0} 22:58:59.384514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10826): Launched 22:58:59.715852 run osmo-hlr_10.42.42.2(pid=10827): Launched 22:58:59.843276 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:00.412866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10829): Launched 22:59:00.743781 run osmo-stp_10.42.42.5(pid=10830): Launched 22:59:00.960542 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:01.621795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10833): Launched 22:59:01.981721 run osmo-msc_10.42.42.6(pid=10834): Launched 22:59:02.257224 run osmo-stp_10.42.42.5(pid=10830): ERR: Terminated: ERROR {rc=1} [trial-2395↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10830)] 22:59:02.401639 run osmo-stp_10.42.42.5(pid=10830): stdout: | (launched: 2022-12-13_22:59:00.682374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:02.544106 run osmo-stp_10.42.42.5(pid=10830): stderr: | 20221213225900918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225900918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225900919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225900919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225900919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225900920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225900920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:02.683411 run osmo-stp_10.42.42.5(pid=10830): stdout: | (launched: 2022-12-13_22:59:00.682374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:02.815835 run osmo-stp_10.42.42.5(pid=10830): stderr: | 20221213225900918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225900918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225900919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225900919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225900919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225900920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225900920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:02.974692 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10830): Process ended prematurely: osmo-stp_10.42.42.5(pid=10830) [trial-2395↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10830)] [trial-2395↪encryption↪register_a5_0_authopt.py:8] 22:59:02.984543 tst register_a5_0_authopt.py:8: Test FAILED (6.7 sec) 22:59:03.012840 run osmo-hlr_10.42.42.2(pid=10827): ERR: Terminated: ERROR {rc=237} [trial-2395↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10827)] 22:59:03.064215 run osmo-hlr_10.42.42.2(pid=10827): stdout: | (launched: 2022-12-13_22:58:59.656074) 22:59:03.117413 run osmo-hlr_10.42.42.2(pid=10827): stderr: | 20221213225859857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225859857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225859857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225859857 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225859857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225859857 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225859869 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225859878 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225859878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225859878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:03.190661 run osmo-msc_10.42.42.6(pid=10834): ERR: Terminated: ERROR {rc=2} [trial-2395↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10834)] 22:59:03.241296 run osmo-msc_10.42.42.6(pid=10834): stdout: | (launched: 2022-12-13_22:59:01.909939) 22:59:03.294445 run osmo-msc_10.42.42.6(pid=10834): stderr: | 20221213225902338 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225902339 DLGLOBAL DEBUG validating counter group 0x7f2e7af77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225902339 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225902339 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225902339 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225902339 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225902341 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225902341 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225902341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225902342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:03.347662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10826): Terminating (SIGTERM) 22:59:03.389916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10829): Terminating (SIGTERM) 22:59:03.432649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10833): Terminating (SIGTERM) 22:59:03.475485 --- ParallelTerminationStrategy: PID 10826 died... 22:59:03.496208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10826): Terminated: ok {rc=0} 22:59:03.543384 --- ParallelTerminationStrategy: PID 10829 died... 22:59:03.563799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10829): Terminated: ok {rc=0} 22:59:03.610833 --- ParallelTerminationStrategy: PID 10833 died... 22:59:03.631189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10833): Terminated: ok {rc=0} 22:59:03.722048 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 encryption register_a5_0_authreq.py ---------------------------------------------- 22:59:04.878111 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:04.889792 tst encryption: Using 1 x bts (candidates: 1) 22:59:04.924630 tst register_a5_0_authreq.py: using LAC 36816 22:59:05.054426 tst register_a5_0_authreq.py: using RAC 96 22:59:05.185210 tst register_a5_0_authreq.py: using CellId 36816 22:59:05.316769 tst register_a5_0_authreq.py: using BVCI 36817 22:59:05.429953 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:05.440533 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:05.451054 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:05.461518 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:05.471973 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:05.482580 tst encryption: Using 1 x modem (candidates: 1) 22:59:05.599401 tst register_a5_0_authreq.py:8: start network... 22:59:05.806088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:59:06.280229 run create_hlr_db(pid=10836): Launched 22:59:06.405296 bus /sierra_2: Setting Powered False 22:59:07.466903 run create_hlr_db(pid=10836): Terminated: ok {rc=0} 22:59:07.916917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10838): Launched 22:59:08.247647 run osmo-hlr_10.42.42.2(pid=10839): Launched 22:59:08.375298 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:08.948164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10841): Launched 22:59:09.277925 run osmo-stp_10.42.42.5(pid=10842): Launched 22:59:09.405224 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:10.002219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10844): Launched 22:59:10.333531 run osmo-msc_10.42.42.6(pid=10845): Launched 22:59:10.518098 run osmo-stp_10.42.42.5(pid=10842): ERR: Terminated: ERROR {rc=1} [trial-2395↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10842)] 22:59:10.658471 run osmo-stp_10.42.42.5(pid=10842): stdout: | (launched: 2022-12-13_22:59:09.218551) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:10.798519 run osmo-stp_10.42.42.5(pid=10842): stderr: | 20221213225909413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225909413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225909413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225909414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225909414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225909414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225909414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:10.937527 run osmo-stp_10.42.42.5(pid=10842): stdout: | (launched: 2022-12-13_22:59:09.218551) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:11.068824 run osmo-stp_10.42.42.5(pid=10842): stderr: | 20221213225909413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225909413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225909413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225909414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225909414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225909414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225909414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:11.225655 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10842): Process ended prematurely: osmo-stp_10.42.42.5(pid=10842) [trial-2395↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10842)] [trial-2395↪encryption↪register_a5_0_authreq.py:8] 22:59:11.235237 tst register_a5_0_authreq.py:8: Test FAILED (6.4 sec) 22:59:11.262773 run osmo-hlr_10.42.42.2(pid=10839): ERR: Terminated: ERROR {rc=237} [trial-2395↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10839)] 22:59:11.313230 run osmo-hlr_10.42.42.2(pid=10839): stdout: | (launched: 2022-12-13_22:59:08.188194) 22:59:11.364641 run osmo-hlr_10.42.42.2(pid=10839): stderr: | 20221213225908386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225908386 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225908386 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225908386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225908386 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225908386 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225908398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225908409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225908410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225908410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:11.436812 run osmo-msc_10.42.42.6(pid=10845): ERR: Terminated: ERROR {rc=2} [trial-2395↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10845)] 22:59:11.486403 run osmo-msc_10.42.42.6(pid=10845): stdout: | (launched: 2022-12-13_22:59:10.273885) 22:59:11.538308 run osmo-msc_10.42.42.6(pid=10845): stderr: | 20221213225910599 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225910599 DLGLOBAL DEBUG validating counter group 0x7fe7684aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225910599 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225910599 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225910599 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225910599 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225910601 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225910602 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225910602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225910602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:11.590469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10838): Terminating (SIGTERM) 22:59:11.632367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10841): Terminating (SIGTERM) 22:59:11.675342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10844): Terminating (SIGTERM) 22:59:11.717875 --- ParallelTerminationStrategy: PID 10838 died... 22:59:11.738327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10838): Terminated: ok {rc=0} 22:59:11.784897 --- ParallelTerminationStrategy: PID 10841 died... 22:59:11.805190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10841): Terminated: ok {rc=0} 22:59:11.851476 --- ParallelTerminationStrategy: PID 10844 died... 22:59:11.871722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10844): Terminated: ok {rc=0} 22:59:11.965378 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 encryption register_a5_1_authreq.py ---------------------------------------------- 22:59:13.116356 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:13.128074 tst encryption: Using 1 x bts (candidates: 1) 22:59:13.166609 tst register_a5_1_authreq.py: using LAC 36817 22:59:13.287778 tst register_a5_1_authreq.py: using RAC 97 22:59:13.409635 tst register_a5_1_authreq.py: using CellId 36817 22:59:13.540261 tst register_a5_1_authreq.py: using BVCI 36818 22:59:13.660097 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:13.671594 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:13.682669 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:13.693679 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:13.705096 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:13.716544 tst encryption: Using 1 x modem (candidates: 1) 22:59:13.837132 tst register_a5_1_authreq.py:8: start network... 22:59:14.062490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:59:14.575003 run create_hlr_db(pid=10847): Launched 22:59:14.700938 bus /sierra_2: Setting Powered False 22:59:15.766077 run create_hlr_db(pid=10847): Terminated: ok {rc=0} 22:59:16.243972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10849): Launched 22:59:16.594712 run osmo-hlr_10.42.42.2(pid=10850): Launched 22:59:16.838577 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:17.467178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10852): Launched 22:59:17.797640 run osmo-stp_10.42.42.5(pid=10853): Launched 22:59:17.925282 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:18.519171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10855): Launched 22:59:18.848797 run osmo-msc_10.42.42.6(pid=10856): Launched 22:59:19.034116 run osmo-stp_10.42.42.5(pid=10853): ERR: Terminated: ERROR {rc=1} [trial-2395↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10853)] 22:59:19.173363 run osmo-stp_10.42.42.5(pid=10853): stdout: | (launched: 2022-12-13_22:59:17.738049) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:19.313732 run osmo-stp_10.42.42.5(pid=10853): stderr: | 20221213225917931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225917931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225917931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225917932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225917932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225917932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225917932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:19.445443 run osmo-stp_10.42.42.5(pid=10853): stdout: | (launched: 2022-12-13_22:59:17.738049) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:19.568546 run osmo-stp_10.42.42.5(pid=10853): stderr: | 20221213225917931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225917931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225917931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225917932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225917932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225917932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225917932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:19.715428 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10853): Process ended prematurely: osmo-stp_10.42.42.5(pid=10853) [trial-2395↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10853)] [trial-2395↪encryption↪register_a5_1_authreq.py:8] 22:59:19.724331 tst register_a5_1_authreq.py:8: Test FAILED (6.6 sec) 22:59:19.750786 run osmo-hlr_10.42.42.2(pid=10850): ERR: Terminated: ERROR {rc=237} [trial-2395↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10850)] 22:59:19.798320 run osmo-hlr_10.42.42.2(pid=10850): stdout: | (launched: 2022-12-13_22:59:16.529376) 22:59:19.847516 run osmo-hlr_10.42.42.2(pid=10850): stderr: | 20221213225916777 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225916777 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225916777 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225916777 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225916777 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225916777 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225916791 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225916804 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225916804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225916804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:19.916170 run osmo-msc_10.42.42.6(pid=10856): ERR: Terminated: ERROR {rc=2} [trial-2395↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10856)] 22:59:19.963693 run osmo-msc_10.42.42.6(pid=10856): stdout: | (launched: 2022-12-13_22:59:18.789069) 22:59:20.013212 run osmo-msc_10.42.42.6(pid=10856): stderr: | 20221213225919114 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225919114 DLGLOBAL DEBUG validating counter group 0x7f09c1740c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225919114 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225919114 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225919114 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225919115 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225919116 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225919117 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225919117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225919117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:20.062882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10849): Terminating (SIGTERM) 22:59:20.102523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10852): Terminating (SIGTERM) 22:59:20.142388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10855): Terminating (SIGTERM) 22:59:20.182437 --- ParallelTerminationStrategy: PID 10849 died... 22:59:20.201560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10849): Terminated: ok {rc=0} 22:59:20.245386 --- ParallelTerminationStrategy: PID 10852 died... 22:59:20.263859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10852): Terminated: ok {rc=0} 22:59:20.307963 --- ParallelTerminationStrategy: PID 10855 died... 22:59:20.326678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10855): Terminated: ok {rc=0} 22:59:20.412330 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2395 encryption register_a5_3_authreq.py ---------------------------------------------- 22:59:21.559123 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:21.570169 tst encryption: Using 1 x bts (candidates: 1) 22:59:21.606224 tst register_a5_3_authreq.py: using LAC 36818 22:59:21.736227 tst register_a5_3_authreq.py: using RAC 98 22:59:21.868268 tst register_a5_3_authreq.py: using CellId 36818 22:59:21.996770 tst register_a5_3_authreq.py: using BVCI 36819 22:59:22.117543 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:22.128574 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:22.139614 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:22.150588 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:22.162148 tst encryption: Using 1 x ip_address (candidates: 6) 22:59:22.173649 tst encryption: Using 1 x modem (candidates: 1) 22:59:22.300164 tst register_a5_3_authreq.py:8: start network... 22:59:22.507668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:59:22.984653 run create_hlr_db(pid=10858): Launched 22:59:23.110786 bus /sierra_2: Setting Powered False 22:59:24.175429 run create_hlr_db(pid=10858): Terminated: ok {rc=0} 22:59:24.633647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10860): Launched 22:59:24.962762 run osmo-hlr_10.42.42.2(pid=10861): Launched 22:59:25.089902 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:25.659323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10863): Launched 22:59:25.989570 run osmo-stp_10.42.42.5(pid=10864): Launched 22:59:26.116201 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:26.710761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10866): Launched 22:59:27.021345 run osmo-msc_10.42.42.6(pid=10867): Launched 22:59:27.194638 run osmo-stp_10.42.42.5(pid=10864): ERR: Terminated: ERROR {rc=1} [trial-2395↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10864)] 22:59:27.325145 run osmo-stp_10.42.42.5(pid=10864): stdout: | (launched: 2022-12-13_22:59:25.930312) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:27.456270 run osmo-stp_10.42.42.5(pid=10864): stderr: | 20221213225926122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225926122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225926123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225926123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225926125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225926125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225926125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:27.585381 run osmo-stp_10.42.42.5(pid=10864): stdout: | (launched: 2022-12-13_22:59:25.930312) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:27.708414 run osmo-stp_10.42.42.5(pid=10864): stderr: | 20221213225926122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213225926122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213225926123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213225926123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213225926125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213225926125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213225926125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:27.856087 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10864): Process ended prematurely: osmo-stp_10.42.42.5(pid=10864) [trial-2395↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10864)] [trial-2395↪encryption↪register_a5_3_authreq.py:8] 22:59:27.865477 tst register_a5_3_authreq.py:8: Test FAILED (6.3 sec) 22:59:27.891709 run osmo-hlr_10.42.42.2(pid=10861): ERR: Terminated: ERROR {rc=237} [trial-2395↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10861)] 22:59:27.939488 run osmo-hlr_10.42.42.2(pid=10861): stdout: | (launched: 2022-12-13_22:59:24.903550) 22:59:27.988911 run osmo-hlr_10.42.42.2(pid=10861): stderr: | 20221213225925101 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213225925102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213225925102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213225925102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213225925102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213225925102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213225925115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213225925123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213225925123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213225925124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:28.057822 run osmo-msc_10.42.42.6(pid=10867): ERR: Terminated: ERROR {rc=2} [trial-2395↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10867)] 22:59:28.105185 run osmo-msc_10.42.42.6(pid=10867): stdout: | (launched: 2022-12-13_22:59:26.965636) 22:59:28.154186 run osmo-msc_10.42.42.6(pid=10867): stderr: | 20221213225927239 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213225927239 DLGLOBAL DEBUG validating counter group 0x7f60fccedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213225927239 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213225927239 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213225927239 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213225927240 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213225927241 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213225927242 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213225927242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213225927242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:28.203579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10860): Terminating (SIGTERM) 22:59:28.243302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10863): Terminating (SIGTERM) 22:59:28.283316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10866): Terminating (SIGTERM) 22:59:28.323400 --- ParallelTerminationStrategy: PID 10860 died... 22:59:28.342705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10860): Terminated: ok {rc=0} 22:59:28.386715 --- ParallelTerminationStrategy: PID 10863 died... 22:59:28.405488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10863): Terminated: ok {rc=0} 22:59:28.449532 --- ParallelTerminationStrategy: PID 10866 died... 22:59:28.468429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10866): Terminated: ok {rc=0} 22:59:28.554366 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 22:59:29.761712 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:59:29.766386 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 22:59:29.784387 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 22:59:29.810828 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 22:59:29.837004 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 22:59:29.854997 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 22:59:29.881194 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 22:59:30.393947 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2395 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 22:59:30.398845 tst handover.py:11: TEST_CONFIG: {} 22:59:30.603369 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 22:59:30.619229 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 22:59:30.641969 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 22:59:30.690580 tst handover.py: using MSISDN 8378 22:59:30.804753 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8378', subscriber_id=0} 22:59:30.937180 run srsepc_10.42.42.118: Starting srsepc 22:59:32.880629 run rm-remote-dir(pid=10872): Launched 22:59:33.012275 bus /sierra_2: Setting Powered False 22:59:34.080792 run rm-remote-dir(pid=10872): Terminated: ok {rc=0} 22:59:34.533419 run mk-remote-dir(pid=10873): Launched 22:59:35.714466 run mk-remote-dir(pid=10873): Terminated: ok {rc=0} 22:59:36.003795 run scp-inst-to-remote(pid=10874): Launched 22:59:38.187075 run scp-inst-to-remote(pid=10874): Terminated: ok {rc=0} 22:59:38.544578 run rm-remote-dir(pid=10876): Launched 22:59:39.736177 run rm-remote-dir(pid=10876): Terminated: ok {rc=0} 22:59:40.095588 run mk-remote-dir(pid=10877): Launched 22:59:41.286897 run mk-remote-dir(pid=10877): Terminated: ok {rc=0} 22:59:41.593416 run scp-cfg-to-remote(pid=10878): Launched 22:59:42.781690 run scp-cfg-to-remote(pid=10878): Terminated: ok {rc=0} 22:59:43.086291 run scp-db-to-remote(pid=10880): Launched 22:59:44.274419 run scp-db-to-remote(pid=10880): Terminated: ok {rc=0} 22:59:44.415526 run srsepc_10.42.42.118: Setting RPATH for srsepc 22:59:44.745624 run patchelf(pid=10882): Launched 22:59:45.944082 run patchelf(pid=10882): Terminated: ok {rc=0} 22:59:46.087480 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 22:59:46.431267 run setcap-netadm(pid=10883): Launched 22:59:47.689954 run setcap-netadm(pid=10883): Terminated: ok {rc=0} 22:59:48.035399 run srsepc(pid=10884): Launched 22:59:48.158051 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 22:59:49.343041 run rm-remote-dir(pid=10885): Launched 22:59:49.531803 run srsepc(pid=10884): ERR: Terminated: ERROR {rc=127} [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10884)] 22:59:49.675585 run srsepc(pid=10884): stdout: | (launched: 2022-12-13_22:59:47.975964) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 22:59:49.820343 run srsepc(pid=10884): stderr: | (launched: 2022-12-13_22:59:48.024830) | Connection to 10.42.42.116 closed. 22:59:49.965678 run srsepc(pid=10884): stdout: | (launched: 2022-12-13_22:59:47.975964) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 22:59:50.104654 run srsepc(pid=10884): stderr: | (launched: 2022-12-13_22:59:48.024830) | Connection to 10.42.42.116 closed. 22:59:50.269618 run rm-remote-dir(pid=10885): Terminating (SIGINT) 22:59:50.460048 run rm-remote-dir(pid=10885): Terminated: ok {rc=0} 22:59:50.597913 tst handover.py:37: ERR: Error: srsepc(pid=10884): Process ended prematurely: srsepc(pid=10884) [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10884)] [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 22:59:50.608489 tst handover.py:37: Test FAILED (20.2 sec) 22:59:50.689419 run scp-back-log(pid=10886): Launched 22:59:51.770213 run scp-back-log(pid=10886): ERR: Terminated: ERROR {rc=1} [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10886)] 22:59:51.834670 run scp-back-log(pid=10886): stdout: | (launched: 2022-12-13_22:59:50.657753) 22:59:51.900852 run scp-back-log(pid=10886): stderr: | (launched: 2022-12-13_22:59:50.678514) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 22:59:51.975097 tst srsepc_10.42.42.118: Error('scp-back-log(pid=10886): launch_sync(): local process exited with status 1 [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10886)]') ---------------------------------------------- trial-2395 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 22:59:52.022207 tst iperf3_bidir.py:13: Number of physical ue: 1 22:59:52.244043 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 22:59:52.287004 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 22:59:52.508191 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 22:59:52.524438 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 22:59:52.557112 tst iperf3_bidir.py: using MSISDN 8379 22:59:52.669088 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8379', subscriber_id=0} 22:59:52.776488 run srsepc_10.42.42.118: Starting srsepc 22:59:53.405220 run rm-remote-dir(pid=10889): Launched 22:59:54.589707 run rm-remote-dir(pid=10889): Terminated: ok {rc=0} 22:59:54.949751 run mk-remote-dir(pid=10890): Launched 22:59:56.141662 run mk-remote-dir(pid=10890): Terminated: ok {rc=0} 22:59:56.447967 run scp-inst-to-remote(pid=10891): Launched 22:59:58.638314 run scp-inst-to-remote(pid=10891): Terminated: ok {rc=0} 22:59:58.996660 run rm-remote-dir(pid=10893): Launched 23:00:00.187932 run rm-remote-dir(pid=10893): Terminated: ok {rc=0} 23:00:00.547178 run mk-remote-dir(pid=10894): Launched 23:00:01.736910 run mk-remote-dir(pid=10894): Terminated: ok {rc=0} 23:00:02.056796 run scp-cfg-to-remote(pid=10898): Launched 23:00:03.247580 run scp-cfg-to-remote(pid=10898): Terminated: ok {rc=0} 23:00:03.551531 run scp-db-to-remote(pid=10900): Launched 23:00:04.740395 run scp-db-to-remote(pid=10900): Terminated: ok {rc=0} 23:00:04.880847 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:00:05.212490 run patchelf(pid=10902): Launched 23:00:06.401126 run patchelf(pid=10902): Terminated: ok {rc=0} 23:00:06.542332 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:00:06.873423 run setcap-netadm(pid=10903): Launched 23:00:08.062576 run setcap-netadm(pid=10903): Terminated: ok {rc=0} 23:00:08.408879 run srsepc(pid=10904): Launched 23:00:08.531437 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:00:09.749902 run rm-remote-dir(pid=10905): Launched 23:00:09.938460 run srsepc(pid=10904): ERR: Terminated: ERROR {rc=127} [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10904)] 23:00:10.082249 run srsepc(pid=10904): stdout: | (launched: 2022-12-13_23:00:08.349270) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:10.227439 run srsepc(pid=10904): stderr: | (launched: 2022-12-13_23:00:08.398197) | Connection to 10.42.42.116 closed. 23:00:10.372324 run srsepc(pid=10904): stdout: | (launched: 2022-12-13_23:00:08.349270) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:10.511324 run srsepc(pid=10904): stderr: | (launched: 2022-12-13_23:00:08.398197) | Connection to 10.42.42.116 closed. 23:00:10.675991 run rm-remote-dir(pid=10905): Terminating (SIGINT) 23:00:10.866027 run rm-remote-dir(pid=10905): Terminated: ok {rc=0} 23:00:11.003803 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=10904): Process ended prematurely: srsepc(pid=10904) [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10904)] [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 23:00:11.014747 tst iperf3_bidir.py:42: Test FAILED (19.0 sec) 23:00:11.095486 run scp-back-log(pid=10906): Launched 23:00:12.174421 run scp-back-log(pid=10906): ERR: Terminated: ERROR {rc=1} [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10906)] 23:00:12.239147 run scp-back-log(pid=10906): stdout: | (launched: 2022-12-13_23:00:11.063996) 23:00:12.304690 run scp-back-log(pid=10906): stderr: | (launched: 2022-12-13_23:00:11.084745) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:00:12.378776 tst srsepc_10.42.42.118: Error('scp-back-log(pid=10906): launch_sync(): local process exited with status 1 [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10906)]') ---------------------------------------------- trial-2395 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 23:00:12.426102 tst iperf3_dl.py:13: Number of physical ue: 1 23:00:12.648790 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:00:12.694541 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 23:00:12.915496 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:00:12.931985 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:00:12.965183 tst iperf3_dl.py: using MSISDN 8380 23:00:13.078500 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8380', subscriber_id=0} 23:00:13.186542 run srsepc_10.42.42.118: Starting srsepc 23:00:13.814533 run rm-remote-dir(pid=10920): Launched 23:00:14.995404 run rm-remote-dir(pid=10920): Terminated: ok {rc=0} 23:00:15.332577 run mk-remote-dir(pid=10921): Launched 23:00:16.516369 run mk-remote-dir(pid=10921): Terminated: ok {rc=0} 23:00:16.814770 run scp-inst-to-remote(pid=10922): Launched 23:00:19.053681 run scp-inst-to-remote(pid=10922): Terminated: ok {rc=0} 23:00:19.411331 run rm-remote-dir(pid=10924): Launched 23:00:20.602569 run rm-remote-dir(pid=10924): Terminated: ok {rc=0} 23:00:20.962201 run mk-remote-dir(pid=10925): Launched 23:00:22.153930 run mk-remote-dir(pid=10925): Terminated: ok {rc=0} 23:00:22.459668 run scp-cfg-to-remote(pid=10926): Launched 23:00:23.647111 run scp-cfg-to-remote(pid=10926): Terminated: ok {rc=0} 23:00:23.950930 run scp-db-to-remote(pid=10928): Launched 23:00:25.140735 run scp-db-to-remote(pid=10928): Terminated: ok {rc=0} 23:00:25.281928 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:00:25.612922 run patchelf(pid=10930): Launched 23:00:26.802118 run patchelf(pid=10930): Terminated: ok {rc=0} 23:00:26.943734 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:00:27.274524 run setcap-netadm(pid=10931): Launched 23:00:28.462408 run setcap-netadm(pid=10931): Terminated: ok {rc=0} 23:00:28.808912 run srsepc(pid=10932): Launched 23:00:28.931586 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:00:30.115367 run rm-remote-dir(pid=10933): Launched 23:00:30.303689 run srsepc(pid=10932): ERR: Terminated: ERROR {rc=127} [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10932)] 23:00:30.447123 run srsepc(pid=10932): stdout: | (launched: 2022-12-13_23:00:28.749535) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:30.591578 run srsepc(pid=10932): stderr: | (launched: 2022-12-13_23:00:28.798253) | Connection to 10.42.42.116 closed. 23:00:30.735612 run srsepc(pid=10932): stdout: | (launched: 2022-12-13_23:00:28.749535) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:30.898613 run srsepc(pid=10932): stderr: | (launched: 2022-12-13_23:00:28.798253) | Connection to 10.42.42.116 closed. 23:00:31.065495 run rm-remote-dir(pid=10933): Terminating (SIGINT) 23:00:31.257490 run rm-remote-dir(pid=10933): Terminated: ok {rc=0} 23:00:31.397098 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=10932): Process ended prematurely: srsepc(pid=10932) [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10932)] [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 23:00:31.408339 tst iperf3_dl.py:42: Test FAILED (19.0 sec) 23:00:31.496236 run scp-back-log(pid=10934): Launched 23:00:32.611431 run scp-back-log(pid=10934): ERR: Terminated: ERROR {rc=1} [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10934)] 23:00:32.675600 run scp-back-log(pid=10934): stdout: | (launched: 2022-12-13_23:00:31.458742) 23:00:32.741192 run scp-back-log(pid=10934): stderr: | (launched: 2022-12-13_23:00:31.479545) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:00:32.815022 tst srsepc_10.42.42.118: Error('scp-back-log(pid=10934): launch_sync(): local process exited with status 1 [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10934)]') ---------------------------------------------- trial-2395 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 23:00:32.862281 tst iperf3_ul.py:13: Number of physical ue: 1 23:00:33.084519 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:00:33.128136 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 23:00:33.349488 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:00:33.365912 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:00:33.399340 tst iperf3_ul.py: using MSISDN 8381 23:00:33.519702 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8381', subscriber_id=0} 23:00:33.635144 run srsepc_10.42.42.118: Starting srsepc 23:00:34.309476 run rm-remote-dir(pid=10936): Launched 23:00:35.502141 run rm-remote-dir(pid=10936): Terminated: ok {rc=0} 23:00:35.863297 run mk-remote-dir(pid=10937): Launched 23:00:37.056459 run mk-remote-dir(pid=10937): Terminated: ok {rc=0} 23:00:37.364292 run scp-inst-to-remote(pid=10938): Launched 23:00:39.555727 run scp-inst-to-remote(pid=10938): Terminated: ok {rc=0} 23:00:39.914829 run rm-remote-dir(pid=10940): Launched 23:00:41.107220 run rm-remote-dir(pid=10940): Terminated: ok {rc=0} 23:00:41.467806 run mk-remote-dir(pid=10941): Launched 23:00:42.660545 run mk-remote-dir(pid=10941): Terminated: ok {rc=0} 23:00:42.968522 run scp-cfg-to-remote(pid=10942): Launched 23:00:44.157859 run scp-cfg-to-remote(pid=10942): Terminated: ok {rc=0} 23:00:44.462359 run scp-db-to-remote(pid=10944): Launched 23:00:45.652785 run scp-db-to-remote(pid=10944): Terminated: ok {rc=0} 23:00:45.794137 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:00:46.198766 run patchelf(pid=10946): Launched 23:00:47.437246 run patchelf(pid=10946): Terminated: ok {rc=0} 23:00:47.579839 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:00:47.911720 run setcap-netadm(pid=10947): Launched 23:00:49.101543 run setcap-netadm(pid=10947): Terminated: ok {rc=0} 23:00:49.447454 run srsepc(pid=10948): Launched 23:00:49.570947 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:00:50.760190 run rm-remote-dir(pid=10949): Launched 23:00:50.949871 run srsepc(pid=10948): ERR: Terminated: ERROR {rc=127} [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10948)] 23:00:51.094439 run srsepc(pid=10948): stdout: | (launched: 2022-12-13_23:00:49.387676) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:51.239615 run srsepc(pid=10948): stderr: | (launched: 2022-12-13_23:00:49.436725) | Connection to 10.42.42.116 closed. 23:00:51.385382 run srsepc(pid=10948): stdout: | (launched: 2022-12-13_23:00:49.387676) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:00:51.526139 run srsepc(pid=10948): stderr: | (launched: 2022-12-13_23:00:49.436725) | Connection to 10.42.42.116 closed. 23:00:51.691621 run rm-remote-dir(pid=10949): Terminating (SIGINT) 23:00:51.882367 run rm-remote-dir(pid=10949): Terminated: ok {rc=0} 23:00:52.019610 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=10948): Process ended prematurely: srsepc(pid=10948) [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10948)] [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 23:00:52.029621 tst iperf3_ul.py:42: Test FAILED (19.2 sec) 23:00:52.106581 run scp-back-log(pid=10954): Launched 23:00:53.185058 run scp-back-log(pid=10954): ERR: Terminated: ERROR {rc=1} [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10954)] 23:00:53.246136 run scp-back-log(pid=10954): stdout: | (launched: 2022-12-13_23:00:52.076542) 23:00:53.308535 run scp-back-log(pid=10954): stderr: | (launched: 2022-12-13_23:00:52.096476) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:00:53.379217 tst srsepc_10.42.42.118: Error('scp-back-log(pid=10954): launch_sync(): local process exited with status 1 [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10954)]') ---------------------------------------------- trial-2395 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 23:00:53.424744 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:00:53.441420 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:00:53.463995 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:00:53.513100 tst ping.py: using MSISDN 8382 23:00:53.635598 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8382', subscriber_id=0} 23:00:53.751588 run srsepc_10.42.42.118: Starting srsepc 23:00:54.428161 run rm-remote-dir(pid=10956): Launched 23:00:55.620366 run rm-remote-dir(pid=10956): Terminated: ok {rc=0} 23:00:55.980644 run mk-remote-dir(pid=10957): Launched 23:00:57.171929 run mk-remote-dir(pid=10957): Terminated: ok {rc=0} 23:00:57.478253 run scp-inst-to-remote(pid=10958): Launched 23:00:59.668835 run scp-inst-to-remote(pid=10958): Terminated: ok {rc=0} 23:01:00.026842 run rm-remote-dir(pid=10960): Launched 23:01:01.216782 run rm-remote-dir(pid=10960): Terminated: ok {rc=0} 23:01:01.597724 run mk-remote-dir(pid=10961): Launched 23:01:02.819857 run mk-remote-dir(pid=10961): Terminated: ok {rc=0} 23:01:03.126430 run scp-cfg-to-remote(pid=10962): Launched 23:01:04.315001 run scp-cfg-to-remote(pid=10962): Terminated: ok {rc=0} 23:01:04.619074 run scp-db-to-remote(pid=10964): Launched 23:01:05.809226 run scp-db-to-remote(pid=10964): Terminated: ok {rc=0} 23:01:05.950208 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:01:06.280815 run patchelf(pid=10966): Launched 23:01:07.468629 run patchelf(pid=10966): Terminated: ok {rc=0} 23:01:07.609711 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:01:07.940510 run setcap-netadm(pid=10967): Launched 23:01:09.128627 run setcap-netadm(pid=10967): Terminated: ok {rc=0} 23:01:09.473325 run srsepc(pid=10968): Launched 23:01:09.595426 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:01:10.782356 run rm-remote-dir(pid=10969): Launched 23:01:10.972461 run srsepc(pid=10968): ERR: Terminated: ERROR {rc=127} [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10968)] 23:01:11.117079 run srsepc(pid=10968): stdout: | (launched: 2022-12-13_23:01:09.413682) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:11.262763 run srsepc(pid=10968): stderr: | (launched: 2022-12-13_23:01:09.462520) | Connection to 10.42.42.116 closed. 23:01:11.408236 run srsepc(pid=10968): stdout: | (launched: 2022-12-13_23:01:09.413682) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:11.547488 run srsepc(pid=10968): stderr: | (launched: 2022-12-13_23:01:09.462520) | Connection to 10.42.42.116 closed. 23:01:11.713298 run rm-remote-dir(pid=10969): Terminating (SIGINT) 23:01:11.904067 run rm-remote-dir(pid=10969): Terminated: ok {rc=0} 23:01:12.042387 tst ping.py:16: ERR: Error: srsepc(pid=10968): Process ended prematurely: srsepc(pid=10968) [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10968)] [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 23:01:12.053152 tst ping.py:16: Test FAILED (18.6 sec) 23:01:12.134133 run scp-back-log(pid=10970): Launched 23:01:13.214679 run scp-back-log(pid=10970): ERR: Terminated: ERROR {rc=1} [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10970)] 23:01:13.278928 run scp-back-log(pid=10970): stdout: | (launched: 2022-12-13_23:01:12.102743) 23:01:13.344707 run scp-back-log(pid=10970): stderr: | (launched: 2022-12-13_23:01:12.123374) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:01:13.418422 tst srsepc_10.42.42.118: Error('scp-back-log(pid=10970): launch_sync(): local process exited with status 1 [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10970)]') ---------------------------------------------- trial-2395 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 23:01:13.466079 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:01:13.483551 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:01:13.507763 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:01:13.561513 tst rrc_idle_mo_ping.py: using MSISDN 8383 23:01:13.685315 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8383', subscriber_id=0} 23:01:13.800462 run srsepc_10.42.42.118: Starting srsepc 23:01:14.474947 run rm-remote-dir(pid=10972): Launched 23:01:15.667087 run rm-remote-dir(pid=10972): Terminated: ok {rc=0} 23:01:16.059764 run mk-remote-dir(pid=10973): Launched 23:01:17.305895 run mk-remote-dir(pid=10973): Terminated: ok {rc=0} 23:01:17.616433 run scp-inst-to-remote(pid=10974): Launched 23:01:19.807495 run scp-inst-to-remote(pid=10974): Terminated: ok {rc=0} 23:01:20.164935 run rm-remote-dir(pid=10976): Launched 23:01:21.355849 run rm-remote-dir(pid=10976): Terminated: ok {rc=0} 23:01:21.715474 run mk-remote-dir(pid=10977): Launched 23:01:22.896715 run mk-remote-dir(pid=10977): Terminated: ok {rc=0} 23:01:23.184284 run scp-cfg-to-remote(pid=10978): Launched 23:01:24.363149 run scp-cfg-to-remote(pid=10978): Terminated: ok {rc=0} 23:01:24.647499 run scp-db-to-remote(pid=10980): Launched 23:01:25.826900 run scp-db-to-remote(pid=10980): Terminated: ok {rc=0} 23:01:25.958455 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:01:26.267930 run patchelf(pid=10982): Launched 23:01:27.446801 run patchelf(pid=10982): Terminated: ok {rc=0} 23:01:27.578544 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:01:27.887847 run setcap-netadm(pid=10983): Launched 23:01:29.065872 run setcap-netadm(pid=10983): Terminated: ok {rc=0} 23:01:29.389405 run srsepc(pid=10984): Launched 23:01:29.505977 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:01:30.682934 run rm-remote-dir(pid=10985): Launched 23:01:30.873387 run srsepc(pid=10984): ERR: Terminated: ERROR {rc=127} [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10984)] 23:01:31.049312 run srsepc(pid=10984): stdout: | (launched: 2022-12-13_23:01:29.332644) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:31.197546 run srsepc(pid=10984): stderr: | (launched: 2022-12-13_23:01:29.378566) | Connection to 10.42.42.116 closed. 23:01:31.346679 run srsepc(pid=10984): stdout: | (launched: 2022-12-13_23:01:29.332644) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:31.489159 run srsepc(pid=10984): stderr: | (launched: 2022-12-13_23:01:29.378566) | Connection to 10.42.42.116 closed. 23:01:31.657438 run rm-remote-dir(pid=10985): Terminating (SIGINT) 23:01:31.851393 run rm-remote-dir(pid=10985): Terminated: ok {rc=0} 23:01:31.993437 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=10984): Process ended prematurely: srsepc(pid=10984) [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10984)] [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 23:01:32.005222 tst rrc_idle_mo_ping.py:16: Test FAILED (18.5 sec) 23:01:32.098276 run scp-back-log(pid=10986): Launched 23:01:33.212840 run scp-back-log(pid=10986): ERR: Terminated: ERROR {rc=1} [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10986)] 23:01:33.277220 run scp-back-log(pid=10986): stdout: | (launched: 2022-12-13_23:01:32.057776) 23:01:33.343123 run scp-back-log(pid=10986): stderr: | (launched: 2022-12-13_23:01:32.078900) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:01:33.416989 tst srsepc_10.42.42.118: Error('scp-back-log(pid=10986): launch_sync(): local process exited with status 1 [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10986)]') ---------------------------------------------- trial-2395 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 23:01:33.464694 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:01:33.482261 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:01:33.506086 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:01:33.559015 tst rrc_idle_mt_ping.py: using MSISDN 8384 23:01:33.672335 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8384', subscriber_id=0} 23:01:33.778687 run srsepc_10.42.42.118: Starting srsepc 23:01:34.405605 run rm-remote-dir(pid=10988): Launched 23:01:35.587415 run rm-remote-dir(pid=10988): Terminated: ok {rc=0} 23:01:35.924060 run mk-remote-dir(pid=10989): Launched 23:01:37.104885 run mk-remote-dir(pid=10989): Terminated: ok {rc=0} 23:01:37.392700 run scp-inst-to-remote(pid=10990): Launched 23:01:39.577333 run scp-inst-to-remote(pid=10990): Terminated: ok {rc=0} 23:01:39.934902 run rm-remote-dir(pid=10992): Launched 23:01:41.127035 run rm-remote-dir(pid=10992): Terminated: ok {rc=0} 23:01:41.486032 run mk-remote-dir(pid=10993): Launched 23:01:42.677991 run mk-remote-dir(pid=10993): Terminated: ok {rc=0} 23:01:42.985189 run scp-cfg-to-remote(pid=10994): Launched 23:01:44.174495 run scp-cfg-to-remote(pid=10994): Terminated: ok {rc=0} 23:01:44.478185 run scp-db-to-remote(pid=10996): Launched 23:01:45.666899 run scp-db-to-remote(pid=10996): Terminated: ok {rc=0} 23:01:45.807237 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:01:46.167822 run patchelf(pid=10998): Launched 23:01:47.420355 run patchelf(pid=10998): Terminated: ok {rc=0} 23:01:47.552250 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:01:47.861775 run setcap-netadm(pid=10999): Launched 23:01:49.041126 run setcap-netadm(pid=10999): Terminated: ok {rc=0} 23:01:49.364768 run srsepc(pid=11000): Launched 23:01:49.481542 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:01:50.595032 run rm-remote-dir(pid=11001): Launched 23:01:50.773949 run srsepc(pid=11000): ERR: Terminated: ERROR {rc=127} [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11000)] 23:01:50.910093 run srsepc(pid=11000): stdout: | (launched: 2022-12-13_23:01:49.308453) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:51.044848 run srsepc(pid=11000): stderr: | (launched: 2022-12-13_23:01:49.354271) | Connection to 10.42.42.116 closed. 23:01:51.180055 run srsepc(pid=11000): stdout: | (launched: 2022-12-13_23:01:49.308453) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:01:51.309586 run srsepc(pid=11000): stderr: | (launched: 2022-12-13_23:01:49.354271) | Connection to 10.42.42.116 closed. 23:01:51.462788 run rm-remote-dir(pid=11001): Terminating (SIGINT) 23:01:51.640587 run rm-remote-dir(pid=11001): Terminated: ok {rc=0} 23:01:51.769348 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=11000): Process ended prematurely: srsepc(pid=11000) [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11000)] [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 23:01:51.779144 tst rrc_idle_mt_ping.py:16: Test FAILED (18.3 sec) 23:01:51.855732 run scp-back-log(pid=11002): Launched 23:01:52.933728 run scp-back-log(pid=11002): ERR: Terminated: ERROR {rc=1} [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11002)] 23:01:52.994285 run scp-back-log(pid=11002): stdout: | (launched: 2022-12-13_23:01:51.825603) 23:01:53.056247 run scp-back-log(pid=11002): stderr: | (launched: 2022-12-13_23:01:51.845336) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:01:53.126055 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11002): launch_sync(): local process exited with status 1 [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11002)]') --------------------------------------------------------------------- trial-2395 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 23:01:53.259285 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:01:53.266308 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 23:01:53.310906 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 23:01:53.338097 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 23:01:53.391414 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 23:01:53.434450 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 23:01:53.460524 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 23:01:54.009495 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 23:01:54.014725 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:54.025522 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 23:01:54.062623 tst handover.py: using LAC 36819 23:01:54.182463 tst handover.py: using RAC 99 23:01:54.301399 tst handover.py: using CellId 36819 23:01:54.418623 tst handover.py: using BVCI 36820 23:01:54.529900 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 23:01:54.562559 tst handover.py: using LAC 36820 23:01:54.680645 tst handover.py: using RAC 100 23:01:54.798155 tst handover.py: using CellId 36820 23:01:54.917675 tst handover.py: using BVCI 36821 23:01:55.029734 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:55.040386 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:55.051017 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:55.061525 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:55.072115 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:01:55.082687 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 23:01:55.201710 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 23:01:55.317868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:01:55.786355 run create_hlr_db(pid=11008): Launched 23:01:56.956404 run create_hlr_db(pid=11008): Terminated: ok {rc=0} 23:01:57.275410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11010): Launched 23:01:57.577589 run osmo-hlr_10.42.42.2(pid=11011): Launched 23:01:57.693646 run osmo-stp_10.42.42.5: Starting osmo-stp 23:01:58.226116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11013): Launched 23:01:58.527420 run osmo-stp_10.42.42.5(pid=11014): Launched 23:01:58.642955 run osmo-msc_10.42.42.6: Starting osmo-msc 23:01:59.188929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11016): Launched 23:01:59.490898 run osmo-msc_10.42.42.6(pid=11018): Launched 23:01:59.659891 run osmo-stp_10.42.42.5(pid=11014): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11014)] 23:01:59.787320 run osmo-stp_10.42.42.5(pid=11014): stdout: | (launched: 2022-12-13_23:01:58.472250) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:01:59.914448 run osmo-stp_10.42.42.5(pid=11014): stderr: | 20221213230158642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230158642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230158643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230158643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230158645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230158646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230158646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:00.040410 run osmo-stp_10.42.42.5(pid=11014): stdout: | (launched: 2022-12-13_23:01:58.472250) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:00.160226 run osmo-stp_10.42.42.5(pid=11014): stderr: | 20221213230158642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230158642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230158643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230158643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230158645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230158646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230158646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:00.303432 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11014): Process ended prematurely: osmo-stp_10.42.42.5(pid=11014) [trial-2395↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11014)] [trial-2395↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 23:02:00.311593 tst handover.py:18: Test FAILED (6.3 sec) 23:02:00.337424 run osmo-hlr_10.42.42.2(pid=11011): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11011)] 23:02:00.384679 run osmo-hlr_10.42.42.2(pid=11011): stdout: | (launched: 2022-12-13_23:01:57.522472) 23:02:00.433642 run osmo-hlr_10.42.42.2(pid=11011): stderr: | 20221213230157699 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230157699 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230157699 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230157699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230157699 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230157699 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230157711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230157722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230157723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230157723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:00.501935 run osmo-msc_10.42.42.6(pid=11018): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11018)] 23:02:00.548830 run osmo-msc_10.42.42.6(pid=11018): stdout: | (launched: 2022-12-13_23:01:59.435883) 23:02:00.597366 run osmo-msc_10.42.42.6(pid=11018): stderr: | 20221213230159709 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230159709 DLGLOBAL DEBUG validating counter group 0x7f6adf8d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230159709 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230159709 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230159709 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230159710 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230159711 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230159712 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230159712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230159712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:02:00.646160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11010): Terminating (SIGTERM) 23:02:00.685438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11013): Terminating (SIGTERM) 23:02:00.724867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11016): Terminating (SIGTERM) 23:02:00.764378 --- ParallelTerminationStrategy: PID 11010 died... 23:02:00.783302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11010): Terminated: ok {rc=0} 23:02:00.827087 --- ParallelTerminationStrategy: PID 11013 died... 23:02:00.864505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11013): Terminated: ok {rc=0} 23:02:00.942187 --- ParallelTerminationStrategy: PID 11016 died... 23:02:00.964484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11016): Terminated: ok {rc=0} 23:02:01.080398 bus /sierra_3: Setting Powered False 23:02:02.191764 bus /sierra_3: Setting Powered False 23:02:03.303503 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 23:02:04.549256 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:04.554743 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 23:02:04.596819 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 23:02:04.624790 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 23:02:04.679558 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 23:02:04.720280 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 23:02:04.748240 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 23:02:05.296179 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 23:02:05.301672 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:05.312429 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 23:02:05.349385 tst handover.py: using LAC 36821 23:02:05.467735 tst handover.py: using RAC 101 23:02:05.586665 tst handover.py: using CellId 36821 23:02:05.705210 tst handover.py: using BVCI 36822 23:02:05.815605 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 23:02:05.849682 tst handover.py: using LAC 36822 23:02:05.979935 tst handover.py: using RAC 102 23:02:06.099532 tst handover.py: using CellId 36822 23:02:06.228091 tst handover.py: using BVCI 36823 23:02:06.346120 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:06.357584 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:06.368689 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:06.380063 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:06.391750 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:02:06.403121 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 23:02:06.519623 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 23:02:06.638893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:07.112786 run create_hlr_db(pid=11025): Launched 23:02:07.245047 bus /sierra_2: Setting Powered False 23:02:08.308849 run create_hlr_db(pid=11025): Terminated: ok {rc=0} 23:02:08.716576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11027): Launched 23:02:09.020620 run osmo-hlr_10.42.42.2(pid=11028): Launched 23:02:09.137670 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:09.649523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11030): Launched 23:02:09.951616 run osmo-stp_10.42.42.5(pid=11031): Launched 23:02:10.067377 run osmo-msc_10.42.42.6: Starting osmo-msc 23:02:10.589646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11033): Launched 23:02:10.892767 run osmo-msc_10.42.42.6(pid=11034): Launched 23:02:11.063447 run osmo-stp_10.42.42.5(pid=11031): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11031)] 23:02:11.192237 run osmo-stp_10.42.42.5(pid=11031): stdout: | (launched: 2022-12-13_23:02:09.896318) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:11.320362 run osmo-stp_10.42.42.5(pid=11031): stderr: | 20221213230210067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230210068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230210068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230210068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230210069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230210069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230210069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:11.446390 run osmo-stp_10.42.42.5(pid=11031): stdout: | (launched: 2022-12-13_23:02:09.896318) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:11.566770 run osmo-stp_10.42.42.5(pid=11031): stderr: | 20221213230210067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230210068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230210068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230210068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230210069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230210069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230210069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:11.710955 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11031): Process ended prematurely: osmo-stp_10.42.42.5(pid=11031) [trial-2395↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11031)] [trial-2395↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 23:02:11.719009 tst handover.py:18: Test FAILED (6.4 sec) 23:02:11.744900 run osmo-hlr_10.42.42.2(pid=11028): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11028)] 23:02:11.792033 run osmo-hlr_10.42.42.2(pid=11028): stdout: | (launched: 2022-12-13_23:02:08.965175) 23:02:11.841044 run osmo-hlr_10.42.42.2(pid=11028): stderr: | 20221213230209142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230209142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230209142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230209142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230209142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230209142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230209154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230209165 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230209165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230209166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:11.909507 run osmo-msc_10.42.42.6(pid=11034): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11034)] 23:02:11.956646 run osmo-msc_10.42.42.6(pid=11034): stdout: | (launched: 2022-12-13_23:02:10.837513) 23:02:12.005301 run osmo-msc_10.42.42.6(pid=11034): stderr: | 20221213230211111 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230211111 DLGLOBAL DEBUG validating counter group 0x7f1b31ad2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230211111 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230211111 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230211112 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230211112 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230211115 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230211115 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230211115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230211115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:02:12.054495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11027): Terminating (SIGTERM) 23:02:12.093614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11030): Terminating (SIGTERM) 23:02:12.133567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11033): Terminating (SIGTERM) 23:02:12.173089 --- ParallelTerminationStrategy: PID 11027 died... 23:02:12.191834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11027): Terminated: ok {rc=0} 23:02:12.235738 --- ParallelTerminationStrategy: PID 11030 died... 23:02:12.254077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11030): Terminated: ok {rc=0} 23:02:12.297473 --- ParallelTerminationStrategy: PID 11033 died... 23:02:12.315837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11033): Terminated: ok {rc=0} 23:02:12.401454 bus /sierra_3: Setting Powered False 23:02:13.500325 bus /sierra_3: Setting Powered False 23:02:14.615469 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 23:02:15.864254 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:15.870207 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 23:02:15.948392 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 23:02:15.977360 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 23:02:16.041447 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 23:02:16.101541 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 23:02:16.138682 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 23:02:16.707745 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 23:02:16.716227 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:16.728191 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:02:16.769123 tst handover.py: using LAC 36823 23:02:16.899932 tst handover.py: using RAC 103 23:02:17.022260 tst handover.py: using CellId 36823 23:02:17.200821 tst handover.py: using BVCI 36824 23:02:17.312501 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:02:17.361316 tst handover.py: using LAC 36824 23:02:17.488652 tst handover.py: using RAC 104 23:02:17.614491 tst handover.py: using CellId 36824 23:02:17.740334 tst handover.py: using BVCI 36825 23:02:17.852915 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:17.863679 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:17.874313 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:17.884906 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:17.896085 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:02:17.907241 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:02:18.029692 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:02:18.146641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:18.591465 run create_hlr_db(pid=11039): Launched 23:02:18.715135 bus /sierra_2: Setting Powered False 23:02:19.775491 run create_hlr_db(pid=11039): Terminated: ok {rc=0} 23:02:20.172579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11041): Launched 23:02:20.476534 run osmo-hlr_10.42.42.2(pid=11042): Launched 23:02:20.592660 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:21.086357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11044): Launched 23:02:21.388316 run osmo-stp_10.42.42.5(pid=11045): Launched 23:02:21.504579 run osmo-msc_10.42.42.6: Starting osmo-msc 23:02:22.026174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11047): Launched 23:02:22.329808 run osmo-msc_10.42.42.6(pid=11048): Launched 23:02:22.499385 run osmo-stp_10.42.42.5(pid=11045): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11045)] 23:02:22.631171 run osmo-stp_10.42.42.5(pid=11045): stdout: | (launched: 2022-12-13_23:02:21.333147) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:22.758672 run osmo-stp_10.42.42.5(pid=11045): stderr: | 20221213230221504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230221504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230221504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230221505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230221505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230221505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230221505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:22.884625 run osmo-stp_10.42.42.5(pid=11045): stdout: | (launched: 2022-12-13_23:02:21.333147) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:23.004916 run osmo-stp_10.42.42.5(pid=11045): stderr: | 20221213230221504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230221504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230221504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230221505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230221505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230221505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230221505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:23.148892 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11045): Process ended prematurely: osmo-stp_10.42.42.5(pid=11045) [trial-2395↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11045)] [trial-2395↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 23:02:23.157167 tst handover.py:18: Test FAILED (6.4 sec) 23:02:23.183081 run osmo-hlr_10.42.42.2(pid=11042): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11042)] 23:02:23.230465 run osmo-hlr_10.42.42.2(pid=11042): stdout: | (launched: 2022-12-13_23:02:20.420850) 23:02:23.279715 run osmo-hlr_10.42.42.2(pid=11042): stderr: | 20221213230220599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230220599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230220599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230220599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230220599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230220599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230220614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230220624 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230220625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230220625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:23.348073 run osmo-msc_10.42.42.6(pid=11048): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11048)] 23:02:23.395109 run osmo-msc_10.42.42.6(pid=11048): stdout: | (launched: 2022-12-13_23:02:22.274707) 23:02:23.443921 run osmo-msc_10.42.42.6(pid=11048): stderr: | 20221213230222548 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230222548 DLGLOBAL DEBUG validating counter group 0x7fd0a5754c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230222548 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230222548 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230222548 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230222548 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230222550 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230222551 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230222551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230222551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:02:23.493272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11041): Terminating (SIGTERM) 23:02:23.532744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11044): Terminating (SIGTERM) 23:02:23.571910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11047): Terminating (SIGTERM) 23:02:23.611428 --- ParallelTerminationStrategy: PID 11041 died... 23:02:23.630616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11041): Terminated: ok {rc=0} 23:02:23.674582 --- ParallelTerminationStrategy: PID 11044 died... 23:02:23.693101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11044): Terminated: ok {rc=0} 23:02:23.736776 --- ParallelTerminationStrategy: PID 11047 died... 23:02:23.755387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11047): Terminated: ok {rc=0} 23:02:23.839423 bus /sierra_3: Setting Powered False 23:02:24.938058 bus /sierra_3: Setting Powered False 23:02:26.055767 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 23:02:27.320181 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:27.325917 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 23:02:27.377138 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:02:27.404063 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 23:02:27.457298 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 23:02:27.508679 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:02:27.535764 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 23:02:28.084696 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 23:02:28.090135 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:28.101356 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:02:28.139033 tst handover.py: using LAC 36825 23:02:28.258308 tst handover.py: using RAC 105 23:02:28.378449 tst handover.py: using CellId 36825 23:02:28.499296 tst handover.py: using BVCI 36826 23:02:28.609957 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:02:28.654309 tst handover.py: using LAC 36826 23:02:28.775263 tst handover.py: using RAC 106 23:02:28.895671 tst handover.py: using CellId 36826 23:02:29.016298 tst handover.py: using BVCI 36827 23:02:29.125952 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:29.136859 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:29.147658 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:29.158597 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:29.169572 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:02:29.180305 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:02:29.301989 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:02:29.421306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:29.897382 run create_hlr_db(pid=11053): Launched 23:02:30.022406 bus /sierra_2: Setting Powered False 23:02:31.081741 run create_hlr_db(pid=11053): Terminated: ok {rc=0} 23:02:31.497622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11055): Launched 23:02:31.827148 run osmo-hlr_10.42.42.2(pid=11056): Launched 23:02:31.957719 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:32.586414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11058): Launched 23:02:32.911188 run osmo-stp_10.42.42.5(pid=11059): Launched 23:02:33.036920 run osmo-msc_10.42.42.6: Starting osmo-msc 23:02:33.599463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11061): Launched 23:02:33.925095 run osmo-msc_10.42.42.6(pid=11062): Launched 23:02:34.107510 run osmo-stp_10.42.42.5(pid=11059): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11059)] 23:02:34.244644 run osmo-stp_10.42.42.5(pid=11059): stdout: | (launched: 2022-12-13_23:02:32.852456) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:34.382538 run osmo-stp_10.42.42.5(pid=11059): stderr: | 20221213230233043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230233043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230233043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230233044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230233046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230233046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230233046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:34.519450 run osmo-stp_10.42.42.5(pid=11059): stdout: | (launched: 2022-12-13_23:02:32.852456) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:34.649152 run osmo-stp_10.42.42.5(pid=11059): stderr: | 20221213230233043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230233043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230233043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230233044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230233046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230233046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230233046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:34.804291 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11059): Process ended prematurely: osmo-stp_10.42.42.5(pid=11059) [trial-2395↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11059)] [trial-2395↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 23:02:34.813305 tst handover.py:18: Test FAILED (6.7 sec) 23:02:34.840469 run osmo-hlr_10.42.42.2(pid=11056): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11056)] 23:02:34.891082 run osmo-hlr_10.42.42.2(pid=11056): stdout: | (launched: 2022-12-13_23:02:31.769335) 23:02:34.943183 run osmo-hlr_10.42.42.2(pid=11056): stderr: | 20221213230232147 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230232147 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230232147 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230232147 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230232147 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230232147 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230232158 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230232175 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230232175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230232175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:35.015563 run osmo-msc_10.42.42.6(pid=11062): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11062)] 23:02:35.065220 run osmo-msc_10.42.42.6(pid=11062): stdout: | (launched: 2022-12-13_23:02:33.865579) 23:02:35.117162 run osmo-msc_10.42.42.6(pid=11062): stderr: | 20221213230234187 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230234187 DLGLOBAL DEBUG validating counter group 0x7f186175ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230234187 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230234187 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230234187 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230234187 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230234189 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230234190 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230234190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230234190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:02:35.169304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11055): Terminating (SIGTERM) 23:02:35.210540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11058): Terminating (SIGTERM) 23:02:35.252290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11061): Terminating (SIGTERM) 23:02:35.294750 --- ParallelTerminationStrategy: PID 11055 died... 23:02:35.314926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11055): Terminated: ok {rc=0} 23:02:35.361202 --- ParallelTerminationStrategy: PID 11058 died... 23:02:35.380925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11058): Terminated: ok {rc=0} 23:02:35.427140 --- ParallelTerminationStrategy: PID 11061 died... 23:02:35.446918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11061): Terminated: ok {rc=0} 23:02:35.537434 bus /sierra_3: Setting Powered False 23:02:36.637117 bus /sierra_3: Setting Powered False 23:02:37.757293 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:02:39.009067 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:39.014166 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:02:39.067641 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:02:39.093901 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:02:39.144498 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:02:39.197890 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:02:39.223933 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:02:39.776398 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:02:39.781837 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:39.792764 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:02:39.833350 tst handover.py: using LAC 36827 23:02:39.952278 tst handover.py: using RAC 107 23:02:40.081358 tst handover.py: using CellId 36827 23:02:40.208064 tst handover.py: using BVCI 36828 23:02:40.325394 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:02:40.374089 tst handover.py: using LAC 36828 23:02:40.501481 tst handover.py: using RAC 108 23:02:40.620892 tst handover.py: using CellId 36828 23:02:40.739159 tst handover.py: using BVCI 36829 23:02:40.850422 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:40.861514 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:40.872331 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:40.883281 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:40.894464 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:02:40.905382 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:02:41.027272 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:02:41.144088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:41.587549 run create_hlr_db(pid=11068): Launched 23:02:41.712337 bus /sierra_2: Setting Powered False 23:02:42.773122 run create_hlr_db(pid=11068): Terminated: ok {rc=0} 23:02:43.188596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11070): Launched 23:02:43.512191 run osmo-hlr_10.42.42.2(pid=11071): Launched 23:02:43.638389 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:44.172367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11073): Launched 23:02:44.497196 run osmo-stp_10.42.42.5(pid=11074): Launched 23:02:44.624225 run osmo-msc_10.42.42.6: Starting osmo-msc 23:02:45.184682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11076): Launched 23:02:45.508257 run osmo-msc_10.42.42.6(pid=11077): Launched 23:02:45.692209 run osmo-stp_10.42.42.5(pid=11074): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11074)] 23:02:45.839337 run osmo-stp_10.42.42.5(pid=11074): stdout: | (launched: 2022-12-13_23:02:44.438387) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:46.061668 run osmo-stp_10.42.42.5(pid=11074): stderr: | 20221213230244630 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230244630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230244630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230244630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230244631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230244631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230244631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:46.213603 run osmo-stp_10.42.42.5(pid=11074): stdout: | (launched: 2022-12-13_23:02:44.438387) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:46.338126 run osmo-stp_10.42.42.5(pid=11074): stderr: | 20221213230244630 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230244630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230244630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230244630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230244631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230244631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230244631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:46.487115 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11074): Process ended prematurely: osmo-stp_10.42.42.5(pid=11074) [trial-2395↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11074)] [trial-2395↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 23:02:46.496291 tst handover.py:18: Test FAILED (6.7 sec) 23:02:46.523472 run osmo-hlr_10.42.42.2(pid=11071): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11071)] 23:02:46.573376 run osmo-hlr_10.42.42.2(pid=11071): stdout: | (launched: 2022-12-13_23:02:43.453549) 23:02:46.623399 run osmo-hlr_10.42.42.2(pid=11071): stderr: | 20221213230243651 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230243651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230243651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230243651 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230243651 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230243651 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230243664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230243672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230243672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230243672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:46.692668 run osmo-msc_10.42.42.6(pid=11077): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11077)] 23:02:46.742339 run osmo-msc_10.42.42.6(pid=11077): stdout: | (launched: 2022-12-13_23:02:45.449636) 23:02:46.792075 run osmo-msc_10.42.42.6(pid=11077): stderr: | 20221213230245770 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230245770 DLGLOBAL DEBUG validating counter group 0x7fc6e5921c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230245770 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230245770 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230245771 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230245771 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230245772 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230245773 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230245773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230245773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:02:46.843343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11070): Terminating (SIGTERM) 23:02:46.884029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11073): Terminating (SIGTERM) 23:02:46.927366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11076): Terminating (SIGTERM) 23:02:46.970962 --- ParallelTerminationStrategy: PID 11070 died... 23:02:46.990665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11070): Terminated: ok {rc=0} 23:02:47.036812 --- ParallelTerminationStrategy: PID 11073 died... 23:02:47.055890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11073): Terminated: ok {rc=0} 23:02:47.100341 --- ParallelTerminationStrategy: PID 11076 died... 23:02:47.119466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11076): Terminated: ok {rc=0} 23:02:47.207911 bus /sierra_3: Setting Powered False 23:02:48.308519 bus /sierra_3: Setting Powered False 23:02:49.426932 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 23:02:50.692014 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:50.696864 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:02:50.738166 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:02:50.764548 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:02:50.814402 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:02:50.855234 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:02:50.881513 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:02:51.433053 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 23:02:51.438331 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:51.449323 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 23:02:51.486531 tst handover.py: using LAC 36829 23:02:51.604354 tst handover.py: using RAC 109 23:02:51.721507 tst handover.py: using CellId 36829 23:02:51.838748 tst handover.py: using BVCI 36830 23:02:51.948221 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 23:02:51.981397 tst handover.py: using LAC 36830 23:02:52.099063 tst handover.py: using RAC 110 23:02:52.217922 tst handover.py: using CellId 36830 23:02:52.334930 tst handover.py: using BVCI 36831 23:02:52.446785 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:52.457574 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:52.468162 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:52.478727 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:52.489337 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:02:52.499806 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 23:02:52.621227 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 23:02:52.737526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:53.213916 run create_hlr_db(pid=11082): Launched 23:02:53.338129 bus /sierra_2: Setting Powered False 23:02:54.402375 run create_hlr_db(pid=11082): Terminated: ok {rc=0} 23:02:54.825280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11084): Launched 23:02:55.149427 run osmo-hlr_10.42.42.2(pid=11085): Launched 23:02:55.275487 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:55.806218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11087): Launched 23:02:56.132206 run osmo-stp_10.42.42.5(pid=11088): Launched 23:02:56.257115 run osmo-msc_10.42.42.6: Starting osmo-msc 23:02:56.816369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11090): Launched 23:02:57.141545 run osmo-msc_10.42.42.6(pid=11091): Launched 23:02:57.322897 run osmo-stp_10.42.42.5(pid=11088): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11088)] 23:02:57.460185 run osmo-stp_10.42.42.5(pid=11088): stdout: | (launched: 2022-12-13_23:02:56.072510) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:57.598456 run osmo-stp_10.42.42.5(pid=11088): stderr: | 20221213230256265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230256265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230256265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230256266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230256266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230256266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230256266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:57.735083 run osmo-stp_10.42.42.5(pid=11088): stdout: | (launched: 2022-12-13_23:02:56.072510) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:57.864315 run osmo-stp_10.42.42.5(pid=11088): stderr: | 20221213230256265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230256265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230256265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230256266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230256266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230256266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230256266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:58.019423 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11088): Process ended prematurely: osmo-stp_10.42.42.5(pid=11088) [trial-2395↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11088)] [trial-2395↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 23:02:58.028338 tst handover.py:18: Test FAILED (6.6 sec) 23:02:58.055695 run osmo-hlr_10.42.42.2(pid=11085): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11085)] 23:02:58.106186 run osmo-hlr_10.42.42.2(pid=11085): stdout: | (launched: 2022-12-13_23:02:55.090614) 23:02:58.158254 run osmo-hlr_10.42.42.2(pid=11085): stderr: | 20221213230255288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230255288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230255288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230255288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230255288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230255288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230255300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230255309 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230255309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230255309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:58.230214 run osmo-msc_10.42.42.6(pid=11091): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11091)] 23:02:58.279653 run osmo-msc_10.42.42.6(pid=11091): stdout: | (launched: 2022-12-13_23:02:57.082489) 23:02:58.331021 run osmo-msc_10.42.42.6(pid=11091): stderr: | 20221213230257402 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230257402 DLGLOBAL DEBUG validating counter group 0x7f582424dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230257402 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230257402 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230257403 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230257403 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230257404 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230257405 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230257405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230257405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:02:58.382998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11084): Terminating (SIGTERM) 23:02:58.424438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11087): Terminating (SIGTERM) 23:02:58.466621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11090): Terminating (SIGTERM) 23:02:58.508849 --- ParallelTerminationStrategy: PID 11084 died... 23:02:58.529266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11084): Terminated: ok {rc=0} 23:02:58.575807 --- ParallelTerminationStrategy: PID 11087 died... 23:02:58.595747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11087): Terminated: ok {rc=0} 23:02:58.642003 --- ParallelTerminationStrategy: PID 11090 died... 23:02:58.662027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11090): Terminated: ok {rc=0} 23:02:58.749842 bus /sierra_3: Setting Powered False 23:02:59.847686 bus /sierra_3: Setting Powered False 23:03:00.971665 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 23:03:02.250434 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:03:02.256369 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:03:02.313820 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:03:02.340674 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:03:02.393869 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:03:02.446759 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:03:02.473134 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:03:03.022036 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 23:03:03.027420 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:03.038325 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:03:03.076032 tst handover.py: using LAC 36831 23:03:03.195526 tst handover.py: using RAC 111 23:03:03.315214 tst handover.py: using CellId 36831 23:03:03.435459 tst handover.py: using BVCI 36832 23:03:03.546735 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:03:03.598989 tst handover.py: using LAC 36832 23:03:03.717186 tst handover.py: using RAC 112 23:03:03.841499 tst handover.py: using CellId 36832 23:03:03.978428 tst handover.py: using BVCI 36833 23:03:04.098048 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:04.109564 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:04.120716 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:04.131950 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:04.143543 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:03:04.155050 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:03:04.275887 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:03:04.392479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:04.835283 run create_hlr_db(pid=11097): Launched 23:03:04.960557 bus /sierra_2: Setting Powered False 23:03:06.021485 run create_hlr_db(pid=11097): Terminated: ok {rc=0} 23:03:06.438626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11099): Launched 23:03:06.764572 run osmo-hlr_10.42.42.2(pid=11100): Launched 23:03:06.890421 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:07.422657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11102): Launched 23:03:07.747802 run osmo-stp_10.42.42.5(pid=11103): Launched 23:03:07.873014 run osmo-msc_10.42.42.6: Starting osmo-msc 23:03:08.434257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11105): Launched 23:03:08.759831 run osmo-msc_10.42.42.6(pid=11106): Launched 23:03:08.942849 run osmo-stp_10.42.42.5(pid=11103): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11103)] 23:03:09.081689 run osmo-stp_10.42.42.5(pid=11103): stdout: | (launched: 2022-12-13_23:03:07.688685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:09.219485 run osmo-stp_10.42.42.5(pid=11103): stderr: | 20221213230307881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230307882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230307882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230307882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230307883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230307883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230307883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:09.356918 run osmo-stp_10.42.42.5(pid=11103): stdout: | (launched: 2022-12-13_23:03:07.688685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:09.486809 run osmo-stp_10.42.42.5(pid=11103): stderr: | 20221213230307881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230307882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230307882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230307882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230307883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230307883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230307883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:09.641872 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11103): Process ended prematurely: osmo-stp_10.42.42.5(pid=11103) [trial-2395↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11103)] [trial-2395↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 23:03:09.650788 tst handover.py:18: Test FAILED (6.6 sec) 23:03:09.678573 run osmo-hlr_10.42.42.2(pid=11100): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11100)] 23:03:09.729167 run osmo-hlr_10.42.42.2(pid=11100): stdout: | (launched: 2022-12-13_23:03:06.705337) 23:03:09.780864 run osmo-hlr_10.42.42.2(pid=11100): stderr: | 20221213230306904 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230306904 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230306904 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230306904 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230306905 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230306905 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230306917 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230306926 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230306927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230306927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:09.853444 run osmo-msc_10.42.42.6(pid=11106): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11106)] 23:03:09.903202 run osmo-msc_10.42.42.6(pid=11106): stdout: | (launched: 2022-12-13_23:03:08.700817) 23:03:09.954845 run osmo-msc_10.42.42.6(pid=11106): stderr: | 20221213230309019 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230309020 DLGLOBAL DEBUG validating counter group 0x7f7dc99efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230309020 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230309020 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230309020 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230309020 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230309022 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230309022 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230309022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230309023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:03:10.007194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11099): Terminating (SIGTERM) 23:03:10.049166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11102): Terminating (SIGTERM) 23:03:10.091407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11105): Terminating (SIGTERM) 23:03:10.133835 --- ParallelTerminationStrategy: PID 11099 died... 23:03:10.154245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11099): Terminated: ok {rc=0} 23:03:10.200868 --- ParallelTerminationStrategy: PID 11102 died... 23:03:10.220871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11102): Terminated: ok {rc=0} 23:03:10.267388 --- ParallelTerminationStrategy: PID 11105 died... 23:03:10.287717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11105): Terminated: ok {rc=0} 23:03:10.377165 bus /sierra_3: Setting Powered False 23:03:11.475859 bus /sierra_3: Setting Powered False 23:03:12.593309 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 23:03:13.858680 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:03:13.864092 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:03:13.918786 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:03:13.945889 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:03:13.999232 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:03:14.053695 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:03:14.080589 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:03:14.632313 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 23:03:14.638170 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:14.649539 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:03:14.689697 tst handover.py: using LAC 36833 23:03:14.819529 tst handover.py: using RAC 113 23:03:14.947072 tst handover.py: using CellId 36833 23:03:15.076894 tst handover.py: using BVCI 36834 23:03:15.194466 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:03:15.243530 tst handover.py: using LAC 36834 23:03:15.363776 tst handover.py: using RAC 114 23:03:15.483234 tst handover.py: using CellId 36834 23:03:15.604524 tst handover.py: using BVCI 36835 23:03:15.716694 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:15.727700 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:15.738424 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:15.749031 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:15.759983 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:03:15.770693 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:03:15.900933 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:03:16.038027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:16.505858 run create_hlr_db(pid=11111): Launched 23:03:16.668021 bus /sierra_2: Setting Powered False 23:03:17.728589 run create_hlr_db(pid=11111): Terminated: ok {rc=0} 23:03:18.145243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11113): Launched 23:03:18.471609 run osmo-hlr_10.42.42.2(pid=11114): Launched 23:03:18.597550 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:19.131241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11116): Launched 23:03:19.455080 run osmo-stp_10.42.42.5(pid=11117): Launched 23:03:19.580906 run osmo-msc_10.42.42.6: Starting osmo-msc 23:03:20.140594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11119): Launched 23:03:20.463888 run osmo-msc_10.42.42.6(pid=11120): Launched 23:03:20.648733 run osmo-stp_10.42.42.5(pid=11117): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11117)] 23:03:20.786846 run osmo-stp_10.42.42.5(pid=11117): stdout: | (launched: 2022-12-13_23:03:19.396038) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:20.923850 run osmo-stp_10.42.42.5(pid=11117): stderr: | 20221213230319589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230319589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230319589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230319590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230319590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230319590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230319590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:21.060615 run osmo-stp_10.42.42.5(pid=11117): stdout: | (launched: 2022-12-13_23:03:19.396038) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:21.189807 run osmo-stp_10.42.42.5(pid=11117): stderr: | 20221213230319589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230319589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230319589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230319590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230319590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230319590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230319590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:21.344312 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11117): Process ended prematurely: osmo-stp_10.42.42.5(pid=11117) [trial-2395↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11117)] [trial-2395↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 23:03:21.353097 tst handover.py:18: Test FAILED (6.7 sec) 23:03:21.380285 run osmo-hlr_10.42.42.2(pid=11114): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11114)] 23:03:21.430894 run osmo-hlr_10.42.42.2(pid=11114): stdout: | (launched: 2022-12-13_23:03:18.412466) 23:03:21.482940 run osmo-hlr_10.42.42.2(pid=11114): stderr: | 20221213230318611 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230318611 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230318611 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230318611 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230318611 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230318611 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230318624 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230318633 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230318633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230318634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:21.555419 run osmo-msc_10.42.42.6(pid=11120): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11120)] 23:03:21.605411 run osmo-msc_10.42.42.6(pid=11120): stdout: | (launched: 2022-12-13_23:03:20.405068) 23:03:21.657249 run osmo-msc_10.42.42.6(pid=11120): stderr: | 20221213230320727 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230320727 DLGLOBAL DEBUG validating counter group 0x7f9dba405c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230320727 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230320727 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230320727 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230320727 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230320729 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230320730 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230320730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230320730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:03:21.709360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11113): Terminating (SIGTERM) 23:03:21.750635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11116): Terminating (SIGTERM) 23:03:21.792482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11119): Terminating (SIGTERM) 23:03:21.835047 --- ParallelTerminationStrategy: PID 11113 died... 23:03:21.855252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11113): Terminated: ok {rc=0} 23:03:21.901910 --- ParallelTerminationStrategy: PID 11116 died... 23:03:21.921769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11116): Terminated: ok {rc=0} 23:03:21.968033 --- ParallelTerminationStrategy: PID 11119 died... 23:03:21.988176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11119): Terminated: ok {rc=0} 23:03:22.076769 bus /sierra_3: Setting Powered False 23:03:23.174222 bus /sierra_3: Setting Powered False 23:03:24.290367 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 23:03:25.552293 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:03:25.558070 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 23:03:25.596420 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 23:03:25.624017 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 23:03:25.678680 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 23:03:25.716501 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 23:03:25.744110 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 23:03:26.288282 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 23:03:26.293715 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:26.304309 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 23:03:26.342216 tst handover.py: using LAC 36835 23:03:26.460714 tst handover.py: using RAC 115 23:03:26.578207 tst handover.py: using CellId 36835 23:03:26.697436 tst handover.py: using BVCI 36836 23:03:26.807400 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 23:03:26.840440 tst handover.py: using LAC 36836 23:03:26.957414 tst handover.py: using RAC 116 23:03:27.077590 tst handover.py: using CellId 36836 23:03:27.196846 tst handover.py: using BVCI 36837 23:03:27.305947 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:27.316574 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:27.327060 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:27.337847 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:27.348395 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:03:27.358920 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 23:03:27.475124 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 23:03:27.592602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:28.037816 run create_hlr_db(pid=11125): Launched 23:03:28.162671 bus /sierra_2: Setting Powered False 23:03:29.223240 run create_hlr_db(pid=11125): Terminated: ok {rc=0} 23:03:29.639261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11127): Launched 23:03:29.964373 run osmo-hlr_10.42.42.2(pid=11128): Launched 23:03:30.090010 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:30.621847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11130): Launched 23:03:30.969816 run osmo-stp_10.42.42.5(pid=11131): Launched 23:03:31.200127 run osmo-msc_10.42.42.6: Starting osmo-msc 23:03:32.045363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11133): Launched 23:03:32.391290 run osmo-msc_10.42.42.6(pid=11134): Launched 23:03:32.574718 run osmo-stp_10.42.42.5(pid=11131): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11131)] 23:03:32.716510 run osmo-stp_10.42.42.5(pid=11131): stdout: | (launched: 2022-12-13_23:03:30.895572) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:32.855141 run osmo-stp_10.42.42.5(pid=11131): stderr: | 20221213230331255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230331255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230331256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230331256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230331261 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230331261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230331261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:32.993294 run osmo-stp_10.42.42.5(pid=11131): stdout: | (launched: 2022-12-13_23:03:30.895572) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:33.123278 run osmo-stp_10.42.42.5(pid=11131): stderr: | 20221213230331255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230331255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230331256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230331256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230331261 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230331261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230331261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:33.278090 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11131): Process ended prematurely: osmo-stp_10.42.42.5(pid=11131) [trial-2395↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11131)] [trial-2395↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 23:03:33.287181 tst handover.py:18: Test FAILED (7.0 sec) 23:03:33.314338 run osmo-hlr_10.42.42.2(pid=11128): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11128)] 23:03:33.365135 run osmo-hlr_10.42.42.2(pid=11128): stdout: | (launched: 2022-12-13_23:03:29.905626) 23:03:33.417151 run osmo-hlr_10.42.42.2(pid=11128): stderr: | 20221213230330105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230330105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230330105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230330105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230330105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230330105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230330117 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230330126 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230330127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230330127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:33.489083 run osmo-msc_10.42.42.6(pid=11134): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11134)] 23:03:33.538930 run osmo-msc_10.42.42.6(pid=11134): stdout: | (launched: 2022-12-13_23:03:32.327468) 23:03:33.591016 run osmo-msc_10.42.42.6(pid=11134): stderr: | 20221213230332689 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230332689 DLGLOBAL DEBUG validating counter group 0x7fab1a391c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230332689 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230332689 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230332689 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230332689 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230332691 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230332691 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230332692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230332692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:03:33.643311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11127): Terminating (SIGTERM) 23:03:33.685225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11130): Terminating (SIGTERM) 23:03:33.727435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11133): Terminating (SIGTERM) 23:03:33.769586 --- ParallelTerminationStrategy: PID 11127 died... 23:03:33.790018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11127): Terminated: ok {rc=0} 23:03:33.836401 --- ParallelTerminationStrategy: PID 11130 died... 23:03:33.856284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11130): Terminated: ok {rc=0} 23:03:33.902479 --- ParallelTerminationStrategy: PID 11133 died... 23:03:33.922456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11133): Terminated: ok {rc=0} 23:03:34.010918 bus /sierra_3: Setting Powered False 23:03:35.109882 bus /sierra_3: Setting Powered False 23:03:36.226144 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 23:03:37.470396 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:03:37.475811 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 23:03:37.528011 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 23:03:37.555245 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 23:03:37.609697 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 23:03:37.661302 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 23:03:37.688398 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 23:03:38.234904 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 23:03:38.240291 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:38.251149 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:03:38.284804 tst handover.py: using LAC 36837 23:03:38.413651 tst handover.py: using RAC 117 23:03:38.533852 tst handover.py: using CellId 36837 23:03:38.662863 tst handover.py: using BVCI 36838 23:03:38.782139 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:03:38.831383 tst handover.py: using LAC 36838 23:03:38.951001 tst handover.py: using RAC 118 23:03:39.079638 tst handover.py: using CellId 36838 23:03:39.206732 tst handover.py: using BVCI 36839 23:03:39.326413 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:39.338119 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:39.349383 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:39.360569 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:39.372386 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:03:39.384163 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:03:39.503749 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:03:39.624438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:40.100293 run create_hlr_db(pid=11139): Launched 23:03:40.225784 bus /sierra_2: Setting Powered False 23:03:41.289726 run create_hlr_db(pid=11139): Terminated: ok {rc=0} 23:03:41.714885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11141): Launched 23:03:42.040515 run osmo-hlr_10.42.42.2(pid=11142): Launched 23:03:42.166683 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:42.698614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11144): Launched 23:03:43.024206 run osmo-stp_10.42.42.5(pid=11145): Launched 23:03:43.148638 run osmo-msc_10.42.42.6: Starting osmo-msc 23:03:43.706708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11147): Launched 23:03:44.031881 run osmo-msc_10.42.42.6(pid=11148): Launched 23:03:44.214637 run osmo-stp_10.42.42.5(pid=11145): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11145)] 23:03:44.351739 run osmo-stp_10.42.42.5(pid=11145): stdout: | (launched: 2022-12-13_23:03:42.964563) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:44.489694 run osmo-stp_10.42.42.5(pid=11145): stderr: | 20221213230343156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230343156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230343156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230343156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230343157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230343157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230343157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:44.626814 run osmo-stp_10.42.42.5(pid=11145): stdout: | (launched: 2022-12-13_23:03:42.964563) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:44.756593 run osmo-stp_10.42.42.5(pid=11145): stderr: | 20221213230343156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230343156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230343156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230343156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230343157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230343157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230343157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:44.912042 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11145): Process ended prematurely: osmo-stp_10.42.42.5(pid=11145) [trial-2395↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11145)] [trial-2395↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 23:03:44.921264 tst handover.py:18: Test FAILED (6.7 sec) 23:03:44.948499 run osmo-hlr_10.42.42.2(pid=11142): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11142)] 23:03:44.999565 run osmo-hlr_10.42.42.2(pid=11142): stdout: | (launched: 2022-12-13_23:03:41.981128) 23:03:45.052271 run osmo-hlr_10.42.42.2(pid=11142): stderr: | 20221213230342180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230342180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230342180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230342181 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230342181 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230342181 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230342193 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230342201 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230342201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230342202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:45.124387 run osmo-msc_10.42.42.6(pid=11148): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11148)] 23:03:45.173694 run osmo-msc_10.42.42.6(pid=11148): stdout: | (launched: 2022-12-13_23:03:43.972477) 23:03:45.225229 run osmo-msc_10.42.42.6(pid=11148): stderr: | 20221213230344293 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230344293 DLGLOBAL DEBUG validating counter group 0x7f510c524c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230344293 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230344293 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230344293 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230344293 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230344295 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230344295 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230344296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230344296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:03:45.277750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11141): Terminating (SIGTERM) 23:03:45.319210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11144): Terminating (SIGTERM) 23:03:45.360912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11147): Terminating (SIGTERM) 23:03:45.403221 --- ParallelTerminationStrategy: PID 11141 died... 23:03:45.423332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11141): Terminated: ok {rc=0} 23:03:45.469335 --- ParallelTerminationStrategy: PID 11144 died... 23:03:45.488773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11144): Terminated: ok {rc=0} 23:03:45.534694 --- ParallelTerminationStrategy: PID 11147 died... 23:03:45.554266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11147): Terminated: ok {rc=0} 23:03:45.642260 bus /sierra_3: Setting Powered False 23:03:46.741509 bus /sierra_3: Setting Powered False 23:03:47.855989 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 23:03:49.114425 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:03:49.119826 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 23:03:49.167843 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:03:49.194965 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 23:03:49.248120 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 23:03:49.296269 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:03:49.323568 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 23:03:49.872597 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 23:03:49.878075 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:49.889207 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:03:49.927199 tst handover.py: using LAC 36839 23:03:50.045566 tst handover.py: using RAC 119 23:03:50.165306 tst handover.py: using CellId 36839 23:03:50.283254 tst handover.py: using BVCI 36840 23:03:50.393725 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:03:50.437256 tst handover.py: using LAC 36840 23:03:50.554932 tst handover.py: using RAC 120 23:03:50.674431 tst handover.py: using CellId 36840 23:03:50.794196 tst handover.py: using BVCI 36841 23:03:50.905359 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:50.916468 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:50.927524 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:50.938594 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:50.949882 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:03:50.960916 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:03:51.081856 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:03:51.202897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:51.679534 run create_hlr_db(pid=11154): Launched 23:03:51.804806 bus /sierra_2: Setting Powered False 23:03:52.869330 run create_hlr_db(pid=11154): Terminated: ok {rc=0} 23:03:53.294512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11156): Launched 23:03:53.620074 run osmo-hlr_10.42.42.2(pid=11157): Launched 23:03:53.747158 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:54.278672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11159): Launched 23:03:54.604264 run osmo-stp_10.42.42.5(pid=11160): Launched 23:03:54.731011 run osmo-msc_10.42.42.6: Starting osmo-msc 23:03:55.291829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11162): Launched 23:03:55.616824 run osmo-msc_10.42.42.6(pid=11163): Launched 23:03:55.801220 run osmo-stp_10.42.42.5(pid=11160): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11160)] 23:03:55.938242 run osmo-stp_10.42.42.5(pid=11160): stdout: | (launched: 2022-12-13_23:03:54.545325) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:56.076915 run osmo-stp_10.42.42.5(pid=11160): stderr: | 20221213230354739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230354739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230354740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230354740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230354741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230354741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230354741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:56.213762 run osmo-stp_10.42.42.5(pid=11160): stdout: | (launched: 2022-12-13_23:03:54.545325) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:56.343148 run osmo-stp_10.42.42.5(pid=11160): stderr: | 20221213230354739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230354739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230354740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230354740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230354741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230354741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230354741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:56.497956 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11160): Process ended prematurely: osmo-stp_10.42.42.5(pid=11160) [trial-2395↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11160)] [trial-2395↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 23:03:56.506807 tst handover.py:18: Test FAILED (6.6 sec) 23:03:56.534156 run osmo-hlr_10.42.42.2(pid=11157): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11157)] 23:03:56.584404 run osmo-hlr_10.42.42.2(pid=11157): stdout: | (launched: 2022-12-13_23:03:53.561180) 23:03:56.636092 run osmo-hlr_10.42.42.2(pid=11157): stderr: | 20221213230353759 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230353759 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230353759 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230353760 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230353760 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230353760 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230353772 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230353780 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230353780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230353780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:56.708330 run osmo-msc_10.42.42.6(pid=11163): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11163)] 23:03:56.757754 run osmo-msc_10.42.42.6(pid=11163): stdout: | (launched: 2022-12-13_23:03:55.557986) 23:03:56.809087 run osmo-msc_10.42.42.6(pid=11163): stderr: | 20221213230355877 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230355877 DLGLOBAL DEBUG validating counter group 0x7f9950612c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230355877 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230355877 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230355877 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230355878 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230355879 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230355880 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230355880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230355880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:03:56.860718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11156): Terminating (SIGTERM) 23:03:56.902179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11159): Terminating (SIGTERM) 23:03:56.943646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11162): Terminating (SIGTERM) 23:03:56.985721 --- ParallelTerminationStrategy: PID 11156 died... 23:03:57.006184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11156): Terminated: ok {rc=0} 23:03:57.052370 --- ParallelTerminationStrategy: PID 11159 died... 23:03:57.072095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11159): Terminated: ok {rc=0} 23:03:57.118405 --- ParallelTerminationStrategy: PID 11162 died... 23:03:57.138095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11162): Terminated: ok {rc=0} 23:03:57.226100 bus /sierra_3: Setting Powered False 23:03:58.325031 bus /sierra_3: Setting Powered False 23:03:59.440865 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:04:00.698788 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:00.705364 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:04:00.756490 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:04:00.782844 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:04:00.839074 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:04:00.896411 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:04:00.927032 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:04:01.470962 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:04:01.477784 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:04:01.490679 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:04:01.527185 tst handover.py: using LAC 36841 23:04:01.693381 tst handover.py: using RAC 121 23:04:01.821451 tst handover.py: using CellId 36841 23:04:01.983666 tst handover.py: using BVCI 36842 23:04:02.124444 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:04:02.174854 tst handover.py: using LAC 36842 23:04:02.304851 tst handover.py: using RAC 122 23:04:02.432688 tst handover.py: using CellId 36842 23:04:02.558162 tst handover.py: using BVCI 36843 23:04:02.676652 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:04:02.688223 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:04:02.699625 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:04:02.711114 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:04:02.722914 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:04:02.734625 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:04:02.853802 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:04:02.969881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:03.415634 run create_hlr_db(pid=11168): Launched 23:04:03.541226 bus /sierra_2: Setting Powered False 23:04:04.601937 run create_hlr_db(pid=11168): Terminated: ok {rc=0} 23:04:05.019426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11170): Launched 23:04:05.345970 run osmo-hlr_10.42.42.2(pid=11171): Launched 23:04:05.471412 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:06.009953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11173): Launched 23:04:06.335251 run osmo-stp_10.42.42.5(pid=11174): Launched 23:04:06.460470 run osmo-msc_10.42.42.6: Starting osmo-msc 23:04:07.021816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11176): Launched 23:04:07.346701 run osmo-msc_10.42.42.6(pid=11177): Launched 23:04:07.529399 run osmo-stp_10.42.42.5(pid=11174): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11174)] 23:04:07.666980 run osmo-stp_10.42.42.5(pid=11174): stdout: | (launched: 2022-12-13_23:04:06.276197) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:07.804902 run osmo-stp_10.42.42.5(pid=11174): stderr: | 20221213230406466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230406466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230406466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230406467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230406469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230406469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230406469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:07.942110 run osmo-stp_10.42.42.5(pid=11174): stdout: | (launched: 2022-12-13_23:04:06.276197) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:08.072520 run osmo-stp_10.42.42.5(pid=11174): stderr: | 20221213230406466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230406466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230406466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230406467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230406469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230406469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230406469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:08.227941 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11174): Process ended prematurely: osmo-stp_10.42.42.5(pid=11174) [trial-2395↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11174)] [trial-2395↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 23:04:08.236812 tst handover.py:18: Test FAILED (6.8 sec) 23:04:08.264160 run osmo-hlr_10.42.42.2(pid=11171): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11171)] 23:04:08.314728 run osmo-hlr_10.42.42.2(pid=11171): stdout: | (launched: 2022-12-13_23:04:05.287106) 23:04:08.367064 run osmo-hlr_10.42.42.2(pid=11171): stderr: | 20221213230405485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230405485 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230405485 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230405485 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230405485 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230405485 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230405500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230405510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230405510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230405510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:08.438802 run osmo-msc_10.42.42.6(pid=11177): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11177)] 23:04:08.488127 run osmo-msc_10.42.42.6(pid=11177): stdout: | (launched: 2022-12-13_23:04:07.287509) 23:04:08.539529 run osmo-msc_10.42.42.6(pid=11177): stderr: | 20221213230407610 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230407611 DLGLOBAL DEBUG validating counter group 0x7f1e8f07ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230407611 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230407611 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230407611 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230407611 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230407613 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230407613 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230407613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230407614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:04:08.591505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11170): Terminating (SIGTERM) 23:04:08.633032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11173): Terminating (SIGTERM) 23:04:08.674893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11176): Terminating (SIGTERM) 23:04:08.717190 --- ParallelTerminationStrategy: PID 11170 died... 23:04:08.737410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11170): Terminated: ok {rc=0} 23:04:08.783920 --- ParallelTerminationStrategy: PID 11173 died... 23:04:08.803932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11173): Terminated: ok {rc=0} 23:04:08.850812 --- ParallelTerminationStrategy: PID 11176 died... 23:04:08.870979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11176): Terminated: ok {rc=0} 23:04:08.959022 bus /sierra_3: Setting Powered False 23:04:10.058963 bus /sierra_3: Setting Powered False 23:04:11.175273 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 23:04:12.438866 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:12.444923 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:04:12.482732 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:04:12.508931 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:04:12.562839 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:04:12.601179 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:04:12.627338 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:04:13.177983 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 23:04:13.183739 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:13.195116 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 23:04:13.233517 tst handover.py: using LAC 36843 23:04:13.353548 tst handover.py: using RAC 123 23:04:13.480413 tst handover.py: using CellId 36843 23:04:13.607771 tst handover.py: using BVCI 36844 23:04:13.726437 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 23:04:13.760317 tst handover.py: using LAC 36844 23:04:13.886105 tst handover.py: using RAC 124 23:04:14.011989 tst handover.py: using CellId 36844 23:04:14.140583 tst handover.py: using BVCI 36845 23:04:14.260518 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:14.271951 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:14.283208 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:14.294454 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:14.306190 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:04:14.318078 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 23:04:14.434790 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 23:04:14.553935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:15.030032 run create_hlr_db(pid=11182): Launched 23:04:15.154967 bus /sierra_2: Setting Powered False 23:04:16.217803 run create_hlr_db(pid=11182): Terminated: ok {rc=0} 23:04:16.654346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11184): Launched 23:04:16.995803 run osmo-hlr_10.42.42.2(pid=11185): Launched 23:04:17.163698 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:17.712095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11187): Launched 23:04:18.038514 run osmo-stp_10.42.42.5(pid=11188): Launched 23:04:18.164607 run osmo-msc_10.42.42.6: Starting osmo-msc 23:04:18.726059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11190): Launched 23:04:19.052497 run osmo-msc_10.42.42.6(pid=11191): Launched 23:04:19.235813 run osmo-stp_10.42.42.5(pid=11188): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11188)] 23:04:19.374313 run osmo-stp_10.42.42.5(pid=11188): stdout: | (launched: 2022-12-13_23:04:17.978754) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:19.513282 run osmo-stp_10.42.42.5(pid=11188): stderr: | 20221213230418170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230418170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230418171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230418171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230418173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230418174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230418174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:19.650751 run osmo-stp_10.42.42.5(pid=11188): stdout: | (launched: 2022-12-13_23:04:17.978754) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:19.780800 run osmo-stp_10.42.42.5(pid=11188): stderr: | 20221213230418170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230418170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230418171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230418171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230418173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230418174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230418174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:19.936404 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11188): Process ended prematurely: osmo-stp_10.42.42.5(pid=11188) [trial-2395↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11188)] [trial-2395↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 23:04:19.945528 tst handover.py:18: Test FAILED (6.8 sec) 23:04:19.973128 run osmo-hlr_10.42.42.2(pid=11185): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11185)] 23:04:20.025238 run osmo-hlr_10.42.42.2(pid=11185): stdout: | (launched: 2022-12-13_23:04:16.931657) 23:04:20.077759 run osmo-hlr_10.42.42.2(pid=11185): stderr: | 20221213230417239 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230417239 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230417239 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230417239 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230417239 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230417239 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230417253 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230417261 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230417261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230417261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:20.150394 run osmo-msc_10.42.42.6(pid=11191): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11191)] 23:04:20.200192 run osmo-msc_10.42.42.6(pid=11191): stdout: | (launched: 2022-12-13_23:04:18.992842) 23:04:20.252403 run osmo-msc_10.42.42.6(pid=11191): stderr: | 20221213230419315 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230419315 DLGLOBAL DEBUG validating counter group 0x7f2c100e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230419315 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230419316 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230419316 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230419316 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230419318 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230419318 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230419318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230419318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:04:20.305048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11184): Terminating (SIGTERM) 23:04:20.346719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11187): Terminating (SIGTERM) 23:04:20.388746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11190): Terminating (SIGTERM) 23:04:20.431155 --- ParallelTerminationStrategy: PID 11184 died... 23:04:20.451344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11184): Terminated: ok {rc=0} 23:04:20.497679 --- ParallelTerminationStrategy: PID 11187 died... 23:04:20.517313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11187): Terminated: ok {rc=0} 23:04:20.564019 --- ParallelTerminationStrategy: PID 11190 died... 23:04:20.583755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11190): Terminated: ok {rc=0} 23:04:20.671302 bus /sierra_3: Setting Powered False 23:04:21.770127 bus /sierra_3: Setting Powered False 23:04:22.889547 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 23:04:24.125449 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:24.131072 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:04:24.182231 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:04:24.208622 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:04:24.260528 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:04:24.310776 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:04:24.337140 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:04:24.894702 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 23:04:24.901339 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:24.913191 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:04:24.949184 tst handover.py: using LAC 36845 23:04:25.069045 tst handover.py: using RAC 125 23:04:25.188649 tst handover.py: using CellId 36845 23:04:25.307618 tst handover.py: using BVCI 36846 23:04:25.428103 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:04:25.475693 tst handover.py: using LAC 36846 23:04:25.602751 tst handover.py: using RAC 126 23:04:25.728520 tst handover.py: using CellId 36846 23:04:25.854341 tst handover.py: using BVCI 36847 23:04:25.973046 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:25.984339 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:25.995660 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:26.006751 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:26.019006 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:04:26.031016 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:04:26.149788 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:04:26.269967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:26.745706 run create_hlr_db(pid=11196): Launched 23:04:26.869842 bus /sierra_2: Setting Powered False 23:04:27.933887 run create_hlr_db(pid=11196): Terminated: ok {rc=0} 23:04:28.358606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11198): Launched 23:04:28.684579 run osmo-hlr_10.42.42.2(pid=11199): Launched 23:04:28.810111 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:29.342244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11201): Launched 23:04:29.666754 run osmo-stp_10.42.42.5(pid=11202): Launched 23:04:29.791495 run osmo-msc_10.42.42.6: Starting osmo-msc 23:04:30.351950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11204): Launched 23:04:30.677620 run osmo-msc_10.42.42.6(pid=11205): Launched 23:04:30.904403 run osmo-stp_10.42.42.5(pid=11202): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11202)] 23:04:31.206516 run osmo-stp_10.42.42.5(pid=11202): stdout: | (launched: 2022-12-13_23:04:29.607608) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:31.428413 run osmo-stp_10.42.42.5(pid=11202): stderr: | 20221213230429801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230429801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230429801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230429802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230429802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230429802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230429802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:31.571484 run osmo-stp_10.42.42.5(pid=11202): stdout: | (launched: 2022-12-13_23:04:29.607608) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:31.705956 run osmo-stp_10.42.42.5(pid=11202): stderr: | 20221213230429801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230429801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230429801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230429802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230429802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230429802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230429802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:31.865434 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11202): Process ended prematurely: osmo-stp_10.42.42.5(pid=11202) [trial-2395↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11202)] [trial-2395↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 23:04:31.875340 tst handover.py:18: Test FAILED (7.0 sec) 23:04:31.903946 run osmo-hlr_10.42.42.2(pid=11199): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11199)] 23:04:31.957723 run osmo-hlr_10.42.42.2(pid=11199): stdout: | (launched: 2022-12-13_23:04:28.625355) 23:04:32.011365 run osmo-hlr_10.42.42.2(pid=11199): stderr: | 20221213230428822 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230428822 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230428822 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230428823 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230428823 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230428823 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230428836 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230428844 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230428844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230428844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:32.086085 run osmo-msc_10.42.42.6(pid=11205): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11205)] 23:04:32.137866 run osmo-msc_10.42.42.6(pid=11205): stdout: | (launched: 2022-12-13_23:04:30.617604) 23:04:32.191433 run osmo-msc_10.42.42.6(pid=11205): stderr: | 20221213230431021 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230431021 DLGLOBAL DEBUG validating counter group 0x7f19db280c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230431021 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230431021 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230431021 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230431021 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230431023 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230431023 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230431024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230431024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:04:32.245425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11198): Terminating (SIGTERM) 23:04:32.287726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11201): Terminating (SIGTERM) 23:04:32.331709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11204): Terminating (SIGTERM) 23:04:32.374205 --- ParallelTerminationStrategy: PID 11198 died... 23:04:32.394846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11198): Terminated: ok {rc=0} 23:04:32.441388 --- ParallelTerminationStrategy: PID 11201 died... 23:04:32.461411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11201): Terminated: ok {rc=0} 23:04:32.507730 --- ParallelTerminationStrategy: PID 11204 died... 23:04:32.527942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11204): Terminated: ok {rc=0} 23:04:32.617304 bus /sierra_3: Setting Powered False 23:04:33.714445 bus /sierra_3: Setting Powered False 23:04:34.829708 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 23:04:36.081371 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:36.086607 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:04:36.135811 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:04:36.162240 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:04:36.213928 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:04:36.263149 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:04:36.289313 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:04:36.847834 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 23:04:36.853836 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:36.867278 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:04:36.907030 tst handover.py: using LAC 36847 23:04:37.026000 tst handover.py: using RAC 127 23:04:37.153454 tst handover.py: using CellId 36847 23:04:37.281378 tst handover.py: using BVCI 36848 23:04:37.391500 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:04:37.437583 tst handover.py: using LAC 36848 23:04:37.557300 tst handover.py: using RAC 128 23:04:37.674566 tst handover.py: using CellId 36848 23:04:37.791802 tst handover.py: using BVCI 36849 23:04:37.900858 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:37.911668 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:37.922304 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:37.932732 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:37.943351 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:04:37.953833 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:04:38.069191 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:04:38.189431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:38.665422 run create_hlr_db(pid=11212): Launched 23:04:38.790313 bus /sierra_2: Setting Powered False 23:04:39.851350 run create_hlr_db(pid=11212): Terminated: ok {rc=0} 23:04:40.248014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11214): Launched 23:04:40.551465 run osmo-hlr_10.42.42.2(pid=11215): Launched 23:04:40.669569 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:41.179159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11217): Launched 23:04:41.482097 run osmo-stp_10.42.42.5(pid=11218): Launched 23:04:41.598740 run osmo-msc_10.42.42.6: Starting osmo-msc 23:04:42.138165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11220): Launched 23:04:42.441614 run osmo-msc_10.42.42.6(pid=11221): Launched 23:04:42.612368 run osmo-stp_10.42.42.5(pid=11218): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11218)] 23:04:42.740567 run osmo-stp_10.42.42.5(pid=11218): stdout: | (launched: 2022-12-13_23:04:41.426648) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:42.868409 run osmo-stp_10.42.42.5(pid=11218): stderr: | 20221213230441598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230441599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230441599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230441599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230441600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230441600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230441600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:42.994538 run osmo-stp_10.42.42.5(pid=11218): stdout: | (launched: 2022-12-13_23:04:41.426648) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:43.114997 run osmo-stp_10.42.42.5(pid=11218): stderr: | 20221213230441598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230441599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230441599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230441599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230441600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230441600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230441600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:43.259143 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11218): Process ended prematurely: osmo-stp_10.42.42.5(pid=11218) [trial-2395↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11218)] [trial-2395↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 23:04:43.267378 tst handover.py:18: Test FAILED (6.4 sec) 23:04:43.293092 run osmo-hlr_10.42.42.2(pid=11215): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11215)] 23:04:43.340560 run osmo-hlr_10.42.42.2(pid=11215): stdout: | (launched: 2022-12-13_23:04:40.496026) 23:04:43.389338 run osmo-hlr_10.42.42.2(pid=11215): stderr: | 20221213230440674 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230440674 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230440674 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230440674 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230440674 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230440674 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230440686 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230440696 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230440696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230440696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:43.457235 run osmo-msc_10.42.42.6(pid=11221): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11221)] 23:04:43.504026 run osmo-msc_10.42.42.6(pid=11221): stdout: | (launched: 2022-12-13_23:04:42.385937) 23:04:43.552438 run osmo-msc_10.42.42.6(pid=11221): stderr: | 20221213230442659 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230442659 DLGLOBAL DEBUG validating counter group 0x7f7911306c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230442660 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230442660 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230442660 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230442660 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230442662 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230442663 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230442663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230442664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:04:43.601430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11214): Terminating (SIGTERM) 23:04:43.640408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11217): Terminating (SIGTERM) 23:04:43.679406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11220): Terminating (SIGTERM) 23:04:43.718728 --- ParallelTerminationStrategy: PID 11214 died... 23:04:43.737540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11214): Terminated: ok {rc=0} 23:04:43.780677 --- ParallelTerminationStrategy: PID 11217 died... 23:04:43.799121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11217): Terminated: ok {rc=0} 23:04:43.842433 --- ParallelTerminationStrategy: PID 11220 died... 23:04:43.860809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11220): Terminated: ok {rc=0} 23:04:43.942861 bus /sierra_3: Setting Powered False 23:04:45.040194 bus /sierra_3: Setting Powered False 23:04:46.155358 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 23:04:47.413414 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:47.419478 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 23:04:47.471309 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 23:04:47.499001 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 23:04:47.552609 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 23:04:47.603257 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 23:04:47.630647 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 23:04:48.181316 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 23:04:48.186936 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:48.198390 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:04:48.233052 tst handover.py: using LAC 36849 23:04:48.362838 tst handover.py: using RAC 129 23:04:48.492055 tst handover.py: using CellId 36849 23:04:48.619470 tst handover.py: using BVCI 36850 23:04:48.739544 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:04:48.788751 tst handover.py: using LAC 36850 23:04:48.909303 tst handover.py: using RAC 130 23:04:49.028780 tst handover.py: using CellId 36850 23:04:49.153078 tst handover.py: using BVCI 36851 23:04:49.263726 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:49.274647 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:49.285251 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:49.295744 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:49.306898 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:04:49.318041 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:04:49.440104 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:04:49.561154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:50.036221 run create_hlr_db(pid=11226): Launched 23:04:50.161674 bus /sierra_2: Setting Powered False 23:04:51.226141 run create_hlr_db(pid=11226): Terminated: ok {rc=0} 23:04:51.650216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11228): Launched 23:04:51.976090 run osmo-hlr_10.42.42.2(pid=11229): Launched 23:04:52.101896 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:52.631004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11231): Launched 23:04:52.955391 run osmo-stp_10.42.42.5(pid=11232): Launched 23:04:53.081022 run osmo-msc_10.42.42.6: Starting osmo-msc 23:04:53.644283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11234): Launched 23:04:53.970172 run osmo-msc_10.42.42.6(pid=11235): Launched 23:04:54.152526 run osmo-stp_10.42.42.5(pid=11232): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11232)] 23:04:54.289415 run osmo-stp_10.42.42.5(pid=11232): stdout: | (launched: 2022-12-13_23:04:52.896446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:54.427031 run osmo-stp_10.42.42.5(pid=11232): stderr: | 20221213230453087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230453087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230453087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230453087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230453088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230453088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230453088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:54.563828 run osmo-stp_10.42.42.5(pid=11232): stdout: | (launched: 2022-12-13_23:04:52.896446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:54.693771 run osmo-stp_10.42.42.5(pid=11232): stderr: | 20221213230453087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230453087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230453087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230453087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230453088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230453088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230453088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:54.848548 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11232): Process ended prematurely: osmo-stp_10.42.42.5(pid=11232) [trial-2395↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11232)] [trial-2395↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 23:04:54.857622 tst handover.py:18: Test FAILED (6.7 sec) 23:04:54.884838 run osmo-hlr_10.42.42.2(pid=11229): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11229)] 23:04:54.935300 run osmo-hlr_10.42.42.2(pid=11229): stdout: | (launched: 2022-12-13_23:04:51.917120) 23:04:54.986814 run osmo-hlr_10.42.42.2(pid=11229): stderr: | 20221213230452116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230452116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230452116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230452116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230452116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230452117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230452131 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230452140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230452140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230452140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:55.059433 run osmo-msc_10.42.42.6(pid=11235): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11235)] 23:04:55.109184 run osmo-msc_10.42.42.6(pid=11235): stdout: | (launched: 2022-12-13_23:04:53.911197) 23:04:55.160872 run osmo-msc_10.42.42.6(pid=11235): stderr: | 20221213230454233 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230454233 DLGLOBAL DEBUG validating counter group 0x7ff842fe6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230454233 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230454233 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230454233 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230454233 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230454235 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230454235 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230454236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230454236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:04:55.212337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11228): Terminating (SIGTERM) 23:04:55.253905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11231): Terminating (SIGTERM) 23:04:55.295363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11234): Terminating (SIGTERM) 23:04:55.337141 --- ParallelTerminationStrategy: PID 11228 died... 23:04:55.357405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11228): Terminated: ok {rc=0} 23:04:55.403550 --- ParallelTerminationStrategy: PID 11231 died... 23:04:55.423331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11231): Terminated: ok {rc=0} 23:04:55.469406 --- ParallelTerminationStrategy: PID 11234 died... 23:04:55.489298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11234): Terminated: ok {rc=0} 23:04:55.578218 bus /sierra_3: Setting Powered False 23:04:56.677362 bus /sierra_3: Setting Powered False 23:04:57.794012 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 23:04:59.052714 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:59.059649 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 23:04:59.105670 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:04:59.132248 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 23:04:59.184070 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 23:04:59.228458 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:04:59.254525 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 23:04:59.807291 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 23:04:59.813189 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:04:59.824305 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:04:59.858325 tst handover.py: using LAC 36851 23:04:59.986645 tst handover.py: using RAC 131 23:05:00.115089 tst handover.py: using CellId 36851 23:05:00.243584 tst handover.py: using BVCI 36852 23:05:00.362054 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:05:00.407682 tst handover.py: using LAC 36852 23:05:00.536479 tst handover.py: using RAC 132 23:05:00.665039 tst handover.py: using CellId 36852 23:05:00.793352 tst handover.py: using BVCI 36853 23:05:00.919939 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:00.932531 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:00.944789 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:00.957331 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:00.970389 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:00.983342 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:05:01.115137 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:05:01.270029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:01.780876 run create_hlr_db(pid=11243): Launched 23:05:01.942004 bus /sierra_2: Setting Powered False 23:05:03.006360 run create_hlr_db(pid=11243): Terminated: ok {rc=0} 23:05:03.433557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11245): Launched 23:05:03.759327 run osmo-hlr_10.42.42.2(pid=11247): Launched 23:05:03.885470 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:04.418035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11249): Launched 23:05:04.744178 run osmo-stp_10.42.42.5(pid=11250): Launched 23:05:04.870453 run osmo-msc_10.42.42.6: Starting osmo-msc 23:05:05.432222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11252): Launched 23:05:05.758167 run osmo-msc_10.42.42.6(pid=11253): Launched 23:05:05.941128 run osmo-stp_10.42.42.5(pid=11250): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11250)] 23:05:06.079552 run osmo-stp_10.42.42.5(pid=11250): stdout: | (launched: 2022-12-13_23:05:04.685105) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:06.217847 run osmo-stp_10.42.42.5(pid=11250): stderr: | 20221213230504877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230504877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230504877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230504878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230504878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230504878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230504878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:06.354519 run osmo-stp_10.42.42.5(pid=11250): stdout: | (launched: 2022-12-13_23:05:04.685105) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:06.484207 run osmo-stp_10.42.42.5(pid=11250): stderr: | 20221213230504877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230504877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230504877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230504878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230504878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230504878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230504878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:06.639526 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11250): Process ended prematurely: osmo-stp_10.42.42.5(pid=11250) [trial-2395↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11250)] [trial-2395↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 23:05:06.648585 tst handover.py:18: Test FAILED (6.8 sec) 23:05:06.676172 run osmo-hlr_10.42.42.2(pid=11247): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11247)] 23:05:06.726612 run osmo-hlr_10.42.42.2(pid=11247): stdout: | (launched: 2022-12-13_23:05:03.700367) 23:05:06.778916 run osmo-hlr_10.42.42.2(pid=11247): stderr: | 20221213230503896 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230503896 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230503896 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230503896 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230503897 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230503897 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230503908 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230503917 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230503917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230503917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:06.851261 run osmo-msc_10.42.42.6(pid=11253): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11253)] 23:05:06.900773 run osmo-msc_10.42.42.6(pid=11253): stdout: | (launched: 2022-12-13_23:05:05.698985) 23:05:06.952633 run osmo-msc_10.42.42.6(pid=11253): stderr: | 20221213230506020 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230506020 DLGLOBAL DEBUG validating counter group 0x7fef6ab81c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230506020 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230506020 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230506020 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230506021 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230506022 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230506023 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230506023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230506023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:05:07.004468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11245): Terminating (SIGTERM) 23:05:07.046506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11249): Terminating (SIGTERM) 23:05:07.088882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11252): Terminating (SIGTERM) 23:05:07.130870 --- ParallelTerminationStrategy: PID 11245 died... 23:05:07.151293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11245): Terminated: ok {rc=0} 23:05:07.197465 --- ParallelTerminationStrategy: PID 11249 died... 23:05:07.217425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11249): Terminated: ok {rc=0} 23:05:07.263474 --- ParallelTerminationStrategy: PID 11252 died... 23:05:07.283222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11252): Terminated: ok {rc=0} 23:05:07.371017 bus /sierra_3: Setting Powered False 23:05:08.472108 bus /sierra_3: Setting Powered False 23:05:09.590877 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:05:10.845435 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:10.851116 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:05:10.903281 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:05:10.930575 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:05:10.985349 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:05:11.036849 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:05:11.064502 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:05:11.611784 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:05:11.618015 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:11.629439 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:05:11.662473 tst handover.py: using LAC 36853 23:05:11.793156 tst handover.py: using RAC 133 23:05:11.922972 tst handover.py: using CellId 36853 23:05:12.052679 tst handover.py: using BVCI 36854 23:05:12.170908 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:05:12.224172 tst handover.py: using LAC 36854 23:05:12.344636 tst handover.py: using RAC 134 23:05:12.462494 tst handover.py: using CellId 36854 23:05:12.582206 tst handover.py: using BVCI 36855 23:05:12.694229 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:12.705368 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:12.716090 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:12.727003 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:12.738958 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:05:12.750347 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:05:12.871713 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:05:12.987762 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:13.433602 run create_hlr_db(pid=11258): Launched 23:05:13.558314 bus /sierra_2: Setting Powered False 23:05:14.618010 run create_hlr_db(pid=11258): Terminated: ok {rc=0} 23:05:15.016254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11260): Launched 23:05:15.320802 run osmo-hlr_10.42.42.2(pid=11261): Launched 23:05:15.437468 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:15.945331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11263): Launched 23:05:16.282851 run osmo-stp_10.42.42.5(pid=11264): Launched 23:05:16.473142 run osmo-msc_10.42.42.6: Starting osmo-msc 23:05:17.119599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11266): Launched 23:05:17.502260 run osmo-msc_10.42.42.6(pid=11267): Launched 23:05:17.687863 run osmo-stp_10.42.42.5(pid=11264): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11264)] 23:05:17.827330 run osmo-stp_10.42.42.5(pid=11264): stdout: | (launched: 2022-12-13_23:05:16.213314) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:17.967217 run osmo-stp_10.42.42.5(pid=11264): stderr: | 20221213230516554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230516554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230516555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230516555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230516562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230516562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230516562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:18.104915 run osmo-stp_10.42.42.5(pid=11264): stdout: | (launched: 2022-12-13_23:05:16.213314) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:18.235799 run osmo-stp_10.42.42.5(pid=11264): stderr: | 20221213230516554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230516554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230516555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230516555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230516562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230516562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230516562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:18.391493 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11264): Process ended prematurely: osmo-stp_10.42.42.5(pid=11264) [trial-2395↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11264)] [trial-2395↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 23:05:18.400552 tst handover.py:18: Test FAILED (6.8 sec) 23:05:18.428246 run osmo-hlr_10.42.42.2(pid=11261): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11261)] 23:05:18.479077 run osmo-hlr_10.42.42.2(pid=11261): stdout: | (launched: 2022-12-13_23:05:15.264632) 23:05:18.530916 run osmo-hlr_10.42.42.2(pid=11261): stderr: | 20221213230515440 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230515440 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230515440 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230515440 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230515440 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230515440 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230515452 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230515461 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230515461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230515461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:18.603082 run osmo-msc_10.42.42.6(pid=11267): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11267)] 23:05:18.653544 run osmo-msc_10.42.42.6(pid=11267): stdout: | (launched: 2022-12-13_23:05:17.443264) 23:05:18.705274 run osmo-msc_10.42.42.6(pid=11267): stderr: | 20221213230517765 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230517766 DLGLOBAL DEBUG validating counter group 0x7efd2f16ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230517766 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230517766 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230517766 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230517766 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230517768 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230517768 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230517768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230517768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:05:18.757712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11260): Terminating (SIGTERM) 23:05:18.799228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11263): Terminating (SIGTERM) 23:05:18.841696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11266): Terminating (SIGTERM) 23:05:18.884037 --- ParallelTerminationStrategy: PID 11260 died... 23:05:18.904282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11260): Terminated: ok {rc=0} 23:05:18.950988 --- ParallelTerminationStrategy: PID 11263 died... 23:05:18.970967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11263): Terminated: ok {rc=0} 23:05:19.017473 --- ParallelTerminationStrategy: PID 11266 died... 23:05:19.037658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11266): Terminated: ok {rc=0} 23:05:19.126383 bus /sierra_3: Setting Powered False 23:05:20.225344 bus /sierra_3: Setting Powered False 23:05:21.343131 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 23:05:22.606778 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:22.611740 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:05:22.648074 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:05:22.675003 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:05:22.725140 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:05:22.762028 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:05:22.789288 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:05:23.342496 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 23:05:23.348698 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:23.360347 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 23:05:23.395290 tst handover.py: using LAC 36855 23:05:23.514025 tst handover.py: using RAC 135 23:05:23.631248 tst handover.py: using CellId 36855 23:05:23.749382 tst handover.py: using BVCI 36856 23:05:23.859078 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 23:05:23.892820 tst handover.py: using LAC 36856 23:05:24.013823 tst handover.py: using RAC 136 23:05:24.132821 tst handover.py: using CellId 36856 23:05:24.250547 tst handover.py: using BVCI 36857 23:05:24.362129 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:24.373002 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:24.383693 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:24.394188 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:24.404824 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:05:24.415808 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 23:05:24.538266 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 23:05:24.660228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:25.137914 run create_hlr_db(pid=11273): Launched 23:05:25.262979 bus /sierra_2: Setting Powered False 23:05:26.326993 run create_hlr_db(pid=11273): Terminated: ok {rc=0} 23:05:26.735987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11275): Launched 23:05:27.040478 run osmo-hlr_10.42.42.2(pid=11276): Launched 23:05:27.157135 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:27.653453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11278): Launched 23:05:27.955872 run osmo-stp_10.42.42.5(pid=11279): Launched 23:05:28.071634 run osmo-msc_10.42.42.6: Starting osmo-msc 23:05:28.593929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11281): Launched 23:05:28.897523 run osmo-msc_10.42.42.6(pid=11282): Launched 23:05:29.068209 run osmo-stp_10.42.42.5(pid=11279): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11279)] 23:05:29.196684 run osmo-stp_10.42.42.5(pid=11279): stdout: | (launched: 2022-12-13_23:05:27.900692) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:29.324606 run osmo-stp_10.42.42.5(pid=11279): stderr: | 20221213230528070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230528070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230528071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230528071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230528072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230528072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230528072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:29.450587 run osmo-stp_10.42.42.5(pid=11279): stdout: | (launched: 2022-12-13_23:05:27.900692) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:29.571284 run osmo-stp_10.42.42.5(pid=11279): stderr: | 20221213230528070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230528070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230528071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230528071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230528072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230528072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230528072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:29.715925 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11279): Process ended prematurely: osmo-stp_10.42.42.5(pid=11279) [trial-2395↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11279)] [trial-2395↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 23:05:29.724414 tst handover.py:18: Test FAILED (6.4 sec) 23:05:29.750534 run osmo-hlr_10.42.42.2(pid=11276): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11276)] 23:05:29.797734 run osmo-hlr_10.42.42.2(pid=11276): stdout: | (launched: 2022-12-13_23:05:26.985097) 23:05:29.846868 run osmo-hlr_10.42.42.2(pid=11276): stderr: | 20221213230527161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230527161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230527161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230527161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230527161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230527162 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230527174 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230527184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230527184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230527184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:29.915237 run osmo-msc_10.42.42.6(pid=11282): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11282)] 23:05:29.962274 run osmo-msc_10.42.42.6(pid=11282): stdout: | (launched: 2022-12-13_23:05:28.841990) 23:05:30.010906 run osmo-msc_10.42.42.6(pid=11282): stderr: | 20221213230529113 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230529113 DLGLOBAL DEBUG validating counter group 0x7f68735e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230529113 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230529114 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230529114 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230529114 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230529116 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230529116 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230529116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230529116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:05:30.060150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11275): Terminating (SIGTERM) 23:05:30.099582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11278): Terminating (SIGTERM) 23:05:30.138693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11281): Terminating (SIGTERM) 23:05:30.178260 --- ParallelTerminationStrategy: PID 11275 died... 23:05:30.197460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11275): Terminated: ok {rc=0} 23:05:30.241107 --- ParallelTerminationStrategy: PID 11278 died... 23:05:30.259651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11278): Terminated: ok {rc=0} 23:05:30.302981 --- ParallelTerminationStrategy: PID 11281 died... 23:05:30.321560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11281): Terminated: ok {rc=0} 23:05:30.407051 bus /sierra_3: Setting Powered False 23:05:31.506110 bus /sierra_3: Setting Powered False 23:05:32.623301 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 23:05:33.865969 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:33.872201 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:05:33.921907 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:05:33.948229 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:05:34.000638 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:05:34.051803 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:05:34.079170 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:05:34.627840 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 23:05:34.633940 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:34.644933 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:05:34.679175 tst handover.py: using LAC 36857 23:05:34.810566 tst handover.py: using RAC 137 23:05:34.938328 tst handover.py: using CellId 36857 23:05:35.065642 tst handover.py: using BVCI 36858 23:05:35.186726 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:05:35.234576 tst handover.py: using LAC 36858 23:05:35.363251 tst handover.py: using RAC 138 23:05:35.490326 tst handover.py: using CellId 36858 23:05:35.616239 tst handover.py: using BVCI 36859 23:05:35.734667 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:35.746173 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:35.757324 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:35.768290 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:35.780244 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:05:35.792070 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:05:35.909784 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:05:36.031996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:36.508426 run create_hlr_db(pid=11287): Launched 23:05:36.632743 bus /sierra_2: Setting Powered False 23:05:37.696530 run create_hlr_db(pid=11287): Terminated: ok {rc=0} 23:05:38.122093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11289): Launched 23:05:38.447394 run osmo-hlr_10.42.42.2(pid=11290): Launched 23:05:38.572445 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:39.105041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11292): Launched 23:05:39.429640 run osmo-stp_10.42.42.5(pid=11293): Launched 23:05:39.554482 run osmo-msc_10.42.42.6: Starting osmo-msc 23:05:40.113353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11295): Launched 23:05:40.439649 run osmo-msc_10.42.42.6(pid=11296): Launched 23:05:40.622193 run osmo-stp_10.42.42.5(pid=11293): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11293)] 23:05:40.759376 run osmo-stp_10.42.42.5(pid=11293): stdout: | (launched: 2022-12-13_23:05:39.370789) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:40.896864 run osmo-stp_10.42.42.5(pid=11293): stderr: | 20221213230539564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230539564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230539564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230539565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230539565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230539565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230539566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:41.033964 run osmo-stp_10.42.42.5(pid=11293): stdout: | (launched: 2022-12-13_23:05:39.370789) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:41.164624 run osmo-stp_10.42.42.5(pid=11293): stderr: | 20221213230539564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230539564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230539564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230539565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230539565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230539565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230539566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:41.319916 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11293): Process ended prematurely: osmo-stp_10.42.42.5(pid=11293) [trial-2395↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11293)] [trial-2395↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 23:05:41.328820 tst handover.py:18: Test FAILED (6.7 sec) 23:05:41.356212 run osmo-hlr_10.42.42.2(pid=11290): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11290)] 23:05:41.408045 run osmo-hlr_10.42.42.2(pid=11290): stdout: | (launched: 2022-12-13_23:05:38.388433) 23:05:41.460749 run osmo-hlr_10.42.42.2(pid=11290): stderr: | 20221213230538588 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230538588 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230538588 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230538588 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230538588 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230538588 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230538599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230538608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230538608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230538608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:41.533309 run osmo-msc_10.42.42.6(pid=11296): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11296)] 23:05:41.583185 run osmo-msc_10.42.42.6(pid=11296): stdout: | (launched: 2022-12-13_23:05:40.380429) 23:05:41.635547 run osmo-msc_10.42.42.6(pid=11296): stderr: | 20221213230540705 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230540705 DLGLOBAL DEBUG validating counter group 0x7fb6343f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230540705 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230540705 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230540705 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230540705 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230540707 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230540707 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230540708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230540708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:05:41.689067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11289): Terminating (SIGTERM) 23:05:41.730608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11292): Terminating (SIGTERM) 23:05:41.773070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11295): Terminating (SIGTERM) 23:05:41.816042 --- ParallelTerminationStrategy: PID 11289 died... 23:05:41.836874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11289): Terminated: ok {rc=0} 23:05:41.883626 --- ParallelTerminationStrategy: PID 11292 died... 23:05:41.904256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11292): Terminated: ok {rc=0} 23:05:41.951322 --- ParallelTerminationStrategy: PID 11295 died... 23:05:41.971968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11295): Terminated: ok {rc=0} 23:05:42.060687 bus /sierra_3: Setting Powered False 23:05:43.158660 bus /sierra_3: Setting Powered False 23:05:44.275321 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 23:05:45.531468 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:45.537501 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:05:45.587360 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:05:45.614406 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:05:45.670066 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:05:45.720359 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:05:45.747295 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:05:46.314491 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 23:05:46.321350 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:46.334151 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:05:46.369183 tst handover.py: using LAC 36859 23:05:46.490891 tst handover.py: using RAC 139 23:05:46.643473 tst handover.py: using CellId 36859 23:05:46.814386 tst handover.py: using BVCI 36860 23:05:46.935091 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:05:46.983479 tst handover.py: using LAC 36860 23:05:47.139599 tst handover.py: using RAC 140 23:05:47.260033 tst handover.py: using CellId 36860 23:05:47.380140 tst handover.py: using BVCI 36861 23:05:47.489306 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:47.500100 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:47.510847 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:47.521564 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:47.533076 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:05:47.543921 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:05:47.663613 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:05:47.782801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:48.223007 run create_hlr_db(pid=11301): Launched 23:05:48.346428 bus /sierra_2: Setting Powered False 23:05:49.406168 run create_hlr_db(pid=11301): Terminated: ok {rc=0} 23:05:49.818702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11303): Launched 23:05:50.143158 run osmo-hlr_10.42.42.2(pid=11304): Launched 23:05:50.268727 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:50.799867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11306): Launched 23:05:51.121863 run osmo-stp_10.42.42.5(pid=11307): Launched 23:05:51.246257 run osmo-msc_10.42.42.6: Starting osmo-msc 23:05:51.802728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11309): Launched 23:05:52.129389 run osmo-msc_10.42.42.6(pid=11312): Launched 23:05:52.310462 run osmo-stp_10.42.42.5(pid=11307): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11307)] 23:05:52.449722 run osmo-stp_10.42.42.5(pid=11307): stdout: | (launched: 2022-12-13_23:05:51.063623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:52.586954 run osmo-stp_10.42.42.5(pid=11307): stderr: | 20221213230551254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230551254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230551254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230551255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230551255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230551255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230551255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:52.723188 run osmo-stp_10.42.42.5(pid=11307): stdout: | (launched: 2022-12-13_23:05:51.063623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:52.851733 run osmo-stp_10.42.42.5(pid=11307): stderr: | 20221213230551254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230551254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230551254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230551255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230551255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230551255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230551255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:53.005290 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11307): Process ended prematurely: osmo-stp_10.42.42.5(pid=11307) [trial-2395↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11307)] [trial-2395↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 23:05:53.014164 tst handover.py:18: Test FAILED (6.7 sec) 23:05:53.041275 run osmo-hlr_10.42.42.2(pid=11304): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11304)] 23:05:53.091897 run osmo-hlr_10.42.42.2(pid=11304): stdout: | (launched: 2022-12-13_23:05:50.084824) 23:05:53.143813 run osmo-hlr_10.42.42.2(pid=11304): stderr: | 20221213230550280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230550280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230550280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230550280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230550280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230550280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230550297 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230550306 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230550307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230550307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:53.215462 run osmo-msc_10.42.42.6(pid=11312): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11312)] 23:05:53.265163 run osmo-msc_10.42.42.6(pid=11312): stdout: | (launched: 2022-12-13_23:05:52.070710) 23:05:53.316566 run osmo-msc_10.42.42.6(pid=11312): stderr: | 20221213230552392 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230552392 DLGLOBAL DEBUG validating counter group 0x7fb1e8118c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230552392 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230552393 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230552393 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230552393 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230552395 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230552395 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230552395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230552395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:05:53.368819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11303): Terminating (SIGTERM) 23:05:53.410146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11306): Terminating (SIGTERM) 23:05:53.451779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11309): Terminating (SIGTERM) 23:05:53.494114 --- ParallelTerminationStrategy: PID 11303 died... 23:05:53.514325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11303): Terminated: ok {rc=0} 23:05:53.560095 --- ParallelTerminationStrategy: PID 11306 died... 23:05:53.579775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11306): Terminated: ok {rc=0} 23:05:53.625554 --- ParallelTerminationStrategy: PID 11309 died... 23:05:53.645241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11309): Terminated: ok {rc=0} 23:05:53.732579 bus /sierra_3: Setting Powered False 23:05:54.831080 bus /sierra_3: Setting Powered False 23:05:55.946546 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 23:05:57.200325 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:57.205421 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 23:05:57.263249 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:05:57.289517 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 23:05:57.342540 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 23:05:57.403311 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:05:57.430511 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 23:05:57.981619 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 23:05:57.987428 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:57.999089 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:05:58.050629 tst handover.py: using LAC 36861 23:05:58.178356 tst handover.py: using RAC 141 23:05:58.309180 tst handover.py: using CellId 36861 23:05:58.434404 tst handover.py: using BVCI 36862 23:05:58.550904 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:05:58.598813 tst handover.py: using LAC 36862 23:05:58.724234 tst handover.py: using RAC 142 23:05:58.850242 tst handover.py: using CellId 36862 23:05:58.973930 tst handover.py: using BVCI 36863 23:05:59.091236 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:59.102831 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:59.114497 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:59.125851 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:59.137635 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:05:59.149255 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:05:59.265342 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:05:59.379790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:59.817612 run create_hlr_db(pid=11317): Launched 23:05:59.941183 bus /sierra_2: Setting Powered False 23:06:01.007850 run create_hlr_db(pid=11317): Terminated: ok {rc=0} 23:06:01.434663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11319): Launched 23:06:01.784414 run osmo-hlr_10.42.42.2(pid=11320): Launched 23:06:02.035769 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:02.582097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11322): Launched 23:06:02.903709 run osmo-stp_10.42.42.5(pid=11323): Launched 23:06:03.027870 run osmo-msc_10.42.42.6: Starting osmo-msc 23:06:03.582596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11325): Launched 23:06:03.905796 run osmo-msc_10.42.42.6(pid=11326): Launched 23:06:04.086659 run osmo-stp_10.42.42.5(pid=11323): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11323)] 23:06:04.222906 run osmo-stp_10.42.42.5(pid=11323): stdout: | (launched: 2022-12-13_23:06:02.845817) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:04.360116 run osmo-stp_10.42.42.5(pid=11323): stderr: | 20221213230603040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230603040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230603040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230603041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230603041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230603041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230603041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:04.495643 run osmo-stp_10.42.42.5(pid=11323): stdout: | (launched: 2022-12-13_23:06:02.845817) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:04.623521 run osmo-stp_10.42.42.5(pid=11323): stderr: | 20221213230603040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230603040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230603040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230603041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230603041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230603041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230603041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:04.776590 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11323): Process ended prematurely: osmo-stp_10.42.42.5(pid=11323) [trial-2395↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11323)] [trial-2395↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 23:06:04.785674 tst handover.py:18: Test FAILED (6.8 sec) 23:06:04.813137 run osmo-hlr_10.42.42.2(pid=11320): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11320)] 23:06:04.863475 run osmo-hlr_10.42.42.2(pid=11320): stdout: | (launched: 2022-12-13_23:06:01.715140) 23:06:04.915473 run osmo-hlr_10.42.42.2(pid=11320): stderr: | 20221213230602020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230602020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230602020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230602029 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230602029 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230602029 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230602047 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230602062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230602063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230602063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:04.987241 run osmo-msc_10.42.42.6(pid=11326): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11326)] 23:06:05.037176 run osmo-msc_10.42.42.6(pid=11326): stdout: | (launched: 2022-12-13_23:06:03.847349) 23:06:05.089623 run osmo-msc_10.42.42.6(pid=11326): stderr: | 20221213230604168 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230604168 DLGLOBAL DEBUG validating counter group 0x7f2be7a49c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230604168 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230604168 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230604169 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230604169 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230604170 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230604171 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230604171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230604171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:05.141877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11319): Terminating (SIGTERM) 23:06:05.183425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11322): Terminating (SIGTERM) 23:06:05.225572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11325): Terminating (SIGTERM) 23:06:05.268003 --- ParallelTerminationStrategy: PID 11319 died... 23:06:05.288294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11319): Terminated: ok {rc=0} 23:06:05.335069 --- ParallelTerminationStrategy: PID 11322 died... 23:06:05.355093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11322): Terminated: ok {rc=0} 23:06:05.401427 --- ParallelTerminationStrategy: PID 11325 died... 23:06:05.421258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11325): Terminated: ok {rc=0} 23:06:05.509183 bus /sierra_3: Setting Powered False 23:06:06.608071 bus /sierra_3: Setting Powered False 23:06:07.724302 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:06:08.994495 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:08.999568 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:06:09.062086 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:06:09.088406 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:06:09.139336 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:06:09.205692 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:06:09.232929 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:06:09.780340 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:06:09.786260 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:09.797587 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:06:09.845645 tst handover.py: using LAC 36863 23:06:09.970856 tst handover.py: using RAC 143 23:06:10.095300 tst handover.py: using CellId 36863 23:06:10.221333 tst handover.py: using BVCI 36864 23:06:10.339893 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:06:10.388168 tst handover.py: using LAC 36864 23:06:10.512090 tst handover.py: using RAC 144 23:06:10.636638 tst handover.py: using CellId 36864 23:06:10.760634 tst handover.py: using BVCI 36865 23:06:10.877264 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:10.888753 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:10.899928 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:10.911177 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:10.922861 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:10.934438 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:06:11.051792 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:06:11.172678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:11.644197 run create_hlr_db(pid=11331): Launched 23:06:11.767796 bus /sierra_2: Setting Powered False 23:06:12.830992 run create_hlr_db(pid=11331): Terminated: ok {rc=0} 23:06:13.251582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11333): Launched 23:06:13.573101 run osmo-hlr_10.42.42.2(pid=11334): Launched 23:06:13.697550 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:14.224336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11336): Launched 23:06:14.544798 run osmo-stp_10.42.42.5(pid=11337): Launched 23:06:14.669216 run osmo-msc_10.42.42.6: Starting osmo-msc 23:06:15.224733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11339): Launched 23:06:15.547526 run osmo-msc_10.42.42.6(pid=11340): Launched 23:06:15.728729 run osmo-stp_10.42.42.5(pid=11337): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11337)] 23:06:15.917758 run osmo-stp_10.42.42.5(pid=11337): stdout: | (launched: 2022-12-13_23:06:14.486966) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:16.125100 run osmo-stp_10.42.42.5(pid=11337): stderr: | 20221213230614681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230614681 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230614681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230614682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230614682 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230614683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230614683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:16.256443 run osmo-stp_10.42.42.5(pid=11337): stdout: | (launched: 2022-12-13_23:06:14.486966) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:16.382730 run osmo-stp_10.42.42.5(pid=11337): stderr: | 20221213230614681 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230614681 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230614681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230614682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230614682 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230614683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230614683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:16.533273 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11337): Process ended prematurely: osmo-stp_10.42.42.5(pid=11337) [trial-2395↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11337)] [trial-2395↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 23:06:16.542465 tst handover.py:18: Test FAILED (6.7 sec) 23:06:16.569856 run osmo-hlr_10.42.42.2(pid=11334): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11334)] 23:06:16.619529 run osmo-hlr_10.42.42.2(pid=11334): stdout: | (launched: 2022-12-13_23:06:13.515101) 23:06:16.671650 run osmo-hlr_10.42.42.2(pid=11334): stderr: | 20221213230613712 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230613712 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230613712 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230613712 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230613713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230613713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230613724 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230613733 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230613734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230613734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:16.745400 run osmo-msc_10.42.42.6(pid=11340): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11340)] 23:06:16.794978 run osmo-msc_10.42.42.6(pid=11340): stdout: | (launched: 2022-12-13_23:06:15.489106) 23:06:16.846241 run osmo-msc_10.42.42.6(pid=11340): stderr: | 20221213230615813 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230615813 DLGLOBAL DEBUG validating counter group 0x7f0a536bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230615813 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230615813 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230615813 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230615814 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230615815 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230615816 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230615816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230615816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:16.897469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11333): Terminating (SIGTERM) 23:06:16.940559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11336): Terminating (SIGTERM) 23:06:16.984237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11339): Terminating (SIGTERM) 23:06:17.028032 --- ParallelTerminationStrategy: PID 11333 died... 23:06:17.048304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11333): Terminated: ok {rc=0} 23:06:17.095792 --- ParallelTerminationStrategy: PID 11336 died... 23:06:17.115568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11336): Terminated: ok {rc=0} 23:06:17.161997 --- ParallelTerminationStrategy: PID 11339 died... 23:06:17.181590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11339): Terminated: ok {rc=0} 23:06:17.269298 bus /sierra_3: Setting Powered False 23:06:18.368474 bus /sierra_3: Setting Powered False 23:06:19.484890 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 23:06:20.756398 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:20.761438 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:06:20.811302 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:06:20.837501 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:06:20.889179 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:06:20.939134 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:06:20.965170 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:06:21.515483 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 23:06:21.520501 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:21.531272 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 23:06:21.577960 tst handover.py: using LAC 36865 23:06:21.697028 tst handover.py: using RAC 145 23:06:21.815995 tst handover.py: using CellId 36865 23:06:21.936804 tst handover.py: using BVCI 36866 23:06:22.055933 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 23:06:22.091811 tst handover.py: using LAC 36866 23:06:22.220392 tst handover.py: using RAC 146 23:06:22.346623 tst handover.py: using CellId 36866 23:06:22.472492 tst handover.py: using BVCI 36867 23:06:22.589796 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:22.601177 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:22.612113 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:22.623153 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:22.634739 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:06:22.646185 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 23:06:22.763280 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 23:06:22.882720 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:23.353585 run create_hlr_db(pid=11345): Launched 23:06:23.476932 bus /sierra_2: Setting Powered False 23:06:24.540617 run create_hlr_db(pid=11345): Terminated: ok {rc=0} 23:06:24.945075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11347): Launched 23:06:25.245108 run osmo-hlr_10.42.42.2(pid=11348): Launched 23:06:25.361534 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:25.853470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11350): Launched 23:06:26.153796 run osmo-stp_10.42.42.5(pid=11351): Launched 23:06:26.269105 run osmo-msc_10.42.42.6: Starting osmo-msc 23:06:26.787330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11353): Launched 23:06:27.087866 run osmo-msc_10.42.42.6(pid=11354): Launched 23:06:27.256033 run osmo-stp_10.42.42.5(pid=11351): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11351)] 23:06:27.383644 run osmo-stp_10.42.42.5(pid=11351): stdout: | (launched: 2022-12-13_23:06:26.098300) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:27.510354 run osmo-stp_10.42.42.5(pid=11351): stderr: | 20221213230626268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230626268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230626268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230626268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230626269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230626269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230626269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:27.635113 run osmo-stp_10.42.42.5(pid=11351): stdout: | (launched: 2022-12-13_23:06:26.098300) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:27.754207 run osmo-stp_10.42.42.5(pid=11351): stderr: | 20221213230626268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230626268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230626268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230626268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230626269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230626269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230626269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:27.896631 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11351): Process ended prematurely: osmo-stp_10.42.42.5(pid=11351) [trial-2395↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11351)] [trial-2395↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 23:06:27.904809 tst handover.py:18: Test FAILED (6.4 sec) 23:06:27.930805 run osmo-hlr_10.42.42.2(pid=11348): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11348)] 23:06:27.978363 run osmo-hlr_10.42.42.2(pid=11348): stdout: | (launched: 2022-12-13_23:06:25.190088) 23:06:28.027139 run osmo-hlr_10.42.42.2(pid=11348): stderr: | 20221213230625369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230625369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230625369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230625369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230625369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230625369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230625382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230625390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230625391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230625391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:28.095409 run osmo-msc_10.42.42.6(pid=11354): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11354)] 23:06:28.143120 run osmo-msc_10.42.42.6(pid=11354): stdout: | (launched: 2022-12-13_23:06:27.033076) 23:06:28.192193 run osmo-msc_10.42.42.6(pid=11354): stderr: | 20221213230627304 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230627304 DLGLOBAL DEBUG validating counter group 0x7fe30ca44c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230627305 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230627305 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230627305 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230627305 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230627307 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230627307 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230627307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230627307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:28.241268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11347): Terminating (SIGTERM) 23:06:28.281960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11350): Terminating (SIGTERM) 23:06:28.321115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11353): Terminating (SIGTERM) 23:06:28.360638 --- ParallelTerminationStrategy: PID 11347 died... 23:06:28.379617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11347): Terminated: ok {rc=0} 23:06:28.423328 --- ParallelTerminationStrategy: PID 11350 died... 23:06:28.441855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11350): Terminated: ok {rc=0} 23:06:28.485399 --- ParallelTerminationStrategy: PID 11353 died... 23:06:28.503977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11353): Terminated: ok {rc=0} 23:06:28.587724 bus /sierra_3: Setting Powered False 23:06:29.685158 bus /sierra_3: Setting Powered False 23:06:30.801036 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 23:06:32.061884 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:32.068368 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:06:32.142038 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:06:32.168472 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:06:32.220353 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:06:32.282338 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:06:32.308628 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:06:32.857866 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 23:06:32.862996 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:32.873766 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:06:32.920888 tst handover.py: using LAC 36867 23:06:33.042480 tst handover.py: using RAC 147 23:06:33.160016 tst handover.py: using CellId 36867 23:06:33.276159 tst handover.py: using BVCI 36868 23:06:33.384284 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:06:33.431138 tst handover.py: using LAC 36868 23:06:33.547088 tst handover.py: using RAC 148 23:06:33.662767 tst handover.py: using CellId 36868 23:06:33.778770 tst handover.py: using BVCI 36869 23:06:33.888631 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:33.899461 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:33.910070 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:33.920607 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:33.931425 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:06:33.942160 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:06:34.061754 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:06:34.179118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:34.620254 run create_hlr_db(pid=11359): Launched 23:06:34.743757 bus /sierra_2: Setting Powered False 23:06:35.804756 run create_hlr_db(pid=11359): Terminated: ok {rc=0} 23:06:36.199630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11361): Launched 23:06:36.501056 run osmo-hlr_10.42.42.2(pid=11362): Launched 23:06:36.615402 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:37.123041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11364): Launched 23:06:37.422714 run osmo-stp_10.42.42.5(pid=11365): Launched 23:06:37.537508 run osmo-msc_10.42.42.6: Starting osmo-msc 23:06:38.059220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11367): Launched 23:06:38.361282 run osmo-msc_10.42.42.6(pid=11368): Launched 23:06:38.530282 run osmo-stp_10.42.42.5(pid=11365): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11365)] 23:06:38.658503 run osmo-stp_10.42.42.5(pid=11365): stdout: | (launched: 2022-12-13_23:06:37.368029) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:38.786052 run osmo-stp_10.42.42.5(pid=11365): stderr: | 20221213230637538 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230637538 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230637539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230637539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230637540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230637540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230637540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:38.911585 run osmo-stp_10.42.42.5(pid=11365): stdout: | (launched: 2022-12-13_23:06:37.368029) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:39.031144 run osmo-stp_10.42.42.5(pid=11365): stderr: | 20221213230637538 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230637538 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230637539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230637539 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230637540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230637540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230637540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:39.174619 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11365): Process ended prematurely: osmo-stp_10.42.42.5(pid=11365) [trial-2395↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11365)] [trial-2395↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 23:06:39.182967 tst handover.py:18: Test FAILED (6.3 sec) 23:06:39.208739 run osmo-hlr_10.42.42.2(pid=11362): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11362)] 23:06:39.256830 run osmo-hlr_10.42.42.2(pid=11362): stdout: | (launched: 2022-12-13_23:06:36.446140) 23:06:39.306238 run osmo-hlr_10.42.42.2(pid=11362): stderr: | 20221213230636625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230636625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230636625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230636625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230636625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230636625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230636638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230636647 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230636647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230636647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:39.374726 run osmo-msc_10.42.42.6(pid=11368): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11368)] 23:06:39.422159 run osmo-msc_10.42.42.6(pid=11368): stdout: | (launched: 2022-12-13_23:06:38.306041) 23:06:39.470949 run osmo-msc_10.42.42.6(pid=11368): stderr: | 20221213230638580 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230638580 DLGLOBAL DEBUG validating counter group 0x7f35995b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230638580 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230638580 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230638580 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230638580 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230638582 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230638583 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230638583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230638583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:39.519897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11361): Terminating (SIGTERM) 23:06:39.559288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11364): Terminating (SIGTERM) 23:06:39.598674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11367): Terminating (SIGTERM) 23:06:39.638271 --- ParallelTerminationStrategy: PID 11361 died... 23:06:39.657338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11361): Terminated: ok {rc=0} 23:06:39.701056 --- ParallelTerminationStrategy: PID 11364 died... 23:06:39.719686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11364): Terminated: ok {rc=0} 23:06:39.763222 --- ParallelTerminationStrategy: PID 11367 died... 23:06:39.781908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11367): Terminated: ok {rc=0} 23:06:39.867348 bus /sierra_3: Setting Powered False 23:06:40.965905 bus /sierra_3: Setting Powered False 23:06:42.081239 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 23:06:43.352248 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:43.357388 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:06:43.418557 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:06:43.444911 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:06:43.497010 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:06:43.558853 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:06:43.585283 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:06:44.134710 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 23:06:44.141341 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:44.152445 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:06:44.202123 tst handover.py: using LAC 36869 23:06:44.321595 tst handover.py: using RAC 149 23:06:44.440901 tst handover.py: using CellId 36869 23:06:44.568185 tst handover.py: using BVCI 36870 23:06:44.685435 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:06:44.736549 tst handover.py: using LAC 36870 23:06:44.861601 tst handover.py: using RAC 150 23:06:44.988513 tst handover.py: using CellId 36870 23:06:45.113461 tst handover.py: using BVCI 36871 23:06:45.233458 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:45.244543 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:45.255597 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:45.266837 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:45.278252 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:06:45.289533 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:06:45.407399 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:06:45.524023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:45.972461 run create_hlr_db(pid=11373): Launched 23:06:46.122041 bus /sierra_2: Setting Powered False 23:06:47.181473 run create_hlr_db(pid=11373): Terminated: ok {rc=0} 23:06:47.577426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11375): Launched 23:06:47.877721 run osmo-hlr_10.42.42.2(pid=11376): Launched 23:06:47.992684 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:48.484434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11378): Launched 23:06:48.785054 run osmo-stp_10.42.42.5(pid=11379): Launched 23:06:48.900941 run osmo-msc_10.42.42.6: Starting osmo-msc 23:06:49.418817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11381): Launched 23:06:49.718125 run osmo-msc_10.42.42.6(pid=11382): Launched 23:06:49.886122 run osmo-stp_10.42.42.5(pid=11379): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11379)] 23:06:50.013994 run osmo-stp_10.42.42.5(pid=11379): stdout: | (launched: 2022-12-13_23:06:48.730394) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:50.141231 run osmo-stp_10.42.42.5(pid=11379): stderr: | 20221213230648898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230648898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230648898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230648898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230648901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230648901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230648901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:50.266696 run osmo-stp_10.42.42.5(pid=11379): stdout: | (launched: 2022-12-13_23:06:48.730394) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:50.387024 run osmo-stp_10.42.42.5(pid=11379): stderr: | 20221213230648898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230648898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230648898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230648898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230648901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230648901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230648901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:50.530551 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11379): Process ended prematurely: osmo-stp_10.42.42.5(pid=11379) [trial-2395↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11379)] [trial-2395↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 23:06:50.538544 tst handover.py:18: Test FAILED (6.4 sec) 23:06:50.564376 run osmo-hlr_10.42.42.2(pid=11376): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11376)] 23:06:50.611852 run osmo-hlr_10.42.42.2(pid=11376): stdout: | (launched: 2022-12-13_23:06:47.822984) 23:06:50.660880 run osmo-hlr_10.42.42.2(pid=11376): stderr: | 20221213230648001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230648001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230648001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230648001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230648001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230648001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230648013 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230648022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230648022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230648022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:50.729646 run osmo-msc_10.42.42.6(pid=11382): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11382)] 23:06:50.777098 run osmo-msc_10.42.42.6(pid=11382): stdout: | (launched: 2022-12-13_23:06:49.663324) 23:06:50.825968 run osmo-msc_10.42.42.6(pid=11382): stderr: | 20221213230649937 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230649937 DLGLOBAL DEBUG validating counter group 0x7f1d2ecaac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230649937 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230649938 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230649938 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230649938 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230649940 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230649940 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230649940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230649940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:50.875867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11375): Terminating (SIGTERM) 23:06:50.915383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11378): Terminating (SIGTERM) 23:06:50.954820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11381): Terminating (SIGTERM) 23:06:50.994470 --- ParallelTerminationStrategy: PID 11375 died... 23:06:51.013440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11375): Terminated: ok {rc=0} 23:06:51.056941 --- ParallelTerminationStrategy: PID 11378 died... 23:06:51.075798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11378): Terminated: ok {rc=0} 23:06:51.119129 --- ParallelTerminationStrategy: PID 11381 died... 23:06:51.137593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11381): Terminated: ok {rc=0} 23:06:51.223050 bus /sierra_3: Setting Powered False 23:06:52.322525 bus /sierra_3: Setting Powered False 23:06:53.436781 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:06:54.703955 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:54.709131 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:06:54.767610 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:06:54.793753 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:06:54.845347 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:06:54.905161 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:06:54.931364 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:06:55.485978 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:06:55.493640 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:55.505588 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:06:55.552371 tst handover.py: using LAC 36871 23:06:55.681366 tst handover.py: using RAC 151 23:06:55.806263 tst handover.py: using CellId 36871 23:06:55.930595 tst handover.py: using BVCI 36872 23:06:56.047075 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:06:56.095202 tst handover.py: using LAC 36872 23:06:56.218878 tst handover.py: using RAC 152 23:06:56.346285 tst handover.py: using CellId 36872 23:06:56.472030 tst handover.py: using BVCI 36873 23:06:56.588625 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:56.600181 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:56.611611 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:56.623116 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:56.634987 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:06:56.646707 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:06:56.763682 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:06:56.882511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:57.322532 run create_hlr_db(pid=11387): Launched 23:06:57.445977 bus /sierra_2: Setting Powered False 23:06:58.506682 run create_hlr_db(pid=11387): Terminated: ok {rc=0} 23:06:58.920220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11389): Launched 23:06:59.223025 run osmo-hlr_10.42.42.2(pid=11390): Launched 23:06:59.337807 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:59.842847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11392): Launched 23:07:00.142233 run osmo-stp_10.42.42.5(pid=11393): Launched 23:07:00.256412 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:00.777257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11395): Launched 23:07:01.089715 run osmo-msc_10.42.42.6(pid=11396): Launched 23:07:01.385836 run osmo-stp_10.42.42.5(pid=11393): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11393)] 23:07:01.596769 run osmo-stp_10.42.42.5(pid=11393): stdout: | (launched: 2022-12-13_23:07:00.087094) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:01.796929 run osmo-stp_10.42.42.5(pid=11393): stderr: | 20221213230700257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230700257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230700258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230700258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230700259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230700259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230700259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:02.061451 run osmo-stp_10.42.42.5(pid=11393): stdout: | (launched: 2022-12-13_23:07:00.087094) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:02.197180 run osmo-stp_10.42.42.5(pid=11393): stderr: | 20221213230700257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230700257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230700258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230700258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230700259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230700259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230700259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:02.358845 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11393): Process ended prematurely: osmo-stp_10.42.42.5(pid=11393) [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11393)] [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 23:07:02.368291 tst handover.py:18: Test FAILED (6.9 sec) 23:07:02.396398 run osmo-hlr_10.42.42.2(pid=11390): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11390)] 23:07:02.448470 run osmo-hlr_10.42.42.2(pid=11390): stdout: | (launched: 2022-12-13_23:06:59.168433) 23:07:02.501602 run osmo-hlr_10.42.42.2(pid=11390): stderr: | 20221213230659346 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230659346 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230659346 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230659346 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230659346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230659346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230659357 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230659366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230659366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230659366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:02.574699 run osmo-msc_10.42.42.6(pid=11396): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11396)] 23:07:02.625052 run osmo-msc_10.42.42.6(pid=11396): stdout: | (launched: 2022-12-13_23:07:01.025791) 23:07:02.678223 run osmo-msc_10.42.42.6(pid=11396): stderr: | 20221213230701694 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230701695 DLGLOBAL DEBUG validating counter group 0x7f1bf7093c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230701695 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230701695 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230701695 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230701695 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230701708 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230701717 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230701717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230701717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:02.731045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11389): Terminating (SIGTERM) 23:07:02.772790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11392): Terminating (SIGTERM) 23:07:02.815214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11395): Terminating (SIGTERM) 23:07:02.858164 --- ParallelTerminationStrategy: PID 11389 died... 23:07:02.878899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11389): Terminated: ok {rc=0} 23:07:02.926033 --- ParallelTerminationStrategy: PID 11392 died... 23:07:02.946415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11392): Terminated: ok {rc=0} 23:07:02.993264 --- ParallelTerminationStrategy: PID 11395 died... 23:07:03.013640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11395): Terminated: ok {rc=0} 23:07:03.103182 bus /sierra_3: Setting Powered False 23:07:04.202182 bus /sierra_3: Setting Powered False 23:07:05.321541 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 23:07:06.591556 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:06.597035 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:07:06.643575 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:07:06.669800 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:07:06.721606 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:07:06.767576 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:07:06.793618 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:07:07.344281 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 23:07:07.349725 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:07.360757 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 23:07:07.403955 tst handover.py: using LAC 36873 23:07:07.530968 tst handover.py: using RAC 153 23:07:07.657373 tst handover.py: using CellId 36873 23:07:07.784168 tst handover.py: using BVCI 36874 23:07:07.901155 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 23:07:07.936691 tst handover.py: using LAC 36874 23:07:08.064279 tst handover.py: using RAC 154 23:07:08.190584 tst handover.py: using CellId 36874 23:07:08.316274 tst handover.py: using BVCI 36875 23:07:08.434678 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:08.446152 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:08.457400 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:08.468654 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:08.480286 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:08.491748 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 23:07:08.608467 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 23:07:08.728181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:09.199669 run create_hlr_db(pid=11401): Launched 23:07:09.323292 bus /sierra_2: Setting Powered False 23:07:10.386989 run create_hlr_db(pid=11401): Terminated: ok {rc=0} 23:07:10.807348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11403): Launched 23:07:11.129592 run osmo-hlr_10.42.42.2(pid=11404): Launched 23:07:11.253657 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:11.780582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11406): Launched 23:07:12.101875 run osmo-stp_10.42.42.5(pid=11407): Launched 23:07:12.226067 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:12.781952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11409): Launched 23:07:13.104554 run osmo-msc_10.42.42.6(pid=11410): Launched 23:07:13.285442 run osmo-stp_10.42.42.5(pid=11407): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11407)] 23:07:13.422687 run osmo-stp_10.42.42.5(pid=11407): stdout: | (launched: 2022-12-13_23:07:12.043597) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:13.560194 run osmo-stp_10.42.42.5(pid=11407): stderr: | 20221213230712236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230712237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230712237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230712237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230712238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230712238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230712238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:13.696339 run osmo-stp_10.42.42.5(pid=11407): stdout: | (launched: 2022-12-13_23:07:12.043597) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:13.824866 run osmo-stp_10.42.42.5(pid=11407): stderr: | 20221213230712236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230712237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230712237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230712237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230712238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230712238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230712238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:13.978559 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11407): Process ended prematurely: osmo-stp_10.42.42.5(pid=11407) [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11407)] [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 23:07:13.987354 tst handover.py:18: Test FAILED (6.6 sec) 23:07:14.014679 run osmo-hlr_10.42.42.2(pid=11404): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11404)] 23:07:14.065090 run osmo-hlr_10.42.42.2(pid=11404): stdout: | (launched: 2022-12-13_23:07:11.071041) 23:07:14.116917 run osmo-hlr_10.42.42.2(pid=11404): stderr: | 20221213230711268 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230711268 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230711268 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230711268 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230711268 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230711268 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230711285 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230711294 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230711294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230711295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:14.189521 run osmo-msc_10.42.42.6(pid=11410): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11410)] 23:07:14.238893 run osmo-msc_10.42.42.6(pid=11410): stdout: | (launched: 2022-12-13_23:07:13.045974) 23:07:14.290451 run osmo-msc_10.42.42.6(pid=11410): stderr: | 20221213230713369 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230713369 DLGLOBAL DEBUG validating counter group 0x7f303a988c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230713369 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230713369 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230713369 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230713370 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230713371 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230713372 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230713372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230713372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:14.342148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11403): Terminating (SIGTERM) 23:07:14.383610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11406): Terminating (SIGTERM) 23:07:14.425346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11409): Terminating (SIGTERM) 23:07:14.467374 --- ParallelTerminationStrategy: PID 11403 died... 23:07:14.487413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11403): Terminated: ok {rc=0} 23:07:14.533742 --- ParallelTerminationStrategy: PID 11406 died... 23:07:14.553544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11406): Terminated: ok {rc=0} 23:07:14.599444 --- ParallelTerminationStrategy: PID 11409 died... 23:07:14.619200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11409): Terminated: ok {rc=0} 23:07:14.706293 bus /sierra_3: Setting Powered False 23:07:15.803730 bus /sierra_3: Setting Powered False 23:07:16.953886 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 23:07:18.217927 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:18.222960 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:07:18.280865 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:07:18.307011 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:07:18.358422 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:07:18.416774 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:07:18.442898 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:07:18.994070 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 23:07:18.999178 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:19.010162 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:07:19.052928 tst handover.py: using LAC 36875 23:07:19.174497 tst handover.py: using RAC 155 23:07:19.291770 tst handover.py: using CellId 36875 23:07:19.407766 tst handover.py: using BVCI 36876 23:07:19.516131 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:07:19.562317 tst handover.py: using LAC 36876 23:07:19.684663 tst handover.py: using RAC 156 23:07:19.801858 tst handover.py: using CellId 36876 23:07:19.917374 tst handover.py: using BVCI 36877 23:07:20.025536 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:20.036415 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:20.047188 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:20.057999 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:20.068799 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:20.079607 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:07:20.198888 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:07:20.314352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:20.754311 run create_hlr_db(pid=11415): Launched 23:07:20.876688 bus /sierra_2: Setting Powered False 23:07:21.937316 run create_hlr_db(pid=11415): Terminated: ok {rc=0} 23:07:22.349981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11417): Launched 23:07:22.674009 run osmo-hlr_10.42.42.2(pid=11418): Launched 23:07:22.799131 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:23.326481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11420): Launched 23:07:23.648407 run osmo-stp_10.42.42.5(pid=11421): Launched 23:07:23.773328 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:24.330299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11423): Launched 23:07:24.652762 run osmo-msc_10.42.42.6(pid=11424): Launched 23:07:24.836763 run osmo-stp_10.42.42.5(pid=11421): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11421)] 23:07:24.973819 run osmo-stp_10.42.42.5(pid=11421): stdout: | (launched: 2022-12-13_23:07:23.589893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:25.111639 run osmo-stp_10.42.42.5(pid=11421): stderr: | 20221213230723780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230723781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230723781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230723781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230723782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230723782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230723782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:25.248464 run osmo-stp_10.42.42.5(pid=11421): stdout: | (launched: 2022-12-13_23:07:23.589893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:25.377715 run osmo-stp_10.42.42.5(pid=11421): stderr: | 20221213230723780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230723781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230723781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230723781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230723782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230723782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230723782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:25.531868 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11421): Process ended prematurely: osmo-stp_10.42.42.5(pid=11421) [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11421)] [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 23:07:25.540877 tst handover.py:18: Test FAILED (6.5 sec) 23:07:25.568497 run osmo-hlr_10.42.42.2(pid=11418): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11418)] 23:07:25.618854 run osmo-hlr_10.42.42.2(pid=11418): stdout: | (launched: 2022-12-13_23:07:22.615370) 23:07:25.670904 run osmo-hlr_10.42.42.2(pid=11418): stderr: | 20221213230722814 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230722814 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230722814 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230722814 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230722814 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230722814 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230722826 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230722834 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230722834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230722834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:25.743619 run osmo-msc_10.42.42.6(pid=11424): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11424)] 23:07:25.792858 run osmo-msc_10.42.42.6(pid=11424): stdout: | (launched: 2022-12-13_23:07:24.594114) 23:07:25.844460 run osmo-msc_10.42.42.6(pid=11424): stderr: | 20221213230724916 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230724916 DLGLOBAL DEBUG validating counter group 0x7f060c18bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230724916 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230724916 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230724917 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230724917 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230724918 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230724919 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230724919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230724919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:25.896164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11417): Terminating (SIGTERM) 23:07:25.937896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11420): Terminating (SIGTERM) 23:07:25.979373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11423): Terminating (SIGTERM) 23:07:26.021096 --- ParallelTerminationStrategy: PID 11417 died... 23:07:26.040917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11417): Terminated: ok {rc=0} 23:07:26.087020 --- ParallelTerminationStrategy: PID 11420 died... 23:07:26.107163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11420): Terminated: ok {rc=0} 23:07:26.153184 --- ParallelTerminationStrategy: PID 11423 died... 23:07:26.172733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11423): Terminated: ok {rc=0} 23:07:26.260552 bus /sierra_3: Setting Powered False 23:07:27.358313 bus /sierra_3: Setting Powered False 23:07:28.473351 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 23:07:29.746087 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:29.751974 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:07:29.812057 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:07:29.839118 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:07:29.892025 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:07:29.951516 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:07:29.978424 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:07:30.531712 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 23:07:30.537737 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:30.549391 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:07:30.595690 tst handover.py: using LAC 36877 23:07:30.722342 tst handover.py: using RAC 157 23:07:30.866718 tst handover.py: using CellId 36877 23:07:31.000305 tst handover.py: using BVCI 36878 23:07:31.127961 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:07:31.176546 tst handover.py: using LAC 36878 23:07:31.306492 tst handover.py: using RAC 158 23:07:31.433555 tst handover.py: using CellId 36878 23:07:31.593143 tst handover.py: using BVCI 36879 23:07:31.746845 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:31.758885 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:31.770709 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:31.782824 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:31.794986 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:07:31.808018 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:07:31.924646 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:07:32.041180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:32.486391 run create_hlr_db(pid=11429): Launched 23:07:32.610058 bus /sierra_2: Setting Powered False 23:07:33.669967 run create_hlr_db(pid=11429): Terminated: ok {rc=0} 23:07:34.081507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11431): Launched 23:07:34.404433 run osmo-hlr_10.42.42.2(pid=11432): Launched 23:07:34.529392 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:35.057717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11434): Launched 23:07:35.379923 run osmo-stp_10.42.42.5(pid=11435): Launched 23:07:35.504004 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:36.058254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11437): Launched 23:07:36.380137 run osmo-msc_10.42.42.6(pid=11438): Launched 23:07:36.561775 run osmo-stp_10.42.42.5(pid=11435): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11435)] 23:07:36.698970 run osmo-stp_10.42.42.5(pid=11435): stdout: | (launched: 2022-12-13_23:07:35.321526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:36.836405 run osmo-stp_10.42.42.5(pid=11435): stderr: | 20221213230735512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230735512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230735512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230735513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230735513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230735513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230735514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:36.972200 run osmo-stp_10.42.42.5(pid=11435): stdout: | (launched: 2022-12-13_23:07:35.321526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:37.100773 run osmo-stp_10.42.42.5(pid=11435): stderr: | 20221213230735512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230735512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230735512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230735513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230735513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230735513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230735514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:37.254854 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11435): Process ended prematurely: osmo-stp_10.42.42.5(pid=11435) [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11435)] [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 23:07:37.263536 tst handover.py:18: Test FAILED (6.7 sec) 23:07:37.290876 run osmo-hlr_10.42.42.2(pid=11432): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11432)] 23:07:37.341297 run osmo-hlr_10.42.42.2(pid=11432): stdout: | (launched: 2022-12-13_23:07:34.346050) 23:07:37.392522 run osmo-hlr_10.42.42.2(pid=11432): stderr: | 20221213230734546 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230734546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230734546 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230734546 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230734546 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230734546 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230734563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230734573 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230734573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230734573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:37.464294 run osmo-msc_10.42.42.6(pid=11438): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11438)] 23:07:37.513689 run osmo-msc_10.42.42.6(pid=11438): stdout: | (launched: 2022-12-13_23:07:36.321820) 23:07:37.565346 run osmo-msc_10.42.42.6(pid=11438): stderr: | 20221213230736641 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230736641 DLGLOBAL DEBUG validating counter group 0x7f641b9d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230736641 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230736641 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230736642 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230736642 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230736643 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230736644 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230736644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230736644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:37.617147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11431): Terminating (SIGTERM) 23:07:37.658455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11434): Terminating (SIGTERM) 23:07:37.699767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11437): Terminating (SIGTERM) 23:07:37.741229 --- ParallelTerminationStrategy: PID 11431 died... 23:07:37.761451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11431): Terminated: ok {rc=0} 23:07:37.807093 --- ParallelTerminationStrategy: PID 11434 died... 23:07:37.826756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11434): Terminated: ok {rc=0} 23:07:37.872670 --- ParallelTerminationStrategy: PID 11437 died... 23:07:37.892360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11437): Terminated: ok {rc=0} 23:07:37.980105 bus /sierra_3: Setting Powered False 23:07:39.078720 bus /sierra_3: Setting Powered False 23:07:40.194885 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 23:07:41.464000 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:41.470038 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:07:41.520916 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:07:41.547603 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:07:41.601120 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:07:41.653428 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:07:41.680453 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:07:42.226767 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 23:07:42.232151 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:42.243107 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 23:07:42.290343 tst handover.py: using LAC 36879 23:07:42.410459 tst handover.py: using RAC 159 23:07:42.528836 tst handover.py: using CellId 36879 23:07:42.648902 tst handover.py: using BVCI 36880 23:07:42.760104 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 23:07:42.795272 tst handover.py: using LAC 36880 23:07:42.915710 tst handover.py: using RAC 160 23:07:43.035929 tst handover.py: using CellId 36880 23:07:43.155778 tst handover.py: using BVCI 36881 23:07:43.266862 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:43.277952 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:43.288462 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:43.299102 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:43.310077 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:07:43.320746 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 23:07:43.442341 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 23:07:43.557525 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:43.999204 run create_hlr_db(pid=11443): Launched 23:07:44.123563 bus /sierra_2: Setting Powered False 23:07:45.183899 run create_hlr_db(pid=11443): Terminated: ok {rc=0} 23:07:45.578789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11445): Launched 23:07:45.888505 run osmo-hlr_10.42.42.2(pid=11446): Launched 23:07:46.080462 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:46.759761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11448): Launched 23:07:47.108371 run osmo-stp_10.42.42.5(pid=11449): Launched 23:07:47.328058 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:47.886470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11451): Launched 23:07:48.209916 run osmo-msc_10.42.42.6(pid=11452): Launched 23:07:48.391222 run osmo-stp_10.42.42.5(pid=11449): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11449)] 23:07:48.528139 run osmo-stp_10.42.42.5(pid=11449): stdout: | (launched: 2022-12-13_23:07:47.041428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:48.664862 run osmo-stp_10.42.42.5(pid=11449): stderr: | 20221213230747316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230747316 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230747316 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230747317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230747317 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230747317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230747318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:48.800786 run osmo-stp_10.42.42.5(pid=11449): stdout: | (launched: 2022-12-13_23:07:47.041428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:48.929207 run osmo-stp_10.42.42.5(pid=11449): stderr: | 20221213230747316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230747316 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230747316 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230747317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230747317 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230747317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230747318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:49.082926 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11449): Process ended prematurely: osmo-stp_10.42.42.5(pid=11449) [trial-2395↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11449)] [trial-2395↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 23:07:49.091648 tst handover.py:18: Test FAILED (6.9 sec) 23:07:49.119304 run osmo-hlr_10.42.42.2(pid=11446): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11446)] 23:07:49.170054 run osmo-hlr_10.42.42.2(pid=11446): stdout: | (launched: 2022-12-13_23:07:45.824675) 23:07:49.221269 run osmo-hlr_10.42.42.2(pid=11446): stderr: | 20221213230746064 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230746064 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230746064 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230746064 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230746064 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230746064 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230746090 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230746113 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230746113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230746114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:49.293129 run osmo-msc_10.42.42.6(pid=11452): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11452)] 23:07:49.342870 run osmo-msc_10.42.42.6(pid=11452): stdout: | (launched: 2022-12-13_23:07:48.151358) 23:07:49.393993 run osmo-msc_10.42.42.6(pid=11452): stderr: | 20221213230748471 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230748471 DLGLOBAL DEBUG validating counter group 0x7f3ef13dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230748471 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230748471 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230748471 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230748472 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230748473 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230748474 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230748474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230748474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:49.445742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11445): Terminating (SIGTERM) 23:07:49.487249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11448): Terminating (SIGTERM) 23:07:49.529283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11451): Terminating (SIGTERM) 23:07:49.571766 --- ParallelTerminationStrategy: PID 11445 died... 23:07:49.591994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11445): Terminated: ok {rc=0} 23:07:49.638370 --- ParallelTerminationStrategy: PID 11448 died... 23:07:49.658171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11448): Terminated: ok {rc=0} 23:07:49.704317 --- ParallelTerminationStrategy: PID 11451 died... 23:07:49.724188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11451): Terminated: ok {rc=0} 23:07:49.811864 bus /sierra_3: Setting Powered False 23:07:50.909470 bus /sierra_3: Setting Powered False 23:07:52.025997 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 23:07:53.284221 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:53.291217 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:07:53.356592 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:07:53.383691 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:07:53.438822 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:07:53.507860 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:07:53.534852 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:07:54.082057 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 23:07:54.087419 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:54.098939 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:07:54.149394 tst handover.py: using LAC 36881 23:07:54.270216 tst handover.py: using RAC 161 23:07:54.396260 tst handover.py: using CellId 36881 23:07:54.527008 tst handover.py: using BVCI 36882 23:07:54.644755 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:07:54.693265 tst handover.py: using LAC 36882 23:07:54.819241 tst handover.py: using RAC 162 23:07:54.943725 tst handover.py: using CellId 36882 23:07:55.068296 tst handover.py: using BVCI 36883 23:07:55.185943 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:55.197236 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:55.208433 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:55.219792 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:55.231378 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:07:55.242782 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:07:55.362601 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:07:55.477473 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:55.949230 run create_hlr_db(pid=11457): Launched 23:07:56.073449 bus /sierra_2: Setting Powered False 23:07:57.138250 run create_hlr_db(pid=11457): Terminated: ok {rc=0} 23:07:57.544333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11459): Launched 23:07:57.846716 run osmo-hlr_10.42.42.2(pid=11460): Launched 23:07:57.962220 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:58.455813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11462): Launched 23:07:58.757411 run osmo-stp_10.42.42.5(pid=11463): Launched 23:07:58.873564 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:59.393987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11465): Launched 23:07:59.695477 run osmo-msc_10.42.42.6(pid=11466): Launched 23:07:59.864398 run osmo-stp_10.42.42.5(pid=11463): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11463)] 23:08:00.023767 run osmo-stp_10.42.42.5(pid=11463): stdout: | (launched: 2022-12-13_23:07:58.701954) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:00.165048 run osmo-stp_10.42.42.5(pid=11463): stderr: | 20221213230758872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230758872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230758872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230758873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230758875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230758875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230758875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:00.301227 run osmo-stp_10.42.42.5(pid=11463): stdout: | (launched: 2022-12-13_23:07:58.701954) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:00.430620 run osmo-stp_10.42.42.5(pid=11463): stderr: | 20221213230758872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230758872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230758872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230758873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230758875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230758875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230758875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:00.585103 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11463): Process ended prematurely: osmo-stp_10.42.42.5(pid=11463) [trial-2395↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11463)] [trial-2395↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 23:08:00.594281 tst handover.py:18: Test FAILED (6.5 sec) 23:08:00.621587 run osmo-hlr_10.42.42.2(pid=11460): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11460)] 23:08:00.672547 run osmo-hlr_10.42.42.2(pid=11460): stdout: | (launched: 2022-12-13_23:07:57.791740) 23:08:00.724297 run osmo-hlr_10.42.42.2(pid=11460): stderr: | 20221213230757969 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230757969 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230757969 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230757969 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230757969 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230757969 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230757981 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230757990 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230757990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230757990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:00.796550 run osmo-msc_10.42.42.6(pid=11466): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11466)] 23:08:00.850141 run osmo-msc_10.42.42.6(pid=11466): stdout: | (launched: 2022-12-13_23:07:59.639936) 23:08:00.903276 run osmo-msc_10.42.42.6(pid=11466): stderr: | 20221213230759913 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230759913 DLGLOBAL DEBUG validating counter group 0x7f49f126cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230759914 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230759914 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230759914 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230759914 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230759917 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230759918 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230759918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230759918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:00.956924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11459): Terminating (SIGTERM) 23:08:00.999398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11462): Terminating (SIGTERM) 23:08:01.043947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11465): Terminating (SIGTERM) 23:08:01.088285 --- ParallelTerminationStrategy: PID 11459 died... 23:08:01.109534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11459): Terminated: ok {rc=0} 23:08:01.159111 --- ParallelTerminationStrategy: PID 11462 died... 23:08:01.181042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11462): Terminated: ok {rc=0} 23:08:01.229488 --- ParallelTerminationStrategy: PID 11465 died... 23:08:01.251173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11465): Terminated: ok {rc=0} 23:08:01.343620 bus /sierra_3: Setting Powered False 23:08:02.441829 bus /sierra_3: Setting Powered False 23:08:03.555787 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 23:08:04.826104 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:08:04.831184 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:08:04.892438 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:08:04.918954 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:08:04.972817 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:08:05.036203 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:08:05.062313 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:08:05.610368 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 23:08:05.615824 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:05.626817 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:05.675366 tst handover.py: using LAC 36883 23:08:05.794027 tst handover.py: using RAC 163 23:08:05.912940 tst handover.py: using CellId 36883 23:08:06.035294 tst handover.py: using BVCI 36884 23:08:06.146149 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:06.197068 tst handover.py: using LAC 36884 23:08:06.315979 tst handover.py: using RAC 164 23:08:06.432472 tst handover.py: using CellId 36884 23:08:06.548872 tst handover.py: using BVCI 36885 23:08:06.657237 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:06.668010 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:06.678684 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:06.689524 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:06.700283 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:06.710961 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:06.826477 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:06.945343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:07.418317 run create_hlr_db(pid=11472): Launched 23:08:07.542357 bus /sierra_2: Setting Powered False 23:08:08.606479 run create_hlr_db(pid=11472): Terminated: ok {rc=0} 23:08:09.026991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11474): Launched 23:08:09.350632 run osmo-hlr_10.42.42.2(pid=11475): Launched 23:08:09.475208 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:10.005895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11477): Launched 23:08:10.329281 run osmo-stp_10.42.42.5(pid=11478): Launched 23:08:10.454064 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:11.010576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11480): Launched 23:08:11.334936 run osmo-msc_10.42.42.6(pid=11481): Launched 23:08:11.515733 run osmo-stp_10.42.42.5(pid=11478): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11478)] 23:08:11.652542 run osmo-stp_10.42.42.5(pid=11478): stdout: | (launched: 2022-12-13_23:08:10.270498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:11.789200 run osmo-stp_10.42.42.5(pid=11478): stderr: | 20221213230810462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230810463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230810463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230810463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230810466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230810466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230810466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:11.925554 run osmo-stp_10.42.42.5(pid=11478): stdout: | (launched: 2022-12-13_23:08:10.270498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:12.053997 run osmo-stp_10.42.42.5(pid=11478): stderr: | 20221213230810462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230810463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230810463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230810463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230810466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230810466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230810466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:12.208054 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11478): Process ended prematurely: osmo-stp_10.42.42.5(pid=11478) [trial-2395↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11478)] [trial-2395↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 23:08:12.217005 tst handover.py:18: Test FAILED (6.6 sec) 23:08:12.244021 run osmo-hlr_10.42.42.2(pid=11475): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11475)] 23:08:12.294065 run osmo-hlr_10.42.42.2(pid=11475): stdout: | (launched: 2022-12-13_23:08:09.292060) 23:08:12.345775 run osmo-hlr_10.42.42.2(pid=11475): stderr: | 20221213230809490 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230809490 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230809490 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230809490 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230809490 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230809490 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230809503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230809513 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230809513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230809513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:12.417629 run osmo-msc_10.42.42.6(pid=11481): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11481)] 23:08:12.467112 run osmo-msc_10.42.42.6(pid=11481): stdout: | (launched: 2022-12-13_23:08:11.276082) 23:08:12.518654 run osmo-msc_10.42.42.6(pid=11481): stderr: | 20221213230811598 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230811598 DLGLOBAL DEBUG validating counter group 0x7fe2edc0cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230811598 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230811598 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230811598 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230811598 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230811600 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230811600 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230811600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230811601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:12.570671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11474): Terminating (SIGTERM) 23:08:12.611959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11477): Terminating (SIGTERM) 23:08:12.653555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11480): Terminating (SIGTERM) 23:08:12.695159 --- ParallelTerminationStrategy: PID 11474 died... 23:08:12.715317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11474): Terminated: ok {rc=0} 23:08:12.761476 --- ParallelTerminationStrategy: PID 11477 died... 23:08:12.781368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11477): Terminated: ok {rc=0} 23:08:12.827152 --- ParallelTerminationStrategy: PID 11480 died... 23:08:12.846765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11480): Terminated: ok {rc=0} 23:08:12.934299 bus /sierra_3: Setting Powered False 23:08:14.031804 bus /sierra_3: Setting Powered False 23:08:15.147439 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 23:08:16.433205 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:08:16.439430 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:08:16.495616 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:08:16.524162 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:08:16.582026 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:08:16.646179 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:08:16.675212 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:08:17.213515 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 23:08:17.219375 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:17.230899 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:08:17.272081 tst handover.py: using LAC 36885 23:08:17.397806 tst handover.py: using RAC 165 23:08:17.522771 tst handover.py: using CellId 36885 23:08:17.647194 tst handover.py: using BVCI 36886 23:08:17.763981 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:08:17.814454 tst handover.py: using LAC 36886 23:08:17.941242 tst handover.py: using RAC 166 23:08:18.066983 tst handover.py: using CellId 36886 23:08:18.193308 tst handover.py: using BVCI 36887 23:08:18.312922 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:18.324217 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:18.335395 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:18.346636 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:18.358516 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:08:18.370593 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:08:18.487710 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:08:18.601292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:19.041527 run create_hlr_db(pid=11486): Launched 23:08:19.165112 bus /sierra_2: Setting Powered False 23:08:20.225971 run create_hlr_db(pid=11486): Terminated: ok {rc=0} 23:08:20.637740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11488): Launched 23:08:20.959962 run osmo-hlr_10.42.42.2(pid=11489): Launched 23:08:21.084317 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:21.611287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11491): Launched 23:08:21.936150 run osmo-stp_10.42.42.5(pid=11492): Launched 23:08:22.060719 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:22.616709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11494): Launched 23:08:22.939558 run osmo-msc_10.42.42.6(pid=11495): Launched 23:08:23.120813 run osmo-stp_10.42.42.5(pid=11492): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11492)] 23:08:23.257755 run osmo-stp_10.42.42.5(pid=11492): stdout: | (launched: 2022-12-13_23:08:21.876115) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:23.394458 run osmo-stp_10.42.42.5(pid=11492): stderr: | 20221213230822067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230822068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230822068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230822068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230822069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230822069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230822069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:23.530479 run osmo-stp_10.42.42.5(pid=11492): stdout: | (launched: 2022-12-13_23:08:21.876115) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:23.658919 run osmo-stp_10.42.42.5(pid=11492): stderr: | 20221213230822067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230822068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230822068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230822068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230822069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230822069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230822069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:23.812830 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11492): Process ended prematurely: osmo-stp_10.42.42.5(pid=11492) [trial-2395↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11492)] [trial-2395↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 23:08:23.821789 tst handover.py:18: Test FAILED (6.6 sec) 23:08:23.848909 run osmo-hlr_10.42.42.2(pid=11489): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11489)] 23:08:23.899044 run osmo-hlr_10.42.42.2(pid=11489): stdout: | (launched: 2022-12-13_23:08:20.901476) 23:08:23.950572 run osmo-hlr_10.42.42.2(pid=11489): stderr: | 20221213230821097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230821097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230821097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230821097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230821097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230821097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230821111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230821119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230821119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230821119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:24.022800 run osmo-msc_10.42.42.6(pid=11495): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11495)] 23:08:24.072403 run osmo-msc_10.42.42.6(pid=11495): stdout: | (launched: 2022-12-13_23:08:22.881133) 23:08:24.123679 run osmo-msc_10.42.42.6(pid=11495): stderr: | 20221213230823204 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230823204 DLGLOBAL DEBUG validating counter group 0x7fd600957c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230823204 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230823204 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230823204 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230823204 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230823206 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230823207 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230823207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230823207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:24.175625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11488): Terminating (SIGTERM) 23:08:24.217275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11491): Terminating (SIGTERM) 23:08:24.258901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11494): Terminating (SIGTERM) 23:08:24.300682 --- ParallelTerminationStrategy: PID 11488 died... 23:08:24.321013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11488): Terminated: ok {rc=0} 23:08:24.367160 --- ParallelTerminationStrategy: PID 11491 died... 23:08:24.386861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11491): Terminated: ok {rc=0} 23:08:24.432601 --- ParallelTerminationStrategy: PID 11494 died... 23:08:24.452433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11494): Terminated: ok {rc=0} 23:08:24.539724 bus /sierra_3: Setting Powered False 23:08:25.638768 bus /sierra_3: Setting Powered False 23:08:26.753825 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 23:08:28.005910 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:08:28.010795 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:08:28.059816 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:08:28.086044 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:08:28.139443 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:08:28.189793 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:08:28.215883 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:08:28.762274 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 23:08:28.767754 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:28.778678 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:28.812051 tst handover.py: using LAC 36887 23:08:28.931245 tst handover.py: using RAC 167 23:08:29.051405 tst handover.py: using CellId 36887 23:08:29.171972 tst handover.py: using BVCI 36888 23:08:29.280829 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:29.328194 tst handover.py: using LAC 36888 23:08:29.448768 tst handover.py: using RAC 168 23:08:29.569328 tst handover.py: using CellId 36888 23:08:29.689348 tst handover.py: using BVCI 36889 23:08:29.798304 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:29.809106 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:29.819651 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:29.830187 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:29.840760 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:29.851669 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:29.970430 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:30.089584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:30.562463 run create_hlr_db(pid=11500): Launched 23:08:30.687014 bus /sierra_2: Setting Powered False 23:08:31.750010 run create_hlr_db(pid=11500): Terminated: ok {rc=0} 23:08:32.182116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11502): Launched 23:08:32.504482 run osmo-hlr_10.42.42.2(pid=11503): Launched 23:08:32.629337 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:33.158119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11505): Launched 23:08:33.481544 run osmo-stp_10.42.42.5(pid=11506): Launched 23:08:33.606546 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:34.164183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11508): Launched 23:08:34.486793 run osmo-msc_10.42.42.6(pid=11509): Launched 23:08:34.668123 run osmo-stp_10.42.42.5(pid=11506): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11506)] 23:08:34.805228 run osmo-stp_10.42.42.5(pid=11506): stdout: | (launched: 2022-12-13_23:08:33.422810) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:34.942407 run osmo-stp_10.42.42.5(pid=11506): stderr: | 20221213230833617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230833617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230833617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230833618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230833618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230833618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230833618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:35.078463 run osmo-stp_10.42.42.5(pid=11506): stdout: | (launched: 2022-12-13_23:08:33.422810) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:35.208607 run osmo-stp_10.42.42.5(pid=11506): stderr: | 20221213230833617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230833617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230833617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230833618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230833618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230833618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230833618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:35.363184 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11506): Process ended prematurely: osmo-stp_10.42.42.5(pid=11506) [trial-2395↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11506)] [trial-2395↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 23:08:35.372176 tst handover.py:18: Test FAILED (6.6 sec) 23:08:35.399440 run osmo-hlr_10.42.42.2(pid=11503): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11503)] 23:08:35.449911 run osmo-hlr_10.42.42.2(pid=11503): stdout: | (launched: 2022-12-13_23:08:32.446010) 23:08:35.501283 run osmo-hlr_10.42.42.2(pid=11503): stderr: | 20221213230832645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230832645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230832645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230832645 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230832645 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230832645 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230832658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230832666 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230832666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230832666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:35.573543 run osmo-msc_10.42.42.6(pid=11509): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11509)] 23:08:35.622939 run osmo-msc_10.42.42.6(pid=11509): stdout: | (launched: 2022-12-13_23:08:34.428318) 23:08:35.674366 run osmo-msc_10.42.42.6(pid=11509): stderr: | 20221213230834751 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230834751 DLGLOBAL DEBUG validating counter group 0x7f38b2a03c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230834751 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230834751 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230834751 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230834751 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230834753 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230834753 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230834754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230834754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:35.725764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11502): Terminating (SIGTERM) 23:08:35.767217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11505): Terminating (SIGTERM) 23:08:35.808889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11508): Terminating (SIGTERM) 23:08:35.851097 --- ParallelTerminationStrategy: PID 11502 died... 23:08:35.871642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11502): Terminated: ok {rc=0} 23:08:35.917992 --- ParallelTerminationStrategy: PID 11505 died... 23:08:35.937930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11505): Terminated: ok {rc=0} 23:08:35.983990 --- ParallelTerminationStrategy: PID 11508 died... 23:08:36.004076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11508): Terminated: ok {rc=0} 23:08:36.091958 bus /sierra_3: Setting Powered False 23:08:37.191220 bus /sierra_3: Setting Powered False 23:08:38.309915 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2395 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 23:08:39.565389 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:08:39.570852 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:08:39.634691 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:08:39.661761 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:08:39.715769 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:08:39.780688 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:08:39.807811 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:08:40.357169 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2395 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 23:08:40.362539 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:40.373843 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:40.423426 tst handover.py: using LAC 36889 23:08:40.550329 tst handover.py: using RAC 169 23:08:40.676938 tst handover.py: using CellId 36889 23:08:40.805375 tst handover.py: using BVCI 36890 23:08:40.923150 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:08:40.975967 tst handover.py: using LAC 36890 23:08:41.095558 tst handover.py: using RAC 170 23:08:41.212421 tst handover.py: using CellId 36890 23:08:41.329378 tst handover.py: using BVCI 36891 23:08:41.438553 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:41.449460 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:41.460075 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:41.470784 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:41.481456 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:08:41.491944 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:41.612640 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:08:41.732068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:42.206978 run create_hlr_db(pid=11514): Launched 23:08:42.331627 bus /sierra_2: Setting Powered False 23:08:43.395378 run create_hlr_db(pid=11514): Terminated: ok {rc=0} 23:08:43.816769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11516): Launched 23:08:44.139982 run osmo-hlr_10.42.42.2(pid=11517): Launched 23:08:44.264920 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:44.794237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11519): Launched 23:08:45.117283 run osmo-stp_10.42.42.5(pid=11520): Launched 23:08:45.242721 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:45.800177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11522): Launched 23:08:46.150681 run osmo-msc_10.42.42.6(pid=11523): Launched 23:08:46.449241 run osmo-stp_10.42.42.5(pid=11520): ERR: Terminated: ERROR {rc=1} [trial-2395↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11520)] 23:08:46.682054 run osmo-stp_10.42.42.5(pid=11520): stdout: | (launched: 2022-12-13_23:08:45.058588) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:47.030537 run osmo-stp_10.42.42.5(pid=11520): stderr: | 20221213230845250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230845250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230845250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230845251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230845253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230845253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230845253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:47.310015 run osmo-stp_10.42.42.5(pid=11520): stdout: | (launched: 2022-12-13_23:08:45.058588) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:47.434220 run osmo-stp_10.42.42.5(pid=11520): stderr: | 20221213230845250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213230845250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213230845250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213230845251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213230845253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213230845253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213230845253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:47.578784 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11520): Process ended prematurely: osmo-stp_10.42.42.5(pid=11520) [trial-2395↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11520)] [trial-2395↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 23:08:47.587045 tst handover.py:18: Test FAILED (7.2 sec) 23:08:47.613134 run osmo-hlr_10.42.42.2(pid=11517): ERR: Terminated: ERROR {rc=237} [trial-2395↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11517)] 23:08:47.661403 run osmo-hlr_10.42.42.2(pid=11517): stdout: | (launched: 2022-12-13_23:08:44.081427) 23:08:47.710906 run osmo-hlr_10.42.42.2(pid=11517): stderr: | 20221213230844281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213230844281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213230844281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213230844281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213230844281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213230844281 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213230844293 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213230844302 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213230844302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213230844302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:47.780106 run osmo-msc_10.42.42.6(pid=11523): ERR: Terminated: ERROR {rc=2} [trial-2395↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11523)] 23:08:47.827695 run osmo-msc_10.42.42.6(pid=11523): stdout: | (launched: 2022-12-13_23:08:46.080103) 23:08:47.877104 run osmo-msc_10.42.42.6(pid=11523): stderr: | 20221213230846651 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213230846651 DLGLOBAL DEBUG validating counter group 0x7faa4d5f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213230846652 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213230846652 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213230846653 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213230846655 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213230846664 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213230846666 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213230846667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213230846667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:47.926648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11516): Terminating (SIGTERM) 23:08:47.966228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11519): Terminating (SIGTERM) 23:08:48.005818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11522): Terminating (SIGTERM) 23:08:48.045676 --- ParallelTerminationStrategy: PID 11516 died... 23:08:48.064778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11516): Terminated: ok {rc=0} 23:08:48.109155 --- ParallelTerminationStrategy: PID 11519 died... 23:08:48.127874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11519): Terminated: ok {rc=0} 23:08:48.171789 --- ParallelTerminationStrategy: PID 11522 died... 23:08:48.190525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11522): Terminated: ok {rc=0} 23:08:48.275935 bus /sierra_3: Setting Powered False 23:08:49.375539 bus /sierra_3: Setting Powered False 23:08:50.488834 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2395 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 23:08:51.760597 tst trial-2395: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395/run.2022-12-13_21-44-31/trial-2395.xml -------------------------------------------------------------------------------------------- trial-2395 FAIL -------------------------------------------------------------------------------------------- 23:08:53.699209 tst trial-2395: trial-2395: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.7 sec) Error: osmo-nitb_10.42.42.2(pid=3369): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3369) [trial-2395↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3369)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.3 sec) Error: osmo-stp_10.42.42.5(pid=3379): Process ended prematurely: osmo-stp_10.42.42.5(pid=3379) [trial-2395↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3379)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=3388): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3388) [trial-2395↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3388)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3398): Process ended prematurely: osmo-stp_10.42.42.5(pid=3398) [trial-2395↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3398)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3412): Process ended prematurely: osmo-stp_10.42.42.5(pid=3412) [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3412)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3423): Process ended prematurely: osmo-stp_10.42.42.5(pid=3423) [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3423)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3437): Process ended prematurely: osmo-stp_10.42.42.5(pid=3437) [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3437)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3448): Process ended prematurely: osmo-stp_10.42.42.5(pid=3448) [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3448)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3462): Process ended prematurely: osmo-stp_10.42.42.5(pid=3462) [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3462)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3473): Process ended prematurely: osmo-stp_10.42.42.5(pid=3473) [trial-2395↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3473)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3487): Process ended prematurely: osmo-stp_10.42.42.5(pid=3487) [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3487)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3498): Process ended prematurely: osmo-stp_10.42.42.5(pid=3498) [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3498)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3512): Process ended prematurely: osmo-stp_10.42.42.5(pid=3512) [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3512)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3523): Process ended prematurely: osmo-stp_10.42.42.5(pid=3523) [trial-2395↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3523)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3538): Process ended prematurely: osmo-stp_10.42.42.5(pid=3538) [trial-2395↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3538)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3549): Process ended prematurely: osmo-stp_10.42.42.5(pid=3549) [trial-2395↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3549)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3563): Process ended prematurely: osmo-stp_10.42.42.5(pid=3563) [trial-2395↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3563)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3574): Process ended prematurely: osmo-stp_10.42.42.5(pid=3574) [trial-2395↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3574)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3588): Process ended prematurely: osmo-stp_10.42.42.5(pid=3588) [trial-2395↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3588)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3609): Process ended prematurely: osmo-stp_10.42.42.5(pid=3609) [trial-2395↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3609)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=4153): Process ended prematurely: osmo-stp_10.42.42.5(pid=4153) [trial-2395↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4153)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=4166): Process ended prematurely: osmo-stp_10.42.42.5(pid=4166) [trial-2395↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4166)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=4185): Process ended prematurely: osmo-stp_10.42.42.5(pid=4185) [trial-2395↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4185)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4198): Process ended prematurely: osmo-stp_10.42.42.5(pid=4198) [trial-2395↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4198)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4208): Process ended prematurely: osmo-stp_10.42.42.5(pid=4208) [trial-2395↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4208)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=4225): Process ended prematurely: osmo-stp_10.42.42.5(pid=4225) [trial-2395↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4225)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=4237): Process ended prematurely: osmo-stp_10.42.42.5(pid=4237) [trial-2395↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4237)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=4255): Process ended prematurely: osmo-stp_10.42.42.5(pid=4255) [trial-2395↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4255)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4265): Process ended prematurely: osmo-stp_10.42.42.5(pid=4265) [trial-2395↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4265)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4275): Process ended prematurely: osmo-stp_10.42.42.5(pid=4275) [trial-2395↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4275)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=4293): Process ended prematurely: osmo-stp_10.42.42.5(pid=4293) [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4293)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=4305): Process ended prematurely: osmo-stp_10.42.42.5(pid=4305) [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4305)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=4323): Process ended prematurely: osmo-stp_10.42.42.5(pid=4323) [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4323)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4333): Process ended prematurely: osmo-stp_10.42.42.5(pid=4333) [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4333)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4343): Process ended prematurely: osmo-stp_10.42.42.5(pid=4343) [trial-2395↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4343)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=4362): Process ended prematurely: osmo-stp_10.42.42.5(pid=4362) [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4362)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=4374): Process ended prematurely: osmo-stp_10.42.42.5(pid=4374) [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4374)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=4392): Process ended prematurely: osmo-stp_10.42.42.5(pid=4392) [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4392)] FAIL: ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=4671): Process ended prematurely: osmo-stp_10.42.42.5(pid=4671) [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4671)] FAIL: ping_idle_ping.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=4683): Process ended prematurely: osmo-stp_10.42.42.5(pid=4683) [trial-2395↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4683)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=4696): Process ended prematurely: osmo-stp_10.42.42.5(pid=4696) [trial-2395↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4696)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4710): Process ended prematurely: osmo-stp_10.42.42.5(pid=4710) [trial-2395↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4710)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=4720): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4720) [trial-2395↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4720)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4731): Process ended prematurely: osmo-stp_10.42.42.5(pid=4731) [trial-2395↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4731)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=4743): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4743) [trial-2395↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4743)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=4753): Process ended prematurely: osmo-stp_10.42.42.5(pid=4753) [trial-2395↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4753)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4767): Process ended prematurely: osmo-stp_10.42.42.5(pid=4767) [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4767)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4778): Process ended prematurely: osmo-stp_10.42.42.5(pid=4778) [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4778)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4792): Process ended prematurely: osmo-stp_10.42.42.5(pid=4792) [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4792)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4803): Process ended prematurely: osmo-stp_10.42.42.5(pid=4803) [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4803)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4819): Process ended prematurely: osmo-stp_10.42.42.5(pid=4819) [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4819)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4830): Process ended prematurely: osmo-stp_10.42.42.5(pid=4830) [trial-2395↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4830)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4844): Process ended prematurely: osmo-stp_10.42.42.5(pid=4844) [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4844)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4855): Process ended prematurely: osmo-stp_10.42.42.5(pid=4855) [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4855)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4869): Process ended prematurely: osmo-stp_10.42.42.5(pid=4869) [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4869)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4880): Process ended prematurely: osmo-stp_10.42.42.5(pid=4880) [trial-2395↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4880)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=4894): Process ended prematurely: osmo-stp_10.42.42.5(pid=4894) [trial-2395↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4894)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4905): Process ended prematurely: osmo-stp_10.42.42.5(pid=4905) [trial-2395↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4905)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4919): Process ended prematurely: osmo-stp_10.42.42.5(pid=4919) [trial-2395↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4919)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4930): Process ended prematurely: osmo-stp_10.42.42.5(pid=4930) [trial-2395↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4930)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4946): Process ended prematurely: osmo-stp_10.42.42.5(pid=4946) [trial-2395↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4946)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=4957): Process ended prematurely: osmo-stp_10.42.42.5(pid=4957) [trial-2395↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4957)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=4975): Process ended prematurely: osmo-stp_10.42.42.5(pid=4975) [trial-2395↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4975)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=4987): Process ended prematurely: osmo-stp_10.42.42.5(pid=4987) [trial-2395↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4987)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=5005): Process ended prematurely: osmo-stp_10.42.42.5(pid=5005) [trial-2395↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5005)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5016): Process ended prematurely: osmo-stp_10.42.42.5(pid=5016) [trial-2395↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5016)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5026): Process ended prematurely: osmo-stp_10.42.42.5(pid=5026) [trial-2395↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5026)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=5044): Process ended prematurely: osmo-stp_10.42.42.5(pid=5044) [trial-2395↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5044)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=5056): Process ended prematurely: osmo-stp_10.42.42.5(pid=5056) [trial-2395↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5056)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=5074): Process ended prematurely: osmo-stp_10.42.42.5(pid=5074) [trial-2395↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5074)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5084): Process ended prematurely: osmo-stp_10.42.42.5(pid=5084) [trial-2395↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5084)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5097): Process ended prematurely: osmo-stp_10.42.42.5(pid=5097) [trial-2395↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5097)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=5114): Process ended prematurely: osmo-stp_10.42.42.5(pid=5114) [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5114)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=5126): Process ended prematurely: osmo-stp_10.42.42.5(pid=5126) [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5126)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=5144): Process ended prematurely: osmo-stp_10.42.42.5(pid=5144) [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5144)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5154): Process ended prematurely: osmo-stp_10.42.42.5(pid=5154) [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5154)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5164): Process ended prematurely: osmo-stp_10.42.42.5(pid=5164) [trial-2395↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5164)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=5182): Process ended prematurely: osmo-stp_10.42.42.5(pid=5182) [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5182)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=5194): Process ended prematurely: osmo-stp_10.42.42.5(pid=5194) [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5194)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=5212): Process ended prematurely: osmo-stp_10.42.42.5(pid=5212) [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5212)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5222): Process ended prematurely: osmo-stp_10.42.42.5(pid=5222) [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5222)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5232): Process ended prematurely: osmo-stp_10.42.42.5(pid=5232) [trial-2395↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5232)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5245): Process ended prematurely: osmo-stp_10.42.42.5(pid=5245) [trial-2395↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5245)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5258): Process ended prematurely: osmo-stp_10.42.42.5(pid=5258) [trial-2395↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5258)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=5266): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5266) [trial-2395↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5266)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=5277): Process ended prematurely: osmo-stp_10.42.42.5(pid=5277) [trial-2395↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5277)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=5287): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5287) [trial-2395↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5287)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5297): Process ended prematurely: osmo-stp_10.42.42.5(pid=5297) [trial-2395↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5297)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=5312): Process ended prematurely: osmo-stp_10.42.42.5(pid=5312) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5312)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5323): Process ended prematurely: osmo-stp_10.42.42.5(pid=5323) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5323)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5337): Process ended prematurely: osmo-stp_10.42.42.5(pid=5337) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5337)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5348): Process ended prematurely: osmo-stp_10.42.42.5(pid=5348) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5348)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5362): Process ended prematurely: osmo-stp_10.42.42.5(pid=5362) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5362)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5373): Process ended prematurely: osmo-stp_10.42.42.5(pid=5373) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5373)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=5387): Process ended prematurely: osmo-stp_10.42.42.5(pid=5387) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5387)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=5398): Process ended prematurely: osmo-stp_10.42.42.5(pid=5398) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5398)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=5412): Process ended prematurely: osmo-stp_10.42.42.5(pid=5412) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5412)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5423): Process ended prematurely: osmo-stp_10.42.42.5(pid=5423) [trial-2395↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5423)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5437): Process ended prematurely: osmo-stp_10.42.42.5(pid=5437) [trial-2395↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5437)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5458): Process ended prematurely: osmo-stp_10.42.42.5(pid=5458) [trial-2395↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5458)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5823): Process ended prematurely: osmo-stp_10.42.42.5(pid=5823) [trial-2395↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5823)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6010): Process ended prematurely: osmo-stp_10.42.42.5(pid=6010) [trial-2395↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6010)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6024): Process ended prematurely: osmo-stp_10.42.42.5(pid=6024) [trial-2395↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6024)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6035): Process ended prematurely: osmo-stp_10.42.42.5(pid=6035) [trial-2395↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6035)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6051): Process ended prematurely: osmo-stp_10.42.42.5(pid=6051) [trial-2395↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6051)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6062): Process ended prematurely: osmo-stp_10.42.42.5(pid=6062) [trial-2395↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6062)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6077): Process ended prematurely: osmo-stp_10.42.42.5(pid=6077) [trial-2395↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6077)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6088): Process ended prematurely: osmo-stp_10.42.42.5(pid=6088) [trial-2395↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6088)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=6107): Process ended prematurely: osmo-stp_10.42.42.5(pid=6107) [trial-2395↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6107)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6119): Process ended prematurely: osmo-stp_10.42.42.5(pid=6119) [trial-2395↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6119)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=6137): Process ended prematurely: osmo-stp_10.42.42.5(pid=6137) [trial-2395↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6137)] FAIL: ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=6147): Process ended prematurely: osmo-stp_10.42.42.5(pid=6147) [trial-2395↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6147)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6157): Process ended prematurely: osmo-stp_10.42.42.5(pid=6157) [trial-2395↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6157)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=6174): Process ended prematurely: osmo-stp_10.42.42.5(pid=6174) [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6174)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6186): Process ended prematurely: osmo-stp_10.42.42.5(pid=6186) [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6186)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=6204): Process ended prematurely: osmo-stp_10.42.42.5(pid=6204) [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6204)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=6215): Process ended prematurely: osmo-stp_10.42.42.5(pid=6215) [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6215)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6225): Process ended prematurely: osmo-stp_10.42.42.5(pid=6225) [trial-2395↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6225)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=6242): Process ended prematurely: osmo-stp_10.42.42.5(pid=6242) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6242)] FAIL: iperf3.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=6523): Process ended prematurely: osmo-stp_10.42.42.5(pid=6523) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6523)] FAIL: iperf3m4.py (12.2 sec) Error: osmo-stp_10.42.42.5(pid=6543): Process ended prematurely: osmo-stp_10.42.42.5(pid=6543) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6543)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6555): Process ended prematurely: osmo-stp_10.42.42.5(pid=6555) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6555)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6565): Process ended prematurely: osmo-stp_10.42.42.5(pid=6565) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6565)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=6585): Process ended prematurely: osmo-stp_10.42.42.5(pid=6585) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6585)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=6600): Process ended prematurely: osmo-stp_10.42.42.5(pid=6600) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6600)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=6618): Process ended prematurely: osmo-stp_10.42.42.5(pid=6618) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6618)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=6628): Process ended prematurely: osmo-stp_10.42.42.5(pid=6628) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6628)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6638): Process ended prematurely: osmo-stp_10.42.42.5(pid=6638) [trial-2395↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6638)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=6658): Process ended prematurely: osmo-stp_10.42.42.5(pid=6658) [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6658)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=6670): Process ended prematurely: osmo-stp_10.42.42.5(pid=6670) [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6670)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=6688): Process ended prematurely: osmo-stp_10.42.42.5(pid=6688) [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6688)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6699): Process ended prematurely: osmo-stp_10.42.42.5(pid=6699) [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6699)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6709): Process ended prematurely: osmo-stp_10.42.42.5(pid=6709) [trial-2395↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6709)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6722): Process ended prematurely: osmo-stp_10.42.42.5(pid=6722) [trial-2395↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6722)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6735): Process ended prematurely: osmo-stp_10.42.42.5(pid=6735) [trial-2395↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6735)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=6744): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6744) [trial-2395↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6744)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=6754): Process ended prematurely: osmo-stp_10.42.42.5(pid=6754) [trial-2395↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6754)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=6763): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6763) [trial-2395↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6763)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6773): Process ended prematurely: osmo-stp_10.42.42.5(pid=6773) [trial-2395↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6773)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6787): Process ended prematurely: osmo-stp_10.42.42.5(pid=6787) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6787)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6798): Process ended prematurely: osmo-stp_10.42.42.5(pid=6798) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6798)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6812): Process ended prematurely: osmo-stp_10.42.42.5(pid=6812) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6812)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6824): Process ended prematurely: osmo-stp_10.42.42.5(pid=6824) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6824)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6838): Process ended prematurely: osmo-stp_10.42.42.5(pid=6838) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6838)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6849): Process ended prematurely: osmo-stp_10.42.42.5(pid=6849) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6849)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6863): Process ended prematurely: osmo-stp_10.42.42.5(pid=6863) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6863)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6874): Process ended prematurely: osmo-stp_10.42.42.5(pid=6874) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6874)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6888): Process ended prematurely: osmo-stp_10.42.42.5(pid=6888) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6888)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6899): Process ended prematurely: osmo-stp_10.42.42.5(pid=6899) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6899)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6914): Process ended prematurely: osmo-stp_10.42.42.5(pid=6914) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6914)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6925): Process ended prematurely: osmo-stp_10.42.42.5(pid=6925) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6925)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6939): Process ended prematurely: osmo-stp_10.42.42.5(pid=6939) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6939)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6953): Process ended prematurely: osmo-stp_10.42.42.5(pid=6953) [trial-2395↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6953)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6967): Process ended prematurely: osmo-stp_10.42.42.5(pid=6967) [trial-2395↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6967)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6978): Process ended prematurely: osmo-stp_10.42.42.5(pid=6978) [trial-2395↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6978)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=6997): Process ended prematurely: osmo-stp_10.42.42.5(pid=6997) [trial-2395↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6997)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=7010): Process ended prematurely: osmo-stp_10.42.42.5(pid=7010) [trial-2395↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7010)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=7028): Process ended prematurely: osmo-stp_10.42.42.5(pid=7028) [trial-2395↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7028)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7038): Process ended prematurely: osmo-stp_10.42.42.5(pid=7038) [trial-2395↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7038)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7048): Process ended prematurely: osmo-stp_10.42.42.5(pid=7048) [trial-2395↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7048)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=7066): Process ended prematurely: osmo-stp_10.42.42.5(pid=7066) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7066)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=7078): Process ended prematurely: osmo-stp_10.42.42.5(pid=7078) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7078)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=7099): Process ended prematurely: osmo-stp_10.42.42.5(pid=7099) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7099)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7109): Process ended prematurely: osmo-stp_10.42.42.5(pid=7109) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7109)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7119): Process ended prematurely: osmo-stp_10.42.42.5(pid=7119) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7119)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=7136): Process ended prematurely: osmo-stp_10.42.42.5(pid=7136) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7136)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=7148): Process ended prematurely: osmo-stp_10.42.42.5(pid=7148) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7148)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=7166): Process ended prematurely: osmo-stp_10.42.42.5(pid=7166) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7166)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7176): Process ended prematurely: osmo-stp_10.42.42.5(pid=7176) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7176)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7186): Process ended prematurely: osmo-stp_10.42.42.5(pid=7186) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7186)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=7204): Process ended prematurely: osmo-stp_10.42.42.5(pid=7204) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7204)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=7216): Process ended prematurely: osmo-stp_10.42.42.5(pid=7216) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7216)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=7234): Process ended prematurely: osmo-stp_10.42.42.5(pid=7234) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7234)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7244): Process ended prematurely: osmo-stp_10.42.42.5(pid=7244) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7244)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7256): Process ended prematurely: osmo-stp_10.42.42.5(pid=7256) [trial-2395↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7256)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7269): Process ended prematurely: osmo-stp_10.42.42.5(pid=7269) [trial-2395↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7269)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7282): Process ended prematurely: osmo-stp_10.42.42.5(pid=7282) [trial-2395↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7282)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=7293): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7293) [trial-2395↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7293)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7303): Process ended prematurely: osmo-stp_10.42.42.5(pid=7303) [trial-2395↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7303)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=7313): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7313) [trial-2395↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7313)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7323): Process ended prematurely: osmo-stp_10.42.42.5(pid=7323) [trial-2395↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7323)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7337): Process ended prematurely: osmo-stp_10.42.42.5(pid=7337) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7337)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7349): Process ended prematurely: osmo-stp_10.42.42.5(pid=7349) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7349)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7363): Process ended prematurely: osmo-stp_10.42.42.5(pid=7363) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7363)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7374): Process ended prematurely: osmo-stp_10.42.42.5(pid=7374) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7374)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7388): Process ended prematurely: osmo-stp_10.42.42.5(pid=7388) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7388)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7399): Process ended prematurely: osmo-stp_10.42.42.5(pid=7399) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7399)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7413): Process ended prematurely: osmo-stp_10.42.42.5(pid=7413) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7413)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7425): Process ended prematurely: osmo-stp_10.42.42.5(pid=7425) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7425)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7440): Process ended prematurely: osmo-stp_10.42.42.5(pid=7440) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7440)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7451): Process ended prematurely: osmo-stp_10.42.42.5(pid=7451) [trial-2395↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7451)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7465): Process ended prematurely: osmo-stp_10.42.42.5(pid=7465) [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7465)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7476): Process ended prematurely: osmo-stp_10.42.42.5(pid=7476) [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7476)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7490): Process ended prematurely: osmo-stp_10.42.42.5(pid=7490) [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7490)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7501): Process ended prematurely: osmo-stp_10.42.42.5(pid=7501) [trial-2395↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7501)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7516): Process ended prematurely: osmo-stp_10.42.42.5(pid=7516) [trial-2395↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7516)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7527): Process ended prematurely: osmo-stp_10.42.42.5(pid=7527) [trial-2395↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7527)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7541): Process ended prematurely: osmo-stp_10.42.42.5(pid=7541) [trial-2395↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7541)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7552): Process ended prematurely: osmo-stp_10.42.42.5(pid=7552) [trial-2395↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7552)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (9.5 sec) Error: osmo-stp_10.42.42.5(pid=7618): Process ended prematurely: osmo-stp_10.42.42.5(pid=7618) [trial-2395↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7618)] FAIL: iperf3.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=7854): Process ended prematurely: osmo-stp_10.42.42.5(pid=7854) [trial-2395↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7854)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=7873): Process ended prematurely: osmo-stp_10.42.42.5(pid=7873) [trial-2395↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7873)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7883): Process ended prematurely: osmo-stp_10.42.42.5(pid=7883) [trial-2395↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7883)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7893): Process ended prematurely: osmo-stp_10.42.42.5(pid=7893) [trial-2395↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7893)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=7916): Process ended prematurely: osmo-stp_10.42.42.5(pid=7916) [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7916)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=7928): Process ended prematurely: osmo-stp_10.42.42.5(pid=7928) [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7928)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=7946): Process ended prematurely: osmo-stp_10.42.42.5(pid=7946) [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7946)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7956): Process ended prematurely: osmo-stp_10.42.42.5(pid=7956) [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7956)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7966): Process ended prematurely: osmo-stp_10.42.42.5(pid=7966) [trial-2395↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7966)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=7985): Process ended prematurely: osmo-stp_10.42.42.5(pid=7985) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7985)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=7997): Process ended prematurely: osmo-stp_10.42.42.5(pid=7997) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7997)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=8015): Process ended prematurely: osmo-stp_10.42.42.5(pid=8015) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8015)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8025): Process ended prematurely: osmo-stp_10.42.42.5(pid=8025) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8025)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8035): Process ended prematurely: osmo-stp_10.42.42.5(pid=8035) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8035)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=8052): Process ended prematurely: osmo-stp_10.42.42.5(pid=8052) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8052)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=8065): Process ended prematurely: osmo-stp_10.42.42.5(pid=8065) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8065)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=8083): Process ended prematurely: osmo-stp_10.42.42.5(pid=8083) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8083)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8093): Process ended prematurely: osmo-stp_10.42.42.5(pid=8093) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8093)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8103): Process ended prematurely: osmo-stp_10.42.42.5(pid=8103) [trial-2395↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8103)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=8120): Process ended prematurely: osmo-stp_10.42.42.5(pid=8120) [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8120)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=8132): Process ended prematurely: osmo-stp_10.42.42.5(pid=8132) [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8132)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=8150): Process ended prematurely: osmo-stp_10.42.42.5(pid=8150) [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8150)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8160): Process ended prematurely: osmo-stp_10.42.42.5(pid=8160) [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8160)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8170): Process ended prematurely: osmo-stp_10.42.42.5(pid=8170) [trial-2395↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8170)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8183): Process ended prematurely: osmo-stp_10.42.42.5(pid=8183) [trial-2395↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8183)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8196): Process ended prematurely: osmo-stp_10.42.42.5(pid=8196) [trial-2395↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8196)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=8204): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8204) [trial-2395↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8204)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8215): Process ended prematurely: osmo-stp_10.42.42.5(pid=8215) [trial-2395↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8215)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=8224): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8224) [trial-2395↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8224)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8234): Process ended prematurely: osmo-stp_10.42.42.5(pid=8234) [trial-2395↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8234)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8248): Process ended prematurely: osmo-stp_10.42.42.5(pid=8248) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8248)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8262): Process ended prematurely: osmo-stp_10.42.42.5(pid=8262) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8262)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8276): Process ended prematurely: osmo-stp_10.42.42.5(pid=8276) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8276)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8287): Process ended prematurely: osmo-stp_10.42.42.5(pid=8287) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8287)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8301): Process ended prematurely: osmo-stp_10.42.42.5(pid=8301) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8301)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8312): Process ended prematurely: osmo-stp_10.42.42.5(pid=8312) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8312)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8326): Process ended prematurely: osmo-stp_10.42.42.5(pid=8326) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8326)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8337): Process ended prematurely: osmo-stp_10.42.42.5(pid=8337) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8337)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8351): Process ended prematurely: osmo-stp_10.42.42.5(pid=8351) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8351)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8362): Process ended prematurely: osmo-stp_10.42.42.5(pid=8362) [trial-2395↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8362)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8377): Process ended prematurely: osmo-stp_10.42.42.5(pid=8377) [trial-2395↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8377)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8388): Process ended prematurely: osmo-stp_10.42.42.5(pid=8388) [trial-2395↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8388)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8402): Process ended prematurely: osmo-stp_10.42.42.5(pid=8402) [trial-2395↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8402)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8413): Process ended prematurely: osmo-stp_10.42.42.5(pid=8413) [trial-2395↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8413)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8428): Process ended prematurely: osmo-stp_10.42.42.5(pid=8428) [trial-2395↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8428)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8439): Process ended prematurely: osmo-stp_10.42.42.5(pid=8439) [trial-2395↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8439)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=8458): Process ended prematurely: osmo-stp_10.42.42.5(pid=8458) [trial-2395↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8458)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=8471): Process ended prematurely: osmo-stp_10.42.42.5(pid=8471) [trial-2395↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8471)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=8489): Process ended prematurely: osmo-stp_10.42.42.5(pid=8489) [trial-2395↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8489)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8499): Process ended prematurely: osmo-stp_10.42.42.5(pid=8499) [trial-2395↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8499)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8509): Process ended prematurely: osmo-stp_10.42.42.5(pid=8509) [trial-2395↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8509)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=8527): Process ended prematurely: osmo-stp_10.42.42.5(pid=8527) [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8527)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=8539): Process ended prematurely: osmo-stp_10.42.42.5(pid=8539) [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8539)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=8557): Process ended prematurely: osmo-stp_10.42.42.5(pid=8557) [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8557)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8567): Process ended prematurely: osmo-stp_10.42.42.5(pid=8567) [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8567)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8577): Process ended prematurely: osmo-stp_10.42.42.5(pid=8577) [trial-2395↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8577)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=8595): Process ended prematurely: osmo-stp_10.42.42.5(pid=8595) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8595)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=8610): Process ended prematurely: osmo-stp_10.42.42.5(pid=8610) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8610)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=8628): Process ended prematurely: osmo-stp_10.42.42.5(pid=8628) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8628)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8638): Process ended prematurely: osmo-stp_10.42.42.5(pid=8638) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8638)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8648): Process ended prematurely: osmo-stp_10.42.42.5(pid=8648) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8648)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=8668): Process ended prematurely: osmo-stp_10.42.42.5(pid=8668) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8668)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=8680): Process ended prematurely: osmo-stp_10.42.42.5(pid=8680) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8680)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=8703): Process ended prematurely: osmo-stp_10.42.42.5(pid=8703) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8703)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8713): Process ended prematurely: osmo-stp_10.42.42.5(pid=8713) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8713)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8723): Process ended prematurely: osmo-stp_10.42.42.5(pid=8723) [trial-2395↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8723)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8736): Process ended prematurely: osmo-stp_10.42.42.5(pid=8736) [trial-2395↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8736)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8749): Process ended prematurely: osmo-stp_10.42.42.5(pid=8749) [trial-2395↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8749)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=8757): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8757) [trial-2395↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8757)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8767): Process ended prematurely: osmo-stp_10.42.42.5(pid=8767) [trial-2395↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8767)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=8777): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8777) [trial-2395↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8777)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=8787): Process ended prematurely: osmo-stp_10.42.42.5(pid=8787) [trial-2395↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8787)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8801): Process ended prematurely: osmo-stp_10.42.42.5(pid=8801) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8801)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8812): Process ended prematurely: osmo-stp_10.42.42.5(pid=8812) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8812)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8827): Process ended prematurely: osmo-stp_10.42.42.5(pid=8827) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8827)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8838): Process ended prematurely: osmo-stp_10.42.42.5(pid=8838) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8838)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8852): Process ended prematurely: osmo-stp_10.42.42.5(pid=8852) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8852)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8863): Process ended prematurely: osmo-stp_10.42.42.5(pid=8863) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8863)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8879): Process ended prematurely: osmo-stp_10.42.42.5(pid=8879) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8879)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8890): Process ended prematurely: osmo-stp_10.42.42.5(pid=8890) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8890)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=9175): Process ended prematurely: osmo-stp_10.42.42.5(pid=9175) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9175)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9187): Process ended prematurely: osmo-stp_10.42.42.5(pid=9187) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9187)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9201): Process ended prematurely: osmo-stp_10.42.42.5(pid=9201) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9201)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9212): Process ended prematurely: osmo-stp_10.42.42.5(pid=9212) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9212)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9226): Process ended prematurely: osmo-stp_10.42.42.5(pid=9226) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9226)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9240): Process ended prematurely: osmo-stp_10.42.42.5(pid=9240) [trial-2395↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9240)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9254): Process ended prematurely: osmo-stp_10.42.42.5(pid=9254) [trial-2395↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9254)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9265): Process ended prematurely: osmo-stp_10.42.42.5(pid=9265) [trial-2395↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9265)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=9283): Process ended prematurely: osmo-stp_10.42.42.5(pid=9283) [trial-2395↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9283)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=9295): Process ended prematurely: osmo-stp_10.42.42.5(pid=9295) [trial-2395↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9295)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=9313): Process ended prematurely: osmo-stp_10.42.42.5(pid=9313) [trial-2395↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9313)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9323): Process ended prematurely: osmo-stp_10.42.42.5(pid=9323) [trial-2395↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9323)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9333): Process ended prematurely: osmo-stp_10.42.42.5(pid=9333) [trial-2395↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9333)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=9350): Process ended prematurely: osmo-stp_10.42.42.5(pid=9350) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9350)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=9362): Process ended prematurely: osmo-stp_10.42.42.5(pid=9362) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9362)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=9382): Process ended prematurely: osmo-stp_10.42.42.5(pid=9382) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9382)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9392): Process ended prematurely: osmo-stp_10.42.42.5(pid=9392) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9392)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9402): Process ended prematurely: osmo-stp_10.42.42.5(pid=9402) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9402)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=9419): Process ended prematurely: osmo-stp_10.42.42.5(pid=9419) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9419)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=9431): Process ended prematurely: osmo-stp_10.42.42.5(pid=9431) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9431)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=9449): Process ended prematurely: osmo-stp_10.42.42.5(pid=9449) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9449)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9459): Process ended prematurely: osmo-stp_10.42.42.5(pid=9459) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9459)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9469): Process ended prematurely: osmo-stp_10.42.42.5(pid=9469) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9469)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=9487): Process ended prematurely: osmo-stp_10.42.42.5(pid=9487) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9487)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=9499): Process ended prematurely: osmo-stp_10.42.42.5(pid=9499) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9499)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=9517): Process ended prematurely: osmo-stp_10.42.42.5(pid=9517) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9517)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9530): Process ended prematurely: osmo-stp_10.42.42.5(pid=9530) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9530)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9540): Process ended prematurely: osmo-stp_10.42.42.5(pid=9540) [trial-2395↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9540)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9554): Process ended prematurely: osmo-stp_10.42.42.5(pid=9554) [trial-2395↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9554)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9567): Process ended prematurely: osmo-stp_10.42.42.5(pid=9567) [trial-2395↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9567)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=9578): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9578) [trial-2395↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9578)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9588): Process ended prematurely: osmo-stp_10.42.42.5(pid=9588) [trial-2395↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9588)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=9597): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9597) [trial-2395↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9597)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=9607): Process ended prematurely: osmo-stp_10.42.42.5(pid=9607) [trial-2395↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9607)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9621): Process ended prematurely: osmo-stp_10.42.42.5(pid=9621) [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9621)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9632): Process ended prematurely: osmo-stp_10.42.42.5(pid=9632) [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9632)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9646): Process ended prematurely: osmo-stp_10.42.42.5(pid=9646) [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9646)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9657): Process ended prematurely: osmo-stp_10.42.42.5(pid=9657) [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9657)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9671): Process ended prematurely: osmo-stp_10.42.42.5(pid=9671) [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9671)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9682): Process ended prematurely: osmo-stp_10.42.42.5(pid=9682) [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9682)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9696): Process ended prematurely: osmo-stp_10.42.42.5(pid=9696) [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9696)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9707): Process ended prematurely: osmo-stp_10.42.42.5(pid=9707) [trial-2395↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9707)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9721): Process ended prematurely: osmo-stp_10.42.42.5(pid=9721) [trial-2395↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9721)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9732): Process ended prematurely: osmo-stp_10.42.42.5(pid=9732) [trial-2395↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9732)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9746): Process ended prematurely: osmo-stp_10.42.42.5(pid=9746) [trial-2395↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9746)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9757): Process ended prematurely: osmo-stp_10.42.42.5(pid=9757) [trial-2395↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9757)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=9775): Process ended prematurely: osmo-stp_10.42.42.5(pid=9775) [trial-2395↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9775)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=9787): Process ended prematurely: osmo-stp_10.42.42.5(pid=9787) [trial-2395↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9787)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=9805): Process ended prematurely: osmo-stp_10.42.42.5(pid=9805) [trial-2395↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9805)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9816): Process ended prematurely: osmo-stp_10.42.42.5(pid=9816) [trial-2395↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9816)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9826): Process ended prematurely: osmo-stp_10.42.42.5(pid=9826) [trial-2395↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9826)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=9844): Process ended prematurely: osmo-stp_10.42.42.5(pid=9844) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9844)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=9856): Process ended prematurely: osmo-stp_10.42.42.5(pid=9856) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9856)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=9874): Process ended prematurely: osmo-stp_10.42.42.5(pid=9874) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9874)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9884): Process ended prematurely: osmo-stp_10.42.42.5(pid=9884) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9884)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9895): Process ended prematurely: osmo-stp_10.42.42.5(pid=9895) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9895)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=9912): Process ended prematurely: osmo-stp_10.42.42.5(pid=9912) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9912)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=9927): Process ended prematurely: osmo-stp_10.42.42.5(pid=9927) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9927)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=9945): Process ended prematurely: osmo-stp_10.42.42.5(pid=9945) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9945)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9955): Process ended prematurely: osmo-stp_10.42.42.5(pid=9955) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9955)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9965): Process ended prematurely: osmo-stp_10.42.42.5(pid=9965) [trial-2395↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9965)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9978): Process ended prematurely: osmo-stp_10.42.42.5(pid=9978) [trial-2395↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9978)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9994): Process ended prematurely: osmo-stp_10.42.42.5(pid=9994) [trial-2395↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9994)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=10003): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10003) [trial-2395↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10003)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10013): Process ended prematurely: osmo-stp_10.42.42.5(pid=10013) [trial-2395↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10013)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10027): Process ended prematurely: osmo-stp_10.42.42.5(pid=10027) [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10027)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10038): Process ended prematurely: osmo-stp_10.42.42.5(pid=10038) [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10038)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10052): Process ended prematurely: osmo-stp_10.42.42.5(pid=10052) [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10052)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10063): Process ended prematurely: osmo-stp_10.42.42.5(pid=10063) [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10063)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10077): Process ended prematurely: osmo-stp_10.42.42.5(pid=10077) [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10077)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10088): Process ended prematurely: osmo-stp_10.42.42.5(pid=10088) [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10088)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10103): Process ended prematurely: osmo-stp_10.42.42.5(pid=10103) [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10103)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10114): Process ended prematurely: osmo-stp_10.42.42.5(pid=10114) [trial-2395↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10114)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10128): Process ended prematurely: osmo-stp_10.42.42.5(pid=10128) [trial-2395↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10128)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10139): Process ended prematurely: osmo-stp_10.42.42.5(pid=10139) [trial-2395↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10139)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10153): Process ended prematurely: osmo-stp_10.42.42.5(pid=10153) [trial-2395↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10153)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10164): Process ended prematurely: osmo-stp_10.42.42.5(pid=10164) [trial-2395↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10164)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10178): Process ended prematurely: osmo-stp_10.42.42.5(pid=10178) [trial-2395↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10178)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10189): Process ended prematurely: osmo-stp_10.42.42.5(pid=10189) [trial-2395↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10189)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (9.9 sec) Error: osmo-stp_10.42.42.5(pid=10477): Process ended prematurely: osmo-stp_10.42.42.5(pid=10477) [trial-2395↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10477)] FAIL: iperf3.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=10491): Process ended prematurely: osmo-stp_10.42.42.5(pid=10491) [trial-2395↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10491)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=10509): Process ended prematurely: osmo-stp_10.42.42.5(pid=10509) [trial-2395↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10509)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=10520): Process ended prematurely: osmo-stp_10.42.42.5(pid=10520) [trial-2395↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10520)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10530): Process ended prematurely: osmo-stp_10.42.42.5(pid=10530) [trial-2395↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10530)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=10552): Process ended prematurely: osmo-stp_10.42.42.5(pid=10552) [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10552)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=10564): Process ended prematurely: osmo-stp_10.42.42.5(pid=10564) [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10564)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=10582): Process ended prematurely: osmo-stp_10.42.42.5(pid=10582) [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10582)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10592): Process ended prematurely: osmo-stp_10.42.42.5(pid=10592) [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10592)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10606): Process ended prematurely: osmo-stp_10.42.42.5(pid=10606) [trial-2395↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10606)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=10623): Process ended prematurely: osmo-stp_10.42.42.5(pid=10623) [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10623)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=10635): Process ended prematurely: osmo-stp_10.42.42.5(pid=10635) [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10635)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=10657): Process ended prematurely: osmo-stp_10.42.42.5(pid=10657) [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10657)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10667): Process ended prematurely: osmo-stp_10.42.42.5(pid=10667) [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10667)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10677): Process ended prematurely: osmo-stp_10.42.42.5(pid=10677) [trial-2395↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10677)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=10694): Process ended prematurely: osmo-stp_10.42.42.5(pid=10694) [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10694)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=10706): Process ended prematurely: osmo-stp_10.42.42.5(pid=10706) [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10706)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=10724): Process ended prematurely: osmo-stp_10.42.42.5(pid=10724) [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10724)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=10734): Process ended prematurely: osmo-stp_10.42.42.5(pid=10734) [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10734)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10744): Process ended prematurely: osmo-stp_10.42.42.5(pid=10744) [trial-2395↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10744)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10759): Process ended prematurely: osmo-stp_10.42.42.5(pid=10759) [trial-2395↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10759)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=10767): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10767) [trial-2395↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10767)] FAIL: esme_connect_policy_closed.py (1.9 sec) Error: osmo-nitb_10.42.42.2(pid=10769): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10769) [trial-2395↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10769)] FAIL: esme_ms_sms_storeforward.py (2.8 sec) Error: osmo-nitb_10.42.42.2(pid=10771): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10771) [trial-2395↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10771)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=10773): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10773) [trial-2395↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10773)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (6.3 sec) Error: osmo-hlr_10.42.42.2(pid=10782): Process ended prematurely: osmo-hlr_10.42.42.2(pid=10782) [trial-2395↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10782)] FAIL: esme_connect_policy_closed.py (5.8 sec) Error: osmo-hlr_10.42.42.2(pid=10793): Process ended prematurely: osmo-hlr_10.42.42.2(pid=10793) [trial-2395↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10793)] FAIL: esme_ms_sms_storeforward.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10805): Process ended prematurely: osmo-stp_10.42.42.5(pid=10805) [trial-2395↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10805)] FAIL: esme_ms_sms_transaction.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10816): Process ended prematurely: osmo-stp_10.42.42.5(pid=10816) [trial-2395↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10816)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10830): Process ended prematurely: osmo-stp_10.42.42.5(pid=10830) [trial-2395↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10830)] FAIL: register_a5_0_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10842): Process ended prematurely: osmo-stp_10.42.42.5(pid=10842) [trial-2395↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10842)] FAIL: register_a5_1_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10853): Process ended prematurely: osmo-stp_10.42.42.5(pid=10853) [trial-2395↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10853)] FAIL: register_a5_3_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10864): Process ended prematurely: osmo-stp_10.42.42.5(pid=10864) [trial-2395↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10864)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.2 sec) Error: srsepc(pid=10884): Process ended prematurely: srsepc(pid=10884) [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10884)] FAIL: iperf3_bidir.py (19.0 sec) Error: srsepc(pid=10904): Process ended prematurely: srsepc(pid=10904) [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10904)] FAIL: iperf3_dl.py (19.0 sec) Error: srsepc(pid=10932): Process ended prematurely: srsepc(pid=10932) [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10932)] FAIL: iperf3_ul.py (19.2 sec) Error: srsepc(pid=10948): Process ended prematurely: srsepc(pid=10948) [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10948)] FAIL: ping.py (18.6 sec) Error: srsepc(pid=10968): Process ended prematurely: srsepc(pid=10968) [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10968)] FAIL: rrc_idle_mo_ping.py (18.5 sec) Error: srsepc(pid=10984): Process ended prematurely: srsepc(pid=10984) [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10984)] FAIL: rrc_idle_mt_ping.py (18.3 sec) Error: srsepc(pid=11000): Process ended prematurely: srsepc(pid=11000) [trial-2395↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11000)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11014): Process ended prematurely: osmo-stp_10.42.42.5(pid=11014) [trial-2395↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11014)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11031): Process ended prematurely: osmo-stp_10.42.42.5(pid=11031) [trial-2395↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11031)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11045): Process ended prematurely: osmo-stp_10.42.42.5(pid=11045) [trial-2395↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11045)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11059): Process ended prematurely: osmo-stp_10.42.42.5(pid=11059) [trial-2395↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11059)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11074): Process ended prematurely: osmo-stp_10.42.42.5(pid=11074) [trial-2395↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11074)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11088): Process ended prematurely: osmo-stp_10.42.42.5(pid=11088) [trial-2395↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11088)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11103): Process ended prematurely: osmo-stp_10.42.42.5(pid=11103) [trial-2395↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11103)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11117): Process ended prematurely: osmo-stp_10.42.42.5(pid=11117) [trial-2395↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11117)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=11131): Process ended prematurely: osmo-stp_10.42.42.5(pid=11131) [trial-2395↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11131)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11145): Process ended prematurely: osmo-stp_10.42.42.5(pid=11145) [trial-2395↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11145)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11160): Process ended prematurely: osmo-stp_10.42.42.5(pid=11160) [trial-2395↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11160)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11174): Process ended prematurely: osmo-stp_10.42.42.5(pid=11174) [trial-2395↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11174)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11188): Process ended prematurely: osmo-stp_10.42.42.5(pid=11188) [trial-2395↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11188)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=11202): Process ended prematurely: osmo-stp_10.42.42.5(pid=11202) [trial-2395↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11202)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11218): Process ended prematurely: osmo-stp_10.42.42.5(pid=11218) [trial-2395↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11218)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11232): Process ended prematurely: osmo-stp_10.42.42.5(pid=11232) [trial-2395↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11232)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11250): Process ended prematurely: osmo-stp_10.42.42.5(pid=11250) [trial-2395↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11250)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11264): Process ended prematurely: osmo-stp_10.42.42.5(pid=11264) [trial-2395↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11264)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11279): Process ended prematurely: osmo-stp_10.42.42.5(pid=11279) [trial-2395↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11279)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11293): Process ended prematurely: osmo-stp_10.42.42.5(pid=11293) [trial-2395↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11293)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11307): Process ended prematurely: osmo-stp_10.42.42.5(pid=11307) [trial-2395↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11307)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11323): Process ended prematurely: osmo-stp_10.42.42.5(pid=11323) [trial-2395↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11323)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11337): Process ended prematurely: osmo-stp_10.42.42.5(pid=11337) [trial-2395↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11337)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11351): Process ended prematurely: osmo-stp_10.42.42.5(pid=11351) [trial-2395↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11351)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11365): Process ended prematurely: osmo-stp_10.42.42.5(pid=11365) [trial-2395↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11365)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11379): Process ended prematurely: osmo-stp_10.42.42.5(pid=11379) [trial-2395↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11379)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11393): Process ended prematurely: osmo-stp_10.42.42.5(pid=11393) [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11393)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11407): Process ended prematurely: osmo-stp_10.42.42.5(pid=11407) [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11407)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11421): Process ended prematurely: osmo-stp_10.42.42.5(pid=11421) [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11421)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11435): Process ended prematurely: osmo-stp_10.42.42.5(pid=11435) [trial-2395↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11435)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11449): Process ended prematurely: osmo-stp_10.42.42.5(pid=11449) [trial-2395↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11449)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11463): Process ended prematurely: osmo-stp_10.42.42.5(pid=11463) [trial-2395↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11463)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11478): Process ended prematurely: osmo-stp_10.42.42.5(pid=11478) [trial-2395↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11478)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11492): Process ended prematurely: osmo-stp_10.42.42.5(pid=11492) [trial-2395↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11492)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11506): Process ended prematurely: osmo-stp_10.42.42.5(pid=11506) [trial-2395↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11506)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=11520): Process ended prematurely: osmo-stp_10.42.42.5(pid=11520) [trial-2395↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11520)] + rm -rf trial-2395/inst + cd trial-2395 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-13 21:44:19 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395-run.tgz run.2022-12-13_21-44-31 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2395-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17681.tgz osmo-bts-oc2g.build-5537.tgz osmo-bts-sysmo.build-8041.tgz osmo-bts.build-7510.tgz osmo-ggsn.build-6691.tgz osmo-hlr.build-8715.tgz osmo-hnbgw.build-2987.tgz osmo-mgw.build-8960.tgz osmo-msc.build-29307.tgz osmo-nitb.build-12991.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30091.tgz osmo-stp.build-9256.tgz osmo-trx.build-4683.tgz osmocom-bb.build-4710.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE