Changes

osmo-sgsn: Fix template cfg to work with NS2 implementation

See following HOW-TO to update existing configs:
https://osmocom.org/projects/libosmocore/wiki/Network_service_(NS)

Change-Id: I391c977ca20ef185db6b1f17912608acaa13e87f

Fix bts.ready_for_pcu() implementation for sysmo and oc2g

osmo-bts.git ae09c8acb4aa93284cdb44f8bbdc14533dc4fa52 modified code to
avoid calling pcu_tx_info_ind() if pcu socket was not connected. Since
osmo-gsm-tester relied on log message sent from within that funtion to
find out whether BTS was able to handle PCUIF connections, that log line
is not printed anymore and hence the function ready_for_pcu() fails to
ever return true.
As a result, gprs tests for sysmo and oc2g bts types always fail with a
timeout.

Other BTS types are not affected (such as osmo-bts-trx) because in there
we simply check whether the osmo-bts process is running.

Change-Id: Ibde4b8b27b8300b4b9197c0f8d82a6ccbf3b0522

contrib: Add build script for open5gs

Change-Id: I0ed43dadbfe08811dd72064ee7332d0872882dfd

enb,epc,ms: refactor KPI API

we previously mixed component specific and component agnostic APIs
(stdout vs. log file for example) for setting and retrieving KPI.

This patch propose to use a single abstract get_kpis() method for
all components that can be enriched with component-specific
stuff as desired.

In the case of srsLTE blocks, the main implementation will
remain in srslte_common() and is shared among srsENB/srsUE/srsEPC.

The KPI analyzer in srslte_common() extract and also manages
all three KPI sources (log, csv and stdout) independently.

In addition to the get_kpis() method that always returns a flat
dictionary, it also exposes get_kpi_tree() that return
a dict of KPI dicts that will be used for the Junit.xml generation.

Change-Id: I4bacc6b8a0cb92a581edfb947100b57022265265

enb.py: increase zmq trx timeout to 4000ms

with many parallel jobs running on one machine we should
relax the timeout a bit to avoid false positives.

Change-Id: Ib32a07559bd5a4b0165f6d3431c5ac57cc050f44

{enb,ms}-label.conf: raneme and add modifier to select eNB/MS based on label

Change-Id: I26ea160b65b9dd5ef3e5ca1100d4541a0bbcbb27

srsenb_drb.conf.tmpl: set PDCP discard timer to 150ms for QCI9

srsENB now supports PDCP discard so we set it to a sane value.
Also enable status reporting for UL.

Change-Id: Ib6ad0ff57b95a1f220f87c1ede0f6eacc5fb21ff

amarisoft_drb.cfg.tmpl: add additional QCI10 with infinit PDCP discard timer

also set QCI9 to 150ms to match default srsENB config

Change-Id: I60cc1390480142bd5bb516934c9f30b6122496d5

srsenb_drb.conf.tmpl: add QCI10 with infinit PDCP discard timer

copy of QCI9 params but with infinit PDCP discard to avoid SDU drops
at PDCP

Change-Id: I64a74d09cc1a55ba21a7be7b5cc203e56bba3b10

ms_srs: add config scheme to select NAS log level

we've provided only all_log_level so far but sometimes it's needed
to select the level per layer. This patch adds the ability
to do so for the NAS layer in the UE.

Change-Id: Iab2bce65e8af81f6d344849c97952e6441cb2846

srsue.conf.tmpl: Adjust ue.config template for new pcap path

Change-Id: I4af6abaa3973652a12f571d88bca59cd443704f3

srsenb_sib.conf.tmpl: reduce the default size of the PUCCH

optimized PUCCH config

Change-Id: I45ae7c33f9d1df20df37c0fe6c3d73aa85ae1b31

jenkins-build-amarisoft: copy ltesim_server binary into epc trial tgz

the ltesim_server is part of the UE package but needs to be executed
on the EPC run node. Therefore its handy to have the binary in the epc
trial tgz.

Change-Id: I21ac57d1c1547c1cf4d2394c8593f58ff2c78697

osmo-gsm-tester_androidue_conn_chk.sh: improve error handling

fix check of $serial and check passed arguments.
exit when adb isn't installed on host

Change-Id: I6190a840dbc86838457da96d188afc17f83ab15f

ms_android: set num_carriers to 1 by default

throughput tests require the UE object to have the num_carriers
member. For Android UEs, set it to 1 by default.

Change-Id: I297d24bb578a7db0eb7629be4f2cc0d54624467d

epc-label@.conf: add scenario to select runnode based on label

this allows to select the resource/machine the EPC runs on based on the label

Change-Id: I710c67ad5a11bd33071acd779e19835ae49ce4a3

run_node: add label to RunNode class

this allows specifying a label on each run node that can be used
to filter/select specific nodes.

Change-Id: Ib6a977007f56d6ff9ff029aaf049a75fb5d5e1dd

mod-enb-ncells@.conf: add scenario file to select number of cells

Change-Id: Ib599de56b0b51a125555895014d78d3d649c01a0

ms_srs: turn tx/rx_gain into INT and make them optional

when they are greater than 0 they are written as config paramter.
if they are -1 they are disbaled and automatic gain calibration is
used.

Change-Id: I473ff3ae679784178574d2f76b612dbf77180490

AndroidUE: Fix connection timeout

Change-Id: Iaacf348e2e018da5b67ada33079018c1859d3b63

iperf3_bidir: add extra test for bi-directional iperf test

Change-Id: Ibb62f53dbb15bc4788c92ebb2dee70e31dd851de

ms_srs: add force_ul_amplitude config

this allows to overwrite the PHY export option phy.force_ul_amplitude

Change-Id: I255f027433944c1739c89757609f0dcc3b8aa7cb

enb.py: increase ZMQ trx timeout to 8s

increase value further to avoid failed tests due to load on system

Change-Id: I77b7864e7ef60faf0262dc24325915d73dd2d5a3

srslte_common: fix condition to check if KPI have already extracted

Change-Id: I6fdcbfadfdcfe131096d0345d2c21c87f8f7b1b6

sysmo/defaults.conf: Fix attribute name

According to schema, the name is cipher_list.
Same goes for "integrity".

Fixes: a81801558e7bb6ef0f0a32ab078d302c91e940a8
Change-Id: Ib7b48ce207b96ea5f5b59db08320563be40edba1

sysmocom/default.conf: Add missing default value for force_ul_amplitude

Change-Id: I04218dca21f27e32d7c85a74a3e9bbf63b499357

contrib: open5gs: Install more binaries to have an EPC

Change-Id: I1ff143b4f876e28ad9a1bc6a4a4cad5dacef8e18

Initial Open5GS support

Change-Id: Iff8b88dc22d8f156572839abb48b0c1377c55e33

open5gs: Avoid use of non-standard ports

Despite open5gs allowing to change the GTP ports in the config file, in
reality changing those values to something else than the standard prot
will fail. Hence, we must use the standard port. As a result, we must
use different IP addresses in each process to avoid ip+port collisions.
Let's use some loopback addresses which shouldn't require extra
configuration on the host, and still only requiring 1 run_node as per
existing EPCs, with the limitation that only 1 open5gs EPC instance can
be run at one in a given run_node.

Related: https://github.com/open5gs/open5gs/issues/897
Change-Id: Id3062c6ad9d6de4c6066547e1e46edad5da285c1

amarisoft_mme: use/expose count paramter from MS config for MME

the UEs count param, if specified, is mapped into the config
values of the EPC so it can be used for template rendering.

Since we only have one count parameter, its added to the first
subscriber. 1 is the default value and its used when no count
param is specified.

this allows to run the Amarisoft UE simulator with the Amarisoft EPC
without having to create subscriber entries for each simulated UE.

Change-Id: I29885791f716c204d0b6f18ba134885bae853b6f

epc_amarisoft: launch ltesim server when starting

this allows to use the lteue to generate DL traffic. the
server listens on the default spgw address.

Change-Id: Iad081e57e2fd9d3cbc3e59e4f729a4721ad778c9

ms_srs: add resource scheme to configure fixed DL and UL freq

this config option overwrites the EARFCN config that is typically
used to tell the UE the bands to scan for cells. When custom
frequencies are used, this option allows to set them explicitly.

Change-Id: Ice070ea6755e273d916db2dc941068d33bbe206a

enb_srs: add support for eNB traces

this patch adds support for srsENB event tracing. it provides
a cfg scenario to enable it.

Change-Id: Icb2342acac5db87a0889cbf1b6c7bb1ad26c16fa

ms_amarisoft: extend AmariUE to support custom frequency bands

this patch adds generic support for custom frequency bands to the ms class.
it then extends the config template for AmariUE to use them.
we set the default values for EARFCNs for DL/UL to the old values.

Change-Id: I7b2250e13fc1161be1a1d73a4348f07b31c0f724

ping.py: add stricter pass/fail check

the ping test should only pass if not a single ping is lost

Change-Id: If089f77df1ffe991f26f1546558d51aac242df83

schema: add 5G as UE feature

Change-Id: I851e95fb0b763f2a838b161be4938715770eaa83

jenkins-build-amarisoft: adjusting lib name to srsran and update versions

fix rename of srslte to srsran libs and also update Amarisoft
versions.

Change-Id: I2174aec3c7ded8c966877a87f4cc6a39ce1325c2

amarisoft_ltemme.cfg.tmpl: add gbr to the template

newer version of the amarisoft mme requires the GBR to be set

Change-Id: Ib0b046ea9fcc26b6bbe03461ca6308acc35175d1

rfemu_srsenb_stdin: catch exception in rfemu and log error

not handling the exception causes all following tests to
fail.

Change-Id: I496313ef8412c8cb18a3c2cb32c52a3b5a672853

srsenb_drb.conf.tmpl: decrease pollPDU for QCI9

due to internal PDU buffering between PDCP/RLC the poll frequency
needs to be increase to get quicker feedback.

Change-Id: I4114fb36e675b3f91c471558f716276ab24f1db5

enb: add rx_ant param

Change-Id: Iada98fce3608808914562d9f7e2af2c230e03cae

4g: add overlay template path for all suites

this allows, without changing the test case, to use a custom
template, which is useful for development. By default, nothing changes
and the OGT template is used

Change-Id: Ifc43ac41b16813116f2559da5223a6fecc186125

ping: add a short delay after UE is attached before starting ping

this is mainly to avoid ping losses in 5G NSA during NR attach.
No impact on 4G though.

Change-Id: Ic507dc4a24e8576b0ec3b301ee8e340ed553b300

ms_srs: extend prach_sent counter with NR version

make LTE version more explicit and add another counter for NR

Change-Id: I8192dc3b4dae27417c93b68d33a686bca4783f4d

srsue.conf.tmpl: update args for 21.04 changes to include NSA

this also removes the entire help text around arguments (that
were very outdated already) and only leaves the actual values with changes.

Change-Id: Icb9e8e7b1c68cf024db3a7273af791f017c32003

enb_amarisoft: add "sdr" as rf_dev_type and rx_ant parameter

this allows to use the Amarisoft PCIe cards with OGT

Change-Id: Ia373a78f59538d6dfca390431f85a7af26c9d914

ms_srs: add short_sn as config option for srsUE

this allows to change the announced support for PDCP
short sequence number lengths

Change-Id: Ibcf72dbb424ae3b6a87b60febb4dadf716407612

amarisoft_rf_driver.cfg.tmpl: only set trx offset for B210

all other RF devices do not required any offset

Change-Id: Id4c5f0bede5b09d59237cdd6a959a3663f1a1b37

srsue.conf.tmpl: set srate param with the X310

Change-Id: Icb04ed51ace97d4467558639aeb3f556dbe8678a

srsenb.conf.tmpl: use LTE sample rates when Lime is found in rf args

the lime doesn't work well with the shorter sample rates the eNB
uses by default.

Change-Id: I2d3dbdf5ff62980854ef67b20469f072ce31612e

amarisoft_enb: add NR support

this patch adds the ability to configure NR cells with
Amarisoft eNB. It adds the new DRB-NR template and updates
the normal enb.cfg template to allow using it as LTE only
or with NR cells (5G NSA).

Change-Id: Ia27bbc6db5920ce14bacabe8043601aa2adaa5fe

ms_srs: add 5G NSA support

extend the MS to allow for NR carriers

Change-Id: I7de9f867e7e32d0ab4f74eb7661928175f6c1a16

amarisoft_ltemme.cfg.tmpl: enable ENDC support in config template

patch also remove the UE forwarding option which isn't used anymore in the MME.

Change-Id: Ia1628e6674b124806e3cd59c5b190d27f6ba4403

amarisoftue: solve conflict of sample rate param in rf_driver

move sample_rate setting into rf_driver template that is shared
between enb and ue

Change-Id: Icc8042c3eec2a1e8bfc6823c06430c1cb18355b7

srsue.conf.tmpl: tidy up config file

no functional changes, just remove whitespaces and newlines

Change-Id: Ib58d3591cc51c11c9e496f6510ebffb91ee71345

epc_open5gs: remove _epc from name

there is no open5gs_enb so having the epc in the name is redundent, also
it safes typing and allows longer scenario configs without exceeding
filename limit.

Change-Id: Ib10bc6031ecc8de88a9c718b136d2641ce46e11d

open5gs: fix stopping of open5gs components after test finishes

use RemoteProcessSafeExit() for launching all open5gs components
to make sure they are stopped at the end as well.

Change-Id: Ia1439577d60f9694da70c4e42c621100c8ef295e

androidue: fix execute permissions for conn_chk and diag parser scripts

Change-Id: I755b65188a485a3c2f30488ab598f7a50cf80dc5

open5gs: fix name

Change-Id: I7b0325718f9572b03e282d17ddf111a9493e2ee7

open5gs: lower default log level to info

Change-Id: I15aaac5838bdb9d271a850b959a3a8fb4a56a313

srsenb: enable S1AP pcaps as well when PCAPs are configured

this stores the S1AP pcaps in an own file but uses
the same switch to enable them.

Change-Id: If24048d61d8dff0b9b31aff9ed6995342830ebf8

open5gs_mme: set short network name

Change-Id: Ifd7a78e35fb47cc5a96452fe93d8ab305359d7bd

sysmocom/defaults.conf: Fix recently changed node name

This node was changed recently but this file was not updated.

Change-Id: Id5df83a356579340259d9d02ebc621f298151599

open5gs: Pre-configure tun device for UPF

open5gs requires the tun device to be pre-created and pre-configured
before using it. A ticket was opened in order to allow upfd itself
configuring it in [1]

[1] https://github.com/open5gs/open5gs/issues/899

Change-Id: I3b1857f09017cacee1c86f41dae1463c11b50490

open5gs: Fix GTP-U addr binding

Change-Id: I8c91a9c4a07f4229cb4ae9af61d94e720d81a961

iperf: adds the option to define the packet length for udp.

Added the feature to configure the packet length in udp iperf. Added a modifier to select the length value.
The default value is configured to 1460.

Change-Id: Ic886faa82b7cb25f2bce685eb80910623e4ff686

4g-iperf3-ul: modified the test to parameterize the number of ue in the test.

Parameterize the iperf3 uplink test for the 4g test suite to execute a
given number of UEs. By default, the number of ue is 1.

Change-Id: I4b006df04bd1af6c117bcb25e6a6b1609ac732fb

4g-iperf3-dl: modified the test to parameterize the number of ue in the test.

Parameterize the iperf3 downlink test for the 4g test suite to execute a
given number of UEs. By default, the number of ue is 1.

Change-Id: Ifafea196289d1ce0d35ae66c6564266ba123b27a

4g-iperf3-bidir: modified the test to parameterize the number of ue in the test.

Parameterize the iperf3 bidirectional test for the 4g test suite to execute a
given number of UEs. By default, the number of ue is 1.

Change-Id: I34fb436d581eda12388819b5dee9a3bafd419a7f

srs-ms: allows to run given scripts before the execution of the UE.

Executes the scripts given by the 'prerun_scripts' variable before launching the UE.

Change-Id: I718e686b5844f2f07eda820914678052f1008182

srs-enb: runs the given list of scripts before and after launching the eNodeB.

Allows to run given scripts before and after the execution of the SRS
eNodeB. The scripts are retrieved as a list from the resource.conf file.

Change-Id: I5017caae933809b89b32ea132be8552d6554e20e

srs-enb: adds fapi to the rf supported devices.

Added support to 'fapi' rf device for the SRS eNodeB.

Change-Id: I0ac2a7db7c0533dfbc90f2526a7b823110d355c0

srs-enb: sets the remote directory to the given one.

Sets the remote directory for fapi to the given in the variable 'remote_dir' in the reource schema.

Change-Id: I77a56835a4054b86d1d3f7da823a013b3370f767

srs-enb: adds support to the malloc interceptor.

Adds support to the malloc interceptor for the SRS eNodeB. This interceptor will generate a log file that lists the mallocs, reallocs and frees produced by the srsenb.

Change-Id: I0078020468f58bdd70b0b5de879eb58192f947a6

jenkins-build-common: adds support to the new variables for patchelf.

2 variables are added in order to increase the flexibility of the add_rpath function.
patchelf_rpath_extra_args: adds more arguments to the rpath patch. For example "--force-rpath"
patchelf_rpath_dir: path to the libraries. This path is appended to the default '$ORIGIN/../lib/'

This commit add the jenkins-build-srslte-bbu.sh script, that builds the given repository filling the information for the 2 newly added variables.

Change-Id: I9f510112c63e7598add8c00f8573e34cac1b6064

util: fix the functions "create_netns" and "setcap_netsys_admin".

This commit fixes 2 functions from util.py:
- setcap_netsys_admin: removed "self" from the arguments.
- create_netns: pass "run_dir" to Process and convert the arguments to
a list as the other methods in the file.

Change-Id: Ida4c6d6500be92b8d1f96e4e7a870e63bd329be9

ttcn3: Use osmocom registry to pull ttcn3-bts-test

Since recently, the ttcn3-bts-test image is available in the osmocom
registry. Let's use that one instead of the sysmocom one.

The imaqge is built and pushed to the registry regularly by osmocom
jenkins job registry-rebuild-upload-ttcn3-bts-tests (see
osmo-ci.git/jobs/registry-rebuild-upload-titan.yml).

Related: SYS#5765
Change-Id: I6de9719830290aa7f3ca80a6080ed37f107bdc16

contrib: Convert trial osmo-iuh->osmo-hnbgw

The real target was not osmo-iuh itself but osmo-hnbgw. Since osmo-hnbgw
is inits own repository now, let's rename it.

Change-Id: I03c0988db5c5d72bcac71b4515e40a099600ce7c