Changes

osmo-ns-master: drop python3-osmopy-utils / --enable-external-tests

--enable-external-tests requires python3-osmopy-utils, however this
package is no longer available for debian:10.  We're not running
tests, so it's not really needed.  Removing it fixes ttcn3-ns-test-fr.

Change-Id: I342099be87175dfe189a8906b53ee26328c0a417

ttcn3-bts-test: fail on unexpected respawn count

Suggested-by: Pau Espin Pedrol <pespin@sysmocom.de>
Change-Id: Idd9f8dcf1a7186a0715c1026da44f404c1c574d9

debian-trixie-obs-latest: fix signed-by= path

Fix for:
  Error: Failed to parse keyring "/usr/share/keyrings/osmocom-misc.asc"

Fixes: 59d469 ("debian-trixie-build: install the osmocom:misc repo")
Change-Id: Ib90abcdf96fc2b555f477899bac730c6f4a76fad

debian-trixie-build: install the osmocom:misc repo

Install the osmocom:misc repository, so we can use the latest bpftrace
version in ttcn3-bts-test.

Related: OS#6927
Change-Id: I58e91932b089a92f4f4c31814cd1fd7d202b04c0

debian-trixie-obs-asan: new container

Switching to debian 13 by default requires this new container for
ttcn3-bts-test-asan.

Fixes: 82bee6c4 ("jenkins-common: use debian 13 by default")
Change-Id: Icda707751fca8a314e92200bce0e473e43e426f3

ttcn3-bts-test: add --no-warnings to bpftrace

Since switching to debian 13 and having bpftrace 0.23.2 instead of
0.17.0, bpftrace is constantly printing warnings. Turn off warnings by
default so we don't end up filling up the disk space of jenkins runners
while ttcn3-bts-test runs for >2h.

We can turn on warnings in copies of the main jenkins job for
development, while also ensuring that we only run a few tests instead of
the whole testsuite.

Warnings look like this:

  root@deb12build-ansible:/home/osmocom-build/jenkins/workspace/ttcn3-bts-test/logs/bts/bpftrace# head udp_sendmsg_delay.log
  [Thu Jan 15 01:31:13 UTC 2026] respawn: 0: starting: /data/bpftrace/udp_sendmsg_delay.sh
  + pidof osmo-bts-trx
  + bpftrace /data/bpftrace/udp_sendmsg_delay.bt -p 9
  Attaching 3 probes...
  Tracing udp_sendmsg() latency... Hit Ctrl-C to end.
  /data/bpftrace/udp_sendmsg_delay.bt:29:3-13: WARNING: Invalid argument
  Additional Info - helper: get_ns_current_pid_tgid, retcode: -22
    @start[tid] = nsecs;
    ~~~~~~~~~~
  /data/bpftrace/udp_sendmsg_delay.bt:30:3-13: WARNING: Invalid argument

Change-Id: I0e4c62f27f67d4b8601516ce5c1ebfa415331b4a

debian-trixie-obs-latest: new container

Switching to debian 13 by default requires this new container for all
the -latest jobs that are still docker-playground based.

Fixes: 82bee6c4 ("jenkins-common: use debian 13 by default")
Change-Id: Id78e445ff93dbe63751f4579a52f122d524e0003

jenkins-common: use debian 13 by default

The testsuites were still using debian 12, switch to the current stable
version (13).

This also gives us a much newer bpftrace version:
* Debian 12: 0.17.0-1
* Debian 13: 0.23.2-1

Change-Id: I231e1e93724faf6d659132be9b9d0e164502bf95

bpftrace: Introduce ksys_write_delay.bt

This will record latency of write() calls during ttcn3-bts-test run,
where some write() call on stderr seems to be taking ~0.32 seconds,
stalling the timerfd (71 times) and making osmo-bts exit.

Related: OS#6794
Change-Id: Ia1d2036ac7c6c9e2818d07e8787d857b3b3e5881

Upgrade redmine to 5.1.11 (security fixes)

As the official docker image still has 5.1.10 we're temporarily using a
custom build of the redmine base container.

Change-Id: Id06331c1f169cd02340730d5499bcb8a1ad3ea22
Closes: OS#6915

ttcn3-bts-test: give bpftrace time to print stats

When running with bpftrace, send a kill signal to the bpftrace scripts
before killing the container. Otherwise the scripts don't print their
statistics, the end of the log then looks like this:

  [Thu Dec 18 18:06:06 UTC 2025] respawn: 2: starting: /data/bpftrace/udp_sendmsg_delay.sh
  + pidof osmo-bts-trx
  + bpftrace /data/bpftrace/udp_sendmsg_delay.bt -p 56
  Attaching 3 probes...
  Tracing udp_sendmsg() latency... Hit Ctrl-C to end.

Change-Id: I1781bddddf429c4c6a951b519a639b8663d397e6

ttcn3-bts-test: mount tracingfs only when needed

Change-Id: I59bbbc96c0686a2c8792626297e656df72e578ed

ttcn3-bts-test/jenkins.sh: tweak local vars

Make it consistent.

Change-Id: I8c5597f20428f8f274ea15f62e561562e5768460

ttcn3-bts-test: run bpftrace scripts

Add logic to run bpftrace scripts attached to osmo-bts-* while the
testsuite runs. The initial script is from Vadim:
https://gitea.osmocom.org/osmocom/bpftrace-scripts/src/branch/master/udp_sendmsg_delay.bt

Change-Id: I5c22cdbb08fe797be936ca174f65ade626fa4895

common/respawn: improve logging

Add "[$(date)] respawn:" infront of all log messages, so it is clear
that they come from this script and so we have timestamps that we can
compare. This will be useful when running the bpftrace scripts along
with osmo-bts-*, which will get restarted at the same time as the
osmo-bts-* processes.

Change-Id: I641f17f6988eced12c9b301042fb5c5cfd757511

ttcn3-bts-test: Run fake_trx with sched-prio-rr

Change-Id: Ie8c395bb7de1823ac5de951e6a66085148e9c224
Depends: osmocom-bb.git I3c7f36c17fc7b9cae1023b4a0ed37f983dc286dc

nplab-m3ua-test: Parametrize git branch and change it to osmocom/master

I just pushed a new "osmocom/master" branch to our fork pointing to
laforge/python3.

Change-Id: I78b2a27b355f11ba64476216bc7ef76713e8f61e

nplab-m3ua-test: Configure Network Indicator as International

That's what we are using at the osmo-stp configuration.
Until now it didn't matter since libosmo-sigtran didn't validate NI
matching configuration on received messages, but since
1af56bf8cf266dd708b623e75d6d175a58f3dd47 it does.

Change-Id: Iae825ebc588524c7a3761c80392940733f3887a6

gerrit: update to 3.10.9 (latest 3.10 patch release)

Change-Id: Id3f70d0a2de8b2bd640c36796e643b953f6716cb

gerrit: update to 3.11.x as 3.10.x will become EOL on November 10, 2025

see https://www.gerritcodereview.com/2025-09-17-gerrit-3.13-release-plan.html

Change-Id: Icfbed5017e867f4195ee2922331c0e76b64139a0

common/Release.key: update

Source: https://obs.osmocom.org/projects/osmocom/public_key
Change-Id: I5bee715ad50830ab12472fc3946b30ec3d9ace16

debian-trixie-build: add libgcrypt20-dev

Add libgcrypt20-dev as it is needed by open5gs's dependency
freeDiameter:

../../../../../build/src/open5gs/subprojects/freeDiameter/include/freeDiameter/meson.build:146:15: ERROR: C shared or static library 'gcrypt' not found

Without this installed, gerrit-verifications for osmo-dev fails.

Change-Id: Ifc0cc2e3900530cb75651125c0f769f8689748b2

debian-trixie-build: new container

Create a copy of debian-bookworm-build for trixie.

Change-Id: I880b5d9c57642af98c116fcb4137a54c58f5f7b4

debian-trixie-build-arm: new container

Change-Id: I1c0efb85324b70b6370ea94f74f440e639442da5

debian-bookworm-build: add gdb

Add gdb to display backtraces for coredumps in jenkins.

Change-Id: I0069b157501ac37ef0a6be814b3f78e7504436a8

redmine: set session_store to active_record_store

Change the session store to fix the
"ActionDispatch::Cookies::CookieOverflow" errors we are getting.

IMPORTANT: after deploying this change, the following commands must be
executed once manually to create the session table:

  # docker compose exec redmine bash
  $ rails generate active_record:session_migration
  $ rake db:migrate

Related: OS#5476
Change-Id: Iacec800b9179cfac894f41e9eb1a5cca7e56ff1c

redmine: upgrade from 5.1.7 to 5.1.10 (security update)

Change-Id: I526679bd35baea3ba71c66b34fee9ccea44ca312

titan: upgrade to libfftranscode 0.6 (updated NGAP ASN.1 to V17.5.0)

Change-Id: I56034ef75cd6cca88fc9d353e097086bce6d639c

ttcn3-bts-test: show respawn count at the end

As mentioned in the last commit, we currently must use respawn.sh to be
able to recover from clock skew errors seen in jenkins. Let's display
the respawn count at the end as warning.

Related: OS#6794
Change-Id: I4e5c3dd46ec682bfd79f2328195b0050fe3f186d

Revert "ttcn3-bts-test: do not use respawn.sh"

This reverts commit 57f680439f378f5bb5c6582297ae0636db6650f8.

We're observing a lot of turbulence in ttcn3-bts-test due to the
clock instability:

  Shutting down BTS, exit 1, reason: PC clock skew too high

Even though it's no longer necessary to respawn osmo-bts-trx,
let's restore the respawn.sh to recover from such failures.

Related: OS#6794
Change-Id: I1177e9068c49bf31a4010cd21700839dfa8d5050

osmo-s1gw-master: align with the upstream

Change-Id: I3c694af378c500002752c208c8fcc040fdac5587
Related: osmo-s1gw.git I5681ca103daf1c497218b4513b0ca97b1aae03d3
Related: SYS#7332

Use debian archive for deb10 libssl package

As Debian 10 is EOL, this debian 10 package we are still using here to
make mongodb work is getting removed from the mirrors. Currently some
still have it, some have deleted it already. Use the archive instead.

Fix for currently failing osmo-gsm-tester jobs:

  1.879 + wget http://security.debian.org/debian-security/pool/updates/main/o/openssl/libssl1.1_1.1.1n-0+deb10u6_amd64.deb
  1.885 --2025-07-29 08:34:52--  http://security.debian.org/debian-security/pool/updates/main/o/openssl/libssl1.1_1.1.1n-0+deb10u6_amd64.deb
  1.885 Resolving security.debian.org (security.debian.org)... 151.101.2.132, 151.101.66.132, 151.101.130.132, ...
  1.886 Connecting to security.debian.org (security.debian.org)|151.101.2.132|:80... connected.
  1.891 HTTP request sent, awaiting response... 404 Not Found
  1.898 2025-07-29 08:34:52 ERROR 404: Not Found.

Change-Id: Ia447d850d38c662aac567aa88685d984c0b42238

Makefile: add missing OSMO_S1GW_BRANCH

Change-Id: I952fd357ccc1d8ceaf51700134f8786c4dbc96e6

Use debian/eol:buster instead of debian:buster

Change-Id: Ic960320dcc6c5e8d8cc4d0bdf7541da4b692e10e

debian-bookworm-build: add deps for osmo-dev test

Prepare to run new tests for gen_makefile.py in osmo-dev in CI. This
requires pytest and open5gs dependencies to pass "meson setup".

Related: osmo-dev I8bb2af7ffb902fd690e83e36739c2b4415b9ab80
Change-Id: I528565fe21b5989fff1d1b005e53136af5be429e

debian-bookworm-erlang: add libnftables-dev

Change-Id: I08e08954dbf90f6548d817e0d179cc1bfbe6f315
Related: osmo-s1gw.git I498d2854447a2d53d2abddd38652f3e2bbb1fbdd
Related: SYS#7307

Fix remaining users of deprecated git.osmocom.org

git.osmocom.org is deprecated and will be removed at some point. Make
sure we don't use it anywhere in our docker containers.

Notably this drops the following line without replacement:
  ADD http://git.osmocom.org/python/osmo-python-tests/patch/?id=$OSMO_PYTHON2_TESTS_COMMIT /tmp/osmo-python-tests2-commit

This was not needed, because the patch for OSMO_PYTHON2_TESTS_COMMIT
will never change, it points to a commit hash (unlike checking master,
where the patch can change).

Change-Id: I2c7ab8fe9e87dd973df44ae1c5ff90930627040c

nplab: don't use deprecated git.osmocom.org

Update the git clones to point to gitea.

Change-Id: If6859323b5af3bd13a974cd1d676d4f19aa16773

{osmo-dev-on-,}debian-sid: remove

I just discovered this while updating the remaining users of legacy
git.osmocom.org. These containers have been added in 2017 and don't
build anymore, let's remove them. I highly doubt anybody is still these,
and if they do, we can bring them back easily.

Change-Id: I379d56676327a59962d955bb3d4a0562142228e3

common/ttcn3-docker-prepare: add _scripts symlink

The ttcn3-*-{start,stop}.sh scripts include a file from the _scripts dir
since Ia63c37b54fb42a8c64a676334cef6f9df4152e18. As they are called
through symlinks in / in docker-playground.git, we must make the another
symlink available for _scripts as well.

Fix for:
  ../ttcn3-tcpdump-start.sh: 3: .: cannot open ../_scripts/tcpdump-dumpcap.inc.sh: No such file

Change-Id: I3a093ac7058d31db958785692444cb58525a6181

debian-bookworm-rp2040: add openssh-client, rsync

Add packages required for publishing binaries.

Related: OS#6784
Change-Id: Ie82eff2de77cbe2770b677439f6942f515572f06

debian-bookworm-rp2040: new container

Related: OS#6784
Change-Id: I2a26ebc3c01a54dc2b0847b6b88d2f66934488c6

fixup: ttcn3-bts-test: use an older version of fake_trx.py

Setting OSMO_BB_BRANCH=ttcn3-bts-test did not achieve the goal, because
it was not consumed by the osmocom-bb-host-master's Makefile.  Setting
it in jenkins.sh does the trick.

Change-Id: Ib6857fafd4085aae91eec9c67f08766bdabeb2b7
Fixes: 8540ae7 ("ttcn3-bts-test: use an older version of fake_trx.py")

ttcn3-bts-test: use an older version of fake_trx.py

The latest version of fake_trx.py [re-]introduces burst queueing [1],
making its behavior more closely resemble that of a real transceiver.
However, this change has also introduced stability issues, leading
to increased flakiness in ttcn3-bts-test.

As a temporary workaround, use an older version predating this change.
Unset the "--sched-rr-prio" [2], which is not supported by that version.

Change-Id: I251082474bb29d0169f88b5bd545c97d487c8353
Related: [1] osmocom-bb.git I41291708effdd2c767be680fff22ffbd9a56815e
Related: [2] 6374a9e ("ttcn3-bts-test: Run fake_trx with sched-prio-rr")
Related: OS#6672

osmo-ns-master: build without uring for debian 10

In preparation for running FR tests with debian 10, adjust
osmo-ns-master to build libosmocore without uring support as
liburing-dev is not packaged for debian 10.

Related: OS#6494#note-19
Change-Id: I1278bc3435c791c429b38a21b53c8efe20e741df

debian-buster-obs-latest: new container

Add this container in preparation for running
ttcn3-gbproxy-test-fr-latest with debian 10.

Related: OS#6494#note-19
Change-Id: I38c3ecb5cd40a6f67901388068ec1c8316a70fd4

jenkins-common: support {latest,master}-debian10

It is required that we run the FR tests with debian 10. Adjust
jenkins-common.sh so we can use IMAGE_SUFFIX=master-debian10 and
IMAGE_SUFFIX=latest-debian10.

The related osmo-ci patch will configure jenkins to make use of this.

Related: OS#6494#note-19
Related: osmo-ci Ibd4cb705048ef5c39fa4192870e2b0f0d067842f
Change-Id: I1a41ca8ddd06f716c4bf29d60a0c2f0f82dc4e35

Remove ttcn3 testsuites ported to testenv, part 3

Related: OS#6494
Change-Id: Ic07793fb7d8889684fd89b00860ebd0b17561a9e

upgrade to gerrit 3.10.x as 3.9 is EOL on May 12th

Change-Id: I906b4ff47cf714010697eeb226af826edfbaf911

debian-bookworm-build: remove pysispm, pydbus

Remove pysispm as it currently breaks building the container and as it
is unlikely that we actually need this library as it is for switching
on/off power strips.

I've seen it mentioned first in c9fa2a ("Introduce osmo-gsm-tester
docker setup") from where it apparently was copy pasted to debian 10, 11
and 12 containers afterwards c1f302c2 ("Add debian-buster-jenkins docker
setup").

Remove pydbus as well, it was apparently copy pasted with the same
history and isn't used in Osmocom software.

Fix for:
  #17 30.93 ERROR: Could not find a version that satisfies the requirement pysispm (from versions: none)
  #17 30.93 ERROR: No matching distribution found for pysispm

Change-Id: I731e171c85d530984279dc05544b6f02cec7cb3c

debian-bookworm-build: fix lcov-to-cobertura-xml

Use a specific commit with lcov-to-cobertura-xml, as the latest master
currently can't be installed with pip.

Change-Id: I2e248bf988be055a3a88cc414946e0377e266e1e

ttcn3-bts-test: Run fake_trx with sched-prio-rr

Depends: osmocom-bb.git I3c7f36c17fc7b9cae1023b4a0ed37f983dc286dc
Change-Id: I8f9df66e0819881587b55c93043fed9a294ab5e8

ttcn3-bts: Allow running osmo-bts-trx with rt prio

osmo-ttcn3-hacks.git Change-Id I0251ed3ec0645617cf4e9bcc03e75c805bf1634c
adds "policy rr" to VTY config of osmo-bts-trx. Allow the process to set
it inside docker.

Change-Id: Ie85d62a865db9ee0ec26a476bb42e4a6ca0ef70b

osmo-{bsc,bts,sgsn}-master: remove unused deps

Change-Id: I8350091e3b0ce7af48edba10bd0b88875fe8ec41

debian-bookworm-build: add xxd

The xxd program is now required for building osmo-asf4-dfu.

Related: osmo-asf4-dfu I1403d35497cdea41ea5bed2c94b9e729ca352772
Change-Id: I8064c6a24ad7dfc0a6c83c1ff5bcb7b47fdd66f4

update redmine to latest 5.1.7 (security update)

Change-Id: Ia628674900376623626d8ad5f2a97324ed8780a1

nplab-{m3ua,sua}-test: Record pcap of all testsuite run

Scripts are cherry-picked from osmo-ttcn3-hacks.git/ttcn3-tcpdump-{start,stop}.sh,
8fc1b2152ff7615f610e7a040cb3b5135dfc5351.

Change-Id: If4ea74c07d5aaca1278811ce8398dff23c386c10

debian-bookworm-build: add linting tools

Prepare for being able to run these linting tools in CI.

* clang-format gets used for osmo-asf4-dfu
* ruff gets used for testenv in osmo-ttcn3-hacks

Related: osmo-asf4-dfu I9768bc2590ca5306ee19d3276f0953c6b0b6f926
Related: osmo-ttcn3-hacks 157897523e54762ec3739cd7842c7b5f5d724ac2
Change-Id: I0a287b991a3efa50090587739529f95de32225bc

ttcn3-bts-test: do not use respawn.sh

Re-spawning osmo-bts is no longer necessary.  For quite some time now,
it has been able to attempt OML link re-establishment in a loop instead
of exit()ing.

Additionally, using respawn.sh makes crashes harder to detect.  Whether
we should restart the IUT process and continue executing the remaining
test cases after a crash is debatable.  However, none of the other
testsuites (except ttcn3-pcu-test, which actually requires restarting
osmo-pcu after each TC) use respawn.sh for that purpose.

Change-Id: I770a0530f90c5e03d2073bfc1c4cfd0e840379c9
Related: OS#6728, OS#6729

debian-bookworm-aram-applet: new container

Add a container for building aram-applet.

Related: SYS#7293
Change-Id: I6ed01bb837bffe6581a4c0d0b1cda39abb375fd5

osmo-pcap-master: depend on libosmo-netif

Fix the TTCN3-centos7-pcap-client-test jenkins job by adding the now
missing dependency on libosmo-netif.

Related: osmo-pcap I3562185f98685ea5a412273212e6dfbe55b360e2
Change-Id: Idc3cd011bc019c094d9b8b534dbd86056b76476c

upgrade gerrit to 3.9.7

Change-Id: Idd60966d7d7dc17dad0390ecc09e9601724136d7

redmine: upgrade to 5.1.5

Change-Id: I47444b672e4a1bacec85762c6bad4dbb2a281ca4

ttcn3-remsim: Enable debug output of bankd

Change-Id: I8cd9d32b2612390bde31fa2814a51ecda20f920e

make: Fix OSMO_REMSIM_BRANCH not passed

Change-Id: Iae85a99d998f91f9fda8f416155059a00da35296

debian-bookworm-android: new container

Add a container for building android-apdu-proxy and possibly more
android projects in the future.

Related: OS#6367
Change-Id: Ic7a454be23072c3f0ed609d370fc88f49205b04c

jenkins-common: add NO_DOCKER_IMAGE_PULL

The docker_images_require function runs "docker build" with the "--pull"
argument to automatically get new base images (typically debian
bookworm).

Recently this started to cause an error when building the arm32/v7
image debian-bookworm-build-arm on the now arm64/v8 (aarch64) rpi4.

Add NO_DOCKER_IMAGE_PULL to be able to omit "--pull". The related patch
adjusts osmo-ci to pull separately beforehand.

Related: OS#6627
Related: osmo-ci Ibf91bc098f34b43f46680d0395928e60cdd478fc
Change-Id: I6e0a84ce7f8357611abc5da856f36d0df247de75

Remove ttcn3 testsuites ported to testenv, part 2

Related: OS#6494
Change-Id: I61fd5523dbd5664763b006d5ba9a368cd9caf9b9

osmo-gsm-tester: use debian-bookworm-build

osmo-gsm-tester was the last user of debian-buster-jenkins, and it just
broke again for some reason. Instead of adjusting debian-buster-jenkins
again this time, I've adjusted osmo-gsm-tester to run with
debian-bookworm-build instead so we can avoid the maintenance effort of
keeping debian-buster-jenkins working, as well as the additional time
needed to build this container.

We held off from upgrading to debian-bookworm-build, because no mongodb
debian packages are available for bookworm. However in the meantime we
have just installed the bullseye mongodb package in bookworm together
with the older libssl from bullseye that it was build against - we did
this in other containers already, so do this here too.

Other adjustments:
* Pip needs --break-system-packages now (it is fine in a docker
  container)
* Patchelf in bookworm is >= 0.11 (getting installed in the apt install
  call already), so we don't need to build it from source anymore.
* Remove 'if [ "$(arch)" = "x86_64" ];' around the mongodb code. This
  was needed earlier when we used to build this container on arm devices
  too, but AFAIK we don't do that anymore and it wasn't really useful in
  the first place. (And if we do we can bring this back easily.)
* Add rpm2cpio and cpio, because these are used during the
  osmo-gsm-tester_build-osmocom-bb job which will use this docker image
  with an upcoming osmo-ci patch (currently it is not using docker to
  build the Osmocom programs, but that leads to missing library errors
  once we upgrade to bookworm here). IMHO the build process should be
  reworked so that this is not necessary, but given that osmo-gsm-tester
  isn't really maintained currently, this is the bare minimum needed to
  migrate it away from debian buster.

Related: OS#6126
Change-Id: I5ed3b92f07f23c96b8f953e0a93991cc89476a12

make/Makefile: Update git branch references for asterisk and pjproject

The branches were modified a while ago to point to a development branch
while in heavy development phase. The work has been merged into feature
branches now, so move to those now that bulk of work is done.

Change-Id: I28e86f8d9ce5d46e1a891f83ec365ac9ca4e289f

upgrade gerrit to 3.8.6

Change-Id: I794db60131534619c0de85eeab7f493bcd4e9106

upgrade gerrit to 3.9.5

Change-Id: I5d82853c8c533f055ff0590bfef343e601280520

redmine: upgrade our docker container to redmine 5.1.3

Change-Id: Ie65cfa0cfb4b1914966525be0d8db77dc98b7fa0

fpga-build: Update RISC-V toolchain to riscv-none-elf

The riscv-none-embeded was deprecated ...

Change-Id: Iecdeae61f730d55d4e76056472100ca926229270
Signed-off-by: Sylvain Munaut <tnt@246tNt.com>

debian-bookworm-titan: chown 1000 for deps

Change the ownership of the "deps" directory to a not yet created user
with the ID 1000. This user gets created when the gerrit verifications
use the container for building. Changing the ownership of the deps
directory allows using them and updating them as needed (e.g. if the
patch in review changes a commit of one of the deps).

Chowning here once results in faster jobs, compared to if we did it
every time the gerrit verifications job ran.

Creating the user here would result in conflicts with other containers
depending on debian-bookworm-titan that may create their own user with
the same UID.

Related: osmo-ci I4bea336097e8180b19b3afa41c0b984d93c21bd1
Change-Id: Id51885d0929f4966b1a4a181b3453c06d7956b53

debian-buster-jenkins: remove pysim

This container is still used for osmo-gsm-tester_virtual (OS#6126).
pysim doesn't build anymore for some reason since the new dependency on
pyosmocom was added to it. Since we don't use pysim in osmo-gsm-tester,
simply don't install it in this container anymore.

Change-Id: I89f667fe5603526d9f0118fc338745aab8273070

osmo-stp-master: libosmo-sccp -> libosmo-sigtran

Related: OS#6239
Change-Id: Ifc8dea67746a0f785831c6b0c6b7dd391d3afa52

debian-bookworm-build-arm: FROM: add arm32v7

Use the arm32v7 architecture explicitly, instead of implicitly using the
same architecture as the host. That way we can use the arm32v7 image on
a raspberry pi 4, even if the host system is 64 bit arm.

Using 32 bit arm instead of aarch64 is needed for the osmo-trx jenkins
jobs, which test -mfpu=neon and -mfpu=neon-vfpv4 build flags.

Related: https://github.com/docker-library/official-images#architectures-other-than-amd64
Change-Id: I93986569a9f492237da28fbc534ac5ccd176f120

osmo-*-master: don't install libosmo-sccp-dev

The libosmo-sccp-dev package is no longer provided by libosmo-sccp.
Without this patch, an older version of the library from debian packages
gets installed, resulting in a conflict for sccp_types.h which is now in
libosmo-sccp-dev.

Fix for:
  #6 8.585 dpkg: error processing archive /tmp/apt-dpkg-install-llkDLH/25-libosmo-sigtran-dev_1.9.0.3.fc4c.202409092026_amd64.deb (--unpack):
  #6 8.585  trying to overwrite '/usr/include/osmocom/sccp/sccp_types.h', which is also in package libosmo-sccp-dev:amd64 1.6.0+dfsg1-3

Related: libosmo-sccp I299a32a2f8f61477cf49c8126567fef2092d5407
Change-Id: I3e7c3c14649d8ebf71fa2968709816dae7bff20c

Remove ttcn3 testsuites ported to testenv, part 1

Related: OS#6494
Depends: osmo-ci I6c7f88bb268a9f339b3af1d31d665e4376b34e48
Depends: osmo-ci Iac626d0c7c87c49ee6ba540ae1894abdb2336642
Change-Id: I7182c7e8eb00a9323fe1b6d27f630d253b4d34f6

ttcn3-epdg-test: restore osmo-epdg.latest.config

The osmo-epdg.latest.config is needed, as it has a different libdir:
-  {libdir, "/usr/lib"}
+  {libdir, "/tmp/osmo-epdg/_build/default/lib/gen_socket/priv/lib"}

Fix for:
Failed to load NIF library: '/tmp/osmo-epdg/_build/default/lib/gen_socket/priv/lib/gen_socket_nif.so: cannot open shared object file: No such file or directory'

Change-Id: Icb3e79d5f5ca9af67037c2746318d61fd2713967

ttcn3-epdg-test: fix osmo-epdg path for latest

Restore the proper path for osmo-epdg when running with -latest, which
has been removed by accident in the earlier commit that should only
have changed the config.

Fix for:
/data/epdg.sh: line 14: /tmp/osmo-epdg/_build/default/bin/osmo-epdg: No such file or directory

Fixes: 00e68245 ("ttcn3-epdg-test: remove latest code path")
Change-Id: I0547f62a3610a62e90ad767f447c68851e8a725d

ttcn3-epdg-test: remove "cp osmo-epdg.latest.config"

I've overlooked this in my last patch. Fix for:
  cp: cannot stat 'osmo-epdg.latest.config': No such file or directory

Fixes: 00e68245 ("ttcn3-epdg-test: remove latest code path")
Change-Id: I720e718a9daec125e94cf2e98127ec3aa48820f8

ttcn3-epdg-test: remove latest code path

Use the same config in latest as in master, as a new version 0.1.0 has
been released recently. This fixes the two currently failing tests on
latest. The ttcn3-epdg-test has not been replaced by testenv (OS#6494)
yet, so let's fix it here.

Change-Id: I522824a6df3c58d26788c8d9e978759e7ec8a462

common/Release.key: update

The current key was about to expire at the end of the month, so I've
regenerated it. The new key is valid until 2026-10-16.

Source: https://obs.osmocom.org/projects/osmocom/public_key
Change-Id: I7446565ff3bbbcd30e53234786d84109583284a5

debian-bookworm-build: update sphinx-argparse branch

Our changes are now in the "inside-classes" branch.

Fix for:
  Collecting sphinx-argparse
    Cloning https://github.com/osmocom/sphinx-argparse (to revision master) to /tmp/pip-install-cff9hqce/sphinx-argparse_4b90c55018034988836549dbf04f94ad
    Running command git clone --filter=blob:none --quiet https://github.com/osmocom/sphinx-argparse /tmp/pip-install-cff9hqce/sphinx-argparse_4b90c55018034988836549dbf04f94ad
    WARNING: Did not find branch or tag 'master', assuming revision or ref.
    Running command git checkout -q master
    error: pathspec 'master' did not match any file(s) known to git

Change-Id: I666972097db269dd1e46031854719210e993a71a

scripts/kernel-test/smoke-test.sh: Log qemu output to stdout

This allows logging the run-qemu.sh output/progress to eg.
/tmp/logs/ggsn-v6_only/osmo-ggsn.log when running the jenkins.sh.

Change-Id: Ia638b0b9631518a9bb58e70ef55029085ce0fa9c

ttcn3-ggsn-test: Reduce timers for ggsn-test-kernel-torvalds

The TTCN3 test already assumes that t3 = 1 and n3 = 2 and sets the
timers accordingly. The osmo-ggsn config for the non-kernel test already
includes these timer values and doesn't need to be updated.

Change-Id: I738b460996b29ca828c62427e01b9bb6b995c051

ttcn3-stp-test: remove <= 1.8.x code path

Change-Id: I3c134df2e194dbad47261eed5c0b3b54ed39a383

ttcn3-sgsn: Use new 172.18.8.104 in emulated RNC

I forgot to push with last commit the change in IP address using the new
IP address in the emulated HNBGW. Doing it here to avoid test breakage.

Fixes: 594e021b9b699600a2f89a16676b05446a64fbdc
Change-Id: I20801e22bf20d2b2e67697fbf15811fe8eaa2996

ttcn3-sgsn: Use 2nd IP address on emulated HNBGW

In 3G, both HNBGW and GGSN talk GTPv1U, and osmo-sgsn uses
Direct Tunnel feature to connect both together.
Since GTPv1U uses a fixed port, we need 2 IP addresses, one set for the
emulated GGSN and one for the emulated HNBGW.

This is a preparation towards adding tests validating creation of PDP
context in 3G, which was not yet tested.

Related: SYS#5435
Change-Id: I21882dc5a9f5167ac9104d4ac48d5e5631505463

asterisk: Enable use of EVS codec

We want to test Asterisk using only EVS against the IMS Core.

Related: SYS#7012
Change-Id: I8bf781cbb0ae40a2bc67ede1110d50721d1f6025

asterisk: extensions.conf: Allow extra MO call from SIP UA which HOLDed previous call

We need to keep track of the SIP UA using the IMS endpoint, so that when
the IMS call is set on HOLD we can identidy that the same SIP UA can
still initiate new calls on the IMS endpoint.

Related: SYS#7003
Change-Id: Idad9e613669466f3aac8b1c7b43f8d9b6e0494e6

ttcn3-asterisk: pjsip.conf: Update config name s/ims_aka/volte/g

The config key was renamed today, so update the tests to avoid failing
reading the config file.

Change-Id: I29d8ecb0f514de4745de22711234b0d514b2eb39

ttcn3-asterisk: extensions.conf: Reject subsequent MO/MT calls in VoLTE when busy

Reject calls when the VoLTE endpoint is already busy with an ongoing
call.

Related: SYS#7003
Change-Id: If4ce1fee36e51ac72681ac2ce04531d501ccb56c

ttcn3-asterisk: extensions.conf: Reject calls if all SIP UAs busy in call

Before this patch, asterisk would ring on local SIP UAs already in a
call, which is not the expected behavior for this project.

Related: SYS#7003
Change-Id: Id9e3ead6e28a53793c6cceb6f23d5e6d987521d8

asterisk: dnsmasq.conf: Avoid forwarding queries to other DNS servers

This creates problems when requesting resolution of the IPv6 address.
For some reason, dnsmasq was forwarding the request to the non-available
google DNS servers, and Asterisk docker container pre-start commands
checking for DNS resolution would never pass when run in jenkins node.

Change-Id: I0ee7a7b0c307cc83acfb1c4c8f4bdc092133fddb

asterisk: timeout ping DNS validations after 3 seconds

Change-Id: I9f1bcbc2b868cf7c894a57ca77e28b5bfbba0eac

asterisk: Wait for Asterisk ready before starting testsuite

A recent commit made Asterisk wait for dnsmasq to be ready before
starting it. This means Asterisk takes more time now to be ready itself,
hence we need to delay launching the testsuite until it is ready.
Otherwise, the entire set of tests may be run even before Asterisk gets
to answer on the AMI socket.

Change-Id: I337d57f3eb3e6688dbf3c61d55978da10d84b2cb

centos7: use vault.centos.org

The centos7 images try to use mirrorlist.centos.org to determine the
fastest mirror, and then download binary packages from there. But
mirrorlist.centos.org isn't online anymore. Use the vault instead.

Without this patch, the mirrors that can't be reached are ignored, and
later on it fails to properly install packages because of missing
dependencies.

Related: https://serverfault.com/a/1161847
Change-Id: I0a8f93bb16dd9245760b8a1ad53f0642d446b4cf

asterisk: Wait for dnsmasq resolver ready before starting Asterisk

Otherwise Asterisk wil lfaill to add the identify match at startup:

[2024-07-11 10:35:02.199] ERROR[14]: netsock2.c:303 ast_sockaddr_resolve: getaddrinfo("ims.mnc001.mcc238.3gppnetwork.org", "(null)", ...): Temporary failure in name resolution
[2024-07-11 10:35:02.199] ERROR[14]: res_pjsip_endpoint_identifier_ip.c:553 ip_identify_apply: Identify 'volte_ims' failed when adding resolution results of 'ims.mnc001.mcc238.3gppnetwork.org'
[2024-07-11 10:35:02.199] ERROR[14]: res_sorcery_config.c:422 sorcery_config_internal_load: Could not create an object of type 'identify' with id 'volte_ims' from configuration file 'pjsip.conf'

Related: SYS#7010
Change-Id: I01475c1ed2aa20fb9b8b8722a7b965ea9b63e8a9

dnsmasq: Log additional query info with --log-queries=extra

Related: SYS#7010
Change-Id: I445b7900769418d8f3958f37d0613283ca9a7b78

asterisk: pjsip.conf: Forward Hold/Resume SIP UA -> IMS Core

This is needed for forward the a=sendonly when a local SIP UA wishes to
hold a call.

Related: SYS#7002
Change-Id: I70e7e5df2d9c91acdc85c689cf8e48c5a44b2a34

ttcn3-s1gw-test: update logging config in osmo-s1gw.config

Bring logging configuration in sync with erlang/osmo-s1gw.git.

Change-Id: I3853c40c94d3ee2bbd5d6f6b345bfd87cce134d0
Related: erlang/osmo-s1gw.git Ib88801b8d38976b98a02ed06e1638e0e9056bafb

seccomp_profile: import

Import the current default seccomp profile from docker, commit from
current master branch. The next patch will re-enable the io_uring
syscalls in the profile.

Source:
https: //raw.githubusercontent.com/moby/moby/c4dcaa0d9adb8cc0a0d95393e8cf3e853254eacb/profiles/seccomp/default.json

Related: OS#6405
Change-Id: Ib6f7bc04cb58815190fc2102900e873da301ce95

seccomp_profile: enable io_uring

Revert 891241e7 ("seccomp: block io_uring_* syscalls in default
profile") from upstream:
https://github.com/moby/moby/commit/891241e7e74d4aae6de5f6125574eb994f25e169

This will be used by osmo-ci Iaeb84627fc1404014e5a8a2e88a02ee66cfb880d.

Related: OS#6405
Change-Id: I27567c2a5d9543c3509c316226c082ab950c5ebc

ttcn3-asterisk: Allow running testsuite with IPv4 and IPv6 configs

Requires [1] to be able to run SIPmsg_PT in Asterisk_Tests with IPv6
support.

[1] https://gitlab.eclipse.org/eclipse/titan/titan.TestPorts.SIPmsg/-/merge_requests/4

Related: SYS#6982
Change-Id: I1de922c681fef4d308898cd592544aef25901c7b

ttcn3-asterisk: Small improvements to ease introducing IPv6 support

Change-Id: If5200e9ba7774f5ec1037584dcb1f8ca2e45f835

osmo-epdg: add support for testing for latest

Create a new osmo-epdg-latest docker image.
Use a different configuration for ttcn3-epdg-test if running the latest.
The latest comes from the obs repository and has different paths for libraries.

Change-Id: Ia31a92446e82a25fb592a2c91d0204db8f265d52

jenkins-common.sh: Store IP subnet prefix in global variable

Change-Id: Icc492aea1ddb91f672c7a0cec764b42711789fb6

ttcn3-asterisk: Move ttcn3 docker related files to ttcn3/ subdir

Other files belonging to other containers are already placed in subdirs,
so do the same for these ones too.

Change-Id: Ie2b3de22df9ab155f42a717bccf718fccd388fc6

asterisk: conf: Handle precondition through app_waitforprecondition.so

This module has been introduced recently, which allows handling
precondition FSM during MT calls.

Change-Id: I84eefec6cd38d50e88633ac01f606b1dda06bb43

asterisk: Allow alaw code from IMS until evs is supported

EVS codec is not yet fully supported, specially if no specific
implementation of the EVS API is available. Let's allow using alway
from/to IMS for now, so calls can be made and tests work.

Change-Id: I4835f73ef1b13343ff209f1aba84fab43427aa9d

ttcn3-ggsn-test/jenkins: tweak loop logic

Iterate over TEST_CONFIGS instead of TEST_CONFIGS_ALL and then filtering
with test_config_enabled.

Change-Id: Ie7701abe6ab7cff139766eca9240e0f26af32231

asterisk: pjsip.conf: Set IMEI

Newer asterisk VoLTE code being developed (jolly/work) now has a config
to set the IMEI instead of the whole contact header. Use it.

Change-Id: I5d4584fac309bea4afe3929bdca047c31c93b457

ttcn3-asterisk: Fix ICSI value encoding

As seen in TS 24.229 7.2A.8.2 example.

Change-Id: I02b3d54003bb02e999b27b533a651299dbb53503

asterisk: logger.conf: Log milliseconds in timestamps

Change-Id: I4d518547d1e284b18034ae195e6d05da283593de

asterisk-master: Fetch required branch directly

When I added the Dockerfile I initially wrote it in a 2 step fetch &
build, to try to avoid recompiling the whole thing every time some patch
from one of the devs was pushed to our building branch.
This, whoever, creates problems sometimes due to how the build system
for pjproject is generated when building asterisk, so let's drop the
2stage setup to avoid problems fetching from different branches, etc.

Change-Id: Id9fbee9cdb8f9387e0daefd7925df2542d384a91

asterisk-master: Build from jolly/work branch by default

That one will not be the final branch, but it's the one where most of
the development is happening. Hence, switch to that branch by default
for now, so that jenkins nightly job runs that branch.

Change-Id: Iabf141ae0b997f9707a7dbd555307e052b92d355

ttcn3-asterisk: pjsip.conf: Avoid advertising support for +g.3gpp.smsip

Asterisk doesn't so far support SMS over IMS, so avoid announcing it
during REGISTER.

Related: SYS#6981
Change-Id: I1546b7106d25ebfb1c92c1a27db1f44c51b0413a

ttcn3-asterisk: pjsip.conf: Use reliable provisional responses if peer supports it

The default 100rel=yes won't use reliable provisional responses unless
the peer "requires" it, while we should instead be using them if the
peer "supports" it.

Related: SYS#6980
Change-Id: I40764e24f2c80ce48d6634e09797fefe97d99e51

ttcn3-asterisk: Set mp_ims_imei matching pjsip.conf

Since recently, the testsuite validates the IMEI received at IMS Core
over REGISTER Contact header matches the one configured at Asterisk
config file.
Hence, add the same value to Asterisk_Tests.cfg so it can match the
value.

Depends: osmo-ttcn3-hacks.git Change-Id I866d89ec137d264e257b05226900b744a93c257e
Related: SYS#6877
Change-Id: Id8bb7886ffcea506348496148e17f71cef1edc90

ttcn3-s1gw-test: start osmo-s1gw container with --user=root

For some reason, on Arch with docker 26.1.3 it implicitly starts
with --user=root, while with docker 20.10.5 on Debian bookworm it
starts with --user=build.  This results in permission errors:

  + ip addr add 172.18.74.100/24 dev eth0
  RTNETLINK answers: Operation not permitted
  + true
  + ip addr add 172.18.74.200/24 dev eth0
  RTNETLINK answers: Operation not permitted

Pass --user=root explicitly to bring consistency and fix those.
Hopefully, ttcn3-s1gw-test will be passing on Jenkins with this patch.

Change-Id: I5cc67d1c3192fd55560c16c8cc44b13b2c9b3e98
Fixes: 9ca9bed "ttcn3-s1gw-test: fix using unassigned addr for osmo-s1gw"

debian-{bullseye,bookworm}-erlang: fix non-alphabetic pkg order

Purely cosmetic change, bringing a bit of consistency.

Change-Id: I956a15304cbdcdc5572e181dcefd0da884b8fc63

debian-{bullseye,bookworm}-erlang: install iproute2

Change-Id: I753a8c97c17e6a143dd96b168ddc88400f0fc02d

ttcn3-s1gw-test: fix using unassigned addr for osmo-s1gw

The S1GW container gets assigned the primary addr 172.18.10.100/24
by docker_network_params().  The secondary addr 172.18.10.200/24,
which is used for eNB connections, needs to be assigned manually.

This patch finally makes ttcn3-s1gw-test pass.

Change-Id: I109a5feaca5acf050008e883cc8b4e1e28beebab
Related: SYS#6772

ttcn3-s1gw-test: fixup: align with the moduleparam naming changes

Change-Id: Ibbc8501b01e4b168c856b6817e5b92bfd9816669

ttcn3-s1gw-test: align with the moduleparam naming changes

Change-Id: I37b7d91e9e18df463f54cac3e5586942aea21a69
Related: osmo-ttcn3-hacks.git Ice665662c8448c8314d5e6cc1e401e62b635872c

s1gw: add osmo-s1gw-master

Change-Id: Ic732f57940fa41fe21a26af663fea559551b1811
Related: SYS#6772

s1gw: add ttcn3-s1gw-test

Change-Id: I95000d7a9d778df1da830cd5059e5b6899391fbe
Related: SYS#6772

jenkins-common: Treat -asan builds the same as -master

This fixes the jenkins test failures seen in ttcn3-stp-test-asan. TTCN3
tries to connect to stp via TCP, but since the jenkins.sh script doesn't
consider this a build from master the corresponding config is not added
to osmo-stp.cfg.

Also change the function names from image_suffix_is_* to osmo_repo_is_*
to better reflect what they are doing (instead of how).

Related: OS#6486
Change-Id: Ibf93880345f38668f8dc812d1523b985d368dfcc

debian-bookworm-*: useradd -d -m instead of mkdir

Shorten the logic for adding the user slightly, as suggested by Vadim in
code review.

Change-Id: Ief8837bd9f89f51e66857a453f7fc4645620159f

asterisk: extensions.conf: Route non-local extensions towards IMS side

Previous config had only 1 digit extensions being routed, plus the fact
that the endpoint name was incorrect (now "volte_ims").

Change-Id: Icce5e55ab75c0c9fdacc4d8504e6714b99d385b4

ttcn3-asterisk: Add extra IP addr in ttcn3 docker for IMS Core

TTCN-3 docker container is emulating both the SIP UAs and the IMS Core.
So far all the components being emulated there were running under the
only local IP address available in the docker container.
This means, both the SIP UAs and the IMS Core were using the same IP
address.

This is actually causing problems for Asterisk, since on the VoLTE side
it needs to be configured to identify the endpoint based on the IMS Core
domain name.
Since the default identify matching ordered in Asterisk is:
"endpoint_identifier_order=ip,username,anonymous"
That means it always first checks the source IP address, which means
messages coming from local SIP UAs are misunderstood to be coming from
the IMS Core (since ims.mnc001.mcc238.3gppnetwork.org resolves to same
IP address).

The issue can be fixed by swapping the order to "username,ip", because
then the well-known 50X extensions are matched before attempting to
match by IP address.
However, this is all deviating config for the expected usual network
configuration, since the local IP network will be different than the IP
address coming from VoLTE.
Hence, let's instead properly separate the local SIP and VoLTE networks
with different IP addresses, which then solves the issue.

Change-Id: I6e5a261748ec61bb1cfa4aafee8c748d0f46aa9e

asterisk: extensions.conf: Forward call from VoLTE to all registered local UAs

Change-Id: Id3e14ca660f0aa4ed685a90f527feb8732a83806

debian-bookworm-obs-asan: new container

Copy debian-bookworm-obs-latest and configure it to use the
osmocom:nightly:asan repository. Adjust jenkins-cmmon.sh for running the
testusite against the asan repository.

Related: OS#5301
Change-Id: I4219d927d4617232584d5401debd0be04df67ea0

asterisk: pjsip.conf: Set default p_access_network_info

The value is overwritten if set through AMI PJSIPAccessNetworkInfo
action.

Change-Id: I2bb0b89ec36137bbae613962ff5f5aad56721f34

asterisk: pjsip.conf: Update IMS port asterisk config

The config names changes recently during development.
Adapt to the new range style fields.

Change-Id: I4aceb3b62ce7f446abd02b1a53993a3baecf2f20

Introduce dnsmasq docker container

This container will be used by the ttcn3-asterisk testsuite setup, so
that asterisk can resolve NAPTR nameservers for the IMS 3gpp DNS.

Change-Id: Ic1490334375c2a9b11b923a6757e844faf524634

ttcn3-asterisk: Use dnsmasq to let asterisk resolve IMS DNS

Depends: osmo-ttcn3-hacks.git Change-Id I23afdc8b70132dbd947c280f6e5aadbc84849f01
Change-Id: I2da10c80a81ef5603082e4ee1445a39745c0c24f

asterisk: pjsip.conf: Configure Contact field

Change-Id: I0b52407f9e7d1ca7f186c77db8f9e1a0ca272ff7

asterisk: pjsip.conf: identify incoming register started by local SIP UAs

This config section is needed so that Asterisk can figure out the endpoint
when receiving a "REGISTER sip:172.18.248.10". Without it, it will answer with
a 404 Not Found.

Change-Id: I39568c3cebb89fc5a62a8144f448b50c48d79f10

asterisk: pjsip.conf: Fix msisdn not used in From field during IMS INVITE

Related: SYS#6950
Change-Id: I972e75b36457c532bd7528ffb5a7b80544abba4a

asterisk-master: Install AMR enc/dec dependencies

Change-Id: Ic5de8ae6ac8ade375b9692427e5865bee49dc01f

asterisk: pjsip.conf: Use TCP when forwarding INVITE to IMS core

Change-Id: I67bc01e4d53d47eb805e81736378f292b2834fd2

asterisk: pjsip.conf: Disable remote bridging between local SIP and IMS

While implementing a first ttcn3 test validating the MO call scenario
(SIP-UA -> Asterisk -> IMS-CORE) [1] I was running into the scenario
where, after the first SIP INVITE + 200 OK + ACK, Asterisk was sending
a RE-INVITE to both parties to attempt to remotely bridge them (RTP
traffic flowing directly between them without passing through Asterisk).

This happened in part because I'm so far configure A-LAW on both sides
so asterisk figures out it can do so. I still need to change IMS-core
to EVS only.

In any case, regardless of the codecs used, my understanding is that
asterisk should never attempt remote bridging when using the "volte_ims"
endpoint, since that network segment is separate from the local network
where the local SIP UAs are located.

The "direct_media=no" option just addresses the issue; Asterisk no longer
tries to re-invite after the call is established

Related: SYS#6782
Change-Id: I4edea96151b31f02bf292b43b757922389375429

asterisk: pjsip.conf: Stop Asterisk doing unexpected REGISTER on IMS

REGISTER should only be done when the IMS APN is ready, and baseband
then interface asks it to register.

Change-Id: I56249d4138c0a1f5824e089c14c095badc41dc95

asterisk: pjsip.conf: Enable USIM Auth over AMI interface

Astersik_Tests already implement the related AMI procedures, hence
configure Asterisk to use them.

Depends: osmo-ttcn3-hacks.git ddc4c709e51b92dae4d10f0c71b062e4719da673
Change-Id: Iab2e9ad21ff6271ae51329608658ffe353173f38

ttcn3-bts-test: also execute tests from BTS_Tests_ASCI

We do have 5 ASCI (VBS/VGCS) testcases in osmo-ttcn3-hacks.git,
but we never executed them on Jenkins so far.  Fix this.

Change-Id: I1bcdccb6e2c48542d6447d7757fe1d56c1bf8406
Related: osmo-ttcn3-hacks.git I3727c471663b731117a264f60d2f1ba5fd16928e

ttcn3-bsc-test: also execute tests from BSC_Tests_ASCI

We do have 13 ASCI (VBS/VGCS) testcases in osmo-ttcn3-hacks.git,
but we never executed them on Jenkins so far.  Fix this.

Change-Id: I03f1ac2ed9ca59b90fead73fee3cf333b6146344

ttcn3-asterisk: Configure docker testsuite to be able to set up ipsec tunnels

Depends: osmo-ttcn3-hacks.git Change-Id Ic042422788ee406f5b71ca3878bc5617e5455579
Change-Id: I3379e4991a5c705b5b0a14e5fee2eb165cc8a1e3

debian-*: install pylint from debian repos

Get pylint from the debian repositories to be on the same version until
we use the next debian version, instead of always installing the latest
pylint version from pip.

Change-Id: I721db1c18db43cc7a2d38177e9846c43dbdd0ae3

Revert "ttcn3-docker-run.sh: Fix dumpcap failing to access /data inside docker"

This reverts commit 2b9c8e3db8cf77c5ce5c3f888365f983f3ee8d76, as it
causes a lot of testsuites to fail with e.g.

  + network_replace_subnet_in_configs
  + set +x
  Applying SUBNET=161 to: /home/osmocom-build/jenkins/workspace/ttcn3-ggsn-test/logs/ggsn-all/osmo-ggsn.cfg
  Applying SUBNET=161 to: /home/osmocom-build/jenkins/workspace/ttcn3-ggsn-test/logs/ggsn-tester-all/GGSN_Tests.cfg
  sed: couldn't open temporary file /home/osmocom-build/jenkins/workspace/ttcn3-ggsn-test/logs/ggsn-tester-all/sedsByWIc: Permission denied

Let's discuss how to fix the dumpcap problem instead in OS#6455.

Change-Id: Ic98e8206d8251060b777fc7d0b4497ba3e1caf7f

ttcn3-ggsn-test-ogs: run smf in 4g only mode

Remove the SBI related configuration, so open5gs-smf does not attempt to
connect to the NRF every few seconds.

Fix for:
  [sbi] WARNING: [299d78ae-fae5-41ee-84a3-dbd9fa117ce7] Retry registration with NRF (../lib/sbi/nf-sm.c:182)
  [sbi] WARNING: [7] Failed to connect to 127.0.1.10 port 7777 after 200 ms: Couldn't connect to server (../lib/sbi/client.c:698)

Change-Id: I61d60e6e71b671c3deb20cc7ff8abb81ea4d5f03

ttcn3-asterisk: Configure asterisk for initial SIP register on IMS side

This set of pjsip config requires work done by jolly in our fork of
asterisk adding IMS features.

Depends: osmo-ttcn3-hacks.git Change-Id Idb3b19ccd82cad25948106b2c72aa424d7f79cd8
Change-Id: I66d128192146ad600203ea2a41b8bf019311d603

ttcn3-docker-run.sh: Fix dumpcap failing to access /data inside docker

In docker, the /data dir is mapped to $VOL_BASE_DIR, which is created by
docker-playground.git jenkins-common.sh, hence as the user running
jenkins.sh in the host system.
As a result, when the dir is mapped to /data, inside the container it
will have the UID:GID of the outter user, not the one inside docker.

Before this patch, if a ttcn3 container was started in jenkins.sh with
--cap-add=NET_ADMIN, then osmo-ttcn3-hacks.git/ttcn3-tcpdump-start.sh
would select dumpcap instead of tcpdump, to attempt to record a pcap
file to /data/$testcase.pcap.
Due to some unknown way of dropping privileges done by dumpcap though,
it was unable to open the /data/$testcase.pcap due to /data being owned
to another user (tcpdump doesn't have this problem).

This patch fixes the above scenario by making sure /data is chowned to
the user running stuff inside docker. This is already kinda expected
since there's a fix_perms() script in jenkins-common.sh reverting files
created during the test so that they can be accessible by outter user
once everything is finished.

Change-Id: I1229a91cdbb1aa73fd94f1bf7e26f34086f06b25

ttcn3-asterisk: Enable debug in log file

Change-Id: Ifbc8208507ba47e9f6a1eaf5a43465d2a1af08c1

ttcn3-asterisk: Enable debug for pjproject

Change-Id: I7de6ac31f7a75411fb515501611187f97e829ab3

asterisk: Enable capabilities required to set up ipsec

Change-Id: I2dc040cf87169c9a59dc7e9f1af0e1c17bde6683

ttcn3-asterisk: Update Asterisk_Tests.cfg to adapt to new AMI_Adapter implementation

Change-Id: I8d89e1694347f93e84c692d23b375062e003878e

asterisk: manager.conf: Give more permissions to AMI user

These are required to use eg. PJSIPRegister command, otherwise Asterisk
answers with "Permission Denied".

It also seems to help in getting more events from Asterisk.

Change-Id: Ia77a9d88758f648a5539dbc7511b75c20fe7dd6b

asterisk: pjsip.conf: Mark templates accordingly

Mark templates as such, in order to remove error messages during
asterisk setup when trying to apply the templates (which lack fields
such as "username", provided by config sections using the templates).

Reference: https://docs.asterisk.org/Fundamentals/Asterisk-Configuration/Asterisk-Configuration-Files/Templates/Template-Syntax/

Change-Id: Ia132c2e90cf6ee44145ca2e2555cf2dc6c1cfd51

ttcn3-asterisk: Configure new IMS ConnHdlr

Configure new component added to Asterisk_Tests to emulate an IMS Core.

Depends: osmo-ttcn3-hacks.git Change-Id Ibbbadd54b7facf4ef7384499704e742f482a1252
Change-Id: I0ee6cb8955fc4f7dec3db97c768430905374f115

asterisk-master: Use pjproject from external git repo

By default, asterisk.git build system will fetch pjproject tarball from
https://raw.githubusercontent.com/asterisk/third-party/master/pjproject/$(PJPROJECT_VERSION),
where PJPROJECT_VERSION is defined in asterisk/third-party/versions.mak:
PJPROJECT_VERSION=2.14
On top of that, it applies some patches adapting build system, found in
asterisk/third-party/pjproject/patches/.

The build system also allows to use an out-of-tree pjproject (eg from a
git repo) by symlinking the directory to
asterisk/third-party/pjprojec/source/.

This is all documented in asterisk/third-party/pjproject/README-hacking.md.

Since we want to develop on pjproject too, fetch our own pjproject.git
repo, where we can push changes, and build asterisk using that repo.

Bear in mind that, when asterisk.git builds with out-of-tree pjproject,
it wont apply pjproject patches under asterisk.git/third-party/pjproject/patches.
Hence, I created an "asterisk/2.14" branch in our pjproject.git repo which points
to tag "2.14" (the one used by asterisk 20.7.0, which we use), and has the 2 patches
applied on top.
Then, we have our own "sysmocom/2.14" branch on top of that "asterisk/2.14"
branch, where we put our development. WIP development can also be done  in whatever
branch  on top of "asterisk/2.14" branch.

Change-Id: I73f3323db1b6897fc43215578b0a011fdb6909c5

ttcn3-sgsn-test-sns: add missing symlink to osmo-stp.cfg

This commit fixes the following error:

cp osmo-stp.cfg /home/osmocom-build/jenkins/workspace/ttcn3-sgsn-test-sns/logs/stp/
cp: cannot stat 'osmo-stp.cfg': No such file or directory

Change-Id: Ie0f887dc68e89d2fa1f9a2ee8dfd7f8ce71fc329
Fixes: e4fdd72 "ttcn3-sgsn-test-sns: add missing symlink to osmo-stp.cfg"

ttcn3-sgsn-test: add missing SGSN_Tests_NS.control

This does not enable the SNS testcases though.  We need a separate
job with its own configuration files for running the SNS testcases.

Change-Id: I605526dff6d3c0ec4c5dc58dc00ca51b4ccd68a7
Related: osmo-ttcn3-hacks.git Ib2bffbb110961474928f35d212cb492d4b6fdee0

ttcn3-sgsn-test: add config files for running SNS testcases

Change-Id: I767ec223585002d6420eda27ed338722f764c902

ttcn3-hnbgw: Apply latest changes to 'with-pfcp' scenario

Recent commits applied changes to the default scenario, but forgot to
apply them to the 'with-pfcp' subdir.

Fixes: 6de89a5fb529928ce9b7b3320e0ca2e3e568d458
Fixes: 3736d31fc0314cb5d39c707374eecdcfe33241c9
Fixes: 0bdbcd6815358a7b1c4b0bb4575a585c45a01e57
Fixes: 2c22a96355b8e057dbd85ac1922ae84cc63f8b1e
Fixes: d3711e67103691171d7ed3e224c050e78c1f5bc4
Change-Id: Ie02a0754a6ca985e60e08f1f171f532b6cc16264

ttcn3-asterisk: Set Asterisk AMI IP address in Asterisk_Tests

The Asterisk_tests testsuite recently gained initial AMI support.
Configure it with the proper IP address.

Depends: osmo-ttcn3-hacks.git Change-Id I2c570e4d04e7ab8c44962cf484e4bbc946209aee
Change-Id: Ibb6af1cbfb652214b2fdd2a6eb9a4887c9a9cfb0

ttcn3-hnbgw: osmo-hnbgw.cfg: Switch from deprecated 'mgcp' node to 'mgw'

Change-Id: Ie27dcae05fa719cd0eac9faa6e2fb6b63581ac28

ttcn3-hnbgw: osmo-hnbgw.cfg: Enable color in log file

Change-Id: Iffd28619ca075e0cf870e10989cfced6096ca8d7

ttcn3-hnbgw: Set STATSVTY.CTRL_HOSTNAME to correct IP address

Also update osmo-hnbgw.cfg to configure statsd, as done in
osmo-ttcn3-hacks.git 904b5f1a56629b84f67807a75d5c0b356cc7d726.

Change-Id: I80c228b7ad4b9fb06b1651f23a2932bf19374297

ttcn3-asterisk: Configure AMI

Change-Id: I590d89e9173b0372611790d4178747e28a1215d1

ttcn3-hnbgw: Set new mp_local_statsd_ip module paramter to correct IP addr

Depends: osmo-ttcn3-hacks.git Change-Id I213173c99ec314c2eebfb8836c4d3467b3a7f818
Change-Id: I16cddef5833bf2abff0edb82ec3eb9f6ce976364

{open5gs,osmo-uecups}-latest: don't hardcode UID

Adjust open5gs-latest and osmo-uecups-latest to not hardcode a UID. This
is in preparation for creating a "build" user in
debian-bookworm-obs-latest, like we have it in debian-bookworm-build.

Change-Id: Icaebf46487056cea745805527fdc545d9a1846cd

debian-bookworm-obs-latest: add build user

Copy the block for configuring the build user and disabling man pages
from debian-bookworm-build. This fixes failures on
ttcn3-ggsn-test-kernel-latest* (non-latest worked fine since these use
containers based on debian-bookworm-build).

Fixes: 5a48bfbe ("scripts/kernel-test: build initrd+kernel as user")
Change-Id: Idee29d5b9796e8905bdf822d076f25612cbc77a0

debian-bookworm-build: add libnftnl-dev

For osmo-hnbgw, osmo-upf.

Related: OS#6425
Change-Id: I5fdaa634d12bc6c8643c130a43d30e840890d572

scripts/kernel-test: do shallow fetch

Instead of fetching the entire history, only fetch the most recent
commit.

Change-Id: I92d90c1451ff6abff2df3b1318b5194880e77f2e

kernel-test/kernel-build: update net-next branch

The branch of net-next is now called main. Update the default
KERNEL_BRANCH to main, as the default KERNEL_URL points to net-next.git.

Related: https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net-next.git/
Change-Id: Ic4b13c3cbc0933db9d520e6d737c45b6b08e8c48

jenkins-common: fix_perms: chown files too

Ensure the user that runs docker owns files in cache and data dirs
during fix_perms, if an old job created them as root.

Change-Id: I43af48bd87e27abad5ad52e734256d78651f67c3

scripts/kernel-test: put mknod commands in init.sh

Prepare to run the preparation without root rights.

Change-Id: I07648f058ca55515ffc7396598147a03dcfe7976

scripts/kernel-test: build initrd+kernel as user

Refactor code to build the initramfs and kernel as user, instead of
running related code as root. Put the smoke_test.log into /tmp instead
of the cache dir, so we don't write as root into the cache dir. We cat
it on error anyway, so we don't need to have it in the workspace.

Change-Id: I1670dd86f2670f42eb99e4527d483965d8222402

debian-bookworm-build: add virtualenv

Fixes: OS#6430
Change-Id: I5d087b8edb9e77a5226df9e4f55e04480eea45dd

Introduce asterisk-master docker image

This Docker image allows building and running Asterisk from git.
Default config is to build the sysmocom fork used to develop new
features (hence pointing to sysmocom/master branch in that repo.

Related: SYS#6782
Change-Id: Iaa3816f8ceefac8956e61e15f79ed708dec55238

Introduce ttcn3-asterisk-ims-ue-test

This dockerized setup allows running the Asterisk_Tests ttcn3 testsuite
against Asterisk from the asterisk-master docker image, in order to test
the IMS UE feature which will be developed soon.

Related: SYS#6782
Depends: osmo-ttcn3-hacks.git Change-Id I66f776d5df6fb5dc488d9e589b84a6b2385406e8
Change-Id: Idd262b9224ea879a6e941792944fe0b0db3e68ba

*/osmo-bsc.cfg: BTS type 'sysmobts' (deprecated) -> osmo-bts

Change-Id: I98ea9e96d490473efbbe189842ed9f547060dc7d

ttcn3-bsc-test-sccplite: osmo-bsc.cfg: remove deprecated 'mgw remote-ip'

Change-Id: Ie322315dd1608636002d4003e5f8629925041476

ttcn3-bts-test: fix start_config_oml(): do not start BSC

As the comment states, the BSC container is not needed for the OML
tests.  The testsuite itself "speaks" OML to the IUT in this case.

Change-Id: Iab44b9ed83e917475c9e2e86ad32b303b05b2ace
Fixes: aad045f5 "ttcn3-bts-test: add env var to not run all configs"
Fixes: OS#6421

ttcn3-*-test: set OSMO_SUT_{HOST,PORT} for more testsuites

Let's also retrieve talloc reports for these testsuites.

Change-Id: Iaa94dd200fdb98962b784cb507c9995096232dc9

ttcn3-ggsn-test: ignore failure to kill osmo-ggsn

Don't fail if osmo-ggsn can't be killed at the end of a testsuite
run. This happens currently with ttcn3-ggsn-test-kernel-latest-* jobs,
in the v6_only configurations, because osmo-ggsn latest doesn't support
ipv6 yet and exits. The jenkins.sh should keep going and try other
combinations, and exit without error in the end.

Fixes: d8c51cce ("ttcn3-ggsn-test: run with multiple configurations")
Change-Id: I6f3154a9ef114f31bcb5868ee09d1ebc10f35d07

ttcn3-bts-test: use start_config functions

As suggested by Pau in code review, refactor the file to use functions
for starting the testsuites, SUT and related containers with specific
configurations.

Related: https://gerrit.osmocom.org/c/docker-playground/+/36389/comment/67a7c35e_766943a3/
Change-Id: If3cb7dbe585c03d21e5ec6353fd25575ccac7af0

ttcn3-bts-test: abort if missing osmo-config-merge

Change-Id: I9cea4affac0b3981c88078581a070f98649da667

ttcn3-bts-test: add env var to not run all configs

Make it possible to e.g. run only one of the generic/oml/hopping
configurations.

I made a version of this patch a few weeks ago for testing OS#6375,
and I'm submitting it now so I can add multiple configurations for
ttcn3-ggsn-test in the next patch with the same logic.

Change-Id: I1dce5e6aa4b5d67f9f8c96ced611ab2875c353c8

ttcn3-ggsn-test/jenkins: add functions for start ggsn/testsuite

Prepare to run start_ggsn and start_testsuite multiple times with
different configurations in a follow-up patch.

Related: OS#6096
Change-Id: I0754b0df5f1b0b162732c3db0797f65676553ab0

ttcn3-ggsn-test: move confgs to subdirs

Prepare to add variations of the configs: move them to subdirs, so we
don't cullter the main directory.

Related: OS#6096
Change-Id: I03a06f9f516922c47e3092ff7d7c2c68b0852c1b

ttcn3-ggsn-test: run with multiple configurations

The kernel ttcn3-ggsn-tests have been failing since the osmo-ggsn
config for kernel-gtp has been adjusted for v4v6 instead of v4 only.

This new configuration caused a regression with:
* linux kernel without Pablo's GTP IPv6 patches
* latest stable release of osmo-ggsn, which does not support IPv6

As the kernel patches aren't merged yet, this caused all tests to fail.

Avoid this by running the ttcn3-ggsn-test with multiple configurations:
* v4_only: one APN with v4
* v6_only: one APN with v6
* v4v6_only: one APN with v4v6
* all: multiple APNs with all of the above

With this change, the tests running in the v4_only configuration will
pass again with the stable versions of osmo-ggsn, libgtpnl and kernel.
And with new versions, most test in the other configurations will pass
too.

As discussed with Harald, this does not only split up the configuration
for osmo-ggsn with kernel gtp-u, but also with the userspace
implementation. The "all" config currently only works with the
userspace gtp implementation (OS#6106).

Related: OS#6096
Depends: osmo-ttcn3-hacks I6d94a8b18200fbb2119406827b74b83e912e3ecc
Fixes: e24442f9 ("ttcn3-ggsn-test: kernel-gtp: add ipv6")
Change-Id: Ia2fe0c3ed4ccf06e72fd258d085e4a79cecd5f26

openbts-umts: fix apt: use archive.debian.org

This helps to get access to Debian 8 repositories in 2024.

Change-Id: Ia869476feeb67e2b3313b5d75ca01eaff41597ba

debian-bookworm-build: add libbladerf-dev

Related: OS#6409
Change-Id: I3c3fe95d8ebb21f7691a491144885c7deb8049a5

ttcn3-stp-test: enable M3UA-over-TCP testing for master

Change-Id: I210b7d62845075dcfe147f2f77603625cc1e64f9
Depends: osmo-ttcn3-hacks.git I5d0b05aa434c057ad379125ac293f5fc9a240b6f
Related: osmo-ttcn3-hacks.git I1e2a887aa22f317783b3207494fd707d7b426439
Related: SYS#5424

ttcn3-epdg: Set up params to get GTP-U echo working

Set the new module parameter added in the test.
Make sure the gtp_u_kmod osmo-epdg.config IP address is updated to the
proper docker network subnet.

Depends: osmo-ttcn3-hacks.git Change-Id I3fd96f212175959cb113d2f6a362c0e77e5ca0d7
Change-Id: I5cd9dcd6188227baed71823b0cbceb77dc771011

ttcn3-epdg: Test GTP-U userplane

Set the assigned IP address for the UE in the EPDG docker container on
the eth0 interface. This way the emulated UPF (ttcn3) can test
decaps+encaps of osmo-epdg tun by pinging the UE IP address and
expecting a pong back.

Related: OS#6235
Change-Id: Icc5710b42e5a5374aade6b952e1c543565ffad2e

ttcn3-ggsn-test: enable dynamic debug

Enable loglevel=8, as otherwise the messages do not show up.

Change-Id: I048646c4f90233939809546d30c94c4218eedbb1

ttcn3-ggsn-test: tweak log options

Change-Id: I6c3095f4d3378d2026d3720bc32e27ce4c8345b3

cosmetic: .txt file shouldn't have execute permissions set

Change-Id: Ib1e0a79b97ae1af07e206b3be7762cc805820ae1

scripts/kernel-test: add /dev/null

Some busybox programs need /dev/null, add it to the initramfs.

Change-Id: Ie583ae816b517c10d13d77aa45155fc4d1209c26

ttcn3-pgw-test: Configure open5gs-smfd S2b/S6b/P-CSCF related bits

Depends: osmo-ttcn3-hacks.git Change-Id I38e469edf0e00feca5a648035b64645e2c905937
Change-Id: I3ff503990167f52ddb94a7719e2773db3f889a39

ttcn3-ggsn-test: kernel-gtp: add ipv6

Related: OS#6096
Change-Id: If3549db216ff89bdb963744bb38015ad68d4cf6a

ttcn3-epdg: Create tun with iface name gtp0

As done in the default/usual config.

Change-Id: I066c22a381ab85762c8ef247a5eb248f7adf6c71

ttcn3-epdg: Give some time for osmo-epdg to start

erlang osmo-epdg is a bit slow starting up, and sometimes the first ttcn3
test may start when osmo-epdg is still not yet listening on the GSUP
socket, specially when the system is on high load.
Give some head time to make sure it is properly started.

Change-Id: I14e39db6548409b203e15fb562e0b44a90bd44cd

ttcn3-ggsn-test/fragment.config: add NET_NS, VETH

Build the kernel with NET_NS and VETH, so libgtpnl's qemu tests can
download the kernel and use it.

Related: OS#1952
Related: libgtpnl Ibf75514b866fffb11e90529e4705f126b23d7415
Change-Id: I6e893b64718f853b8595de36c090a1326db34419

epdg: Configure gtpu tunnel

Related: OS#6235
Change-Id: Ifeece08cdcceb378ae1e195cada5bfef54a1e2bd

fixup: ttcn3-bts-test: do not start osmo-bts-virtual / virtphy containers

Change-Id: I9a38356be1f970a2b8f1bf51bfc220471502682f
Related: OS#6352

ttcn3-bts-test: do not start osmo-bts-virtual / virtphy containers

We cannot execute the virtphy based testcases due to the limitations
of Docker (see https://github.com/moby/libnetwork/issues/2397).  The
function starting the testsuite was already commented out, but not
the lines starting containers with osmo-bts-virtual and virtphy.

To put it simple, we start and immediately terminate those containers.
And since recently (Feb 1st), we started seeing socket creation errors
in both containers, causing jenkins.sh to abort early.  It's yet
unclear what's the cause of those socket errors, but regardless of
that we should still be running other pending testcases.

Change-Id: I7c9ccc9cc400edb7a05e222e51671fd49631a4cd
Fixes: OS#6352

ttcn3-epdg: Run osmo-epdg with CAP_NET_ADMIN

This will be needed since soon osmo-epdg will start creating tunnel
devices througth gtp_u_kmod, which requires CAP_NET_ADMIN, plus it will
need probably need to set up local IP addresses.

Change-Id: I48eea0e8d7969cc0a3ad2ed08f696decf064c474

ttcn3-epdg: Add section to control logging

Similar as to what's defined in osmo-epdg.git/config/sys.config.

Change-Id: I7b9a3421b5f0f384324bb0f9b6de3fffdceaef53

osmo-epdg-master: Remove rebar.lock to force build against updated dependencies

This way we notice when some dependency update breaks build, and
prevents running against old dependencies if developer forgot to update
rebar.lock.

Change-Id: Ia9112d641e80d1eddcddea1e54e4c135d6efcc5b

ttcn3-epdg: Set new osmo-epdg diameter connect/wathdog configs

Depends: osmo-epdg.git Change-Id I99b5e02264c2c35a3fbfcd2d6083a07e2cfea566
Change-Id: I3632abb8b33d5f2636f443573196d73ea8d3c818

ttcn3-epdg: Update renamed config fields

The config file fields have been renamed recently, update them.

Depends: osmo-epdg.git Change-Id I63fe4c7acc7460575a921b254adf066134c0527f
Change-Id: Ic9f2f33b8ffae7b4273e6fac8a42b6e9e1e38ed8

debian-{buster,bullseye}-jenkins: Add python3-cryptography from debian

This avoids having to use rust to build the cryptography module
during pySim requirements.txt

Change-Id: I9246c9260b1d227ce6e290058caa33e04407d11f

upgrade gerrit to 3.7.6

Change-Id: I6266b1dbfbad71aca95d45f812354f7336b8bd69

ttcn3-msc-test: also execute ASCI (VBS/VGCS) testcases

These new testcases were added to osmo-ttcn3-hacks.git back in August
2023 (see the related patch), but have never been executed automatically
on Jenkins because the config file was not updated in this repo...

Change-Id: I9ec0a03658ead382eaaef175090cfc3650ffd9b7
Related: osmo-ttcn3-hacks.git I4bbe739ea55ecf9f7ebf9ee413df69f29aa642f8

ttcn3-msc-test: set 'hlr' / 'ipa-name' explicitly

Old osmo-msc versions do not include the Source Name IE in SMS related
GSUP messages, unless it's set explicitly in the config file ('hlr' /
'ipa-name').  Recent osmo-msc versions (see the related osmo-msc patch)
do include this IE even if it's not set explicitly ('unnamed-MSC').

Because of this, some testcases in ttcn3-msc-test are currently
failing for osmo-msc master, but still passing for the -latest.

Let's set the 'ipa-name' explicitly in osmo-msc.cfg, so that we can
expect both -master and -latest to include the Source Name IE.

Change-Id: I7757aae1d01b679f530b5c0a6c95b224cb9f204f
Related: osmo-ttcn3-hacks.git Ic24d3082fe3dce08e43e8f3ecb6d6132503c55c6
Related: osmo-msc.git I7bacd001b81326c32bc262c7d0c0491ded822fa8
Related: OS#6135

mme: Use LAC from SGSN with most significat bit set to 0

Adapt to the new default value used by ttcn3 tests.

Depends: osmo-ttcn3-hacks.git Change-Id Iaf89228f6f026e04d5f583211959025e6d8d4a1d
Change-Id: Ifefbd9bf2ed1bce8089e3dc4c6f9fe901e72308e

ttcn3-mme: Set log level of open5gs-mmed to debug

INFO is in general not enough to debug tests.

Change-Id: Ic91571f0caf138dc2ac798d75b0600ad265473c3

ttcn3-pcu-test: set PCUIFv12 for both -master and -latest

osmo-pcu v1.4.0 (recently tagged) now also speaks PCUIFv12.

Change-Id: If0b2209af645f391817f65b4227736b52ca59e2e
Related: OS#6191

ttcn3-bts-test: set PCUIFv12 for both -master and -latest

osmo-bts v1.7.2 (recently tagged) now also speaks PCUIFv12.

Take a chance to fix ttcn3-bts-test-2023q1 by setting PCUIFv10.

Change-Id: I70f0c30d6c514614095dcbbcac5d025001861fbc

ttcn3-pcu-test/sns: fix PCUIF version number (follow up patch)

Unfortunately we had to revert [1] because it worked for current master
but not for latest. The mistake here was to change the PCUIF version
number in PCU_Tests.cfg to PCUIF v12. This is indeed the correct version
for current master, but latest still uses v11. Also the change we made in
jenkins-sns only affected 2023q1 builds, it does not affect latest. This
is the reason why the previous patch broke latest.

This follow up patch now copies the approach we already successfully use
with the normal ttcn3-pcu-test / ttcn3-pcu-test-latest. (see also
jenkins.sh)

[1] I0b37f01f4c7bb829053231339e39ab734f4c8cbc

Change-Id: I1f94a0459e35d7b5632c81d7f7e2e60eb0d0229f
Related: OS#6275

Revert "ttcn3-pcu-test/sns: fix PCUIF version number"

Unfortunately this patch only fixes ttcn3-pcu-test-sns but it breaks
ttcn3-pcu-test-sns-latest, this means a different solution is needed.

This reverts commit c9820d7b36eb3f75c32d193394da46aad9406cb2.

Change-Id: I101d27ae8ed7449b199e49795a3561436c2532dd
Related: OS#6275

ttcn3-pcu-test/sns: fix PCUIF version number

The current master of OsmoPCU is now using PCUIF version number 12.
However, the configuration file of the the SNS tests still sets it to
11.

Related: OS#6275
Change-Id: I0b37f01f4c7bb829053231339e39ab734f4c8cbc

open5gs configs: duplicate cfgs for latest/master

The config format just changed significantly in main/master. Duplicate
the configs, so we can run latest with the old versions.

Related: OS#6267
Change-Id: I2446695172b92ccf75305f878cb932a82e44fdd2

open5gs configs: update to current format

Adjust open5gs configs to the new formats from:
https://github.com/open5gs/open5gs/pull/2739

This fixes all open5gs programs from crashing on startup with various
errors such as:
  11/21 07:39:25.971: [core] FATAL: epoll_init: Assertion `context->epfd >= 0' failed. (../lib/core/ogs-epoll.c:77)

Related: OS#6267
Change-Id: Idf2706f3904eb06e94cee0728faa17e72a6cf1f6

open5gs configs: remove comments

A lot of these comments got outdated with recent config changes
in the related PR. Instead of syncing the comments again and having a
big diff, remove the comments once and then only have diffs of
actual config changes in future patches. This will make it easier to
maintain these configs.

Related: https://github.com/open5gs/open5gs/pull/2739
Change-Id: I67c2a198b9682e15e23a466380e62a976e6236cd

ttcn3-bts/pcu-test: Use PCUIF v12 for current master and PCUIF v11 for latest

At the moment we use PCUIF v11 in latest and in master. This will now
change (see Depends) so that we will have to use v12 in master. This
patch adds the necessary conditional config changes.

Depends: osmo-pcu.git I48eb75f65ab54fdec41ef913e24c1f18cd4a4047
Change-Id: I5c0914c0bf906b51a500a3b099578700798cf8c0
Related: OS#6191

Use 2023q1 osmo-ttcn3-hacks branch for 2023q1 SUTs

Fix the TTCN3-centos-pcu-test-2023q1 jenkins job where currently most
tests are failing. This is because 2023q1 is using an older PCUIF
version that is no longer supported by osmo-ttcn3-hacks.git. As
discussed, use a 2023q1 branch of osmo-ttcn3-hacks where the support was
not removed yet.

Fixes: SYS#6638
Change-Id: Id82425aca4a8ff87feb8a130d31712bc62fa27ed

ttcn3-dia2gsup-test/osmo_dia2gsup: set connect timer to 200 ms

Related: OS#5657
Change-Id: I22839cdf76120bb6152b32059822001cbd7979d8

ttcn3-hnbgw-test: reduce X31 to 5s

Set X31 to 5s as expected by the testsuite to fix currently failing:
  - TC_ranap_cs_mo_disconnect
  - TC_ranap_ps_mo_disconnect

It was recently increased to 15s in the related patch.

Related: osmo-hnbgw I24225cfc0addf326c239ec658a27b93b83a3e751
Change-Id: I223d38e9ec2ca0f9f2ce2ac5311932789f328c9a

ttcn3-hnbgw: Use new module param mp_hnbgw_timer_x31

Depends: osmo-ttcn3-hacks.git I176ef96e193f2ca39077bcee3a2187768ddb45ce
Change-Id: I98e1d4d649ea07b006a7d4c15f8d94a9b4b3de1d

redmine: run 'apt upgrade' in Dockerfile to get glibc fix from Debian

https://lwn.net/ml/oss-security/20231003175031.GA16924@localhost.localdomain/

Change-Id: Ice5c5e86cd519446fc59c09d64b20836f998d384

sigtran-tests: Add note on why this is still using buster

Change-Id: I403401be7e469085f9a82944b3eaa6b8c8ea6319

ttcn3-epdg: Configure S6b interface

Configure the newly added S6b interface on both TTCN3 emulation code as
well as osmo-epdg.

Depends: osmo-ttcn3-hacks.git Change-Id Ia50698a3f6f5ed8251486b84c09f84edfd6d3951
Depends: osmo-epdg.git Change-Id Ia2b138317cb291a95882853f5403949c5e6a5a1b
Change-Id: I1145ee1068a2fdd2fe8d3e48b80c8e6c1fcb50ad

ttcn3-epdg-test: Update config file to set up GTPv2C socket

Depends: osmo-epdg.git I6f00b7fce2d5fcdc484bfd45629b9141f16bc579
Depends: osmo-ttcn3-hacks.git I8f18c927b1897806233cc9d049c25694c1e639d4
Change-Id: I05ae2d87e16cef9772bc5c3690f687e5ecbd5f51

Introduce osmo-epdg-master

Related: OS#6204
Change-Id: Iefc43ffa47f443f2826b8979d4dd0c5542dda1c5

Introduce ttcn3-epdg-test

Change-Id: I77a4d66c1bd0236dee8fc54e03a9d6bf8d63f204

debian-bookworm-erlang: use debian's rebar3

Use debian's version of rebar3 instead of downloading a binary. This
was useful when the container was based on debian 11 where rebar3
wasn't in debian's repositories. Debian 12 has version 3.19.0.

This also solves a caching problem on one of the jenkins nodes, which
currently fails at this line:
  ADD  https://github.com/erlang/rebar3/archive/refs/tags/${REBAR3_VERSION}.tar.gz /tmp/rebar3.tar.gz
with:
  ERROR: failed to solve: failed to load cache key: invalid not-modified ETag: "fce57989250a021a2be5fe5eddd655d6d415eef04f769bf1437f3d6dddfa5559"

My understanding is that docker has cached an ETag that is no longer
valid / maybe the format changed - and instead of simply requesting the
file again, it just fails there.

Related: https://en.wikipedia.org/wiki/HTTP_ETag
Change-Id: I69e02d004a0bd6f9d3a462f4e184b3e9361cc7fe

common/ttcn3-docker-run.sh: add TEST_NAME env var

Make it possible to run only one test by setting an environment
variable.

Change-Id: I1f45a05e089b429918096fcd64f7c02033d5a9dd

open5gs-latest: Support debian bookworm

The open5gs Debian_12 is available since today [1]; hence starting using
debian 12 now.

[1] https://github.com/open5gs/open5gs/issues/2669
Related: SYS#6588
Change-Id: Ib11a55294b525e3c3806246b133f8e479554a068

Introduce ttcn3-hss-test-ogs

Related: SYS#6588
Depends: osmo-ttcn3-hacks.git Ic2fccd9c54aea04f1a31649a0af47c974939fb2f
Change-Id: Iebeefd9689ae2efa54678b99ff929ca255ec64d1

ttcn3-hss-test-ogs: Adapt mongodb db setup to pass new test

Add DB config for new subscriber required by TC_ulr_ula_subscr_op_det_barring_7.

Depends: osmo-ttcn3-hacks.git I8deea9e284447f8991bdeced982c14fae2f211c5
Related: SYS#6588
Change-Id: I42d6af42bada50c55914ec94c4090fccbe8d1c97

debian-bookworm-titan: add ccache

Add ccache, so it can be used when rebuilding the testsuite from source
from a development branch. Ccache is not used by default.

Related: osmo-dev I800062d0379295a6905851db29e820ff16217653
Change-Id: I94d22b8da9f897974c5913b2a8138c653c215446

open5gs-master: Make mongodb available in the image

The open5gs-latest image installs mongodb, but the master one doesn't.
Having a mongodb image is required to run together with open5gs-hssd.

Related: SYS#6588
Change-Id: Id6dde5f54b666279c102eb14fabb87194192c9e4

open5gs-master: Install open5gs-dbctl to /usr/bin

meson install doesn't install that file because it's aimed at
developers. However, debian package does install it manually in
debian/open5gs-common.install.
Hence, the app is available in open5gs-latest docker image, but not in
open5gs-master. Manually copy it to /usr/bin to have both behave the
same in this aspect.

Related: SYS#6588
Change-Id: I54a760d04e6522d843e6d65b94ef6067e502fbaa

open5gs-master: Fix indentation

Use tabs everywhere, as usual with other Dockerfiles (eg.
open5gs-latest).

Change-Id: Ie4e72f484797ada718915e837cd38be574136631

ttcn3-pcu-test: use PFUIF v10 for 2023q1

Change-Id: Iae895240276fa68bfd9fdb2e13358a3a7fb65f59

Fix osmo_dia2gsup-master not pulling in debian-bookworm-erlang dep image

Change-Id: I8d9bd77bbfac14a9951a549a21ee6bc4ea7b267a

make/Makefile: update DISTRO, UPSTREAM_DISTRO

Update the Makefile, so it does not pick the wrong base distribution
when running make in e.g. osmo-bsc-master directly (without going
through ttcn3-*/jenkins.sh as jenkins does).

Change-Id: I31b2a1b8c70b973f4ec0f93d6e9e5e417afec994

ttcn3-mme: Fix missing IP/port config for S11 interface

This fixes failure when running MME_Tests.TC_s1ap_attach

Depends: osmo-ttcn3-hacks.git Change-Id Ia94f50a11292a83dcbd2da8d6df608ef71842b50
Change-Id: I941da52a4d9e10d954a44f32680cf8e8f7a8086a

ttcn3-bts: Use PCUIF v11

Since osmo-bts 1.7.0 which was just released, PCUIF v11 is supported, so
use it both in master and latest.

Change-Id: I6c905d074ffc324dd72d6a5c9ce79f3c241ac780

ttcn3-hnbgw: Update config files for latest after osmo-hnbgw new release

Change-Id: Id184686ba50ec07532b2f11cc9513626f66ed94c

gerrit: update to 3.6.6

Change-Id: I3935d1c6ac671e4c2ba2db685c9ddf75d77ab7f1

gerrit: upgrade to 3.7.4

Change-Id: Ie96b0fabd39248d3f20b073b51d163004ae3dd8a

ttcn3-dia2gsup: Avoid retrieving unexisting talloc report

The OSMO_SUT_{HOST,PORT} envvars are used to trigger retrieving of
talloc reportes from the VTY port in osmo-ttcn3-hacks.git
ttcn3-tcpdump-stop.sh.
osmo_dia2gsup is an erland app and hence it makes no sense trying to
retrieve such information.

Change-Id: I6ee3fa83758e09898d1cd05bf15bc3428e2ffd11

dia2gsup: Fix logfile name

Change-Id: I26e480ee8358476dcda72d51c3d135a0806ca82b

Introduce osmo-dia2gsup-master, ttcn3-dia2gsup-test

- Add a docker container to run osmo_dia2gsup from git master.
- Add infrastructure to run the osmo-dia2gsup container against
  osmo-ttcn3-hacks.git/dia2gsup testsuite.

Related: OS#5757
Change-Id: I646096d5a010df02af75aefa33b023b55997a6d7

debian-*-erlang: Install libsctp to enable sctp support in erlang apps

The current "--enable-sctp" flag when building erlang consists of
supporting SCTP if the libsctp library is found at runtime, by
dynamically linking to it only when SCTP features are requested.

The erlang package in debian only lists libsctp as a Build-Depends, but
it is not installed by default, so apps wishing to use SCTP will fail:
"""
[error] CRASH REPORT Process <0.155.0> with 0 neighbours crashed with reason: no match of right hand value {error,{shutdown,{open,eprotonosupport}
"""

Installing the libsctp library fixes the issue.

Related: OS#5757
Change-Id: I5ca332f9064c16491116608577b3f68379d840e6

debian-bookworm-build: add curl

Add curl, as required by the coverity job to submit the API request.

Change-Id: I70eb2b94d0eda4b371d674e1087b4dc13397dcdf

debian-bookworm-build: add libnftables-dev

Add libnftables-dev, which is needed for osmo-upf. This is required to
move the coverity jenkins job to use this docker container.

Order the list alphabetically again while at it.

Change-Id: I25862a7e3c8a73e13fd4a9237ab57500d8dfc95c

debian-bookworm-build: inkscape -> librsvg2-bin

Merge at the same time as the osmo-gsm-manuals patch.

Depends: osmo-gsm-manuals I0d132f8f6fd73fbe14b5bfa10a8659acaddf38f7
Change-Id: I012c61eb777e6dc267dd4a52500da98c01ac1438

fpga-build: use debian-bookworm-build

* Remove code that is in debian-bookworm-build already (all packages
  that get installed, creating the build user, installing osmo-ci and
  osmo-gsm-manuals).
* Put toolchain installations in single RUN commands, so the unextracted
  tarballs are not stored in image layers.

Related: OS#6057
Change-Id: Iaaca6367b76a6ec860c63d57c767954f82edfee5

release-tarball-build-dist: remove

Remove the container, as the job has been rewritten to not require its
own docker container anymore, see the osmo-ci patch.

Depends: osmo-ci I9f8b671b9780da500637a64fc4dbc72b450f9d11
Change-Id: Ic35a28a386170b85d32aab8f2bd33e48e6d45392

Cosmetic: debian-buster-jenkins: update comment

Related: OS#6126
Change-Id: I15be64a662e97e7e819abeda1c6c955d8198176c

debian-bookworm-titan{,-master}: new containers

Add new containers based on debian-bookworm. Make some improvements
over the bullseye containers while at it:
* Remove sed for cversion.h, as the #error it is trying to replace is a
  warning now so it is a no-op, and we use our own eclipse-titan package
  instead of debian's package.
* Make apt commands consistent
* Move commands around to make better use of the cache
* Clone osmo-python-tests from gerrit instead of gitea and invalidate
  cache when master changes
* Tweak comments

Related: OS#6057
Change-Id: I4415fcde6518bd26d1e2cb5785ddaf84ac2116b3

ttcn3: use debian-bookworm-titan

Related: OS#6057
Change-Id: I2017dd3888670c475b96e692d911a433484f3df9

hnbgw: fixup: with-pfcp cfg: missing 'pfcp' section

Change-Id: I02be7c857d7dbf032bcadbea0812af732d27784f

hnbgw: fixup: with-pfcp cfg: set missing x26 timer

Change-Id: Id9af3f99dedcc04424793560b171e595b88af0d7

ttcn3-hnbgw-latest: fixup for cnpool: bind CTRL to 0.0.0.0

Change-Id: I70c8d8fc61830cb46dcc580b7e344425f7c6c26d

hnbgw: fixup for cnpool: fix ASP IP addresses in osmo-stp.cfg

Change-Id: Ib6175eee69a7f37f987f996049351b9e1a545f58

hnbgw: fixup for cnpool: re-add lost MGCP cfg

Change-Id: I3491e2f9a675b737c12d84484f6d0219e8db0900

hnbgw: fixup: adjust with-pfcp cfg like without-pfcp

Change-Id: Ice5aa8a6db512edad3535a55c5dba841670837ec

hnbgw: tweak log

Change-Id: I974272b800bad4efc277d9832357e9caf34e2dd8

hnbgw-latest: fixup for cnpool: use correct osmo-stp.cfg file name

Change-Id: I80ecfc694adb1cb44dddec30e845237676a4eead

hnbgw-latest: fixup for cnpool: use correct cfg file name

Change-Id: I40c2aca069114f9a07840eed11e608921ed65d26

hnbgw: fixup for cnpool: bind CTRL to 0.0.0.0

Change-Id: Ia71688f5468b3eabdead2996cc1470e467b9c10b

hnbgw: adjust cfg for cnpool tests

Config changes matching cnpool tests added in osmo-ttcn3-hacks, see
'Related'.

Keep a copy of the old config files named "-legacy", to not break the
'latest' tests, because osmo-hnbgw 'latest' does not yet support the new
config options.

Depends: osmo-ttcn3-hacks I027a059faed3f140f8801f84338956cd004043b5
Change-Id: I94aa0b2adfc48b98cb4b1efe595c2432fc603d6c

ttcn3-mme-test-ogs: configure Gn interface

The Gn interface is not configured yet, hence TC_gn_echo_request fails.

Related: OS#5760
Change-Id: Ia89a137103f558ae96e269c935fabe80bb2e2884

debian-bookworm-build{,-arm}: fix temp dir removal

Change-Id: I6a0e0869986550ddfa710dfc15d7e78d8974dbc5

osmo-uecups-master: make osmocom user avilable

Bring back the osmocom user that was removed earlier to fix a UID
conflict with the build user.

The osmocom user is being used after all, the TTCN-3 PGW tests use it to
start commands as "osmocom" user in osmo-uecups-master. This lead to e.g.
PGW_Tests.TC_createSession_ping4 failing.

Rename the user instead of adding a new one, so it can write log files
to the log dir as the same UID as the user that runs docker.

Fixes: 94f8a8 ("osmo-uecups-master: remove useradd")
Related: OS#6057
Change-Id: I2b29d7fedcf3e0a4c17bfbad16077098f94c529b

debian-bullseye-titan-*/Dockerfile: Replace inetutils-ping with iputils-ping

iCurrently we install inetutils-ping in some docker images and
iputils-ping in others; let's make it more uniform to avoid running
different implementations in different images.
The iputils-ping provides further linux-specific features, such as the
"-I interface" param, which is used by some images, so let's pick that
one everywhere.

Change-Id: If11a1c2ae1115b585b6a44a45e9569c16856d8c4

ttcn3-hnbgw: fix disabling talloc report checks for hnbgw-latest

Older commit disabled the talloc report checks but forgot to add the
same line to the with-pfcp/ variant, and as a result the sed command in
jenkins.sh won't work there.

Fixes: cb4897e4c09f7213c929dfd85f1657d697e6bf3d
Change-Id: Id4eed548b3a552747e95784be3654952e10e96ab

scripts/kernel-test: add KERNEL_SKIP_REBUILD

Speed up local test cycles by not building the kernel again from source
if not needed.

Change-Id: Iaa401918d7c09ec92ec546071d8961e99a4cbb47

scripts/kernel-test: add KERNEL_SKIP_SMOKE_TEST

Speed up local test cycles by not running the smoke test every time.

Change-Id: I505b74e8c9b221655a97c5464f6fe4f21204a894

kernel_test_prepare: use $DOCKER_ARGS

Use $DOCKER_ARGS in the docker run call to kernel-test/prepare.sh, which
builds the initramfs. I use this to make a local build of osmo-ggsn +
depends available in the docker container in /usr/local with the
ttcn3.sh script in osmo-dev.git.

Change-Id: Ie2500fa1bd9d57e2531463ce93fdd9930ad829d3

open5gs-master: useradd: don't hardcode uid

Give the user that runs open5gs a different UID than the build user from
the debian-bookworm-build container.

Fix for:
useradd: UID 1000 is not unique

Related: OS#6057
Change-Id: I49051e038740cfccbb11ad33a1884bb7de318710

open5gs-master: drop unknown option metrics_impl

The metrics_impl option has been dropped in the related commit as
prometheus is now the default in open5gs. With newer meson, unknown
options are treated as errors (used to be warnings before).

Fix for:
ERROR: Unknown options: "metrics_impl"

Related: OS#6057
Related: https://github.com/open5gs/open5gs/commit/982ac61894ba5ac7b532661773df0cae859bb4f1
Change-Id: Ib859ef7389928019addecae08df2011eecda80ad

open5gs-master: use DISTRO variable

Instead of hardcoding bullseye, use the DISTRO variable so it now
defaults to bookworm.

Related: OS#6057
Change-Id: Ia392de80ee1f0844563f08a6dc775678ef6b263f

Cosmetic: ttcn3-ggsn-test: env vars -> README

Prepare to add more kernel related env vars. Instead of duplicating the
descriptions here, point to the README file.

Change-Id: I324f12930c5521e29312b309d6344ed5ffbd2581

hnbgw: Skip asn1 talloc mem checks in osmo-hnbgw-latest

Depends: osmo-ttcn3-hacks.git Change-Id I5c18cf2d6797bcf0bef13d71ab0b69f1403b474f
Change-Id: I1a933795ffef3cea97fcf34b1c513e71f3256c83

scripts/kernel-test: fixup for initrd_add_file

The previous versions happened to work too in my testing with
osmo-ggsn. Use the correct loop variable.

Fixes: 0660fc4e ("scripts/kernel-test: adjust to usr-merge")
Change-Id: I0c0ca91116a8cd156b185bb53512371bbcb76515

scripts/kernel-test: adjust to usr-merge

In debian bookworm, the /usr merge has been implemented:

  /bin → /usr/bin
  /sbin → /usr/sbin
  /lib → /usr/lib
  /lib64 → /usr/lib64

The initramfs filesystem layout is derived from the paths of the
binaries and libraries in the full system. Create the same symlinks and
adjust initrd_add_bin so it does not trip over the symlinks.

I've also considered to change all input for initrd_add_bin to point at
the /usr/… paths. But this is not possible, for example ldd/lddtree will
point at libraries in /lib and /lib64, and this gets passed to
initrd_add_bin.

Without this patch, the init script and all binaries called from it
cannot be executed.

Related: OS#6057
Related: https://wiki.debian.org/UsrMerge
Change-Id: I975d3af0fa88869688673936a08189de800fba29

scripts/kernel-test/run-qemu: set init=/init

Set init= so the kernel doesn't try to run other scripts if /init
fails:

[    2.946381] Run /init as init process
[    2.948885] Failed to execute /init (error -2)
[    2.949051] Run /sbin/init as init process
[    2.949329] Run /etc/init as init process
[    2.949566] Run /bin/init as init process
[    2.949795] Run /bin/sh as init process

Change-Id: I063c7625acaa15130d8361d4e944c3773c9b37c4

scripts/kernel-test/run-qemu: update qemu args

Fix these warnings:

warning: short-form boolean option 'server' deprecated
warning: short-form boolean option 'nowait' deprecated

Change-Id: Iba84d8e61c2d9cbd687d803066db0c04aca9f805

osmo-uecups-master: remove useradd

debian-bookworm-build already adds a user (as it is a combination of
debian-bullseye-build and debian-bullseye-jenkins, and the latter did
it). Remove the additional useradd in osmo-uecups-master to fix:

useradd: UID 1000 is not unique

I've looked through related configs and scripts and the username is not
hardcoded there.

Related: OS#6057
Change-Id: I28f2a110167f550e1b38332ed4e7124b9e76f312

jenkins-common: add + set default: debian bookworm

Related: OS#6057
Change-Id: I37e5393398f17c5c8809e17bb363fa86d769f2c2

debian-bookworm-build(-arm): new docker containers

Create debian bookworm (12) based containers for building all Osmocom
projects in master/gerrit/ttcn3 jenkins jobs.

This is a combination of debian-bullseye-build (ttcn3) and
debian-bullseye-jenkins(-arm) (master/gerrit), which were used for this
purpose but had several differences. Combining them solves the
following problems:
* The naming was confusing, as both the -jenkins and -build containers
   were used in jenkins and were used to build the Osmocom stack.
* This lead to adding the dependencies to the wrong containers / not
   adding them to both containers.
* Now we are sure that if a program builds from source in the master
   and gerrit verifications, it will also build in the ttcn3 jobs.

Other notable changes from the debian 11 containers:
* Python2 is finally gone (OS#5950, for the few projects that still
   need it like openbsc, I'll use debian 11 for the jenkins jobs)
* Removed osc and git-buildpackage, now that OBS package building is
   done in different docker containers (see osmo-ci/scripts/obs)
* Combined multiple RUN commands into one as they the image build
   down, used set -x to display what commands run exactly
* Use UID variable instead of hardcoding 1000
* Optimized order of commands, so e.g. the LLVM for Arm that we will
   rarely change gets installed/cached before the big list of apt pkgs
* Replaced old git.osmocom.org urls
* Removed apt-get upgrade; the base image will get upgraded from time
   to time, no need to upgrade within the image
* Add --depth=1 option to git clones and remove temporary git clones
* Removed generating locales code, it was only done by one of the two
   images and I couldn't find in the git log why we would need this (if
   we do need it we can add it back later)

The following patches add more debian bookworm containers and have
similar improvements.

Related: OS#6057
Change-Id: I49aaf62b5b97775f923453611df3b91354a640a0

debian-bookworm-erlang: new docker container

Related: OS#6057
Change-Id: I797ec0e6700860be8fb59bf6b1fab6fa44e53421

debian-bookworm-obs-latest: new container

Related: OS#6057
Change-Id: Ie30135362e37558010f9894bb80a3684786f5aee

adjust HNBGW_Tests.cfg to changed HNBGW_Tests.ttcn

Fix current jenkins test breakage:

Adjust HNBGW_Tests.cfg after changes to osmo-ttcn3-hacks in
"hnbgw: prepare cn pool: add multiple MSCs and SGSNs"
Ia29565cabc072de9aa46565b57232e1eda65874f

Change-Id: I912e8ad1f528d0d726b778a02a0f54c77b298f54

Install  liburing-dev in jenkins and build containers

Change-Id: I048c43d3bcbecfdfd26e087109fb99315e1629ec

debian-bullseye-jenkins: add libcdk5-dev

Prepare for osmo-bsc I8b3d5efb769437a5d3036e1e627b8d477275d93e where
jenkins.sh will explicitly build meas_vis and configure.ac will stop if
libcdk5-dev is not installed.

Currently meas_vis only gets built if libcdk5-dev is installed, meaning
right now it doesn't get built by the jenkins verification and
master-build jobs (only by the debian package build verification).

Related: OS#5173
Change-Id: I015b6d7cb834e99ea5d04206ba5f8c519c4e6af1

MME_Tests: add docker tests for MME

an MME testsuite exists in osmo-ttcn3-hacks but it is not executed in
docker yet.

Related: OS#5760
Change-Id: Ic1ce1dace47353b0dcf321c923a78567e3ddefb9

ttcn3-bts-test/jenkins.sh: set mp_pcuif_version

OsmoBTS currently uses PCUIF v.10 but will move to v.11 soon. (see
Depends). Unfortuantely this means that we have to execute the TTCN3
testsuite in master with PCUIF v.11 and in latest with PCUIF v.10. This
will be the case until the current master becomes the new latest on the
next release.

Depends: osmo-bts.git I25816ac12e63cc6b641eb414e6bc7eaa9c85fc25
Depends: osmo-ttcn3-hacks.git I08de02e951e10bc8b4381cc2ad32e63f2747e3c4
Change-Id: Ia28bc0d6d3cbfe63be19443db86631fb67bb80fb
Related: OS#5927

*/osmo-stp.cfg: Explicitly define role & sctp-role

It was recently decided it's a good practice to always specify the role
and sctp-role for all ASPs configured in the VTY, since it's an
important configuration providing feedback on the network setup
expectancies.

Change-Id: Ia495bc3c5dd4421e5730c74b2f5dc4e4cdc1a673

redmine: fix auto-scan of repositories

While inspecting the running docker container I found that the script
already runs as redmine user. I had assumed that it runs as root
earlier. Running 'su' as redmine user fails, therefore it currently does
not run the fetch_changesets command.

Related: OS#6083
Change-Id: I195311b93868eb5fd73ad6e3c165d48f3b7b53ce

ttcn3-bts-test: fix config merge caching problem

Do "docker run" directly inside the Makefile, without wrapping it
through the "run" target in make/Makefile. Use $(USER)/ttcn3-bts-test as
image name, instead of $(REGISTRY)/$(USER)/ttcn3-bts-test. The
$(REGISTRY)/ part is hardcoded in make/Makefile.

This fixes TTCN3-centos-bts-test, because it uses the ttcn3-bts-test
image that gets built in jenkins.sh before running 'make cfg'. Without
the patch, an image downloaded some time ago from the registry gets
used (a new image is not pulled), leading to the stale config.

Fixes: OS#6065
Change-Id: Iebd81e814d84e8cf8360568419ceda7ffc38e742

Explicitly configure ASPs asp-clnt-* as role=asp & sctp-role=client

Until recently, the asp-clnt-* ASPs, which have specific handling in osmo_sccp_simple_client_on_ss7_id(),
were being always forcedly set to sctp-role CLIENT by code in that
function.
This prevented user of that API from explicitly configuring the ASP as
"sctp-role server" through the VTY as the option would be overwritten silently.

Now, the sctp-role from config is followed if the ASP is
defined/configured through the VTY (not dynamically created at the time
osmo_sccp_simple_client_on_ss7_id() is called).

Since the default for a VTY-specified ASP is to be in "sctp-role
server", the config files need to be updated to properly configure the
ASP to be in "sctp-role client", which is the desired mode here.

Same applies for "role", where the default is SG but it is actually used
as "ASP" here.

Change-Id: Idf84502ffa199926a5f0ee616313b515743811ab
Depends: osmo-ttcn3-hacks.git Change-Id I4eb5b5f6b4b24df079b4c74e2a2e2ebb8769b0bd

stp: Expand osmo-stp.cfg for "norctx" tests

In osmo-ttcn3-hacks.git I81052ece7d1cc8b43da6155356ed1c4d9620acdc
we're adding support for so-called "norctrx"tests, covering
operation without routing-context IEs.  For this, we need additional
AS/ASP definitions in the osmo-stp.cfg

Change-Id: Ie00d96d04dd36c71c79f3b73713c3fe1c26a5145
Related: OS#6003

ttcn3-ggsn: Speed up tests by lowering retransmission T3,N3 timers

Every test needs to wait for T3*N3 seconds before exiting in order to
make sure the queues waiting for duplicates are cleared, otherwise state
from previous state may affect next tests.
Since 1.10.0, osmo-ggsn supports having those timers changed through
VTY. Let's set them to a lower value than default specified by spec, in
order to speed up each test 15 seconds -> 2 seconds.

Only ttcn3-ggsn (against osmo-ggsn) and not ttcn3-ggsn-ogs (against
open5gs-smfd) is updated, since the later doesn't support changing the
default timer values using the config files yet.

Related: OS#5485
Change-Id: Ica346bd791a67b72fad597702d750383e8ac5895

debian-bullseye-jenkins: add iproute2

Add iproute2 to make "ss" available. It is used in the openbsc testsuite
to dump socket statistics. If it isn't available, it does not cause
tests to fail, but prints an error message that looks like it might be
the real cause for the test failures:

  > ss -tn
  /bin/sh: 1: ss: not found

I've also asked Harald if we should just retire the master-openbsc job,
but we want to keep it around to ensure new libosmocore builds with this
old codebase.

Change-Id: I306caeda9bcd4020734eb3b343420c8115958ded

ttcn3-bts-test: enable running GPRS related tests with trxcon

Change-Id: I06ad8e6403e2538c64d650f19a8d0bd4a344edbe
Depends: osmo-ttcn3-hacks.git Ib8f4459480bbe12584a6fa71882f745f03c5055d
Related: osmocom-bb.git I9567d64f9d00262e36147e8d7e541e5e246bda5f
Related: OS#5500

debian-bullseye-jenkins: sync with buster-jenkins

Prepare to let jenkins master-builds use debian-bullseye-jenkins
instead of debian-buster-jenkins. Add almost everything from the buster
Dockerfile to the bullseye Dockerfile that is not there, except for:
dh-systemd (not available in debian11)

Also add python2, as some projects still require it to run tests
(OS#5950).

Related: OS#5949
Change-Id: I51925d0ab9e5a779379efab59c381ef12fb60929

debian-bullseye-jenkins-arm: add new container

Add a bullseye based container that can be used instead of
debian-buster-jenkins-arm. The master-builds jenkins jobs will attempt
to use this jenkins job for the arm builds after setting the main
default image from debian-buster-jenkins to debian-bullseye-jenkins.

Related: OS#5949
Change-Id: I8e1741f86ffb8abd658d1e4e0415dfd11fb1a8a1

README: add example: nightlies from different date

Change-Id: I1b21c90b13a11aa1e51ea337207775c729709676

debian-buster-jenkins: add ghostscript

Add the ghostscript package, it contains ps2pdf which is now used in
osmo-gsm-manuals to shrink pdfs.

Related: SYS#6380
Change-Id: If7b30d0c948604211f4f5242aca8564c310a6ce3

docker kill: wait until containers are stopped

As "docker kill" / "docker container kill" (alias) doesn't block until
the given container stops, make sure to always run "docker wait"
afterwards.

Closes: OS#5928
Change-Id: I0242ece96541d8036ebbf8b0f498ebf231db26b5

Introduce debian-bullseye-titan-master

This Dockerfile allows building a given repo and branch of
titan.core.git which can then be used by any ttcn-*-test/ environment by
simply changing its Dockerfile "FROM" line from
$REGISTRY/$USER/debian-bullseye-titan to
$REGISTRY/$USER/debian-bullseye-titan-mater.

This is useful to debug or develop titan.core or test whether a given
testsuite works fine with a newer version of titan.core.

Change-Id: I19ee98a319ccad167d06c4f183fe80ecac909483

ttcn3-ggsn-test-ogs: update open5gs-{smf,upf} config files

Change-Id: Ic92d73e93b47abb4fae99fc9bece0c93bf9b91ef
Related: I27adbab6a6b95ddf4c6d39803e4f7dd079f11a4c
Related: OS#5913

ttcn3-pgw-test: make the testsuite dir writable by all users

When running jenkins.sh as root or any other user with UID different
than UID=1000 of the 'osmocom' user we have in open5gs-{master,latest}
images, programs spawned by osmo-uecups-daemon (e.g. ping) may fail to
start.  In such cases, osmo-uecups-daemon reports unexpected program
termination with exit code=512.  This is happening because the
stdout and stderr of a spawned program are being redirected to
"$VOL_BASE_DIR/pgw-tester/TESTCASE.prog.std{out,err}", for which
the 'osmocom' user needs to have write permissions.

Change-Id: Icb6b30e618e290d974a919fef34c6b5cb7eeb648
Related: OS#5913

ttcn3-pgw-test: update open5gs-{nrf,smf,upf} config files

As stated in the ticket, both open5gs-{nrf,smf} daemons refuse to
start since build #326 because of the following error:

  [sbi] ERROR: TLS enabled but no server key (../lib/sbi/context.c:186)

The problem is that the recent open5gs (v2.6.0-39-g22be888 at the
moment of writing) is attempting to employ TLS verification for SBI
even if it's not explicitly configured in the config files.

  commit 05fbaf69587488e53b5e741a9ada9f9fa5749322
  Author: Sukchan Lee <acetcom@gmail.com>
  Date:   Sat Feb 18 10:58:29 2023 +0900

    [SBI] HTTP2-TLS verification - ConfFile Changed

Our config files are slightly outdated, so let's take a chance
to update them and specify the missing TLS params.  Check out
open5gs-{nrf,smf,upf}.yaml from the latest git version.

The updated files are confirmed to work with both:

* latest release for Debian v2.5.8, and
* latest git version v2.6.0-39-g22be888.

Change-Id: I27adbab6a6b95ddf4c6d39803e4f7dd079f11a4c
Related: OS#5913

osmo-uecups-latest: install missing iputils-ping

ping is needed for ttcn3-pgw-test.  In the case of osmo-uecups-master
it's available from the parent $DISTRO-build image, but for the -latest
it needs to be installed by the inherited image itself.

Change-Id: Ia1b9124f09203c7dcf6d26dee78b09d5a139a04f
Related: OS#5913

open5gs-latest: install missing packages for ttcn3-pgw-test

These are present in open5gs-master, but missing in open5gs-latest.

Change-Id: Ic9227033d65d621e7f6c5e196a9a8d6a1b73d5da
Related: OS#5913

open5gs-master: fix comment in Dockerfile

Change-Id: I34577dd39051f429af8257afe075f22b20cfdfe4
Related: OS#5913

open5gs-latest: add osmocom user for ttcn3-pgw-test

In ttcn3-pgw-test we're running open5gs-upfd as a non-root user.
We do have this user in open5gs-master, but not in open5gs-latest.

Change-Id: I9139fc52fa6973cf495559d3c4202d9f804a2079
Related: OS#5913

debian-bullseye-*: apt-key is deprecated, use [signed-by] instead

The following warning message appears when running apt-key:

  apt-key is deprecated. Manage keyring files in trusted.gpg.d instead

The apt-key man page mentions that the "use of apt-key is deprecated,
except for the use of apt-key del in maintainer scripts to remove
existing keys from the main keyring".  What's more, "apt-key will last
be available in Debian 11 and Ubuntu 22.04".

Additionally, while the deprecation message says to "manage keyring
files in trusted.gpg.d instead", the Debian wiki states otherwise.
It's recommended to store the keys in /usr/share/keyrings instead,
and then use the 'signed-by' option to reference them.

https://salsa.debian.org/apt-team/apt/-/commit/ee284d5917d09649b68ff1632d44e892f290c52f

Change-Id: I1cae4f49e72f5e4f9d703cdb8f6d117e18e3567c

osmo-uecups-latest: new Dockerfile

osmo-uecups is available in the latest feed since recently.

Change-Id: I89c16dd0a71d2461981d978d2abf36f62bb9b339
Related: SYS#5602

ttcn3-pgw-test: allow using osmo-uecups from the latest feed

Change-Id: I4f92577f062e8a9be29af83026214636dff19d78

upgrade to gerrit 3.6.3

Change-Id: I56eadf8c6dd4c131dcdaf451e493f619576ae198

ttcn3-bsc-test: sleep 1s before starting testsuite

Give OsmoBSC time to connect to OsmoSTP, so BSSMAP RESET from the
testsuite doesn't fail in OsmoSTP with:
  MTP-TRANSFER.req for DPC 187: no route!

Without this patch, it would fail every other time on my system when
only having one test enabled in BSC_Tests.cfg.

Change-Id: Ic7f80bdfe2fe58e93c2f2e3baa6d7645fcdc3062

release-tarball: support git submodules

osmo-trx 1.5.0 is now using a git submodule for osmocom-bb, so add
support for it.

Change-Id: I35e9ef6d976ae8cf2bfb4f3c410e6b2cb3ca7841

release-tarball: fix osmo-trx 1.5.0

Run configure with the --with-mstrx argument, so LIBTRXCON_DIR is not
pointing at an empty directory.

Fix for:
  make[2]: Entering directory '/build/_temp/repos/osmo-trx/osmocom-bb'
  make[2]: *** No rule to make target 'distdir'.  Stop.

Change-Id: I2f067409f98119d4e35cf86cc2c816fc3c19e3f5

release-tarball: remove PARALLEL_MAKE variable

Probably copy pasted from another script, doesn't make much sense here
since only the release tarballs are built. Nothing gets compiled here,
the variable was not used.

Change-Id: Ie74ee6976759f9634503b21e964e93efcc925679

release-tarball: add var to use list from jenkins

Add a parameter that can be used to reproduce the failure locally with
the last list from jenkins, without having SSH set up to download the
list of existing tarballs.

Change-Id: I9af310c24aa65c21cc4bd365d3df7804cba02df7

release-tarball: add libosmo-pfcp, libgtpnl

Change-Id: I4096c21352366c16167efce5c2a97f4e04c1addb

release-tarball: add missing cd /build

Fix for:
  upload: no tarballs generated, nothing to do.

Change-Id: I047546b26f379c5302d8558b92b77e4fa311a0a0

ttcn3-*: Update test setup after Osmocom CNI release 202302

Change-Id: If34b043a55177e6c0d1be3949fc2a2682258cc84

jenkins-common.sh: open5gs-latest does not require debian-bullseye-build

We're not *building* anything for the open5gs-latest, but simply
downloading and installing DEBs from Sukchan's opensuse.org repo.

Change-Id: Iec7ccab28c37d274a731e08a2f893ec0514c1068
Fixes: 62ac21133a828bab849c072f27664102790fcb91

FR testsuites: clean up all networks before start

Add a new network_clean_remove_all_ttcn3 function and use it in the fr
related testsuites to ensure no network is running before the test
starts. We just had the situation where the network link between
gtp0-deb10fr (where these testsuites run exclusively, and only one at a
time) and the jenkins host went down. And so the clean up trap
apparently did not run and starting a new test fails as the old network
still exists and has the network devices attached.

Related: OS#5802
Change-Id: I6a9464a11edcba978be08764bec9de19760a5c77

debian-buster-jenkins-arm: new image

Add a minimal image to use on the raspberry pis, so it doesn't need to
spend 1-2 hours building debian-buster-jenkins on the raspberry pis,
full of things we don't actually use there.

I've verified that osmo-bts, osmo-pcu, osmo-trx build with this image
(the only projects which we build on the rpis).

Related: OS#5863
Change-Id: I4fb4b48b233acaef815c4c27ec6f17f12cfe836b

ttcn3-bts-test: replace subnets during 'make cfg'

Make ttcn3-bts-test work as expected again by replacing the subnets
hardcoded in the confmerge files and Makefile.

Related: OS#5802
Change-Id: I733619f80b4e2456da070649634d3c942bb6d95f

debian-buster-jenkins: install ccache

Make ccache available inside debian-buster-jenkins. An upcoming osmo-ci
patch will make use of it in gerrit-verification and master jobs. With
this docker-playground patch alone it's not used yet since
/usr/lib/ccache is not in the default PATH.

Related: OS#5848
Change-Id: I164c7835f99436e8d768a864f36118eaf799d109

kernel_test_wait_for_vm: increase timeout to 15s

As we run more testsuites in parallel, the load was higher and so this
timeout was reached.

Related: OS#5802
Change-Id: I823010106a99a4906e32198ed42b36f9fe662c4e

network_create: set NET_NAME after next SUBNET

Put the current SUBNET into NET_NAME, not the previous one. Without this
patch it works too, but this makes more sense.

Related: OS#5802
Change-Id: I6c90505fd6c0ba62244ff67709b0bf31bf44b449

jenkins-common: replace subnet in scm files too

Replace the subnet in *.scm configs of nplab-sua-test and
nplab-m3ua-test too.

Related: OS#5802
Change-Id: Ia734df3721a4ae3408a17d33c835282b79174132

network_create: put SUBNET in NET_NAME

Fix the bug that running a test twice on the same host results in the
second test stopping the containers and network of the first test:

* Have the subnet name in the network name, so there's no collision of
  network names when cleaning up the network.

* Don't clean up the network when creating a new network. Rely on the
  clean up trap to clean up the network instead.

* Don't set NET_NAME when sourcing jenkins-common.sh anymore, as
  network_create will set it. There's also network_bridge_create, which
  only gets used by osmo-ran (which we don't run in jenkins). Add a
  check to this function to ensure NET_NAME is set before calling it,
  which osmo-ran is already doing.

Related: OS#5802
Change-Id: Ifcd384272c56d585e220e2588f2186dc110902ed

network_create: find free subnet automatically

Try multiple subnet numbers until successfully creating a network. This
way we can run the same ttcn3 testsuite multiple times in parallel
without conflicts (e.g. once against latest, once against nightly). Also
we don't need to make sure each new testsuite has a unique subnet
number anymore.

I've considered also adjusting network_bridge_create, but that gets used
exclusively by osmo-ran/jenkins.sh, a script which we don't actually run
in jenkins. It seems that in this script it makes more sense to not get
a random subnet number.

Related: OS#5802
Change-Id: I57152b08ef0f38e17e7019a8df032189b03f56cf

ttcn3-*/jenkins*.sh: use $SUBNET everywhere

Use the SUBNET variable instead of hardcoding it in some places. Split
commands across multiple lines while at it to improve readability.

Related: OS#5802
Change-Id: I08f83089ef97f5f92d4bbfa5743301e7375e9f0f

*/Dockerfile: clone from gerrit.osmocom.org using https://

* Do not clone using deprecated git://, use https:// instead.
* Clone from the main repo gerrit.osmocom.org (if possible).
* Use the gitiles plugin to fetch the last commit from Gerrit.

Change-Id: I204fa6e3e3ebbdb8732393b897fca35659d61ae8

ttcn3-upf-test: fetch /tmp/commit from gerrit, not from cgit

Change-Id: Id327720258a9ece1efb79db0d7c4fcbe19864c92

jenkins-common: tweak echo messages

Use 'set +x' before echo, so messages are not printed twice and the
output becomes more readable.

Example:
  + echo Creating network ttcn3-bts-test
  Creating network ttcn3-bts-test

Related: OS#5802
Change-Id: I213cb80bd1d9401281ae1fb7394b2319453550dd

ttcn3-ggsn-test: cp initrd-ggsn.sh to VOL_BASE_DIR

Prepare for a future patch where a free subnet will be figured out
automatically instead of having a hardcoded one, by moving
initrd-ggsn.sh to $VOL_BASE_DIR as the subnet will be replaced in files
in this directory.

Related: OS#5802
Change-Id: Ie4f35b77a2bff20f2a0479890a429754768cafd2

scripts/regen_doc: use SUBNET variable

Add a $SUBNET parameter and use it throughout the script, similar to
other ttcn3-*/jenkins.sh scripts. This is in preparation for figuring
out a free network in network_create() automatically in a future patch.

Related: OS#5802
Change-Id: I3bda4bd7280469ad5ee02104295134a2e0b768e3

*-repo-install-test: remove

Remove the docker containers for repo-install-test, as it is now running
in qemu + kvm.

Related: OS#5365
Depends: osmo-ci Ie7f1bccb05779cb3614016c0b965b810bbb1471b
Change-Id: Ic40fddcc6b30318b3a6e63fe99b010939b95be25