aptly/system
Sjoerd Simons f61514edaf Allow disabling bzip2 compression for index files
Using bzip2 generates smaller index files (roughly 20% smaller Packages
files) but it comes with a big performance penalty.  When publishing a
debian mirror snapshot (amd64, arm64, armhf, source) without contents
skipping bzip speeds things up around 1.8 times.

```
$ hyperfine -w 1 -L skip-bz2 true,false  -m 3 -p "aptly -config aptly.conf publish drop bullseye || true" "aptly -config aptly.conf  publish snapshot  --skip-bz2={skip-bz2} --skip-contents --skip-signing bullseye"
Benchmark 1: aptly -config aptly.conf  publish snapshot  --skip-bz2=true --skip-contents --skip-signing bullseye
  Time (mean ± σ):     35.567 s ±  0.307 s    [User: 39.366 s, System: 10.075 s]
  Range (min … max):   35.311 s … 35.907 s    3 runs

Benchmark 2: aptly -config aptly.conf  publish snapshot  --skip-bz2=false --skip-contents --skip-signing bullseye
  Time (mean ± σ):     64.740 s ±  0.135 s    [User: 68.565 s, System: 10.129 s]
  Range (min … max):   64.596 s … 64.862 s    3 runs

Summary
  'aptly -config aptly.conf  publish snapshot  --skip-bz2=true --skip-contents --skip-signing bullseye' ran
    1.82 ± 0.02 times faster than 'aptly -config aptly.conf  publish snapshot  --skip-bz2=false --skip-contents --skip-signing bullseye'
```

Allow skipping bz2 creation for setups where faster publishing is more
important then Package file size.

Signed-off-by: Sjoerd Simons <sjoerd@collabora.com>
2022-06-22 11:25:45 +02:00
..
changes Add unittest for zstd compression support 2022-04-04 17:51:21 +02:00
files Add Debian 11 keys to test fixture keyring 2021-09-24 10:29:33 +02:00
t01_version Automatic versioning for aptly 2017-03-25 00:18:45 +03:00
t02_config Allow disabling bzip2 compression for index files 2022-06-22 11:25:45 +02:00
t03_help Revive skipped tests 2022-02-08 11:18:50 +01:00
t04_mirror Use University of Utah mirror in tests 2022-02-13 20:44:28 +01:00
t05_snapshot Add -json flag to mirror list|show 2021-09-24 10:29:33 +02:00
t06_publish Allow disabling bzip2 compression for index files 2022-06-22 11:25:45 +02:00
t07_serve Convert tests to Python 3 2022-01-27 15:06:33 +01:00
t08_db Bump Go versions for Travis, fix tests 2019-07-04 00:16:12 +03:00
t09_repo Convert tests to Python 3 2022-01-27 15:06:33 +01:00
t10_task Add system's requirements.txt, enforce flake8 linter 2017-04-28 00:05:11 +03:00
t11_package Allow package queries to return duplicate entries on `PackageCollection` 2017-08-17 00:40:34 +03:00
t12_api Add functional test for metrics endpoint 2022-04-12 14:39:16 +02:00
udebs System test for repo adding .udebs. #108 2014-09-30 21:26:28 +04:00
README.rst System test, first sketch. 2014-01-20 23:39:25 +04:00
api_lib.py Fix system tests 2022-01-27 09:30:14 +01:00
fixture.sh Updated fixture: sensu mirror, new mirror contents. 2014-06-29 09:56:30 +04:00
fs_endpoint_lib.py Convert tests to Python 3 2022-01-27 15:06:33 +01:00
gpg-gen-key Compatibility with GnuPG 1.x and 2.x, auto-detect GnuPG version 2018-10-10 01:34:00 +03:00
lib.py Add functional test for metrics endpoint 2022-04-12 14:39:16 +02:00
requirements.txt Print when test is skipped 2019-07-11 00:49:36 +03:00
run.py Convert tests to Python 3 2022-01-27 15:06:33 +01:00
s3_lib.py Convert tests to Python 3 2022-01-27 15:06:33 +01:00
swift_lib.py Convert tests to Python 3 2022-01-27 15:06:33 +01:00

README.rst

System test for aptly