aptly/deb
Sjoerd Simons f61514edaf Allow disabling bzip2 compression for index files
Using bzip2 generates smaller index files (roughly 20% smaller Packages
files) but it comes with a big performance penalty.  When publishing a
debian mirror snapshot (amd64, arm64, armhf, source) without contents
skipping bzip speeds things up around 1.8 times.

```
$ hyperfine -w 1 -L skip-bz2 true,false  -m 3 -p "aptly -config aptly.conf publish drop bullseye || true" "aptly -config aptly.conf  publish snapshot  --skip-bz2={skip-bz2} --skip-contents --skip-signing bullseye"
Benchmark 1: aptly -config aptly.conf  publish snapshot  --skip-bz2=true --skip-contents --skip-signing bullseye
  Time (mean ± σ):     35.567 s ±  0.307 s    [User: 39.366 s, System: 10.075 s]
  Range (min … max):   35.311 s … 35.907 s    3 runs

Benchmark 2: aptly -config aptly.conf  publish snapshot  --skip-bz2=false --skip-contents --skip-signing bullseye
  Time (mean ± σ):     64.740 s ±  0.135 s    [User: 68.565 s, System: 10.129 s]
  Range (min … max):   64.596 s … 64.862 s    3 runs

Summary
  'aptly -config aptly.conf  publish snapshot  --skip-bz2=true --skip-contents --skip-signing bullseye' ran
    1.82 ± 0.02 times faster than 'aptly -config aptly.conf  publish snapshot  --skip-bz2=false --skip-contents --skip-signing bullseye'
```

Allow skipping bz2 creation for setups where faster publishing is more
important then Package file size.

Signed-off-by: Sjoerd Simons <sjoerd@collabora.com>
2022-06-22 11:25:45 +02:00
..
testdata deb: fix importing dbgsym packages with versioned Source field 2022-01-31 11:14:18 +01:00
changes.go deb: fix importing dbgsym packages with versioned Source field 2022-01-31 11:14:18 +01:00
changes_test.go deb: fix importing dbgsym packages with versioned Source field 2022-01-31 11:14:18 +01:00
checksum_collection.go Consistently use transactions to update database 2019-08-11 00:11:53 +03:00
checksum_collection_test.go Refactor database code to support standalone batches, transactions. 2019-08-09 00:46:40 +03:00
collections.go Consistently use transactions to update database 2019-08-11 00:11:53 +03:00
contents.go Refactor database code to support standalone batches, transactions. 2019-08-09 00:46:40 +03:00
deb.go Add support for zst compression 2022-04-04 17:51:21 +02:00
deb_test.go Add unittest for zstd compression support 2022-04-04 17:51:21 +02:00
debian.go Style fix. 2014-04-08 01:04:01 +04:00
debian_test.go Upgrade gocheck 2014-11-05 13:27:15 -06:00
format.go Bump Go versions for Travis, fix tests 2019-07-04 00:16:12 +03:00
format_test.go Add support to mirror non package installer files 2018-07-06 15:02:37 +02:00
graph.go Enable goconst & interfacer linters 2017-05-17 00:53:10 +03:00
import.go Consistently use transactions to update database 2019-08-11 00:11:53 +03:00
index_files.go Allow disabling bzip2 compression for index files 2022-06-22 11:25:45 +02:00
list.go Add publish output progress counting remaining number of packages 2022-01-27 09:30:14 +01:00
list_test.go Test case for filters. #227 2015-03-30 19:56:53 +03:00
local.go Don't use transactions when direct db access is enough 2022-01-27 09:30:14 +01:00
local_test.go Don't use transactions when direct db access is enough 2022-01-27 09:30:14 +01:00
long.stanza Buffer increase (#738) 2018-05-14 17:41:33 +03:00
package.go Add -json flag to mirror list|show 2021-09-24 10:29:33 +02:00
package_collection.go Database changes of resources need to be atomic 2022-01-27 09:30:14 +01:00
package_collection_test.go Refactor database code to support standalone batches, transactions. 2019-08-09 00:46:40 +03:00
package_deps.go Ignore empty 'Depends:' while parsing control file. #233 2015-04-10 21:10:53 +03:00
package_files.go Add support to mirror non package installer files 2018-07-06 15:02:37 +02:00
package_files_test.go Fix paths after repository transfer to aptly-dev 2018-04-18 21:19:43 +03:00
package_test.go Simplify package function signature LinkFromPool 2018-07-06 15:02:37 +02:00
ppa.go Fix paths after repository transfer to aptly-dev 2018-04-18 21:19:43 +03:00
ppa_test.go Fix paths after repository transfer to aptly-dev 2018-04-18 21:19:43 +03:00
publish.go Allow disabling bzip2 compression for index files 2022-06-22 11:25:45 +02:00
publish_test.go Refactor database code to support standalone batches, transactions. 2019-08-09 00:46:40 +03:00
query.go Use proper version comparisions for querys 2022-04-27 13:50:14 +02:00
query_test.go Use proper version comparisions for querys 2022-04-27 13:50:14 +02:00
reflist.go Style fixups 2017-07-05 00:36:48 +03:00
reflist_test.go Refactor database code to support standalone batches, transactions. 2019-08-09 00:46:40 +03:00
remote.go Don't use transactions when direct db access is enough 2022-01-27 09:30:14 +01:00
remote_test.go Consistently use transactions to update database 2019-08-11 00:11:53 +03:00
snapshot.go Don't use transactions when direct db access is enough 2022-01-27 09:30:14 +01:00
snapshot_bench_test.go Refactor database code to support standalone batches, transactions. 2019-08-09 00:46:40 +03:00
snapshot_test.go Consistently use transactions to update database 2019-08-11 00:11:53 +03:00
uploaders.go Fix paths after repository transfer to aptly-dev 2018-04-18 21:19:43 +03:00
uploaders_test.go Fix paths after repository transfer to aptly-dev 2018-04-18 21:19:43 +03:00
version.go Parse dependency architecture even without version 2019-09-06 15:41:59 +03:00
version_test.go Use proper version comparisions for querys 2022-04-27 13:50:14 +02:00