Marcus Holland-Moritz
ad14b7e067
fix: add workaround for broken utf8cpp release (fixes gh #182 )
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
dd58e74594
docs(mkdwarfs): update man page with all new options
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
79d3302990
chore: tweak incompressible categorizer option description
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
60e68e1849
chore(flac): use same default level as the offical flac tool
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
cc5af7bad8
feat(mkdwarfs): improve --categorize defaults
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
711b87fd95
chore: disable libmagic & binary categorizers, which aren't ready yet
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
b3f027a853
chore: add manpage checker
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
1db93c813b
feat(mkdwarfs): improve performance and safety when rewriting image
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
de3ee6cc42
chore(filesystem_writer): pass fs_section when copying sections
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
96af22d715
chore(fs_section): expose section number and hash values
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
0a24ebada1
chore: don't try to recompress uncompressed to uncompressed
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
db0f2c0450
fix(filesystem_writer): correctly show rewriting progress when copying
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
bbeffbfd98
feat(mkdwarfs): allow selection of categories to recompress
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
2c91e80119
feat(mkdwarfs): support for rewriting file systems with categories
...
At the same time, this finally adds multi-threaded decompression
when rewriting a file system.
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
e2606226bd
chore(categorizer): add category resolver interface
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
6228677672
chore(metadata-requirements): support checking an optional<string>
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
7293717a94
feat(metadata): add accessors for block category information
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
f6c3b5d43d
chore: mark static rewrite method as deprecated
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
c005b841c0
chore(metadata-requirements): support folly::dynamic requirements
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
a2e44d13d5
feat: add interface to retrieve metadata from block decompressor
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
ce3972f0b4
build: use mold for linking when available
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
eecc01bcbf
fix(console-writer): rewinding was broken in rewrite mode
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
799f981f91
feat(dwarfsck): add new metadata fields to memory usage analysis
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
f4d918dd73
feat(dwarfsck): show categories in metadata output
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
20f8ca51a3
feat(features): add features to metadata when creating file system
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
cb022d3dbc
feat(features): use thrift feature enum and implement feature_set
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
88425dd38f
docs(metadata): rationale for using feature strings
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
eff100c202
chore: update TODO
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
63533a0a5b
feat(mkdwarfs): add --history-compression option
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
db2bd1f69a
docs(mkdwarfs): update section on producing bit-identical images
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
2bf6699241
docs(mkdwarfs): add new history related options
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
e9279590a0
test(nilsimsa): ensure that nilsimsa order is reproducible
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
f35f4c7bd7
fix: add missing case to file_order_mode ostream operator
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
f5e97a3212
test: support adding files with random contents
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
46bd4dd11d
chore(docker): fix running git in docker /workspace directory
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
07412cb7c0
feat(fuse-driver): implement dwarfs.inodeinfo xattr
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
c2840cbe79
feat(filesystem): initial support for file system history
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
b508f4a7b9
chore(metadata): add uint8 typedef for completeness
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
8dae679ad4
feat(forward-compat): allow unknown section/compression types (gh #158 )
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
95eac672f8
feat(metadata): add block category information
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
6aba533688
chore: update TODOs
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
1b0d34accc
feat(logging): enable logging context at verbose level
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
912bd25a4a
feat(logging): more colours to distinguish log levels
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
92d6691b74
fix(block_merger): correctly compute queueable size
...
Don't assume that the block size doesn't change during a block's
lifetime. Blocks can be compressed in the background and shrink in
size. So instead of subtracting the block size from a queueable_size_
member and later adding a (potentially smaller) size back, we always
compute the queueable size from the queued size (by traversing all
queues), the releaseable size, and the maximum queueable size.
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
071da719cb
feat(filesystem_writer): use fsblock policy for block merger
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
c2ceeee9bd
docs(block_merger): add TODO about holder lifetime
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
6ca388fa6b
feat(block_merger): support block policies and partial release
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
a284aecc35
fix: update header size for Wave 64 format
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
cebfea15c1
chore: another attempt at fixing rebuilds
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
32da9c7577
chore: include run number/attempt when storing artifacts
2023-12-17 23:02:28 +01:00