1442 Commits

Author SHA1 Message Date
Marcus Holland-Moritz
ad14b7e067 fix: add workaround for broken utf8cpp release (fixes gh #182) 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
dd58e74594 docs(mkdwarfs): update man page with all new options 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
79d3302990 chore: tweak incompressible categorizer option description 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
60e68e1849 chore(flac): use same default level as the offical flac tool 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
cc5af7bad8 feat(mkdwarfs): improve --categorize defaults 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
711b87fd95 chore: disable libmagic & binary categorizers, which aren't ready yet 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
b3f027a853 chore: add manpage checker 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
1db93c813b feat(mkdwarfs): improve performance and safety when rewriting image 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
de3ee6cc42 chore(filesystem_writer): pass fs_section when copying sections 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
96af22d715 chore(fs_section): expose section number and hash values 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
0a24ebada1 chore: don't try to recompress uncompressed to uncompressed 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
db0f2c0450 fix(filesystem_writer): correctly show rewriting progress when copying 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
bbeffbfd98 feat(mkdwarfs): allow selection of categories to recompress 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
2c91e80119 feat(mkdwarfs): support for rewriting file systems with categories
At the same time, this finally adds multi-threaded decompression
when rewriting a file system.
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
e2606226bd chore(categorizer): add category resolver interface 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
6228677672 chore(metadata-requirements): support checking an optional<string> 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
7293717a94 feat(metadata): add accessors for block category information 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
f6c3b5d43d chore: mark static rewrite method as deprecated 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
c005b841c0 chore(metadata-requirements): support folly::dynamic requirements 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
a2e44d13d5 feat: add interface to retrieve metadata from block decompressor 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
ce3972f0b4 build: use mold for linking when available 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
eecc01bcbf fix(console-writer): rewinding was broken in rewrite mode 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
799f981f91 feat(dwarfsck): add new metadata fields to memory usage analysis 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
f4d918dd73 feat(dwarfsck): show categories in metadata output 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
20f8ca51a3 feat(features): add features to metadata when creating file system 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
cb022d3dbc feat(features): use thrift feature enum and implement feature_set 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
88425dd38f docs(metadata): rationale for using feature strings 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
eff100c202 chore: update TODO 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
63533a0a5b feat(mkdwarfs): add --history-compression option 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
db2bd1f69a docs(mkdwarfs): update section on producing bit-identical images 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
2bf6699241 docs(mkdwarfs): add new history related options 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
e9279590a0 test(nilsimsa): ensure that nilsimsa order is reproducible 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
f35f4c7bd7 fix: add missing case to file_order_mode ostream operator 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
f5e97a3212 test: support adding files with random contents 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
46bd4dd11d chore(docker): fix running git in docker /workspace directory 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
07412cb7c0 feat(fuse-driver): implement dwarfs.inodeinfo xattr 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
c2840cbe79 feat(filesystem): initial support for file system history 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
b508f4a7b9 chore(metadata): add uint8 typedef for completeness 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
8dae679ad4 feat(forward-compat): allow unknown section/compression types (gh #158) 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
95eac672f8 feat(metadata): add block category information 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
6aba533688 chore: update TODOs 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
1b0d34accc feat(logging): enable logging context at verbose level 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
912bd25a4a feat(logging): more colours to distinguish log levels 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
92d6691b74 fix(block_merger): correctly compute queueable size
Don't assume that the block size doesn't change during a block's
lifetime. Blocks can be compressed in the background and shrink in
size. So instead of subtracting the block size from a queueable_size_
member and later adding a (potentially smaller) size back, we always
compute the queueable size from the queued size (by traversing all
queues), the releaseable size, and the maximum queueable size.
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
071da719cb feat(filesystem_writer): use fsblock policy for block merger 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
c2ceeee9bd docs(block_merger): add TODO about holder lifetime 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
6ca388fa6b feat(block_merger): support block policies and partial release 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
a284aecc35 fix: update header size for Wave 64 format 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
cebfea15c1 chore: another attempt at fixing rebuilds 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
32da9c7577 chore: include run number/attempt when storing artifacts 2023-12-17 23:02:28 +01:00