Marcus Holland-Moritz
e3b25ffea4
wip: compressor memory usage
2025-05-26 20:27:33 +02:00
Marcus Holland-Moritz
a1536e064a
build: bump library versions
2025-05-26 20:27:33 +02:00
Marcus Holland-Moritz
e89ac2bf18
build: use different versions of libarchive for openssl/libressl
2025-05-26 20:27:33 +02:00
Marcus Holland-Moritz
103981d289
docs(mkdwarfs): update workers and bit-identical image descriptions
2025-05-26 20:27:33 +02:00
Marcus Holland-Moritz
932a912a31
chore: add segmenter memory usage estimation
2025-05-26 20:27:33 +02:00
Marcus Holland-Moritz
434b145be5
feat(util): add support for memory usage on Windows
2025-05-25 13:45:35 +02:00
Marcus Holland-Moritz
16fc873c77
feat: show memory usage in mkdwarfs
2025-05-25 13:45:35 +02:00
Marcus Holland-Moritz
61522acd8a
build: use full and minimal jemalloc configurations
2025-05-25 13:45:35 +02:00
Marcus Holland-Moritz
8ebb2036a7
chore(filesystem_writer): debug log compressor memory usage
2025-05-25 13:45:35 +02:00
Marcus Holland-Moritz
36de0275a6
fix(segmenter): don't use per-block bloom filters with -B1
2025-05-25 13:45:35 +02:00
Marcus Holland-Moritz
94563188d5
chore(segmenter): add debug logging with memory usage information
2025-05-24 19:20:46 +02:00
Marcus Holland-Moritz
a7b9772cec
refactor(block_merger): improve naming, don't hard-code policy
2025-05-24 19:20:46 +02:00
Marcus Holland-Moritz
4c1e1611e7
refactor(filesystem_writer): capacity -> estimated_mem_usage
2025-05-24 19:20:46 +02:00
Marcus Holland-Moritz
27e8ede963
refactor(filesystem_writer): rename re-writing methods
2025-05-24 19:20:46 +02:00
Marcus Holland-Moritz
121422f35c
refactor(zstd): drop zstd_context_manager from zstd compressor
2025-05-24 19:20:46 +02:00
Marcus Holland-Moritz
a93776c0af
feat(metadata_analyzer): add old string table details
2025-05-24 19:20:46 +02:00
Marcus Holland-Moritz
d87bae1c08
refactor(metadata_analyzer): clean up analyzer code
2025-05-24 19:20:46 +02:00
Marcus Holland-Moritz
1188b8563c
refactor: factor out metadata_analyzer
2025-05-20 11:33:33 +02:00
Marcus Holland-Moritz
7dd246954c
feat(dwarfsck): show metadata byte ranges with frozen_analysis_details
2025-05-20 10:59:50 +02:00
Marcus Holland-Moritz
caca05ab49
feat: add --change-block-size
2025-05-18 13:54:06 +02:00
Marcus Holland-Moritz
36789b4be4
feat: use sane per-category defaults for rewriting
2025-05-18 13:54:06 +02:00
Marcus Holland-Moritz
a962954ff4
fix(mkdwarfs_main): only store time resolution if necessary
2025-05-18 13:54:06 +02:00
Marcus Holland-Moritz
4aa2107f28
test: add metadata rebuilding tests
2025-05-18 13:54:06 +02:00
Marcus Holland-Moritz
1ae3aeb193
feat: update inode info when rebuilding metadata
2025-05-18 13:54:06 +02:00
Marcus Holland-Moritz
ac2443cd0b
feat: add metadata version history
2025-05-18 13:54:04 +02:00
Marcus Holland-Moritz
c6416084c9
feat: add metadata_builder and --rebuild-metadata option
2025-05-18 13:52:15 +02:00
Marcus Holland-Moritz
f7b29e87e7
docs(dwarfs-format): update section index description (gh #264 )
2025-05-18 13:52:15 +02:00
Marcus Holland-Moritz
3feef5fc05
fix(filesystem_parser): more section index discovery checks (gh #264 )
2025-05-18 13:52:15 +02:00
Marcus Holland-Moritz
a74de310a0
fix(filesystem_parser): more robust section index discovery (gh #264 )
2025-05-18 13:52:14 +02:00
Marcus Holland-Moritz
d577cd04bf
feat: optionally add category metadata to file system metadata
2025-05-15 20:50:24 +02:00
Marcus Holland-Moritz
327dba5585
feat(metadata_freezer): log metadata freezing time
2025-05-15 20:50:24 +02:00
Marcus Holland-Moritz
20b973825f
build: add ENABLE_SANITIZER for other sanitizer types
2025-05-15 20:50:24 +02:00
Marcus Holland-Moritz
d498ddddb0
build: try adding /bigobj for test targets
2025-05-15 20:50:24 +02:00
Marcus Holland-Moritz
a04d5cab6d
refactor(lru_cache): pass prune hook by reference
2025-05-15 20:50:24 +02:00
Marcus Holland-Moritz
3790c5451e
refactor: factor out metadata_builder from scanner
2025-05-15 20:49:38 +02:00
Marcus Holland-Moritz
b1e4dad673
chore: allow access to thawed/unpacked metadata for rewriting
2025-05-15 20:49:38 +02:00
Marcus Holland-Moritz
7a86412e6c
chore: update benchmark scripts after v0.12.4
2025-05-15 20:49:38 +02:00
Marcus Holland-Moritz
66b80efd0f
chore: update change log
2025-05-14 09:23:25 +02:00
Marcus Holland-Moritz
5b3a5e1f3c
test(block_merger): don't excessively sleep on Windows
2025-05-14 07:09:49 +02:00
Marcus Holland-Moritz
d47cabc537
chore: sync fsst from upstream
2025-05-14 07:09:49 +02:00
Marcus Holland-Moritz
293ed10eff
feat(dwarfck): add schema_raw_dump to --detail
2025-05-14 07:02:15 +02:00
Marcus Holland-Moritz
5b095bbf69
feat(metadata_v2): dump more details in frozen metadata breakdown
2025-05-14 07:02:15 +02:00
Marcus Holland-Moritz
eb401acea4
fix(metadata_v2): allow dumping frozen_layout w/o frozen_analysis
2025-05-14 07:02:14 +02:00
Marcus Holland-Moritz
4cbc96293d
feat(metadata_v2): more complete metadata breakdown
2025-05-14 07:01:21 +02:00
Marcus Holland-Moritz
3a49825eca
fix(rewrite_filesystem): add history unless --no-history is given
2025-05-14 06:50:13 +02:00
Marcus Holland-Moritz
f01cf2c76a
fix(filesystem_writer): segfault on bad_compression_ratio_error
...
When recompressing a filesystem where some blocks cannot be compressed
using the selected algorithm because of a `bad_compression_ratio_error`,
the resulting `block` was left empty after the refactoring done in
06f8728cc. It's a really easy fix, pretty much just doing what the code
did before the refactor: initialize `block` with the decompressed data
before attempting to compress it. Since `clang-format` reformatted the
whole lambda after the change, I've pulled the lamdba body out into a
separate function, which makes this change much bigger than it is.
2025-05-14 06:47:32 +02:00
Marcus Holland-Moritz
be8a152a98
fix(logger): logging timestamps should show local time
2025-05-14 06:47:32 +02:00
Marcus Holland-Moritz
7b0b1cdc0c
refactor: introduce and use safe_localtime()
2025-05-14 06:47:32 +02:00
Marcus Holland-Moritz
4b277a0507
docs(dwarfs-format): add some details about frozen2 metadata storage
2025-05-14 06:47:32 +02:00
Marcus Holland-Moritz
63b0cc70d0
doc(dwarfs-format): clarify docs based on #263
2025-05-12 08:26:51 +02:00
