1265 Commits

Author SHA1 Message Date
Marcus Holland-Moritz
cacf8d212b Remove sync() call in progress class 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
b43500219a Remove old nilsimsa progress variables 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
6b855c57fd Remove debug_progress_ in console_writer 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
8913a86ad1 Simplify inode manager category interface 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
ff6586d8fd Add chunkable::get_file 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
e4b09aae2f Remove inode_chunkable 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
978f689f8f Simple local progress context 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
7be9aa7585 Add reverse path ordering 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
1e80009d45 Segmenter cleanup 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
026f57ccb7 Improve logging 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
a9636a3f0b Improve segmenter logging 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
5a9c7f823e Add verbose logging level 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
cbc8d6759a Pre-generate more segmenter code paths 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
802f876f6e Factor out common code in inode manager 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
03da4120e5 Allow larger bloom filters 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
65a16dc214 Fix bug where match frames were not properly converted to bytes 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
24829e2efe Allow disabling of the segmenter 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
42dc2986f9 Show total category sizes 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
86e19e3886 Fix bloom filter size computation for granularity > 1 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
0f6a33af17 Fix block size computation 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
7b2fd03572 Final granularity tweaks 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
cf388ee24a Move logging from dtor to finish() 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
4eb512b6ed No ranges code for now, sadly, as this breaks clang-15 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
029b4def9c first draft of adding granularity support to segmenter 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
c903f6b265 Add constexpr rsync_hash::repeating_window() 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
db4499847e Set default compression correctly 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
75d8159d85 Add granularity size assertions 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
d82eed8513 Simplify & cleanup in segmenter 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
19b3424a3c Add constrained_block_size to granularity policy 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
18b306033b Add check_chunkable_size in granularity policy 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
ee9885f377 More granularity changes in segmenter 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
894993f54c Update TODO 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
2eadb48cfa Granularity docs 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
42207408a9 Segmenting timers 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
01cd62d2fc Switch to folly::small_vector as p99 match count is 1. 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
89f4a24fec Build match counts historgram in segmenter 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
b75e0c78a1 Add and use category_prefix() function 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
a9ff74ee0c Add granularity policies to segmenter 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
f94d1c7def Forward compression constraints from compressor to segmenter 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
8206e585d6 Set defaults for categorized options correctly 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
ade7116484 We can reserve chunk memory upfront 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
26056b726d Fix DbgWithRelInfo build on Windows 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
ec3daf0ef3 Fix strange error on Windows 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
51e0bb72a7 update per-category command line options 2023-12-17 23:00:57 +01:00
Marcus Holland-Moritz
aacb9a0d94 add segmenter_factory 2023-12-17 23:00:41 +01:00
Marcus Holland-Moritz
8fa157bf92 add block_manager 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
7b591c741f Use std::shared_mutex to silence TSAN 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
ff3246f518 Pass predicate by universal reference in sortable_span 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
df475adc01 Add non-const begin/end to inode_fragments 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
3f7cb975ca Fix cloning of zstd compressor objects 2023-12-17 23:00:07 +01:00