1233 Commits

Author SHA1 Message Date
Marcus Holland-Moritz
2eadb48cfa Granularity docs 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
42207408a9 Segmenting timers 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
01cd62d2fc Switch to folly::small_vector as p99 match count is 1. 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
89f4a24fec Build match counts historgram in segmenter 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
b75e0c78a1 Add and use category_prefix() function 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
a9ff74ee0c Add granularity policies to segmenter 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
f94d1c7def Forward compression constraints from compressor to segmenter 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
8206e585d6 Set defaults for categorized options correctly 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
ade7116484 We can reserve chunk memory upfront 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
26056b726d Fix DbgWithRelInfo build on Windows 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
ec3daf0ef3 Fix strange error on Windows 2023-12-17 23:01:36 +01:00
Marcus Holland-Moritz
51e0bb72a7 update per-category command line options 2023-12-17 23:00:57 +01:00
Marcus Holland-Moritz
aacb9a0d94 add segmenter_factory 2023-12-17 23:00:41 +01:00
Marcus Holland-Moritz
8fa157bf92 add block_manager 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
7b591c741f Use std::shared_mutex to silence TSAN 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
ff3246f518 Pass predicate by universal reference in sortable_span 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
df475adc01 Add non-const begin/end to inode_fragments 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
3f7cb975ca Fix cloning of zstd compressor objects 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
4e5d45deaf Fix decompress_frame return value in FLAC decompressor 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
8c24b443d9 Allow block_compressor default construction 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
6f9702c347 Dump all inodes with DWARFS_DUMP_INODES 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
7e95647cfe Always set default order (can be overwritten by user) 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
f7d3fca9e2 Fix scanning logic in inode manager to perform sequential scans 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
6866a2fef7 Add TODO 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
67e05b4fe9 More cleaning up 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
e1a26d77c8 Remove script ordering and more cleaning up 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
51b1c1148a More Python removal 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
4cfac79a2e Update mkdwarfs docs 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
c42d168726 nilsimsa2 -> nilsimsa 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
2546cc94f4 Nuke nilsimsa v1 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
7891608c82 Factor out nilsimsa2 ordering 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
a90768ae0f More inode methods 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
b49dd782c6 add inode_ordering 2023-12-17 22:59:37 +01:00
Marcus Holland-Moritz
f54ac8d50e add fragment_chunkable 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
7b24687c56 performance improvement: fs_path -> less_revpath 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
0f362be4ee Decouple segmenter from inode / os_access / mmif 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
78c15ad028 Ownership cleanup 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
1f575df739 Use receiver abstraction for similarity_ordering 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
94b1384e68 Add simple receiver abstraction 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
a0d00bac2b Add multihreaded nilsimsa ordering using similarity_ordering 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
94a66087a9 Add similarity_ordering module 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
94b875868e Logging & timing for file_scanner 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
b309d7165b CMakeLists test cleanup 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
663a95be63 Update TODO 2023-12-17 22:58:06 +01:00
Marcus Holland-Moritz
56dfe58695 DWARFS_UNLIKELY -> [[unlikely]] 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
35af027b27 block_manager -> segmenter 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
8b05c2b338 Show categories in long help 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
e86cd07246 Generate list of seen categories 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
a75381b0ef Contextual option logging 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
5d191a6dbf Add incompressible categorizer test 2023-12-17 21:59:11 +01:00