1521 Commits

Author SHA1 Message Date
Marcus Holland-Moritz
aacb9a0d94 add segmenter_factory 2023-12-17 23:00:41 +01:00
Marcus Holland-Moritz
8fa157bf92 add block_manager 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
7b591c741f Use std::shared_mutex to silence TSAN 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
ff3246f518 Pass predicate by universal reference in sortable_span 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
df475adc01 Add non-const begin/end to inode_fragments 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
3f7cb975ca Fix cloning of zstd compressor objects 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
4e5d45deaf Fix decompress_frame return value in FLAC decompressor 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
8c24b443d9 Allow block_compressor default construction 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
6f9702c347 Dump all inodes with DWARFS_DUMP_INODES 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
7e95647cfe Always set default order (can be overwritten by user) 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
f7d3fca9e2 Fix scanning logic in inode manager to perform sequential scans 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
6866a2fef7 Add TODO 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
67e05b4fe9 More cleaning up 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
e1a26d77c8 Remove script ordering and more cleaning up 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
51b1c1148a More Python removal 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
4cfac79a2e Update mkdwarfs docs 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
c42d168726 nilsimsa2 -> nilsimsa 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
2546cc94f4 Nuke nilsimsa v1 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
7891608c82 Factor out nilsimsa2 ordering 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
a90768ae0f More inode methods 2023-12-17 23:00:07 +01:00
Marcus Holland-Moritz
b49dd782c6 add inode_ordering 2023-12-17 22:59:37 +01:00
Marcus Holland-Moritz
f54ac8d50e add fragment_chunkable 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
7b24687c56 performance improvement: fs_path -> less_revpath 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
0f362be4ee Decouple segmenter from inode / os_access / mmif 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
78c15ad028 Ownership cleanup 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
1f575df739 Use receiver abstraction for similarity_ordering 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
94b1384e68 Add simple receiver abstraction 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
a0d00bac2b Add multihreaded nilsimsa ordering using similarity_ordering 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
94a66087a9 Add similarity_ordering module 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
94b875868e Logging & timing for file_scanner 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
b309d7165b CMakeLists test cleanup 2023-12-17 22:58:51 +01:00
Marcus Holland-Moritz
663a95be63 Update TODO 2023-12-17 22:58:06 +01:00
Marcus Holland-Moritz
56dfe58695 DWARFS_UNLIKELY -> [[unlikely]] 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
35af027b27 block_manager -> segmenter 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
8b05c2b338 Show categories in long help 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
e86cd07246 Generate list of seen categories 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
a75381b0ef Contextual option logging 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
5d191a6dbf Add incompressible categorizer test 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
35ae53b3fe More options for incompressible categorizer 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
3b981ea406 Make default category available to categorizers 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
dbd5502f82 Add some pcmaudio categorizer tests 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
0f0505947c Add PCM audio test files 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
3b5b15eaf8 Add TODOs for ranges when we switch to C++23 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
9d5969adb7 Better modeling of metadata requirements 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
e08faf2c0c Basic working FLAC compression 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
4d5c039f12 Add pcm_sample_transformer 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
6ddbcad93b Perform metadata check 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
c2da034983 Compression metadata 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
3f0d7c14fd Category-dependent block compression 2023-12-17 21:59:11 +01:00
Marcus Holland-Moritz
92226a73bd Parsing more categorized options 2023-12-17 21:59:11 +01:00