1465 Commits

Author SHA1 Message Date
Marcus Holland-Moritz
9ac06fe40d More verbose segmenter logging 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
f9a1db48ee Simplify and speed up nilsimsa computation 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
b4becd5d48 Simplify multiversioning using target_clones() 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
f82fb8509e Add nilsimsa update benchmark 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
acc4e7d7b4 Remove unused nilsimsa code 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
54e5723f01 Move progress contexts to bottom of output 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
5f3209028d Merge chunks 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
79d8641998 Check for mergeable chunks and refactor chunk analysis 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
8eb4188277 Support operator[] for chunk_range 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
1ab991f8aa Fix & refine hashing/scanning/categorizing progress 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
bfacd2e962 Suppress warnings with multiversioning 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
dd7d984ebf Slightly increase nilsimsa parameters 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
166fa057c2 Cache bit vector pointers and factor out distance ordering 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
743587e0cc Tiny tweak to similarity ordering 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
bfae0ea210 Optimize distance computation for similarity ordering 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
b82d84fcdf Show single file block refs / chunk counts in dwarfsck 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
33d3de8193 Use C++20 bit operations in segmenter 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
2e2dd4fd5c Implement deterministic category ordering 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
c82f4dc1f7 libfmt 10.1.0 -> 10.1.1 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
4fc2705894 Remove overall speedometer 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
4d59bc677f Benchmark library tweaks 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
d280d470ec Save homedir state in docker container 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
05425c85ae Add simple segmenter benchmark 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
bf4da2fb36 Specialized segmenters for typical PCM audio granularities
These are significantly faster (20-35%) than the variable
granularity segmenter.
2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
88f2d44f05 More detailed verbose logging in scanner & segmenter 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
bef05cbfcf Show libarchive version in dwarfsextract 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
1523239b14 Show compression library versions 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
fc002a6cfa Try without -fno-omit-frame-pointer 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
1ae81075f4 Only enable -fno-omit-frame-pointer for static builds 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
bbb33af4ca Let's try building on Ubuntu 23.04 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
f9f9b0b6fc Try FLAC static build again 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
fdde5ea3e2 Fetch libflac if we have to 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
1940f48b06 Let's see if flac-1.3.3 is good enough 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
03fab6e246 Show progress for file hashing 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
8e84faf0a1 Factor out scanner progress class 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
cee06b28f6 Delay compression progress until we actually start compressing 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
6d582cb3dc Attempt to fix flaky tools test on Windows 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
e3f739d6e2 Compression progress and progress context priority 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
6254dcd35b Improve progress contexts 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
6c3fadbf13 Expose utf8_truncate 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
706b5e2be7 More flexible terminal coloring code 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
053bb82726 Update command line help 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
aa64bab88a Tweak progress/scanning parameters slightly 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
fa94168ea0 Add scanning / categorizing progress 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
7f563432a6 Give a little more space to speedometer 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
323ece6589 Fix update_progress for files >4GiB 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
af8aafc30f Fix compilation with older GCC versions 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
992d4cd51e Improve path truncation 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
94c377379b Segmenter context progress 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
b247654a77 Improved progress context support 2023-12-17 23:02:28 +01:00