TheCloud/dwarfs
1
0
Fork 0
mirror of https://github.com/mhx/dwarfs.git synced 2025-09-11 21:35:27 -04:00
Code Issues Packages Projects Releases Wiki Activity
1,323 Commits 97 Branches 62 Tags
Commit Graph

1323 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Marcus Holland-Moritz
d59ff62ad7 build: add example for setting per-file compile options 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
fb8c01cf18 Clean up console writer 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
f8e7f66b6a Output metadata size in verbose mode 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
bff7e1b4b0 Support validation function in integral_value_parser 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
5046930d17 Use unsigned bytes in cyclic hash 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
3dd82bc085 Use zstd instead of lz4 for incompressible categorizer 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
b101694d06 Fix segmenter for the case when segmenting is disable 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
bad2c5e057 Factor out zstd context manager 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
9ac06fe40d More verbose segmenter logging 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
f9a1db48ee Simplify and speed up nilsimsa computation 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
b4becd5d48 Simplify multiversioning using target_clones() 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
f82fb8509e Add nilsimsa update benchmark 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
acc4e7d7b4 Remove unused nilsimsa code 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
54e5723f01 Move progress contexts to bottom of output 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
5f3209028d Merge chunks 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
79d8641998 Check for mergeable chunks and refactor chunk analysis 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
8eb4188277 Support operator[] for chunk_range 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
1ab991f8aa Fix & refine hashing/scanning/categorizing progress 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
bfacd2e962 Suppress warnings with multiversioning 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
dd7d984ebf Slightly increase nilsimsa parameters 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
166fa057c2 Cache bit vector pointers and factor out distance ordering 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
743587e0cc Tiny tweak to similarity ordering 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
bfae0ea210 Optimize distance computation for similarity ordering 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
b82d84fcdf Show single file block refs / chunk counts in dwarfsck 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
33d3de8193 Use C++20 bit operations in segmenter 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
2e2dd4fd5c Implement deterministic category ordering 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
c82f4dc1f7 libfmt 10.1.0 -> 10.1.1 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
4fc2705894 Remove overall speedometer 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
4d59bc677f Benchmark library tweaks 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
d280d470ec Save homedir state in docker container 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
05425c85ae Add simple segmenter benchmark 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
bf4da2fb36 Specialized segmenters for typical PCM audio granularities 
These are significantly faster (20-35%) than the variable
granularity segmenter.
 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
88f2d44f05 More detailed verbose logging in scanner & segmenter 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
bef05cbfcf Show libarchive version in dwarfsextract 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
1523239b14 Show compression library versions 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
fc002a6cfa Try without -fno-omit-frame-pointer 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
1ae81075f4 Only enable -fno-omit-frame-pointer for static builds 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
bbb33af4ca Let's try building on Ubuntu 23.04 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
f9f9b0b6fc Try FLAC static build again 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
fdde5ea3e2 Fetch libflac if we have to 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
1940f48b06 Let's see if flac-1.3.3 is good enough 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
03fab6e246 Show progress for file hashing 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
8e84faf0a1 Factor out scanner progress class 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
cee06b28f6 Delay compression progress until we actually start compressing 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
6d582cb3dc Attempt to fix flaky tools test on Windows 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
e3f739d6e2 Compression progress and progress context priority 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
6254dcd35b Improve progress contexts 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
6c3fadbf13 Expose utf8_truncate 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
706b5e2be7 More flexible terminal coloring code 2023-12-17 23:02:28 +01:00
Marcus Holland-Moritz
053bb82726 Update command line help 2023-12-17 23:02:28 +01:00