TheCloud/dwarfs
1
0
Fork 0
mirror of https://github.com/mhx/dwarfs.git synced 2025-09-13 22:40:03 -04:00
Code Issues Packages Projects Releases Wiki Activity
1,729 Commits 97 Branches 62 Tags
Commit Graph

1729 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Marcus Holland-Moritz
8e376d77ad Document mkdwarfs internals 2021-04-01 17:52:43 +02:00
Marcus Holland-Moritz
89df6add69 Some alignment optimisation of bloom filter 2021-04-01 15:01:41 +02:00
Marcus Holland-Moritz
ba84b130cf Drop default bloom filter size 2021-04-01 15:00:36 +02:00
Marcus Holland-Moritz
2a7acc3ea4 Fix bloom filter bit shifting (spotted by ubsan) 
This actually made the bloom filters only half as efficient
as only the lower 32 bits of each 64 bit slot were used...
 2021-04-01 13:15:28 +02:00
Marcus Holland-Moritz
e0c361c872 Wording 2021-04-01 11:43:57 +02:00
Marcus Holland-Moritz
ad09f4517d Logger cleanup 2021-04-01 11:08:01 +02:00
Marcus Holland-Moritz
c075eaab0e Show unpacked string table size in dwarfsck metadata analysis 2021-04-01 02:53:01 +02:00
Marcus Holland-Moritz
a80a068c6d Adjust max name length again 2021-04-01 02:10:25 +02:00
Marcus Holland-Moritz
c09891b34f README updates 2021-04-01 01:19:38 +02:00
Marcus Holland-Moritz
aebd325c68 More relaxed max name length 2021-04-01 01:12:49 +02:00
Marcus Holland-Moritz
44c43e4c7d Slightly more verbose error message 2021-04-01 01:10:38 +02:00
Marcus Holland-Moritz
d5c38136dc Update man pages 2021-04-01 00:41:09 +02:00
Marcus Holland-Moritz
ae9d521efc Export metadata as "regular" (non-simple) JSON 
This makes the output independent from changes to identifiers
used in the thrift specification.
 2021-04-01 00:38:43 +02:00
Marcus Holland-Moritz
3d5023ba39 Add bad filesystem detection test 2021-03-31 23:23:17 +02:00
Marcus Holland-Moritz
c5081608e9 Dump raw metadata before recursive traversal 2021-03-31 22:51:00 +02:00
Marcus Holland-Moritz
aec1cd924d More consistency in command line tool behaviour 2021-03-31 22:50:14 +02:00
Marcus Holland-Moritz
8dd1385d1d Enable metadata consistency checking in tests 2021-03-31 22:49:46 +02:00
Marcus Holland-Moritz
dca93db1da Even more metadata checks 2021-03-31 22:49:27 +02:00
Marcus Holland-Moritz
9112f1f7ac Moar checks 2021-03-31 08:21:41 +02:00
Marcus Holland-Moritz
69fc251cd6 Two more checks 2021-03-30 18:17:07 +02:00
Marcus Holland-Moritz
72f56004ec Add metadata consistency checks 2021-03-30 17:49:14 +02:00
Marcus Holland-Moritz
e85f782f6c Slightly better progress reporting when rewriting filesystem 2021-03-30 17:48:03 +02:00
Marcus Holland-Moritz
bf26f7948a Formatting 2021-03-30 17:45:56 +02:00
Marcus Holland-Moritz
071982ba0f Improved error message when using an empty filesystem file 2021-03-30 17:45:36 +02:00
Marcus Holland-Moritz
4072fc424f Update folly/fbthrift 2021-03-30 13:15:22 +02:00
Marcus Holland-Moritz
ad69be77cf Add some simple filesystem extractor tests 2021-03-28 23:38:56 +02:00
Marcus Holland-Moritz
938a5dd1ce Add streaming interface for filesystem extractor 2021-03-28 23:38:38 +02:00
Marcus Holland-Moritz
9ddd2a5d71 Catch errors during filesystem rewrite 2021-03-28 23:06:48 +02:00
Marcus Holland-Moritz
3cf157421d Check against overflow due to corrupted length field 2021-03-28 23:06:27 +02:00
Marcus Holland-Moritz
dff559bc3f Fix segfault with corrupted filesystem 2021-03-28 16:56:00 +02:00
Marcus Holland-Moritz
7f62fe2e4b Catch errors during filesystem extraction 2021-03-28 16:46:26 +02:00
Marcus Holland-Moritz
95d4b4f049 More filesystem header options (github #38) 
Add `--header` and `--remove-header` to `mkdwarfs`, add
`--print-header` to `dwarfsck`.

Also more testing of rewriting in the presence of headers.
 2021-03-28 15:29:43 +02:00
Marcus Holland-Moritz
53416df766 Add tests for automatic image offset computation 2021-03-28 10:26:01 +02:00
Marcus Holland-Moritz
0a992d41c2 Fix image offset calculation with early matches 2021-03-28 10:25:30 +02:00
Marcus Holland-Moritz
aa92e69d10 Allow specifying a filesystem image offset (fixes github #38) 
Works for dwarfs, dwarfsck and dwarfsextract
 2021-03-28 00:28:55 +01:00
Marcus Holland-Moritz
b4a8e0134b Update documentation 2021-03-28 00:23:00 +01:00
Marcus Holland-Moritz
b7ec25b887 Fix dependencies 2021-03-25 14:41:26 +01:00
Marcus Holland-Moritz
eadd7c1abe Add dependency 2021-03-25 14:11:24 +01:00
Marcus Holland-Moritz
257cadb071 More readv benchmarks 2021-03-25 13:59:08 +01:00
Marcus Holland-Moritz
f30ca742be Format CMakeLists.txt 2021-03-25 13:45:13 +01:00
Marcus Holland-Moritz
d97df34b11 Add filesystem benchmark 2021-03-25 13:44:50 +01:00
Marcus Holland-Moritz
5c698e7433 Set default for readv offset argument 2021-03-25 13:40:40 +01:00
Marcus Holland-Moritz
32f7ea9961 Make string table more flexible to pack 2021-03-25 11:29:49 +01:00
Marcus Holland-Moritz
ef3e51037b Fix bloom filter for small sizes 2021-03-25 01:21:42 +01:00
Marcus Holland-Moritz
f87aa4a8cf Factor out test helpers 2021-03-25 00:45:38 +01:00
Marcus Holland-Moritz
50d42005e3 Truncate metadata export output file 2021-03-25 00:38:51 +01:00
Marcus Holland-Moritz
e67d3df41a Unpack fields for metadata export 2021-03-25 00:38:39 +01:00
Marcus Holland-Moritz
423c7ea3e8 Reuse zstd contexts (appears to give some speedup) 2021-03-23 17:44:49 +01:00
Marcus Holland-Moritz
a2b373165f Update man page 2021-03-23 14:45:00 +01:00
Marcus Holland-Moritz
77184fd5a9 Add --pack-metadata=mmap 2021-03-23 14:41:53 +01:00