TheCloud/dwarfs
1
0
Fork 0
mirror of https://github.com/mhx/dwarfs.git synced 2025-09-13 22:40:03 -04:00
Code Issues Packages Projects Releases Wiki Activity
1,729 Commits 97 Branches 62 Tags
Commit Graph

1729 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Marcus Holland-Moritz
58b23cebe8 Add warning on low memory limit 2021-03-23 14:17:48 +01:00
Marcus Holland-Moritz
c19c426968 Remove --max-scanner-workers 2021-03-23 14:08:32 +01:00
Marcus Holland-Moritz
5bfabef613 Update static linking 2021-03-23 14:02:35 +01:00
Marcus Holland-Moritz
4cd67bb38c Update fbthrift to master (for now) 2021-03-23 13:54:06 +01:00
Marcus Holland-Moritz
bd2e66fdea Move sorting & add a comment 2021-03-23 13:49:27 +01:00
Marcus Holland-Moritz
df5de1f486 Update format docs 2021-03-23 12:46:31 +01:00
Marcus Holland-Moritz
88d684379e Improve dwarfsck output 2021-03-23 12:07:20 +01:00
Marcus Holland-Moritz
f3c0f96059 Start scanning right after discovering file inodes 
This is safe because filtering happens yet before that and stuff
like inode assignment happens afterwards.
 2021-03-23 11:42:27 +01:00
Marcus Holland-Moritz
d41a0f5e1b More logging 2021-03-22 23:33:36 +01:00
Marcus Holland-Moritz
33e388f966 Improve detail levels, add more debug info 2021-03-22 17:57:06 +01:00
Marcus Holland-Moritz
e973ce0b49 Formatting 2021-03-22 17:56:43 +01:00
Marcus Holland-Moritz
8492a989bf Remove arch=skylake multiversioning (also fixes gh #37) 2021-03-22 17:56:24 +01:00
Marcus Holland-Moritz
5c20498f62 Make integrity check optional to speed up dwarfsck 2021-03-22 17:55:28 +01:00
Marcus Holland-Moritz
9f0e9340dd Fix missing space 2021-03-22 17:54:53 +01:00
Marcus Holland-Moritz
a22aa99729 Small refactor to avoid excessive vector allocation 2021-03-22 10:21:07 +01:00
Marcus Holland-Moritz
6c24e55897 Add dump for nilsimsa data 2021-03-21 23:06:28 +01:00
Marcus Holland-Moritz
953869e913 Fix inode count in progress output 2021-03-21 17:16:30 +01:00
Marcus Holland-Moritz
609e5ac3a7 Use regular worker group (non-load-apaptive) for scanning 
Also rename `writer` thread pool to `compress`.
 2021-03-21 16:08:09 +01:00
Marcus Holland-Moritz
29acde87b5 Optimize scanning 
This parallelizes scanning so that files only have to be touched
twice (scanning + segmenting) instead of three times (scanning,
scanning again, segmenting).
 2021-03-21 16:07:01 +01:00
Marcus Holland-Moritz
592c7376ce Window step size defaults depending on compression level 2021-03-21 16:07:01 +01:00
Marcus Holland-Moritz
c322650738 Add --plain-string-tables 2021-03-21 16:07:01 +01:00
Marcus Holland-Moritz
9e1b111b43 Don't output randomly from worker group 2021-03-21 16:07:01 +01:00
Marcus Holland-Moritz
df2c653d8a New compact string table representation 2021-03-21 16:06:37 +01:00
Marcus Holland-Moritz
955103fdab Add libfsst 2021-03-20 20:41:54 +01:00
Marcus Holland-Moritz
694075d7d2 Multithreaded dwarfsck 2021-03-20 07:10:58 +01:00
Marcus Holland-Moritz
db5576ac29 Support packaged tasks in worker groups 2021-03-20 07:06:40 +01:00
Marcus Holland-Moritz
13eeaba658 Improve dwarfsck output 2021-03-20 06:30:32 +01:00
Marcus Holland-Moritz
e4e03fa687 Improved metadata analysis 2021-03-19 21:46:59 +01:00
Marcus Holland-Moritz
7b38c0744f Flexible metadata packing 2021-03-19 12:04:11 +01:00
Marcus Holland-Moritz
fdf29cd1d9 Update thrift comments 2021-03-18 23:48:24 +01:00
Marcus Holland-Moritz
5a4d15f086 Packing/unpacking of chunk table and directories 2021-03-18 23:36:12 +01:00
Marcus Holland-Moritz
0fa8e29897 Fix metadata dump() output 2021-03-18 23:35:07 +01:00
Marcus Holland-Moritz
71e92b2005 Remove delta_compress 2021-03-18 23:34:35 +01:00
Marcus Holland-Moritz
e04e897a70 build_parent_entry_list 2021-03-18 21:27:14 +01:00
Marcus Holland-Moritz
762c50dc9b Delta compression 2021-03-18 21:27:14 +01:00
Marcus Holland-Moritz
95a8875198 Comments 2021-03-18 21:27:14 +01:00
Marcus Holland-Moritz
7c88677b91 Refactor directory_view to support external data vector 2021-03-18 21:27:14 +01:00
Marcus Holland-Moritz
cbbf741519 Make code a bit more readable 2021-03-18 20:43:57 +01:00
Marcus Holland-Moritz
a35283a0c3 Remove unused code 2021-03-18 20:43:24 +01:00
Marcus Holland-Moritz
e89401291e Fix chunk count in progress 2021-03-18 17:51:47 +01:00
Marcus Holland-Moritz
11589d04f0 Properly document the thrift definitions 2021-03-18 12:34:44 +01:00
Marcus Holland-Moritz
4e09098727 Docs 2021-03-18 11:06:31 +01:00
Marcus Holland-Moritz
35a3a900a7 Fix doc nit 2021-03-18 01:01:24 +01:00
Marcus Holland-Moritz
df2ec0cafa More cleanup 2021-03-18 00:53:25 +01:00
Marcus Holland-Moritz
59d249c1fb Consistent naming 2021-03-18 00:09:49 +01:00
Marcus Holland-Moritz
bfe8e2e4c4 Cleanup 2021-03-17 23:48:13 +01:00
Marcus Holland-Moritz
fc5815e2cc Update folly / fbthrift 2021-03-17 23:41:14 +01:00
Marcus Holland-Moritz
b39d01bd10 Cleanup 2021-03-17 23:41:03 +01:00
Marcus Holland-Moritz
579ac41f58 More testing 2021-03-17 22:52:37 +01:00
Marcus Holland-Moritz
ac5582ad48 Cleanup 2021-03-17 21:04:03 +01:00