Marcus Holland-Moritz
44dc446849
Optimize
2021-03-17 20:48:01 +01:00
Marcus Holland-Moritz
718e7050f7
Optimize more
2021-03-17 20:48:01 +01:00
Marcus Holland-Moritz
aa323d2ed6
Renaming
2021-03-17 20:48:01 +01:00
Marcus Holland-Moritz
daecc748db
Optimize files table
2021-03-17 20:48:01 +01:00
Marcus Holland-Moritz
ad51853c82
Re-enable checks, fix comments
2021-03-17 20:48:01 +01:00
Marcus Holland-Moritz
5ac501467a
Rename walk_inode_order to walk_data_order
...
We want to walk the file system in the order in which file data is
stored. This used to be inode order, but it's not anymore, so let's
name the function appropriately and fix the implementation.
2021-03-17 20:48:01 +01:00
Marcus Holland-Moritz
10b1ea9e31
More debug info
2021-03-17 20:48:01 +01:00
Marcus Holland-Moritz
69bb8bf1b9
Fix hardlink extraction, use safe extraction options
2021-03-17 20:48:01 +01:00
Marcus Holland-Moritz
5726ee708f
Cleanup
2021-03-17 20:48:01 +01:00
Marcus Holland-Moritz
5cc2023a45
Fix parent entry index
2021-03-17 20:48:01 +01:00
Marcus Holland-Moritz
85981ff794
Fix extractor
2021-03-17 20:48:01 +01:00
Marcus Holland-Moritz
9727d56be8
Test statvfs
2021-03-17 20:48:01 +01:00
Marcus Holland-Moritz
4563256651
Fix inode count in statvfs
2021-03-17 20:48:01 +01:00
Marcus Holland-Moritz
7904d2f0ca
More accurate filesystem size
2021-03-17 20:48:01 +01:00
Marcus Holland-Moritz
ad48cae7b1
Unique files table, deprecate inode_v2_2, some cleanup
2021-03-17 20:48:01 +01:00
Marcus Holland-Moritz
d507ade9d1
Initial implementation of metadata format v2.3
2021-03-17 20:48:01 +01:00
Marcus Holland-Moritz
282fc33ca3
Add file system format documentation
2021-03-17 20:47:42 +01:00
Marcus Holland-Moritz
6ef5361fc5
Improve test coverage
2021-03-16 13:06:09 +01:00
Marcus Holland-Moritz
44b135f548
Don't access devices if not present
2021-03-16 13:06:00 +01:00
Marcus Holland-Moritz
7a5350c36d
Cleanup
2021-03-15 11:32:52 +01:00
Marcus Holland-Moritz
2877d55db1
Clean up block manager code
2021-03-15 10:34:23 +01:00
Marcus Holland-Moritz
3ed20dcac3
Only output block manager stats when they're meaningful
2021-03-15 10:28:48 +01:00
Marcus Holland-Moritz
18520de172
Working towards new metadata format
2021-03-15 10:19:09 +01:00
Marcus Holland-Moritz
fe5eb38741
Add ENABLE_COVERAGE cmake option
2021-03-15 09:26:33 +01:00
Marcus Holland-Moritz
3608072836
More naming cleanups
2021-03-14 20:52:22 +01:00
Marcus Holland-Moritz
93e7ba7e09
Emit more metadata details in dwarfsck
2021-03-14 10:06:01 +01:00
Marcus Holland-Moritz
a00d3dd863
More naming cleanup
2021-03-14 10:05:31 +01:00
Marcus Holland-Moritz
514b644358
Be more explicit about naming symlinks
2021-03-13 18:04:01 +01:00
Marcus Holland-Moritz
579dc1a556
Disable multiversioning on non-x86 platforms (part 3)
2021-03-13 17:24:48 +01:00
Marcus Holland-Moritz
de6dbb5955
Disable multiversioning on non-x86 platforms (part 2)
2021-03-13 17:22:55 +01:00
Marcus Holland-Moritz
eddce26ac4
Disable multiversioning on non-x86 platforms
2021-03-13 17:20:30 +01:00
Marcus Holland-Moritz
c57a0a67ce
Remove .tar.bz2 packages again
2021-03-13 16:16:52 +01:00
Marcus Holland-Moritz
6c5986307c
Update README
2021-03-13 16:13:49 +01:00
Marcus Holland-Moritz
5b0142a45b
Re-enable .tar.bz2 packages
2021-03-13 15:51:20 +01:00
Marcus Holland-Moritz
bc2007a240
Update change log
2021-03-13 15:27:36 +01:00
Marcus Holland-Moritz
ef7d342f3d
Catch system_error in mkdwarfs
2021-03-13 15:24:30 +01:00
Marcus Holland-Moritz
60003f7c48
Update static linking script to fix exception handling
2021-03-13 15:23:07 +01:00
Marcus Holland-Moritz
2e2e9bdd9c
Only generate .tar.gz for now
2021-03-13 13:36:49 +01:00
Marcus Holland-Moritz
632028a75a
Update README
2021-03-13 13:25:52 +01:00
Marcus Holland-Moritz
8138e45922
Update change log
2021-03-13 12:32:43 +01:00
Marcus Holland-Moritz
4f93d37f1d
Update README
2021-03-13 12:32:12 +01:00
Marcus Holland-Moritz
4d5df018b8
Update mkdwarfs docs
2021-03-13 12:31:44 +01:00
Marcus Holland-Moritz
142bd999dc
More nilsimsa optimizations
2021-03-10 00:18:50 +01:00
Marcus Holland-Moritz
c06bc5e8b5
clang-format
2021-03-09 17:24:10 +01:00
Marcus Holland-Moritz
22d41effa6
Enable multiversioned nilsimsa similarity computation
...
This significantly improves inode ordering speed. Overall inode
ordering is about twice as fast as before.
32.88% mkdwarfs-origin mkdwarfs-original [.] dwarfs::nilsimsa::similarity
18.51% mkdwarfs-origin mkdwarfs-original [.] dwarfs::inode_manager_<dwarfs::prod_logger_policy>::order_inodes_by_nilsimsa
4.07% blockify1 mkdwarfs-original [.] dwarfs::block_manager_<dwarfs::prod_logger_policy>::segment_and_add_data
3.31% mkdwarfs-origin mkdwarfs-original [.] dwarfs::(anonymous namespace)::inode_::nilsimsa_similarity_hash
2.91% blockify1 mkdwarfs-original [.] dwarfs::active_block::append
2.65% writer libcrypto.so.1.1 [.] sha512_block_data_order_avx2
24.19% mkdwarfs-nilsim mkdwarfs-nilsimsa [.] dwarfs::nilsimsa::similarity
11.27% mkdwarfs-nilsim mkdwarfs-nilsimsa [.] dwarfs::inode_manager_<dwarfs::prod_logger_policy>::order_inodes_by_nilsimsa
5.42% blockify1 mkdwarfs-nilsimsa [.] dwarfs::block_manager_<dwarfs::prod_logger_policy>::segment_and_add_data
4.18% mkdwarfs-nilsim mkdwarfs-nilsimsa [.] dwarfs::(anonymous namespace)::inode_::nilsimsa_similarity_hash
3.84% blockify1 mkdwarfs-nilsimsa [.] dwarfs::active_block::append
3.47% writer libcrypto.so.1.1 [.] sha512_block_data_order_avx2
2021-03-09 17:23:56 +01:00
Marcus Holland-Moritz
ef06b6749e
Use -O2 for gcc by default (fixes github #14 )
2021-03-09 12:07:00 +01:00
Marcus Holland-Moritz
86323a0623
Remove old code
2021-03-08 21:18:40 +01:00
Marcus Holland-Moritz
ebe92f9540
Fix window size initialization and div-by-zero
2021-03-08 18:19:49 +01:00
Marcus Holland-Moritz
3a78ab9ce4
Add bloom filter to speed up block manager
2021-03-08 17:51:34 +01:00
Marcus Holland-Moritz
35ea333f85
Fix linking against libarchive
2021-03-08 16:16:20 +01:00
