591 Commits

Author SHA1 Message Date
Marcus Holland-Moritz
6c5986307c Update README 2021-03-13 16:13:49 +01:00
Marcus Holland-Moritz
5b0142a45b Re-enable .tar.bz2 packages 2021-03-13 15:51:20 +01:00
Marcus Holland-Moritz
bc2007a240 Update change log v0.4.1 2021-03-13 15:27:36 +01:00
Marcus Holland-Moritz
ef7d342f3d Catch system_error in mkdwarfs 2021-03-13 15:24:30 +01:00
Marcus Holland-Moritz
60003f7c48 Update static linking script to fix exception handling 2021-03-13 15:23:07 +01:00
Marcus Holland-Moritz
2e2e9bdd9c Only generate .tar.gz for now 2021-03-13 13:36:49 +01:00
Marcus Holland-Moritz
632028a75a Update README 2021-03-13 13:25:52 +01:00
Marcus Holland-Moritz
8138e45922 Update change log 2021-03-13 12:32:43 +01:00
Marcus Holland-Moritz
4f93d37f1d Update README 2021-03-13 12:32:12 +01:00
Marcus Holland-Moritz
4d5df018b8 Update mkdwarfs docs 2021-03-13 12:31:44 +01:00
Marcus Holland-Moritz
142bd999dc More nilsimsa optimizations 2021-03-10 00:18:50 +01:00
Marcus Holland-Moritz
c06bc5e8b5 clang-format 2021-03-09 17:24:10 +01:00
Marcus Holland-Moritz
22d41effa6 Enable multiversioned nilsimsa similarity computation
This significantly improves inode ordering speed. Overall inode
ordering is about twice as fast as before.

    32.88%  mkdwarfs-origin  mkdwarfs-original    [.] dwarfs::nilsimsa::similarity
    18.51%  mkdwarfs-origin  mkdwarfs-original    [.] dwarfs::inode_manager_<dwarfs::prod_logger_policy>::order_inodes_by_nilsimsa
     4.07%  blockify1        mkdwarfs-original    [.] dwarfs::block_manager_<dwarfs::prod_logger_policy>::segment_and_add_data
     3.31%  mkdwarfs-origin  mkdwarfs-original    [.] dwarfs::(anonymous namespace)::inode_::nilsimsa_similarity_hash
     2.91%  blockify1        mkdwarfs-original    [.] dwarfs::active_block::append
     2.65%  writer           libcrypto.so.1.1     [.] sha512_block_data_order_avx2

    24.19%  mkdwarfs-nilsim  mkdwarfs-nilsimsa    [.] dwarfs::nilsimsa::similarity
    11.27%  mkdwarfs-nilsim  mkdwarfs-nilsimsa    [.] dwarfs::inode_manager_<dwarfs::prod_logger_policy>::order_inodes_by_nilsimsa
     5.42%  blockify1        mkdwarfs-nilsimsa    [.] dwarfs::block_manager_<dwarfs::prod_logger_policy>::segment_and_add_data
     4.18%  mkdwarfs-nilsim  mkdwarfs-nilsimsa    [.] dwarfs::(anonymous namespace)::inode_::nilsimsa_similarity_hash
     3.84%  blockify1        mkdwarfs-nilsimsa    [.] dwarfs::active_block::append
     3.47%  writer           libcrypto.so.1.1     [.] sha512_block_data_order_avx2
2021-03-09 17:23:56 +01:00
Marcus Holland-Moritz
ef06b6749e Use -O2 for gcc by default (fixes github #14) 2021-03-09 12:07:00 +01:00
Marcus Holland-Moritz
86323a0623 Remove old code 2021-03-08 21:18:40 +01:00
Marcus Holland-Moritz
ebe92f9540 Fix window size initialization and div-by-zero 2021-03-08 18:19:49 +01:00
Marcus Holland-Moritz
3a78ab9ce4 Add bloom filter to speed up block manager 2021-03-08 17:51:34 +01:00
Marcus Holland-Moritz
35ea333f85 Fix linking against libarchive 2021-03-08 16:16:20 +01:00
Marcus Holland-Moritz
430801a425 Fix a comment 2021-03-07 15:13:12 +01:00
Marcus Holland-Moritz
50afe97f55 Add missing words 2021-03-07 11:42:35 +01:00
Marcus Holland-Moritz
4cfe2ac205 Update README, add zpaq comparison 2021-03-07 11:40:35 +01:00
Marcus Holland-Moritz
c9c40225e8 Remove clang-format leftover comment 2021-03-07 11:27:24 +01:00
Marcus Holland-Moritz
5b2186463e Add comparison with lrzip and update wimlib comparison 2021-03-07 01:38:35 +01:00
Marcus Holland-Moritz
9d57191386 Update static linking script v0.4.0 2021-03-06 18:37:36 +01:00
Marcus Holland-Moritz
15ed145465 Update change log 2021-03-06 18:14:49 +01:00
Marcus Holland-Moritz
27edc52d95 More cleanups 2021-03-06 16:17:43 +01:00
Marcus Holland-Moritz
a31b0ea208 Explicit ctors 2021-03-06 16:05:28 +01:00
Marcus Holland-Moritz
159d092c01 More cleaning up 2021-03-06 15:06:03 +01:00
Marcus Holland-Moritz
d1730a8d49 More cleaning up 2021-03-06 15:02:51 +01:00
Marcus Holland-Moritz
60a31dc346 Add default case in switch 2021-03-06 14:48:00 +01:00
Marcus Holland-Moritz
a9b7bf35b1 Use string_view in mapping 2021-03-06 14:47:47 +01:00
Marcus Holland-Moritz
54b4d8494a Cleanup some more 2021-03-06 14:40:13 +01:00
Marcus Holland-Moritz
db181acba7 Fix some clang-tidy issues 2021-03-06 14:39:57 +01:00
Marcus Holland-Moritz
1f20b02b68 Finalize classes 2021-03-06 14:39:38 +01:00
Marcus Holland-Moritz
06f0d3ff07 Create filesystem_extractor class 2021-03-06 12:32:56 +01:00
Marcus Holland-Moritz
77a409f97a Remove hash_util.h 2021-03-06 08:58:31 +01:00
Marcus Holland-Moritz
e31bb921c4 Fix data race in cached_block 2021-03-06 08:54:35 +01:00
Marcus Holland-Moritz
fa24c37770 Remove explicit template arguments for lock objects 2021-03-06 00:04:55 +01:00
Marcus Holland-Moritz
d6d87b24a2 Name the semaphore more appropriately 2021-03-06 00:04:01 +01:00
Marcus Holland-Moritz
2f18ba0e13 Update README 2021-03-05 23:54:39 +01:00
Marcus Holland-Moritz
fb38539c69 Some dwarfsextract tweaks
- Make sure we don't block if file size is larger than cache size
- Increase default cache size just a bit
- Tweak initial semaphore value to avoid early cache evictions
2021-03-05 23:54:29 +01:00
Marcus Holland-Moritz
30a3d2faad Add timing for entry ordering in walk_inode_order 2021-03-05 23:52:10 +01:00
Marcus Holland-Moritz
c596629d05 Silence block cache debug output a bit 2021-03-05 23:51:11 +01:00
Marcus Holland-Moritz
5d704db42a Update dwarfsextract man page 2021-03-05 23:00:39 +01:00
Marcus Holland-Moritz
24f6d3b638 Update README 2021-03-05 22:44:35 +01:00
Marcus Holland-Moritz
1c080920d0 Use asynchronous filesystem access to speed up extraction 2021-03-05 22:44:03 +01:00
Marcus Holland-Moritz
12b949525d Add asynchronous readv method for filesystem_v2 2021-03-05 22:42:45 +01:00
Marcus Holland-Moritz
5c13287c1a Update README 2021-03-05 15:51:18 +01:00
Marcus Holland-Moritz
28f10ece29 Update README 2021-03-05 12:52:52 +01:00
Marcus Holland-Moritz
3b602dec21 Fix pop from empty queue 2021-03-05 12:44:01 +01:00