From df779a5cfd74805e1b37cbb3b56979cc55f7b84a Mon Sep 17 00:00:00 2001 From: Marcus Holland-Moritz Date: Wed, 30 Dec 2020 12:48:28 +0100 Subject: [PATCH] Update benchmark --- README.md | 62 +++++++++++++++++++++++++++---------------------------- 1 file changed, 31 insertions(+), 31 deletions(-) diff --git a/README.md b/README.md index 42889f54..3e2decbe 100644 --- a/README.md +++ b/README.md @@ -336,45 +336,45 @@ SquashFS that is the default setting for DwarFS: For DwarFS, I'm sticking to the defaults: $ time mkdwarfs -i install -o perl-install.dwarfs - 18:06:32.393073 scanning install - 18:06:50.157744 waiting for background scanners... - 18:07:24.659010 assigning directory and link inodes... - 18:07:25.056728 finding duplicate files... - 18:07:41.914170 saved 28.2 GiB / 47.65 GiB in 1782826/1927501 duplicate files - 18:07:41.914243 waiting for inode scanners... - 18:08:16.065580 assigning device inodes... - 18:08:16.126759 assigning pipe/socket inodes... - 18:08:16.185546 building metadata... - 18:08:16.185628 building blocks... - 18:08:16.185730 saving names and links... - 18:08:16.186987 ordering 144675 inodes using nilsimsa similarity... - 18:08:16.196982 nilsimsa: depth=20000, limit=255 - 18:08:16.665114 updating name and link indices... - 18:08:17.134243 pre-sorted index (1016186 name, 639519 path lookups) [937.2ms] - 18:15:49.332792 144675 inodes ordered [453.1s] - 18:15:49.332890 waiting for segmenting/blockifying to finish... - 18:19:33.746355 saving chunks... - 18:19:33.779313 saving directories... - 18:19:38.284634 waiting for compression to finish... - 18:20:47.316245 compressed 47.65 GiB to 471.7 MiB (ratio=0.00966738) - 18:20:48.027411 filesystem created without errors [855.6s] - ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ + I 23:54:10.119098 scanning install + I 23:54:32.317096 waiting for background scanners... + I 23:55:04.131755 assigning directory and link inodes... + I 23:55:04.457824 finding duplicate files... + I 23:55:22.041760 saved 28.2 GiB / 47.65 GiB in 1782826/1927501 duplicate files + I 23:55:22.041862 waiting for inode scanners... + I 23:55:55.365591 assigning device inodes... + I 23:55:55.423564 assigning pipe/socket inodes... + I 23:55:55.479380 building metadata... + I 23:55:55.479468 building blocks... + I 23:55:55.479538 saving names and links... + I 23:55:55.479615 ordering 144675 inodes using nilsimsa similarity... + I 23:55:55.488995 nilsimsa: depth=20000 (1000), limit=255 + I 23:55:55.928990 updating name and link indices... + I 23:55:56.186375 pre-sorted index (659296 name, 366624 path lookups) [697.3ms] + I 00:02:11.239104 144675 inodes ordered [375.8s] + I 00:02:11.239224 waiting for segmenting/blockifying to finish... + I 00:06:45.599953 saving chunks... + I 00:06:45.639297 saving directories... + I 00:06:49.937160 waiting for compression to finish... + I 00:08:07.873055 compressed 47.65 GiB to 471.6 MiB (ratio=0.0096655) + I 00:08:08.512030 filesystem created without errors [838.4s] + ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ waiting for block compression to finish 330733 dirs, 0/2440 soft/hard links, 1927501/1927501 files, 0 other - original size: 47.65 GiB, dedupe: 28.2 GiB (1782826 files), segment: 12.62 GiB - filesystem: 6.832 GiB in 438 blocks (477878 chunks, 144675/144675 inodes) - compressed filesystem: 438 blocks/471.7 MiB written - ███████████████████████████████████████████████████████████████████████▏100% / + original size: 47.65 GiB, dedupe: 28.2 GiB (1782826 files), segment: 12.6 GiB + filesystem: 6.846 GiB in 439 blocks (471482 chunks, 144675/144675 inodes) + compressed filesystem: 439 blocks/471.6 MiB written [depth: 20000] + ████████████████████████████████████████████████████████████████████████▏100% \ - real 14m15.783s - user 133m57.608s - sys 2m52.546s + real 13m58.556s + user 135m40.567s + sys 2m59.853s So in this comparison, `mkdwarfs` is almost 5 times faster than `mksquashfs`. In total CPU time, it actually uses 6 times less CPU resources. $ ls -l perl-install.*fs - -rw-r--r-- 1 mhx users 494602224 Dec 10 18:20 perl-install.dwarfs + -rw-r--r-- 1 mhx users 494505722 Dec 30 00:22 perl-install.dwarfs -rw-r--r-- 1 mhx users 4748902400 Nov 25 00:37 perl-install.squashfs In terms of compression ratio, the **DwarFS file system is almost 10 times