TheCloud/dwarfs
1
0
Fork 0
mirror of https://github.com/mhx/dwarfs.git synced 2025-08-03 17:56:12 -04:00
Code Issues Packages Projects Releases Wiki Activity

Update benchmark

Browse Source
This commit is contained in:
Marcus Holland-Moritz 2020-12-30 12:48:28 +01:00
parent ee83786189
commit df779a5cfd
1 changed files with 31 additions and 31 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

62
README.md
View File

@ -336,45 +336,45 @@ SquashFS that is the default setting for DwarFS:
For DwarFS, I'm sticking to the defaults: For DwarFS, I'm sticking to the defaults:
$ time mkdwarfs -i install -o perl-install.dwarfs $ time mkdwarfs -i install -o perl-install.dwarfs
18:06:32.393073 scanning install I 23:54:10.119098 scanning install
18:06:50.157744 waiting for background scanners... I 23:54:32.317096 waiting for background scanners...
18:07:24.659010 assigning directory and link inodes... I 23:55:04.131755 assigning directory and link inodes...
18:07:25.056728 finding duplicate files... I 23:55:04.457824 finding duplicate files...
18:07:41.914170 saved 28.2 GiB / 47.65 GiB in 1782826/1927501 duplicate files I 23:55:22.041760 saved 28.2 GiB / 47.65 GiB in 1782826/1927501 duplicate files
18:07:41.914243 waiting for inode scanners... I 23:55:22.041862 waiting for inode scanners...
18:08:16.065580 assigning device inodes... I 23:55:55.365591 assigning device inodes...
18:08:16.126759 assigning pipe/socket inodes... I 23:55:55.423564 assigning pipe/socket inodes...
18:08:16.185546 building metadata... I 23:55:55.479380 building metadata...
18:08:16.185628 building blocks... I 23:55:55.479468 building blocks...
18:08:16.185730 saving names and links... I 23:55:55.479538 saving names and links...
18:08:16.186987 ordering 144675 inodes using nilsimsa similarity... I 23:55:55.479615 ordering 144675 inodes using nilsimsa similarity...
18:08:16.196982 nilsimsa: depth=20000, limit=255 I 23:55:55.488995 nilsimsa: depth=20000 (1000), limit=255
18:08:16.665114 updating name and link indices... I 23:55:55.928990 updating name and link indices...
18:08:17.134243 pre-sorted index (1016186 name, 639519 path lookups) [937.2ms] I 23:55:56.186375 pre-sorted index (659296 name, 366624 path lookups) [697.3ms]
18:15:49.332792 144675 inodes ordered [453.1s] I 00:02:11.239104 144675 inodes ordered [375.8s]
18:15:49.332890 waiting for segmenting/blockifying to finish... I 00:02:11.239224 waiting for segmenting/blockifying to finish...
18:19:33.746355 saving chunks... I 00:06:45.599953 saving chunks...
18:19:33.779313 saving directories... I 00:06:45.639297 saving directories...
18:19:38.284634 waiting for compression to finish... I 00:06:49.937160 waiting for compression to finish...
18:20:47.316245 compressed 47.65 GiB to 471.7 MiB (ratio=0.00966738) I 00:08:07.873055 compressed 47.65 GiB to 471.6 MiB (ratio=0.0096655)
18:20:48.027411 filesystem created without errors [855.6s] I 00:08:08.512030 filesystem created without errors [838.4s]
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
waiting for block compression to finish waiting for block compression to finish
330733 dirs, 0/2440 soft/hard links, 1927501/1927501 files, 0 other 330733 dirs, 0/2440 soft/hard links, 1927501/1927501 files, 0 other
original size: 47.65 GiB, dedupe: 28.2 GiB (1782826 files), segment: 12.62 GiB original size: 47.65 GiB, dedupe: 28.2 GiB (1782826 files), segment: 12.6 GiB
filesystem: 6.832 GiB in 438 blocks (477878 chunks, 144675/144675 inodes) filesystem: 6.846 GiB in 439 blocks (471482 chunks, 144675/144675 inodes)
compressed filesystem: 438 blocks/471.7 MiB written compressed filesystem: 439 blocks/471.6 MiB written [depth: 20000]
███████████████████████████████████████████████████████████████████████▏100% / ████████████████████████████████████████████████████████████████████████▏100% \
real 14m15.783s real 13m58.556s
user 133m57.608s user 135m40.567s
sys 2m52.546s sys 2m59.853s
So in this comparison, `mkdwarfs` is almost 5 times faster than `mksquashfs`. So in this comparison, `mkdwarfs` is almost 5 times faster than `mksquashfs`.
In total CPU time, it actually uses 6 times less CPU resources. In total CPU time, it actually uses 6 times less CPU resources.
$ ls -l perl-install.*fs $ ls -l perl-install.*fs
-rw-r--r-- 1 mhx users 494602224 Dec 10 18:20 perl-install.dwarfs -rw-r--r-- 1 mhx users 494505722 Dec 30 00:22 perl-install.dwarfs
-rw-r--r-- 1 mhx users 4748902400 Nov 25 00:37 perl-install.squashfs -rw-r--r-- 1 mhx users 4748902400 Nov 25 00:37 perl-install.squashfs
In terms of compression ratio, the **DwarFS file system is almost 10 times In terms of compression ratio, the **DwarFS file system is almost 10 times