Samsung 960 EVO Linux RAID Benchmarks Samsung 960 EVO RAID0 and RAID1 dual drive Btrfs XFS EXT4 F2FS Linux RAID performance benchmarks on 4.16 kernel. Benchmarks by Michael Larabel for a future article on Phoronix.com.
HTML result view exported from: https://openbenchmarking.org/result/1803273-FO-SAMSUNG9663&export=txt&grr&rdt .
Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution Single RAID0 RAID1 RAID0 F2FS EXT4 Btrfs XFS Btrfs Btrfs EXT4 XFS F2FS F2FS XFS EXT4 Intel Core i9-7980XE @ 4.40GHz (18 Cores / 36 Threads) ASUS PRIME X299-A (1004 BIOS) Intel Sky Lake-E DMI3 Registers 4 x 4096 MB DDR4-3200MT/s Corsair CMK16GX4M4C3200C16 256GB INTEL SSDPEKKW256G8 + Samsung SSD 960 EVO 500GB NV136 6144MB Realtek ALC1220 Acer B286HK Intel Connection Ubuntu 18.04 4.16.0-999-generic (x86_64) 20180324 GNOME Shell 3.28.0 X Server 1.19.6 4.3 Mesa 18.0.0-rc5 GCC 7.3.0 f2fs 3840x2160 ext4 btrfs xfs 256GB INTEL SSDPEKKW256G8 + 2 x Samsung SSD 960 EVO 500GB btrfs ext4 xfs f2fs xfs ext4 OpenBenchmarking.org Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details - Single: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr - Single: EXT4: NONE / data=ordered,relatime,rw - Single: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 - Single: XFS: NONE / attr2,inode64,noquota,relatime,rw - RAID0: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0 - RAID1: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1 - RAID1: EXT4: NONE / data=ordered,relatime,rw / raid1 nvme2n1[1] nvme1n1[0] - RAID1: XFS: NONE / attr2,inode64,noquota,relatime,rw / raid1 nvme1n1[0] nvme2n1[1] - RAID1: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid1 nvme1n1[1] nvme2n1[0] - RAID0: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid0 nvme2n1[1] nvme1n1[0] - RAID0: XFS: NONE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=2048 / raid0 nvme2n1[1] nvme1n1[0] - RAID0: EXT4: NONE / data=ordered,relatime,rw,stripe=256 / raid0 nvme2n1[1] nvme1n1[0] Processor Details - Scaling Governor: intel_pstate powersave Python Details - Python 2.7.14+ + Python 3.6.5rc1 Security Details - KPTI + __user pointer sanitization + Full generic retpoline Protection
osbench: Create Files pgbench: Mostly RAM - Normal Load - Read Write pgbench: Mostly RAM - Normal Load - Read Only compress-gzip: Linux Source Tree Archiving To .tar.gz unpack-linux: linux-4.15.tar.xz compilebench: Initial Create compilebench: Compile iozone: 4Kb - 8GB - Write Performance iozone: 1MB - 8GB - Write Performance dbench: 12 blogbench: Write fs-mark: 4000 Files, 32 Sub Dirs, 1MB Size fs-mark: 5000 Files, 1MB Size, 4 Threads fs-mark: 1000 Files, 1MB Size fio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directory fio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directory fio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directory fio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directory sqlite: Timed SQLite Insertions Single RAID0 RAID1 RAID0 F2FS EXT4 Btrfs XFS Btrfs Btrfs EXT4 XFS F2FS F2FS XFS EXT4 20.42 3457.06 112571.02 34.42 5.59 641.50 1309.50 388.04 595.87 136.23 7444 179.75 258.47 295.53 1763 2909 1552 1146 43.24 12.65 5280.73 112451.34 34.96 5.20 638.18 1205.48 670.16 678.26 353.52 27330 104.00 229.80 173.57 1826 2723 1586 1171 45.11 27.11 4303.45 108580.71 34.97 5.74 285.69 1753.94 737.61 729.25 310.90 5401 139.90 222.05 160.83 631 942 505 1146 111.58 35.54 5526.96 93888.75 34.54 6.04 520.23 1399.49 860.45 862.94 333.76 6292 104.43 208.80 184.90 1780 2872 1564 1152 44.05 27.19 3533.85 201194.53 33.99 5.70 328.09 3011.17 1872.37 2179.58 340.84 5337 110.52 446.53 164.90 1581 2176 1551 2159 110.45 27.83 5184.95 204955.62 35.24 5.71 268.37 2007.22 1568.28 1625.99 471.80 5380 108.52 247.07 164.97 712 1105 727 1127 113.25 12.70 3409.42 209072.69 35.87 5.45 627.87 1036.53 535.62 290.98 299.23 14078 46.82 143.33 116.02 612 2802 605 1698 165.92 49.31 5436.99 226603.67 34.26 6.49 518.78 1815.14 1499.26 1085.61 143.93 5316 99.77 214.22 173.73 1821 4548 1570 2305 47.52 21.09 3039.79 216444.71 34.38 5.72 494.11 1265.95 336.53 563.51 123.79 8307 164.03 272.98 282.70 1822 4546 1576 2357 47.55 21.10 5967.51 206821.75 33.61 5.62 706.09 2455.17 1256.90 1354.88 139.93 8643 220.92 416.85 326.50 3598 2321 3349 2319 43.28 44.03 6555.07 218391.41 33.75 6.64 543.81 2973.84 2360.19 2369.79 281.47 2862 191.87 426.57 195.50 3643 5180 3369 2402 45.14 12.54 6254.56 207376.84 34.91 5.37 660.81 2159.13 1311.08 1358.80 374.02 48714 122.98 356.27 177.67 3642 5745 3369 2747 50.90 OpenBenchmarking.org
OSBench Test: Create Files Single RAID0 RAID1 OpenBenchmarking.org us Per Event, Fewer Is Better OSBench Test: Create Files F2FS EXT4 Btrfs XFS 11 22 33 44 55 SE +/- 1.45, N = 6 SE +/- 0.04, N = 3 SE +/- 0.19, N = 3 SE +/- 2.58, N = 6 SE +/- 0.16, N = 3 SE +/- 1.52, N = 6 SE +/- 4.57, N = 6 SE +/- 0.02, N = 3 SE +/- 0.36, N = 3 SE +/- 0.04, N = 3 SE +/- 5.88, N = 6 SE +/- 1.55, N = 6 20.42 12.65 27.11 35.54 27.19 21.10 44.03 12.54 27.83 12.70 49.31 21.09 1. (CC) gcc options:
PostgreSQL pgbench Scaling: Mostly RAM - Test: Normal Load - Mode: Read Write Single RAID0 RAID1 OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 10.3 Scaling: Mostly RAM - Test: Normal Load - Mode: Read Write F2FS EXT4 Btrfs XFS 1400 2800 4200 5600 7000 SE +/- 95.10, N = 4 3457.06 5280.73 4303.45 5526.96 3533.85 5967.51 6555.07 6254.56 5184.95 3409.42 5436.99 3039.79 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
PostgreSQL pgbench Scaling: Mostly RAM - Test: Normal Load - Mode: Read Only Single RAID0 RAID1 OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 10.3 Scaling: Mostly RAM - Test: Normal Load - Mode: Read Only F2FS EXT4 Btrfs XFS 50K 100K 150K 200K 250K SE +/- 62.04, N = 3 112571.02 112451.34 108580.71 93888.75 201194.53 206821.75 218391.41 207376.84 204955.62 209072.69 226603.67 216444.71 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
Gzip Compression Linux Source Tree Archiving To .tar.gz Single RAID0 RAID1 OpenBenchmarking.org Seconds, Fewer Is Better Gzip Compression Linux Source Tree Archiving To .tar.gz F2FS EXT4 Btrfs XFS 8 16 24 32 40 SE +/- 0.50, N = 5 SE +/- 0.09, N = 3 SE +/- 0.47, N = 3 SE +/- 0.12, N = 3 SE +/- 0.47, N = 6 SE +/- 0.41, N = 3 SE +/- 0.53, N = 3 SE +/- 0.12, N = 3 SE +/- 0.58, N = 4 SE +/- 0.54, N = 3 SE +/- 0.51, N = 4 SE +/- 0.53, N = 4 34.42 34.96 34.97 34.54 33.99 33.61 33.75 34.91 35.24 35.87 34.26 34.38
Unpacking The Linux Kernel linux-4.15.tar.xz Single RAID0 RAID1 OpenBenchmarking.org Seconds, Fewer Is Better Unpacking The Linux Kernel linux-4.15.tar.xz F2FS EXT4 Btrfs XFS 2 4 6 8 10 SE +/- 0.04, N = 4 SE +/- 0.01, N = 4 SE +/- 0.03, N = 4 SE +/- 0.15, N = 8 SE +/- 0.05, N = 4 SE +/- 0.04, N = 4 SE +/- 0.15, N = 8 SE +/- 0.07, N = 4 SE +/- 0.04, N = 4 SE +/- 0.01, N = 4 SE +/- 0.16, N = 8 SE +/- 0.02, N = 4 5.59 5.20 5.74 6.04 5.70 5.62 6.64 5.37 5.71 5.45 6.49 5.72
Compile Bench Test: Initial Create Single RAID0 RAID1 OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Initial Create F2FS EXT4 Btrfs XFS 150 300 450 600 750 SE +/- 35.40, N = 3 SE +/- 9.29, N = 3 SE +/- 7.15, N = 3 SE +/- 4.60, N = 3 SE +/- 10.30, N = 3 SE +/- 4.53, N = 3 SE +/- 2.83, N = 3 SE +/- 3.32, N = 3 SE +/- 1.71, N = 3 SE +/- 8.70, N = 3 SE +/- 1.88, N = 3 SE +/- 20.47, N = 3 641.50 638.18 285.69 520.23 328.09 706.09 543.81 660.81 268.37 627.87 518.78 494.11
Compile Bench Test: Compile Single RAID0 RAID1 OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Compile F2FS EXT4 Btrfs XFS 600 1200 1800 2400 3000 SE +/- 16.67, N = 3 SE +/- 57.92, N = 6 SE +/- 55.85, N = 6 SE +/- 50.02, N = 6 SE +/- 44.00, N = 3 SE +/- 210.26, N = 6 SE +/- 95.92, N = 6 SE +/- 61.58, N = 6 SE +/- 134.93, N = 6 SE +/- 70.69, N = 6 SE +/- 120.63, N = 6 SE +/- 16.55, N = 3 1309.50 1205.48 1753.94 1399.49 3011.17 2455.17 2973.84 2159.13 2007.22 1036.53 1815.14 1265.95
IOzone Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance Single RAID0 RAID1 OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance F2FS EXT4 Btrfs XFS 500 1000 1500 2000 2500 SE +/- 75.22, N = 6 SE +/- 41.99, N = 6 SE +/- 44.62, N = 6 SE +/- 4.43, N = 3 SE +/- 5.51, N = 3 SE +/- 87.51, N = 6 SE +/- 36.42, N = 3 SE +/- 101.51, N = 6 SE +/- 8.75, N = 3 SE +/- 23.19, N = 6 SE +/- 15.99, N = 3 SE +/- 52.07, N = 6 388.04 670.16 737.61 860.45 1872.37 1256.90 2360.19 1311.08 1568.28 535.62 1499.26 336.53 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance Single RAID0 RAID1 OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance F2FS EXT4 Btrfs XFS 500 1000 1500 2000 2500 SE +/- 44.79, N = 6 SE +/- 42.34, N = 6 SE +/- 33.51, N = 6 SE +/- 8.56, N = 3 SE +/- 391.13, N = 6 SE +/- 177.96, N = 6 SE +/- 192.93, N = 6 SE +/- 137.83, N = 6 SE +/- 14.72, N = 3 SE +/- 68.00, N = 6 SE +/- 214.99, N = 6 SE +/- 66.37, N = 6 595.87 678.26 729.25 862.94 2179.58 1354.88 2369.79 1358.80 1625.99 290.98 1085.61 563.51 1. (CC) gcc options: -O3
Dbench Client Count: 12 Single RAID0 RAID1 OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 Client Count: 12 F2FS EXT4 Btrfs XFS 100 200 300 400 500 SE +/- 0.74, N = 3 SE +/- 3.12, N = 3 SE +/- 2.88, N = 3 SE +/- 21.09, N = 6 SE +/- 1.94, N = 3 SE +/- 0.09, N = 3 SE +/- 13.23, N = 6 SE +/- 3.95, N = 3 SE +/- 1.17, N = 3 SE +/- 1.44, N = 3 SE +/- 4.17, N = 6 SE +/- 1.17, N = 3 136.23 353.52 310.90 333.76 340.84 139.93 281.47 374.02 471.80 299.23 143.93 123.79 1. (CC) gcc options: -lpopt -O2
BlogBench Test: Write Single RAID0 RAID1 OpenBenchmarking.org Final Score, More Is Better BlogBench 1.0 Test: Write F2FS EXT4 Btrfs XFS 10K 20K 30K 40K 50K SE +/- 709.05, N = 6 SE +/- 1288.79, N = 6 SE +/- 12.41, N = 3 SE +/- 31.78, N = 3 SE +/- 37.47, N = 3 SE +/- 133.68, N = 4 SE +/- 306.61, N = 6 SE +/- 262.80, N = 3 SE +/- 46.46, N = 3 SE +/- 184.39, N = 3 SE +/- 90.65, N = 3 SE +/- 690.66, N = 6 7444 27330 5401 6292 5337 8643 2862 48714 5380 14078 5316 8307 1. (CC) gcc options: -O2 -pthread
FS-Mark Test: 4000 Files, 32 Sub Dirs, 1MB Size Single RAID0 RAID1 OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size F2FS EXT4 Btrfs XFS 50 100 150 200 250 SE +/- 16.19, N = 6 SE +/- 8.87, N = 6 SE +/- 6.90, N = 6 SE +/- 7.34, N = 6 SE +/- 11.85, N = 6 SE +/- 28.10, N = 6 SE +/- 0.54, N = 3 SE +/- 12.91, N = 6 SE +/- 8.51, N = 6 SE +/- 6.58, N = 6 SE +/- 7.22, N = 6 SE +/- 15.78, N = 6 179.75 104.00 139.90 104.43 110.52 220.92 191.87 122.98 108.52 46.82 99.77 164.03 1. (CC) gcc options: -static
FS-Mark Test: 5000 Files, 1MB Size, 4 Threads Single RAID0 RAID1 OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads F2FS EXT4 Btrfs XFS 100 200 300 400 500 SE +/- 17.62, N = 6 SE +/- 22.41, N = 6 SE +/- 13.06, N = 6 SE +/- 8.47, N = 6 SE +/- 62.72, N = 6 SE +/- 84.68, N = 6 SE +/- 3.54, N = 3 SE +/- 64.94, N = 6 SE +/- 35.15, N = 6 SE +/- 1.75, N = 3 SE +/- 27.22, N = 6 SE +/- 57.28, N = 6 258.47 229.80 222.05 208.80 446.53 416.85 426.57 356.27 247.07 143.33 214.22 272.98 1. (CC) gcc options: -static
FS-Mark Test: 1000 Files, 1MB Size Single RAID0 RAID1 OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 1MB Size F2FS EXT4 Btrfs XFS 70 140 210 280 350 SE +/- 0.53, N = 3 SE +/- 1.62, N = 3 SE +/- 0.52, N = 3 SE +/- 0.38, N = 3 SE +/- 2.30, N = 3 SE +/- 1.77, N = 3 SE +/- 1.25, N = 3 SE +/- 1.59, N = 3 SE +/- 0.19, N = 3 SE +/- 15.94, N = 6 SE +/- 0.63, N = 3 SE +/- 0.95, N = 3 295.53 173.57 160.83 184.90 164.90 326.50 195.50 177.67 164.97 116.02 173.73 282.70 1. (CC) gcc options: -static
Flexible IO Tester Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Single RAID0 RAID1 OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory F2FS EXT4 Btrfs XFS 800 1600 2400 3200 4000 SE +/- 1.86, N = 3 SE +/- 0.58, N = 3 SE +/- 7.51, N = 3 SE +/- 1.20, N = 3 SE +/- 226.33, N = 6 SE +/- 2.91, N = 3 SE +/- 1.20, N = 3 SE +/- 3.06, N = 3 SE +/- 93.04, N = 6 SE +/- 5.17, N = 3 SE +/- 0.67, N = 3 SE +/- 0.88, N = 3 1763 1826 631 1780 1581 3598 3643 3642 712 612 1821 1822 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
Flexible IO Tester Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Single RAID0 RAID1 OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory F2FS EXT4 Btrfs XFS 1200 2400 3600 4800 6000 SE +/- 0.67, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 SE +/- 1.76, N = 3 SE +/- 1.15, N = 3 SE +/- 0.33, N = 3 SE +/- 7.69, N = 3 2909 2723 942 2872 2176 2321 5180 5745 1105 2802 4548 4546 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
Flexible IO Tester Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Single RAID0 RAID1 OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory F2FS EXT4 Btrfs XFS 700 1400 2100 2800 3500 SE +/- 0.88, N = 3 SE +/- 3.71, N = 3 SE +/- 59.31, N = 6 SE +/- 4.04, N = 3 SE +/- 178.74, N = 6 SE +/- 0.88, N = 3 SE +/- 2.08, N = 3 SE +/- 1.45, N = 3 SE +/- 88.05, N = 6 SE +/- 1.15, N = 3 SE +/- 1.67, N = 3 SE +/- 3.53, N = 3 1552 1586 505 1564 1551 3349 3369 3369 727 605 1570 1576 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
Flexible IO Tester Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Single RAID0 RAID1 OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory F2FS EXT4 Btrfs XFS 600 1200 1800 2400 3000 SE +/- 0.33, N = 3 SE +/- 291.88, N = 6 SE +/- 2.31, N = 3 SE +/- 10.87, N = 3 1146 1171 1146 1152 2159 2319 2402 2747 1127 1698 2305 2357 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl
SQLite Timed SQLite Insertions Single RAID0 RAID1 OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.22 Timed SQLite Insertions F2FS EXT4 Btrfs XFS 40 80 120 160 200 SE +/- 0.04, N = 3 SE +/- 0.24, N = 3 SE +/- 0.30, N = 3 SE +/- 0.25, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.12, N = 3 SE +/- 0.77, N = 3 SE +/- 0.05, N = 3 SE +/- 0.26, N = 3 SE +/- 0.08, N = 3 SE +/- 0.36, N = 3 43.24 45.11 111.58 44.05 110.45 43.28 45.14 50.90 113.25 165.92 47.52 47.55 1. (CC) gcc options: -O2 -ldl -lpthread
Phoronix Test Suite v10.8.5