Samsung 960 EVO Linux RAID Benchmarks

Samsung 960 EVO RAID0 and RAID1 dual drive Btrfs XFS EXT4 F2FS Linux RAID performance benchmarks on 4.16 kernel. Benchmarks by Michael Larabel for a future article on Phoronix.com.

HTML result view exported from: https://openbenchmarking.org/result/1803273-FO-SAMSUNG9663&grr&rdt.

ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionSingleRAID0RAID1RAID0 F2FS EXT4 Btrfs XFS Btrfs Btrfs EXT4 XFS F2FS F2FS XFS EXT4Intel Core i9-7980XE @ 4.40GHz (18 Cores / 36 Threads)ASUS PRIME X299-A (1004 BIOS)Intel Sky Lake-E DMI3 Registers4 x 4096 MB DDR4-3200MT/s Corsair CMK16GX4M4C3200C16256GB INTEL SSDPEKKW256G8 + Samsung SSD 960 EVO 500GBNV136 6144MBRealtek ALC1220Acer B286HKIntel ConnectionUbuntu 18.044.16.0-999-generic (x86_64) 20180324GNOME Shell 3.28.0X Server 1.19.64.3 Mesa 18.0.0-rc5GCC 7.3.0f2fs3840x2160ext4btrfsxfs256GB INTEL SSDPEKKW256G8 + 2 x Samsung SSD 960 EVO 500GBbtrfsext4xfsf2fsxfsext4OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- Single: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr- Single: EXT4: NONE / data=ordered,relatime,rw- Single: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- Single: XFS: NONE / attr2,inode64,noquota,relatime,rw- RAID0: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- RAID1: Btrfs: NONE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- RAID1: EXT4: NONE / data=ordered,relatime,rw / raid1 nvme2n1[1] nvme1n1[0]- RAID1: XFS: NONE / attr2,inode64,noquota,relatime,rw / raid1 nvme1n1[0] nvme2n1[1]- RAID1: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid1 nvme1n1[1] nvme2n1[0] - RAID0: F2FS: NONE / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr / raid0 nvme2n1[1] nvme1n1[0] - RAID0: XFS: NONE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=2048 / raid0 nvme2n1[1] nvme1n1[0]- RAID0: EXT4: NONE / data=ordered,relatime,rw,stripe=256 / raid0 nvme2n1[1] nvme1n1[0]Processor Details- Scaling Governor: intel_pstate powersavePython Details- Python 2.7.14+ + Python 3.6.5rc1Security Details- KPTI + __user pointer sanitization + Full generic retpoline Protection

osbench: Create Filespgbench: Mostly RAM - Normal Load - Read Writepgbench: Mostly RAM - Normal Load - Read Onlycompress-gzip: Linux Source Tree Archiving To .tar.gzunpack-linux: linux-4.15.tar.xzcompilebench: Initial Createcompilebench: Compileiozone: 4Kb - 8GB - Write Performanceiozone: 1MB - 8GB - Write Performancedbench: 12blogbench: Writefs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 1000 Files, 1MB Sizefio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directorysqlite: Timed SQLite InsertionsSingleRAID0RAID1RAID0 F2FS EXT4 Btrfs XFS Btrfs Btrfs EXT4 XFS F2FS F2FS XFS EXT420.423457.06112571.0234.425.59641.501309.50388.04595.87136.237444179.75258.47295.53176329091552114643.2412.655280.73112451.3434.965.20638.181205.48670.16678.26353.5227330104.00229.80173.57182627231586117145.1127.114303.45108580.7134.975.74285.691753.94737.61729.25310.905401139.90222.05160.836319425051146111.5835.545526.9693888.7534.546.04520.231399.49860.45862.94333.766292104.43208.80184.90178028721564115244.0527.193533.85201194.5333.995.70328.093011.171872.372179.58340.845337110.52446.53164.901581217615512159110.4527.835184.95204955.6235.245.71268.372007.221568.281625.99471.805380108.52247.07164.9771211057271127113.2512.703409.42209072.6935.875.45627.871036.53535.62290.98299.231407846.82143.33116.0261228026051698165.9249.315436.99226603.6734.266.49518.781815.141499.261085.61143.93531699.77214.22173.73182145481570230547.5221.093039.79216444.7134.385.72494.111265.95336.53563.51123.798307164.03272.98282.70182245461576235747.5521.105967.51206821.7533.615.62706.092455.171256.901354.88139.938643220.92416.85326.50359823213349231943.2844.036555.07218391.4133.756.64543.812973.842360.192369.79281.472862191.87426.57195.50364351803369240245.1412.546254.56207376.8434.915.37660.812159.131311.081358.80374.0248714122.98356.27177.67364257453369274750.90OpenBenchmarking.org

OSBench

Test: Create Files

SingleRAID0RAID1OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesF2FSEXT4BtrfsXFS1122334455SE +/- 1.45, N = 6SE +/- 0.04, N = 3SE +/- 0.19, N = 3SE +/- 2.58, N = 6SE +/- 0.16, N = 3SE +/- 1.52, N = 6SE +/- 4.57, N = 6SE +/- 0.02, N = 3SE +/- 0.36, N = 3SE +/- 0.04, N = 3SE +/- 5.88, N = 6SE +/- 1.55, N = 620.4212.6527.1135.5427.1921.1044.0312.5427.8312.7049.3121.091. (CC) gcc options:

PostgreSQL pgbench

Scaling: Mostly RAM - Test: Normal Load - Mode: Read Write

SingleRAID0RAID1OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Mostly RAM - Test: Normal Load - Mode: Read WriteF2FSEXT4BtrfsXFS14002800420056007000SE +/- 95.10, N = 43457.065280.734303.455526.963533.855967.516555.076254.565184.953409.425436.993039.791. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

PostgreSQL pgbench

Scaling: Mostly RAM - Test: Normal Load - Mode: Read Only

SingleRAID0RAID1OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Mostly RAM - Test: Normal Load - Mode: Read OnlyF2FSEXT4BtrfsXFS50K100K150K200K250KSE +/- 62.04, N = 3112571.02112451.34108580.7193888.75201194.53206821.75218391.41207376.84204955.62209072.69226603.67216444.711. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

Gzip Compression

Linux Source Tree Archiving To .tar.gz

SingleRAID0RAID1OpenBenchmarking.orgSeconds, Fewer Is BetterGzip CompressionLinux Source Tree Archiving To .tar.gzF2FSEXT4BtrfsXFS816243240SE +/- 0.50, N = 5SE +/- 0.09, N = 3SE +/- 0.47, N = 3SE +/- 0.12, N = 3SE +/- 0.47, N = 6SE +/- 0.41, N = 3SE +/- 0.53, N = 3SE +/- 0.12, N = 3SE +/- 0.58, N = 4SE +/- 0.54, N = 3SE +/- 0.51, N = 4SE +/- 0.53, N = 434.4234.9634.9734.5433.9933.6133.7534.9135.2435.8734.2634.38

Unpacking The Linux Kernel

linux-4.15.tar.xz

SingleRAID0RAID1OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-4.15.tar.xzF2FSEXT4BtrfsXFS246810SE +/- 0.04, N = 4SE +/- 0.01, N = 4SE +/- 0.03, N = 4SE +/- 0.15, N = 8SE +/- 0.05, N = 4SE +/- 0.04, N = 4SE +/- 0.15, N = 8SE +/- 0.07, N = 4SE +/- 0.04, N = 4SE +/- 0.01, N = 4SE +/- 0.16, N = 8SE +/- 0.02, N = 45.595.205.746.045.705.626.645.375.715.456.495.72

Compile Bench

Test: Initial Create

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateF2FSEXT4BtrfsXFS150300450600750SE +/- 35.40, N = 3SE +/- 9.29, N = 3SE +/- 7.15, N = 3SE +/- 4.60, N = 3SE +/- 10.30, N = 3SE +/- 4.53, N = 3SE +/- 2.83, N = 3SE +/- 3.32, N = 3SE +/- 1.71, N = 3SE +/- 8.70, N = 3SE +/- 1.88, N = 3SE +/- 20.47, N = 3641.50638.18285.69520.23328.09706.09543.81660.81268.37627.87518.78494.11

Compile Bench

Test: Compile

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileF2FSEXT4BtrfsXFS6001200180024003000SE +/- 16.67, N = 3SE +/- 57.92, N = 6SE +/- 55.85, N = 6SE +/- 50.02, N = 6SE +/- 44.00, N = 3SE +/- 210.26, N = 6SE +/- 95.92, N = 6SE +/- 61.58, N = 6SE +/- 134.93, N = 6SE +/- 70.69, N = 6SE +/- 120.63, N = 6SE +/- 16.55, N = 31309.501205.481753.941399.493011.172455.172973.842159.132007.221036.531815.141265.95

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceF2FSEXT4BtrfsXFS5001000150020002500SE +/- 75.22, N = 6SE +/- 41.99, N = 6SE +/- 44.62, N = 6SE +/- 4.43, N = 3SE +/- 5.51, N = 3SE +/- 87.51, N = 6SE +/- 36.42, N = 3SE +/- 101.51, N = 6SE +/- 8.75, N = 3SE +/- 23.19, N = 6SE +/- 15.99, N = 3SE +/- 52.07, N = 6388.04670.16737.61860.451872.371256.902360.191311.081568.28535.621499.26336.531. (CC) gcc options: -O3

IOzone

Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceF2FSEXT4BtrfsXFS5001000150020002500SE +/- 44.79, N = 6SE +/- 42.34, N = 6SE +/- 33.51, N = 6SE +/- 8.56, N = 3SE +/- 391.13, N = 6SE +/- 177.96, N = 6SE +/- 192.93, N = 6SE +/- 137.83, N = 6SE +/- 14.72, N = 3SE +/- 68.00, N = 6SE +/- 214.99, N = 6SE +/- 66.37, N = 6595.87678.26729.25862.942179.581354.882369.791358.801625.99290.981085.61563.511. (CC) gcc options: -O3

Dbench

Client Count: 12

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12F2FSEXT4BtrfsXFS100200300400500SE +/- 0.74, N = 3SE +/- 3.12, N = 3SE +/- 2.88, N = 3SE +/- 21.09, N = 6SE +/- 1.94, N = 3SE +/- 0.09, N = 3SE +/- 13.23, N = 6SE +/- 3.95, N = 3SE +/- 1.17, N = 3SE +/- 1.44, N = 3SE +/- 4.17, N = 6SE +/- 1.17, N = 3136.23353.52310.90333.76340.84139.93281.47374.02471.80299.23143.93123.791. (CC) gcc options: -lpopt -O2

BlogBench

Test: Write

SingleRAID0RAID1OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteF2FSEXT4BtrfsXFS10K20K30K40K50KSE +/- 709.05, N = 6SE +/- 1288.79, N = 6SE +/- 12.41, N = 3SE +/- 31.78, N = 3SE +/- 37.47, N = 3SE +/- 133.68, N = 4SE +/- 306.61, N = 6SE +/- 262.80, N = 3SE +/- 46.46, N = 3SE +/- 184.39, N = 3SE +/- 90.65, N = 3SE +/- 690.66, N = 67444273305401629253378643286248714538014078531683071. (CC) gcc options: -O2 -pthread

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

SingleRAID0RAID1OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeF2FSEXT4BtrfsXFS50100150200250SE +/- 16.19, N = 6SE +/- 8.87, N = 6SE +/- 6.90, N = 6SE +/- 7.34, N = 6SE +/- 11.85, N = 6SE +/- 28.10, N = 6SE +/- 0.54, N = 3SE +/- 12.91, N = 6SE +/- 8.51, N = 6SE +/- 6.58, N = 6SE +/- 7.22, N = 6SE +/- 15.78, N = 6179.75104.00139.90104.43110.52220.92191.87122.98108.5246.8299.77164.031. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

SingleRAID0RAID1OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsF2FSEXT4BtrfsXFS100200300400500SE +/- 17.62, N = 6SE +/- 22.41, N = 6SE +/- 13.06, N = 6SE +/- 8.47, N = 6SE +/- 62.72, N = 6SE +/- 84.68, N = 6SE +/- 3.54, N = 3SE +/- 64.94, N = 6SE +/- 35.15, N = 6SE +/- 1.75, N = 3SE +/- 27.22, N = 6SE +/- 57.28, N = 6258.47229.80222.05208.80446.53416.85426.57356.27247.07143.33214.22272.981. (CC) gcc options: -static

FS-Mark

Test: 1000 Files, 1MB Size

SingleRAID0RAID1OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeF2FSEXT4BtrfsXFS70140210280350SE +/- 0.53, N = 3SE +/- 1.62, N = 3SE +/- 0.52, N = 3SE +/- 0.38, N = 3SE +/- 2.30, N = 3SE +/- 1.77, N = 3SE +/- 1.25, N = 3SE +/- 1.59, N = 3SE +/- 0.19, N = 3SE +/- 15.94, N = 6SE +/- 0.63, N = 3SE +/- 0.95, N = 3295.53173.57160.83184.90164.90326.50195.50177.67164.97116.02173.73282.701. (CC) gcc options: -static

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryF2FSEXT4BtrfsXFS8001600240032004000SE +/- 1.86, N = 3SE +/- 0.58, N = 3SE +/- 7.51, N = 3SE +/- 1.20, N = 3SE +/- 226.33, N = 6SE +/- 2.91, N = 3SE +/- 1.20, N = 3SE +/- 3.06, N = 3SE +/- 93.04, N = 6SE +/- 5.17, N = 3SE +/- 0.67, N = 3SE +/- 0.88, N = 31763182663117801581359836433642712612182118221. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryF2FSEXT4BtrfsXFS12002400360048006000SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 1.76, N = 3SE +/- 1.15, N = 3SE +/- 0.33, N = 3SE +/- 7.69, N = 3290927239422872217623215180574511052802454845461. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryF2FSEXT4BtrfsXFS7001400210028003500SE +/- 0.88, N = 3SE +/- 3.71, N = 3SE +/- 59.31, N = 6SE +/- 4.04, N = 3SE +/- 178.74, N = 6SE +/- 0.88, N = 3SE +/- 2.08, N = 3SE +/- 1.45, N = 3SE +/- 88.05, N = 6SE +/- 1.15, N = 3SE +/- 1.67, N = 3SE +/- 3.53, N = 31552158650515641551334933693369727605157015761. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

SingleRAID0RAID1OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryF2FSEXT4BtrfsXFS6001200180024003000SE +/- 0.33, N = 3SE +/- 291.88, N = 6SE +/- 2.31, N = 3SE +/- 10.87, N = 31146117111461152215923192402274711271698230523571. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -lrt -laio -lm -lpthread -ldl

SQLite

Timed SQLite Insertions

SingleRAID0RAID1OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsF2FSEXT4BtrfsXFS4080120160200SE +/- 0.04, N = 3SE +/- 0.24, N = 3SE +/- 0.30, N = 3SE +/- 0.25, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.77, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.08, N = 3SE +/- 0.36, N = 343.2445.11111.5844.05110.4543.2845.1450.90113.25165.9247.5247.551. (CC) gcc options: -O2 -ldl -lpthread


Phoronix Test Suite v10.8.4