freenas-zpool-replacement

AMD Ryzen 5 3600XT 6-Core testing with a Gigabyte B550M DS3H (F11 BIOS) and NVIDIA GeForce GTX 1660 SUPER 6GB on Linuxmint 20.1 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2103304-HA-FREENASZP35
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
old-cifs-raidz-3disks
March 29 2021
  1 Hour, 36 Minutes
old-nfs-raidz-3disks
March 29 2021
  41 Minutes
new-cifs-raid10-4disks
March 30 2021
  53 Minutes
new-nfs-raid10-4disks
March 30 2021
  28 Minutes
Invert Hiding All Results Option
  54 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

old-cifs-raidz-3disks

Processor: AMD Ryzen 5 3600XT 6-Core @ 3.80GHz (6 Cores / 12 Threads), Motherboard: Gigabyte B550M DS3H (F11 BIOS), Chipset: AMD Starship/Matisse, Memory: 2 x 8192 MB DDR4-2400MT/s Kingston KHX3200C16D4, Disk: 500GB Western Digital WDS500G2B0C-00PXH0 + 2000GB Western Digital WDS200T2B0C-00PXH0 + 256GB Samsung SSD 850 + 2 x 128GB SAMSUNG SSD 830, Graphics: NVIDIA GeForce GTX 1660 SUPER 6GB, Audio: NVIDIA TU116 HD Audio, Network: Realtek RTL8111/8168/8411

OS: Linuxmint 20.1, Kernel: 5.4.0-67-generic (x86_64), Desktop: Xfce, Display Server: X Server 1.20.9, Display Driver: NVIDIA, Vulkan: 1.2.155, Compiler: GCC 9.3.0, File-System: smb2, Screen Resolution: 1024x768

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: NONE / actimeo=1,addr=192.168.1.120,bsize=1048576,cache=strict,dir_mode=0755,echo_interval=60,file_mode=0755,gid=0,mapposix,noforcegid,noforceuid,nounix,relatime,rsize=4194304,rw,serverino,soft,uid=0,username=konstantin,vers=3.1.1,wsize=4194304 / Block Size: 1024
Processor Notes: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0x8701021
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

old-nfs-raidz-3disks

OS: Linuxmint 20.1, Kernel: 5.4.0-67-generic (x86_64), Desktop: Xfce, Display Server: X Server 1.20.9, Display Driver: NVIDIA, Vulkan: 1.2.155, Compiler: GCC 9.3.0, File-System: nfs, Screen Resolution: 1024x768

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0x8701021
Disk Scheduler Notes: NONE
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

new-cifs-raid10-4disks

Processor: AMD Ryzen 5 3600XT 6-Core @ 3.80GHz (6 Cores / 12 Threads), Motherboard: Gigabyte B550M DS3H (F11 BIOS), Chipset: AMD Starship/Matisse, Memory: 2 x 8192 MB DDR4-2400MT/s Kingston KHX3200C16D4, Disk: 500GB Western Digital WDS500G2B0C-00PXH0 + 2000GB Western Digital WDS200T2B0C-00PXH0 + 256GB Samsung SSD 850 + 2 x 128GB SAMSUNG SSD 830, Graphics: NVIDIA GeForce GTX 1660 SUPER 6GB (1530/7000MHz), Audio: NVIDIA TU116 HD Audio, Monitor: PB248, Network: Realtek RTL8111/8168/8411

OS: Linuxmint 20.1, Kernel: 5.4.0-67-generic (x86_64), Desktop: Xfce 4.14, Display Server: X Server 1.20.9, Display Driver: NVIDIA 460.39, OpenGL: 4.6.0, Vulkan: 1.2.155, Compiler: GCC 9.3.0, File-System: smb2, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: NONE / actimeo=1,addr=192.168.1.120,bsize=1048576,cache=strict,dir_mode=0755,echo_interval=60,file_mode=0755,gid=0,mapposix,noforcegid,noforceuid,nounix,relatime,rsize=4194304,rw,serverino,soft,uid=0,username=konstantin,vers=3.1.1,wsize=4194304 / Block Size: 1024
Processor Notes: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0x8701021
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

new-nfs-raid10-4disks

OS: Linuxmint 20.1, Kernel: 5.4.0-67-generic (x86_64), Desktop: Xfce 4.14, Display Server: X Server 1.20.9, Display Driver: NVIDIA 460.39, OpenGL: 4.6.0, Vulkan: 1.2.155, Compiler: GCC 9.3.0, File-System: nfs, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0x8701021
Disk Scheduler Notes: NONE
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

freenas-zpool-replacementProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkMonitorOSKernelDesktopDisplay ServerDisplay DriverVulkanCompilerFile-SystemScreen ResolutionOpenGLold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disksAMD Ryzen 5 3600XT 6-Core @ 3.80GHz (6 Cores / 12 Threads)Gigabyte B550M DS3H (F11 BIOS)AMD Starship/Matisse2 x 8192 MB DDR4-2400MT/s Kingston KHX3200C16D4500GB Western Digital WDS500G2B0C-00PXH0 + 2000GB Western Digital WDS200T2B0C-00PXH0 + 256GB Samsung SSD 850 + 2 x 128GB SAMSUNG SSD 830NVIDIA GeForce GTX 1660 SUPER 6GBNVIDIA TU116 HD AudioRealtek RTL8111/8168/8411Linuxmint 20.15.4.0-67-generic (x86_64)XfceX Server 1.20.9NVIDIA1.2.155GCC 9.3.0smb21024x768nfsNVIDIA GeForce GTX 1660 SUPER 6GB (1530/7000MHz)PB248Xfce 4.14NVIDIA 460.394.6.0smb21920x1200nfsOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- old-cifs-raidz-3disks, new-cifs-raid10-4disks: NONE / actimeo=1,addr=192.168.1.120,bsize=1048576,cache=strict,dir_mode=0755,echo_interval=60,file_mode=0755,gid=0,mapposix,noforcegid,noforceuid,nounix,relatime,rsize=4194304,rw,serverino,soft,uid=0,username=konstantin,vers=3.1.1,wsize=4194304 / Block Size: 1024 Processor Details- Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0x8701021Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected Disk Scheduler Details- old-nfs-raidz-3disks, new-nfs-raid10-4disks: NONE

old-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disksLogarithmic Result OverviewPhoronix Test SuiteFS-MarkFlexible IO TesterFS-MarkFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO Tester1.F.1.SRand Write - Linux AIO - No - Yes - 2MB1.F.1.S.N.S.FRand Write - Linux AIO - No - Yes - 2MBRand Write - Linux AIO - No - Yes - 4KBRand Write - Linux AIO - No - Yes - 4KBRand Read - Linux AIO - No - Yes - 2MBRand Read - Linux AIO - No - Yes - 4KBRand Read - Linux AIO - No - Yes - 4KB

freenas-zpool-replacementfio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 1000 Files, 1MB Size, No Sync/FSyncold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks89.54110727533107.65040.0102747.516.2110521012556740.6170.2776623.931.492.64310927900105.64940.81013116.225.0111521022603357.1251.03625546.944.3OpenBenchmarking.org

Flexible IO Tester

FIO, the Flexible I/O Tester, is an advanced Linux disk benchmark supporting multiple I/O engines and a wealth of options. FIO was written by Jens Axboe for testing of the Linux I/O subsystem and schedulers. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks20406080100SE +/- 1.02, N = 4SE +/- 0.67, N = 3SE +/- 1.69, N = 15SE +/- 0.33, N = 388.1110.092.6111.01. (CC) gcc options: -rdynamic -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks20406080100Min: 86.8 / Avg: 88.05 / Max: 91.1Min: 109 / Avg: 110.33 / Max: 111Min: 81.9 / Avg: 92.63 / Max: 101Min: 110 / Avg: 110.67 / Max: 1111. (CC) gcc options: -rdynamic -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks1224364860SE +/- 0.50, N = 4SE +/- 0.86, N = 15415243521. (CC) gcc options: -rdynamic -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks1020304050Min: 40 / Avg: 40.5 / Max: 42Min: 37 / Avg: 42.87 / Max: 471. (CC) gcc options: -rdynamic -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks20406080100SE +/- 0.67, N = 31071011091021. (CC) gcc options: -rdynamic -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks20406080100Min: 106 / Avg: 107.33 / Max: 1081. (CC) gcc options: -rdynamic -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks6K12K18K24K30KSE +/- 166.67, N = 3SE +/- 284.80, N = 3SE +/- 33.33, N = 3275332556727900260331. (CC) gcc options: -rdynamic -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks5K10K15K20K25KMin: 27200 / Avg: 27533.33 / Max: 27700Min: 25000 / Avg: 25566.67 / Max: 25900Min: 26000 / Avg: 26033.33 / Max: 261001. (CC) gcc options: -rdynamic -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks20406080100SE +/- 1.37, N = 15SE +/- 1.08, N = 3SE +/- 1.45, N = 13SE +/- 0.74, N = 3107.640.6105.657.11. (CC) gcc options: -rdynamic -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks20406080100Min: 99.9 / Avg: 107.59 / Max: 116Min: 38.5 / Avg: 40.6 / Max: 42.1Min: 91.2 / Avg: 105.63 / Max: 111Min: 56.3 / Avg: 57.13 / Max: 58.61. (CC) gcc options: -rdynamic -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks1122334455SE +/- 0.68, N = 15501749251. (CC) gcc options: -rdynamic -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks1020304050Min: 46 / Avg: 50.2 / Max: 551. (CC) gcc options: -rdynamic -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks918273645SE +/- 0.321, N = 15SE +/- 0.010, N = 15SE +/- 1.079, N = 3SE +/- 0.017, N = 840.0000.27740.8001.0361. (CC) gcc options: -rdynamic -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks816243240Min: 37.5 / Avg: 39.99 / Max: 41.7Min: 0.23 / Avg: 0.28 / Max: 0.34Min: 39.1 / Avg: 40.8 / Max: 42.8Min: 0.97 / Avg: 1.04 / Max: 1.141. (CC) gcc options: -rdynamic -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks2K4K6K8K10KSE +/- 86.14, N = 15SE +/- 2.38, N = 15SE +/- 134.34, N = 3SE +/- 4.39, N = 81027466101312551. (CC) gcc options: -rdynamic -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks2K4K6K8K10KMin: 9606 / Avg: 10273.6 / Max: 10700Min: 54 / Avg: 65.8 / Max: 83Min: 9994 / Avg: 10131.33 / Max: 10400Min: 238 / Avg: 255.38 / Max: 2811. (CC) gcc options: -rdynamic -lnuma -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Sizeold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks1122334455SE +/- 0.44, N = 12SE +/- 1.02, N = 15SE +/- 0.32, N = 3SE +/- 0.99, N = 57.523.916.246.91. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Sizeold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks1020304050Min: 5.8 / Avg: 7.53 / Max: 11.3Min: 14.9 / Avg: 23.93 / Max: 31.3Min: 15.6 / Avg: 16.23 / Max: 16.6Min: 43 / Avg: 46.86 / Max: 48.41. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks1020304050SE +/- 0.72, N = 12SE +/- 0.82, N = 3SE +/- 0.64, N = 3SE +/- 0.90, N = 1516.231.425.044.31. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncold-cifs-raidz-3disksold-nfs-raidz-3disksnew-cifs-raid10-4disksnew-nfs-raid10-4disks918273645Min: 11.7 / Avg: 16.18 / Max: 18.5Min: 30.3 / Avg: 31.4 / Max: 33Min: 24.2 / Avg: 25.03 / Max: 26.3Min: 37.8 / Avg: 44.26 / Max: 48.91. (CC) gcc options: -static

10 Results Shown

Flexible IO Tester:
  Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
FS-Mark:
  1000 Files, 1MB Size
  1000 Files, 1MB Size, No Sync/FSync

old-cifs-raidz-3disks

Processor: AMD Ryzen 5 3600XT 6-Core @ 3.80GHz (6 Cores / 12 Threads), Motherboard: Gigabyte B550M DS3H (F11 BIOS), Chipset: AMD Starship/Matisse, Memory: 2 x 8192 MB DDR4-2400MT/s Kingston KHX3200C16D4, Disk: 500GB Western Digital WDS500G2B0C-00PXH0 + 2000GB Western Digital WDS200T2B0C-00PXH0 + 256GB Samsung SSD 850 + 2 x 128GB SAMSUNG SSD 830, Graphics: NVIDIA GeForce GTX 1660 SUPER 6GB, Audio: NVIDIA TU116 HD Audio, Network: Realtek RTL8111/8168/8411

OS: Linuxmint 20.1, Kernel: 5.4.0-67-generic (x86_64), Desktop: Xfce, Display Server: X Server 1.20.9, Display Driver: NVIDIA, Vulkan: 1.2.155, Compiler: GCC 9.3.0, File-System: smb2, Screen Resolution: 1024x768

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: NONE / actimeo=1,addr=192.168.1.120,bsize=1048576,cache=strict,dir_mode=0755,echo_interval=60,file_mode=0755,gid=0,mapposix,noforcegid,noforceuid,nounix,relatime,rsize=4194304,rw,serverino,soft,uid=0,username=konstantin,vers=3.1.1,wsize=4194304 / Block Size: 1024
Processor Notes: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0x8701021
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 29 March 2021 21:25 by user root.

old-nfs-raidz-3disks

Processor: AMD Ryzen 5 3600XT 6-Core @ 3.80GHz (6 Cores / 12 Threads), Motherboard: Gigabyte B550M DS3H (F11 BIOS), Chipset: AMD Starship/Matisse, Memory: 2 x 8192 MB DDR4-2400MT/s Kingston KHX3200C16D4, Disk: 500GB Western Digital WDS500G2B0C-00PXH0 + 2000GB Western Digital WDS200T2B0C-00PXH0 + 256GB Samsung SSD 850 + 2 x 128GB SAMSUNG SSD 830, Graphics: NVIDIA GeForce GTX 1660 SUPER 6GB, Audio: NVIDIA TU116 HD Audio, Network: Realtek RTL8111/8168/8411

OS: Linuxmint 20.1, Kernel: 5.4.0-67-generic (x86_64), Desktop: Xfce, Display Server: X Server 1.20.9, Display Driver: NVIDIA, Vulkan: 1.2.155, Compiler: GCC 9.3.0, File-System: nfs, Screen Resolution: 1024x768

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0x8701021
Disk Scheduler Notes: NONE
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 29 March 2021 22:54 by user root.

new-cifs-raid10-4disks

Processor: AMD Ryzen 5 3600XT 6-Core @ 3.80GHz (6 Cores / 12 Threads), Motherboard: Gigabyte B550M DS3H (F11 BIOS), Chipset: AMD Starship/Matisse, Memory: 2 x 8192 MB DDR4-2400MT/s Kingston KHX3200C16D4, Disk: 500GB Western Digital WDS500G2B0C-00PXH0 + 2000GB Western Digital WDS200T2B0C-00PXH0 + 256GB Samsung SSD 850 + 2 x 128GB SAMSUNG SSD 830, Graphics: NVIDIA GeForce GTX 1660 SUPER 6GB (1530/7000MHz), Audio: NVIDIA TU116 HD Audio, Monitor: PB248, Network: Realtek RTL8111/8168/8411

OS: Linuxmint 20.1, Kernel: 5.4.0-67-generic (x86_64), Desktop: Xfce 4.14, Display Server: X Server 1.20.9, Display Driver: NVIDIA 460.39, OpenGL: 4.6.0, Vulkan: 1.2.155, Compiler: GCC 9.3.0, File-System: smb2, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: NONE / actimeo=1,addr=192.168.1.120,bsize=1048576,cache=strict,dir_mode=0755,echo_interval=60,file_mode=0755,gid=0,mapposix,noforcegid,noforceuid,nounix,relatime,rsize=4194304,rw,serverino,soft,uid=0,username=konstantin,vers=3.1.1,wsize=4194304 / Block Size: 1024
Processor Notes: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0x8701021
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 30 March 2021 18:55 by user root.

new-nfs-raid10-4disks

Processor: AMD Ryzen 5 3600XT 6-Core @ 3.80GHz (6 Cores / 12 Threads), Motherboard: Gigabyte B550M DS3H (F11 BIOS), Chipset: AMD Starship/Matisse, Memory: 2 x 8192 MB DDR4-2400MT/s Kingston KHX3200C16D4, Disk: 500GB Western Digital WDS500G2B0C-00PXH0 + 2000GB Western Digital WDS200T2B0C-00PXH0 + 256GB Samsung SSD 850 + 2 x 128GB SAMSUNG SSD 830, Graphics: NVIDIA GeForce GTX 1660 SUPER 6GB (1530/7000MHz), Audio: NVIDIA TU116 HD Audio, Monitor: PB248, Network: Realtek RTL8111/8168/8411

OS: Linuxmint 20.1, Kernel: 5.4.0-67-generic (x86_64), Desktop: Xfce 4.14, Display Server: X Server 1.20.9, Display Driver: NVIDIA 460.39, OpenGL: 4.6.0, Vulkan: 1.2.155, Compiler: GCC 9.3.0, File-System: nfs, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0x8701021
Disk Scheduler Notes: NONE
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 30 March 2021 19:33 by user root.