host-nfs-6-zfs-3xraidz2-sas-3tb20240616 2 x Intel Xeon E5-2697A v4 testing with a Supermicro PIO-648R-E1CR36L+-ST031 X10DRi-T4+ v1.01 (3.4 BIOS) and ASPEED on Debian GNU/Linux 12 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2406186-MBI-HOSTNFS688 Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test Kernel Notes: Transparent Huge Pages: madviseDisk Notes: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xb00003eSecurity Notes: gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines; IBPB: conditional; IBRS_FW; STIBP: conditional; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT vulnerable
12 x 3001GB HUS723030ALS64 Processor: 2 x Intel Xeon E5-2697A v4 @ 3.60GHz (32 Cores / 64 Threads), Motherboard: Supermicro PIO-648R-E1CR36L+-ST031 X10DRi-T4+ v1.01 (3.4 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 24 x 32 GB DDR4-1866MT/s Samsung M386A4G40DM0-CPB, Disk: 12 x 3001GB HUS723030ALS64 + 15 x 3001GB Seagate ST33000650SS + 9 x 3001GB Seagate ST3000NM0023 + 2048GB Lexar SSD NS100 + 32GB Cruzer Blade, Graphics: ASPEED, Monitor: DELL S2009W, Network: 4 x Intel 10-Gigabit X540-AT2
OS: Debian GNU/Linux 12, Kernel: 6.8.4-3-pve (x86_64), Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1600x900
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vDisk Notes: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xb00003eSecurity Notes: gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines; IBPB: conditional; IBRS_FW; STIBP: conditional; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT vulnerable
host-nfs-6-zfs-3xraidz2-sas-3tb20240616 OpenBenchmarking.org Phoronix Test Suite 2 x Intel Xeon E5-2697A v4 @ 3.60GHz (32 Cores / 64 Threads) Supermicro PIO-648R-E1CR36L+-ST031 X10DRi-T4+ v1.01 (3.4 BIOS) Intel Xeon E7 v4/Xeon 24 x 32 GB DDR4-1866MT/s Samsung M386A4G40DM0-CPB 12 x 3001GB HUS723030ALS64 + 15 x 3001GB Seagate ST33000650SS + 9 x 3001GB Seagate ST3000NM0023 + 2048GB Lexar SSD NS100 + 32GB Cruzer Blade ASPEED DELL S2009W 4 x Intel 10-Gigabit X540-AT2 Debian GNU/Linux 12 6.8.4-3-pve (x86_64) GCC 12.2.0 ext4 1600x900 Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernel Compiler File-System Screen Resolution Host-nfs-6-zfs-3xraidz2-sas-3tb20240616 Benchmarks System Logs - Transparent Huge Pages: madvise - MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xb00003e - gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines; IBPB: conditional; IBRS_FW; STIBP: conditional; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT vulnerable - 12 x 3001GB HUS723030ALS64: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
PostMark This is a test of NetApp's PostMark benchmark designed to simulate small-file testing similar to the tasks endured by web and mail servers. This test profile will set PostMark to perform 25,000 transactions with 500 files simultaneously with the file sizes ranging between 5 and 512 kilobytes. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org TPS, More Is Better PostMark 1.51 Disk Transaction Performance 12 x 3001GB HUS723030ALS64 900 1800 2700 3600 4500 SE +/- 44.46, N = 3 4386 1. (CC) gcc options: -O3
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 25.78, N = 15 2400
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 600 1200 1800 2400 3000 SE +/- 27.45, N = 15 2585
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 600 1200 1800 2400 3000 SE +/- 37.45, N = 15 2591
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 64MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 33.84, N = 15 2293
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 400 800 1200 1600 2000 SE +/- 18.11, N = 15 1975
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 400 800 1200 1600 2000 SE +/- 8.09, N = 3 1915
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 24.87, N = 5 2426
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 600 1200 1800 2400 3000 SE +/- 21.09, N = 3 2827
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 40K 80K 120K 160K 200K SE +/- 1154.70, N = 3 165000
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 140 280 420 560 700 SE +/- 4.63, N = 3 645
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 600 1200 1800 2400 3000 SE +/- 37.56, N = 15 2583
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 30K 60K 90K 120K 150K SE +/- 918.79, N = 13 134846
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 110 220 330 440 550 SE +/- 3.59, N = 13 527
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 400 800 1200 1600 2000 SE +/- 22.64, N = 15 2034
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 64MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 32.11, N = 3 2240
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 16MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 400 800 1200 1600 2000 SE +/- 20.35, N = 15 2078
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 400 800 1200 1600 2000 SE +/- 22.53, N = 5 2049
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 60K 120K 180K 240K 300K SE +/- 3008.66, N = 15 269267
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 200 400 600 800 1000 SE +/- 11.70, N = 15 1052
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 23.69, N = 3 2154
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 50K 100K 150K 200K 250K SE +/- 2249.44, N = 5 226400
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 200 400 600 800 1000 SE +/- 9.04, N = 5 883
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 27.18, N = 15 2440
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 600 1200 1800 2400 3000 SE +/- 29.96, N = 3 2655
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 64MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 24.84, N = 15 2366
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 16MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 600 1200 1800 2400 3000 SE +/- 19.27, N = 15 2593
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 24.44, N = 15 2223
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 22.60, N = 15 2184
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 128MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 600 1200 1800 2400 3000 SE +/- 30.38, N = 3 2616
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 64MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 26.08, N = 15 2202
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 16MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 600 1200 1800 2400 3000 SE +/- 39.98, N = 3 2897
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 600 1200 1800 2400 3000 SE +/- 25.90, N = 15 2584
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 128MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 400 800 1200 1600 2000 SE +/- 24.02, N = 15 2019
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 600 1200 1800 2400 3000 SE +/- 21.30, N = 3 2835
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 20K 40K 60K 80K 100K SE +/- 1201.85, N = 3 114333
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 100 200 300 400 500 SE +/- 4.36, N = 3 446
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 600 1200 1800 2400 3000 SE +/- 9.39, N = 3 2689
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 20K 40K 60K 80K 100K SE +/- 1083.72, N = 3 92833
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 80 160 240 320 400 SE +/- 4.10, N = 3 363
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 18.15, N = 3 2284
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 64MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 16.56, N = 3 2515
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 16MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 27.61, N = 4 2387
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 700 1400 2100 2800 3500 SE +/- 44.55, N = 3 3128
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester Type: Sequential Write - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 40K 80K 120K 160K 200K SE +/- 2158.48, N = 15 181800
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 150 300 450 600 750 SE +/- 8.39, N = 15 710
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 64MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 400 800 1200 1600 2000 SE +/- 9.67, N = 3 2076
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 16MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 22.33, N = 15 2124
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 24.73, N = 15 2307
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 15K 30K 45K 60K 75K SE +/- 845.47, N = 15 71767
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 60 120 180 240 300 SE +/- 3.27, N = 15 280
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 22.91, N = 15 2315
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 15K 30K 45K 60K 75K SE +/- 200.00, N = 3 68200
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 60 120 180 240 300 SE +/- 0.88, N = 3 266
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 600 1200 1800 2400 3000 SE +/- 19.43, N = 3 2703
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester Type: Sequential Read - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 60K 120K 180K 240K 300K SE +/- 1886.96, N = 15 294133
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 200 400 600 800 1000 SE +/- 7.44, N = 15 1149
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 700 1400 2100 2800 3500 SE +/- 33.06, N = 15 3241
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 128MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 9.82, N = 3 2345
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 64MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 27.26, N = 15 2196
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 16MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 600 1200 1800 2400 3000 SE +/- 38.67, N = 15 2909
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 700 1400 2100 2800 3500 SE +/- 24.02, N = 3 3083
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 128MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 14.75, N = 3 2266
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 700 1400 2100 2800 3500 SE +/- 28.02, N = 3 3090
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester Type: Random Write - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 20K 40K 60K 80K 100K SE +/- 864.41, N = 15 103367
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 90 180 270 360 450 SE +/- 3.39, N = 15 404
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 64MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 16.80, N = 3 2235
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 16MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 600 1200 1800 2400 3000 SE +/- 29.01, N = 4 2565
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 8MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 700 1400 2100 2800 3500 SE +/- 36.59, N = 3 3047
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester Type: Random Read - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 15K 30K 45K 60K 75K SE +/- 617.34, N = 3 68633
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 4KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 60 120 180 240 300 SE +/- 2.52, N = 3 268
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 128.85, N = 15 2417
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 90.03, N = 15 2400
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 16MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 51.66, N = 12 2479
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 400 800 1200 1600 2000 SE +/- 89.63, N = 12 1845
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 400 800 1200 1600 2000 SE +/- 33.80, N = 12 1768
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 600 1200 1800 2400 3000 SE +/- 47.06, N = 15 2643
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 93.27, N = 12 2444
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 700 1400 2100 2800 3500 SE +/- 59.06, N = 12 3088
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Sequential Write - IO Engine: Sync - Buffered: Yes - Direct: No - Block Size: 128MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 38.93, N = 15 2190
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 500 1000 1500 2000 2500 SE +/- 72.49, N = 15 2402
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 16MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 600 1200 1800 2400 3000 SE +/- 50.67, N = 15 2617
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 128MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 400 800 1200 1600 2000 SE +/- 70.29, N = 15 2064
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.33 Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64MB - Disk Target: /data Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test 400 800 1200 1600 2000 SE +/- 60.26, N = 15 2017
Newly built, 3 VDAVs Of 12 SAS in RAIDZ2, Large Test Kernel Notes: Transparent Huge Pages: madviseDisk Notes: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xb00003eSecurity Notes: gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines; IBPB: conditional; IBRS_FW; STIBP: conditional; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT vulnerable
Testing initiated at 16 June 2024 09:15 by user root.
12 x 3001GB HUS723030ALS64 Processor: 2 x Intel Xeon E5-2697A v4 @ 3.60GHz (32 Cores / 64 Threads), Motherboard: Supermicro PIO-648R-E1CR36L+-ST031 X10DRi-T4+ v1.01 (3.4 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 24 x 32 GB DDR4-1866MT/s Samsung M386A4G40DM0-CPB, Disk: 12 x 3001GB HUS723030ALS64 + 15 x 3001GB Seagate ST33000650SS + 9 x 3001GB Seagate ST3000NM0023 + 2048GB Lexar SSD NS100 + 32GB Cruzer Blade, Graphics: ASPEED, Monitor: DELL S2009W, Network: 4 x Intel 10-Gigabit X540-AT2
OS: Debian GNU/Linux 12, Kernel: 6.8.4-3-pve (x86_64), Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1600x900
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vDisk Notes: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xb00003eSecurity Notes: gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines; IBPB: conditional; IBRS_FW; STIBP: conditional; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT vulnerable
Testing initiated at 18 June 2024 08:08 by user mbi.