Linux 4.19 I/O Scheduler Performance

Linux I/O scheduler benchmarks for a future article on Phoronix.com.

HTML result view exported from: https://openbenchmarking.org/result/1811264-SK-LINUX419I79&obr_sor=y&obr_rro=y&gru&sro.

Linux 4.19 I/O Scheduler PerformanceProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelCompilerFile-SystemScreen ResolutionCFQDeadlineNoopMQ NoneBFQ low_latencyBFQKyberMQ Deadline2 x AMD EPYC 7601 32-Core (64 Cores / 128 Threads)Dell 02MJ3T (1.2.5 BIOS)AMD Family 17h16 x 32 GB DDR4-2400MT/s 36ASF4G72PZ-2G6D2120GB SSDSCKJB120G7R + 20 x 500GB Samsung SSD 860Matrox G200eW3VE228Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMAUbuntu 18.104.19.0-041900-generic (x86_64)GCC 8.2.0 + Clang 7.0.0-3 + LLVM 7.0.0ext41600x120020 x 500GB Samsung SSD 860 + 120GB SSDSCKJB120G7R120GB SSDSCKJB120G7R + 20 x 500GB Samsung SSD 860OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- CFQ: CFQ / relatime,rw- Deadline: DEADLINE / relatime,rw- Noop: NOOP / relatime,rw- MQ None: NONE / relatime,rw- BFQ low_latency: BFQ / relatime,rw- BFQ: BFQ / relatime,rw- Kyber: KYBER / relatime,rw- MQ Deadline: MQ-DEADLINE / relatime,rwPython Details- Python 2.7.15+ + Python 3.6.7Security Details- __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp

Linux 4.19 I/O Scheduler Performancefs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefs-mark: 1000 Files, 1MB Size, No Sync/FSyncblogbench: Readblogbench: Writefio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 4KB - Default Test Directorycompilebench: Compilecompilebench: Initial Createcompilebench: Read Compiled Treepgbench: Buffer Test - Normal Load - Read Onlypgbench: Buffer Test - Normal Load - Read Writesqlite: Timed SQLite Insertionsbuild-gcc: Time To Compilebuild-linux-kernel: Time To CompileCFQDeadlineNoopMQ NoneBFQ low_latencyBFQKyberMQ Deadline17418186.701890748396235472532843912373823224053131554370881519438365633.1780626.3817317384.471896736143228175423134032373823244103151576388938552470507434.2080326.3791.3017881.801897705847214855422713102382532533183091568391968533709255477.1080726.4864.4314057.201920795075273205432702802272522523113091571396972533463208968.2980026.5061.3313166.931918785541225125432722232122522533123101591394960519792340675.0580426.49168.2318183.831896805148241635422703792363813293863131575387969545719483757.3280026.4391.6818389.171909780536274925432753112362532533123081577390949497899230369.1180426.4259.2312367.381893783446263425432722432262522523133071577389955506397245377.5279626.44OpenBenchmarking.org

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeMQ DeadlineBFQ low_latencyMQ NoneNoopKyberBFQDeadlineCFQ4080120160200SE +/- 2.40, N = 12SE +/- 2.31, N = 12SE +/- 2.14, N = 12SE +/- 6.28, N = 12SE +/- 2.15, N = 12SE +/- 0.44, N = 3SE +/- 0.23, N = 3SE +/- 0.09, N = 359.2361.3364.4391.3091.68168.23173.00174.001. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsMQ DeadlineBFQ low_latencyMQ NoneDeadlineNoopBFQCFQKyber4080120160200SE +/- 12.68, N = 6SE +/- 9.48, N = 6SE +/- 8.57, N = 8SE +/- 0.13, N = 3SE +/- 0.61, N = 3SE +/- 5.19, N = 12SE +/- 5.69, N = 12SE +/- 0.35, N = 31231311401731781811811831. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeMQ NoneBFQ low_latencyMQ DeadlineNoopBFQDeadlineCFQKyber20406080100SE +/- 1.01, N = 3SE +/- 1.76, N = 12SE +/- 1.79, N = 12SE +/- 1.50, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 357.2066.9367.3881.8083.8384.4786.7089.171. (CC) gcc options: -static

FS-Mark

Test: 1000 Files, 1MB Size, No Sync/FSync

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncCFQMQ DeadlineBFQDeadlineNoopKyberBFQ low_latencyMQ None400800120016002000SE +/- 4.42, N = 3SE +/- 5.34, N = 3SE +/- 9.03, N = 3SE +/- 4.07, N = 3SE +/- 5.04, N = 3SE +/- 8.63, N = 3SE +/- 13.64, N = 3SE +/- 10.18, N = 3189018931896189618971909191819201. (CC) gcc options: -static

BlogBench

Test: Read

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: ReadNoopDeadlineCFQKyberMQ DeadlineBFQ low_latencyMQ NoneBFQ200K400K600K800K1000KSE +/- 14644.01, N = 9SE +/- 12667.35, N = 4SE +/- 12021.04, N = 3SE +/- 3436.67, N = 3SE +/- 15271.38, N = 3SE +/- 7744.57, N = 3SE +/- 5674.85, N = 3SE +/- 6417.79, N = 37058477361437483967805367834467855417950758051481. (CC) gcc options: -O2 -pthread

BlogBench

Test: Write

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteNoopBFQ low_latencyDeadlineCFQBFQMQ DeadlineMQ NoneKyber6K12K18K24K30KSE +/- 1540.70, N = 3SE +/- 2941.93, N = 3SE +/- 1730.49, N = 3SE +/- 1591.21, N = 3SE +/- 2384.58, N = 3SE +/- 1133.74, N = 3SE +/- 386.03, N = 3SE +/- 265.64, N = 321485225122281723547241632634227320274921. (CC) gcc options: -O2 -pthread

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBFQMQ NoneBFQ low_latencyNoopMQ DeadlineKyberCFQDeadline20K40K60K80K100KSE +/- 384.42, N = 3SE +/- 33.33, N = 3SE +/- 100.00, N = 3SE +/- 33.33, N = 3SE +/- 33.33, N = 368767691336950069500697007046772667802001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBFQ low_latencyMQ DeadlineMQ NoneBFQKyberDeadlineNoopCFQ13K26K39K52K65KSE +/- 632.60, N = 10SE +/- 771.00, N = 6SE +/- 260.34, N = 3SE +/- 272.85, N = 3SE +/- 88.19, N = 3SE +/- 328.30, N = 3SE +/- 284.80, N = 354280577335806760333605336060060633607671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryMQ DeadlineMQ NoneBFQ low_latencyKyberNoopCFQDeadlineBFQ20K40K60K80K100KSE +/- 33.33, N = 3SE +/- 120.19, N = 3SE +/- 233.33, N = 3SE +/- 650.64, N = 364600646006463364700648008256782833843001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryKyberMQ DeadlineNoopMQ NoneBFQ low_latencyCFQBFQDeadline20K40K60K80K100KSE +/- 296.27, N = 3SE +/- 366.67, N = 3SE +/- 133.33, N = 3SE +/- 208.17, N = 3SE +/- 584.05, N = 3SE +/- 635.96, N = 3SE +/- 437.16, N = 378567787677910079167793008016780233805671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryCFQBFQDeadlineNoopBFQ low_latencyKyberMQ DeadlineMQ None120240360480600SE +/- 0.33, N = 3SE +/- 0.33, N = 32535425425425435435435431. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBFQMQ NoneNoopBFQ low_latencyMQ DeadlineKyberCFQDeadline70140210280350SE +/- 0.33, N = 3SE +/- 0.33, N = 32702702712722722752843131. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryBFQ low_latencyMQ DeadlineMQ NoneNoopKyberBFQCFQDeadline90180270360450SE +/- 12.98, N = 12SE +/- 12.51, N = 12SE +/- 7.26, N = 12SE +/- 1.53, N = 3SE +/- 3.71, N = 3SE +/- 4.04, N = 3SE +/- 7.51, N = 32232432803103113793914031. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBFQ low_latencyMQ DeadlineMQ NoneBFQKyberCFQDeadlineNoop50100150200250SE +/- 2.41, N = 10SE +/- 3.07, N = 6SE +/- 1.15, N = 3SE +/- 0.88, N = 3SE +/- 1.20, N = 32122262272362362372372381. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryBFQ low_latencyMQ DeadlineMQ NoneKyberNoopBFQCFQDeadline801602403204002522522522532533813823821. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryMQ DeadlineMQ NoneBFQ low_latencyKyberNoopCFQDeadlineBFQ70140210280350SE +/- 0.88, N = 3SE +/- 2.33, N = 32522522532532533223243291. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryMQ NoneBFQ low_latencyKyberMQ DeadlineNoopBFQCFQDeadline90180270360450SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.88, N = 3SE +/- 1.86, N = 3SE +/- 0.33, N = 3SE +/- 4.74, N = 7SE +/- 3.84, N = 3SE +/- 0.67, N = 33113123123133183864054101. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryMQ DeadlineKyberMQ NoneNoopBFQ low_latencyBFQCFQDeadline70140210280350SE +/- 1.33, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 2.52, N = 3SE +/- 2.19, N = 3SE +/- 1.86, N = 33073083093093103133133151. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileCFQNoopMQ NoneBFQDeadlineKyberMQ DeadlineBFQ low_latency30060090012001500SE +/- 25.94, N = 12SE +/- 3.60, N = 3SE +/- 10.25, N = 3SE +/- 27.17, N = 3SE +/- 18.06, N = 3SE +/- 9.90, N = 3SE +/- 8.82, N = 3SE +/- 23.01, N = 315541568157115751576157715771591

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateCFQBFQDeadlineMQ DeadlineKyberNoopBFQ low_latencyMQ None90180270360450SE +/- 14.05, N = 3SE +/- 4.71, N = 3SE +/- 5.24, N = 3SE +/- 4.48, N = 3SE +/- 3.28, N = 3SE +/- 0.40, N = 3SE +/- 2.88, N = 3SE +/- 2.34, N = 3370387388389390391394396

Compile Bench

Test: Read Compiled Tree

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeCFQDeadlineKyberMQ DeadlineBFQ low_latencyNoopBFQMQ None2004006008001000SE +/- 88.38, N = 3SE +/- 16.27, N = 3SE +/- 33.71, N = 3SE +/- 9.75, N = 3SE +/- 10.55, N = 3SE +/- 0.51, N = 3SE +/- 13.50, N = 3SE +/- 0.68, N = 3881938949955960968969972

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyKyberMQ DeadlineCFQBFQ low_latencyMQ NoneNoopBFQDeadline120K240K360K480K600KSE +/- 16915.21, N = 9SE +/- 17086.01, N = 9SE +/- 14237.99, N = 9SE +/- 8044.90, N = 9SE +/- 1266.65, N = 3SE +/- 5081.43, N = 3SE +/- 9965.65, N = 3SE +/- 5594.65, N = 34978995063975194385197925334635337095457195524701. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteMQ NoneKyberMQ DeadlineNoopBFQ low_latencyCFQBFQDeadline11002200330044005500SE +/- 79.41, N = 9SE +/- 328.42, N = 9SE +/- 116.16, N = 6SE +/- 178.04, N = 9SE +/- 274.44, N = 6SE +/- 482.90, N = 6SE +/- 30.68, N = 3SE +/- 43.49, N = 3208923032453255434063656483750741. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsMQ DeadlineNoopBFQ low_latencyKyberMQ NoneBFQDeadlineCFQ20406080100SE +/- 10.09, N = 9SE +/- 10.02, N = 9SE +/- 8.89, N = 9SE +/- 9.71, N = 9SE +/- 9.94, N = 9SE +/- 0.64, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 377.5277.1075.0569.1168.2957.3234.2033.171. (CC) gcc options: -O2 -lz -ldl -lpthread

Timed GCC Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GCC Compilation 8.2Time To CompileNoopCFQKyberBFQ low_latencyDeadlineMQ NoneBFQMQ Deadline2004006008001000807806804804803800800796

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 4.18Time To CompileMQ NoneBFQ low_latencyNoopMQ DeadlineBFQKyberCFQDeadline612182430SE +/- 0.28, N = 12SE +/- 0.30, N = 12SE +/- 0.30, N = 12SE +/- 0.29, N = 12SE +/- 0.27, N = 12SE +/- 0.26, N = 12SE +/- 0.30, N = 9SE +/- 0.32, N = 1226.5026.4926.4826.4426.4326.4226.3826.37

Phoronix Test Suite v10.8.5