Linux 6.11 File-Systems

Tests for a future article. AMD EPYC 8534P 64-Core testing with a AMD Cinnabar (RCB1009C BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2408065-NE-LINUX611F18&grr.

Linux 6.11 File-SystemsProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionEXT4F2FSBtrfsXFSBcachefsAMD EPYC 8534P 64-Core @ 2.30GHz (64 Cores / 128 Threads)AMD Cinnabar (RCB1009C BIOS)AMD Device 14a46 x 32GB DRAM-4800MT/s Samsung M321R4GA0BB0-CQKMG1000GB INTEL SSDPE2KX010T8 + 7682GB SOLIDIGM SB5PH27X076TASPEED2 x Broadcom NetXtreme BCM5720 PCIeUbuntu 23.106.11.0-061100rc2-generic (x86_64)GCC 13.2.0ext41920x1200f2fsbtrfsxfsBcacheFSOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- EXT4: NONE / relatime,rw,stripe=256 / Block Size: 4096- F2FS: NONE / acl,active_logs=6,alloc_mode=default,background_gc=on,barrier,checkpoint_merge,discard,discard_unit=block,errors=continue,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,memory=normal,mode=adaptive,nogc_merge,relatime,rw,user_xattr / Block Size: 4096 - Btrfs: NONE / discard=async,relatime,rw,space_cache=v2,ssd,subvol=/,subvolid=5 / Block Size: 4096 - XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw / Block Size: 4096 - Bcachefs: NONE / relatime,rw / Block Size: 4096Processor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00212 Java Details- EXT4: OpenJDK Runtime Environment (build 11.0.23+9-post-Ubuntu-1ubuntu123.10.1)Python Details- EXT4: Python 3.11.6Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Linux 6.11 File-Systemsdbench: 12fio: Seq Read - IO_uring - Yes - 2MB - 32 - Default Test Directorycockroach: KV, 60% Reads - 256mariadb: oltp_update_non_index - 64cockroach: KV, 50% Reads - 256speedb: Read While Writingfio: Seq Read - IO_uring - Yes - 2MB - 32 - Default Test Directorypgbench: 100 - 1000 - Read Write - Average Latencypgbench: 100 - 1000 - Read Writespeedb: Rand Fillfio: Rand Read - IO_uring - Yes - 4KB - 32 - Default Test Directoryfio: Rand Read - IO_uring - Yes - 4KB - 32 - Default Test Directoryfio: Seq Write - IO_uring - Yes - 2MB - 32 - Default Test Directoryfio: Seq Write - IO_uring - Yes - 2MB - 32 - Default Test Directoryfio: Rand Write - IO_uring - Yes - 4KB - 32 - Default Test Directoryfio: Rand Write - IO_uring - Yes - 4KB - 32 - Default Test Directorymysqlslap: 32sqlite: 4EXT4F2FSBtrfsXFSBcachefs5057.88106658.518391397936.812274192594115.746635113711312036677954039808113600053215382.6066756.04101341.9186562100277.012193430611021.4874654936880620333379440428087147000574153810.4412061.2099639.74782688960.712070975598141.640240163694701390005431367273760833237101514.8825777.24101495.3185630100698.812275021609215.500645193557212050008004042808613000050715362.4883229.787186102296.815812794771.812110788371224.0644155636757817666769098419715460021313474.537OpenBenchmarking.org

Dbench

Client Count: 12

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12EXT4F2FSBtrfsXFSBcachefs14002800420056007000SE +/- 5.27, N = 3SE +/- 12.71, N = 3SE +/- 7.42, N = 3SE +/- 1.83, N = 3SE +/- 3.41, N = 35057.886756.042061.205777.243229.781. (CC) gcc options: -lpopt -O2

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.36Type: Sequential Read - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test DirectoryBcachefs15003000450060007500SE +/- 35.33, N = 1471861. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

CockroachDB

Workload: KV, 60% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 256EXT4F2FSBtrfsXFSBcachefs20K40K60K80K100KSE +/- 291.24, N = 3SE +/- 1635.56, N = 15SE +/- 695.82, N = 3SE +/- 1480.60, N = 15SE +/- 1084.81, N = 15106658.5101341.999639.7101495.3102296.8

MariaDB

Test: oltp_update_non_index - Threads: 64

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB 11.5Test: oltp_update_non_index - Threads: 64EXT4F2FSBtrfsXFSBcachefs40K80K120K160K200KSE +/- 162.81, N = 3SE +/- 374.96, N = 3SE +/- 352.18, N = 3SE +/- 224.91, N = 3SE +/- 142.43, N = 318391318656247826185630158127-shared -lrt -lstdc++-lcrypt -laio -lnuma -lssl -lcrypto-shared -lrt -lstdc++-shared -lrt -lstdc++-shared -lrt -lstdc++1. (CXX) g++ options: -fPIC -pie -fstack-protector -O3 -lpthread -lz -ldl -lm

CockroachDB

Workload: KV, 50% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 256EXT4F2FSBtrfsXFSBcachefs20K40K60K80K100KSE +/- 1094.28, N = 15SE +/- 1260.51, N = 3SE +/- 981.48, N = 5SE +/- 327.73, N = 3SE +/- 1082.29, N = 1597936.8100277.088960.7100698.894771.8

Speedb

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read While WritingEXT4F2FSBtrfsXFSBcachefs3M6M9M12M15MSE +/- 124696.22, N = 15SE +/- 110325.78, N = 15SE +/- 115159.19, N = 6SE +/- 86255.08, N = 3SE +/- 114927.82, N = 1512274192121934301207097512275021121107881. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.36Type: Sequential Read - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFSBcachefs13002600390052006500SE +/- 6.74, N = 3SE +/- 5.24, N = 3SE +/- 13.01, N = 3SE +/- 5.69, N = 3SE +/- 121.50, N = 15594161105981609237121. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyEXT4F2FSBtrfsXFSBcachefs1020304050SE +/- 0.08, N = 3SE +/- 0.20, N = 3SE +/- 0.14, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 315.7521.4941.6415.5024.061. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteEXT4F2FSBtrfsXFSBcachefs14K28K42K56K70KSE +/- 307.92, N = 3SE +/- 444.74, N = 3SE +/- 78.26, N = 3SE +/- 375.90, N = 3SE +/- 150.28, N = 363511465492401664519415561. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Speedb

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random FillEXT4F2FSBtrfsXFSBcachefs80K160K240K320K400KSE +/- 1260.12, N = 3SE +/- 207.63, N = 3SE +/- 846.81, N = 3SE +/- 15517.10, N = 12SE +/- 104.11, N = 33711313688063694703557213675781. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.36Type: Random Read - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFSBcachefs40K80K120K160K200KSE +/- 333.33, N = 3SE +/- 333.33, N = 3SE +/- 577.35, N = 3SE +/- 577.35, N = 3SE +/- 2185.81, N = 32036672033331390002050001766671. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.36Type: Random Read - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFSBcachefs2004006008001000SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 1.67, N = 3SE +/- 2.52, N = 3SE +/- 8.84, N = 37957945438006901. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.36Type: Sequential Write - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFSBcachefs9001800270036004500SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 1.45, N = 3SE +/- 0.67, N = 3SE +/- 1.20, N = 340394042136740429841. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.36Type: Sequential Write - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFSBcachefs2K4K6K8K10KSE +/- 1.53, N = 3SE +/- 0.88, N = 3SE +/- 2.91, N = 3SE +/- 1.33, N = 3SE +/- 2.33, N = 3808180872737808619711. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.36Type: Random Write - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFSBcachefs30K60K90K120K150KSE +/- 577.35, N = 3SE +/- 0.00, N = 3SE +/- 578.31, N = 3SE +/- 0.00, N = 3SE +/- 57.74, N = 313600014700060833130000546001. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.36Type: Random Write - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test DirectoryEXT4F2FSBtrfsXFSBcachefs120240360480600SE +/- 2.19, N = 3SE +/- 0.58, N = 3SE +/- 2.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 35325742375072131. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

MariaDB mariadb-slap

Clients: 32

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB mariadb-slap 11.5Clients: 32EXT4F2FSBtrfsXFSBcachefs30060090012001500SE +/- 3.43, N = 3SE +/- 4.18, N = 3SE +/- 14.43, N = 3SE +/- 7.57, N = 3SE +/- 7.10, N = 3153815381015153613471. (CXX) g++ options: -fPIC -pie -fstack-protector -O3 -shared -lrt -lpthread -lz -ldl -lm -lstdc++

SQLite

Threads / Copies: 4

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.41.2Threads / Copies: 4EXT4F2FSBtrfsXFSBcachefs48121620SE +/- 0.010, N = 3SE +/- 0.099, N = 3SE +/- 0.321, N = 15SE +/- 0.009, N = 3SE +/- 0.055, N = 152.60610.44114.8822.4884.537-lreadline -ltermcap-lreadline -ltermcap-lreadline -ltermcap-lreadline -ltermcap1. (CC) gcc options: -O2 -lz -lm

Phoronix Test Suite v10.8.5