Bcachefs Linux 6.7 Benchmarks

Bcachefs benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2311036-NE-BCACHEFSL97&grw&sor.

Bcachefs Linux 6.7 BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionBcachefsEXT4BtrfsF2FSXFSAMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads)ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS)AMD Device 14d82 x 16 GB DDR5-6000MT/s F5-6000J3038F16G2000GB Samsung SSD 980 PRO 2TB + 2048GB SOLIDIGM SSDPFKKW020X7AMD Radeon 16GB (2124/1218MHz)AMD Navi 31 HDMI/DPASUS MG28UIntel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411Ubuntu 23.106.6.0-phx-bcachefs (x86_64)GNOME Shell 45.0X Server4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.54)GCC 13.2.0 + LLVM 16.0.6BcacheFS3840x2160ext4btrfsf2fsxfsOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- Bcachefs: NONE / errors=remount-ro,relatime,rw / Block Size: 512- EXT4: NONE / errors=remount-ro,relatime,rw / Block Size: 4096- Btrfs: NONE / errors=remount-ro,relatime,rw / Block Size: 4096- F2FS: NONE / errors=remount-ro,relatime,rw / Block Size: 4096- XFS: NONE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Details- Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa601203 Java Details- OpenJDK Runtime Environment (build 11.0.20+8-post-Ubuntu-1ubuntu1)Python Details- Bcachefs: Python 3.11.6Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Vulnerable: Safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Bcachefs Linux 6.7 Benchmarksfio: Rand Read - IO_uring - No - Yes - 4KB - 8 - Default Test Directoryfio: Rand Read - IO_uring - No - Yes - 4KB - 8 - Default Test Directorystartup-time: Seq Reads + Writes - xterm - Default Test Directoryfio: Rand Read - IO_uring - No - Yes - 4KB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - Yes - 4KB - 8 - Default Test Directoryfio: Seq Read - IO_uring - No - Yes - 2MB - 1 - Default Test Directorystartup-time: Seq Reads + Writes - LibreOffice Writer - Default Test Directoryfio: Seq Read - IO_uring - No - Yes - 2MB - 1 - Default Test Directorystartup-time: Seq Reads + Writes - GNOME Terminal - Default Test Directorystartup-time: Only Seq Reads - LibreOffice Writer - Default Test Directorystartup-time: Only Seq Reads - GNOME Terminal - Default Test Directoryfio: Rand Write - IO_uring - No - Yes - 4KB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - Yes - 2MB - 8 - Default Test Directoryfio: Seq Read - IO_uring - No - Yes - 2MB - 8 - Default Test Directoryfio: Seq Write - IO_uring - No - Yes - 2MB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - Yes - 2MB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - Yes - 2MB - 8 - Default Test Directoryfio: Seq Write - IO_uring - No - Yes - 2MB - 8 - Default Test Directoryfio: Rand Write - IO_uring - No - Yes - 4KB - 8 - Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeduckdb: TPC-H Parquetnginx: 500apache-iotdb: 800 - 100 - 500 - 400apache-iotdb: 800 - 100 - 500 - 400clickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Runsqlite: 1sqlite: 2sqlite: 4pgbench: 1000 - 800 - Read Writepgbench: 1000 - 800 - Read Write - Average Latencystartup-time: Only Seq Reads - xterm - Default Test Directorysqlite: 8BcachefsEXT4BtrfsF2FSXFS303113.71757780.24263976162400234853.740.48666724270.7273330.3820000.519000373504901.2824512461.6312311263.51632199.3651.6201.797.489173189.6166327842268.00212.92247.05246.2012.82818.95921.9337562108.2030.18177824.2854172.5310681670.20586137074613470066112.060.53177830560.6437780.4428890.4870562880276252.5931265559.4527805582.582791748.9981.6447.394.596176467.1166828851270.70239.03267.34266.497.61810.50013.2751963141.1400.16374118.7333162.168095131.00144252620795726184.311.9323430923.023472.148783.46144777606065.9830334728.9523644781.962391650.01993.6677.895.898164208.0968886304264.66236.45266.61270.8017.23527.00827.5713155125.3711.1276130.0104164.1910660320.1602783768893629846290.370.28155631450.3367780.2893330.3558332685576296.2231485615.7728085552.932776790.32258.2641.198.787174634.9470210625255.63237.60264.44268.579.33110.99516.9472785628.7290.17050018.0054140.3210599220.21358337542014079456165.180.57344430830.6617780.4436660.5188332991636237.2531185547.5327745499.9127505499.781151.81513.4235.293.109177367.2470190661258.41240.47270.38273.777.70410.19512.6194374918.2890.18152424.109OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 4KB - Job Count: 8 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 4KB - Job Count: 8 - Disk Target: Default Test DirectoryBcachefsEXT4F2FSXFSBtrfs60K120K180K240K300KSE +/- 2910.36, N = 6SE +/- 46.08, N = 15SE +/- 48.15, N = 15SE +/- 53.06, N = 14SE +/- 8.01, N = 3303113.714172.534164.194140.323162.16MIN: 297377.67 / MAX: 317335.741. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 4KB - Job Count: 8 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 4KB - Job Count: 8 - Disk Target: Default Test DirectoryEXT4F2FSXFSBtrfsBcachefs200K400K600K800K1000KSE +/- 11797.21, N = 15SE +/- 12325.85, N = 15SE +/- 13582.99, N = 14SE +/- 2050.88, N = 3SE +/- 727.59, N = 610681671066032105992280951375778MIN: 1039508.21 / MAX: 1230002.04MIN: 1026726.21 / MAX: 1230497.8MIN: 1022842.76 / MAX: 1231799.82MIN: 806653.2 / MAX: 813489.181. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Application Start-up Time

Background I/O Mix: Sequential Reads + Writes - Application To Start: xterm - Disk Target: Default Test Directory

OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: xterm - Disk Target: Default Test DirectoryF2FSEXT4XFSBcachefsBtrfs0.22530.45060.67590.90121.1265SE +/- 0.003985, N = 12SE +/- 0.002191, N = 12SE +/- 0.004156, N = 12SE +/- 0.002923, N = 12SE +/- 0.009624, N = 30.1602780.2058610.2135830.2426391.001440

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryF2FSXFSEXT4BtrfsBcachefs80K160K240K320K400KSE +/- 811.99, N = 3SE +/- 2446.50, N = 3SE +/- 2792.67, N = 3SE +/- 1602.80, N = 3SE +/- 569.75, N = 1537688937542037074625262076162MIN: 375794.76 / MAX: 378475.42MIN: 370802.87 / MAX: 379130.97MIN: 365747.42 / MAX: 375403.37MIN: 249668.66 / MAX: 255179.14MIN: 73658.17 / MAX: 80946.091. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 4KB - Job Count: 8 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 4KB - Job Count: 8 - Disk Target: Default Test DirectoryXFSEXT4F2FSBtrfsBcachefs300K600K900K1200K1500KSE +/- 717.34, N = 3SE +/- 16634.48, N = 15SE +/- 4136.29, N = 4SE +/- 660.10, N = 15SE +/- 566.87, N = 15140794513470063629847957240023MIN: 1406672.14 / MAX: 1409154.7MIN: 1239048.22 / MAX: 1414090.84MIN: 357966.22 / MAX: 375302.331. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 2MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 2MB - Job Count: 1 - Disk Target: Default Test DirectoryF2FSBtrfsXFSEXT4Bcachefs13002600390052006500SE +/- 67.61, N = 12SE +/- 70.88, N = 13SE +/- 70.33, N = 3SE +/- 33.48, N = 3SE +/- 140.63, N = 146290.376184.316165.186112.064853.74MIN: 6110.26 / MAX: 7018.12MIN: 6041.9 / MAX: 7020.39MIN: 6043.66 / MAX: 6287.3MIN: 6051.52 / MAX: 6167.11MIN: 4538.06 / MAX: 6621.811. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Application Start-up Time

Background I/O Mix: Sequential Reads + Writes - Application To Start: LibreOffice Writer - Disk Target: Default Test Directory

OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: LibreOffice Writer - Disk Target: Default Test DirectoryF2FSBcachefsEXT4XFSBtrfs0.43480.86961.30441.73922.174SE +/- 0.002724, N = 3SE +/- 0.004446, N = 6SE +/- 0.002452, N = 3SE +/- 0.003279, N = 3SE +/- 0.011624, N = 30.2815560.4866670.5317780.5734441.932340

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 2MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 2MB - Job Count: 1 - Disk Target: Default Test DirectoryF2FSBtrfsXFSEXT4Bcachefs7001400210028003500SE +/- 33.81, N = 12SE +/- 35.44, N = 13SE +/- 35.16, N = 3SE +/- 16.74, N = 3SE +/- 70.31, N = 1431453092308330562427MIN: 3055.12 / MAX: 3509.06MIN: 3020.94 / MAX: 3510.19MIN: 3021.83 / MAX: 3143.64MIN: 3025.76 / MAX: 3083.55MIN: 2269.02 / MAX: 3310.871. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Application Start-up Time

Background I/O Mix: Sequential Reads + Writes - Application To Start: GNOME Terminal - Disk Target: Default Test Directory

OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Sequential Reads + Writes - Application To Start: GNOME Terminal - Disk Target: Default Test DirectoryF2FSEXT4XFSBcachefsBtrfs0.68031.36062.04092.72123.4015SE +/- 0.012354, N = 9SE +/- 0.008880, N = 3SE +/- 0.005964, N = 3SE +/- 0.008395, N = 10SE +/- 0.047895, N = 120.3367780.6437780.6617780.7273333.023470

Application Start-up Time

Background I/O Mix: Only Sequential Reads - Application To Start: LibreOffice Writer - Disk Target: Default Test Directory

OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: LibreOffice Writer - Disk Target: Default Test DirectoryF2FSBcachefsEXT4XFSBtrfs0.48350.9671.45051.9342.4175SE +/- 0.003355, N = 3SE +/- 0.002694, N = 3SE +/- 0.003318, N = 3SE +/- 0.003283, N = 3SE +/- 0.022155, N = 30.2893330.3820000.4428890.4436662.148780

Application Start-up Time

Background I/O Mix: Only Sequential Reads - Application To Start: GNOME Terminal - Disk Target: Default Test Directory

OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: GNOME Terminal - Disk Target: Default Test DirectoryF2FSEXT4XFSBcachefsBtrfs0.77881.55762.33643.11523.894SE +/- 0.008732, N = 12SE +/- 0.003448, N = 12SE +/- 0.004053, N = 12SE +/- 0.002775, N = 3SE +/- 0.024813, N = 30.3558330.4870560.5188330.5190003.461440

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryXFSEXT4F2FSBtrfsBcachefs60K120K180K240K300KSE +/- 717.19, N = 3SE +/- 660.93, N = 3SE +/- 244.81, N = 3SE +/- 858.39, N = 15SE +/- 652.12, N = 152991632880272685577776037350MIN: 297780.74 / MAX: 300185.54MIN: 286852.76 / MAX: 289139.8MIN: 268068 / MAX: 268820.75MIN: 74100.36 / MAX: 85019.83MIN: 32943.45 / MAX: 40962.481. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 2MB - Job Count: 8 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 2MB - Job Count: 8 - Disk Target: Default Test DirectoryF2FSEXT4XFSBtrfsBcachefs13002600390052006500SE +/- 50.62, N = 9SE +/- 64.89, N = 5SE +/- 67.10, N = 5SE +/- 41.29, N = 15SE +/- 50.05, N = 156296.226252.596237.256065.984901.28MIN: 6119.52 / MAX: 6673.78MIN: 6132.64 / MAX: 6500.51MIN: 6120.08 / MAX: 6500.26MIN: 5658.18 / MAX: 6484.12MIN: 4710.38 / MAX: 5357.721. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 2MB - Job Count: 8 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 2MB - Job Count: 8 - Disk Target: Default Test DirectoryF2FSEXT4XFSBtrfsBcachefs7001400210028003500SE +/- 25.31, N = 9SE +/- 32.45, N = 5SE +/- 33.57, N = 5SE +/- 20.64, N = 15SE +/- 25.03, N = 1531483126311830332451MIN: 3059.68 / MAX: 3336.7MIN: 3066.14 / MAX: 3250.13MIN: 3059.87 / MAX: 3250.07MIN: 2829.03 / MAX: 3241.97MIN: 2355.14 / MAX: 2678.791. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 2MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 2MB - Job Count: 1 - Disk Target: Default Test DirectoryF2FSEXT4XFSBtrfsBcachefs12002400360048006000SE +/- 61.25, N = 4SE +/- 33.23, N = 3SE +/- 32.05, N = 3SE +/- 50.53, N = 5SE +/- 100.65, N = 155615.775559.455547.534728.952461.63MIN: 5501.73 / MAX: 5789.5MIN: 5495.61 / MAX: 5607.4MIN: 5483.6 / MAX: 5583.57MIN: 4530.31 / MAX: 4797.4MIN: 1772.46 / MAX: 3002.831. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 2MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 2MB - Job Count: 1 - Disk Target: Default Test DirectoryF2FSEXT4XFSBtrfsBcachefs6001200180024003000SE +/- 30.62, N = 4SE +/- 16.62, N = 3SE +/- 16.02, N = 3SE +/- 25.26, N = 5SE +/- 50.33, N = 1528082780277423641231MIN: 2750.85 / MAX: 2894.73MIN: 2747.78 / MAX: 2803.68MIN: 2741.78 / MAX: 2791.75MIN: 2265.05 / MAX: 2398.5MIN: 886.2 / MAX: 1501.381. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 2MB - Job Count: 8 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 2MB - Job Count: 8 - Disk Target: Default Test DirectoryEXT4F2FSXFSBtrfsBcachefs12002400360048006000SE +/- 47.29, N = 3SE +/- 49.27, N = 7SE +/- 61.45, N = 5SE +/- 80.34, N = 15SE +/- 33.52, N = 155582.585552.935499.914781.961263.51MIN: 5499.3 / MAX: 5663.06MIN: 5467.43 / MAX: 5834.39MIN: 5410.39 / MAX: 5737.43MIN: 4419.75 / MAX: 5541.81MIN: 1131.89 / MAX: 15671. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 2MB - Job Count: 8 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 2MB - Job Count: 8 - Disk Target: Default Test DirectoryEXT4F2FSXFSBtrfsBcachefs6001200180024003000SE +/- 23.64, N = 3SE +/- 24.62, N = 7SE +/- 30.72, N = 5SE +/- 40.17, N = 15SE +/- 16.76, N = 152791277627502391632MIN: 2749.5 / MAX: 2831.35MIN: 2733.64 / MAX: 2916.99MIN: 2705.07 / MAX: 2868.6MIN: 2209.68 / MAX: 2770.82MIN: 565.92 / MAX: 783.491. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 4KB - Job Count: 8 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: Yes - Block Size: 4KB - Job Count: 8 - Disk Target: Default Test DirectoryXFS12002400360048006000SE +/- 2.80, N = 35499.78MIN: 5494.81 / MAX: 5504.511. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeXFSF2FSEXT4BtrfsBcachefs2004006008001000SE +/- 2.38, N = 3SE +/- 8.77, N = 3SE +/- 6.83, N = 3SE +/- 18.54, N = 15SE +/- 1.04, N = 31151.8790.3748.9650.0199.3

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsF2FSBtrfsXFSEXT4Bcachefs5001000150020002500SE +/- 2.51, N = 3SE +/- 28.10, N = 3SE +/- 329.80, N = 9SE +/- 259.08, N = 9SE +/- 37.17, N = 92258.21993.61513.4981.6651.6

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeBtrfsF2FSEXT4XFSBcachefs150300450600750SE +/- 5.44, N = 12SE +/- 70.16, N = 14SE +/- 83.39, N = 12SE +/- 0.57, N = 3SE +/- 2.75, N = 3677.8641.1447.3235.2201.7

DuckDB

Benchmark: TPC-H Parquet

OpenBenchmarking.orgSeconds, Fewer Is BetterDuckDB 0.9.1Benchmark: TPC-H ParquetXFSEXT4BtrfsBcachefsF2FS20406080100SE +/- 0.19, N = 3SE +/- 0.09, N = 3SE +/- 0.37, N = 3SE +/- 0.58, N = 3SE +/- 0.57, N = 393.1194.6095.9097.4998.791. (CXX) g++ options: -O3 -rdynamic -lssl -lcrypto -ldl

nginx

Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500XFSEXT4F2FSBcachefsBtrfs40K80K120K160K200KSE +/- 287.75, N = 3SE +/- 175.02, N = 3SE +/- 105.74, N = 3SE +/- 265.35, N = 3SE +/- 53.17, N = 3177367.24176467.11174634.94173189.61164208.091. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400F2FSXFSBtrfsEXT4Bcachefs15M30M45M60M75MSE +/- 155319.69, N = 3SE +/- 831053.70, N = 3SE +/- 563599.21, N = 3SE +/- 480213.11, N = 12SE +/- 649405.71, N = 37021062570190661688863046682885166327842

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400F2FSXFSBtrfsBcachefsEXT460120180240300SE +/- 1.86, N = 3SE +/- 6.17, N = 3SE +/- 3.04, N = 3SE +/- 5.31, N = 3SE +/- 1.71, N = 12255.63258.41264.66268.00270.70MAX: 26895.84MAX: 27048.64MAX: 27208.91MAX: 37923.24MAX: 32210.43

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheXFSEXT4F2FSBtrfsBcachefs50100150200250SE +/- 2.27, N = 7SE +/- 1.66, N = 3SE +/- 2.86, N = 4SE +/- 2.06, N = 8SE +/- 1.03, N = 3240.47239.03237.60236.45212.92MIN: 14.37 / MAX: 8571.43MIN: 12.72 / MAX: 7500MIN: 12.66 / MAX: 8571.43MIN: 11.55 / MAX: 8571.43MIN: 12.92 / MAX: 6666.67

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunXFSEXT4BtrfsF2FSBcachefs60120180240300SE +/- 0.57, N = 7SE +/- 2.43, N = 3SE +/- 1.97, N = 8SE +/- 1.40, N = 4SE +/- 1.20, N = 3270.38267.34266.61264.44247.05MIN: 15.02 / MAX: 10000MIN: 14.9 / MAX: 10000MIN: 14.4 / MAX: 12000MIN: 16.82 / MAX: 10000MIN: 16.58 / MAX: 8571.43

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunXFSBtrfsF2FSEXT4Bcachefs60120180240300SE +/- 1.06, N = 7SE +/- 1.93, N = 8SE +/- 1.79, N = 4SE +/- 1.37, N = 3SE +/- 3.01, N = 3273.77270.80268.57266.49246.20MIN: 14.93 / MAX: 10000MIN: 14.52 / MAX: 12000MIN: 14.87 / MAX: 10000MIN: 14.91 / MAX: 7500MIN: 14.29 / MAX: 10000

SQLite

Threads / Copies: 1

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.41.2Threads / Copies: 1EXT4XFSF2FSBcachefsBtrfs48121620SE +/- 0.002, N = 3SE +/- 0.004, N = 3SE +/- 0.002, N = 3SE +/- 0.018, N = 3SE +/- 0.039, N = 37.6187.7049.33112.82817.2351. (CC) gcc options: -O2 -lz -lm

SQLite

Threads / Copies: 2

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.41.2Threads / Copies: 2XFSEXT4F2FSBcachefsBtrfs612182430SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.13, N = 3SE +/- 0.14, N = 3SE +/- 0.17, N = 310.2010.5011.0018.9627.011. (CC) gcc options: -O2 -lz -lm

SQLite

Threads / Copies: 4

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.41.2Threads / Copies: 4XFSEXT4F2FSBcachefsBtrfs612182430SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.13, N = 10SE +/- 0.04, N = 3SE +/- 0.29, N = 312.6213.2816.9521.9327.571. (CC) gcc options: -O2 -lz -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 800 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 800 - Mode: Read WriteXFSBtrfsF2FSEXT4Bcachefs9K18K27K36K45KSE +/- 395.03, N = 3SE +/- 230.46, N = 12SE +/- 372.92, N = 3SE +/- 666.75, N = 9SE +/- 361.54, N = 124374931551278561963175621. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 800 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 800 - Mode: Read Write - Average LatencyXFSBtrfsF2FSEXT4Bcachefs20406080100SE +/- 0.16, N = 3SE +/- 0.19, N = 12SE +/- 0.38, N = 3SE +/- 1.44, N = 9SE +/- 4.62, N = 1218.2925.3728.7341.14108.201. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Application Start-up Time

Background I/O Mix: Only Sequential Reads - Application To Start: xterm - Disk Target: Default Test Directory

OpenBenchmarking.orgsec, Fewer Is BetterApplication Start-up Time 3.4.0Background I/O Mix: Only Sequential Reads - Application To Start: xterm - Disk Target: Default Test DirectoryEXT4F2FSXFSBcachefsBtrfs0.25370.50740.76111.01481.2685SE +/- 0.004034, N = 9SE +/- 0.002632, N = 12SE +/- 0.001577, N = 7SE +/- 0.001495, N = 3SE +/- 0.014067, N = 120.1637410.1705000.1815240.1817781.127610

SQLite

Threads / Copies: 8

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.41.2Threads / Copies: 8F2FSEXT4XFSBcachefsBtrfs714212835SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.15, N = 3SE +/- 0.40, N = 318.0118.7324.1124.2930.011. (CC) gcc options: -O2 -lz -lm

Phoronix Test Suite v10.8.5