Bcachefs Linux File-System Testing + Benchmarks Bcachefs Linux file-system benchmarking against Btrfs, EXT4, F2FS, and XFS on an HDD and SSD. Benchmarks by Michael Larabel for a future article. HDD: Bcachefs: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.00 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 12 x 8192 MB DDR4-2666MT/s Micron 9ASF1G72PZ-2G6B1, Disk: 256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150, Graphics: ASPEED ASPEED Family, Monitor: VE228, Network: Intel I210 Gigabit Connection OS: Ubuntu 18.04, Kernel: 4.16.0-bcachefs (x86_64), Desktop: GNOME Shell 3.28.1, Compiler: GCC 7.3.0, File-System: BcacheFS, Screen Resolution: 1920x1080 HDD: Btrfs: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.00 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 12 x 8192 MB DDR4-2666MT/s Micron 9ASF1G72PZ-2G6B1, Disk: 256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150, Graphics: ASPEED ASPEED Family, Monitor: VE228, Network: Intel I210 Gigabit Connection OS: Ubuntu 18.04, Kernel: 4.16.0-bcachefs (x86_64), Desktop: GNOME Shell 3.28.1, Compiler: GCC 7.3.0, File-System: btrfs, Screen Resolution: 1920x1080 HDD: EXT4: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.00 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 12 x 8192 MB DDR4-2666MT/s Micron 9ASF1G72PZ-2G6B1, Disk: 256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150, Graphics: ASPEED ASPEED Family, Monitor: VE228, Network: Intel I210 Gigabit Connection OS: Ubuntu 18.04, Kernel: 4.16.0-bcachefs (x86_64), Desktop: GNOME Shell 3.28.1, Compiler: GCC 7.3.0, File-System: ext4, Screen Resolution: 1920x1080 HDD: XFS: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.00 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 12 x 8192 MB DDR4-2666MT/s Micron 9ASF1G72PZ-2G6B1, Disk: 256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150, Graphics: ASPEED ASPEED Family, Monitor: VE228, Network: Intel I210 Gigabit Connection OS: Ubuntu 18.04, Kernel: 4.16.0-bcachefs (x86_64), Desktop: GNOME Shell 3.28.1, Compiler: GCC 7.3.0, File-System: xfs, Screen Resolution: 1920x1080 SSD: Bcachefs: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.00 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 12 x 8192 MB DDR4-2666MT/s Micron 9ASF1G72PZ-2G6B1, Disk: 256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150, Graphics: ASPEED ASPEED Family, Monitor: VE228, Network: Intel I210 Gigabit Connection OS: Ubuntu 18.04, Kernel: 4.16.0-bcachefs (x86_64), Desktop: GNOME Shell 3.28.1, Compiler: GCC 7.3.0, File-System: BcacheFS, Screen Resolution: 1920x1080 SSD: Btrfs: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.00 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 12 x 8192 MB DDR4-2666MT/s Micron 9ASF1G72PZ-2G6B1, Disk: 256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150, Graphics: ASPEED ASPEED Family, Monitor: VE228, Network: Intel I210 Gigabit Connection OS: Ubuntu 18.04, Kernel: 4.16.0-bcachefs (x86_64), Desktop: GNOME Shell 3.28.1, Compiler: GCC 7.3.0, File-System: btrfs, Screen Resolution: 1920x1080 SSD: EXT4: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.00 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 12 x 8192 MB DDR4-2666MT/s Micron 9ASF1G72PZ-2G6B1, Disk: 256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150, Graphics: ASPEED ASPEED Family, Monitor: VE228, Network: Intel I210 Gigabit Connection OS: Ubuntu 18.04, Kernel: 4.16.0-bcachefs (x86_64), Desktop: GNOME Shell 3.28.1, Compiler: GCC 7.3.0, File-System: ext4, Screen Resolution: 1920x1080 SSD: F2FS: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.00 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 12 x 8192 MB DDR4-2666MT/s Micron 9ASF1G72PZ-2G6B1, Disk: 256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150, Graphics: ASPEED ASPEED Family, Monitor: VE228, Network: Intel I210 Gigabit Connection OS: Ubuntu 18.04, Kernel: 4.16.0-bcachefs (x86_64), Desktop: GNOME Shell 3.28.1, Compiler: GCC 7.3.0, File-System: f2fs, Screen Resolution: 1920x1080 SSD: XFS: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.00 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 12 x 8192 MB DDR4-2666MT/s Micron 9ASF1G72PZ-2G6B1, Disk: 256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150, Graphics: ASPEED ASPEED Family, Monitor: VE228, Network: Intel I210 Gigabit Connection OS: Ubuntu 18.04, Kernel: 4.16.0-bcachefs (x86_64), Desktop: GNOME Shell 3.28.1, Compiler: GCC 7.3.0, File-System: xfs, Screen Resolution: 1920x1080 Application Start-up Time 2.3.0 Background I/O Mix: Only Sequential Reads - Application To Start: GNOME Terminal sec < Lower Is Better HDD: Bcachefs . 5.29 |======================================================== HDD: Btrfs .... 5.27 |======================================================== HDD: EXT4 ..... 5.36 |========================================================= HDD: XFS ...... 5.31 |======================================================== SSD: Bcachefs . 5.36 |========================================================= SSD: Btrfs .... 5.34 |========================================================= SSD: EXT4 ..... 5.28 |======================================================== SSD: F2FS ..... 5.38 |========================================================= SSD: XFS ...... 5.30 |======================================================== Application Start-up Time 2.3.0 Background I/O Mix: Sequential Reads + Writes - Application To Start: GNOME Terminal sec < Lower Is Better HDD: Bcachefs . 48.12 |================================================= HDD: Btrfs .... 49.66 |=================================================== HDD: EXT4 ..... 52.52 |====================================================== HDD: XFS ...... 50.00 |=================================================== SSD: Bcachefs . 49.88 |=================================================== SSD: Btrfs .... 54.79 |======================================================== SSD: EXT4 ..... 54.20 |======================================================= SSD: F2FS ..... 50.45 |==================================================== SSD: XFS ...... 47.57 |================================================= SQLite 3.22 Timed SQLite Insertions Seconds < Lower Is Better HDD: Bcachefs . 707.37 |====================================== HDD: Btrfs .... 1010.42 |====================================================== HDD: EXT4 ..... 685.20 |===================================== HDD: XFS ...... 407.93 |====================== SSD: Bcachefs . 58.45 |=== SSD: Btrfs .... 87.64 |===== SSD: EXT4 ..... 40.98 |== SSD: F2FS ..... 34.30 |== SSD: XFS ...... 36.98 |== Flexible IO Tester 3.1 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better HDD: Bcachefs . 1.39 | HDD: Btrfs .... 1.53 | HDD: EXT4 ..... 1.55 | HDD: XFS ...... 1.56 | SSD: Bcachefs . 33.57 |======== SSD: Btrfs .... 210.00 |=================================================== SSD: EXT4 ..... 225.00 |======================================================= SSD: F2FS ..... 213.00 |==================================================== SSD: XFS ...... 211.00 |==================================================== Flexible IO Tester 3.1 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better HDD: Bcachefs . 85.53 |================= HDD: Btrfs .... 28.23 |====== HDD: EXT4 ..... 1.07 | HDD: XFS ...... 1.20 | SSD: Bcachefs . 50.43 |========== SSD: Btrfs .... 80.15 |================ SSD: EXT4 ..... 280.00 |======================================================= SSD: F2FS ..... 280.00 |======================================================= SSD: XFS ...... 271.00 |===================================================== Flexible IO Tester 3.1 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better HDD: Bcachefs . 21967 |================= HDD: Btrfs .... 16550 |============= SSD: Bcachefs . 12900 |========== SSD: Btrfs .... 20567 |================ SSD: EXT4 ..... 71833 |======================================================== SSD: F2FS ..... 71700 |======================================================== SSD: XFS ...... 69433 |====================================================== Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better HDD: Bcachefs . 1.61 | HDD: Btrfs .... 1.49 | HDD: EXT4 ..... 162.00 |======================================= HDD: XFS ...... 181.00 |=========================================== SSD: Bcachefs . 197.00 |=============================================== SSD: Btrfs .... 231.00 |======================================================= SSD: EXT4 ..... 211.00 |================================================== SSD: F2FS ..... 225.00 |====================================================== SSD: XFS ...... 202.00 |================================================ Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better HDD: EXT4 ..... 41433 |======================================= HDD: XFS ...... 46300 |============================================ SSD: Bcachefs . 50333 |================================================ SSD: Btrfs .... 59150 |======================================================== SSD: EXT4 ..... 54000 |=================================================== SSD: F2FS ..... 57633 |======================================================= SSD: XFS ...... 51567 |================================================= Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better HDD: Bcachefs . 81.07 |=========== HDD: Btrfs .... 4.16 |= HDD: EXT4 ..... 155.00 |===================== HDD: XFS ...... 177.00 |======================= SSD: Bcachefs . 47.80 |====== SSD: Btrfs .... 82.35 |=========== SSD: EXT4 ..... 415.00 |======================================================= SSD: F2FS ..... 411.00 |====================================================== SSD: XFS ...... 376.00 |================================================== Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better HDD: Bcachefs . 20433 |=========== HDD: EXT4 ..... 39767 |===================== HDD: XFS ...... 45175 |======================= SSD: Bcachefs . 11900 |====== SSD: Btrfs .... 21100 |=========== SSD: EXT4 ..... 106667 |======================================================= SSD: F2FS ..... 105000 |====================================================== SSD: XFS ...... 95783 |================================================= FS-Mark 3.3 Test: 1000 Files, 1MB Size Files/s > Higher Is Better HDD: Bcachefs . 22.17 |============= HDD: Btrfs .... 23.17 |============= HDD: EXT4 ..... 17.63 |========== HDD: XFS ...... 19.83 |============ SSD: Bcachefs . 48.63 |============================ SSD: Btrfs .... 77.00 |============================================= SSD: EXT4 ..... 57.97 |================================== SSD: F2FS ..... 57.42 |================================= SSD: XFS ...... 96.37 |======================================================== FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Files/s > Higher Is Better HDD: Bcachefs . 34.57 |===================================== HDD: Btrfs .... 37.87 |========================================= HDD: EXT4 ..... 45.47 |================================================= HDD: XFS ...... 36.67 |======================================= SSD: Bcachefs . 50.93 |======================================================= SSD: Btrfs .... 50.70 |====================================================== SSD: EXT4 ..... 50.67 |====================================================== SSD: F2FS ..... 51.20 |======================================================= SSD: XFS ...... 52.30 |======================================================== FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size Files/s > Higher Is Better HDD: Bcachefs . 21.30 |=========================== HDD: Btrfs .... 21.23 |=========================== HDD: EXT4 ..... 17.30 |====================== HDD: XFS ...... 19.85 |========================= SSD: Bcachefs . 44.35 |======================================================== SSD: Btrfs .... 44.70 |======================================================== SSD: EXT4 ..... 41.28 |==================================================== SSD: F2FS ..... 44.55 |======================================================== SSD: XFS ...... 43.40 |====================================================== Dbench 4.0 Client Count: 6 MB/s > Higher Is Better HDD: Bcachefs . 30.12 |==== HDD: Btrfs .... 42.82 |===== HDD: EXT4 ..... 18.96 |== HDD: XFS ...... 17.96 |== SSD: Bcachefs . 313.21 |======================================= SSD: Btrfs .... 243.17 |============================== SSD: EXT4 ..... 358.53 |============================================= SSD: F2FS ..... 277.63 |=================================== SSD: XFS ...... 438.73 |======================================================= IOzone 3.465 Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance MB/s > Higher Is Better HDD: Bcachefs . 136.31 |============================================= HDD: Btrfs .... 166.08 |======================================================= HDD: EXT4 ..... 135.10 |============================================= HDD: XFS ...... 162.08 |====================================================== SSD: Bcachefs . 37.90 |============= SSD: Btrfs .... 92.38 |=============================== SSD: EXT4 ..... 103.93 |================================== SSD: F2FS ..... 88.95 |============================= SSD: XFS ...... 105.69 |=================================== Threaded I/O Tester 20170503 Test: Write - Size Per Thread: 128MB - Thread Count: 16 MB/s > Higher Is Better SSD: Bcachefs . 9.32 |================================================== SSD: Btrfs .... 5.85 |=============================== SSD: EXT4 ..... 10.46 |======================================================== SSD: F2FS ..... 7.37 |======================================= SSD: XFS ...... 8.92 |================================================ Threaded I/O Tester 20170503 Test: Random Write - Size Per Thread: 128MB - Thread Count: 16 MB/s > Higher Is Better SSD: Bcachefs . 268.18 |==================================== SSD: Btrfs .... 94.11 |============= SSD: EXT4 ..... 404.90 |======================================================= SSD: F2FS ..... 126.45 |================= SSD: XFS ...... 396.16 |====================================================== Compile Bench 0.6 Test: Initial Create MB/s > Higher Is Better HDD: Bcachefs . 238.34 |======================= HDD: Btrfs .... 288.90 |============================ HDD: EXT4 ..... 515.36 |=================================================== HDD: XFS ...... 419.41 |========================================= SSD: Bcachefs . 506.97 |================================================== SSD: Btrfs .... 122.68 |============ SSD: EXT4 ..... 519.96 |=================================================== SSD: F2FS ..... 559.40 |======================================================= SSD: XFS ...... 410.11 |======================================== PostgreSQL pgbench 10.3 Scaling: Buffer Test - Test: Normal Load - Mode: Read Write TPS > Higher Is Better HDD: Bcachefs . 625.33 |============== HDD: Btrfs .... 578.88 |============= HDD: EXT4 ..... 313.95 |======= HDD: XFS ...... 304.16 |======= SSD: Bcachefs . 905.24 |==================== SSD: Btrfs .... 1386.00 |============================== SSD: EXT4 ..... 2293.36 |================================================== SSD: F2FS ..... 1600.03 |=================================== SSD: XFS ...... 2485.86 |====================================================== Flexible IO Tester 3.1 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better SSD: Btrfs . 53467 |======================================================= SSD: EXT4 .. 57667 |=========================================================== SSD: F2FS .. 54533 |======================================================== SSD: XFS ... 53700 |=======================================================