TestPCIe 2 x Intel Xeon Gold 5215 testing with a Supermicro X11DPG-OT-CPU v1.01 (3.3 BIOS) and NVIDIA Quadro RTX 6000 24GB on Ubuntu 20.04 via the Phoronix Test Suite. TestPCIe1: Processor: 2 x Intel Xeon Gold 5215 @ 3.40GHz (20 Cores / 40 Threads), Motherboard: Supermicro X11DPG-OT-CPU v1.01 (3.3 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 504GB, Disk: 1024GB Samsung SSD 970 PRO 1TB + 8 x 3841GB TOSHIBA KHK61RSE, Graphics: NVIDIA Quadro RTX 6000 24GB (465/810MHz), Audio: NVIDIA TU102 HD Audio, Network: 2 x Intel X722 for 10GBASE-T OS: Ubuntu 20.04, Kernel: 5.4.0-40-generic (x86_64), Desktop: GNOME Shell 3.36.2, Display Server: X Server 1.20.8, Display Driver: NVIDIA 440.100, OpenGL: 4.6.0, Compiler: GCC 9.3.0 + CUDA 10.1, File-System: ext4, Screen Resolution: 2560x1440 Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 512KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 18460 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 512KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 8159 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: Yes - Direct: Yes - Block Size: 512KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 2422 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: Yes - Direct: Yes - Block Size: 512KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1211 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 2243 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1123 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: Yes - Direct: Yes - Block Size: 64KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 17100 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: Yes - Direct: Yes - Block Size: 64KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1081 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: Yes - Block Size: 8KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 136400 |=========================================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: Yes - Block Size: 8KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1066 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: Yes - Block Size: 512KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 2264 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: Yes - Block Size: 512KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1134 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: Yes - Direct: Yes - Block Size: 512KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 2206 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: Yes - Direct: Yes - Block Size: 512KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1105 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: Yes - Block Size: 64KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 18340 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: Yes - Block Size: 64KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1150 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 18480 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1155 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 16025 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1002 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 19973 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1261 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 144600 |=========================================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1130 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 88320 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 5517 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 104008 |=========================================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 6485 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 17900 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1120 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: Yes - Direct: Yes - Block Size: 8KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 120667 |=========================================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: Yes - Direct: Yes - Block Size: 8KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 944 |============================================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 19167 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 64KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1199 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 2681 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1341 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 2257 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1131 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 2361 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 512KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1182 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: Yes - Block Size: 512KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 2045 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: Yes - Block Size: 512KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1025 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 156000 |=========================================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1218 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: Yes - Direct: Yes - Block Size: 64KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 18567 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: Yes - Direct: Yes - Block Size: 64KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1161 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: Yes - Block Size: 64KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 16033 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: Yes - Block Size: 64KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1001 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 144333 |=========================================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1128 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 139333 |=========================================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1089 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 512KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 18000 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 512KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 8352 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: Yes - Block Size: 8KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 120667 |=========================================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: Yes - Block Size: 8KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 944 |============================================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: No - Block Size: 8KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 38533 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: No - Block Size: 8KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 301 |============================================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 38400 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 300 |============================================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 512KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 4429 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 512KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 2215 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 17967 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1124 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 19100 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1194 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: No - Block Size: 512KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 4781 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: No - Block Size: 512KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 2391 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 19467 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1239 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 512KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 4548 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 512KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 2276 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 171667 |=========================================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1341 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 36100 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 8KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 282 |============================================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: Yes - Direct: Yes - Block Size: 8KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 157667 |=========================================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: Sync - Buffered: Yes - Direct: Yes - Block Size: 8KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1232 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: No - Block Size: 512KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 4497 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: No - Block Size: 512KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 2250 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 137333 |=========================================================== Flexible IO Tester 3.18 Type: Sequential Write - Engine: IO_uring - Buffered: Yes - Direct: No - Block Size: 8KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 1073 |============================================================= Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: No - Block Size: 8KB - Disk Target: /media/adrien/tempDrive IOPS > Higher Is Better TestPCIe1 . 37667 |============================================================ Flexible IO Tester 3.18 Type: Sequential Write - Engine: POSIX AIO - Buffered: No - Direct: No - Block Size: 8KB - Disk Target: /media/adrien/tempDrive MB/s > Higher Is Better TestPCIe1 . 294 |==============================================================