New Kernels EPYC 2 x AMD EPYC 9684X 96-Core testing with a AMD Titanite_4G (RTI1007B BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite. Linux 6.5: Processor: 2 x AMD EPYC 9684X 96-Core @ 2.55GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 23.10, Kernel: 6.5.0-060500-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 800x600 Linux 6.7: Processor: 2 x AMD EPYC 9684X 96-Core @ 2.55GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 23.10, Kernel: 6.7.0-060700-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 800x600 Linux 6.6: Processor: 2 x AMD EPYC 9684X 96-Core @ 2.55GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 23.10, Kernel: 6.6.0-060600-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 800x600 Linux 6.8 26 Jan: Processor: 2 x AMD EPYC 9684X 96-Core @ 2.55GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 23.10, Kernel: 6.8.0-060800rc1daily20240126-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 800x600 CacheBench Test: Read MB/s > Higher Is Better Linux 6.5 ........ 9390.24 |=================================================== Linux 6.7 ........ 9389.92 |=================================================== Linux 6.6 ........ 9389.42 |=================================================== Linux 6.8 26 Jan . 9388.76 |=================================================== CacheBench Test: Write MB/s > Higher Is Better Linux 6.5 ........ 56278.61 |================================================== Linux 6.7 ........ 56280.20 |================================================== Linux 6.6 ........ 56272.87 |================================================== Linux 6.8 26 Jan . 56268.96 |================================================== CacheBench Test: Read / Modify / Write MB/s > Higher Is Better Linux 6.5 ........ 107547.07 |================================================= Linux 6.7 ........ 107675.92 |================================================= Linux 6.6 ........ 107670.84 |================================================= Linux 6.8 26 Jan . 107666.91 |================================================= LZ4 Compression 1.9.4 Compression Level: 1 - Compression Speed MB/s > Higher Is Better Linux 6.5 ........ 695.36 |==================================================== Linux 6.7 ........ 694.14 |==================================================== Linux 6.6 ........ 694.66 |==================================================== Linux 6.8 26 Jan . 694.81 |==================================================== LZ4 Compression 1.9.4 Compression Level: 1 - Decompression Speed MB/s > Higher Is Better Linux 6.5 ........ 4492.5 |==================================================== Linux 6.7 ........ 4491.7 |==================================================== Linux 6.6 ........ 4491.4 |==================================================== Linux 6.8 26 Jan . 4490.4 |==================================================== LZ4 Compression 1.9.4 Compression Level: 3 - Compression Speed MB/s > Higher Is Better Linux 6.5 ........ 107.01 |==================================================== Linux 6.7 ........ 106.46 |==================================================== Linux 6.6 ........ 106.65 |==================================================== Linux 6.8 26 Jan . 106.51 |==================================================== LZ4 Compression 1.9.4 Compression Level: 3 - Decompression Speed MB/s > Higher Is Better Linux 6.5 ........ 4072.8 |==================================================== Linux 6.7 ........ 4074.1 |==================================================== Linux 6.6 ........ 4071.6 |==================================================== Linux 6.8 26 Jan . 4073.6 |==================================================== LZ4 Compression 1.9.4 Compression Level: 9 - Compression Speed MB/s > Higher Is Better Linux 6.5 ........ 34.61 |===================================================== Linux 6.7 ........ 34.68 |===================================================== Linux 6.6 ........ 34.65 |===================================================== Linux 6.8 26 Jan . 34.68 |===================================================== LZ4 Compression 1.9.4 Compression Level: 9 - Decompression Speed MB/s > Higher Is Better Linux 6.5 ........ 4270.0 |==================================================== Linux 6.7 ........ 4266.8 |==================================================== Linux 6.6 ........ 4266.4 |==================================================== Linux 6.8 26 Jan . 4265.2 |==================================================== 7-Zip Compression 22.01 Test: Compression Rating MIPS > Higher Is Better Linux 6.5 ........ 876040 |=================================================== Linux 6.7 ........ 889667 |==================================================== Linux 6.6 ........ 874679 |=================================================== Linux 6.8 26 Jan . 876753 |=================================================== 7-Zip Compression 22.01 Test: Decompression Rating MIPS > Higher Is Better Linux 6.5 ........ 1360807 |=================================================== Linux 6.7 ........ 1358817 |=================================================== Linux 6.6 ........ 1351742 |=================================================== Linux 6.8 26 Jan . 1355261 |=================================================== Timed Apache Compilation 2.4.41 Time To Compile Seconds < Lower Is Better Linux 6.5 ........ 20.44 |===================================================== Linux 6.7 ........ 19.97 |==================================================== Linux 6.6 ........ 20.30 |===================================================== Linux 6.8 26 Jan . 19.91 |==================================================== Timed Gem5 Compilation 23.0.1 Time To Compile Seconds < Lower Is Better Linux 6.5 ........ 157.44 |==================================================== Linux 6.7 ........ 153.21 |=================================================== Linux 6.6 ........ 153.72 |=================================================== Linux 6.8 26 Jan . 154.44 |=================================================== Timed Godot Game Engine Compilation 4.0 Time To Compile Seconds < Lower Is Better Linux 6.5 ........ 86.83 |==================================================== Linux 6.7 ........ 87.25 |==================================================== Linux 6.6 ........ 88.34 |===================================================== Linux 6.8 26 Jan . 87.51 |===================================================== Timed Linux Kernel Compilation 6.1 Build: defconfig Seconds < Lower Is Better Linux 6.5 ........ 28.28 |===================================================== Linux 6.7 ........ 27.09 |=================================================== Linux 6.6 ........ 27.60 |==================================================== Linux 6.8 26 Jan . 26.88 |================================================== Timed Linux Kernel Compilation 6.1 Build: allmodconfig Seconds < Lower Is Better Linux 6.5 ........ 168.09 |==================================================== Linux 6.7 ........ 161.38 |================================================== Linux 6.6 ........ 165.56 |=================================================== Linux 6.8 26 Jan . 156.23 |================================================ Timed Node.js Compilation 19.8.1 Time To Compile Seconds < Lower Is Better Linux 6.5 ........ 89.48 |===================================================== Linux 6.7 ........ 88.12 |==================================================== Linux 6.6 ........ 87.68 |==================================================== Linux 6.8 26 Jan . 88.21 |==================================================== Y-Cruncher 0.8.3 Pi Digits To Calculate: 1B Seconds < Lower Is Better Linux 6.5 ........ 8.556 |===================================================== Linux 6.7 ........ 8.606 |===================================================== Linux 6.6 ........ 8.590 |===================================================== Linux 6.8 26 Jan . 8.625 |===================================================== Y-Cruncher 0.8.3 Pi Digits To Calculate: 500M Seconds < Lower Is Better Linux 6.5 ........ 4.284 |==================================================== Linux 6.7 ........ 4.354 |===================================================== Linux 6.6 ........ 4.386 |===================================================== Linux 6.8 26 Jan . 4.363 |===================================================== PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only TPS > Higher Is Better Linux 6.5 ........ 3624464 |================================================== Linux 6.7 ........ 3588755 |================================================= Linux 6.6 ........ 3729700 |=================================================== Linux 6.8 26 Jan . 3731648 |=================================================== PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency ms < Lower Is Better Linux 6.5 ........ 0.276 |==================================================== Linux 6.7 ........ 0.280 |===================================================== Linux 6.6 ........ 0.268 |=================================================== Linux 6.8 26 Jan . 0.268 |=================================================== PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write TPS > Higher Is Better Linux 6.5 ........ 54210 |================================================== Linux 6.7 ........ 57875 |===================================================== Linux 6.6 ........ 53339 |================================================= Linux 6.8 26 Jan . 56119 |=================================================== PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency ms < Lower Is Better Linux 6.5 ........ 18.45 |==================================================== Linux 6.7 ........ 17.35 |================================================= Linux 6.6 ........ 18.75 |===================================================== Linux 6.8 26 Jan . 17.82 |================================================== PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 batches/sec > Higher Is Better Linux 6.5 ........ 23.66 |===================================================== Linux 6.7 ........ 19.23 |=========================================== Linux 6.6 ........ 23.47 |===================================================== Linux 6.8 26 Jan . 19.26 |=========================================== PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 batches/sec > Higher Is Better Linux 6.5 ........ 10.57 |===================================================== Linux 6.7 ........ 8.25 |========================================= Linux 6.6 ........ 10.33 |==================================================== Linux 6.8 26 Jan . 8.31 |========================================== PyTorch 2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 batches/sec > Higher Is Better Linux 6.5 ........ 21.08 |===================================================== Linux 6.7 ........ 17.61 |============================================ Linux 6.6 ........ 20.93 |===================================================== Linux 6.8 26 Jan . 17.43 |============================================ PyTorch 2.1 Device: CPU - Batch Size: 512 - Model: ResNet-152 batches/sec > Higher Is Better Linux 6.5 ........ 8.78 |====================================================== Linux 6.7 ........ 7.20 |============================================ Linux 6.6 ........ 8.72 |====================================================== Linux 6.8 26 Jan . 7.27 |============================================= PyTorch 2.1 Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l batches/sec > Higher Is Better Linux 6.5 ........ 6.54 |====================================================== Linux 6.7 ........ 5.56 |============================================== Linux 6.6 ........ 6.55 |====================================================== Linux 6.8 26 Jan . 5.50 |============================================= PyTorch 2.1 Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l batches/sec > Higher Is Better Linux 6.5 ........ 2.33 |====================================================== Linux 6.7 ........ 1.18 |=========================== Linux 6.6 ........ 1.11 |========================== Linux 6.8 26 Jan . 1.26 |============================= TensorFlow 2.12 Device: CPU - Batch Size: 1 - Model: ResNet-50 images/sec > Higher Is Better Linux 6.5 ........ 2.04 |==================================================== Linux 6.7 ........ 2.08 |===================================================== Linux 6.6 ........ 2.12 |====================================================== Linux 6.8 26 Jan . 2.01 |=================================================== TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: ResNet-50 images/sec > Higher Is Better Linux 6.5 ........ 142.76 |=================================================== Linux 6.7 ........ 144.07 |=================================================== Linux 6.6 ........ 143.21 |=================================================== Linux 6.8 26 Jan . 145.75 |==================================================== Stress-NG 0.16.04 Test: Hash Bogo Ops/s > Higher Is Better Linux 6.5 ........ 42891632.60 |=============================================== Linux 6.7 ........ 42856352.41 |=============================================== Linux 6.6 ........ 42841367.56 |=============================================== Linux 6.8 26 Jan . 42902072.99 |=============================================== Stress-NG 0.16.04 Test: MMAP Bogo Ops/s > Higher Is Better Linux 6.5 ........ 4551.91 |================================================== Linux 6.7 ........ 4627.00 |================================================== Linux 6.6 ........ 4685.26 |=================================================== Linux 6.8 26 Jan . 4270.84 |============================================== Stress-NG 0.16.04 Test: NUMA Bogo Ops/s > Higher Is Better Linux 6.5 ........ 691.43 |==================================================== Linux 6.7 ........ 686.37 |=================================================== Linux 6.6 ........ 679.34 |=================================================== Linux 6.8 26 Jan . 696.82 |==================================================== Stress-NG 0.16.04 Test: Pipe Bogo Ops/s > Higher Is Better Linux 6.5 ........ 71470186.96 |=============================================== Linux 6.7 ........ 61641558.02 |========================================= Linux 6.6 ........ 61084286.26 |======================================== Linux 6.8 26 Jan . 66998085.99 |============================================ Stress-NG 0.16.04 Test: Poll Bogo Ops/s > Higher Is Better Linux 6.5 ........ 13095189.44 |================================ Linux 6.7 ........ 19277506.61 |=============================================== Linux 6.6 ........ 13211019.31 |================================ Linux 6.8 26 Jan . 18907852.31 |============================================== Stress-NG 0.16.04 Test: Zlib Bogo Ops/s > Higher Is Better Linux 6.5 ........ 25361.45 |================================================== Linux 6.7 ........ 25311.81 |================================================== Linux 6.6 ........ 25301.41 |================================================== Linux 6.8 26 Jan . 25320.45 |================================================== Stress-NG 0.16.04 Test: Futex Bogo Ops/s > Higher Is Better Linux 6.5 ........ 2996767.15 |================================================ Linux 6.7 ........ 2410851.80 |======================================= Linux 6.6 ........ 2243204.99 |==================================== Linux 6.8 26 Jan . 2337644.18 |===================================== Stress-NG 0.16.04 Test: MEMFD Bogo Ops/s > Higher Is Better Linux 6.5 ........ 134.12 |======== Linux 6.7 ........ 840.58 |==================================================== Linux 6.6 ........ 834.74 |==================================================== Linux 6.8 26 Jan . 658.67 |========================================= Stress-NG 0.16.04 Test: Mutex Bogo Ops/s > Higher Is Better Linux 6.5 ........ 46761181.37 |============================================== Linux 6.7 ........ 47405607.15 |============================================== Linux 6.6 ........ 44546973.96 |============================================ Linux 6.8 26 Jan . 48020269.46 |=============================================== Stress-NG 0.16.04 Test: Atomic Bogo Ops/s > Higher Is Better Linux 6.5 ........ 187.90 |==================================================== Linux 6.7 ........ 183.27 |=================================================== Linux 6.6 ........ 187.72 |==================================================== Linux 6.8 26 Jan . 182.38 |================================================== Stress-NG 0.16.04 Test: Crypto Bogo Ops/s > Higher Is Better Linux 6.5 ........ 492021.86 |================================================= Linux 6.7 ........ 488178.36 |================================================= Linux 6.6 ........ 488061.57 |================================================= Linux 6.8 26 Jan . 492474.65 |================================================= Stress-NG 0.16.04 Test: Malloc Bogo Ops/s > Higher Is Better Linux 6.5 ........ 339209442.28 |============================================= Linux 6.7 ........ 329981338.54 |============================================ Linux 6.6 ........ 329314591.50 |============================================ Linux 6.8 26 Jan . 345731944.96 |============================================== Stress-NG 0.16.04 Test: Cloning Bogo Ops/s > Higher Is Better Linux 6.5 ........ 11924.37 |================================================== Linux 6.7 ........ 9747.48 |========================================= Linux 6.6 ........ 9532.62 |======================================== Linux 6.8 26 Jan . 9729.15 |========================================= Stress-NG 0.16.04 Test: Forking Bogo Ops/s > Higher Is Better Linux 6.5 ........ 36691.26 |================================================= Linux 6.7 ........ 36748.37 |================================================= Linux 6.6 ........ 37276.20 |================================================== Linux 6.8 26 Jan . 33018.31 |============================================ Stress-NG 0.16.04 Test: Pthread Bogo Ops/s > Higher Is Better Linux 6.5 ........ 58661.31 |=============================================== Linux 6.7 ........ 61798.90 |================================================== Linux 6.6 ........ 60556.77 |================================================= Linux 6.8 26 Jan . 60918.24 |================================================= Stress-NG 0.16.04 Test: AVL Tree Bogo Ops/s > Higher Is Better Linux 6.5 ........ 3637.57 |=================================================== Linux 6.7 ........ 3649.23 |=================================================== Linux 6.6 ........ 3640.53 |=================================================== Linux 6.8 26 Jan . 3643.25 |=================================================== Stress-NG 0.16.04 Test: IO_uring Bogo Ops/s > Higher Is Better Linux 6.5 ........ 9895683.75 |========================== Linux 6.7 ........ 18217916.69 |=============================================== Linux 6.6 ........ 12307832.19 |================================ Linux 6.8 26 Jan . 15943494.88 |========================================= Stress-NG 0.16.04 Test: SENDFILE Bogo Ops/s > Higher Is Better Linux 6.5 ........ 1475163.44 |========================= Linux 6.7 ........ 2503374.61 |========================================== Linux 6.6 ........ 2122557.99 |==================================== Linux 6.8 26 Jan . 2846032.14 |================================================ Stress-NG 0.16.04 Test: CPU Cache Bogo Ops/s > Higher Is Better Linux 6.5 ........ 855185.73 |================================================= Linux 6.7 ........ 824396.72 |=============================================== Linux 6.6 ........ 840635.00 |================================================ Linux 6.8 26 Jan . 862417.29 |================================================= Stress-NG 0.16.04 Test: CPU Stress Bogo Ops/s > Higher Is Better Linux 6.5 ........ 460475.32 |================================================= Linux 6.7 ........ 458555.64 |================================================= Linux 6.6 ........ 460897.89 |================================================= Linux 6.8 26 Jan . 460093.34 |================================================= Stress-NG 0.16.04 Test: Semaphores Bogo Ops/s > Higher Is Better Linux 6.5 ........ 301864524.10 |=========================================== Linux 6.7 ........ 316273290.00 |============================================= Linux 6.6 ........ 294597947.60 |========================================== Linux 6.8 26 Jan . 321848076.37 |============================================== Stress-NG 0.16.04 Test: Matrix Math Bogo Ops/s > Higher Is Better Linux 6.5 ........ 943747.15 |================================================= Linux 6.7 ........ 928621.38 |================================================ Linux 6.6 ........ 944251.03 |================================================= Linux 6.8 26 Jan . 947292.95 |================================================= Stress-NG 0.16.04 Test: Vector Math Bogo Ops/s > Higher Is Better Linux 6.5 ........ 1336243.88 |================================================ Linux 6.7 ........ 1333950.70 |================================================ Linux 6.6 ........ 1332249.56 |================================================ Linux 6.8 26 Jan . 1331024.12 |================================================ Stress-NG 0.16.04 Test: AVX-512 VNNI Bogo Ops/s > Higher Is Better Linux 6.5 ........ 19310087.82 |============================================== Linux 6.7 ........ 19568145.68 |=============================================== Linux 6.6 ........ 19338319.36 |============================================== Linux 6.8 26 Jan . 19514410.29 |=============================================== Stress-NG 0.16.04 Test: Function Call Bogo Ops/s > Higher Is Better Linux 6.5 ........ 158411.00 |================================================= Linux 6.7 ........ 158272.40 |================================================= Linux 6.6 ........ 158205.83 |================================================= Linux 6.8 26 Jan . 158008.66 |================================================= Stress-NG 0.16.04 Test: x86_64 RdRand Bogo Ops/s > Higher Is Better Linux 6.5 ........ 72401267.36 |=============================================== Linux 6.7 ........ 72276580.38 |=============================================== Linux 6.6 ........ 72323675.39 |=============================================== Linux 6.8 26 Jan . 72193736.32 |=============================================== Stress-NG 0.16.04 Test: Floating Point Bogo Ops/s > Higher Is Better Linux 6.5 ........ 66221.40 |================================================== Linux 6.7 ........ 66153.99 |================================================== Linux 6.6 ........ 66160.14 |================================================== Linux 6.8 26 Jan . 65869.48 |================================================== Stress-NG 0.16.04 Test: Matrix 3D Math Bogo Ops/s > Higher Is Better Linux 6.5 ........ 21674.06 |================================================== Linux 6.7 ........ 21261.98 |================================================= Linux 6.6 ........ 20769.77 |================================================ Linux 6.8 26 Jan . 21058.81 |================================================= Stress-NG 0.16.04 Test: Memory Copying Bogo Ops/s > Higher Is Better Linux 6.5 ........ 60720.85 |================================================== Linux 6.7 ........ 60600.94 |================================================== Linux 6.6 ........ 60735.60 |================================================== Linux 6.8 26 Jan . 60755.11 |================================================== Stress-NG 0.16.04 Test: Vector Shuffle Bogo Ops/s > Higher Is Better Linux 6.5 ........ 138701.98 |================================================= Linux 6.7 ........ 138698.52 |================================================= Linux 6.6 ........ 138846.02 |================================================= Linux 6.8 26 Jan . 138787.10 |================================================= Stress-NG 0.16.04 Test: Mixed Scheduler Bogo Ops/s > Higher Is Better Linux 6.5 ........ 127531.88 |=============================================== Linux 6.7 ........ 133980.52 |================================================= Linux 6.6 ........ 127334.72 |============================================== Linux 6.8 26 Jan . 134318.71 |================================================= Stress-NG 0.16.04 Test: Socket Activity Bogo Ops/s > Higher Is Better Linux 6.5 ........ 112726.26 |============================================ Linux 6.7 ........ 66923.30 |========================== Linux 6.6 ........ 124526.05 |================================================= Linux 6.8 26 Jan . 66883.60 |========================== Stress-NG 0.16.04 Test: Wide Vector Math Bogo Ops/s > Higher Is Better Linux 6.5 ........ 5890325.79 |================================================ Linux 6.7 ........ 5886158.59 |================================================ Linux 6.6 ........ 5893175.32 |================================================ Linux 6.8 26 Jan . 5884184.30 |================================================ Stress-NG 0.16.04 Test: Context Switching Bogo Ops/s > Higher Is Better Linux 6.5 ........ 35325682.86 |======================================= Linux 6.7 ........ 42973852.02 |=============================================== Linux 6.6 ........ 42558881.72 |=============================================== Linux 6.8 26 Jan . 41473670.27 |============================================= Stress-NG 0.16.04 Test: Fused Multiply-Add Bogo Ops/s > Higher Is Better Linux 6.5 ........ 441801423.41 |============================================== Linux 6.7 ........ 441959661.17 |============================================== Linux 6.6 ........ 441769520.27 |============================================== Linux 6.8 26 Jan . 441825227.41 |============================================== Stress-NG 0.16.04 Test: Vector Floating Point Bogo Ops/s > Higher Is Better Linux 6.5 ........ 456920.91 |================================================= Linux 6.7 ........ 456415.88 |================================================= Linux 6.6 ........ 456150.17 |================================================= Linux 6.8 26 Jan . 456329.90 |================================================= Stress-NG 0.16.04 Test: Glibc C String Functions Bogo Ops/s > Higher Is Better Linux 6.5 ........ 207322045.97 |============================================== Linux 6.7 ........ 201218048.98 |============================================= Linux 6.6 ........ 204900453.75 |============================================= Linux 6.8 26 Jan . 196585232.62 |============================================ Stress-NG 0.16.04 Test: Glibc Qsort Data Sorting Bogo Ops/s > Higher Is Better Linux 6.5 ........ 4661.07 |=================================================== Linux 6.7 ........ 4664.11 |=================================================== Linux 6.6 ........ 4658.15 |=================================================== Linux 6.8 26 Jan . 4658.25 |=================================================== Stress-NG 0.16.04 Test: System V Message Passing Bogo Ops/s > Higher Is Better Linux 6.5 ........ 28034733.60 |============================================== Linux 6.7 ........ 20162835.90 |================================= Linux 6.6 ........ 28183544.82 |=============================================== Linux 6.8 26 Jan . 28486279.67 |=============================================== Blender 4.0 Blend File: BMW27 - Compute: CPU-Only Seconds < Lower Is Better Linux 6.5 ........ 7.98 |====================================================== Linux 6.7 ........ 8.02 |====================================================== Linux 6.6 ........ 7.99 |====================================================== Linux 6.8 26 Jan . 7.97 |====================================================== Blender 4.0 Blend File: Barbershop - Compute: CPU-Only Seconds < Lower Is Better Linux 6.5 ........ 70.76 |===================================================== Linux 6.7 ........ 69.63 |==================================================== Linux 6.6 ........ 70.62 |===================================================== Linux 6.8 26 Jan . 70.11 |===================================================== OpenVINO 2023.2.dev Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better Linux 6.5 ........ 1103.21 |=================================================== Linux 6.7 ........ 1099.92 |=================================================== Linux 6.6 ........ 1105.14 |=================================================== Linux 6.8 26 Jan . 1099.28 |=================================================== OpenVINO 2023.2.dev Model: Person Detection FP16 - Device: CPU ms < Lower Is Better Linux 6.5 ........ 43.48 |===================================================== Linux 6.7 ........ 43.61 |===================================================== Linux 6.6 ........ 43.40 |===================================================== Linux 6.8 26 Jan . 43.63 |===================================================== OpenVINO 2023.2.dev Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better Linux 6.5 ........ 205.46 |==================================================== Linux 6.7 ........ 205.45 |==================================================== Linux 6.6 ........ 205.21 |==================================================== Linux 6.8 26 Jan . 205.32 |==================================================== OpenVINO 2023.2.dev Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better Linux 6.5 ........ 233.31 |==================================================== Linux 6.7 ........ 233.10 |==================================================== Linux 6.6 ........ 233.41 |==================================================== Linux 6.8 26 Jan . 233.39 |==================================================== OpenVINO 2023.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better Linux 6.5 ........ 11840.17 |================================================== Linux 6.7 ........ 11846.98 |================================================== Linux 6.6 ........ 11817.52 |================================================== Linux 6.8 26 Jan . 11826.99 |================================================== OpenVINO 2023.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better Linux 6.5 ........ 4.04 |====================================================== Linux 6.7 ........ 4.04 |====================================================== Linux 6.6 ........ 4.05 |====================================================== Linux 6.8 26 Jan . 4.05 |====================================================== OpenVINO 2023.2.dev Model: Face Detection Retail FP16-INT8 - Device: CPU FPS > Higher Is Better Linux 6.5 ........ 36011.87 |================================================== Linux 6.7 ........ 35967.57 |================================================== Linux 6.6 ........ 36016.99 |================================================== Linux 6.8 26 Jan . 35914.69 |================================================== OpenVINO 2023.2.dev Model: Face Detection Retail FP16-INT8 - Device: CPU ms < Lower Is Better Linux 6.5 ........ 5.31 |====================================================== Linux 6.7 ........ 5.31 |====================================================== Linux 6.6 ........ 5.30 |====================================================== Linux 6.8 26 Jan . 5.32 |====================================================== OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16-INT8 - Device: CPU FPS > Higher Is Better Linux 6.5 ........ 4017.18 |=================================================== Linux 6.7 ........ 4008.83 |=================================================== Linux 6.6 ........ 4017.92 |=================================================== Linux 6.8 26 Jan . 4007.13 |=================================================== OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16-INT8 - Device: CPU ms < Lower Is Better Linux 6.5 ........ 11.94 |===================================================== Linux 6.7 ........ 11.96 |===================================================== Linux 6.6 ........ 11.93 |===================================================== Linux 6.8 26 Jan . 11.97 |===================================================== OpenVINO 2023.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better Linux 6.5 ........ 1104.56 |=================================================== Linux 6.7 ........ 1111.86 |=================================================== Linux 6.6 ........ 1101.20 |================================================== Linux 6.8 26 Jan . 1115.48 |=================================================== OpenVINO 2023.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better Linux 6.5 ........ 43.39 |===================================================== Linux 6.7 ........ 43.10 |==================================================== Linux 6.6 ........ 43.53 |===================================================== Linux 6.8 26 Jan . 42.96 |==================================================== OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better Linux 6.5 ........ 20939.79 |================================================== Linux 6.7 ........ 20905.08 |================================================== Linux 6.6 ........ 20862.69 |================================================== Linux 6.8 26 Jan . 20824.03 |================================================== OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better Linux 6.5 ........ 9.09 |====================================================== Linux 6.7 ........ 9.10 |====================================================== Linux 6.6 ........ 9.13 |====================================================== Linux 6.8 26 Jan . 9.14 |====================================================== OpenVINO 2023.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better Linux 6.5 ........ 9656.03 |=================================================== Linux 6.7 ........ 9678.99 |=================================================== Linux 6.6 ........ 9648.43 |=================================================== Linux 6.8 26 Jan . 9658.44 |=================================================== OpenVINO 2023.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better Linux 6.5 ........ 4.96 |====================================================== Linux 6.7 ........ 4.95 |====================================================== Linux 6.6 ........ 4.96 |====================================================== Linux 6.8 26 Jan . 4.96 |====================================================== OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16-INT8 - Device: CPU FPS > Higher Is Better Linux 6.5 ........ 4622.46 |=================================================== Linux 6.7 ........ 4620.79 |=================================================== Linux 6.6 ........ 4623.48 |=================================================== Linux 6.8 26 Jan . 4633.97 |=================================================== OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16-INT8 - Device: CPU ms < Lower Is Better Linux 6.5 ........ 41.51 |===================================================== Linux 6.7 ........ 41.52 |===================================================== Linux 6.6 ........ 41.50 |===================================================== Linux 6.8 26 Jan . 41.40 |===================================================== OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better Linux 6.5 ........ 158019.60 |================================================= Linux 6.7 ........ 156137.76 |================================================ Linux 6.6 ........ 156517.91 |================================================= Linux 6.8 26 Jan . 156828.34 |================================================= OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better Linux 6.5 ........ 0.34 |====================================================== Linux 6.7 ........ 0.34 |====================================================== Linux 6.6 ........ 0.34 |====================================================== Linux 6.8 26 Jan . 0.34 |====================================================== RocksDB 8.0 Test: Random Read Op/s > Higher Is Better Linux 6.5 ........ 1103782203 |================================================ Linux 6.7 ........ 1101418931 |================================================ Linux 6.6 ........ 1103280876 |================================================ Linux 6.8 26 Jan . 1098560872 |================================================ RocksDB 8.0 Test: Update Random Op/s > Higher Is Better Linux 6.5 ........ 405246 |================================================= Linux 6.7 ........ 406964 |================================================= Linux 6.6 ........ 411177 |================================================= Linux 6.8 26 Jan . 432923 |==================================================== RocksDB 8.0 Test: Read While Writing Op/s > Higher Is Better Linux 6.5 ........ 21198818 |================================================== Linux 6.7 ........ 16760946 |======================================== Linux 6.6 ........ 17014088 |======================================== Linux 6.8 26 Jan . 15095355 |==================================== RocksDB 8.0 Test: Read Random Write Random Op/s > Higher Is Better Linux 6.5 ........ 1594895 |=================================================== Linux 6.7 ........ 1585552 |=================================================== Linux 6.6 ........ 1589032 |=================================================== Linux 6.8 26 Jan . 1581099 |=================================================== Speedb 2.7 Test: Random Read Op/s > Higher Is Better Linux 6.5 ........ 1119235930 |================================================ Linux 6.7 ........ 1117431090 |================================================ Linux 6.6 ........ 1128431155 |================================================ Linux 6.8 26 Jan . 1102902083 |=============================================== Speedb 2.7 Test: Update Random Op/s > Higher Is Better Linux 6.5 ........ 311661 |================================================= Linux 6.7 ........ 314332 |================================================== Linux 6.6 ........ 314786 |================================================== Linux 6.8 26 Jan . 328490 |==================================================== Speedb 2.7 Test: Read While Writing Op/s > Higher Is Better Linux 6.5 ........ 39636850 |================================================== Linux 6.7 ........ 32475216 |========================================= Linux 6.6 ........ 32574249 |========================================= Linux 6.8 26 Jan . 33717802 |=========================================== Speedb 2.7 Test: Read Random Write Random Op/s > Higher Is Better Linux 6.5 ........ 1627225 |=================================================== Linux 6.7 ........ 1580931 |================================================== Linux 6.6 ........ 1585086 |================================================== Linux 6.8 26 Jan . 1594058 |================================================== Llama.cpp b1808 Model: llama-2-7b.Q4_0.gguf Tokens Per Second > Higher Is Better Linux 6.5 ........ 21.13 |================================================== Linux 6.7 ........ 22.23 |==================================================== Linux 6.6 ........ 22.27 |===================================================== Linux 6.8 26 Jan . 22.45 |===================================================== Llama.cpp b1808 Model: llama-2-13b.Q4_0.gguf Tokens Per Second > Higher Is Better Linux 6.5 ........ 17.15 |===================================================== Linux 6.7 ........ 15.70 |================================================ Linux 6.6 ........ 17.17 |===================================================== Linux 6.8 26 Jan . 16.49 |=================================================== Llama.cpp b1808 Model: llama-2-70b-chat.Q5_0.gguf Tokens Per Second > Higher Is Better Linux 6.5 ........ 5.36 |====================================================== Linux 6.7 ........ 3.42 |================================== Linux 6.6 ........ 3.57 |==================================== Linux 6.8 26 Jan . 5.24 |===================================================== Llamafile 0.6 Test: llava-v1.5-7b-q4 - Acceleration: CPU Tokens Per Second > Higher Is Better Linux 6.5 ........ 21.35 |===================================================== Linux 6.7 ........ 20.85 |==================================================== Linux 6.6 ........ 21.37 |===================================================== Linux 6.8 26 Jan . 20.81 |==================================================== Llamafile 0.6 Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU Tokens Per Second > Higher Is Better Linux 6.5 ........ 13.53 |===================================================== Linux 6.7 ........ 13.61 |===================================================== Linux 6.6 ........ 13.47 |==================================================== Linux 6.8 26 Jan . 13.52 |===================================================== Llamafile 0.6 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU Tokens Per Second > Higher Is Better Linux 6.5 ........ 6.21 |====================================================== Linux 6.7 ........ 6.21 |====================================================== Linux 6.6 ........ 6.21 |====================================================== Linux 6.8 26 Jan . 6.23 |======================================================