new-sun Intel Core Ultra 9 285K testing with a ASUS ROG MAXIMUS Z890 HERO (0806 BIOS) and ASUS NVIDIA GeForce RTX 4070 Ti SUPER 16GB on Ubuntu 24.10 via the Phoronix Test Suite. a: Processor: Intel Core Ultra 9 285K @ 5.10GHz (24 Cores), Motherboard: ASUS ROG MAXIMUS Z890 HERO (0806 BIOS), Chipset: Intel Device ae7f, Memory: 2 x 16GB DDR5-6400MT/s Micron CP16G64C38U5B.M8D1, Disk: 4001GB Western Digital WD_BLACK SN850X 4000GB + 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: ASUS NVIDIA GeForce RTX 4070 Ti SUPER 16GB, Audio: Intel Device 7f50, Monitor: ASUS VP28U, Network: Realtek Device 8126 + Intel I226-V + Intel Wi-Fi 7 OS: Ubuntu 24.10, Kernel: 6.11.0-9-generic (x86_64), Desktop: GNOME Shell 47.0, Display Server: X Server 1.21.1.13, Display Driver: NVIDIA 565.57.01, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.7.33, Compiler: GCC 14.2.0, File-System: ext4, Screen Resolution: 3840x2160 aa: Processor: Intel Core Ultra 9 285K @ 5.10GHz (24 Cores), Motherboard: ASUS ROG MAXIMUS Z890 HERO (0806 BIOS), Chipset: Intel Device ae7f, Memory: 2 x 16GB DDR5-6400MT/s Micron CP16G64C38U5B.M8D1, Disk: 4001GB Western Digital WD_BLACK SN850X 4000GB + 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: ASUS NVIDIA GeForce RTX 4070 Ti SUPER 16GB, Audio: Intel Device 7f50, Monitor: ASUS VP28U, Network: Realtek Device 8126 + Intel I226-V + Intel Wi-Fi 7 OS: Ubuntu 24.10, Kernel: 6.11.0-9-generic (x86_64), Desktop: GNOME Shell 47.0, Display Server: X Server 1.21.1.13, Display Driver: NVIDIA 565.57.01, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.7.33, Compiler: GCC 14.2.0, File-System: ext4, Screen Resolution: 3840x2160 b: Processor: Intel Core Ultra 9 285K @ 5.10GHz (24 Cores), Motherboard: ASUS ROG MAXIMUS Z890 HERO (0806 BIOS), Chipset: Intel Device ae7f, Memory: 2 x 16GB DDR5-6400MT/s Micron CP16G64C38U5B.M8D1, Disk: 4001GB Western Digital WD_BLACK SN850X 4000GB + 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: ASUS NVIDIA GeForce RTX 4070 Ti SUPER 16GB, Audio: Intel Device 7f50, Monitor: ASUS VP28U, Network: Realtek Device 8126 + Intel I226-V + Intel Wi-Fi 7 OS: Ubuntu 24.10, Kernel: 6.11.0-9-generic (x86_64), Desktop: GNOME Shell 47.0, Display Server: X Server 1.21.1.13, Display Driver: NVIDIA 565.57.01, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.7.33, Compiler: GCC 14.2.0, File-System: ext4, Screen Resolution: 3840x2160 c: Processor: Intel Core Ultra 9 285K @ 5.10GHz (24 Cores), Motherboard: ASUS ROG MAXIMUS Z890 HERO (0806 BIOS), Chipset: Intel Device ae7f, Memory: 2 x 16GB DDR5-6400MT/s Micron CP16G64C38U5B.M8D1, Disk: 4001GB Western Digital WD_BLACK SN850X 4000GB + 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: ASUS NVIDIA GeForce RTX 4070 Ti SUPER 16GB, Audio: Intel Device 7f50, Monitor: ASUS VP28U, Network: Realtek Device 8126 + Intel I226-V + Intel Wi-Fi 7 OS: Ubuntu 24.10, Kernel: 6.11.0-9-generic (x86_64), Desktop: GNOME Shell 47.0, Display Server: X Server 1.21.1.13, Display Driver: NVIDIA 565.57.01, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.7.33, Compiler: GCC 14.2.0, File-System: ext4, Screen Resolution: 3840x2160 Renaissance 0.16 Test: Scala Dotty ms < Lower Is Better a .. 356.7 |=============================================================== aa . 374.1 |================================================================== b .. 380.1 |=================================================================== c .. 372.1 |================================================================== Renaissance 0.16 Test: Random Forest ms < Lower Is Better a .. 393.1 |================================================================== aa . 391.2 |================================================================== b .. 395.1 |=================================================================== c .. 397.3 |=================================================================== Renaissance 0.16 Test: ALS Movie Lens ms < Lower Is Better a .. 8326.4 |================================================================= aa . 8417.6 |================================================================== b .. 8354.2 |================================================================= c .. 8459.8 |================================================================== Renaissance 0.16 Test: Apache Spark ALS ms < Lower Is Better Renaissance 0.16 Test: Apache Spark Bayes ms < Lower Is Better a .. 353.2 |=================================================================== aa . 345.6 |================================================================== b .. 352.1 |=================================================================== c .. 343.9 |================================================================= Renaissance 0.16 Test: Savina Reactors.IO ms < Lower Is Better a .. 3855.6 |================================================================= aa . 3802.0 |================================================================ b .. 3820.3 |================================================================= c .. 3899.9 |================================================================== Renaissance 0.16 Test: Apache Spark PageRank ms < Lower Is Better a .. 2218.6 |================================================================== aa . 2191.9 |================================================================= b .. 2158.4 |================================================================ c .. 2209.4 |================================================================== Renaissance 0.16 Test: Finagle HTTP Requests ms < Lower Is Better a .. 1046.3 |================================================================= aa . 1043.0 |================================================================= b .. 1011.8 |=============================================================== c .. 1060.1 |================================================================== Renaissance 0.16 Test: Gaussian Mixture Model ms < Lower Is Better a .. 3761.7 |================================================================== aa . 3748.3 |================================================================== b .. 3722.9 |================================================================= c .. 3739.4 |================================================================== Renaissance 0.16 Test: In-Memory Database Shootout ms < Lower Is Better a .. 3005.7 |================================================================ aa . 2990.0 |================================================================ b .. 3052.0 |================================================================= c .. 3085.3 |================================================================== Renaissance 0.16 Test: Akka Unbalanced Cobwebbed Tree ms < Lower Is Better a .. 3472.9 |================================================================= aa . 3503.8 |================================================================= b .. 3514.0 |================================================================= c .. 3542.8 |================================================================== Renaissance 0.16 Test: Genetic Algorithm Using Jenetics + Futures ms < Lower Is Better a .. 695.7 |=================================================================== aa . 699.3 |=================================================================== b .. 695.3 |=================================================================== c .. 698.6 |=================================================================== OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU tokens/s > Higher Is Better aa . 14.10 |=================================================================== b .. 14.18 |=================================================================== c .. 14.18 |=================================================================== OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU tokens/s > Higher Is Better aa . 37.64 |=================================================================== b .. 37.67 |=================================================================== c .. 37.67 |=================================================================== OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU tokens/s > Higher Is Better aa . 20.70 |=================================================================== b .. 20.69 |=================================================================== c .. 20.72 |=================================================================== OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU tokens/s > Higher Is Better aa . 27.48 |=================================================================== b .. 27.61 |=================================================================== c .. 27.52 |=================================================================== OpenVINO 2024.5 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better aa . 6.51 |==================================================================== b .. 6.52 |==================================================================== c .. 6.55 |==================================================================== OpenVINO 2024.5 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better aa . 915.49 |================================================================== b .. 913.66 |================================================================== c .. 911.06 |================================================================== OpenVINO 2024.5 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better aa . 50.64 |================================================================== b .. 50.78 |=================================================================== c .. 51.07 |=================================================================== OpenVINO 2024.5 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better aa . 118.34 |================================================================== b .. 118.01 |================================================================== c .. 117.30 |================================================================= OpenVINO 2024.5 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better aa . 50.43 |=================================================================== b .. 50.44 |=================================================================== c .. 50.56 |=================================================================== OpenVINO 2024.5 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better aa . 118.80 |================================================================== b .. 118.83 |================================================================== c .. 118.47 |================================================================== OpenVINO 2024.5 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better aa . 450.03 |================================================================== b .. 451.38 |================================================================== c .. 449.67 |================================================================== OpenVINO 2024.5 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better aa . 13.27 |=================================================================== b .. 13.24 |=================================================================== c .. 13.29 |=================================================================== OpenVINO 2024.5 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better aa . 23.69 |=================================================================== b .. 23.82 |=================================================================== c .. 23.77 |=================================================================== OpenVINO 2024.5 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better aa . 252.76 |================================================================== b .. 251.23 |================================================================== c .. 251.70 |================================================================== OpenVINO 2024.5 Model: Face Detection Retail FP16 - Device: CPU FPS > Higher Is Better aa . 1760.28 |================================================================= b .. 1754.47 |================================================================= c .. 1754.47 |================================================================= OpenVINO 2024.5 Model: Face Detection Retail FP16 - Device: CPU ms < Lower Is Better aa . 3.33 |==================================================================== b .. 3.34 |==================================================================== c .. 3.34 |==================================================================== OpenVINO 2024.5 Model: Road Segmentation ADAS FP16 - Device: CPU FPS > Higher Is Better aa . 167.54 |================================================================== b .. 167.22 |================================================================== c .. 166.27 |================================================================= OpenVINO 2024.5 Model: Road Segmentation ADAS FP16 - Device: CPU ms < Lower Is Better aa . 35.76 |=================================================================== b .. 35.82 |=================================================================== c .. 36.02 |=================================================================== OpenVINO 2024.5 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better aa . 1239.77 |================================================================ b .. 1243.81 |================================================================= c .. 1249.45 |================================================================= OpenVINO 2024.5 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better aa . 4.78 |==================================================================== b .. 4.77 |==================================================================== c .. 4.75 |==================================================================== OpenVINO 2024.5 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better aa . 648.96 |================================================================== b .. 649.83 |================================================================== c .. 651.59 |================================================================== OpenVINO 2024.5 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better aa . 24.52 |=================================================================== b .. 24.50 |=================================================================== c .. 24.42 |=================================================================== OpenVINO 2024.5 Model: Face Detection Retail FP16-INT8 - Device: CPU FPS > Higher Is Better aa . 2922.03 |=============================================================== b .. 2943.91 |=============================================================== c .. 3021.51 |================================================================= OpenVINO 2024.5 Model: Face Detection Retail FP16-INT8 - Device: CPU ms < Lower Is Better aa . 1.96 |==================================================================== b .. 1.95 |==================================================================== c .. 1.90 |================================================================== OpenVINO 2024.5 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU FPS > Higher Is Better aa . 488.58 |================================================================== b .. 491.68 |================================================================== c .. 491.35 |================================================================== OpenVINO 2024.5 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU ms < Lower Is Better aa . 12.21 |=================================================================== b .. 12.13 |=================================================================== c .. 12.13 |=================================================================== OpenVINO 2024.5 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better aa . 79.99 |=================================================================== b .. 80.17 |=================================================================== c .. 80.59 |=================================================================== OpenVINO 2024.5 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better aa . 74.91 |=================================================================== b .. 74.76 |=================================================================== c .. 74.36 |=================================================================== OpenVINO 2024.5 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better aa . 2429.20 |================================================================= b .. 2437.82 |================================================================= c .. 2441.91 |================================================================= OpenVINO 2024.5 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better aa . 6.48 |==================================================================== b .. 6.47 |==================================================================== c .. 6.45 |==================================================================== OpenVINO 2024.5 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better aa . 802.60 |================================================================== b .. 801.35 |================================================================== c .. 798.32 |================================================================== OpenVINO 2024.5 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better aa . 7.43 |==================================================================== b .. 7.44 |==================================================================== c .. 7.47 |==================================================================== OpenVINO 2024.5 Model: Noise Suppression Poconet-Like FP16 - Device: CPU FPS > Higher Is Better aa . 961.01 |================================================================== b .. 959.74 |================================================================== c .. 963.53 |================================================================== OpenVINO 2024.5 Model: Noise Suppression Poconet-Like FP16 - Device: CPU ms < Lower Is Better aa . 16.44 |=================================================================== b .. 16.46 |=================================================================== c .. 16.40 |=================================================================== OpenVINO 2024.5 Model: Handwritten English Recognition FP16 - Device: CPU FPS > Higher Is Better aa . 321.98 |================================================================== b .. 322.54 |================================================================== c .. 323.10 |================================================================== OpenVINO 2024.5 Model: Handwritten English Recognition FP16 - Device: CPU ms < Lower Is Better aa . 49.66 |=================================================================== b .. 49.57 |=================================================================== c .. 49.48 |=================================================================== OpenVINO 2024.5 Model: Person Re-Identification Retail FP16 - Device: CPU FPS > Higher Is Better aa . 967.78 |================================================================== b .. 969.67 |================================================================== c .. 972.15 |================================================================== OpenVINO 2024.5 Model: Person Re-Identification Retail FP16 - Device: CPU ms < Lower Is Better aa . 6.11 |==================================================================== b .. 6.10 |==================================================================== c .. 6.08 |==================================================================== OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better aa . 15086.16 |=============================================================== b .. 15058.20 |=============================================================== c .. 15355.43 |================================================================ OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better aa . 0.96 |==================================================================== b .. 0.96 |==================================================================== c .. 0.94 |=================================================================== OpenVINO 2024.5 Model: Handwritten English Recognition FP16-INT8 - Device: CPU FPS > Higher Is Better aa . 379.60 |================================================================== b .. 378.84 |================================================================== c .. 380.92 |================================================================== OpenVINO 2024.5 Model: Handwritten English Recognition FP16-INT8 - Device: CPU ms < Lower Is Better aa . 42.11 |=================================================================== b .. 42.20 |=================================================================== c .. 41.97 |=================================================================== OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better aa . 39936.10 |=============================================================== b .. 40039.83 |=============================================================== c .. 40787.25 |================================================================ OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better aa . 0.35 |==================================================================== b .. 0.35 |==================================================================== c .. 0.34 |================================================================== Primesieve 12.6 Length: 1e12 Seconds < Lower Is Better a .. 6.637 |================================================================== aa . 6.783 |=================================================================== b .. 6.654 |================================================================== c .. 6.626 |================================================================= Primesieve 12.6 Length: 1e13 Seconds < Lower Is Better a .. 86.41 |================================================================== aa . 87.50 |=================================================================== b .. 86.83 |================================================================== c .. 86.55 |================================================================== Blender 4.3 Blend File: BMW27 - Compute: CPU-Only Seconds < Lower Is Better a .. 48.64 |================================================================== aa . 49.32 |=================================================================== b .. 49.18 |=================================================================== c .. 48.82 |================================================================== Blender 4.3 Blend File: Junkshop - Compute: CPU-Only Seconds < Lower Is Better a .. 70.06 |=================================================================== aa . 69.93 |=================================================================== b .. 70.11 |=================================================================== c .. 69.93 |=================================================================== Blender 4.3 Blend File: Classroom - Compute: CPU-Only Seconds < Lower Is Better a .. 139.63 |================================================================== aa . 140.07 |================================================================== b .. 140.20 |================================================================== c .. 139.50 |================================================================== Blender 4.3 Blend File: Fishy Cat - Compute: CPU-Only Seconds < Lower Is Better a .. 74.46 |=================================================================== aa . 74.79 |=================================================================== b .. 74.74 |=================================================================== c .. 74.39 |=================================================================== Blender 4.3 Blend File: BMW27 - Compute: NVIDIA CUDA Seconds < Lower Is Better aa . 8.93 |==================================================================== b .. 8.91 |==================================================================== c .. 8.89 |==================================================================== Blender 4.3 Blend File: BMW27 - Compute: NVIDIA OptiX Seconds < Lower Is Better aa . 5.18 |==================================================================== b .. 5.17 |=================================================================== c .. 5.21 |==================================================================== Blender 4.3 Blend File: Barbershop - Compute: CPU-Only Seconds < Lower Is Better aa . 511.92 |================================================================== b .. 512.02 |================================================================== c .. 505.73 |================================================================= Blender 4.3 Blend File: Junkshop - Compute: NVIDIA CUDA Seconds < Lower Is Better aa . 15.32 |=================================================================== b .. 15.32 |=================================================================== c .. 15.29 |=================================================================== Blender 4.3 Blend File: Classroom - Compute: NVIDIA CUDA Seconds < Lower Is Better aa . 16.92 |=================================================================== b .. 16.95 |=================================================================== c .. 16.95 |=================================================================== Blender 4.3 Blend File: Fishy Cat - Compute: NVIDIA CUDA Seconds < Lower Is Better aa . 16.98 |=================================================================== b .. 16.97 |=================================================================== c .. 16.96 |=================================================================== Blender 4.3 Blend File: Junkshop - Compute: NVIDIA OptiX Seconds < Lower Is Better aa . 9.80 |==================================================================== b .. 9.74 |==================================================================== c .. 9.74 |==================================================================== Blender 4.3 Blend File: Barbershop - Compute: NVIDIA CUDA Seconds < Lower Is Better aa . 69.34 |================================================================== b .. 70.15 |=================================================================== c .. 69.11 |================================================================== Blender 4.3 Blend File: Classroom - Compute: NVIDIA OptiX Seconds < Lower Is Better aa . 11.77 |================================================================== b .. 11.92 |=================================================================== c .. 11.76 |================================================================== Blender 4.3 Blend File: Fishy Cat - Compute: NVIDIA OptiX Seconds < Lower Is Better aa . 8.78 |==================================================================== b .. 8.77 |==================================================================== c .. 8.78 |==================================================================== Blender 4.3 Blend File: Barbershop - Compute: NVIDIA OptiX Seconds < Lower Is Better aa . 47.02 |=================================================================== b .. 46.95 |=================================================================== c .. 46.90 |=================================================================== Blender 4.3 Blend File: Pabellon Barcelona - Compute: CPU-Only Seconds < Lower Is Better aa . 166.82 |================================================================== b .. 166.41 |================================================================== c .. 166.11 |================================================================== Blender 4.3 Blend File: Pabellon Barcelona - Compute: NVIDIA CUDA Seconds < Lower Is Better aa . 37.46 |=================================================================== b .. 37.43 |=================================================================== c .. 37.43 |=================================================================== Blender 4.3 Blend File: Pabellon Barcelona - Compute: NVIDIA OptiX Seconds < Lower Is Better aa . 13.00 |=================================================================== b .. 13.02 |=================================================================== c .. 12.98 |=================================================================== vkpeak 20240505 fp32-scalar GFLOPS > Higher Is Better a .. 23473.40 |================================================================ aa . 23465.92 |================================================================ b .. 23476.74 |================================================================ c .. 23478.38 |================================================================ vkpeak 20240505 fp32-vec4 GFLOPS > Higher Is Better a .. 30993.17 |================================================================ aa . 30988.00 |================================================================ b .. 30992.05 |================================================================ c .. 30990.96 |================================================================ vkpeak 20240505 fp16-scalar GFLOPS > Higher Is Better a .. 23384.11 |================================================================ aa . 23411.57 |================================================================ b .. 23384.23 |================================================================ c .. 23381.88 |================================================================ vkpeak 20240505 fp16-vec4 GFLOPS > Higher Is Better a .. 26846.85 |================================================================ aa . 26874.59 |================================================================ b .. 26846.25 |================================================================ c .. 26846.89 |================================================================ vkpeak 20240505 fp64-scalar GFLOPS > Higher Is Better a .. 735.97 |================================================================== aa . 735.77 |================================================================== b .. 735.98 |================================================================== c .. 735.59 |================================================================== vkpeak 20240505 fp64-vec4 GFLOPS > Higher Is Better a .. 735.92 |================================================================== aa . 735.95 |================================================================== b .. 735.92 |================================================================== c .. 735.82 |================================================================== vkpeak 20240505 int32-scalar GIOPS > Higher Is Better a .. 23401.30 |================================================================ aa . 23383.52 |================================================================ b .. 23364.40 |================================================================ c .. 23345.26 |================================================================ vkpeak 20240505 int32-vec4 GIOPS > Higher Is Better a .. 23392.46 |================================================================ aa . 23363.19 |================================================================ b .. 23347.45 |================================================================ c .. 23345.11 |================================================================ vkpeak 20240505 int16-scalar GIOPS > Higher Is Better a .. 15292.55 |================================================================ aa . 15286.16 |================================================================ b .. 15280.32 |================================================================ c .. 15299.24 |================================================================ vkpeak 20240505 int16-vec4 GIOPS > Higher Is Better a .. 17140.62 |================================================================ aa . 17127.56 |================================================================ b .. 17139.21 |================================================================ c .. 17137.18 |================================================================ OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU - Time To First Token ms < Lower Is Better aa . 348.75 |================================================================== b .. 308.91 |========================================================== c .. 295.64 |======================================================== OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Token ms < Lower Is Better aa . 70.94 |=================================================================== b .. 70.50 |=================================================================== c .. 70.50 |=================================================================== OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time To First Token ms < Lower Is Better aa . 37.76 |=================================================================== b .. 37.61 |=================================================================== c .. 37.41 |================================================================== OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time Per Output Token ms < Lower Is Better aa . 26.57 |=================================================================== b .. 26.55 |=================================================================== c .. 26.55 |=================================================================== OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token ms < Lower Is Better aa . 87.61 |=================================================================== b .. 87.56 |=================================================================== c .. 87.16 |=================================================================== OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Token ms < Lower Is Better aa . 48.30 |=================================================================== b .. 48.33 |=================================================================== c .. 48.25 |=================================================================== OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Token ms < Lower Is Better aa . 139.57 |================================================================== b .. 123.13 |========================================================== c .. 121.96 |========================================================== OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Token ms < Lower Is Better aa . 36.39 |=================================================================== b .. 36.22 |=================================================================== c .. 36.34 |===================================================================