new-sun

Intel Core Ultra 9 285K testing with a ASUS ROG MAXIMUS Z890 HERO (0806 BIOS) and ASUS NVIDIA GeForce RTX 4070 Ti SUPER 16GB on Ubuntu 24.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2411250-PTS-NEWSUN2905
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
November 25
  48 Minutes
aa
November 25
  5 Hours, 58 Minutes
b
November 25
  1 Hour, 55 Minutes
c
November 25
  1 Hour, 55 Minutes
Invert Behavior (Only Show Selected Data)
  2 Hours, 39 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


new-sun OpenBenchmarking.orgPhoronix Test SuiteIntel Core Ultra 9 285K @ 5.10GHz (24 Cores)ASUS ROG MAXIMUS Z890 HERO (0806 BIOS)Intel Device ae7f2 x 16GB DDR5-6400MT/s Micron CP16G64C38U5B.M8D14001GB Western Digital WD_BLACK SN850X 4000GB + 1000GB Western Digital WDS100T1X0E-00AFY0ASUS NVIDIA GeForce RTX 4070 Ti SUPER 16GBIntel Device 7f50ASUS VP28URealtek Device 8126 + Intel I226-V + Intel Wi-Fi 7Ubuntu 24.106.11.0-9-generic (x86_64)GNOME Shell 47.0X Server 1.21.1.13NVIDIA 565.57.014.6.0OpenCL 3.0 CUDA 12.7.33GCC 14.2.0ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLOpenCLCompilerFile-SystemScreen ResolutionNew-sun BenchmarksSystem Logs- nouveau.modeset=0 - Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2,rust --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: intel_pstate performance (EPP: default) - CPU Microcode: 0x110 - Thermald 2.5.8- BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.03.45.00.9c- OpenJDK Runtime Environment (build 21.0.5+11-Ubuntu-1ubuntu124.10)- Python 3.12.7- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

aaabcResult OverviewPhoronix Test Suite100%100%101%101%102%PrimesieveRenaissanceBlendervkpeak

new-sun blender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyrenaissance: Scala Dottyvkpeak: int16-vec4vkpeak: int16-scalarvkpeak: int32-vec4vkpeak: int32-scalarvkpeak: fp64-vec4vkpeak: fp64-scalarvkpeak: fp16-vec4vkpeak: fp16-scalarvkpeak: fp32-vec4vkpeak: fp32-scalarblender: Classroom - CPU-Onlyopenvino-genai: Gemma-7b-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Gemma-7b-int4-ov - CPU - Time To First Tokenopenvino-genai: Gemma-7b-int4-ov - CPUprimesieve: 1e13renaissance: In-Memory Database Shootoutrenaissance: ALS Movie Lensblender: Barbershop - NVIDIA CUDAblender: Fishy Cat - CPU-Onlyblender: Junkshop - CPU-Onlyopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUrenaissance: Akka Unbalanced Cobwebbed Treerenaissance: Apache Spark PageRankrenaissance: Savina Reactors.IOopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUrenaissance: Gaussian Mixture Modelopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPUrenaissance: Apache Spark Bayesrenaissance: Rand Forestrenaissance: Finagle HTTP Requestsrenaissance: Genetic Algorithm Using Jenetics + Futuresblender: Barbershop - NVIDIA OptiXblender: BMW27 - CPU-Onlyblender: Pabellon Barcelona - NVIDIA CUDAopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time Per Output Tokenopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time To First Tokenopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPUopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPUblender: Fishy Cat - NVIDIA CUDAblender: Classroom - NVIDIA CUDAblender: BMW27 - NVIDIA OptiXblender: Junkshop - NVIDIA CUDAblender: Pabellon Barcelona - NVIDIA OptiXblender: Junkshop - NVIDIA OptiXblender: Classroom - NVIDIA OptiXblender: Fishy Cat - NVIDIA OptiXblender: BMW27 - NVIDIA CUDAprimesieve: 1e12aaabc356.717140.6215292.5523392.4623401.3735.92735.9726846.8523384.1130993.1723473.4139.6386.4063005.78326.474.4670.063472.92218.63855.63761.7353.2393.11046.3695.748.646.637511.92166.82374.117127.5615286.1623363.1923383.52735.95735.7726874.5923411.5730988.0023465.92140.0770.94348.7514.1087.4992990.08417.669.3474.7969.93915.496.51252.7623.693503.82191.93802.0118.3450.64118.8050.4374.9179.9916.44961.0112.21488.587.43802.6035.76167.5442.11379.606.11967.7849.66321.980.3539936.104.781239.7724.52648.961.962922.0313.27450.030.9615086.166.482429.203.331760.283748.348.3087.6120.70345.6391.21043.0699.347.0249.3237.4626.5737.7637.6436.39139.5727.4816.9816.925.1815.3213.009.8011.778.788.936.783512.02166.41380.117139.2115280.3223347.4523364.4735.92735.9826846.2523384.2330992.0523476.74140.270.5308.9114.1886.8263052.08354.270.1574.7470.11913.666.52251.2323.823514.02158.43820.3118.0150.78118.8350.4474.7680.1716.46959.7412.13491.687.44801.3535.82167.2242.2378.846.1969.6749.57322.540.3540039.834.771243.8124.5649.831.952943.9113.24451.380.9615058.26.472437.823.341754.473722.948.3387.5620.69352.1395.11011.8695.346.9549.1837.4326.5537.6137.6736.22123.1327.6116.9716.955.1715.3213.029.7411.928.778.916.654505.73166.11372.117137.1815299.2423345.1123345.26735.82735.5926846.8923381.8830990.9623478.38139.570.5295.6414.1886.5543085.38459.869.1174.3969.93911.066.55251.723.773542.82209.43899.9117.351.07118.4750.5674.3680.5916.4963.5312.13491.357.47798.3236.02166.2741.97380.926.08972.1549.48323.10.3440787.254.751249.4524.42651.591.93021.5113.29449.670.9415355.436.452441.913.341754.473739.448.2587.1620.72343.9397.31060.1698.646.948.8237.4326.5537.4137.6736.34121.9627.5216.9616.955.2115.2912.989.7411.768.788.896.626OpenBenchmarking.org

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Barbershop - Compute: CPU-Onlybaac110220330440550SE +/- 0.48, N = 3512.02511.92505.73

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Pabellon Barcelona - Compute: CPU-Onlyaabc4080120160200SE +/- 0.30, N = 3166.82166.41166.11

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Scala Dottybaaca80160240320400SE +/- 4.82, N = 15380.1374.1372.1356.7MIN: 311.26 / MAX: 564.35MIN: 310.63 / MAX: 579.42MIN: 328.33 / MAX: 541.75MIN: 314.79 / MAX: 572.12

vkpeak

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int16-vec4aacba4K8K12K16K20KSE +/- 8.92, N = 317127.5617137.1817139.2117140.62

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int16-scalarbaaac3K6K9K12K15KSE +/- 2.13, N = 315280.3215286.1615292.5515299.24

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int32-vec4cbaaa5K10K15K20K25KSE +/- 15.15, N = 323345.1123347.4523363.1923392.46

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int32-scalarcbaaa5K10K15K20K25KSE +/- 18.61, N = 323345.2623364.4023383.5223401.30

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp64-vec4cabaa160320480640800SE +/- 0.01, N = 3735.82735.92735.92735.95

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp64-scalarcaaab160320480640800SE +/- 0.09, N = 3735.59735.77735.97735.98

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp16-vec4bacaa6K12K18K24K30KSE +/- 24.97, N = 326846.2526846.8526846.8926874.59

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp16-scalarcabaa5K10K15K20K25KSE +/- 28.91, N = 323381.8823384.1123384.2323411.57

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp32-vec4aacba7K14K21K28K35KSE +/- 0.50, N = 330988.0030990.9630992.0530993.17

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp32-scalaraaabc5K10K15K20K25KSE +/- 5.72, N = 323465.9223473.4023476.7423478.38

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Classroom - Compute: CPU-Onlybaaac306090120150SE +/- 0.44, N = 3140.20140.07139.63139.50

OpenVINO GenAI

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Tokenaacb1632486480SE +/- 0.09, N = 370.9470.5070.50

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPU - Time To First Tokenaabc80160240320400SE +/- 61.61, N = 3348.75308.91295.64

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPUaabc48121620SE +/- 0.02, N = 314.1014.1814.18

Primesieve

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.6Length: 1e13aabca20406080100SE +/- 0.19, N = 387.5086.8386.5586.411. (CXX) g++ options: -O3

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: In-Memory Database Shootoutcbaaa7001400210028003500SE +/- 34.58, N = 43085.33052.03005.72990.0MIN: 2964.43 / MAX: 3292.26MIN: 2934.84 / MAX: 3173.17MIN: 2879.35 / MAX: 3300.02MIN: 2681.96 / MAX: 3324.34

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: ALS Movie Lenscaaba2K4K6K8K10KSE +/- 72.41, N = 38459.88417.68354.28326.4MIN: 8160.64 / MAX: 8649.1MIN: 7832.38 / MAX: 8701.39MIN: 7901.13 / MAX: 8415.78MIN: 7832.53 / MAX: 8748.58

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Barbershop - Compute: NVIDIA CUDAbaac1632486480SE +/- 0.05, N = 370.1569.3469.11

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Fishy Cat - Compute: CPU-Onlyaabac20406080100SE +/- 0.19, N = 374.7974.7474.4674.39

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Junkshop - Compute: CPU-Onlybacaa1632486480SE +/- 0.20, N = 370.1170.0669.9369.93

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection FP16 - Device: CPUaabc2004006008001000SE +/- 3.02, N = 3915.49913.66911.06MIN: 627.29 / MAX: 1324.9MIN: 624.01 / MAX: 1326.84MIN: 624.05 / MAX: 1319.971. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection FP16 - Device: CPUaabc246810SE +/- 0.03, N = 36.516.526.551. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection FP16-INT8 - Device: CPUaacb60120180240300SE +/- 0.70, N = 3252.76251.70251.23MIN: 162.35 / MAX: 383.62MIN: 159.88 / MAX: 505.02MIN: 164.3 / MAX: 390.351. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection FP16-INT8 - Device: CPUaacb612182430SE +/- 0.07, N = 323.6923.7723.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Akka Unbalanced Cobwebbed Treecbaaa8001600240032004000SE +/- 14.16, N = 33542.83514.03503.83472.9MAX: 4342.51MIN: 3513.99 / MAX: 4408.04MIN: 3475.86 / MAX: 4427.25MAX: 4304.43

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Apache Spark PageRankacaab5001000150020002500SE +/- 10.75, N = 32218.62209.42191.92158.4MIN: 1633.15MIN: 1619.41MIN: 1595.5 / MAX: 2209.7MIN: 1595.87 / MAX: 2158.42

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Savina Reactors.IOcabaa8001600240032004000SE +/- 8.00, N = 33899.93855.63820.33802.0MAX: 5066.66MIN: 3855.59 / MAX: 5136.5MAX: 4954.7MIN: 3792.83 / MAX: 5101.04

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Detection FP16 - Device: CPUaabc306090120150SE +/- 0.09, N = 3118.34118.01117.30MIN: 61.51 / MAX: 185.26MIN: 65.25 / MAX: 177.75MIN: 61.85 / MAX: 184.091. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Detection FP16 - Device: CPUaabc1224364860SE +/- 0.04, N = 350.6450.7851.071. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Detection FP32 - Device: CPUbaac306090120150SE +/- 0.13, N = 3118.83118.80118.47MIN: 61.78 / MAX: 181.12MIN: 60.56 / MAX: 183.24MIN: 60.72 / MAX: 182.581. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Detection FP32 - Device: CPUaabc1122334455SE +/- 0.06, N = 350.4350.4450.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Machine Translation EN To DE FP16 - Device: CPUaabc20406080100SE +/- 0.10, N = 374.9174.7674.36MIN: 47.45 / MAX: 125.1MIN: 47.89 / MAX: 124.4MIN: 47.32 / MAX: 118.581. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Machine Translation EN To DE FP16 - Device: CPUaabc20406080100SE +/- 0.11, N = 379.9980.1780.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Noise Suppression Poconet-Like FP16 - Device: CPUbaac48121620SE +/- 0.03, N = 316.4616.4416.40MIN: 13.06 / MAX: 29.49MIN: 12.76 / MAX: 28.04MIN: 12.8 / MAX: 27.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Noise Suppression Poconet-Like FP16 - Device: CPUbaac2004006008001000SE +/- 1.81, N = 3959.74961.01963.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16-INT8 - Device: CPUaacb3691215SE +/- 0.05, N = 312.2112.1312.13MIN: 7.15 / MAX: 34.14MIN: 7.17 / MAX: 30.12MIN: 7.17 / MAX: 30.851. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16-INT8 - Device: CPUaacb110220330440550SE +/- 1.99, N = 3488.58491.35491.681. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Vehicle Bike Detection FP16 - Device: CPUcbaa246810SE +/- 0.01, N = 37.477.447.43MIN: 4.79 / MAX: 16.87MIN: 4.83 / MAX: 16.13MIN: 4.78 / MAX: 22.131. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Vehicle Bike Detection FP16 - Device: CPUcbaa2004006008001000SE +/- 1.01, N = 3798.32801.35802.601. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16 - Device: CPUcbaa816243240SE +/- 0.02, N = 336.0235.8235.76MIN: 14 / MAX: 64.19MIN: 14.06 / MAX: 65.07MIN: 13.85 / MAX: 68.741. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16 - Device: CPUcbaa4080120160200SE +/- 0.10, N = 3166.27167.22167.541. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16-INT8 - Device: CPUbaac1020304050SE +/- 0.04, N = 342.2042.1141.97MIN: 34.58 / MAX: 72.64MIN: 34.54 / MAX: 67.63MIN: 34.55 / MAX: 61.291. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16-INT8 - Device: CPUbaac80160240320400SE +/- 0.35, N = 3378.84379.60380.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Re-Identification Retail FP16 - Device: CPUaabc246810SE +/- 0.00, N = 36.116.106.08MIN: 4.06 / MAX: 15.69MIN: 4.08 / MAX: 15.79MIN: 4.07 / MAX: 16.281. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Re-Identification Retail FP16 - Device: CPUaabc2004006008001000SE +/- 0.36, N = 3967.78969.67972.151. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16 - Device: CPUaabc1122334455SE +/- 0.08, N = 349.6649.5749.48MIN: 39.94 / MAX: 79.52MIN: 40.31 / MAX: 72.84MIN: 39.94 / MAX: 72.511. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16 - Device: CPUaabc70140210280350SE +/- 0.53, N = 3321.98322.54323.101. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUbaac0.07880.15760.23640.31520.394SE +/- 0.00, N = 30.350.350.34MIN: 0.23 / MAX: 7.74MIN: 0.23 / MAX: 7.42MIN: 0.23 / MAX: 7.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUaabc9K18K27K36K45KSE +/- 185.94, N = 339936.1040039.8340787.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Vehicle Detection FP16-INT8 - Device: CPUaabc1.07552.1513.22654.3025.3775SE +/- 0.02, N = 34.784.774.75MIN: 2.72 / MAX: 19.75MIN: 2.73 / MAX: 14.77MIN: 2.72 / MAX: 13.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Vehicle Detection FP16-INT8 - Device: CPUaabc30060090012001500SE +/- 4.93, N = 31239.771243.811249.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Weld Porosity Detection FP16 - Device: CPUaabc612182430SE +/- 0.02, N = 324.5224.5024.42MIN: 18.82 / MAX: 39.72MIN: 18.99 / MAX: 38.98MIN: 18.97 / MAX: 42.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Weld Porosity Detection FP16 - Device: CPUaabc140280420560700SE +/- 0.78, N = 3648.96649.83651.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16-INT8 - Device: CPUaabc0.4410.8821.3231.7642.205SE +/- 0.00, N = 31.961.951.90MIN: 1.03 / MAX: 13.23MIN: 1.03 / MAX: 8.64MIN: 1.03 / MAX: 8.091. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16-INT8 - Device: CPUaabc6001200180024003000SE +/- 1.66, N = 32922.032943.913021.511. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Vehicle Detection FP16 - Device: CPUcaab3691215SE +/- 0.02, N = 313.2913.2713.24MIN: 6.36 / MAX: 24.82MIN: 6.33 / MAX: 29.46MIN: 6.36 / MAX: 26.021. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Vehicle Detection FP16 - Device: CPUcaab100200300400500SE +/- 0.62, N = 3449.67450.03451.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUbaac0.2160.4320.6480.8641.08SE +/- 0.00, N = 30.960.960.94MIN: 0.59 / MAX: 14.25MIN: 0.59 / MAX: 8.81MIN: 0.59 / MAX: 81. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUbaac3K6K9K12K15KSE +/- 24.22, N = 315058.2015086.1615355.431. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Weld Porosity Detection FP16-INT8 - Device: CPUaabc246810SE +/- 0.01, N = 36.486.476.45MIN: 4.94 / MAX: 20.98MIN: 4.93 / MAX: 19.26MIN: 4.94 / MAX: 15.491. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Weld Porosity Detection FP16-INT8 - Device: CPUaabc5001000150020002500SE +/- 2.42, N = 32429.202437.822441.911. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16 - Device: CPUcbaa0.75151.5032.25453.0063.7575SE +/- 0.00, N = 33.343.343.33MIN: 2.03 / MAX: 10.57MIN: 2.03 / MAX: 10.68MIN: 2.03 / MAX: 17.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16 - Device: CPUbcaa400800120016002000SE +/- 0.98, N = 31754.471754.471760.281. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Gaussian Mixture Modelaaacb8001600240032004000SE +/- 17.46, N = 33761.73748.33739.43722.9MIN: 2716.5 / MAX: 3761.71MIN: 2645.79 / MAX: 3781.01MIN: 2686.88 / MAX: 3739.42MIN: 2677.26 / MAX: 3722.94

OpenVINO GenAI

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Tokenbaac1122334455SE +/- 0.04, N = 348.3348.3048.25

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Tokenaabc20406080100SE +/- 0.86, N = 387.6187.5687.16

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPUbaac510152025SE +/- 0.02, N = 320.6920.7020.72

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Apache Spark Bayesabaac80160240320400SE +/- 2.29, N = 3353.2352.1345.6343.9MIN: 330.84 / MAX: 398.86MIN: 332.91 / MAX: 374.03MIN: 330.79 / MAX: 376.95MIN: 331.51 / MAX: 372.63

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Random Forestcbaaa90180270360450SE +/- 4.00, N = 3397.3395.1393.1391.2MIN: 359.4 / MAX: 454.67MIN: 343.19 / MAX: 463.11MIN: 348.04 / MAX: 437.69MIN: 339.52 / MAX: 449.68

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Finagle HTTP Requestscaaab2004006008001000SE +/- 12.36, N = 31060.11046.31043.01011.8MIN: 966.02 / MAX: 1072.83MIN: 970.98 / MAX: 1047.12MIN: 947.76 / MAX: 1063.57MIN: 958.73 / MAX: 1028.7

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Genetic Algorithm Using Jenetics + Futuresaacab150300450600750SE +/- 2.18, N = 3699.3698.6695.7695.3MIN: 680.86 / MAX: 729.65MIN: 686.88 / MAX: 715.07MIN: 678.55 / MAX: 727.82MIN: 679.26 / MAX: 721.02

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Barbershop - Compute: NVIDIA OptiXaabc1122334455SE +/- 0.05, N = 347.0246.9546.90

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: BMW27 - Compute: CPU-Onlyaabca1122334455SE +/- 0.10, N = 349.3249.1848.8248.64

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Pabellon Barcelona - Compute: NVIDIA CUDAaacb918273645SE +/- 0.04, N = 337.4637.4337.43

OpenVINO GenAI

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time Per Output Tokenaacb612182430SE +/- 0.01, N = 326.5726.5526.55

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time To First Tokenaabc918273645SE +/- 0.21, N = 337.7637.6137.41

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPUaabc918273645SE +/- 0.01, N = 337.6437.6737.67

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Tokenaacb816243240SE +/- 0.06, N = 336.3936.3436.22

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Tokenaabc306090120150SE +/- 8.87, N = 3139.57123.13121.96

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPUaacb612182430SE +/- 0.04, N = 327.4827.5227.61

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Fishy Cat - Compute: NVIDIA CUDAaabc48121620SE +/- 0.01, N = 316.9816.9716.96

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Classroom - Compute: NVIDIA CUDAcbaa48121620SE +/- 0.01, N = 316.9516.9516.92

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: BMW27 - Compute: NVIDIA OptiXcaab1.17232.34463.51694.68925.8615SE +/- 0.04, N = 135.215.185.17

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Junkshop - Compute: NVIDIA CUDAbaac48121620SE +/- 0.01, N = 315.3215.3215.29

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Pabellon Barcelona - Compute: NVIDIA OptiXbaac3691215SE +/- 0.02, N = 313.0213.0012.98

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Junkshop - Compute: NVIDIA OptiXaacb3691215SE +/- 0.11, N = 49.809.749.74

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Classroom - Compute: NVIDIA OptiXbaac3691215SE +/- 0.02, N = 311.9211.7711.76

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Fishy Cat - Compute: NVIDIA OptiXcaab246810SE +/- 0.01, N = 38.788.788.77

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: BMW27 - Compute: NVIDIA CUDAaabc246810SE +/- 0.02, N = 38.938.918.89

Renaissance

Test: Apache Spark ALS

a: The test quit with a non-zero exit status.

aa: The test quit with a non-zero exit status.

b: The test quit with a non-zero exit status.

c: The test quit with a non-zero exit status.

Primesieve

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.6Length: 1e12aabac246810SE +/- 0.066, N = 36.7836.6546.6376.6261. (CXX) g++ options: -O3

93 Results Shown

Blender:
  Barbershop - CPU-Only
  Pabellon Barcelona - CPU-Only
Renaissance
vkpeak:
  int16-vec4
  int16-scalar
  int32-vec4
  int32-scalar
  fp64-vec4
  fp64-scalar
  fp16-vec4
  fp16-scalar
  fp32-vec4
  fp32-scalar
Blender
OpenVINO GenAI:
  Gemma-7b-int4-ov - CPU - Time Per Output Token
  Gemma-7b-int4-ov - CPU - Time To First Token
  Gemma-7b-int4-ov - CPU
Primesieve
Renaissance:
  In-Memory Database Shootout
  ALS Movie Lens
Blender:
  Barbershop - NVIDIA CUDA
  Fishy Cat - CPU-Only
  Junkshop - CPU-Only
OpenVINO:
  Face Detection FP16 - CPU:
    ms
    FPS
  Face Detection FP16-INT8 - CPU:
    ms
    FPS
Renaissance:
  Akka Unbalanced Cobwebbed Tree
  Apache Spark PageRank
  Savina Reactors.IO
OpenVINO:
  Person Detection FP16 - CPU:
    ms
    FPS
  Person Detection FP32 - CPU:
    ms
    FPS
  Machine Translation EN To DE FP16 - CPU:
    ms
    FPS
  Noise Suppression Poconet-Like FP16 - CPU:
    ms
    FPS
  Road Segmentation ADAS FP16-INT8 - CPU:
    ms
    FPS
  Person Vehicle Bike Detection FP16 - CPU:
    ms
    FPS
  Road Segmentation ADAS FP16 - CPU:
    ms
    FPS
  Handwritten English Recognition FP16-INT8 - CPU:
    ms
    FPS
  Person Re-Identification Retail FP16 - CPU:
    ms
    FPS
  Handwritten English Recognition FP16 - CPU:
    ms
    FPS
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    ms
    FPS
  Vehicle Detection FP16-INT8 - CPU:
    ms
    FPS
  Weld Porosity Detection FP16 - CPU:
    ms
    FPS
  Face Detection Retail FP16-INT8 - CPU:
    ms
    FPS
  Vehicle Detection FP16 - CPU:
    ms
    FPS
  Age Gender Recognition Retail 0013 FP16 - CPU:
    ms
    FPS
  Weld Porosity Detection FP16-INT8 - CPU:
    ms
    FPS
  Face Detection Retail FP16 - CPU:
    ms
    FPS
Renaissance
OpenVINO GenAI:
  Falcon-7b-instruct-int4-ov - CPU - Time Per Output Token
  Falcon-7b-instruct-int4-ov - CPU - Time To First Token
  Falcon-7b-instruct-int4-ov - CPU
Renaissance:
  Apache Spark Bayes
  Rand Forest
  Finagle HTTP Requests
  Genetic Algorithm Using Jenetics + Futures
Blender:
  Barbershop - NVIDIA OptiX
  BMW27 - CPU-Only
  Pabellon Barcelona - NVIDIA CUDA
OpenVINO GenAI:
  TinyLlama-1.1B-Chat-v1.0 - CPU - Time Per Output Token
  TinyLlama-1.1B-Chat-v1.0 - CPU - Time To First Token
  TinyLlama-1.1B-Chat-v1.0 - CPU
  Phi-3-mini-128k-instruct-int4-ov - CPU - Time Per Output Token
  Phi-3-mini-128k-instruct-int4-ov - CPU - Time To First Token
  Phi-3-mini-128k-instruct-int4-ov - CPU
Blender:
  Fishy Cat - NVIDIA CUDA
  Classroom - NVIDIA CUDA
  BMW27 - NVIDIA OptiX
  Junkshop - NVIDIA CUDA
  Pabellon Barcelona - NVIDIA OptiX
  Junkshop - NVIDIA OptiX
  Classroom - NVIDIA OptiX
  Fishy Cat - NVIDIA OptiX
  BMW27 - NVIDIA CUDA
Primesieve