new-sun

Intel Core Ultra 9 285K testing with a ASUS ROG MAXIMUS Z890 HERO (0806 BIOS) and ASUS NVIDIA GeForce RTX 4070 Ti SUPER 16GB on Ubuntu 24.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2411250-PTS-NEWSUN2905
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
November 25
  48 Minutes
aa
November 25
  5 Hours, 58 Minutes
b
November 25
  1 Hour, 55 Minutes
c
November 25
  1 Hour, 55 Minutes
Invert Behavior (Only Show Selected Data)
  2 Hours, 39 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


new-sun OpenBenchmarking.orgPhoronix Test SuiteIntel Core Ultra 9 285K @ 5.10GHz (24 Cores)ASUS ROG MAXIMUS Z890 HERO (0806 BIOS)Intel Device ae7f2 x 16GB DDR5-6400MT/s Micron CP16G64C38U5B.M8D14001GB Western Digital WD_BLACK SN850X 4000GB + 1000GB Western Digital WDS100T1X0E-00AFY0ASUS NVIDIA GeForce RTX 4070 Ti SUPER 16GBIntel Device 7f50ASUS VP28URealtek Device 8126 + Intel I226-V + Intel Wi-Fi 7Ubuntu 24.106.11.0-9-generic (x86_64)GNOME Shell 47.0X Server 1.21.1.13NVIDIA 565.57.014.6.0OpenCL 3.0 CUDA 12.7.33GCC 14.2.0ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLOpenCLCompilerFile-SystemScreen ResolutionNew-sun BenchmarksSystem Logs- nouveau.modeset=0 - Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2,rust --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: intel_pstate performance (EPP: default) - CPU Microcode: 0x110 - Thermald 2.5.8- BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.03.45.00.9c- OpenJDK Runtime Environment (build 21.0.5+11-Ubuntu-1ubuntu124.10)- Python 3.12.7- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

aaabcResult OverviewPhoronix Test Suite100%100%101%101%102%PrimesieveRenaissanceBlendervkpeak

new-sun renaissance: Scala Dottyrenaissance: Finagle HTTP Requestsopenvino: Face Detection Retail FP16-INT8 - CPUrenaissance: In-Memory Database Shootoutopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUrenaissance: Apache Spark PageRankrenaissance: Apache Spark Bayesrenaissance: Savina Reactors.IOprimesieve: 1e12openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUrenaissance: Akka Unbalanced Cobwebbed Treeopenvino: Age Gender Recognition Retail 0013 FP16 - CPUrenaissance: ALS Movie Lensrenaissance: Rand Forestblender: Barbershop - NVIDIA CUDAblender: BMW27 - CPU-Onlyblender: Classroom - NVIDIA OptiXprimesieve: 1e13blender: Barbershop - CPU-Onlyrenaissance: Gaussian Mixture Modelopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUblender: BMW27 - NVIDIA OptiXopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUblender: Junkshop - NVIDIA OptiXopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUrenaissance: Genetic Algorithm Using Jenetics + Futuresopenvino-genai: Gemma-7b-int4-ov - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUblender: Fishy Cat - CPU-Onlyopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUblender: Classroom - CPU-Onlyopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Re-Identification Retail FP16 - CPUblender: BMW27 - NVIDIA CUDAblender: Pabellon Barcelona - CPU-Onlyopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Face Detection Retail FP16 - CPUblender: Pabellon Barcelona - NVIDIA OptiXopenvino: Person Detection FP32 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Person Detection FP32 - CPUblender: Junkshop - CPU-Onlyblender: Barbershop - NVIDIA OptiXvkpeak: int32-scalarvkpeak: int32-vec4blender: Junkshop - NVIDIA CUDAblender: Classroom - NVIDIA CUDAopenvino-genai: Falcon-7b-instruct-int4-ov - CPUvkpeak: fp16-scalarvkpeak: int16-scalarblender: Fishy Cat - NVIDIA CUDAblender: Fishy Cat - NVIDIA OptiXvkpeak: fp16-vec4blender: Pabellon Barcelona - NVIDIA CUDAopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPUvkpeak: int16-vec4vkpeak: fp32-scalarvkpeak: fp64-scalarvkpeak: fp64-vec4vkpeak: fp32-vec4openvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time Per Output Tokenopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time To First Tokenopenvino-genai: Gemma-7b-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Gemma-7b-int4-ov - CPU - Time To First Tokenrenaissance: Apache Spark ALSaaabc356.71046.33005.72218.6353.23855.66.6373472.98326.4393.148.6486.4063761.7695.774.46139.6370.0623401.323392.4623384.1115292.5526846.8517140.6223473.4735.97735.9230993.17374.11043.02922.032990.01.960.352191.9345.63802.06.78339936.100.963503.815086.168417.6391.269.3449.3211.7787.499511.923748.3118.3450.641239.775.18167.5479.9974.9135.7612.21488.584.789.806.51252.76699.314.10379.6023.6942.117.4374.79802.602429.20140.076.11915.4927.486.48967.788.93166.8224.52648.96961.01450.0313.2716.4449.66321.981760.2813.00118.803.3350.4369.9347.0223383.5223363.1915.3216.9220.7023411.5715286.1616.988.7826874.5937.4637.6417127.5623465.92735.77735.9530988.0036.39139.5748.3087.6126.5737.7670.94348.75380.11011.82943.913052.01.950.352158.4352.13820.36.65440039.830.963514.015058.28354.2395.170.1549.1811.9286.826512.023722.9118.0150.781243.815.17167.2280.1774.7635.8212.13491.684.779.746.52251.23695.314.18378.8423.8242.27.4474.74801.352437.82140.26.1913.6627.616.47969.678.91166.4124.5649.83959.74451.3813.2416.4649.57322.541754.4713.02118.833.3450.4470.1146.9523364.423347.4515.3216.9520.6923384.2315280.3216.978.7726846.2537.4337.6717139.2123476.74735.98735.9230992.0536.22123.1348.3387.5626.5537.6170.5308.91372.11060.13021.513085.31.90.342209.4343.93899.96.62640787.250.943542.815355.438459.8397.369.1148.8211.7686.554505.733739.4117.351.071249.455.21166.2780.5974.3636.0212.13491.354.759.746.55251.7698.614.18380.9223.7741.977.4774.39798.322441.91139.56.08911.0627.526.45972.158.89166.1124.42651.59963.53449.6713.2916.449.48323.11754.4712.98118.473.3450.5669.9346.923345.2623345.1115.2916.9520.7223381.8815299.2416.968.7826846.8937.4337.6717137.1823478.38735.59735.8230990.9636.34121.9648.2587.1626.5537.4170.5295.64OpenBenchmarking.org

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Scala Dottyaaabc80160240320400SE +/- 4.82, N = 15356.7374.1380.1372.1MIN: 314.79 / MAX: 572.12MIN: 310.63 / MAX: 579.42MIN: 311.26 / MAX: 564.35MIN: 328.33 / MAX: 541.75

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Finagle HTTP Requestsaaabc2004006008001000SE +/- 12.36, N = 31046.31043.01011.81060.1MIN: 970.98 / MAX: 1047.12MIN: 947.76 / MAX: 1063.57MIN: 958.73 / MAX: 1028.7MIN: 966.02 / MAX: 1072.83

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16-INT8 - Device: CPUaabc6001200180024003000SE +/- 1.66, N = 32922.032943.913021.511. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: In-Memory Database Shootoutaaabc7001400210028003500SE +/- 34.58, N = 43005.72990.03052.03085.3MIN: 2879.35 / MAX: 3300.02MIN: 2681.96 / MAX: 3324.34MIN: 2934.84 / MAX: 3173.17MIN: 2964.43 / MAX: 3292.26

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16-INT8 - Device: CPUaabc0.4410.8821.3231.7642.205SE +/- 0.00, N = 31.961.951.90MIN: 1.03 / MAX: 13.23MIN: 1.03 / MAX: 8.64MIN: 1.03 / MAX: 8.091. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUaabc0.07880.15760.23640.31520.394SE +/- 0.00, N = 30.350.350.34MIN: 0.23 / MAX: 7.42MIN: 0.23 / MAX: 7.74MIN: 0.23 / MAX: 7.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Apache Spark PageRankaaabc5001000150020002500SE +/- 10.75, N = 32218.62191.92158.42209.4MIN: 1633.15MIN: 1595.5 / MAX: 2209.7MIN: 1595.87 / MAX: 2158.42MIN: 1619.41

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Apache Spark Bayesaaabc80160240320400SE +/- 2.29, N = 3353.2345.6352.1343.9MIN: 330.84 / MAX: 398.86MIN: 330.79 / MAX: 376.95MIN: 332.91 / MAX: 374.03MIN: 331.51 / MAX: 372.63

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Savina Reactors.IOaaabc8001600240032004000SE +/- 8.00, N = 33855.63802.03820.33899.9MIN: 3855.59 / MAX: 5136.5MIN: 3792.83 / MAX: 5101.04MAX: 4954.7MAX: 5066.66

Primesieve

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.6Length: 1e12aaabc246810SE +/- 0.066, N = 36.6376.7836.6546.6261. (CXX) g++ options: -O3

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUaabc9K18K27K36K45KSE +/- 185.94, N = 339936.1040039.8340787.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUaabc0.2160.4320.6480.8641.08SE +/- 0.00, N = 30.960.960.94MIN: 0.59 / MAX: 8.81MIN: 0.59 / MAX: 14.25MIN: 0.59 / MAX: 81. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Akka Unbalanced Cobwebbed Treeaaabc8001600240032004000SE +/- 14.16, N = 33472.93503.83514.03542.8MAX: 4304.43MIN: 3475.86 / MAX: 4427.25MIN: 3513.99 / MAX: 4408.04MAX: 4342.51

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUaabc3K6K9K12K15KSE +/- 24.22, N = 315086.1615058.2015355.431. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: ALS Movie Lensaaabc2K4K6K8K10KSE +/- 72.41, N = 38326.48417.68354.28459.8MIN: 7832.53 / MAX: 8748.58MIN: 7832.38 / MAX: 8701.39MIN: 7901.13 / MAX: 8415.78MIN: 8160.64 / MAX: 8649.1

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Random Forestaaabc90180270360450SE +/- 4.00, N = 3393.1391.2395.1397.3MIN: 348.04 / MAX: 437.69MIN: 339.52 / MAX: 449.68MIN: 343.19 / MAX: 463.11MIN: 359.4 / MAX: 454.67

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Barbershop - Compute: NVIDIA CUDAaabc1632486480SE +/- 0.05, N = 369.3470.1569.11

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: BMW27 - Compute: CPU-Onlyaaabc1122334455SE +/- 0.10, N = 348.6449.3249.1848.82

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Classroom - Compute: NVIDIA OptiXaabc3691215SE +/- 0.02, N = 311.7711.9211.76

Primesieve

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.6Length: 1e13aaabc20406080100SE +/- 0.19, N = 386.4187.5086.8386.551. (CXX) g++ options: -O3

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Barbershop - Compute: CPU-Onlyaabc110220330440550SE +/- 0.48, N = 3511.92512.02505.73

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Gaussian Mixture Modelaaabc8001600240032004000SE +/- 17.46, N = 33761.73748.33722.93739.4MIN: 2716.5 / MAX: 3761.71MIN: 2645.79 / MAX: 3781.01MIN: 2677.26 / MAX: 3722.94MIN: 2686.88 / MAX: 3739.42

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Detection FP16 - Device: CPUaabc306090120150SE +/- 0.09, N = 3118.34118.01117.30MIN: 61.51 / MAX: 185.26MIN: 65.25 / MAX: 177.75MIN: 61.85 / MAX: 184.091. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Detection FP16 - Device: CPUaabc1224364860SE +/- 0.04, N = 350.6450.7851.071. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Vehicle Detection FP16-INT8 - Device: CPUaabc30060090012001500SE +/- 4.93, N = 31239.771243.811249.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: BMW27 - Compute: NVIDIA OptiXaabc1.17232.34463.51694.68925.8615SE +/- 0.04, N = 135.185.175.21

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16 - Device: CPUaabc4080120160200SE +/- 0.10, N = 3167.54167.22166.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Machine Translation EN To DE FP16 - Device: CPUaabc20406080100SE +/- 0.11, N = 379.9980.1780.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Machine Translation EN To DE FP16 - Device: CPUaabc20406080100SE +/- 0.10, N = 374.9174.7674.36MIN: 47.45 / MAX: 125.1MIN: 47.89 / MAX: 124.4MIN: 47.32 / MAX: 118.581. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16 - Device: CPUaabc816243240SE +/- 0.02, N = 335.7635.8236.02MIN: 13.85 / MAX: 68.74MIN: 14.06 / MAX: 65.07MIN: 14 / MAX: 64.191. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16-INT8 - Device: CPUaabc3691215SE +/- 0.05, N = 312.2112.1312.13MIN: 7.15 / MAX: 34.14MIN: 7.17 / MAX: 30.85MIN: 7.17 / MAX: 30.121. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16-INT8 - Device: CPUaabc110220330440550SE +/- 1.99, N = 3488.58491.68491.351. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Vehicle Detection FP16-INT8 - Device: CPUaabc1.07552.1513.22654.3025.3775SE +/- 0.02, N = 34.784.774.75MIN: 2.72 / MAX: 19.75MIN: 2.73 / MAX: 14.77MIN: 2.72 / MAX: 13.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Junkshop - Compute: NVIDIA OptiXaabc3691215SE +/- 0.11, N = 49.809.749.74

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection FP16 - Device: CPUaabc246810SE +/- 0.03, N = 36.516.526.551. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection FP16-INT8 - Device: CPUaabc60120180240300SE +/- 0.70, N = 3252.76251.23251.70MIN: 162.35 / MAX: 383.62MIN: 164.3 / MAX: 390.35MIN: 159.88 / MAX: 505.021. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Genetic Algorithm Using Jenetics + Futuresaaabc150300450600750SE +/- 2.18, N = 3695.7699.3695.3698.6MIN: 678.55 / MAX: 727.82MIN: 680.86 / MAX: 729.65MIN: 679.26 / MAX: 721.02MIN: 686.88 / MAX: 715.07

OpenVINO GenAI

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPUaabc48121620SE +/- 0.02, N = 314.1014.1814.18

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16-INT8 - Device: CPUaabc80160240320400SE +/- 0.35, N = 3379.60378.84380.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection FP16-INT8 - Device: CPUaabc612182430SE +/- 0.07, N = 323.6923.8223.771. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16-INT8 - Device: CPUaabc1020304050SE +/- 0.04, N = 342.1142.2041.97MIN: 34.54 / MAX: 67.63MIN: 34.58 / MAX: 72.64MIN: 34.55 / MAX: 61.291. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Vehicle Bike Detection FP16 - Device: CPUaabc246810SE +/- 0.01, N = 37.437.447.47MIN: 4.78 / MAX: 22.13MIN: 4.83 / MAX: 16.13MIN: 4.79 / MAX: 16.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Fishy Cat - Compute: CPU-Onlyaaabc20406080100SE +/- 0.19, N = 374.4674.7974.7474.39

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Vehicle Bike Detection FP16 - Device: CPUaabc2004006008001000SE +/- 1.01, N = 3802.60801.35798.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Weld Porosity Detection FP16-INT8 - Device: CPUaabc5001000150020002500SE +/- 2.42, N = 32429.202437.822441.911. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Classroom - Compute: CPU-Onlyaaabc306090120150SE +/- 0.44, N = 3139.63140.07140.20139.50

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Re-Identification Retail FP16 - Device: CPUaabc246810SE +/- 0.00, N = 36.116.106.08MIN: 4.06 / MAX: 15.69MIN: 4.08 / MAX: 15.79MIN: 4.07 / MAX: 16.281. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection FP16 - Device: CPUaabc2004006008001000SE +/- 3.02, N = 3915.49913.66911.06MIN: 627.29 / MAX: 1324.9MIN: 624.01 / MAX: 1326.84MIN: 624.05 / MAX: 1319.971. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenVINO GenAI

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPUaabc612182430SE +/- 0.04, N = 327.4827.6127.52

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Weld Porosity Detection FP16-INT8 - Device: CPUaabc246810SE +/- 0.01, N = 36.486.476.45MIN: 4.94 / MAX: 20.98MIN: 4.93 / MAX: 19.26MIN: 4.94 / MAX: 15.491. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Re-Identification Retail FP16 - Device: CPUaabc2004006008001000SE +/- 0.36, N = 3967.78969.67972.151. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: BMW27 - Compute: NVIDIA CUDAaabc246810SE +/- 0.02, N = 38.938.918.89

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Pabellon Barcelona - Compute: CPU-Onlyaabc4080120160200SE +/- 0.30, N = 3166.82166.41166.11

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Weld Porosity Detection FP16 - Device: CPUaabc612182430SE +/- 0.02, N = 324.5224.5024.42MIN: 18.82 / MAX: 39.72MIN: 18.99 / MAX: 38.98MIN: 18.97 / MAX: 42.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Weld Porosity Detection FP16 - Device: CPUaabc140280420560700SE +/- 0.78, N = 3648.96649.83651.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Noise Suppression Poconet-Like FP16 - Device: CPUaabc2004006008001000SE +/- 1.81, N = 3961.01959.74963.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Vehicle Detection FP16 - Device: CPUaabc100200300400500SE +/- 0.62, N = 3450.03451.38449.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Vehicle Detection FP16 - Device: CPUaabc3691215SE +/- 0.02, N = 313.2713.2413.29MIN: 6.33 / MAX: 29.46MIN: 6.36 / MAX: 26.02MIN: 6.36 / MAX: 24.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Noise Suppression Poconet-Like FP16 - Device: CPUaabc48121620SE +/- 0.03, N = 316.4416.4616.40MIN: 12.76 / MAX: 28.04MIN: 13.06 / MAX: 29.49MIN: 12.8 / MAX: 27.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16 - Device: CPUaabc1122334455SE +/- 0.08, N = 349.6649.5749.48MIN: 39.94 / MAX: 79.52MIN: 40.31 / MAX: 72.84MIN: 39.94 / MAX: 72.511. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16 - Device: CPUaabc70140210280350SE +/- 0.53, N = 3321.98322.54323.101. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16 - Device: CPUaabc400800120016002000SE +/- 0.98, N = 31760.281754.471754.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Pabellon Barcelona - Compute: NVIDIA OptiXaabc3691215SE +/- 0.02, N = 313.0013.0212.98

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Detection FP32 - Device: CPUaabc306090120150SE +/- 0.13, N = 3118.80118.83118.47MIN: 60.56 / MAX: 183.24MIN: 61.78 / MAX: 181.12MIN: 60.72 / MAX: 182.581. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16 - Device: CPUaabc0.75151.5032.25453.0063.7575SE +/- 0.00, N = 33.333.343.34MIN: 2.03 / MAX: 17.62MIN: 2.03 / MAX: 10.68MIN: 2.03 / MAX: 10.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Detection FP32 - Device: CPUaabc1122334455SE +/- 0.06, N = 350.4350.4450.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Junkshop - Compute: CPU-Onlyaaabc1632486480SE +/- 0.20, N = 370.0669.9370.1169.93

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Barbershop - Compute: NVIDIA OptiXaabc1122334455SE +/- 0.05, N = 347.0246.9546.90

vkpeak

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int32-scalaraaabc5K10K15K20K25KSE +/- 18.61, N = 323401.3023383.5223364.4023345.26

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int32-vec4aaabc5K10K15K20K25KSE +/- 15.15, N = 323392.4623363.1923347.4523345.11

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Junkshop - Compute: NVIDIA CUDAaabc48121620SE +/- 0.01, N = 315.3215.3215.29

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Classroom - Compute: NVIDIA CUDAaabc48121620SE +/- 0.01, N = 316.9216.9516.95

OpenVINO GenAI

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPUaabc510152025SE +/- 0.02, N = 320.7020.6920.72

vkpeak

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp16-scalaraaabc5K10K15K20K25KSE +/- 28.91, N = 323384.1123411.5723384.2323381.88

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int16-scalaraaabc3K6K9K12K15KSE +/- 2.13, N = 315292.5515286.1615280.3215299.24

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Fishy Cat - Compute: NVIDIA CUDAaabc48121620SE +/- 0.01, N = 316.9816.9716.96

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Fishy Cat - Compute: NVIDIA OptiXaabc246810SE +/- 0.01, N = 38.788.778.78

vkpeak

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp16-vec4aaabc6K12K18K24K30KSE +/- 24.97, N = 326846.8526874.5926846.2526846.89

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Pabellon Barcelona - Compute: NVIDIA CUDAaabc918273645SE +/- 0.04, N = 337.4637.4337.43

OpenVINO GenAI

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPUaabc918273645SE +/- 0.01, N = 337.6437.6737.67

vkpeak

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int16-vec4aaabc4K8K12K16K20KSE +/- 8.92, N = 317140.6217127.5617139.2117137.18

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp32-scalaraaabc5K10K15K20K25KSE +/- 5.72, N = 323473.4023465.9223476.7423478.38

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp64-scalaraaabc160320480640800SE +/- 0.09, N = 3735.97735.77735.98735.59

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp64-vec4aaabc160320480640800SE +/- 0.01, N = 3735.92735.95735.92735.82

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp32-vec4aaabc7K14K21K28K35KSE +/- 0.50, N = 330993.1730988.0030992.0530990.96

Renaissance

Test: Apache Spark ALS

a: The test quit with a non-zero exit status.

aa: The test quit with a non-zero exit status.

b: The test quit with a non-zero exit status.

c: The test quit with a non-zero exit status.

85 Results Shown

Renaissance:
  Scala Dotty
  Finagle HTTP Requests
OpenVINO
Renaissance
OpenVINO:
  Face Detection Retail FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
Renaissance:
  Apache Spark PageRank
  Apache Spark Bayes
  Savina Reactors.IO
Primesieve
OpenVINO:
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16 - CPU
Renaissance
OpenVINO
Renaissance:
  ALS Movie Lens
  Rand Forest
Blender:
  Barbershop - NVIDIA CUDA
  BMW27 - CPU-Only
  Classroom - NVIDIA OptiX
Primesieve
Blender
Renaissance
OpenVINO:
  Person Detection FP16 - CPU:
    ms
    FPS
  Vehicle Detection FP16-INT8 - CPU:
    FPS
Blender
OpenVINO:
  Road Segmentation ADAS FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
  Road Segmentation ADAS FP16 - CPU
  Road Segmentation ADAS FP16-INT8 - CPU
  Road Segmentation ADAS FP16-INT8 - CPU
  Vehicle Detection FP16-INT8 - CPU
Blender
OpenVINO:
  Face Detection FP16 - CPU
  Face Detection FP16-INT8 - CPU
Renaissance
OpenVINO GenAI
OpenVINO:
  Handwritten English Recognition FP16-INT8 - CPU
  Face Detection FP16-INT8 - CPU
  Handwritten English Recognition FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
Blender
OpenVINO:
  Person Vehicle Bike Detection FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
Blender
OpenVINO:
  Person Re-Identification Retail FP16 - CPU
  Face Detection FP16 - CPU
OpenVINO GenAI
OpenVINO:
  Weld Porosity Detection FP16-INT8 - CPU
  Person Re-Identification Retail FP16 - CPU
Blender:
  BMW27 - NVIDIA CUDA
  Pabellon Barcelona - CPU-Only
OpenVINO:
  Weld Porosity Detection FP16 - CPU:
    ms
    FPS
  Noise Suppression Poconet-Like FP16 - CPU:
    FPS
  Vehicle Detection FP16 - CPU:
    FPS
    ms
  Noise Suppression Poconet-Like FP16 - CPU:
    ms
  Handwritten English Recognition FP16 - CPU:
    ms
    FPS
  Face Detection Retail FP16 - CPU:
    FPS
Blender
OpenVINO:
  Person Detection FP32 - CPU
  Face Detection Retail FP16 - CPU
  Person Detection FP32 - CPU
Blender:
  Junkshop - CPU-Only
  Barbershop - NVIDIA OptiX
vkpeak:
  int32-scalar
  int32-vec4
Blender:
  Junkshop - NVIDIA CUDA
  Classroom - NVIDIA CUDA
OpenVINO GenAI
vkpeak:
  fp16-scalar
  int16-scalar
Blender:
  Fishy Cat - NVIDIA CUDA
  Fishy Cat - NVIDIA OptiX
vkpeak
Blender
OpenVINO GenAI
vkpeak:
  int16-vec4
  fp32-scalar
  fp64-scalar
  fp64-vec4
  fp32-vec4