Intel 5th Gen Xeon AVX-512 Comparison

2 x INTEL XEON PLATINUM 8592 AVX-512 Emerald Rapids vs. Sapphire Rapids by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2312146-NE-INTELAVX523
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

CPU Massive 2 Tests
Creator Workloads 6 Tests
HPC - High Performance Computing 4 Tests
Machine Learning 3 Tests
Multi-Core 6 Tests
Intel oneAPI 6 Tests
Python Tests 2 Tests
Raytracing 2 Tests
Renderers 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Comparison
Transpose Comparison

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Sapphire Rapids: AVX-512 On
December 02 2023
  3 Hours, 51 Minutes
Sapphire Rapids: AVX-512 Off
December 03 2023
  4 Hours, 20 Minutes
Emerald Rapids: AVX-512 On
December 11 2023
  4 Hours, 22 Minutes
Emerald Rapids: AVX-512 Off
December 11 2023
  4 Hours, 57 Minutes
Invert Hiding All Results Option
  4 Hours, 23 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Sapphire Rapids: AVX-512 On

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0004d0
Python Notes: Python 3.11.6
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Sapphire Rapids: AVX-512 Off

Processor: 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads), Motherboard: Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T

OS: Ubuntu 23.10, Kernel: 6.5.0-13-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080

Emerald Rapids: AVX-512 On

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000161
Python Notes: Python 3.11.6
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Emerald Rapids: AVX-512 Off

Changed Processor to 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads).

Changed Motherboard to Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS).

ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSapphire RapidsEmerald Rapids AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)Intel Device 1bce1008GB3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Intel X710 for 10GBASE-TUbuntu 23.106.5.0-13-generic (x86_64)GCC 13.2.0ext41920x10802 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads)Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Sapphire Rapids: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0004d0- Sapphire Rapids: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0004d0- Emerald Rapids: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000161- Emerald Rapids: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000161Python Details- Python 3.11.6Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

minibude: OpenMP - BM1minibude: OpenMP - BM2openvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUembree: Pathtracer ISPC - Crownembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objminibude: OpenMP - BM1minibude: OpenMP - BM2tensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 64 - ResNet-50openvkl: vklBenchmarkCPU ISPCospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUospray-studio: 1 - 4K - 1 - Path Tracer - CPUospray-studio: 3 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 16 - Path Tracer - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUospray-studio: 1 - 1080p - 1 - Path Tracer - CPUospray-studio: 3 - 1080p - 1 - Path Tracer - CPUospray-studio: 1 - 1080p - 16 - Path Tracer - CPUospray-studio: 1 - 1080p - 32 - Path Tracer - CPUospray-studio: 3 - 1080p - 16 - Path Tracer - CPUospray-studio: 3 - 1080p - 32 - Path Tracer - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUy-cruncher: 1By-cruncher: 5By-cruncher: 500MSapphire RapidsEmerald Rapids AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off136.743138.656218.62637.73637.783887.30412.8614944.261528.735759.7126917.0120980.691894.49742.5147113.297556.524381.75144820.35151891.46124.0863152.5351131.84663418.5753466.39485.6466.18103.28270535.888235.243215.0832830.9598891062140543302616796384832262683545708942318457137.0947.0147.007.70290.158.0219.6020.734.385.7163.2740.192.5315.7627.330.370.294.91428.6042.29383.61888.56721.89214.94213.061749.9885.026859.86923.473688.322463.9813852.881645.03212.638773.982564.091075.6565805.38129576.78113.1300141.1111122.33482090.4452214.18257.8447.2268.42215523.658522.52119.22521896.529103512261648638309196044446026330941668326491799341355.33139.44140.6417.12352.0817.4632.4532.5148.488.6572.89140.6813.6611.69111.631.750.576.33836.6372.907212.535199.028236.14747.49747.774765.95538.2718384.831884.998921.9732234.0424769.102389.551097.8249132.9910161.315105.95114369.66123447.74151.4667200.9029174.38435313.3664975.69572.0649.2697.85324542.654541.610917.04091331.74749886121252382514345327231892233017605335747146135.3742.7642.746.69237.366.9516.9514.333.935.1553.5129.072.4412.5524.870.460.45.23327.0582.754135.703124.48024.67238.22237.772116.6494.578208.881159.934277.312822.7115101.291882.97276.639439.922988.911166.1863672.97101244.00137.6227181.8347159.48323392.5683112.00553.6039.0666.08236523.410020.937410.566742341.1489310551425733603171513878722527935857218424285961287.11134.18134.4415.10337.6915.5827.5629.9145.328.4667.93115.3513.5510.69109.751.70.636.54033.6803.109OpenBenchmarking.org

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringAVX-512 OnAVX-512 Off1326395265Min: 30 / Avg: 54 / Max: 64Min: 29 / Avg: 53.19 / Max: 66Min: 25 / Avg: 51.04 / Max: 61Min: 22 / Avg: 48.5 / Max: 59

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On10002000300040005000Min: 500 / Avg: 3017.93 / Max: 3917Min: 800 / Avg: 2954.57 / Max: 3913Min: 800 / Avg: 2870.28 / Max: 5743Min: 500 / Avg: 2841.09 / Max: 3519

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On160320480640800Min: 67.03 / Avg: 598.76 / Max: 762.66Min: 72.02 / Avg: 574.93 / Max: 770.09Min: 99.6 / Avg: 589.71 / Max: 894.8Min: 103.63 / Avg: 583.08 / Max: 772.16

miniBUDE

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On0.0720.1440.2160.2880.360.1540.2440.1960.320

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On50100150200250SE +/- 0.69, N = 5SE +/- 0.52, N = 7SE +/- 0.03, N = 7SE +/- 0.15, N = 883.62136.74135.70212.541. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On0.1080.2160.3240.4320.540.1620.3030.2770.480
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2822.27 / Max: 3508Min: 800 / Avg: 2871.1 / Max: 3512Min: 800 / Avg: 2998.12 / Max: 3905Min: 800 / Avg: 3050.88 / Max: 3906
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 67.03 / Avg: 516.75 / Max: 712.97Min: 125.76 / Avg: 450.59 / Max: 685.74Min: 195.99 / Avg: 489.71 / Max: 754.91Min: 196.51 / Avg: 442.58 / Max: 756.34
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 29 / Avg: 42.38 / Max: 50Min: 30 / Avg: 40.48 / Max: 49Min: 25 / Avg: 39.7 / Max: 48Min: 22 / Avg: 34.39 / Max: 42

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On4080120160200SE +/- 0.22, N = 3SE +/- 0.71, N = 3SE +/- 0.97, N = 15SE +/- 1.98, N = 1588.57138.66124.48199.031. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On0.0720.1440.2160.2880.360.1540.2440.1960.320
Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 800 / Avg: 2947.32 / Max: 3907Min: 800 / Avg: 2958.53 / Max: 3904Min: 800 / Avg: 2971.88 / Max: 5743Min: 800 / Avg: 3062.99 / Max: 3509
Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 196.96 / Avg: 634.15 / Max: 758.15Min: 196.6 / Avg: 621.22 / Max: 756.81Min: 140.54 / Avg: 574.74 / Max: 757.06Min: 130.7 / Avg: 569.31 / Max: 758.19
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 35 / Avg: 55.67 / Max: 63Min: 36 / Avg: 54.58 / Max: 63Min: 33 / Avg: 48.15 / Max: 54Min: 28 / Avg: 43.53 / Max: 50

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OffAVX-512 On50100150200250SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 321.89218.6224.67236.141. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OffAVX-512 On160320480640800SE +/- 0.08, N = 3SE +/- 0.66, N = 3SE +/- 0.31, N = 3SE +/- 0.82, N = 3214.94637.73238.22747.491. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OffAVX-512 On160320480640800SE +/- 0.26, N = 3SE +/- 0.38, N = 3SE +/- 0.09, N = 3SE +/- 1.03, N = 3213.06637.78237.77747.771. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On10002000300040005000SE +/- 0.53, N = 3SE +/- 1.67, N = 3SE +/- 1.56, N = 3SE +/- 1.59, N = 31749.983887.302116.644765.951. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On120240360480600SE +/- 0.06, N = 3SE +/- 2.15, N = 3SE +/- 0.10, N = 3SE +/- 0.53, N = 385.02412.8694.57538.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUAVX-512 OffAVX-512 On4K8K12K16K20KSE +/- 3.57, N = 3SE +/- 24.24, N = 3SE +/- 2.90, N = 3SE +/- 5.71, N = 36859.8614944.268208.8818384.831. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUAVX-512 OffAVX-512 On400800120016002000SE +/- 0.24, N = 3SE +/- 1.66, N = 3SE +/- 0.98, N = 3SE +/- 1.06, N = 3923.471528.731159.931884.991. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 3.58, N = 3SE +/- 11.71, N = 3SE +/- 0.66, N = 3SE +/- 8.09, N = 33688.325759.714277.318921.971. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OffAVX-512 On7K14K21K28K35KSE +/- 2.47, N = 3SE +/- 29.04, N = 3SE +/- 0.50, N = 3SE +/- 24.15, N = 32463.9826917.012822.7132234.041. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On5K10K15K20K25KSE +/- 9.76, N = 3SE +/- 25.65, N = 3SE +/- 8.51, N = 3SE +/- 20.85, N = 313852.8820980.6915101.2924769.101. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On5001000150020002500SE +/- 0.20, N = 3SE +/- 1.25, N = 3SE +/- 0.40, N = 3SE +/- 2.91, N = 31645.031894.491882.972389.551. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OffAVX-512 On2004006008001000SE +/- 1.82, N = 3SE +/- 1.33, N = 3SE +/- 0.41, N = 3SE +/- 1.48, N = 3212.63742.51276.631097.821. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On11K22K33K44K55KSE +/- 3.89, N = 3SE +/- 54.78, N = 3SE +/- 3.35, N = 3SE +/- 80.54, N = 38773.9847113.299439.9249132.991. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 1.81, N = 3SE +/- 6.80, N = 3SE +/- 0.72, N = 3SE +/- 3.93, N = 32564.097556.522988.9110161.311. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUAVX-512 OffAVX-512 On11002200330044005500SE +/- 10.21, N = 15SE +/- 26.63, N = 3SE +/- 10.88, N = 7SE +/- 0.84, N = 31075.654381.751166.185105.951. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OffAVX-512 On30K60K90K120K150KSE +/- 52.05, N = 3SE +/- 898.88, N = 3SE +/- 51.71, N = 3SE +/- 735.86, N = 363672.97114369.6665805.38144820.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On30K60K90K120K150KSE +/- 496.38, N = 3SE +/- 940.07, N = 3SE +/- 1069.55, N = 3SE +/- 547.74, N = 3101244.00123447.74129576.78151891.461. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On306090120150SE +/- 0.27, N = 6SE +/- 0.36, N = 6SE +/- 0.23, N = 7SE +/- 0.55, N = 7113.13124.09137.62151.47
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On0.07110.14220.21330.28440.35550.2320.2600.2860.316
Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2827.67 / Max: 3901Min: 800 / Avg: 3111.22 / Max: 3908Min: 800 / Avg: 2838.46 / Max: 3512Min: 800 / Avg: 2856.35 / Max: 3512
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 125.62 / Avg: 487.84 / Max: 740.05Min: 123.86 / Avg: 478.02 / Max: 740.13Min: 199.01 / Avg: 478.95 / Max: 719.96Min: 195.35 / Avg: 478.68 / Max: 755.09
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OnAVX-512 Off1122334455Min: 41 / Avg: 47.38 / Max: 53Min: 40 / Avg: 47.23 / Max: 53Min: 38 / Avg: 46.37 / Max: 52Min: 35 / Avg: 42.8 / Max: 48

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On4080120160200SE +/- 0.22, N = 7SE +/- 0.33, N = 7SE +/- 0.30, N = 7SE +/- 0.38, N = 8141.11152.54181.83200.90
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On0.10190.20380.30570.40760.50950.3010.3320.4030.453
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2689.74 / Max: 3510Min: 800 / Avg: 2815.76 / Max: 3509Min: 800 / Avg: 2950.63 / Max: 3901Min: 800 / Avg: 3148.94 / Max: 3908
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 121.15 / Avg: 469.47 / Max: 759.39Min: 124.87 / Avg: 459.53 / Max: 760.23Min: 198.42 / Avg: 451.72 / Max: 751.32Min: 99.6 / Avg: 443.11 / Max: 753.55
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 39 / Avg: 45.09 / Max: 50Min: 38 / Avg: 44.58 / Max: 51Min: 36 / Avg: 43.21 / Max: 49Min: 33 / Avg: 39.8 / Max: 45

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OffAVX-512 On4080120160200SE +/- 0.21, N = 3SE +/- 0.26, N = 4SE +/- 0.19, N = 4SE +/- 0.52, N = 4122.33131.85159.48174.38
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OffAVX-512 On0.11880.23760.35640.47520.5940.2990.3220.4560.528
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 3012.02 / Max: 3509Min: 800 / Avg: 3185.08 / Max: 3509Min: 800 / Avg: 3421.05 / Max: 3905Min: 800 / Avg: 3461.42 / Max: 3907
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 131.13 / Avg: 409.32 / Max: 758.21Min: 75.9 / Avg: 408.93 / Max: 760.89Min: 183.81 / Avg: 349.88 / Max: 758.31Min: 183.04 / Avg: 330.48 / Max: 754.13
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 36 / Avg: 39.76 / Max: 48Min: 36 / Avg: 39.47 / Max: 47Min: 34 / Avg: 39.36 / Max: 47Min: 32 / Avg: 36.48 / Max: 43

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On11002200330044005500SE +/- 17.21, N = 5SE +/- 12.90, N = 7SE +/- 0.74, N = 7SE +/- 3.87, N = 82090.453418.583392.575313.371. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On11002200330044005500SE +/- 5.42, N = 3SE +/- 17.85, N = 3SE +/- 24.22, N = 15SE +/- 49.58, N = 152214.183466.393112.014975.701. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

TensorFlow

Emerald RapidsSapphire RapidsOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OffAVX-512 On0.0320.0640.0960.1280.160.0940.1240.0970.142

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 32 - Model: ResNet-50AVX-512 OffAVX-512 On0.0380.0760.1140.1520.190.1130.1690.1190.165

Emerald RapidsSapphire RapidsOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 32 - Model: ResNet-50AVX-512 OffAVX-512 On20406080100SE +/- 0.14, N = 3SE +/- 0.13, N = 3SE +/- 0.36, N = 3SE +/- 0.22, N = 353.6072.0657.8485.64
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 32 - Model: ResNet-50AVX-512 OffAVX-512 On0.0380.0760.1140.1520.190.1130.1690.1190.165
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 3011.19 / Max: 3516Min: 800 / Avg: 3205.24 / Max: 3500Min: 800 / Avg: 3656.93 / Max: 3909Min: 800 / Avg: 3797.09 / Max: 3912
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.12CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 83.76 / Avg: 510.59 / Max: 556.63Min: 133.66 / Avg: 507.68 / Max: 568.58Min: 206.73 / Avg: 448.87 / Max: 498.3Min: 206.81 / Avg: 437.84 / Max: 494.79
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.12CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 36 / Avg: 43.72 / Max: 47Min: 37 / Avg: 43.39 / Max: 46Min: 33 / Avg: 42.52 / Max: 45Min: 34 / Avg: 42.48 / Max: 47

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OffAVX-512 On0.04610.09220.13830.18440.23050.1260.1880.1380.205

Emerald RapidsSapphire RapidsOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OffAVX-512 On1530456075SE +/- 0.20, N = 3SE +/- 0.41, N = 3SE +/- 0.28, N = 3SE +/- 0.31, N = 339.0649.2647.2266.18
Emerald RapidsSapphire RapidsOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OffAVX-512 On0.0320.0640.0960.1280.160.0940.1240.0970.142
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 3179.69 / Max: 3508Min: 800 / Avg: 3199.12 / Max: 3515Min: 800 / Avg: 3719.28 / Max: 3912Min: 800 / Avg: 3778.53 / Max: 3909
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.12CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 145.05 / Avg: 485.57 / Max: 544.2Min: 135.2 / Avg: 467.02 / Max: 544.28Min: 206.9 / Avg: 413.92 / Max: 462.77Min: 170.32 / Avg: 398.6 / Max: 450.75
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.12CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 39 / Avg: 43.36 / Max: 45Min: 39 / Avg: 43.01 / Max: 49Min: 37 / Avg: 41.93 / Max: 46Min: 37 / Avg: 41.69 / Max: 44

Emerald RapidsSapphire RapidsOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OffAVX-512 On20406080100SE +/- 0.58, N = 3SE +/- 0.16, N = 3SE +/- 0.39, N = 3SE +/- 0.75, N = 366.0897.8568.42103.28
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OffAVX-512 On0.04610.09220.13830.18440.23050.1260.1880.1380.205
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 3056.82 / Max: 3509Min: 800 / Avg: 3214.95 / Max: 3515Min: 800 / Avg: 3711.35 / Max: 3906Min: 800 / Avg: 3787.56 / Max: 3910
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.12CPU Power Consumption MonitorAVX-512 OnAVX-512 Off110220330440550Min: 144.3 / Avg: 549.53 / Max: 606.11Min: 133.72 / Avg: 541.03 / Max: 580.13Min: 206.82 / Avg: 480.23 / Max: 511.44Min: 207.18 / Avg: 476.86 / Max: 531.76
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.12CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 37 / Avg: 46.02 / Max: 51Min: 37 / Avg: 45.48 / Max: 50Min: 34 / Avg: 45.35 / Max: 49Min: 34 / Avg: 45.2 / Max: 50

OpenVKL

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 OffAVX-512 On1.1482.2963.4444.5925.743.3564.2583.8925.102

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 OffAVX-512 On7001400210028003500SE +/- 4.04, N = 3SE +/- 3.84, N = 3SE +/- 6.36, N = 3SE +/- 30.78, N = 32155270523653245
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 OffAVX-512 On1.1482.2963.4444.5925.743.3564.2583.8925.102
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVKL 2.0.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 500 / Avg: 2843.9 / Max: 3519Min: 800 / Avg: 2872.62 / Max: 3515Min: 500 / Avg: 2909.25 / Max: 3917Min: 800 / Avg: 2934.37 / Max: 3913
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 2.0.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 134.89 / Avg: 642.1 / Max: 759.51Min: 123.79 / Avg: 635.31 / Max: 760.66Min: 199.73 / Avg: 636.08 / Max: 754.77Min: 105.27 / Avg: 607.73 / Max: 758.79
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVKL 2.0.0CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 35 / Avg: 56.19 / Max: 61Min: 36 / Avg: 54.42 / Max: 60Min: 34 / Avg: 54.24 / Max: 60Min: 30 / Avg: 51.4 / Max: 57

OSPRay

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On0.01460.02920.04380.05840.0730.0360.0550.0390.065

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On1020304050SE +/- 0.07, N = 3SE +/- 0.19, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 323.4142.6523.6635.89
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On0.01490.02980.04470.05960.07450.0380.0560.0410.066
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2650.94 / Max: 3510Min: 800 / Avg: 2909.36 / Max: 3509Min: 800 / Avg: 2821.53 / Max: 3907Min: 2187 / Avg: 3001.49 / Max: 3907
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.12CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 135.38 / Avg: 645.46 / Max: 744.99Min: 132.38 / Avg: 625.29 / Max: 749.25Min: 206.8 / Avg: 642.59 / Max: 756.55Min: 199.85 / Avg: 565.77 / Max: 674.64
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.12CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 55.75 / Max: 60Min: 40 / Avg: 53.64 / Max: 58Min: 36 / Avg: 51.78 / Max: 57Min: 34 / Avg: 50.89 / Max: 55

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On918273645SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 320.9441.6122.5235.24
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On0.01460.02920.04380.05840.0730.0360.0550.0390.065
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2633.09 / Max: 3514Min: 800 / Avg: 2856.21 / Max: 3506Min: 800 / Avg: 2789.09 / Max: 3900Min: 800 / Avg: 2860.32 / Max: 3908
Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.12CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 199.86 / Avg: 642.78 / Max: 757.23Min: 200.25 / Avg: 530.92 / Max: 639.95Min: 140.03 / Avg: 641.68 / Max: 741.33Min: 134.53 / Avg: 625.67 / Max: 751
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.12CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 55.91 / Max: 60Min: 41 / Avg: 50.57 / Max: 56Min: 38 / Avg: 52.29 / Max: 57Min: 37 / Avg: 51.63 / Max: 56

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On0.00650.0130.01950.0260.03250.0150.0240.0180.029

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On48121620SE +/- 0.13104, N = 15SE +/- 0.14483, N = 15SE +/- 0.07557, N = 15SE +/- 0.20744, N = 49.2252115.0832010.5667417.04090
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On0.00650.0130.01950.0260.03250.0150.0240.0180.029
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2944.84 / Max: 3510Min: 800 / Avg: 2962.97 / Max: 3510Min: 800 / Avg: 3011.05 / Max: 3904Min: 800 / Avg: 3027.44 / Max: 3910
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.12CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 129.23 / Avg: 635.29 / Max: 759.02Min: 130.09 / Avg: 616.55 / Max: 735.34Min: 187.87 / Avg: 596.54 / Max: 711.75Min: 206.42 / Avg: 572.92 / Max: 683.35
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.12CPU Temperature MonitorAVX-512 OnAVX-512 Off1122334455Min: 41 / Avg: 52.31 / Max: 57Min: 40 / Avg: 51.3 / Max: 55Min: 38 / Avg: 50.91 / Max: 54Min: 38 / Avg: 50.81 / Max: 54

Y-Cruncher

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2798.17 / Max: 3511Min: 800 / Avg: 2846.32 / Max: 3512Min: 800 / Avg: 3155.23 / Max: 3908Min: 800 / Avg: 3268.42 / Max: 3908

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2736.78 / Max: 3509Min: 800 / Avg: 2783.21 / Max: 3509Min: 800 / Avg: 2830.68 / Max: 3904Min: 800 / Avg: 2895.61 / Max: 3907

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2850.7 / Max: 3510Min: 800 / Avg: 2852.57 / Max: 3515Min: 800 / Avg: 3313.53 / Max: 3907Min: 800 / Avg: 3445.48 / Max: 3908

oneDNN

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2857.85 / Max: 3512Min: 800 / Avg: 2905.96 / Max: 3509Min: 800 / Avg: 2951.28 / Max: 3906Min: 800 / Avg: 2962.65 / Max: 3907

OSPRay Studio

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2870.25 / Max: 3511Min: 800 / Avg: 2906.5 / Max: 3502Min: 800 / Avg: 2954.22 / Max: 3907Min: 800 / Avg: 2996.59 / Max: 3908

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2894.68 / Max: 3510Min: 800 / Avg: 2934.05 / Max: 3501Min: 800 / Avg: 2999.39 / Max: 3906Min: 800 / Avg: 3008.77 / Max: 3904

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2759.25 / Max: 3516Min: 800 / Avg: 2899.72 / Max: 3511Min: 800 / Avg: 2854.58 / Max: 3904Min: 800 / Avg: 2984.18 / Max: 3906

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2818.6 / Max: 3903Min: 800 / Avg: 3089.22 / Max: 3904Min: 800 / Avg: 2898.85 / Max: 3501Min: 800 / Avg: 2936.5 / Max: 3509

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2839.81 / Max: 3512Min: 800 / Avg: 2890.48 / Max: 3509Min: 800 / Avg: 2852.57 / Max: 3908Min: 800 / Avg: 2959.45 / Max: 3908

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2910.39 / Max: 3509Min: 800 / Avg: 2969.61 / Max: 3515Min: 800 / Avg: 2986.32 / Max: 3905Min: 800 / Avg: 3036.33 / Max: 3904

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2860.68 / Max: 3508Min: 800 / Avg: 2895.53 / Max: 3513Min: 800 / Avg: 2911.78 / Max: 3908Min: 800 / Avg: 2951.28 / Max: 3909

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2867.16 / Max: 3507Min: 800 / Avg: 2879.74 / Max: 3503Min: 500 / Avg: 2883.43 / Max: 3904Min: 800 / Avg: 2918.01 / Max: 3904

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2852.98 / Max: 3501Min: 800 / Avg: 2884.44 / Max: 3508Min: 800 / Avg: 2892.35 / Max: 3905Min: 800 / Avg: 2958.37 / Max: 3904

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2805.89 / Max: 3503Min: 800 / Avg: 2861.55 / Max: 3512Min: 800 / Avg: 2863.16 / Max: 3903Min: 800 / Avg: 2907.46 / Max: 3904

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2842.13 / Max: 3513Min: 800 / Avg: 2863.77 / Max: 3508Min: 800 / Avg: 2897.48 / Max: 3904Min: 800 / Avg: 2897.66 / Max: 3904

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2806.99 / Max: 3507Min: 800 / Avg: 2893.76 / Max: 3515Min: 800 / Avg: 2900.24 / Max: 3908Min: 800 / Avg: 2909.62 / Max: 3904

OpenVINO

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2489.2 / Max: 3512Min: 800 / Avg: 2872.4 / Max: 3515Min: 800 / Avg: 2665.33 / Max: 3908Min: 800 / Avg: 3007.46 / Max: 3907

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2567.68 / Max: 3908Min: 800 / Avg: 2892 / Max: 3908Min: 800 / Avg: 2822.65 / Max: 3514Min: 800 / Avg: 2904.53 / Max: 3509

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2545.34 / Max: 3903Min: 800 / Avg: 2830.49 / Max: 3910Min: 800 / Avg: 2785.33 / Max: 3510Min: 800 / Avg: 2808.74 / Max: 3515

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2440.06 / Max: 3509Min: 800 / Avg: 2499.4 / Max: 3510Min: 800 / Avg: 2496.49 / Max: 3905Min: 800 / Avg: 2534.47 / Max: 3911

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2524.72 / Max: 3512Min: 800 / Avg: 2900.67 / Max: 3511Min: 800 / Avg: 2675.48 / Max: 3909Min: 800 / Avg: 2956.05 / Max: 3907

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2364.74 / Max: 3512Min: 800 / Avg: 2409.05 / Max: 3512Min: 800 / Avg: 2432.9 / Max: 3905Min: 800 / Avg: 2474.34 / Max: 3904

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2429.46 / Max: 3910Min: 800 / Avg: 2692.65 / Max: 3912Min: 800 / Avg: 2446.61 / Max: 3509Min: 800 / Avg: 2705.88 / Max: 3511

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2369.5 / Max: 3907Min: 800 / Avg: 2584.05 / Max: 3907Min: 800 / Avg: 2466.01 / Max: 3511Min: 800 / Avg: 2588.47 / Max: 3509

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2246.35 / Max: 3510Min: 800 / Avg: 2823.12 / Max: 3513Min: 800 / Avg: 2334.49 / Max: 3904Min: 800 / Avg: 2912.9 / Max: 3907

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2335.95 / Max: 3514Min: 800 / Avg: 2890.23 / Max: 3515Min: 800 / Avg: 2523.87 / Max: 3907Min: 800 / Avg: 2937.64 / Max: 3910

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2452.95 / Max: 3510Min: 800 / Avg: 2542 / Max: 3511Min: 800 / Avg: 2552.5 / Max: 3909Min: 800 / Avg: 2654.51 / Max: 3908

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2690.93 / Max: 3512Min: 800 / Avg: 2778.23 / Max: 3515Min: 800 / Avg: 2755.35 / Max: 3904Min: 800 / Avg: 2833.67 / Max: 3907

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2252.6 / Max: 3510Min: 800 / Avg: 2808.93 / Max: 3508Min: 800 / Avg: 2316.34 / Max: 3904Min: 800 / Avg: 2931.15 / Max: 3905

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2456.27 / Max: 3513Min: 800 / Avg: 2849.9 / Max: 3513Min: 800 / Avg: 2526.74 / Max: 3905Min: 800 / Avg: 2825.64 / Max: 3908

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2457.57 / Max: 3510Min: 800 / Avg: 2813.17 / Max: 3514Min: 800 / Avg: 2629.98 / Max: 3905Min: 800 / Avg: 2890.31 / Max: 3904

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2573.11 / Max: 3516Min: 800 / Avg: 2659.67 / Max: 3511Min: 800 / Avg: 2666.29 / Max: 3914Min: 800 / Avg: 3132.4 / Max: 3904

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2693.5 / Max: 3506Min: 800 / Avg: 2829.36 / Max: 3513Min: 800 / Avg: 3150.41 / Max: 3904Min: 800 / Avg: 3332.23 / Max: 3906

Y-Cruncher

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.2CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 40 / Avg: 44.62 / Max: 49Min: 41 / Avg: 44.12 / Max: 50Min: 37 / Avg: 42.99 / Max: 49Min: 36 / Avg: 40.69 / Max: 47

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.2CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 37 / Avg: 49.71 / Max: 57Min: 37 / Avg: 48.55 / Max: 55Min: 34 / Avg: 47.63 / Max: 55Min: 32 / Avg: 44.12 / Max: 51

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.2CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 38 / Avg: 41.46 / Max: 47Min: 37 / Avg: 40.47 / Max: 46Min: 36 / Avg: 40.27 / Max: 47Min: 34 / Avg: 37.36 / Max: 43

oneDNN

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.3CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 35 / Avg: 52.63 / Max: 57Min: 35 / Avg: 52.1 / Max: 59Min: 38 / Avg: 50.66 / Max: 54Min: 36 / Avg: 47.82 / Max: 52

OSPRay Studio

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 39 / Avg: 52.09 / Max: 59Min: 39 / Avg: 51.01 / Max: 59Min: 37 / Avg: 49.82 / Max: 57Min: 35 / Avg: 48.28 / Max: 54

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 39 / Avg: 52.36 / Max: 59Min: 39 / Avg: 51.38 / Max: 59Min: 37 / Avg: 49.96 / Max: 57Min: 36 / Avg: 48.71 / Max: 54

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 39 / Avg: 54.76 / Max: 60Min: 41 / Avg: 52.42 / Max: 59Min: 36 / Avg: 51.11 / Max: 56Min: 37 / Avg: 49.91 / Max: 56

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 40 / Avg: 54.1 / Max: 60Min: 40 / Avg: 49.28 / Max: 57Min: 38 / Avg: 48.12 / Max: 55Min: 37 / Avg: 46.03 / Max: 53

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 40 / Avg: 55.23 / Max: 60Min: 39 / Avg: 52.4 / Max: 59Min: 37 / Avg: 50.57 / Max: 57Min: 36 / Avg: 48.42 / Max: 55

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1122334455Min: 41 / Avg: 49.81 / Max: 57Min: 39 / Avg: 49.75 / Max: 57Min: 37 / Avg: 48.42 / Max: 55Min: 37 / Avg: 46.82 / Max: 53

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 40 / Avg: 53.82 / Max: 60Min: 38 / Avg: 52.16 / Max: 59Min: 36 / Avg: 50.91 / Max: 57Min: 36 / Avg: 49.85 / Max: 56

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 54.4 / Max: 60Min: 39 / Avg: 52.07 / Max: 59Min: 37 / Avg: 51.34 / Max: 57Min: 37 / Avg: 50.46 / Max: 56

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 54.26 / Max: 60Min: 38 / Avg: 52.7 / Max: 59Min: 38 / Avg: 51.02 / Max: 57Min: 37 / Avg: 50 / Max: 56

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 40 / Avg: 54.65 / Max: 60Min: 39 / Avg: 53.47 / Max: 59Min: 38 / Avg: 51.41 / Max: 57Min: 37 / Avg: 50.95 / Max: 57

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 54.44 / Max: 60Min: 39 / Avg: 52.8 / Max: 59Min: 37 / Avg: 50.95 / Max: 57Min: 37 / Avg: 50.46 / Max: 56

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 54.83 / Max: 60Min: 39 / Avg: 53.61 / Max: 60Min: 37 / Avg: 50.92 / Max: 57Min: 37 / Avg: 50.81 / Max: 56

OpenVINO

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 55.73 / Max: 60Min: 37 / Avg: 54.55 / Max: 60Min: 36 / Avg: 51.42 / Max: 56Min: 35 / Avg: 51.37 / Max: 57

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 56.47 / Max: 60Min: 40 / Avg: 55.35 / Max: 60Min: 37 / Avg: 51.8 / Max: 55Min: 38 / Avg: 51.7 / Max: 55

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 42 / Avg: 56.49 / Max: 60Min: 40 / Avg: 55.88 / Max: 59Min: 37 / Avg: 52.1 / Max: 56Min: 38 / Avg: 51.96 / Max: 55

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 42 / Avg: 56.43 / Max: 60Min: 40 / Avg: 56.14 / Max: 60Min: 38 / Avg: 52.28 / Max: 55Min: 37 / Avg: 51.81 / Max: 55

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41 / Avg: 56.46 / Max: 61Min: 42 / Avg: 55.99 / Max: 61Min: 38 / Avg: 52.8 / Max: 57Min: 38 / Avg: 51.9 / Max: 56

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 56.27 / Max: 59Min: 41 / Avg: 56 / Max: 59Min: 37 / Avg: 52.35 / Max: 56Min: 36 / Avg: 51.8 / Max: 55

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 56.66 / Max: 60Min: 41 / Avg: 56.23 / Max: 60Min: 38 / Avg: 52.34 / Max: 55Min: 37 / Avg: 52.15 / Max: 56

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 42 / Avg: 56.5 / Max: 60Min: 41 / Avg: 56.01 / Max: 59Min: 37 / Avg: 52.7 / Max: 56Min: 38 / Avg: 52.42 / Max: 56

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 57.39 / Max: 61Min: 41 / Avg: 56.79 / Max: 60Min: 38 / Avg: 53.49 / Max: 57Min: 39 / Avg: 53.16 / Max: 57

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 56.75 / Max: 60Min: 40 / Avg: 56.4 / Max: 60Min: 38 / Avg: 53.64 / Max: 57Min: 38 / Avg: 52.94 / Max: 56

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 42 / Avg: 56.42 / Max: 60Min: 40 / Avg: 55.71 / Max: 59Min: 38 / Avg: 52.67 / Max: 57Min: 37 / Avg: 52.28 / Max: 56

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 42 / Avg: 56.51 / Max: 60Min: 41 / Avg: 55.93 / Max: 60Min: 38 / Avg: 52.23 / Max: 55Min: 38 / Avg: 51.99 / Max: 56

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 43 / Avg: 57.32 / Max: 60Min: 41 / Avg: 57.06 / Max: 60Min: 38 / Avg: 53.43 / Max: 57Min: 38 / Avg: 53.03 / Max: 56

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 42 / Avg: 56.39 / Max: 61Min: 41 / Avg: 56.04 / Max: 60Min: 38 / Avg: 52.29 / Max: 56Min: 38 / Avg: 51.96 / Max: 56

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 42 / Avg: 57.82 / Max: 61Min: 41 / Avg: 56.83 / Max: 60Min: 38 / Avg: 53.14 / Max: 56Min: 38 / Avg: 52.54 / Max: 56

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41 / Avg: 55.93 / Max: 59Min: 42 / Avg: 49.55 / Max: 52Min: 38 / Avg: 52.66 / Max: 56Min: 39 / Avg: 49.89 / Max: 52

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 41 / Avg: 52.35 / Max: 55Min: 41 / Avg: 46.95 / Max: 50Min: 30 / Avg: 49.93 / Max: 56Min: 38 / Avg: 46.79 / Max: 49

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OffAVX-512 On5001000150020002500SE +/- 54.32, N = 15SE +/- 31.97, N = 15SE +/- 6.64, N = 3SE +/- 10.80, N = 32341.141331.74896.53830.961. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2857.85 / Max: 3512Min: 800 / Avg: 2905.96 / Max: 3509Min: 800 / Avg: 2951.28 / Max: 3906Min: 800 / Avg: 2962.65 / Max: 3907
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 131.29 / Avg: 591.96 / Max: 755.76Min: 123.9 / Avg: 567.66 / Max: 734.19Min: 104.84 / Avg: 561.81 / Max: 756.79Min: 206.56 / Avg: 535.79 / Max: 754.55
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.3CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 35 / Avg: 52.63 / Max: 57Min: 35 / Avg: 52.1 / Max: 59Min: 38 / Avg: 50.66 / Max: 54Min: 36 / Avg: 47.82 / Max: 52

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On2004006008001000SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 2.03, N = 3SE +/- 1.20, N = 31035889893749
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2870.25 / Max: 3511Min: 800 / Avg: 2906.5 / Max: 3502Min: 800 / Avg: 2954.22 / Max: 3907Min: 800 / Avg: 2996.59 / Max: 3908
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 124.77 / Avg: 593.3 / Max: 756.49Min: 143.22 / Avg: 588.6 / Max: 751.82Min: 144.81 / Avg: 586.48 / Max: 752.83Min: 206.7 / Avg: 571.85 / Max: 720.32
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 39 / Avg: 52.09 / Max: 59Min: 39 / Avg: 51.01 / Max: 59Min: 37 / Avg: 49.82 / Max: 57Min: 35 / Avg: 48.28 / Max: 54

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On30060090012001500SE +/- 1.67, N = 3SE +/- 0.00, N = 3SE +/- 6.17, N = 3SE +/- 0.88, N = 3122610621055886
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2894.68 / Max: 3510Min: 800 / Avg: 2934.05 / Max: 3501Min: 800 / Avg: 2999.39 / Max: 3906Min: 800 / Avg: 3008.77 / Max: 3904
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 139.08 / Avg: 591.27 / Max: 757.85Min: 143.11 / Avg: 590.62 / Max: 754.02Min: 206.82 / Avg: 583.69 / Max: 755.21Min: 206.89 / Avg: 569.32 / Max: 725.89
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 39 / Avg: 52.36 / Max: 59Min: 39 / Avg: 51.38 / Max: 59Min: 37 / Avg: 49.96 / Max: 57Min: 36 / Avg: 48.71 / Max: 54

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On4K8K12K16K20KSE +/- 24.36, N = 3SE +/- 14.66, N = 3SE +/- 152.25, N = 5SE +/- 96.72, N = 316486140541425712125
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2759.25 / Max: 3516Min: 800 / Avg: 2899.72 / Max: 3511Min: 800 / Avg: 2854.58 / Max: 3904Min: 800 / Avg: 2984.18 / Max: 3906
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 141.11 / Avg: 624.47 / Max: 765.04Min: 143.91 / Avg: 587.53 / Max: 760.59Min: 206.89 / Avg: 620.27 / Max: 751.57Min: 207.14 / Avg: 582.01 / Max: 756.24
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 39 / Avg: 54.76 / Max: 60Min: 41 / Avg: 52.42 / Max: 59Min: 36 / Avg: 51.11 / Max: 56Min: 37 / Avg: 49.91 / Max: 56

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On8K16K24K32K40KSE +/- 150.37, N = 3SE +/- 114.21, N = 3SE +/- 274.25, N = 3SE +/- 74.75, N = 338309330263360323825
Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2818.6 / Max: 3903Min: 800 / Avg: 3089.22 / Max: 3904Min: 800 / Avg: 2898.85 / Max: 3501Min: 800 / Avg: 2936.5 / Max: 3509
Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 148.13 / Avg: 611.69 / Max: 755.87Min: 206.91 / Avg: 527.9 / Max: 734.93Min: 147.32 / Avg: 554.56 / Max: 759.36Min: 142.52 / Avg: 540.07 / Max: 762.44
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 40 / Avg: 54.1 / Max: 60Min: 40 / Avg: 49.28 / Max: 57Min: 38 / Avg: 48.12 / Max: 55Min: 37 / Avg: 46.03 / Max: 53

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On4K8K12K16K20KSE +/- 18.90, N = 3SE +/- 52.30, N = 3SE +/- 155.10, N = 7SE +/- 108.89, N = 1519604167961715114345
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2839.81 / Max: 3512Min: 800 / Avg: 2890.48 / Max: 3509Min: 800 / Avg: 2852.57 / Max: 3908Min: 800 / Avg: 2959.45 / Max: 3908
Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 146.85 / Avg: 620.07 / Max: 762.64Min: 124.93 / Avg: 583.37 / Max: 757.25Min: 146.6 / Avg: 598.52 / Max: 758.88Min: 137.59 / Avg: 587.3 / Max: 760.63
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 40 / Avg: 55.23 / Max: 60Min: 39 / Avg: 52.4 / Max: 59Min: 37 / Avg: 50.57 / Max: 57Min: 36 / Avg: 48.42 / Max: 55

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On10K20K30K40K50KSE +/- 123.86, N = 3SE +/- 213.70, N = 3SE +/- 82.99, N = 3SE +/- 167.00, N = 344460384833878732723
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2910.39 / Max: 3509Min: 800 / Avg: 2969.61 / Max: 3515Min: 800 / Avg: 2986.32 / Max: 3905Min: 800 / Avg: 3036.33 / Max: 3904
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 144.19 / Avg: 568.1 / Max: 759.38Min: 130.86 / Avg: 555.85 / Max: 759.56Min: 200.01 / Avg: 543.95 / Max: 744.29Min: 207.24 / Avg: 524.7 / Max: 756.03
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1122334455Min: 41 / Avg: 49.81 / Max: 57Min: 39 / Avg: 49.75 / Max: 57Min: 37 / Avg: 48.42 / Max: 55Min: 37 / Avg: 46.82 / Max: 53

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On60120180240300SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3263226225189
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2860.68 / Max: 3508Min: 800 / Avg: 2895.53 / Max: 3513Min: 800 / Avg: 2911.78 / Max: 3908Min: 800 / Avg: 2951.28 / Max: 3909
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 141.14 / Avg: 609.71 / Max: 751.36Min: 136.35 / Avg: 609.29 / Max: 755.63Min: 207.24 / Avg: 601.24 / Max: 748.86Min: 207.17 / Avg: 588.7 / Max: 754.39
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 40 / Avg: 53.82 / Max: 60Min: 38 / Avg: 52.16 / Max: 59Min: 36 / Avg: 50.91 / Max: 57Min: 36 / Avg: 49.85 / Max: 56

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On70140210280350SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 2.41, N = 15SE +/- 0.00, N = 3309268279223
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2867.16 / Max: 3507Min: 800 / Avg: 2879.74 / Max: 3503Min: 500 / Avg: 2883.43 / Max: 3904Min: 800 / Avg: 2918.01 / Max: 3904
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 139.84 / Avg: 612.34 / Max: 754.59Min: 144.32 / Avg: 611.95 / Max: 753.73Min: 207.07 / Avg: 607.95 / Max: 755.36Min: 148.8 / Avg: 569.63 / Max: 723.58
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 54.4 / Max: 60Min: 39 / Avg: 52.07 / Max: 59Min: 37 / Avg: 51.34 / Max: 57Min: 37 / Avg: 50.46 / Max: 56

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On9001800270036004500SE +/- 5.17, N = 3SE +/- 1.86, N = 3SE +/- 23.43, N = 3SE +/- 7.00, N = 34166354535853017
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2852.98 / Max: 3501Min: 800 / Avg: 2884.44 / Max: 3508Min: 800 / Avg: 2892.35 / Max: 3905Min: 800 / Avg: 2958.37 / Max: 3904
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 144.54 / Avg: 607.87 / Max: 759.8Min: 144.87 / Avg: 607.3 / Max: 759.23Min: 207.21 / Avg: 604.78 / Max: 754.51Min: 206.92 / Avg: 595.58 / Max: 740.41
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 54.26 / Max: 60Min: 38 / Avg: 52.7 / Max: 59Min: 38 / Avg: 51.02 / Max: 57Min: 37 / Avg: 50 / Max: 56

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 8.69, N = 3SE +/- 17.64, N = 3SE +/- 60.01, N = 3SE +/- 27.24, N = 38326708972186053
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2805.89 / Max: 3503Min: 800 / Avg: 2861.55 / Max: 3512Min: 800 / Avg: 2863.16 / Max: 3903Min: 800 / Avg: 2907.46 / Max: 3904
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 139.81 / Avg: 620.45 / Max: 760.44Min: 139.96 / Avg: 617.36 / Max: 759.01Min: 206.52 / Avg: 611.84 / Max: 754.94Min: 207.16 / Avg: 607.3 / Max: 756.05
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 40 / Avg: 54.65 / Max: 60Min: 39 / Avg: 53.47 / Max: 59Min: 38 / Avg: 51.41 / Max: 57Min: 37 / Avg: 50.95 / Max: 57

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On11002200330044005500SE +/- 8.21, N = 3SE +/- 2.40, N = 3SE +/- 19.40, N = 3SE +/- 10.48, N = 34917423142423574
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2842.13 / Max: 3513Min: 800 / Avg: 2863.77 / Max: 3508Min: 800 / Avg: 2897.48 / Max: 3904Min: 800 / Avg: 2897.66 / Max: 3904
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 142 / Avg: 611.56 / Max: 759.31Min: 147.42 / Avg: 608 / Max: 759.43Min: 207.14 / Avg: 607.98 / Max: 755.1Min: 206.67 / Avg: 597.45 / Max: 757.34
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 54.44 / Max: 60Min: 39 / Avg: 52.8 / Max: 59Min: 37 / Avg: 50.95 / Max: 57Min: 37 / Avg: 50.46 / Max: 56

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 37.24, N = 3SE +/- 11.85, N = 3SE +/- 101.69, N = 3SE +/- 43.03, N = 39934845785967146
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2806.99 / Max: 3507Min: 800 / Avg: 2893.76 / Max: 3515Min: 800 / Avg: 2900.24 / Max: 3908Min: 800 / Avg: 2909.62 / Max: 3904
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 133.08 / Avg: 619.07 / Max: 759.61Min: 142.4 / Avg: 606.92 / Max: 759.82Min: 206.71 / Avg: 617.43 / Max: 757Min: 206.63 / Avg: 608.46 / Max: 765.39
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 54.83 / Max: 60Min: 39 / Avg: 53.61 / Max: 60Min: 37 / Avg: 50.92 / Max: 57Min: 37 / Avg: 50.81 / Max: 56

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OffAVX-512 On30060090012001500SE +/- 4.01, N = 3SE +/- 0.07, N = 3SE +/- 2.43, N = 3SE +/- 0.03, N = 31355.33137.091287.11135.371. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2489.2 / Max: 3512Min: 800 / Avg: 2872.4 / Max: 3515Min: 800 / Avg: 2665.33 / Max: 3908Min: 800 / Avg: 3007.46 / Max: 3907
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 144.55 / Avg: 649.2 / Max: 755.85Min: 143.98 / Avg: 644.15 / Max: 745.46Min: 103.58 / Avg: 645.19 / Max: 824.86Min: 206.75 / Avg: 643.09 / Max: 735.29
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 55.73 / Max: 60Min: 37 / Avg: 54.55 / Max: 60Min: 36 / Avg: 51.42 / Max: 56Min: 35 / Avg: 51.37 / Max: 57

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OffAVX-512 On306090120150SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.04, N = 3139.4447.01134.1842.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2567.68 / Max: 3908Min: 800 / Avg: 2892 / Max: 3908Min: 800 / Avg: 2822.65 / Max: 3514Min: 800 / Avg: 2904.53 / Max: 3509
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off150300450600750Min: 144.78 / Avg: 657.22 / Max: 758.3Min: 141.92 / Avg: 655.28 / Max: 742.22Min: 206.85 / Avg: 654.25 / Max: 835.93Min: 206.66 / Avg: 653.75 / Max: 749.75
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 56.47 / Max: 60Min: 40 / Avg: 55.35 / Max: 60Min: 37 / Avg: 51.8 / Max: 55Min: 38 / Avg: 51.7 / Max: 55

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OffAVX-512 On306090120150SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3140.6447.00134.4442.741. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2545.34 / Max: 3903Min: 800 / Avg: 2830.49 / Max: 3910Min: 800 / Avg: 2785.33 / Max: 3510Min: 800 / Avg: 2808.74 / Max: 3515
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off160320480640800Min: 141.18 / Avg: 652.91 / Max: 759.25Min: 139.22 / Avg: 651.89 / Max: 746.8Min: 206.53 / Avg: 652.32 / Max: 894.8Min: 206.81 / Avg: 652 / Max: 753.73
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 42 / Avg: 56.49 / Max: 60Min: 40 / Avg: 55.88 / Max: 59Min: 37 / Avg: 52.1 / Max: 56Min: 38 / Avg: 51.96 / Max: 55

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On48121620SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 317.127.7015.106.691. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2440.06 / Max: 3509Min: 800 / Avg: 2499.4 / Max: 3510Min: 800 / Avg: 2496.49 / Max: 3905Min: 800 / Avg: 2534.47 / Max: 3911
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 134.39 / Avg: 662.15 / Max: 766.17Min: 134.79 / Avg: 660.58 / Max: 760.14Min: 205.98 / Avg: 660.76 / Max: 798.87Min: 206.55 / Avg: 660.54 / Max: 758.96
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 42 / Avg: 56.43 / Max: 60Min: 40 / Avg: 56.14 / Max: 60Min: 38 / Avg: 52.28 / Max: 55Min: 37 / Avg: 51.81 / Max: 55

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On80160240320400SE +/- 0.22, N = 3SE +/- 1.52, N = 3SE +/- 0.38, N = 3SE +/- 0.24, N = 3352.08290.15337.69237.361. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2524.72 / Max: 3512Min: 800 / Avg: 2900.67 / Max: 3511Min: 800 / Avg: 2675.48 / Max: 3909Min: 800 / Avg: 2956.05 / Max: 3907
Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.98 / Avg: 649.9 / Max: 748.52Min: 206.57 / Avg: 636.48 / Max: 766.86Min: 141.8 / Avg: 646.72 / Max: 748.88Min: 134.08 / Avg: 637.97 / Max: 751.47
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41 / Avg: 56.46 / Max: 61Min: 42 / Avg: 55.99 / Max: 61Min: 38 / Avg: 52.8 / Max: 57Min: 38 / Avg: 51.9 / Max: 56

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUAVX-512 OffAVX-512 On48121620SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 317.468.0215.586.951. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2364.74 / Max: 3512Min: 800 / Avg: 2409.05 / Max: 3512Min: 800 / Avg: 2432.9 / Max: 3905Min: 800 / Avg: 2474.34 / Max: 3904
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 140.27 / Avg: 658.37 / Max: 759.99Min: 140.31 / Avg: 657.79 / Max: 763.65Min: 206.57 / Avg: 657.51 / Max: 759.7Min: 206.34 / Avg: 657.43 / Max: 769.68
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 56.27 / Max: 59Min: 41 / Avg: 56 / Max: 59Min: 37 / Avg: 52.35 / Max: 56Min: 36 / Avg: 51.8 / Max: 55

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUAVX-512 OffAVX-512 On816243240SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 332.4519.6027.5616.951. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2429.46 / Max: 3910Min: 800 / Avg: 2692.65 / Max: 3912Min: 800 / Avg: 2446.61 / Max: 3509Min: 800 / Avg: 2705.88 / Max: 3511
Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 106.14 / Avg: 660.56 / Max: 759.78Min: 207.03 / Avg: 658.56 / Max: 763.43Min: 137.8 / Avg: 658.35 / Max: 760.45Min: 142.57 / Avg: 656.98 / Max: 759.7
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 56.66 / Max: 60Min: 41 / Avg: 56.23 / Max: 60Min: 38 / Avg: 52.34 / Max: 55Min: 37 / Avg: 52.15 / Max: 56

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On816243240SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 332.5120.7329.9114.331. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2369.5 / Max: 3907Min: 800 / Avg: 2584.05 / Max: 3907Min: 800 / Avg: 2466.01 / Max: 3511Min: 800 / Avg: 2588.47 / Max: 3509
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 135.14 / Avg: 659.58 / Max: 759.65Min: 138.9 / Avg: 656.7 / Max: 754.94Min: 205.91 / Avg: 656.76 / Max: 757.26Min: 206.26 / Avg: 655.74 / Max: 760.38
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 42 / Avg: 56.5 / Max: 60Min: 41 / Avg: 56.01 / Max: 59Min: 37 / Avg: 52.7 / Max: 56Min: 38 / Avg: 52.42 / Max: 56

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OffAVX-512 On1122334455SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 348.484.3845.323.931. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2246.35 / Max: 3510Min: 800 / Avg: 2823.12 / Max: 3513Min: 800 / Avg: 2334.49 / Max: 3904Min: 800 / Avg: 2912.9 / Max: 3907
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 141.93 / Avg: 659.08 / Max: 758.69Min: 140.04 / Avg: 656.62 / Max: 757.38Min: 206.6 / Avg: 658.75 / Max: 757.12Min: 206.16 / Avg: 658.43 / Max: 764.17
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 57.39 / Max: 61Min: 41 / Avg: 56.79 / Max: 60Min: 38 / Avg: 53.49 / Max: 57Min: 39 / Avg: 53.16 / Max: 57

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 38.655.718.465.151. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2335.95 / Max: 3514Min: 800 / Avg: 2890.23 / Max: 3515Min: 800 / Avg: 2523.87 / Max: 3907Min: 800 / Avg: 2937.64 / Max: 3910
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 141.2 / Avg: 657.6 / Max: 757.38Min: 138.22 / Avg: 655.8 / Max: 757.3Min: 206.93 / Avg: 656.65 / Max: 755.73Min: 206.88 / Avg: 654.08 / Max: 774.62
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 41 / Avg: 56.75 / Max: 60Min: 40 / Avg: 56.4 / Max: 60Min: 38 / Avg: 53.64 / Max: 57Min: 38 / Avg: 52.94 / Max: 56

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On1632486480SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 372.8963.2767.9353.511. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2452.95 / Max: 3510Min: 800 / Avg: 2542 / Max: 3511Min: 800 / Avg: 2552.5 / Max: 3909Min: 800 / Avg: 2654.51 / Max: 3908
Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 206.86 / Avg: 651.28 / Max: 757.99Min: 206.89 / Avg: 649.79 / Max: 759.52Min: 138.92 / Avg: 650.5 / Max: 760.41Min: 143.33 / Avg: 649.87 / Max: 762.66
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 42 / Avg: 56.42 / Max: 60Min: 40 / Avg: 55.71 / Max: 59Min: 38 / Avg: 52.67 / Max: 57Min: 37 / Avg: 52.28 / Max: 56

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OffAVX-512 On306090120150SE +/- 1.21, N = 3SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.04, N = 3140.6840.19115.3529.071. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2690.93 / Max: 3512Min: 800 / Avg: 2778.23 / Max: 3515Min: 800 / Avg: 2755.35 / Max: 3904Min: 800 / Avg: 2833.67 / Max: 3907
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 139.19 / Avg: 654.14 / Max: 728.45Min: 139.64 / Avg: 650.58 / Max: 751.9Min: 206.4 / Avg: 652.53 / Max: 745.49Min: 206.71 / Avg: 648.21 / Max: 747.87
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 42 / Avg: 56.51 / Max: 60Min: 41 / Avg: 55.93 / Max: 60Min: 38 / Avg: 52.23 / Max: 55Min: 38 / Avg: 51.99 / Max: 56

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On48121620SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 313.662.5313.552.441. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2252.6 / Max: 3510Min: 800 / Avg: 2808.93 / Max: 3508Min: 800 / Avg: 2316.34 / Max: 3904Min: 800 / Avg: 2931.15 / Max: 3905
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 142.53 / Avg: 658.62 / Max: 757.75Min: 143.5 / Avg: 657.41 / Max: 756.56Min: 206.69 / Avg: 658.1 / Max: 752.9Min: 206.84 / Avg: 657.97 / Max: 768.07
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 43 / Avg: 57.32 / Max: 60Min: 41 / Avg: 57.06 / Max: 60Min: 38 / Avg: 53.43 / Max: 57Min: 38 / Avg: 53.03 / Max: 56

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off48121620SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 315.7611.6912.5510.691. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2456.27 / Max: 3513Min: 800 / Avg: 2849.9 / Max: 3513Min: 800 / Avg: 2526.74 / Max: 3905Min: 800 / Avg: 2825.64 / Max: 3908
Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.9 / Avg: 657.33 / Max: 762.02Min: 206.59 / Avg: 645.49 / Max: 767.1Min: 146.73 / Avg: 654.43 / Max: 756.6Min: 143.35 / Avg: 648.95 / Max: 765.36
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 42 / Avg: 56.39 / Max: 61Min: 41 / Avg: 56.04 / Max: 60Min: 38 / Avg: 52.29 / Max: 56Min: 38 / Avg: 51.96 / Max: 56

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUAVX-512 OffAVX-512 On20406080100SE +/- 1.05, N = 15SE +/- 0.15, N = 3SE +/- 1.00, N = 7SE +/- 0.01, N = 3111.6327.33109.7524.871. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2457.57 / Max: 3510Min: 800 / Avg: 2813.17 / Max: 3514Min: 800 / Avg: 2629.98 / Max: 3905Min: 800 / Avg: 2890.31 / Max: 3904
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 134.97 / Avg: 663.13 / Max: 754.59Min: 142.04 / Avg: 656.81 / Max: 744.88Min: 171.5 / Avg: 663.12 / Max: 746.34Min: 206.5 / Avg: 658.68 / Max: 774.35
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 42 / Avg: 57.82 / Max: 61Min: 41 / Avg: 56.83 / Max: 60Min: 38 / Avg: 53.14 / Max: 56Min: 38 / Avg: 52.54 / Max: 56

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OffAVX-512 On0.39380.78761.18141.57521.969SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 31.750.371.700.461. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2573.11 / Max: 3516Min: 800 / Avg: 2659.67 / Max: 3511Min: 800 / Avg: 2666.29 / Max: 3914Min: 800 / Avg: 3132.4 / Max: 3904
Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 206.74 / Avg: 658.37 / Max: 772.16Min: 105.27 / Avg: 509.17 / Max: 614.46Min: 138.57 / Avg: 658.34 / Max: 759.74Min: 140.85 / Avg: 607.89 / Max: 662.55
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41 / Avg: 55.93 / Max: 59Min: 42 / Avg: 49.55 / Max: 52Min: 38 / Avg: 52.66 / Max: 56Min: 39 / Avg: 49.89 / Max: 52

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On0.14180.28360.42540.56720.709SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.630.400.570.291. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2693.5 / Max: 3506Min: 800 / Avg: 2829.36 / Max: 3513Min: 800 / Avg: 3150.41 / Max: 3904Min: 800 / Avg: 3332.23 / Max: 3906
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 145.72 / Avg: 655.91 / Max: 741.97Min: 137.76 / Avg: 545.79 / Max: 590.3Min: 207 / Avg: 514.86 / Max: 663.92Min: 206.49 / Avg: 469.31 / Max: 558.98
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 41 / Avg: 52.35 / Max: 55Min: 41 / Avg: 46.95 / Max: 50Min: 30 / Avg: 49.93 / Max: 56Min: 38 / Avg: 46.79 / Max: 49

Y-Cruncher

Emerald RapidsSapphire RapidsOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.2Pi Digits To Calculate: 1BAVX-512 OffAVX-512 On246810SE +/- 0.026, N = 5SE +/- 0.021, N = 5SE +/- 0.007, N = 5SE +/- 0.003, N = 56.5405.2336.3384.914
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2798.17 / Max: 3511Min: 800 / Avg: 2846.32 / Max: 3512Min: 800 / Avg: 3155.23 / Max: 3908Min: 800 / Avg: 3268.42 / Max: 3908
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.2CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 134.09 / Avg: 451.69 / Max: 736.59Min: 139.77 / Avg: 425.32 / Max: 750.74Min: 103.71 / Avg: 430.76 / Max: 715.25Min: 204.3 / Avg: 399.57 / Max: 725.27
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.2CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 40 / Avg: 44.62 / Max: 49Min: 41 / Avg: 44.12 / Max: 50Min: 37 / Avg: 42.99 / Max: 49Min: 36 / Avg: 40.69 / Max: 47

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.2Pi Digits To Calculate: 5BAVX-512 OffAVX-512 On816243240SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 336.6428.6033.6827.06
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2736.78 / Max: 3509Min: 800 / Avg: 2783.21 / Max: 3509Min: 800 / Avg: 2830.68 / Max: 3904Min: 800 / Avg: 2895.61 / Max: 3907
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.2CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 139.38 / Avg: 575.38 / Max: 737.4Min: 137.75 / Avg: 556.06 / Max: 742.94Min: 206.72 / Avg: 566.95 / Max: 745.43Min: 144.38 / Avg: 545.54 / Max: 739.45
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.2CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 37 / Avg: 49.71 / Max: 57Min: 37 / Avg: 48.55 / Max: 55Min: 34 / Avg: 47.63 / Max: 55Min: 32 / Avg: 44.12 / Max: 51

Emerald RapidsSapphire RapidsOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.2Pi Digits To Calculate: 500MAVX-512 OffAVX-512 On0.69951.3992.09852.7983.4975SE +/- 0.017, N = 7SE +/- 0.022, N = 7SE +/- 0.005, N = 7SE +/- 0.003, N = 73.1092.7542.9072.293
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2850.7 / Max: 3510Min: 800 / Avg: 2852.57 / Max: 3515Min: 800 / Avg: 3313.53 / Max: 3907Min: 800 / Avg: 3445.48 / Max: 3908
Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.2CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 137.49 / Avg: 371.75 / Max: 732.24Min: 133.05 / Avg: 353.03 / Max: 753.25Min: 206.39 / Avg: 359.32 / Max: 686.83Min: 206.15 / Avg: 336.26 / Max: 671.34
Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.2CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 38 / Avg: 41.46 / Max: 47Min: 37 / Avg: 40.47 / Max: 46Min: 36 / Avg: 40.27 / Max: 47Min: 34 / Avg: 37.36 / Max: 43

140 Results Shown

CPU Temperature Monitor:
  Phoronix Test Suite System Monitoring:
    Celsius
    Megahertz
    Watts
  OpenMP - BM2:
    Billion Interactions/s Per Watt
miniBUDE:
  OpenMP - BM1
  OpenMP - BM2
OpenVINO:
  Face Detection FP16 - CPU
  Person Detection FP16 - CPU
  Person Detection FP32 - CPU
  Vehicle Detection FP16 - CPU
  Face Detection FP16-INT8 - CPU
  Face Detection Retail FP16 - CPU
  Road Segmentation ADAS FP16 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Weld Porosity Detection FP16 - CPU
  Face Detection Retail FP16-INT8 - CPU
  Road Segmentation ADAS FP16-INT8 - CPU
  Machine Translation EN To DE FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Handwritten English Recognition FP16 - CPU
  Age Gender Recognition Retail 0013 FP16 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
Embree:
  Pathtracer ISPC - Crown
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Asian Dragon Obj
miniBUDE:
  OpenMP - BM1
  OpenMP - BM2
TensorFlow:
  CPU - 16 - ResNet-50
  CPU - 32 - ResNet-50
TensorFlow
TensorFlow
TensorFlow:
  CPU - 16 - ResNet-50
  CPU - 64 - ResNet-50
OpenVKL
OpenVKL
OSPRay
OSPRay:
  gravity_spheres_volume/dim_512/ao/real_time
  gravity_spheres_volume/dim_512/scivis/real_time
OSPRay
OSPRay
Y-Cruncher:
  CPU Peak Freq (Highest CPU Core Frequency) Monitor:
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
  CPU Temp Monitor:
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
oneDNN
OSPRay Studio:
  1 - 4K - 1 - Path Tracer - CPU
  3 - 4K - 1 - Path Tracer - CPU
  1 - 4K - 16 - Path Tracer - CPU
  1 - 4K - 32 - Path Tracer - CPU
  3 - 4K - 16 - Path Tracer - CPU
  3 - 4K - 32 - Path Tracer - CPU
  1 - 1080p - 1 - Path Tracer - CPU
  3 - 1080p - 1 - Path Tracer - CPU
  1 - 1080p - 16 - Path Tracer - CPU
  1 - 1080p - 32 - Path Tracer - CPU
  3 - 1080p - 16 - Path Tracer - CPU
  3 - 1080p - 32 - Path Tracer - CPU
OpenVINO:
  Face Detection FP16 - CPU
  Person Detection FP16 - CPU
  Person Detection FP32 - CPU
  Vehicle Detection FP16 - CPU
  Face Detection FP16-INT8 - CPU
  Face Detection Retail FP16 - CPU
  Road Segmentation ADAS FP16 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Weld Porosity Detection FP16 - CPU
  Face Detection Retail FP16-INT8 - CPU
  Road Segmentation ADAS FP16-INT8 - CPU
  Machine Translation EN To DE FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Handwritten English Recognition FP16 - CPU
  Age Gender Recognition Retail 0013 FP16 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
Y-Cruncher:
  1B
  5B
  500M

Sapphire Rapids: AVX-512 On

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0004d0
Python Notes: Python 3.11.6
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 2 December 2023 21:41 by user phoronix.

Sapphire Rapids: AVX-512 Off

Processor: 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads), Motherboard: Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T

OS: Ubuntu 23.10, Kernel: 6.5.0-13-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0004d0
Python Notes: Python 3.11.6
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 3 December 2023 15:29 by user phoronix.

Emerald Rapids: AVX-512 On

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000161
Python Notes: Python 3.11.6
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 11 December 2023 12:29 by user phoronix.

Emerald Rapids: AVX-512 Off

Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T

OS: Ubuntu 23.10, Kernel: 6.5.0-13-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000161
Python Notes: Python 3.11.6
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 11 December 2023 17:39 by user phoronix.