Intel 5th Gen Xeon AVX-512 Comparison

2 x INTEL XEON PLATINUM 8592 AVX-512 Emerald Rapids vs. Sapphire Rapids by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2312146-NE-INTELAVX523&sor&grw.

ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSapphire RapidsEmerald Rapids AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)Intel Device 1bce1008GB3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Intel X710 for 10GBASE-TUbuntu 23.106.5.0-13-generic (x86_64)GCC 13.2.0ext41920x10802 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads)Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Sapphire Rapids: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0004d0- Sapphire Rapids: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0004d0- Emerald Rapids: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000161- Emerald Rapids: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000161Python Details- Python 3.11.6Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

y-cruncher: 5By-cruncher: 500My-cruncher: 1Bminibude: OpenMP - BM1minibude: OpenMP - BM1minibude: OpenMP - BM2minibude: OpenMP - BM2tensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 64 - ResNet-50onednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUembree: Pathtracer ISPC - Crownembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objopenvkl: vklBenchmarkCPU ISPCospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray-studio: 1 - 4K - 1 - Path Tracer - CPUospray-studio: 3 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 16 - Path Tracer - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUospray-studio: 1 - 1080p - 1 - Path Tracer - CPUospray-studio: 3 - 1080p - 1 - Path Tracer - CPUospray-studio: 1 - 1080p - 16 - Path Tracer - CPUospray-studio: 1 - 1080p - 32 - Path Tracer - CPUospray-studio: 3 - 1080p - 16 - Path Tracer - CPUospray-studio: 3 - 1080p - 32 - Path Tracer - CPUSapphire RapidsEmerald Rapids AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off28.6042.2934.9143418.575136.7433466.394138.65666.1885.64103.28830.959218.62137.09637.7347.01637.7847.003887.307.70412.86290.1514944.268.021528.7319.605759.7120.7326917.014.3820980.695.711894.4963.27742.5140.1947113.292.537556.5215.764381.7527.33144820.350.37151891.460.29124.0863152.5351131.8466270535.888235.243215.0832889106214054330261679638483226268354570894231845736.6372.9076.3382090.44583.6182214.18288.56747.2257.8468.42896.52921.891355.33214.94139.44213.06140.641749.9817.1285.02352.086859.8617.46923.4732.453688.3232.512463.9848.4813852.888.651645.0372.89212.63140.688773.9813.662564.0911.691075.65111.6365805.381.75129576.780.57113.1300141.1111122.3348215523.658522.52119.225211035122616486383091960444460263309416683264917993427.0582.7545.2335313.366212.5354975.695199.02849.2672.0697.851331.74236.14135.37747.4942.76747.7742.744765.956.69538.27237.3618384.836.951884.9916.958921.9714.3332234.043.9324769.105.152389.5553.511097.8229.0749132.992.4410161.3112.555105.9524.87114369.660.46123447.740.4151.4667200.9029174.3843324542.654541.610917.040974988612125238251434532723189223301760533574714633.6803.1096.5403392.568135.7033112.005124.48039.0653.6066.082341.1424.671287.11238.22134.18237.77134.442116.6415.1094.57337.698208.8815.581159.9327.564277.3129.912822.7145.3215101.298.461882.9767.93276.63115.359439.9213.552988.9110.691166.18109.7563672.971.7101244.000.63137.6227181.8347159.4832236523.410020.937410.566748931055142573360317151387872252793585721842428596OpenBenchmarking.org

Y-Cruncher

Pi Digits To Calculate: 5B

Emerald RapidsSapphire RapidsOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.2Pi Digits To Calculate: 5BAVX-512 OnAVX-512 Off816243240SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 327.0633.6828.6036.64

Y-Cruncher

Pi Digits To Calculate: 500M

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.2Pi Digits To Calculate: 500MAVX-512 OnAVX-512 Off0.69951.3992.09852.7983.4975SE +/- 0.003, N = 7SE +/- 0.005, N = 7SE +/- 0.022, N = 7SE +/- 0.017, N = 72.2932.9072.7543.109

Y-Cruncher

Pi Digits To Calculate: 1B

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.2Pi Digits To Calculate: 1BAVX-512 OnAVX-512 Off246810SE +/- 0.003, N = 5SE +/- 0.007, N = 5SE +/- 0.021, N = 5SE +/- 0.026, N = 54.9146.3385.2336.540

miniBUDE

Implementation: OpenMP - Input Deck: BM1

Emerald RapidsSapphire RapidsOpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OnAVX-512 Off11002200330044005500SE +/- 3.87, N = 8SE +/- 0.74, N = 7SE +/- 12.90, N = 7SE +/- 17.21, N = 55313.373392.573418.582090.451. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

Emerald RapidsSapphire RapidsOpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OnAVX-512 Off50100150200250SE +/- 0.15, N = 8SE +/- 0.03, N = 7SE +/- 0.52, N = 7SE +/- 0.69, N = 5212.54135.70136.7483.621. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

Emerald RapidsSapphire RapidsOpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OnAVX-512 Off11002200330044005500SE +/- 49.58, N = 15SE +/- 24.22, N = 15SE +/- 17.85, N = 3SE +/- 5.42, N = 34975.703112.013466.392214.181. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

Emerald RapidsSapphire RapidsOpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OnAVX-512 Off4080120160200SE +/- 1.98, N = 15SE +/- 0.97, N = 15SE +/- 0.71, N = 3SE +/- 0.22, N = 3199.03124.48138.6688.571. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OnAVX-512 Off1530456075SE +/- 0.31, N = 3SE +/- 0.28, N = 3SE +/- 0.41, N = 3SE +/- 0.20, N = 366.1847.2249.2639.06

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 32 - Model: ResNet-50AVX-512 OnAVX-512 Off20406080100SE +/- 0.22, N = 3SE +/- 0.36, N = 3SE +/- 0.13, N = 3SE +/- 0.14, N = 385.6457.8472.0653.60

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OnAVX-512 Off20406080100SE +/- 0.75, N = 3SE +/- 0.39, N = 3SE +/- 0.16, N = 3SE +/- 0.58, N = 3103.2868.4297.8566.08

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OnAVX-512 Off5001000150020002500SE +/- 10.80, N = 3SE +/- 6.64, N = 3SE +/- 31.97, N = 15SE +/- 54.32, N = 15830.96896.531331.742341.141. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenVINO

Model: Face Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off50100150200250SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3236.1424.67218.6221.891. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off30060090012001500SE +/- 0.03, N = 3SE +/- 2.43, N = 3SE +/- 0.07, N = 3SE +/- 4.01, N = 3135.371287.11137.091355.331. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off160320480640800SE +/- 0.82, N = 3SE +/- 0.31, N = 3SE +/- 0.66, N = 3SE +/- 0.08, N = 3747.49238.22637.73214.941. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off306090120150SE +/- 0.04, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 342.76134.1847.01139.441. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP32 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OnAVX-512 Off160320480640800SE +/- 1.03, N = 3SE +/- 0.09, N = 3SE +/- 0.38, N = 3SE +/- 0.26, N = 3747.77237.77637.78213.061. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP32 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OnAVX-512 Off306090120150SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 342.74134.4447.00140.641. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off10002000300040005000SE +/- 1.59, N = 3SE +/- 1.56, N = 3SE +/- 1.67, N = 3SE +/- 0.53, N = 34765.952116.643887.301749.981. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off48121620SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 36.6915.107.7017.121. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off120240360480600SE +/- 0.53, N = 3SE +/- 0.10, N = 3SE +/- 2.15, N = 3SE +/- 0.06, N = 3538.2794.57412.8685.021. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off80160240320400SE +/- 0.24, N = 3SE +/- 0.38, N = 3SE +/- 1.52, N = 3SE +/- 0.22, N = 3237.36337.69290.15352.081. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUAVX-512 OnAVX-512 Off4K8K12K16K20KSE +/- 5.71, N = 3SE +/- 2.90, N = 3SE +/- 24.24, N = 3SE +/- 3.57, N = 318384.838208.8814944.266859.861. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUAVX-512 OnAVX-512 Off48121620SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.9515.588.0217.461. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUAVX-512 OnAVX-512 Off400800120016002000SE +/- 1.06, N = 3SE +/- 0.98, N = 3SE +/- 1.66, N = 3SE +/- 0.24, N = 31884.991159.931528.73923.471. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUAVX-512 OnAVX-512 Off816243240SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 316.9527.5619.6032.451. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off2K4K6K8K10KSE +/- 8.09, N = 3SE +/- 0.66, N = 3SE +/- 11.71, N = 3SE +/- 3.58, N = 38921.974277.315759.713688.321. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off816243240SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 314.3329.9120.7332.511. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off7K14K21K28K35KSE +/- 24.15, N = 3SE +/- 0.50, N = 3SE +/- 29.04, N = 3SE +/- 2.47, N = 332234.042822.7126917.012463.981. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off1122334455SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 33.9345.324.3848.481. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off5K10K15K20K25KSE +/- 20.85, N = 3SE +/- 8.51, N = 3SE +/- 25.65, N = 3SE +/- 9.76, N = 324769.1015101.2920980.6913852.881. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off246810SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 35.158.465.718.651. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off5001000150020002500SE +/- 2.91, N = 3SE +/- 0.40, N = 3SE +/- 1.25, N = 3SE +/- 0.20, N = 32389.551882.971894.491645.031. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off1632486480SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 353.5167.9363.2772.891. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OnAVX-512 Off2004006008001000SE +/- 1.48, N = 3SE +/- 0.41, N = 3SE +/- 1.33, N = 3SE +/- 1.82, N = 31097.82276.63742.51212.631. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OnAVX-512 Off306090120150SE +/- 0.04, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 1.21, N = 329.07115.3540.19140.681. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off11K22K33K44K55KSE +/- 80.54, N = 3SE +/- 3.35, N = 3SE +/- 54.78, N = 3SE +/- 3.89, N = 349132.999439.9247113.298773.981. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off48121620SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 32.4413.552.5313.661. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off2K4K6K8K10KSE +/- 3.93, N = 3SE +/- 0.72, N = 3SE +/- 6.80, N = 3SE +/- 1.81, N = 310161.312988.917556.522564.091. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OffAVX-512 On48121620SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 310.6912.5511.6915.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUAVX-512 OnAVX-512 Off11002200330044005500SE +/- 0.84, N = 3SE +/- 10.88, N = 7SE +/- 26.63, N = 3SE +/- 10.21, N = 155105.951166.184381.751075.651. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUAVX-512 OnAVX-512 Off20406080100SE +/- 0.01, N = 3SE +/- 1.00, N = 7SE +/- 0.15, N = 3SE +/- 1.05, N = 1524.87109.7527.33111.631. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OnAVX-512 Off30K60K90K120K150KSE +/- 735.86, N = 3SE +/- 51.71, N = 3SE +/- 898.88, N = 3SE +/- 52.05, N = 3144820.3565805.38114369.6663672.971. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OnAVX-512 Off0.39380.78761.18141.57521.969SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 30.371.750.461.701. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -std=c++11 -fPIC -fvisibility=hidden -mavx2 -mfma -MD -MT -MF

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off30K60K90K120K150KSE +/- 547.74, N = 3SE +/- 1069.55, N = 3SE +/- 940.07, N = 3SE +/- 496.38, N = 3151891.46129576.78123447.74101244.001. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off0.14180.28360.42540.56720.709SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.290.570.400.631. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Embree

Binary: Pathtracer ISPC - Model: Crown

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 OnAVX-512 Off306090120150SE +/- 0.55, N = 7SE +/- 0.23, N = 7SE +/- 0.36, N = 6SE +/- 0.27, N = 6151.47137.62124.09113.13

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OnAVX-512 Off4080120160200SE +/- 0.38, N = 8SE +/- 0.30, N = 7SE +/- 0.33, N = 7SE +/- 0.22, N = 7200.90181.83152.54141.11

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OnAVX-512 Off4080120160200SE +/- 0.52, N = 4SE +/- 0.19, N = 4SE +/- 0.26, N = 4SE +/- 0.21, N = 3174.38159.48131.85122.33

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 OnAVX-512 Off7001400210028003500SE +/- 30.78, N = 3SE +/- 6.36, N = 3SE +/- 3.84, N = 3SE +/- 4.04, N = 33245236527052155

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OnAVX-512 Off1020304050SE +/- 0.19, N = 3SE +/- 0.07, N = 3SE +/- 0.20, N = 3SE +/- 0.09, N = 342.6523.4135.8923.66

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OnAVX-512 Off918273645SE +/- 0.07, N = 3SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 341.6120.9435.2422.52

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OnAVX-512 Off48121620SE +/- 0.20744, N = 4SE +/- 0.07557, N = 15SE +/- 0.14483, N = 15SE +/- 0.13104, N = 1517.0409010.5667415.083209.22521

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off2004006008001000SE +/- 1.20, N = 3SE +/- 2.03, N = 3SE +/- 0.67, N = 3SE +/- 0.58, N = 37498938891035

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off30060090012001500SE +/- 0.88, N = 3SE +/- 6.17, N = 3SE +/- 0.00, N = 3SE +/- 1.67, N = 3886105510621226

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off4K8K12K16K20KSE +/- 96.72, N = 3SE +/- 152.25, N = 5SE +/- 14.66, N = 3SE +/- 24.36, N = 312125142571405416486

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off8K16K24K32K40KSE +/- 74.75, N = 3SE +/- 274.25, N = 3SE +/- 114.21, N = 3SE +/- 150.37, N = 323825336033302638309

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off4K8K12K16K20KSE +/- 108.89, N = 15SE +/- 155.10, N = 7SE +/- 52.30, N = 3SE +/- 18.90, N = 314345171511679619604

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off10K20K30K40K50KSE +/- 167.00, N = 3SE +/- 82.99, N = 3SE +/- 213.70, N = 3SE +/- 123.86, N = 332723387873848344460

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off60120180240300SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3189225226263

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off70140210280350SE +/- 0.00, N = 3SE +/- 2.41, N = 15SE +/- 0.00, N = 3SE +/- 0.33, N = 3223279268309

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off9001800270036004500SE +/- 7.00, N = 3SE +/- 23.43, N = 3SE +/- 1.86, N = 3SE +/- 5.17, N = 33017358535454166

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off2K4K6K8K10KSE +/- 27.24, N = 3SE +/- 60.01, N = 3SE +/- 17.64, N = 3SE +/- 8.69, N = 36053721870898326

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off11002200330044005500SE +/- 10.48, N = 3SE +/- 19.40, N = 3SE +/- 2.40, N = 3SE +/- 8.21, N = 33574424242314917

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off2K4K6K8K10KSE +/- 43.03, N = 3SE +/- 101.69, N = 3SE +/- 11.85, N = 3SE +/- 37.24, N = 37146859684579934

miniBUDE

Implementation: OpenMP - Input Deck: BM1

Emerald RapidsSapphire RapidsOpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OnAVX-512 Off0.1080.2160.3240.4320.540.4800.2770.3030.162

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3050.88 / Max: 3906Min: 800 / Avg: 2998.12 / Max: 3905Min: 800 / Avg: 2871.1 / Max: 3512Min: 800 / Avg: 2822.27 / Max: 3508

miniBUDE

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 196.51 / Avg: 442.58 / Max: 756.34Min: 195.99 / Avg: 489.71 / Max: 754.91Min: 125.76 / Avg: 450.59 / Max: 685.74Min: 67.03 / Avg: 516.75 / Max: 712.97

miniBUDE

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 22 / Avg: 34.39 / Max: 42Min: 25 / Avg: 39.7 / Max: 48Min: 30 / Avg: 40.48 / Max: 49Min: 29 / Avg: 42.38 / Max: 50

miniBUDE

Implementation: OpenMP - Input Deck: BM2

Emerald RapidsSapphire RapidsOpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OnAVX-512 Off0.0720.1440.2160.2880.360.3200.1960.2440.154

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 800 / Avg: 3062.99 / Max: 3509Min: 800 / Avg: 2971.88 / Max: 5743Min: 800 / Avg: 2958.53 / Max: 3904Min: 800 / Avg: 2947.32 / Max: 3907

miniBUDE

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 130.7 / Avg: 569.31 / Max: 758.19Min: 140.54 / Avg: 574.74 / Max: 757.06Min: 196.6 / Avg: 621.22 / Max: 756.81Min: 196.96 / Avg: 634.15 / Max: 758.15

miniBUDE

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 28 / Avg: 43.53 / Max: 50Min: 33 / Avg: 48.15 / Max: 54Min: 36 / Avg: 54.58 / Max: 63Min: 35 / Avg: 55.67 / Max: 63

Embree

Binary: Pathtracer ISPC - Model: Crown

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 OnAVX-512 Off0.07110.14220.21330.28440.35550.3160.2860.2600.232

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3111.22 / Max: 3908Min: 800 / Avg: 2827.67 / Max: 3901Min: 800 / Avg: 2856.35 / Max: 3512Min: 800 / Avg: 2838.46 / Max: 3512

Embree

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 123.86 / Avg: 478.02 / Max: 740.13Min: 125.62 / Avg: 487.84 / Max: 740.05Min: 195.35 / Avg: 478.68 / Max: 755.09Min: 199.01 / Avg: 478.95 / Max: 719.96

Embree

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OnAVX-512 Off1122334455Min: 35 / Avg: 42.8 / Max: 48Min: 38 / Avg: 46.37 / Max: 52Min: 40 / Avg: 47.23 / Max: 53Min: 41 / Avg: 47.38 / Max: 53

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OnAVX-512 Off0.10190.20380.30570.40760.50950.4530.4030.3320.301

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3148.94 / Max: 3908Min: 800 / Avg: 2950.63 / Max: 3901Min: 800 / Avg: 2815.76 / Max: 3509Min: 800 / Avg: 2689.74 / Max: 3510

Embree

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 99.6 / Avg: 443.11 / Max: 753.55Min: 198.42 / Avg: 451.72 / Max: 751.32Min: 124.87 / Avg: 459.53 / Max: 760.23Min: 121.15 / Avg: 469.47 / Max: 759.39

Embree

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 33 / Avg: 39.8 / Max: 45Min: 36 / Avg: 43.21 / Max: 49Min: 38 / Avg: 44.58 / Max: 51Min: 39 / Avg: 45.09 / Max: 50

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OnAVX-512 Off0.11880.23760.35640.47520.5940.5280.4560.3220.299

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 3461.42 / Max: 3907Min: 800 / Avg: 3421.05 / Max: 3905Min: 800 / Avg: 3185.08 / Max: 3509Min: 800 / Avg: 3012.02 / Max: 3509

Embree

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 183.04 / Avg: 330.48 / Max: 754.13Min: 183.81 / Avg: 349.88 / Max: 758.31Min: 75.9 / Avg: 408.93 / Max: 760.89Min: 131.13 / Avg: 409.32 / Max: 758.21

Embree

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 32 / Avg: 36.48 / Max: 43Min: 34 / Avg: 39.36 / Max: 47Min: 36 / Avg: 39.47 / Max: 47Min: 36 / Avg: 39.76 / Max: 48

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 OnAVX-512 Off1.1482.2963.4444.5925.745.1023.8924.2583.356

OpenVKL

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVKL 2.0.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2934.37 / Max: 3913Min: 500 / Avg: 2909.25 / Max: 3917Min: 800 / Avg: 2872.62 / Max: 3515Min: 500 / Avg: 2843.9 / Max: 3519

OpenVKL

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 2.0.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 105.27 / Avg: 607.73 / Max: 758.79Min: 199.73 / Avg: 636.08 / Max: 754.77Min: 123.79 / Avg: 635.31 / Max: 760.66Min: 134.89 / Avg: 642.1 / Max: 759.51

OpenVKL

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVKL 2.0.0CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 30 / Avg: 51.4 / Max: 57Min: 34 / Avg: 54.24 / Max: 60Min: 36 / Avg: 54.42 / Max: 60Min: 35 / Avg: 56.19 / Max: 61

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OnAVX-512 Off0.01490.02980.04470.05960.07450.0660.0410.0560.038

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2187 / Avg: 3001.49 / Max: 3907Min: 800 / Avg: 2821.53 / Max: 3907Min: 800 / Avg: 2909.36 / Max: 3509Min: 800 / Avg: 2650.94 / Max: 3510

OSPRay

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.12CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 199.85 / Avg: 565.77 / Max: 674.64Min: 206.8 / Avg: 642.59 / Max: 756.55Min: 132.38 / Avg: 625.29 / Max: 749.25Min: 135.38 / Avg: 645.46 / Max: 744.99

OSPRay

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.12CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 34 / Avg: 50.89 / Max: 55Min: 36 / Avg: 51.78 / Max: 57Min: 40 / Avg: 53.64 / Max: 58Min: 41 / Avg: 55.75 / Max: 60

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OnAVX-512 Off0.01460.02920.04380.05840.0730.0650.0390.0550.036

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2860.32 / Max: 3908Min: 800 / Avg: 2789.09 / Max: 3900Min: 800 / Avg: 2856.21 / Max: 3506Min: 800 / Avg: 2633.09 / Max: 3514

OSPRay

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.12CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 200.25 / Avg: 530.92 / Max: 639.95Min: 199.86 / Avg: 642.78 / Max: 757.23Min: 134.53 / Avg: 625.67 / Max: 751Min: 140.03 / Avg: 641.68 / Max: 741.33

OSPRay

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.12CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41 / Avg: 50.57 / Max: 56Min: 41 / Avg: 55.91 / Max: 60Min: 37 / Avg: 51.63 / Max: 56Min: 38 / Avg: 52.29 / Max: 57

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OnAVX-512 Off0.00650.0130.01950.0260.03250.0290.0180.0240.015

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3027.44 / Max: 3910Min: 800 / Avg: 3011.05 / Max: 3904Min: 800 / Avg: 2962.97 / Max: 3510Min: 800 / Avg: 2944.84 / Max: 3510

OSPRay

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.12CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.42 / Avg: 572.92 / Max: 683.35Min: 187.87 / Avg: 596.54 / Max: 711.75Min: 130.09 / Avg: 616.55 / Max: 735.34Min: 129.23 / Avg: 635.29 / Max: 759.02

OSPRay

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.12CPU Temperature MonitorAVX-512 OnAVX-512 Off1122334455Min: 38 / Avg: 50.81 / Max: 54Min: 38 / Avg: 50.91 / Max: 54Min: 40 / Avg: 51.3 / Max: 55Min: 41 / Avg: 52.31 / Max: 57

Y-Cruncher

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3268.42 / Max: 3908Min: 800 / Avg: 3155.23 / Max: 3908Min: 800 / Avg: 2846.32 / Max: 3512Min: 800 / Avg: 2798.17 / Max: 3511

Y-Cruncher

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.2CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 204.3 / Avg: 399.57 / Max: 725.27Min: 103.71 / Avg: 430.76 / Max: 715.25Min: 139.77 / Avg: 425.32 / Max: 750.74Min: 134.09 / Avg: 451.69 / Max: 736.59

Y-Cruncher

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.2CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 36 / Avg: 40.69 / Max: 47Min: 37 / Avg: 42.99 / Max: 49Min: 41 / Avg: 44.12 / Max: 50Min: 40 / Avg: 44.62 / Max: 49

Y-Cruncher

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2895.61 / Max: 3907Min: 800 / Avg: 2830.68 / Max: 3904Min: 800 / Avg: 2783.21 / Max: 3509Min: 800 / Avg: 2736.78 / Max: 3509

Y-Cruncher

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.2CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 144.38 / Avg: 545.54 / Max: 739.45Min: 206.72 / Avg: 566.95 / Max: 745.43Min: 137.75 / Avg: 556.06 / Max: 742.94Min: 139.38 / Avg: 575.38 / Max: 737.4

Y-Cruncher

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.2CPU Temperature MonitorAVX-512 OnAVX-512 Off1122334455Min: 32 / Avg: 44.12 / Max: 51Min: 34 / Avg: 47.63 / Max: 55Min: 37 / Avg: 48.55 / Max: 55Min: 37 / Avg: 49.71 / Max: 57

Y-Cruncher

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 3445.48 / Max: 3908Min: 800 / Avg: 3313.53 / Max: 3907Min: 800 / Avg: 2852.57 / Max: 3515Min: 800 / Avg: 2850.7 / Max: 3510

Y-Cruncher

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.2CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 206.15 / Avg: 336.26 / Max: 671.34Min: 206.39 / Avg: 359.32 / Max: 686.83Min: 133.05 / Avg: 353.03 / Max: 753.25Min: 137.49 / Avg: 371.75 / Max: 732.24

Y-Cruncher

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.2CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 34 / Avg: 37.36 / Max: 43Min: 36 / Avg: 40.27 / Max: 47Min: 37 / Avg: 40.47 / Max: 46Min: 38 / Avg: 41.46 / Max: 47

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2962.65 / Max: 3907Min: 800 / Avg: 2951.28 / Max: 3906Min: 800 / Avg: 2905.96 / Max: 3509Min: 800 / Avg: 2857.85 / Max: 3512

oneDNN

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.3CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 206.56 / Avg: 535.79 / Max: 754.55Min: 104.84 / Avg: 561.81 / Max: 756.79Min: 123.9 / Avg: 567.66 / Max: 734.19Min: 131.29 / Avg: 591.96 / Max: 755.76

oneDNN

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.3CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 36 / Avg: 47.82 / Max: 52Min: 38 / Avg: 50.66 / Max: 54Min: 35 / Avg: 52.1 / Max: 59Min: 35 / Avg: 52.63 / Max: 57

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2996.59 / Max: 3908Min: 800 / Avg: 2954.22 / Max: 3907Min: 800 / Avg: 2906.5 / Max: 3502Min: 800 / Avg: 2870.25 / Max: 3511

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.7 / Avg: 571.85 / Max: 720.32Min: 144.81 / Avg: 586.48 / Max: 752.83Min: 143.22 / Avg: 588.6 / Max: 751.82Min: 124.77 / Avg: 593.3 / Max: 756.49

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 35 / Avg: 48.28 / Max: 54Min: 37 / Avg: 49.82 / Max: 57Min: 39 / Avg: 51.01 / Max: 59Min: 39 / Avg: 52.09 / Max: 59

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3008.77 / Max: 3904Min: 800 / Avg: 2999.39 / Max: 3906Min: 800 / Avg: 2934.05 / Max: 3501Min: 800 / Avg: 2894.68 / Max: 3510

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.89 / Avg: 569.32 / Max: 725.89Min: 206.82 / Avg: 583.69 / Max: 755.21Min: 143.11 / Avg: 590.62 / Max: 754.02Min: 139.08 / Avg: 591.27 / Max: 757.85

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 36 / Avg: 48.71 / Max: 54Min: 37 / Avg: 49.96 / Max: 57Min: 39 / Avg: 51.38 / Max: 59Min: 39 / Avg: 52.36 / Max: 59

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2984.18 / Max: 3906Min: 800 / Avg: 2854.58 / Max: 3904Min: 800 / Avg: 2899.72 / Max: 3511Min: 800 / Avg: 2759.25 / Max: 3516

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 207.14 / Avg: 582.01 / Max: 756.24Min: 206.89 / Avg: 620.27 / Max: 751.57Min: 143.91 / Avg: 587.53 / Max: 760.59Min: 141.11 / Avg: 624.47 / Max: 765.04

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 37 / Avg: 49.91 / Max: 56Min: 36 / Avg: 51.11 / Max: 56Min: 41 / Avg: 52.42 / Max: 59Min: 39 / Avg: 54.76 / Max: 60

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3089.22 / Max: 3904Min: 800 / Avg: 2818.6 / Max: 3903Min: 800 / Avg: 2936.5 / Max: 3509Min: 800 / Avg: 2898.85 / Max: 3501

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.91 / Avg: 527.9 / Max: 734.93Min: 148.13 / Avg: 611.69 / Max: 755.87Min: 142.52 / Avg: 540.07 / Max: 762.44Min: 147.32 / Avg: 554.56 / Max: 759.36

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 37 / Avg: 46.03 / Max: 53Min: 38 / Avg: 48.12 / Max: 55Min: 40 / Avg: 49.28 / Max: 57Min: 40 / Avg: 54.1 / Max: 60

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2959.45 / Max: 3908Min: 800 / Avg: 2852.57 / Max: 3908Min: 800 / Avg: 2890.48 / Max: 3509Min: 800 / Avg: 2839.81 / Max: 3512

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 124.93 / Avg: 583.37 / Max: 757.25Min: 146.85 / Avg: 620.07 / Max: 762.64Min: 137.59 / Avg: 587.3 / Max: 760.63Min: 146.6 / Avg: 598.52 / Max: 758.88

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 36 / Avg: 48.42 / Max: 55Min: 37 / Avg: 50.57 / Max: 57Min: 39 / Avg: 52.4 / Max: 59Min: 40 / Avg: 55.23 / Max: 60

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 3036.33 / Max: 3904Min: 800 / Avg: 2986.32 / Max: 3905Min: 800 / Avg: 2969.61 / Max: 3515Min: 800 / Avg: 2910.39 / Max: 3509

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 207.24 / Avg: 524.7 / Max: 756.03Min: 200.01 / Avg: 543.95 / Max: 744.29Min: 130.86 / Avg: 555.85 / Max: 759.56Min: 144.19 / Avg: 568.1 / Max: 759.38

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1122334455Min: 37 / Avg: 46.82 / Max: 53Min: 37 / Avg: 48.42 / Max: 55Min: 39 / Avg: 49.75 / Max: 57Min: 41 / Avg: 49.81 / Max: 57

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2951.28 / Max: 3909Min: 800 / Avg: 2911.78 / Max: 3908Min: 800 / Avg: 2895.53 / Max: 3513Min: 800 / Avg: 2860.68 / Max: 3508

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 207.17 / Avg: 588.7 / Max: 754.39Min: 207.24 / Avg: 601.24 / Max: 748.86Min: 136.35 / Avg: 609.29 / Max: 755.63Min: 141.14 / Avg: 609.71 / Max: 751.36

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 36 / Avg: 49.85 / Max: 56Min: 36 / Avg: 50.91 / Max: 57Min: 38 / Avg: 52.16 / Max: 59Min: 40 / Avg: 53.82 / Max: 60

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2918.01 / Max: 3904Min: 500 / Avg: 2883.43 / Max: 3904Min: 800 / Avg: 2879.74 / Max: 3503Min: 800 / Avg: 2867.16 / Max: 3507

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 148.8 / Avg: 569.63 / Max: 723.58Min: 207.07 / Avg: 607.95 / Max: 755.36Min: 144.32 / Avg: 611.95 / Max: 753.73Min: 139.84 / Avg: 612.34 / Max: 754.59

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 37 / Avg: 50.46 / Max: 56Min: 37 / Avg: 51.34 / Max: 57Min: 39 / Avg: 52.07 / Max: 59Min: 41 / Avg: 54.4 / Max: 60

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2958.37 / Max: 3904Min: 800 / Avg: 2892.35 / Max: 3905Min: 800 / Avg: 2884.44 / Max: 3508Min: 800 / Avg: 2852.98 / Max: 3501

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.92 / Avg: 595.58 / Max: 740.41Min: 207.21 / Avg: 604.78 / Max: 754.51Min: 144.87 / Avg: 607.3 / Max: 759.23Min: 144.54 / Avg: 607.87 / Max: 759.8

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 37 / Avg: 50 / Max: 56Min: 38 / Avg: 51.02 / Max: 57Min: 38 / Avg: 52.7 / Max: 59Min: 41 / Avg: 54.26 / Max: 60

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2907.46 / Max: 3904Min: 800 / Avg: 2863.16 / Max: 3903Min: 800 / Avg: 2861.55 / Max: 3512Min: 800 / Avg: 2805.89 / Max: 3503

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 207.16 / Avg: 607.3 / Max: 756.05Min: 206.52 / Avg: 611.84 / Max: 754.94Min: 139.96 / Avg: 617.36 / Max: 759.01Min: 139.81 / Avg: 620.45 / Max: 760.44

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 37 / Avg: 50.95 / Max: 57Min: 38 / Avg: 51.41 / Max: 57Min: 39 / Avg: 53.47 / Max: 59Min: 40 / Avg: 54.65 / Max: 60

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2897.66 / Max: 3904Min: 800 / Avg: 2897.48 / Max: 3904Min: 800 / Avg: 2863.77 / Max: 3508Min: 800 / Avg: 2842.13 / Max: 3513

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.67 / Avg: 597.45 / Max: 757.34Min: 207.14 / Avg: 607.98 / Max: 755.1Min: 147.42 / Avg: 608 / Max: 759.43Min: 142 / Avg: 611.56 / Max: 759.31

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 37 / Avg: 50.46 / Max: 56Min: 37 / Avg: 50.95 / Max: 57Min: 39 / Avg: 52.8 / Max: 59Min: 41 / Avg: 54.44 / Max: 60

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2909.62 / Max: 3904Min: 800 / Avg: 2900.24 / Max: 3908Min: 800 / Avg: 2893.76 / Max: 3515Min: 800 / Avg: 2806.99 / Max: 3507

OSPRay Studio

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 142.4 / Avg: 606.92 / Max: 759.82Min: 133.08 / Avg: 619.07 / Max: 759.61Min: 206.63 / Avg: 608.46 / Max: 765.39Min: 206.71 / Avg: 617.43 / Max: 757

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 37 / Avg: 50.81 / Max: 56Min: 37 / Avg: 50.92 / Max: 57Min: 39 / Avg: 53.61 / Max: 60Min: 41 / Avg: 54.83 / Max: 60

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OnAVX-512 Off0.0320.0640.0960.1280.160.1420.0970.1240.094

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3778.53 / Max: 3909Min: 800 / Avg: 3719.28 / Max: 3912Min: 800 / Avg: 3199.12 / Max: 3515Min: 800 / Avg: 3179.69 / Max: 3508

TensorFlow

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.12CPU Power Consumption MonitorAVX-512 OnAVX-512 Off100200300400500Min: 170.32 / Avg: 398.6 / Max: 450.75Min: 206.9 / Avg: 413.92 / Max: 462.77Min: 135.2 / Avg: 467.02 / Max: 544.28Min: 145.05 / Avg: 485.57 / Max: 544.2

TensorFlow

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.12CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 37 / Avg: 41.69 / Max: 44Min: 37 / Avg: 41.93 / Max: 46Min: 39 / Avg: 43.01 / Max: 49Min: 39 / Avg: 43.36 / Max: 45

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 32 - Model: ResNet-50AVX-512 OnAVX-512 Off0.0380.0760.1140.1520.190.1690.1130.1650.119

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3797.09 / Max: 3912Min: 800 / Avg: 3656.93 / Max: 3909Min: 800 / Avg: 3205.24 / Max: 3500Min: 800 / Avg: 3011.19 / Max: 3516

TensorFlow

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.12CPU Power Consumption MonitorAVX-512 OnAVX-512 Off100200300400500Min: 206.81 / Avg: 437.84 / Max: 494.79Min: 206.73 / Avg: 448.87 / Max: 498.3Min: 133.66 / Avg: 507.68 / Max: 568.58Min: 83.76 / Avg: 510.59 / Max: 556.63

TensorFlow

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.12CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 34 / Avg: 42.48 / Max: 47Min: 33 / Avg: 42.52 / Max: 45Min: 37 / Avg: 43.39 / Max: 46Min: 36 / Avg: 43.72 / Max: 47

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

Emerald RapidsSapphire RapidsOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OnAVX-512 Off0.04610.09220.13830.18440.23050.2050.1380.1880.126

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3787.56 / Max: 3910Min: 800 / Avg: 3711.35 / Max: 3906Min: 800 / Avg: 3214.95 / Max: 3515Min: 800 / Avg: 3056.82 / Max: 3509

TensorFlow

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.12CPU Power Consumption MonitorAVX-512 OnAVX-512 Off110220330440550Min: 207.18 / Avg: 476.86 / Max: 531.76Min: 206.82 / Avg: 480.23 / Max: 511.44Min: 133.72 / Avg: 541.03 / Max: 580.13Min: 144.3 / Avg: 549.53 / Max: 606.11

TensorFlow

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.12CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 34 / Avg: 45.2 / Max: 50Min: 34 / Avg: 45.35 / Max: 49Min: 37 / Avg: 45.48 / Max: 50Min: 37 / Avg: 46.02 / Max: 51

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3007.46 / Max: 3907Min: 800 / Avg: 2665.33 / Max: 3908Min: 800 / Avg: 2872.4 / Max: 3515Min: 800 / Avg: 2489.2 / Max: 3512

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 206.75 / Avg: 643.09 / Max: 735.29Min: 103.58 / Avg: 645.19 / Max: 824.86Min: 143.98 / Avg: 644.15 / Max: 745.46Min: 144.55 / Avg: 649.2 / Max: 755.85

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 35 / Avg: 51.37 / Max: 57Min: 36 / Avg: 51.42 / Max: 56Min: 37 / Avg: 54.55 / Max: 60Min: 38 / Avg: 55.73 / Max: 60

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2904.53 / Max: 3509Min: 800 / Avg: 2822.65 / Max: 3514Min: 800 / Avg: 2892 / Max: 3908Min: 800 / Avg: 2567.68 / Max: 3908

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 206.66 / Avg: 653.75 / Max: 749.75Min: 206.85 / Avg: 654.25 / Max: 835.93Min: 141.92 / Avg: 655.28 / Max: 742.22Min: 144.78 / Avg: 657.22 / Max: 758.3

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 51.7 / Max: 55Min: 37 / Avg: 51.8 / Max: 55Min: 40 / Avg: 55.35 / Max: 60Min: 41 / Avg: 56.47 / Max: 60

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2830.49 / Max: 3910Min: 800 / Avg: 2545.34 / Max: 3903Min: 800 / Avg: 2808.74 / Max: 3515Min: 800 / Avg: 2785.33 / Max: 3510

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On160320480640800Min: 139.22 / Avg: 651.89 / Max: 746.8Min: 141.18 / Avg: 652.91 / Max: 759.25Min: 206.81 / Avg: 652 / Max: 753.73Min: 206.53 / Avg: 652.32 / Max: 894.8

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 51.96 / Max: 55Min: 37 / Avg: 52.1 / Max: 56Min: 40 / Avg: 55.88 / Max: 59Min: 42 / Avg: 56.49 / Max: 60

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2534.47 / Max: 3911Min: 800 / Avg: 2496.49 / Max: 3905Min: 800 / Avg: 2499.4 / Max: 3510Min: 800 / Avg: 2440.06 / Max: 3509

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 206.55 / Avg: 660.54 / Max: 758.96Min: 205.98 / Avg: 660.76 / Max: 798.87Min: 134.79 / Avg: 660.58 / Max: 760.14Min: 134.39 / Avg: 662.15 / Max: 766.17

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 37 / Avg: 51.81 / Max: 55Min: 38 / Avg: 52.28 / Max: 55Min: 40 / Avg: 56.14 / Max: 60Min: 42 / Avg: 56.43 / Max: 60

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2956.05 / Max: 3907Min: 800 / Avg: 2675.48 / Max: 3909Min: 800 / Avg: 2900.67 / Max: 3511Min: 800 / Avg: 2524.72 / Max: 3512

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 206.57 / Avg: 636.48 / Max: 766.86Min: 206.98 / Avg: 649.9 / Max: 748.52Min: 134.08 / Avg: 637.97 / Max: 751.47Min: 141.8 / Avg: 646.72 / Max: 748.88

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 51.9 / Max: 56Min: 38 / Avg: 52.8 / Max: 57Min: 42 / Avg: 55.99 / Max: 61Min: 41 / Avg: 56.46 / Max: 61

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2474.34 / Max: 3904Min: 800 / Avg: 2432.9 / Max: 3905Min: 800 / Avg: 2409.05 / Max: 3512Min: 800 / Avg: 2364.74 / Max: 3512

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 206.34 / Avg: 657.43 / Max: 769.68Min: 206.57 / Avg: 657.51 / Max: 759.7Min: 140.31 / Avg: 657.79 / Max: 763.65Min: 140.27 / Avg: 658.37 / Max: 759.99

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 36 / Avg: 51.8 / Max: 55Min: 37 / Avg: 52.35 / Max: 56Min: 41 / Avg: 56 / Max: 59Min: 41 / Avg: 56.27 / Max: 59

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2705.88 / Max: 3511Min: 800 / Avg: 2446.61 / Max: 3509Min: 800 / Avg: 2692.65 / Max: 3912Min: 800 / Avg: 2429.46 / Max: 3910

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 142.57 / Avg: 656.98 / Max: 759.7Min: 137.8 / Avg: 658.35 / Max: 760.45Min: 207.03 / Avg: 658.56 / Max: 763.43Min: 106.14 / Avg: 660.56 / Max: 759.78

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 37 / Avg: 52.15 / Max: 56Min: 38 / Avg: 52.34 / Max: 55Min: 41 / Avg: 56.23 / Max: 60Min: 41 / Avg: 56.66 / Max: 60

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2588.47 / Max: 3509Min: 800 / Avg: 2466.01 / Max: 3511Min: 800 / Avg: 2584.05 / Max: 3907Min: 800 / Avg: 2369.5 / Max: 3907

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 206.26 / Avg: 655.74 / Max: 760.38Min: 205.91 / Avg: 656.76 / Max: 757.26Min: 138.9 / Avg: 656.7 / Max: 754.94Min: 135.14 / Avg: 659.58 / Max: 759.65

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 52.42 / Max: 56Min: 37 / Avg: 52.7 / Max: 56Min: 41 / Avg: 56.01 / Max: 59Min: 42 / Avg: 56.5 / Max: 60

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2912.9 / Max: 3907Min: 800 / Avg: 2334.49 / Max: 3904Min: 800 / Avg: 2823.12 / Max: 3513Min: 800 / Avg: 2246.35 / Max: 3510

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 140.04 / Avg: 656.62 / Max: 757.38Min: 141.93 / Avg: 659.08 / Max: 758.69Min: 206.16 / Avg: 658.43 / Max: 764.17Min: 206.6 / Avg: 658.75 / Max: 757.12

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 39 / Avg: 53.16 / Max: 57Min: 38 / Avg: 53.49 / Max: 57Min: 41 / Avg: 56.79 / Max: 60Min: 41 / Avg: 57.39 / Max: 61

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2937.64 / Max: 3910Min: 800 / Avg: 2523.87 / Max: 3907Min: 800 / Avg: 2890.23 / Max: 3515Min: 800 / Avg: 2335.95 / Max: 3514

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 206.88 / Avg: 654.08 / Max: 774.62Min: 206.93 / Avg: 656.65 / Max: 755.73Min: 138.22 / Avg: 655.8 / Max: 757.3Min: 141.2 / Avg: 657.6 / Max: 757.38

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 52.94 / Max: 56Min: 38 / Avg: 53.64 / Max: 57Min: 40 / Avg: 56.4 / Max: 60Min: 41 / Avg: 56.75 / Max: 60

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2654.51 / Max: 3908Min: 800 / Avg: 2552.5 / Max: 3909Min: 800 / Avg: 2542 / Max: 3511Min: 800 / Avg: 2452.95 / Max: 3510

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.89 / Avg: 649.79 / Max: 759.52Min: 206.86 / Avg: 651.28 / Max: 757.99Min: 143.33 / Avg: 649.87 / Max: 762.66Min: 138.92 / Avg: 650.5 / Max: 760.41

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 37 / Avg: 52.28 / Max: 56Min: 38 / Avg: 52.67 / Max: 57Min: 40 / Avg: 55.71 / Max: 59Min: 42 / Avg: 56.42 / Max: 60

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2833.67 / Max: 3907Min: 800 / Avg: 2755.35 / Max: 3904Min: 800 / Avg: 2778.23 / Max: 3515Min: 800 / Avg: 2690.93 / Max: 3512

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.71 / Avg: 648.21 / Max: 747.87Min: 206.4 / Avg: 652.53 / Max: 745.49Min: 139.64 / Avg: 650.58 / Max: 751.9Min: 139.19 / Avg: 654.14 / Max: 728.45

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 38 / Avg: 51.99 / Max: 56Min: 38 / Avg: 52.23 / Max: 55Min: 41 / Avg: 55.93 / Max: 60Min: 42 / Avg: 56.51 / Max: 60

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2931.15 / Max: 3905Min: 800 / Avg: 2316.34 / Max: 3904Min: 800 / Avg: 2808.93 / Max: 3508Min: 800 / Avg: 2252.6 / Max: 3510

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 143.5 / Avg: 657.41 / Max: 756.56Min: 142.53 / Avg: 658.62 / Max: 757.75Min: 206.84 / Avg: 657.97 / Max: 768.07Min: 206.69 / Avg: 658.1 / Max: 752.9

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 53.03 / Max: 56Min: 38 / Avg: 53.43 / Max: 57Min: 41 / Avg: 57.06 / Max: 60Min: 43 / Avg: 57.32 / Max: 60

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2849.9 / Max: 3513Min: 800 / Avg: 2456.27 / Max: 3513Min: 800 / Avg: 2825.64 / Max: 3908Min: 800 / Avg: 2526.74 / Max: 3905

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 206.59 / Avg: 645.49 / Max: 767.1Min: 206.9 / Avg: 657.33 / Max: 762.02Min: 143.35 / Avg: 648.95 / Max: 765.36Min: 146.73 / Avg: 654.43 / Max: 756.6

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 38 / Avg: 51.96 / Max: 56Min: 38 / Avg: 52.29 / Max: 56Min: 41 / Avg: 56.04 / Max: 60Min: 42 / Avg: 56.39 / Max: 61

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2890.31 / Max: 3904Min: 800 / Avg: 2629.98 / Max: 3905Min: 800 / Avg: 2813.17 / Max: 3514Min: 800 / Avg: 2457.57 / Max: 3510

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 142.04 / Avg: 656.81 / Max: 744.88Min: 134.97 / Avg: 663.13 / Max: 754.59Min: 206.5 / Avg: 658.68 / Max: 774.35Min: 171.5 / Avg: 663.12 / Max: 746.34

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 52.54 / Max: 56Min: 38 / Avg: 53.14 / Max: 56Min: 41 / Avg: 56.83 / Max: 60Min: 42 / Avg: 57.82 / Max: 61

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 3132.4 / Max: 3904Min: 800 / Avg: 2666.29 / Max: 3914Min: 800 / Avg: 2659.67 / Max: 3511Min: 800 / Avg: 2573.11 / Max: 3516

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 105.27 / Avg: 509.17 / Max: 614.46Min: 206.74 / Avg: 658.37 / Max: 772.16Min: 140.85 / Avg: 607.89 / Max: 662.55Min: 138.57 / Avg: 658.34 / Max: 759.74

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 42 / Avg: 49.55 / Max: 52Min: 41 / Avg: 55.93 / Max: 59Min: 39 / Avg: 49.89 / Max: 52Min: 38 / Avg: 52.66 / Max: 56

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3332.23 / Max: 3906Min: 800 / Avg: 3150.41 / Max: 3904Min: 800 / Avg: 2829.36 / Max: 3513Min: 800 / Avg: 2693.5 / Max: 3506

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 206.49 / Avg: 469.31 / Max: 558.98Min: 207 / Avg: 514.86 / Max: 663.92Min: 137.76 / Avg: 545.79 / Max: 590.3Min: 145.72 / Avg: 655.91 / Max: 741.97

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1122334455Min: 38 / Avg: 46.79 / Max: 49Min: 30 / Avg: 49.93 / Max: 56Min: 41 / Avg: 46.95 / Max: 50Min: 41 / Avg: 52.35 / Max: 55

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Phoronix Test Suite System Monitoring

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringAVX-512 OnAVX-512 Off10002000300040005000Min: 500 / Avg: 2841.09 / Max: 3519Min: 800 / Avg: 2870.28 / Max: 5743Min: 800 / Avg: 2954.57 / Max: 3913Min: 500 / Avg: 3017.93 / Max: 3917

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 OnAVX-512 Off160320480640800Min: 72.02 / Avg: 574.93 / Max: 770.09Min: 67.03 / Avg: 598.76 / Max: 762.66Min: 103.63 / Avg: 583.08 / Max: 772.16Min: 99.6 / Avg: 589.71 / Max: 894.8

CPU Temperature Monitor

Phoronix Test Suite System Monitoring

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringAVX-512 OnAVX-512 Off1326395265Min: 22 / Avg: 48.5 / Max: 59Min: 25 / Avg: 51.04 / Max: 61Min: 29 / Avg: 53.19 / Max: 66Min: 30 / Avg: 54 / Max: 64

Phoronix Test Suite v10.8.5