Intel 5th Gen Xeon AVX-512 Comparison

2 x INTEL XEON PLATINUM 8592 AVX-512 Emerald Rapids vs. Sapphire Rapids by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2312146-NE-INTELAVX523&grs&sro.

ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSapphire RapidsEmerald Rapids AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)Intel Device 1bce1008GB3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Intel X710 for 10GBASE-TUbuntu 23.106.5.0-13-generic (x86_64)GCC 13.2.0ext41920x10802 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads)Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Sapphire Rapids: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0004d0- Sapphire Rapids: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0004d0- Emerald Rapids: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000161- Emerald Rapids: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000161Python Details- Python 3.11.6Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

openvino: Face Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Vehicle Detection FP16 - CPUminibude: OpenMP - BM1minibude: OpenMP - BM1openvino: Face Detection Retail FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUminibude: OpenMP - BM2minibude: OpenMP - BM2openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUospray: gravity_spheres_volume/dim_512/scivis/real_timeopenvino: Road Segmentation ADAS FP16 - CPUospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timeopenvino: Face Detection Retail FP16-INT8 - CPUtensorflow: CPU - 16 - ResNet-50openvino: Face Detection Retail FP16-INT8 - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUtensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 64 - ResNet-50openvkl: vklBenchmarkCPU ISPCopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer ISPC - Asian Dragonospray-studio: 1 - 1080p - 1 - Path Tracer - CPUospray-studio: 3 - 1080p - 32 - Path Tracer - CPUospray-studio: 3 - 1080p - 1 - Path Tracer - CPUospray-studio: 3 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 1080p - 16 - Path Tracer - CPUospray-studio: 3 - 1080p - 16 - Path Tracer - CPUospray-studio: 1 - 1080p - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 16 - Path Tracer - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUy-cruncher: 500My-cruncher: 5Bembree: Pathtracer ISPC - Crowny-cruncher: 1Bonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUSapphire RapidsEmerald Rapids AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off412.8647113.292.53742.5140.194381.750.3727.337556.52637.78637.7347.0047.013887.3014944.267.703418.575136.7438.025759.71144820.3520.73138.6563466.3940.291528.7326917.014.38218.62137.0935.243219.6015.083235.888220980.6966.185.713302685.64103.282705151891.46290.1515.761894.49131.8466152.5351226845726810628893545423170891679663.2714054384832.29328.604124.08634.914830.95985.028773.9813.66212.63140.681075.651.75111.632564.09213.06214.94140.64139.441749.986859.8617.122090.44583.61817.463688.3265805.3832.5188.5672214.1820.57923.472463.9848.4821.891355.3322.521132.459.2252123.658513852.8847.228.653830957.8468.422155129576.78352.0811.691645.03122.3348141.11112639934309122610354166491783261960472.8916486444602.90736.637113.13006.338896.529538.2749132.992.441097.8229.075105.950.4624.8710161.31747.77747.4942.7442.764765.9518384.836.695313.366212.5356.958921.97114369.6614.33199.0284975.6950.41884.9932234.043.93236.14135.3741.610916.9517.040942.654524769.1049.265.152382572.0697.853245123447.74237.3612.552389.55174.3843200.902918971462238867493017357460531434553.5112125327232.75427.058151.46675.2331331.7494.579439.9213.55276.63115.351166.181.7109.752988.91237.77238.22134.44134.182116.648208.8815.103392.568135.70315.584277.3163672.9729.91124.4803112.0050.631159.932822.7145.3224.671287.1120.937427.5610.5667423.410015101.2939.068.463360353.6066.082365101244.00337.6910.691882.97159.4832181.8347225859627910558933585424272181715167.9314257387873.10933.680137.62276.5402341.14OpenBenchmarking.org

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On120240360480600SE +/- 0.10, N = 3SE +/- 0.53, N = 3SE +/- 0.06, N = 3SE +/- 2.15, N = 394.57538.2785.02412.861. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On11K22K33K44K55KSE +/- 3.35, N = 3SE +/- 80.54, N = 3SE +/- 3.89, N = 3SE +/- 54.78, N = 39439.9249132.998773.9847113.291. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On48121620SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 313.552.4413.662.531. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OffAVX-512 On2004006008001000SE +/- 0.41, N = 3SE +/- 1.48, N = 3SE +/- 1.82, N = 3SE +/- 1.33, N = 3276.631097.82212.63742.511. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OffAVX-512 On306090120150SE +/- 0.15, N = 3SE +/- 0.04, N = 3SE +/- 1.21, N = 3SE +/- 0.08, N = 3115.3529.07140.6840.191. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUAVX-512 OffAVX-512 On11002200330044005500SE +/- 10.88, N = 7SE +/- 0.84, N = 3SE +/- 10.21, N = 15SE +/- 26.63, N = 31166.185105.951075.654381.751. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OffAVX-512 On0.39380.78761.18141.57521.969SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.700.461.750.371. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUAVX-512 OffAVX-512 On20406080100SE +/- 1.00, N = 7SE +/- 0.01, N = 3SE +/- 1.05, N = 15SE +/- 0.15, N = 3109.7524.87111.6327.331. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 0.72, N = 3SE +/- 3.93, N = 3SE +/- 1.81, N = 3SE +/- 6.80, N = 32988.9110161.312564.097556.521. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP32 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OffAVX-512 On160320480640800SE +/- 0.09, N = 3SE +/- 1.03, N = 3SE +/- 0.26, N = 3SE +/- 0.38, N = 3237.77747.77213.06637.781. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OffAVX-512 On160320480640800SE +/- 0.31, N = 3SE +/- 0.82, N = 3SE +/- 0.08, N = 3SE +/- 0.66, N = 3238.22747.49214.94637.731. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP32 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OffAVX-512 On306090120150SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.18, N = 3SE +/- 0.03, N = 3134.4442.74140.6447.001. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OffAVX-512 On306090120150SE +/- 0.18, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3134.1842.76139.4447.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On10002000300040005000SE +/- 1.56, N = 3SE +/- 1.59, N = 3SE +/- 0.53, N = 3SE +/- 1.67, N = 32116.644765.951749.983887.301. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUAVX-512 OffAVX-512 On4K8K12K16K20KSE +/- 2.90, N = 3SE +/- 5.71, N = 3SE +/- 3.57, N = 3SE +/- 24.24, N = 38208.8818384.836859.8614944.261. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On48121620SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 315.106.6917.127.701. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

miniBUDE

Implementation: OpenMP - Input Deck: BM1

Emerald RapidsSapphire RapidsOpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On11002200330044005500SE +/- 0.74, N = 7SE +/- 3.87, N = 8SE +/- 17.21, N = 5SE +/- 12.90, N = 73392.575313.372090.453418.581. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

Emerald RapidsSapphire RapidsOpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On50100150200250SE +/- 0.03, N = 7SE +/- 0.15, N = 8SE +/- 0.69, N = 5SE +/- 0.52, N = 7135.70212.5483.62136.741. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUAVX-512 OffAVX-512 On48121620SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 315.586.9517.468.021. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 0.66, N = 3SE +/- 8.09, N = 3SE +/- 3.58, N = 3SE +/- 11.71, N = 34277.318921.973688.325759.711. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OffAVX-512 On30K60K90K120K150KSE +/- 52.05, N = 3SE +/- 898.88, N = 3SE +/- 51.71, N = 3SE +/- 735.86, N = 363672.97114369.6665805.38144820.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On816243240SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 329.9114.3332.5120.731. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

miniBUDE

Implementation: OpenMP - Input Deck: BM2

Emerald RapidsSapphire RapidsOpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On4080120160200SE +/- 0.97, N = 15SE +/- 1.98, N = 15SE +/- 0.22, N = 3SE +/- 0.71, N = 3124.48199.0388.57138.661. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

Emerald RapidsSapphire RapidsOpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On11002200330044005500SE +/- 24.22, N = 15SE +/- 49.58, N = 15SE +/- 5.42, N = 3SE +/- 17.85, N = 33112.014975.702214.183466.391. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On0.14180.28360.42540.56720.709SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.630.400.570.291. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUAVX-512 OffAVX-512 On400800120016002000SE +/- 0.98, N = 3SE +/- 1.06, N = 3SE +/- 0.24, N = 3SE +/- 1.66, N = 31159.931884.99923.471528.731. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OffAVX-512 On7K14K21K28K35KSE +/- 0.50, N = 3SE +/- 24.15, N = 3SE +/- 2.47, N = 3SE +/- 29.04, N = 32822.7132234.042463.9826917.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OffAVX-512 On1122334455SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 345.323.9348.484.381. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OffAVX-512 On50100150200250SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 324.67236.1421.89218.621. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OffAVX-512 On30060090012001500SE +/- 2.43, N = 3SE +/- 0.03, N = 3SE +/- 4.01, N = 3SE +/- 0.07, N = 31287.11135.371355.33137.091. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On918273645SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 320.9441.6122.5235.24

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUAVX-512 OffAVX-512 On816243240SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 327.5616.9532.4519.601. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On48121620SE +/- 0.07557, N = 15SE +/- 0.20744, N = 4SE +/- 0.13104, N = 15SE +/- 0.14483, N = 1510.5667417.040909.2252115.08320

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On1020304050SE +/- 0.07, N = 3SE +/- 0.19, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 323.4142.6523.6635.89

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On5K10K15K20K25KSE +/- 8.51, N = 3SE +/- 20.85, N = 3SE +/- 9.76, N = 3SE +/- 25.65, N = 315101.2924769.1013852.8820980.691. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

Emerald RapidsSapphire RapidsOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OffAVX-512 On1530456075SE +/- 0.20, N = 3SE +/- 0.41, N = 3SE +/- 0.28, N = 3SE +/- 0.31, N = 339.0649.2647.2266.18

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On246810SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.465.158.655.711. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On8K16K24K32K40KSE +/- 274.25, N = 3SE +/- 74.75, N = 3SE +/- 150.37, N = 3SE +/- 114.21, N = 333603238253830933026

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

Emerald RapidsSapphire RapidsOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 32 - Model: ResNet-50AVX-512 OffAVX-512 On20406080100SE +/- 0.14, N = 3SE +/- 0.13, N = 3SE +/- 0.36, N = 3SE +/- 0.22, N = 353.6072.0657.8485.64

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

Emerald RapidsSapphire RapidsOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OffAVX-512 On20406080100SE +/- 0.58, N = 3SE +/- 0.16, N = 3SE +/- 0.39, N = 3SE +/- 0.75, N = 366.0897.8568.42103.28

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 OffAVX-512 On7001400210028003500SE +/- 6.36, N = 3SE +/- 30.78, N = 3SE +/- 4.04, N = 3SE +/- 3.84, N = 32365324521552705

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On30K60K90K120K150KSE +/- 496.38, N = 3SE +/- 940.07, N = 3SE +/- 1069.55, N = 3SE +/- 547.74, N = 3101244.00123447.74129576.78151891.461. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On80160240320400SE +/- 0.38, N = 3SE +/- 0.24, N = 3SE +/- 0.22, N = 3SE +/- 1.52, N = 3337.69237.36352.08290.151. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OffAVX-512 On48121620SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 310.6912.5511.6915.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On5001000150020002500SE +/- 0.40, N = 3SE +/- 2.91, N = 3SE +/- 0.20, N = 3SE +/- 1.25, N = 31882.972389.551645.031894.491. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OffAVX-512 On4080120160200SE +/- 0.19, N = 4SE +/- 0.52, N = 4SE +/- 0.21, N = 3SE +/- 0.26, N = 4159.48174.38122.33131.85

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On4080120160200SE +/- 0.30, N = 7SE +/- 0.38, N = 8SE +/- 0.22, N = 7SE +/- 0.33, N = 7181.83200.90141.11152.54

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On60120180240300SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3225189263226

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 101.69, N = 3SE +/- 43.03, N = 3SE +/- 37.24, N = 3SE +/- 11.85, N = 38596714699348457

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On70140210280350SE +/- 2.41, N = 15SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3279223309268

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On30060090012001500SE +/- 6.17, N = 3SE +/- 0.88, N = 3SE +/- 1.67, N = 3SE +/- 0.00, N = 3105588612261062

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On2004006008001000SE +/- 2.03, N = 3SE +/- 1.20, N = 3SE +/- 0.58, N = 3SE +/- 0.67, N = 38937491035889

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On9001800270036004500SE +/- 23.43, N = 3SE +/- 7.00, N = 3SE +/- 5.17, N = 3SE +/- 1.86, N = 33585301741663545

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On11002200330044005500SE +/- 19.40, N = 3SE +/- 10.48, N = 3SE +/- 8.21, N = 3SE +/- 2.40, N = 34242357449174231

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 60.01, N = 3SE +/- 27.24, N = 3SE +/- 8.69, N = 3SE +/- 17.64, N = 37218605383267089

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On4K8K12K16K20KSE +/- 155.10, N = 7SE +/- 108.89, N = 15SE +/- 18.90, N = 3SE +/- 52.30, N = 317151143451960416796

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On1632486480SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 367.9353.5172.8963.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On4K8K12K16K20KSE +/- 152.25, N = 5SE +/- 96.72, N = 3SE +/- 24.36, N = 3SE +/- 14.66, N = 314257121251648614054

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On10K20K30K40K50KSE +/- 82.99, N = 3SE +/- 167.00, N = 3SE +/- 123.86, N = 3SE +/- 213.70, N = 338787327234446038483

Y-Cruncher

Pi Digits To Calculate: 500M

Emerald RapidsSapphire RapidsOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.2Pi Digits To Calculate: 500MAVX-512 OffAVX-512 On0.69951.3992.09852.7983.4975SE +/- 0.017, N = 7SE +/- 0.022, N = 7SE +/- 0.005, N = 7SE +/- 0.003, N = 73.1092.7542.9072.293

Y-Cruncher

Pi Digits To Calculate: 5B

Emerald RapidsSapphire RapidsOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.2Pi Digits To Calculate: 5BAVX-512 OffAVX-512 On816243240SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 333.6827.0636.6428.60

Embree

Binary: Pathtracer ISPC - Model: Crown

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On306090120150SE +/- 0.23, N = 7SE +/- 0.55, N = 7SE +/- 0.27, N = 6SE +/- 0.36, N = 6137.62151.47113.13124.09

Y-Cruncher

Pi Digits To Calculate: 1B

Emerald RapidsSapphire RapidsOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.2Pi Digits To Calculate: 1BAVX-512 OffAVX-512 On246810SE +/- 0.026, N = 5SE +/- 0.021, N = 5SE +/- 0.007, N = 5SE +/- 0.003, N = 56.5405.2336.3384.914

CPU Temperature Monitor

Phoronix Test Suite System Monitoring

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On1326395265Min: 29 / Avg: 53.19 / Max: 66Min: 30 / Avg: 54 / Max: 64Min: 25 / Avg: 51.04 / Max: 61Min: 22 / Avg: 48.5 / Max: 59

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On160320480640800Min: 103.63 / Avg: 583.08 / Max: 772.16Min: 99.6 / Avg: 589.71 / Max: 894.8Min: 67.03 / Avg: 598.76 / Max: 762.66Min: 72.02 / Avg: 574.93 / Max: 770.09

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Phoronix Test Suite System Monitoring

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On10002000300040005000Min: 500 / Avg: 3017.93 / Max: 3917Min: 800 / Avg: 2954.57 / Max: 3913Min: 800 / Avg: 2870.28 / Max: 5743Min: 500 / Avg: 2841.09 / Max: 3519

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 41 / Avg: 52.35 / Max: 55Min: 41 / Avg: 46.95 / Max: 50Min: 30 / Avg: 49.93 / Max: 56Min: 38 / Avg: 46.79 / Max: 49

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 207 / Avg: 514.86 / Max: 663.92Min: 206.49 / Avg: 469.31 / Max: 558.98Min: 145.72 / Avg: 655.91 / Max: 741.97Min: 137.76 / Avg: 545.79 / Max: 590.3

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3332.23 / Max: 3906Min: 800 / Avg: 3150.41 / Max: 3904Min: 800 / Avg: 2829.36 / Max: 3513Min: 800 / Avg: 2693.5 / Max: 3506

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41 / Avg: 55.93 / Max: 59Min: 42 / Avg: 49.55 / Max: 52Min: 38 / Avg: 52.66 / Max: 56Min: 39 / Avg: 49.89 / Max: 52

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 206.74 / Avg: 658.37 / Max: 772.16Min: 105.27 / Avg: 509.17 / Max: 614.46Min: 138.57 / Avg: 658.34 / Max: 759.74Min: 140.85 / Avg: 607.89 / Max: 662.55

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2666.29 / Max: 3914Min: 800 / Avg: 3132.4 / Max: 3904Min: 800 / Avg: 2573.11 / Max: 3516Min: 800 / Avg: 2659.67 / Max: 3511

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41 / Avg: 56.83 / Max: 60Min: 42 / Avg: 57.82 / Max: 61Min: 38 / Avg: 53.14 / Max: 56Min: 38 / Avg: 52.54 / Max: 56

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 171.5 / Avg: 663.12 / Max: 746.34Min: 206.5 / Avg: 658.68 / Max: 774.35Min: 134.97 / Avg: 663.13 / Max: 754.59Min: 142.04 / Avg: 656.81 / Max: 744.88

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2890.31 / Max: 3904Min: 800 / Avg: 2629.98 / Max: 3905Min: 800 / Avg: 2813.17 / Max: 3514Min: 800 / Avg: 2457.57 / Max: 3510

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41 / Avg: 56.04 / Max: 60Min: 42 / Avg: 56.39 / Max: 61Min: 38 / Avg: 51.96 / Max: 56Min: 38 / Avg: 52.29 / Max: 56

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.9 / Avg: 657.33 / Max: 762.02Min: 206.59 / Avg: 645.49 / Max: 767.1Min: 146.73 / Avg: 654.43 / Max: 756.6Min: 143.35 / Avg: 648.95 / Max: 765.36

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2825.64 / Max: 3908Min: 800 / Avg: 2526.74 / Max: 3905Min: 800 / Avg: 2849.9 / Max: 3513Min: 800 / Avg: 2456.27 / Max: 3513

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41 / Avg: 57.06 / Max: 60Min: 43 / Avg: 57.32 / Max: 60Min: 38 / Avg: 53.43 / Max: 57Min: 38 / Avg: 53.03 / Max: 56

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 206.69 / Avg: 658.1 / Max: 752.9Min: 206.84 / Avg: 657.97 / Max: 768.07Min: 142.53 / Avg: 658.62 / Max: 757.75Min: 143.5 / Avg: 657.41 / Max: 756.56

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2931.15 / Max: 3905Min: 800 / Avg: 2316.34 / Max: 3904Min: 800 / Avg: 2808.93 / Max: 3508Min: 800 / Avg: 2252.6 / Max: 3510

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41 / Avg: 55.93 / Max: 60Min: 42 / Avg: 56.51 / Max: 60Min: 38 / Avg: 51.99 / Max: 56Min: 38 / Avg: 52.23 / Max: 55

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.71 / Avg: 648.21 / Max: 747.87Min: 206.4 / Avg: 652.53 / Max: 745.49Min: 139.64 / Avg: 650.58 / Max: 751.9Min: 139.19 / Avg: 654.14 / Max: 728.45

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2833.67 / Max: 3907Min: 800 / Avg: 2755.35 / Max: 3904Min: 800 / Avg: 2690.93 / Max: 3512Min: 800 / Avg: 2778.23 / Max: 3515

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 40 / Avg: 55.71 / Max: 59Min: 42 / Avg: 56.42 / Max: 60Min: 37 / Avg: 52.28 / Max: 56Min: 38 / Avg: 52.67 / Max: 57

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.89 / Avg: 649.79 / Max: 759.52Min: 206.86 / Avg: 651.28 / Max: 757.99Min: 143.33 / Avg: 649.87 / Max: 762.66Min: 138.92 / Avg: 650.5 / Max: 760.41

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2654.51 / Max: 3908Min: 800 / Avg: 2552.5 / Max: 3909Min: 800 / Avg: 2542 / Max: 3511Min: 800 / Avg: 2452.95 / Max: 3510

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 40 / Avg: 56.4 / Max: 60Min: 41 / Avg: 56.75 / Max: 60Min: 38 / Avg: 53.64 / Max: 57Min: 38 / Avg: 52.94 / Max: 56

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 206.93 / Avg: 656.65 / Max: 755.73Min: 206.88 / Avg: 654.08 / Max: 774.62Min: 141.2 / Avg: 657.6 / Max: 757.38Min: 138.22 / Avg: 655.8 / Max: 757.3

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2937.64 / Max: 3910Min: 800 / Avg: 2523.87 / Max: 3907Min: 800 / Avg: 2890.23 / Max: 3515Min: 800 / Avg: 2335.95 / Max: 3514

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41 / Avg: 56.79 / Max: 60Min: 41 / Avg: 57.39 / Max: 61Min: 38 / Avg: 53.49 / Max: 57Min: 39 / Avg: 53.16 / Max: 57

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.6 / Avg: 658.75 / Max: 757.12Min: 206.16 / Avg: 658.43 / Max: 764.17Min: 140.04 / Avg: 656.62 / Max: 757.38Min: 141.93 / Avg: 659.08 / Max: 758.69

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2912.9 / Max: 3907Min: 800 / Avg: 2334.49 / Max: 3904Min: 800 / Avg: 2823.12 / Max: 3513Min: 800 / Avg: 2246.35 / Max: 3510

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41 / Avg: 56.01 / Max: 59Min: 42 / Avg: 56.5 / Max: 60Min: 37 / Avg: 52.7 / Max: 56Min: 38 / Avg: 52.42 / Max: 56

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 205.91 / Avg: 656.76 / Max: 757.26Min: 206.26 / Avg: 655.74 / Max: 760.38Min: 135.14 / Avg: 659.58 / Max: 759.65Min: 138.9 / Avg: 656.7 / Max: 754.94

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2584.05 / Max: 3907Min: 800 / Avg: 2369.5 / Max: 3907Min: 800 / Avg: 2466.01 / Max: 3511Min: 800 / Avg: 2588.47 / Max: 3509

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41 / Avg: 56.23 / Max: 60Min: 41 / Avg: 56.66 / Max: 60Min: 37 / Avg: 52.15 / Max: 56Min: 38 / Avg: 52.34 / Max: 55

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 106.14 / Avg: 660.56 / Max: 759.78Min: 207.03 / Avg: 658.56 / Max: 763.43Min: 137.8 / Avg: 658.35 / Max: 760.45Min: 142.57 / Avg: 656.98 / Max: 759.7

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2429.46 / Max: 3910Min: 800 / Avg: 2692.65 / Max: 3912Min: 800 / Avg: 2446.61 / Max: 3509Min: 800 / Avg: 2705.88 / Max: 3511

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41 / Avg: 56 / Max: 59Min: 41 / Avg: 56.27 / Max: 59Min: 36 / Avg: 51.8 / Max: 55Min: 37 / Avg: 52.35 / Max: 56

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 206.57 / Avg: 657.51 / Max: 759.7Min: 206.34 / Avg: 657.43 / Max: 769.68Min: 140.27 / Avg: 658.37 / Max: 759.99Min: 140.31 / Avg: 657.79 / Max: 763.65

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2474.34 / Max: 3904Min: 800 / Avg: 2432.9 / Max: 3905Min: 800 / Avg: 2409.05 / Max: 3512Min: 800 / Avg: 2364.74 / Max: 3512

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41 / Avg: 56.46 / Max: 61Min: 42 / Avg: 55.99 / Max: 61Min: 38 / Avg: 52.8 / Max: 57Min: 38 / Avg: 51.9 / Max: 56

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.98 / Avg: 649.9 / Max: 748.52Min: 206.57 / Avg: 636.48 / Max: 766.86Min: 141.8 / Avg: 646.72 / Max: 748.88Min: 134.08 / Avg: 637.97 / Max: 751.47

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2956.05 / Max: 3907Min: 800 / Avg: 2675.48 / Max: 3909Min: 800 / Avg: 2900.67 / Max: 3511Min: 800 / Avg: 2524.72 / Max: 3512

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 40 / Avg: 56.14 / Max: 60Min: 42 / Avg: 56.43 / Max: 60Min: 37 / Avg: 51.81 / Max: 55Min: 38 / Avg: 52.28 / Max: 55

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 206.55 / Avg: 660.54 / Max: 758.96Min: 205.98 / Avg: 660.76 / Max: 798.87Min: 134.79 / Avg: 660.58 / Max: 760.14Min: 134.39 / Avg: 662.15 / Max: 766.17

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2534.47 / Max: 3911Min: 800 / Avg: 2496.49 / Max: 3905Min: 800 / Avg: 2440.06 / Max: 3509Min: 800 / Avg: 2499.4 / Max: 3510

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 40 / Avg: 55.88 / Max: 59Min: 42 / Avg: 56.49 / Max: 60Min: 37 / Avg: 52.1 / Max: 56Min: 38 / Avg: 51.96 / Max: 55

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On160320480640800Min: 206.81 / Avg: 652 / Max: 753.73Min: 206.53 / Avg: 652.32 / Max: 894.8Min: 139.22 / Avg: 651.89 / Max: 746.8Min: 141.18 / Avg: 652.91 / Max: 759.25

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2830.49 / Max: 3910Min: 800 / Avg: 2545.34 / Max: 3903Min: 800 / Avg: 2785.33 / Max: 3510Min: 800 / Avg: 2808.74 / Max: 3515

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 40 / Avg: 55.35 / Max: 60Min: 41 / Avg: 56.47 / Max: 60Min: 37 / Avg: 51.8 / Max: 55Min: 38 / Avg: 51.7 / Max: 55

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 206.66 / Avg: 653.75 / Max: 749.75Min: 206.85 / Avg: 654.25 / Max: 835.93Min: 141.92 / Avg: 655.28 / Max: 742.22Min: 144.78 / Avg: 657.22 / Max: 758.3

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2892 / Max: 3908Min: 800 / Avg: 2567.68 / Max: 3908Min: 800 / Avg: 2904.53 / Max: 3509Min: 800 / Avg: 2822.65 / Max: 3514

OpenVINO

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 37 / Avg: 54.55 / Max: 60Min: 38 / Avg: 55.73 / Max: 60Min: 35 / Avg: 51.37 / Max: 57Min: 36 / Avg: 51.42 / Max: 56

OpenVINO

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 206.75 / Avg: 643.09 / Max: 735.29Min: 103.58 / Avg: 645.19 / Max: 824.86Min: 143.98 / Avg: 644.15 / Max: 745.46Min: 144.55 / Avg: 649.2 / Max: 755.85

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3007.46 / Max: 3907Min: 800 / Avg: 2665.33 / Max: 3908Min: 800 / Avg: 2872.4 / Max: 3515Min: 800 / Avg: 2489.2 / Max: 3512

TensorFlow

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.12CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 37 / Avg: 45.48 / Max: 50Min: 37 / Avg: 46.02 / Max: 51Min: 34 / Avg: 45.2 / Max: 50Min: 34 / Avg: 45.35 / Max: 49

TensorFlow

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.12CPU Power Consumption MonitorAVX-512 OffAVX-512 On110220330440550Min: 206.82 / Avg: 480.23 / Max: 511.44Min: 207.18 / Avg: 476.86 / Max: 531.76Min: 133.72 / Avg: 541.03 / Max: 580.13Min: 144.3 / Avg: 549.53 / Max: 606.11

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3787.56 / Max: 3910Min: 800 / Avg: 3711.35 / Max: 3906Min: 800 / Avg: 3214.95 / Max: 3515Min: 800 / Avg: 3056.82 / Max: 3509

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

Emerald RapidsSapphire RapidsOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OffAVX-512 On0.04610.09220.13830.18440.23050.1380.2050.1260.188

TensorFlow

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.12CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 36 / Avg: 43.72 / Max: 47Min: 37 / Avg: 43.39 / Max: 46Min: 33 / Avg: 42.52 / Max: 45Min: 34 / Avg: 42.48 / Max: 47

TensorFlow

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.12CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 206.73 / Avg: 448.87 / Max: 498.3Min: 206.81 / Avg: 437.84 / Max: 494.79Min: 83.76 / Avg: 510.59 / Max: 556.63Min: 133.66 / Avg: 507.68 / Max: 568.58

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3797.09 / Max: 3912Min: 800 / Avg: 3656.93 / Max: 3909Min: 800 / Avg: 3205.24 / Max: 3500Min: 800 / Avg: 3011.19 / Max: 3516

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

Emerald RapidsSapphire RapidsOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 32 - Model: ResNet-50AVX-512 OffAVX-512 On0.0380.0760.1140.1520.190.1190.1650.1130.169

TensorFlow

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.12CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 39 / Avg: 43.01 / Max: 49Min: 39 / Avg: 43.36 / Max: 45Min: 37 / Avg: 41.93 / Max: 46Min: 37 / Avg: 41.69 / Max: 44

TensorFlow

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.12CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 206.9 / Avg: 413.92 / Max: 462.77Min: 170.32 / Avg: 398.6 / Max: 450.75Min: 145.05 / Avg: 485.57 / Max: 544.2Min: 135.2 / Avg: 467.02 / Max: 544.28

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3778.53 / Max: 3909Min: 800 / Avg: 3719.28 / Max: 3912Min: 800 / Avg: 3199.12 / Max: 3515Min: 800 / Avg: 3179.69 / Max: 3508

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

Emerald RapidsSapphire RapidsOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OffAVX-512 On0.0320.0640.0960.1280.160.0940.1240.0970.142

OSPRay Studio

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 39 / Avg: 53.61 / Max: 60Min: 41 / Avg: 54.83 / Max: 60Min: 37 / Avg: 50.92 / Max: 57Min: 37 / Avg: 50.81 / Max: 56

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.63 / Avg: 608.46 / Max: 765.39Min: 206.71 / Avg: 617.43 / Max: 757Min: 142.4 / Avg: 606.92 / Max: 759.82Min: 133.08 / Avg: 619.07 / Max: 759.61

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2909.62 / Max: 3904Min: 800 / Avg: 2900.24 / Max: 3908Min: 800 / Avg: 2893.76 / Max: 3515Min: 800 / Avg: 2806.99 / Max: 3507

OSPRay Studio

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 39 / Avg: 52.8 / Max: 59Min: 41 / Avg: 54.44 / Max: 60Min: 37 / Avg: 50.95 / Max: 57Min: 37 / Avg: 50.46 / Max: 56

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.67 / Avg: 597.45 / Max: 757.34Min: 207.14 / Avg: 607.98 / Max: 755.1Min: 147.42 / Avg: 608 / Max: 759.43Min: 142 / Avg: 611.56 / Max: 759.31

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2897.48 / Max: 3904Min: 800 / Avg: 2897.66 / Max: 3904Min: 800 / Avg: 2863.77 / Max: 3508Min: 800 / Avg: 2842.13 / Max: 3513

OSPRay Studio

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 39 / Avg: 53.47 / Max: 59Min: 40 / Avg: 54.65 / Max: 60Min: 38 / Avg: 51.41 / Max: 57Min: 37 / Avg: 50.95 / Max: 57

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 207.16 / Avg: 607.3 / Max: 756.05Min: 206.52 / Avg: 611.84 / Max: 754.94Min: 139.96 / Avg: 617.36 / Max: 759.01Min: 139.81 / Avg: 620.45 / Max: 760.44

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2863.16 / Max: 3903Min: 800 / Avg: 2907.46 / Max: 3904Min: 800 / Avg: 2861.55 / Max: 3512Min: 800 / Avg: 2805.89 / Max: 3503

OSPRay Studio

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 38 / Avg: 52.7 / Max: 59Min: 41 / Avg: 54.26 / Max: 60Min: 38 / Avg: 51.02 / Max: 57Min: 37 / Avg: 50 / Max: 56

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.92 / Avg: 595.58 / Max: 740.41Min: 207.21 / Avg: 604.78 / Max: 754.51Min: 144.87 / Avg: 607.3 / Max: 759.23Min: 144.54 / Avg: 607.87 / Max: 759.8

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2892.35 / Max: 3905Min: 800 / Avg: 2958.37 / Max: 3904Min: 800 / Avg: 2884.44 / Max: 3508Min: 800 / Avg: 2852.98 / Max: 3501

OSPRay Studio

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 39 / Avg: 52.07 / Max: 59Min: 41 / Avg: 54.4 / Max: 60Min: 37 / Avg: 51.34 / Max: 57Min: 37 / Avg: 50.46 / Max: 56

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 148.8 / Avg: 569.63 / Max: 723.58Min: 207.07 / Avg: 607.95 / Max: 755.36Min: 144.32 / Avg: 611.95 / Max: 753.73Min: 139.84 / Avg: 612.34 / Max: 754.59

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 500 / Avg: 2883.43 / Max: 3904Min: 800 / Avg: 2918.01 / Max: 3904Min: 800 / Avg: 2879.74 / Max: 3503Min: 800 / Avg: 2867.16 / Max: 3507

OSPRay Studio

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 38 / Avg: 52.16 / Max: 59Min: 40 / Avg: 53.82 / Max: 60Min: 36 / Avg: 50.91 / Max: 57Min: 36 / Avg: 49.85 / Max: 56

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 207.17 / Avg: 588.7 / Max: 754.39Min: 207.24 / Avg: 601.24 / Max: 748.86Min: 141.14 / Avg: 609.71 / Max: 751.36Min: 136.35 / Avg: 609.29 / Max: 755.63

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2911.78 / Max: 3908Min: 800 / Avg: 2951.28 / Max: 3909Min: 800 / Avg: 2895.53 / Max: 3513Min: 800 / Avg: 2860.68 / Max: 3508

OSPRay Studio

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 39 / Avg: 49.75 / Max: 57Min: 41 / Avg: 49.81 / Max: 57Min: 37 / Avg: 48.42 / Max: 55Min: 37 / Avg: 46.82 / Max: 53

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 200.01 / Avg: 543.95 / Max: 744.29Min: 207.24 / Avg: 524.7 / Max: 756.03Min: 144.19 / Avg: 568.1 / Max: 759.38Min: 130.86 / Avg: 555.85 / Max: 759.56

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2986.32 / Max: 3905Min: 800 / Avg: 3036.33 / Max: 3904Min: 800 / Avg: 2969.61 / Max: 3515Min: 800 / Avg: 2910.39 / Max: 3509

OSPRay Studio

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 39 / Avg: 52.4 / Max: 59Min: 40 / Avg: 55.23 / Max: 60Min: 37 / Avg: 50.57 / Max: 57Min: 36 / Avg: 48.42 / Max: 55

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 124.93 / Avg: 583.37 / Max: 757.25Min: 146.85 / Avg: 620.07 / Max: 762.64Min: 146.6 / Avg: 598.52 / Max: 758.88Min: 137.59 / Avg: 587.3 / Max: 760.63

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2959.45 / Max: 3908Min: 800 / Avg: 2852.57 / Max: 3908Min: 800 / Avg: 2890.48 / Max: 3509Min: 800 / Avg: 2839.81 / Max: 3512

OSPRay Studio

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 40 / Avg: 49.28 / Max: 57Min: 40 / Avg: 54.1 / Max: 60Min: 38 / Avg: 48.12 / Max: 55Min: 37 / Avg: 46.03 / Max: 53

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.91 / Avg: 527.9 / Max: 734.93Min: 148.13 / Avg: 611.69 / Max: 755.87Min: 147.32 / Avg: 554.56 / Max: 759.36Min: 142.52 / Avg: 540.07 / Max: 762.44

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3089.22 / Max: 3904Min: 800 / Avg: 2818.6 / Max: 3903Min: 800 / Avg: 2936.5 / Max: 3509Min: 800 / Avg: 2898.85 / Max: 3501

OSPRay Studio

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 39 / Avg: 54.76 / Max: 60Min: 41 / Avg: 52.42 / Max: 59Min: 37 / Avg: 49.91 / Max: 56Min: 36 / Avg: 51.11 / Max: 56

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.89 / Avg: 620.27 / Max: 751.57Min: 207.14 / Avg: 582.01 / Max: 756.24Min: 143.91 / Avg: 587.53 / Max: 760.59Min: 141.11 / Avg: 624.47 / Max: 765.04

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2854.58 / Max: 3904Min: 800 / Avg: 2984.18 / Max: 3906Min: 800 / Avg: 2899.72 / Max: 3511Min: 800 / Avg: 2759.25 / Max: 3516

OSPRay Studio

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 39 / Avg: 51.38 / Max: 59Min: 39 / Avg: 52.36 / Max: 59Min: 37 / Avg: 49.96 / Max: 57Min: 36 / Avg: 48.71 / Max: 54

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.89 / Avg: 569.32 / Max: 725.89Min: 206.82 / Avg: 583.69 / Max: 755.21Min: 143.11 / Avg: 590.62 / Max: 754.02Min: 139.08 / Avg: 591.27 / Max: 757.85

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3008.77 / Max: 3904Min: 800 / Avg: 2999.39 / Max: 3906Min: 800 / Avg: 2934.05 / Max: 3501Min: 800 / Avg: 2894.68 / Max: 3510

OSPRay Studio

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 39 / Avg: 51.01 / Max: 59Min: 39 / Avg: 52.09 / Max: 59Min: 37 / Avg: 49.82 / Max: 57Min: 35 / Avg: 48.28 / Max: 54

OSPRay Studio

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.7 / Avg: 571.85 / Max: 720.32Min: 144.81 / Avg: 586.48 / Max: 752.83Min: 143.22 / Avg: 588.6 / Max: 751.82Min: 124.77 / Avg: 593.3 / Max: 756.49

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2954.22 / Max: 3907Min: 800 / Avg: 2996.59 / Max: 3908Min: 800 / Avg: 2906.5 / Max: 3502Min: 800 / Avg: 2870.25 / Max: 3511

oneDNN

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.3CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 35 / Avg: 52.63 / Max: 57Min: 35 / Avg: 52.1 / Max: 59Min: 38 / Avg: 50.66 / Max: 54Min: 36 / Avg: 47.82 / Max: 52

oneDNN

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 104.84 / Avg: 561.81 / Max: 756.79Min: 206.56 / Avg: 535.79 / Max: 754.55Min: 131.29 / Avg: 591.96 / Max: 755.76Min: 123.9 / Avg: 567.66 / Max: 734.19

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2951.28 / Max: 3906Min: 800 / Avg: 2962.65 / Max: 3907Min: 800 / Avg: 2857.85 / Max: 3512Min: 800 / Avg: 2905.96 / Max: 3509

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

Emerald RapidsSapphire RapidsOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OffAVX-512 On5001000150020002500SE +/- 54.32, N = 15SE +/- 31.97, N = 15SE +/- 6.64, N = 3SE +/- 10.80, N = 32341.141331.74896.53830.961. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Y-Cruncher

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.2CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 38 / Avg: 41.46 / Max: 47Min: 37 / Avg: 40.47 / Max: 46Min: 36 / Avg: 40.27 / Max: 47Min: 34 / Avg: 37.36 / Max: 43

Y-Cruncher

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.2CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.39 / Avg: 359.32 / Max: 686.83Min: 206.15 / Avg: 336.26 / Max: 671.34Min: 137.49 / Avg: 371.75 / Max: 732.24Min: 133.05 / Avg: 353.03 / Max: 753.25

Y-Cruncher

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3313.53 / Max: 3907Min: 800 / Avg: 3445.48 / Max: 3908Min: 800 / Avg: 2852.57 / Max: 3515Min: 800 / Avg: 2850.7 / Max: 3510

Y-Cruncher

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.2CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 37 / Avg: 49.71 / Max: 57Min: 37 / Avg: 48.55 / Max: 55Min: 34 / Avg: 47.63 / Max: 55Min: 32 / Avg: 44.12 / Max: 51

Y-Cruncher

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.2CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.72 / Avg: 566.95 / Max: 745.43Min: 144.38 / Avg: 545.54 / Max: 739.45Min: 139.38 / Avg: 575.38 / Max: 737.4Min: 137.75 / Avg: 556.06 / Max: 742.94

Y-Cruncher

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2895.61 / Max: 3907Min: 800 / Avg: 2830.68 / Max: 3904Min: 800 / Avg: 2783.21 / Max: 3509Min: 800 / Avg: 2736.78 / Max: 3509

Y-Cruncher

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.2CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 40 / Avg: 44.62 / Max: 49Min: 41 / Avg: 44.12 / Max: 50Min: 37 / Avg: 42.99 / Max: 49Min: 36 / Avg: 40.69 / Max: 47

Y-Cruncher

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.2CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 103.71 / Avg: 430.76 / Max: 715.25Min: 204.3 / Avg: 399.57 / Max: 725.27Min: 134.09 / Avg: 451.69 / Max: 736.59Min: 139.77 / Avg: 425.32 / Max: 750.74

Y-Cruncher

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3268.42 / Max: 3908Min: 800 / Avg: 3155.23 / Max: 3908Min: 800 / Avg: 2846.32 / Max: 3512Min: 800 / Avg: 2798.17 / Max: 3511

OSPRay

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.12CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 40 / Avg: 51.3 / Max: 55Min: 41 / Avg: 52.31 / Max: 57Min: 38 / Avg: 50.91 / Max: 54Min: 38 / Avg: 50.81 / Max: 54

OSPRay

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.12CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 206.42 / Avg: 572.92 / Max: 683.35Min: 187.87 / Avg: 596.54 / Max: 711.75Min: 130.09 / Avg: 616.55 / Max: 735.34Min: 129.23 / Avg: 635.29 / Max: 759.02

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3027.44 / Max: 3910Min: 800 / Avg: 3011.05 / Max: 3904Min: 800 / Avg: 2944.84 / Max: 3510Min: 800 / Avg: 2962.97 / Max: 3510

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On0.00650.0130.01950.0260.03250.0180.0290.0150.024

OSPRay

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.12CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41 / Avg: 50.57 / Max: 56Min: 41 / Avg: 55.91 / Max: 60Min: 38 / Avg: 52.29 / Max: 57Min: 37 / Avg: 51.63 / Max: 56

OSPRay

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.12CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 200.25 / Avg: 530.92 / Max: 639.95Min: 199.86 / Avg: 642.78 / Max: 757.23Min: 134.53 / Avg: 625.67 / Max: 751Min: 140.03 / Avg: 641.68 / Max: 741.33

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 2860.32 / Max: 3908Min: 800 / Avg: 2789.09 / Max: 3900Min: 800 / Avg: 2856.21 / Max: 3506Min: 800 / Avg: 2633.09 / Max: 3514

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On0.01460.02920.04380.05840.0730.0390.0650.0360.055

OSPRay

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.12CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 40 / Avg: 53.64 / Max: 58Min: 41 / Avg: 55.75 / Max: 60Min: 36 / Avg: 51.78 / Max: 57Min: 34 / Avg: 50.89 / Max: 55

OSPRay

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.12CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 199.85 / Avg: 565.77 / Max: 674.64Min: 206.8 / Avg: 642.59 / Max: 756.55Min: 132.38 / Avg: 625.29 / Max: 749.25Min: 135.38 / Avg: 645.46 / Max: 744.99

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2187 / Avg: 3001.49 / Max: 3907Min: 800 / Avg: 2821.53 / Max: 3907Min: 800 / Avg: 2909.36 / Max: 3509Min: 800 / Avg: 2650.94 / Max: 3510

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On0.01490.02980.04470.05960.07450.0410.0660.0380.056

OpenVKL

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVKL 2.0.0CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 36 / Avg: 54.42 / Max: 60Min: 35 / Avg: 56.19 / Max: 61Min: 34 / Avg: 54.24 / Max: 60Min: 30 / Avg: 51.4 / Max: 57

OpenVKL

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 2.0.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 105.27 / Avg: 607.73 / Max: 758.79Min: 199.73 / Avg: 636.08 / Max: 754.77Min: 134.89 / Avg: 642.1 / Max: 759.51Min: 123.79 / Avg: 635.31 / Max: 760.66

OpenVKL

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVKL 2.0.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 500 / Avg: 2909.25 / Max: 3917Min: 800 / Avg: 2934.37 / Max: 3913Min: 800 / Avg: 2872.62 / Max: 3515Min: 500 / Avg: 2843.9 / Max: 3519

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

Emerald RapidsSapphire RapidsOpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 OffAVX-512 On1.1482.2963.4444.5925.743.8925.1023.3564.258

Embree

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 36 / Avg: 39.76 / Max: 48Min: 36 / Avg: 39.47 / Max: 47Min: 34 / Avg: 39.36 / Max: 47Min: 32 / Avg: 36.48 / Max: 43

Embree

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 183.81 / Avg: 349.88 / Max: 758.31Min: 183.04 / Avg: 330.48 / Max: 754.13Min: 131.13 / Avg: 409.32 / Max: 758.21Min: 75.9 / Avg: 408.93 / Max: 760.89

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3421.05 / Max: 3905Min: 800 / Avg: 3461.42 / Max: 3907Min: 800 / Avg: 3185.08 / Max: 3509Min: 800 / Avg: 3012.02 / Max: 3509

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OffAVX-512 On0.11880.23760.35640.47520.5940.4560.5280.2990.322

Embree

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 38 / Avg: 44.58 / Max: 51Min: 39 / Avg: 45.09 / Max: 50Min: 36 / Avg: 43.21 / Max: 49Min: 33 / Avg: 39.8 / Max: 45

Embree

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 198.42 / Avg: 451.72 / Max: 751.32Min: 99.6 / Avg: 443.11 / Max: 753.55Min: 121.15 / Avg: 469.47 / Max: 759.39Min: 124.87 / Avg: 459.53 / Max: 760.23

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3148.94 / Max: 3908Min: 800 / Avg: 2950.63 / Max: 3901Min: 800 / Avg: 2689.74 / Max: 3510Min: 800 / Avg: 2815.76 / Max: 3509

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On0.10190.20380.30570.40760.50950.4030.4530.3010.332

Embree

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 40 / Avg: 47.23 / Max: 53Min: 41 / Avg: 47.38 / Max: 53Min: 38 / Avg: 46.37 / Max: 52Min: 35 / Avg: 42.8 / Max: 48

Embree

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 199.01 / Avg: 478.95 / Max: 719.96Min: 195.35 / Avg: 478.68 / Max: 755.09Min: 125.62 / Avg: 487.84 / Max: 740.05Min: 123.86 / Avg: 478.02 / Max: 740.13

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3111.22 / Max: 3908Min: 800 / Avg: 2827.67 / Max: 3901Min: 800 / Avg: 2838.46 / Max: 3512Min: 800 / Avg: 2856.35 / Max: 3512

Embree

Binary: Pathtracer ISPC - Model: Crown

Emerald RapidsSapphire RapidsOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On0.07110.14220.21330.28440.35550.2860.3160.2320.260

miniBUDE

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 35 / Avg: 55.67 / Max: 63Min: 36 / Avg: 54.58 / Max: 63Min: 33 / Avg: 48.15 / Max: 54Min: 28 / Avg: 43.53 / Max: 50

miniBUDE

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 196.96 / Avg: 634.15 / Max: 758.15Min: 196.6 / Avg: 621.22 / Max: 756.81Min: 140.54 / Avg: 574.74 / Max: 757.06Min: 130.7 / Avg: 569.31 / Max: 758.19

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 800 / Avg: 2958.53 / Max: 3904Min: 800 / Avg: 2947.32 / Max: 3907Min: 800 / Avg: 2971.88 / Max: 5743Min: 800 / Avg: 3062.99 / Max: 3509

miniBUDE

Implementation: OpenMP - Input Deck: BM2

Emerald RapidsSapphire RapidsOpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On0.0720.1440.2160.2880.360.1960.3200.1540.244

miniBUDE

CPU Temperature Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 29 / Avg: 42.38 / Max: 50Min: 30 / Avg: 40.48 / Max: 49Min: 25 / Avg: 39.7 / Max: 48Min: 22 / Avg: 34.39 / Max: 42

miniBUDE

CPU Power Consumption Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 195.99 / Avg: 489.71 / Max: 754.91Min: 196.51 / Avg: 442.58 / Max: 756.34Min: 67.03 / Avg: 516.75 / Max: 712.97Min: 125.76 / Avg: 450.59 / Max: 685.74

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Emerald RapidsSapphire RapidsOpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 800 / Avg: 3050.88 / Max: 3906Min: 800 / Avg: 2998.12 / Max: 3905Min: 800 / Avg: 2871.1 / Max: 3512Min: 800 / Avg: 2822.27 / Max: 3508

miniBUDE

Implementation: OpenMP - Input Deck: BM1

Emerald RapidsSapphire RapidsOpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On0.1080.2160.3240.4320.540.2770.4800.1620.303

Phoronix Test Suite v10.8.5