Intel 5th Gen Xeon AVX-512 Comparison

2 x INTEL XEON PLATINUM 8592 AVX-512 Emerald Rapids vs. Sapphire Rapids by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2312146-NE-INTELAVX523&rdt.

ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSapphire RapidsEmerald Rapids AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)Intel Device 1bce1008GB3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Intel X710 for 10GBASE-TUbuntu 23.106.5.0-13-generic (x86_64)GCC 13.2.0ext41920x10802 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads)Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Sapphire Rapids: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0004d0- Sapphire Rapids: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0004d0- Emerald Rapids: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000161- Emerald Rapids: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000161Python Details- Python 3.11.6Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

minibude: OpenMP - BM1minibude: OpenMP - BM1minibude: OpenMP - BM2minibude: OpenMP - BM2embree: Pathtracer ISPC - Crownembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objopenvkl: vklBenchmarkCPU ISPCospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timey-cruncher: 1By-cruncher: 5By-cruncher: 500Monednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUospray-studio: 1 - 4K - 1 - Path Tracer - CPUospray-studio: 3 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 16 - Path Tracer - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUospray-studio: 1 - 1080p - 1 - Path Tracer - CPUospray-studio: 3 - 1080p - 1 - Path Tracer - CPUospray-studio: 1 - 1080p - 16 - Path Tracer - CPUospray-studio: 1 - 1080p - 32 - Path Tracer - CPUospray-studio: 3 - 1080p - 16 - Path Tracer - CPUospray-studio: 3 - 1080p - 32 - Path Tracer - CPUtensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 64 - ResNet-50openvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUSapphire RapidsEmerald Rapids AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off3418.575136.7433466.394138.656124.0863152.5351131.8466270535.888235.243215.08324.91428.6042.293830.959889106214054330261679638483226268354570894231845766.1885.64103.28218.62137.09637.7347.01637.7847.003887.307.70412.86290.1514944.268.021528.7319.605759.7120.7326917.014.3820980.695.711894.4963.27742.5140.1947113.292.537556.5215.764381.7527.33144820.350.37151891.460.292090.44583.6182214.18288.567113.1300141.1111122.3348215523.658522.52119.225216.33836.6372.907896.5291035122616486383091960444460263309416683264917993447.2257.8468.4221.891355.33214.94139.44213.06140.641749.9817.1285.02352.086859.8617.46923.4732.453688.3232.512463.9848.4813852.888.651645.0372.89212.63140.688773.9813.662564.0911.691075.65111.6365805.381.75129576.780.575313.366212.5354975.695199.028151.4667200.9029174.3843324542.654541.610917.04095.23327.0582.7541331.7474988612125238251434532723189223301760533574714649.2672.0697.85236.14135.37747.4942.76747.7742.744765.956.69538.27237.3618384.836.951884.9916.958921.9714.3332234.043.9324769.105.152389.5553.511097.8229.0749132.992.4410161.3112.555105.9524.87114369.660.46123447.740.43392.568135.7033112.005124.480137.6227181.8347159.4832236523.410020.937410.566746.54033.6803.1092341.14893105514257336031715138787225279358572184242859639.0653.6066.0824.671287.11238.22134.18237.77134.442116.6415.1094.57337.698208.8815.581159.9327.564277.3129.912822.7145.3215101.298.461882.9767.93276.63115.359439.9213.552988.9110.691166.18109.7563672.971.7101244.000.63OpenBenchmarking.org

miniBUDE

Implementation: OpenMP - Input Deck: BM1

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OnAVX-512 Off11002200330044005500SE +/- 12.90, N = 7SE +/- 17.21, N = 5SE +/- 3.87, N = 8SE +/- 0.74, N = 73418.582090.455313.373392.571. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OnAVX-512 Off50100150200250SE +/- 0.52, N = 7SE +/- 0.69, N = 5SE +/- 0.15, N = 8SE +/- 0.03, N = 7136.7483.62212.54135.701. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OnAVX-512 Off0.1080.2160.3240.4320.540.3030.1620.4800.277

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2822.27 / Max: 3508Min: 800 / Avg: 2871.1 / Max: 3512Min: 800 / Avg: 2998.12 / Max: 3905Min: 800 / Avg: 3050.88 / Max: 3906

miniBUDE

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 125.76 / Avg: 450.59 / Max: 685.74Min: 67.03 / Avg: 516.75 / Max: 712.97Min: 196.51 / Avg: 442.58 / Max: 756.34Min: 195.99 / Avg: 489.71 / Max: 754.91

miniBUDE

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 22 / Avg: 34.39 / Max: 42Min: 25 / Avg: 39.7 / Max: 48Min: 30 / Avg: 40.48 / Max: 49Min: 29 / Avg: 42.38 / Max: 50

miniBUDE

Implementation: OpenMP - Input Deck: BM2

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OnAVX-512 Off11002200330044005500SE +/- 17.85, N = 3SE +/- 5.42, N = 3SE +/- 49.58, N = 15SE +/- 24.22, N = 153466.392214.184975.703112.011. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OnAVX-512 Off4080120160200SE +/- 0.71, N = 3SE +/- 0.22, N = 3SE +/- 1.98, N = 15SE +/- 0.97, N = 15138.6688.57199.03124.481. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OnAVX-512 Off0.0720.1440.2160.2880.360.2440.1540.3200.196

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 800 / Avg: 3062.99 / Max: 3509Min: 800 / Avg: 2971.88 / Max: 5743Min: 800 / Avg: 2947.32 / Max: 3907Min: 800 / Avg: 2958.53 / Max: 3904

miniBUDE

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 130.7 / Avg: 569.31 / Max: 758.19Min: 140.54 / Avg: 574.74 / Max: 757.06Min: 196.6 / Avg: 621.22 / Max: 756.81Min: 196.96 / Avg: 634.15 / Max: 758.15

miniBUDE

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 28 / Avg: 43.53 / Max: 50Min: 33 / Avg: 48.15 / Max: 54Min: 36 / Avg: 54.58 / Max: 63Min: 35 / Avg: 55.67 / Max: 63

Embree

Binary: Pathtracer ISPC - Model: Crown

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 OnAVX-512 Off306090120150SE +/- 0.36, N = 6SE +/- 0.27, N = 6SE +/- 0.55, N = 7SE +/- 0.23, N = 7124.09113.13151.47137.62

Embree

Binary: Pathtracer ISPC - Model: Crown

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 OnAVX-512 Off0.07110.14220.21330.28440.35550.2600.2320.3160.286

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2856.35 / Max: 3512Min: 800 / Avg: 2838.46 / Max: 3512Min: 800 / Avg: 2827.67 / Max: 3901Min: 800 / Avg: 3111.22 / Max: 3908

Embree

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 123.86 / Avg: 478.02 / Max: 740.13Min: 125.62 / Avg: 487.84 / Max: 740.05Min: 195.35 / Avg: 478.68 / Max: 755.09Min: 199.01 / Avg: 478.95 / Max: 719.96

Embree

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OnAVX-512 Off1122334455Min: 35 / Avg: 42.8 / Max: 48Min: 38 / Avg: 46.37 / Max: 52Min: 41 / Avg: 47.38 / Max: 53Min: 40 / Avg: 47.23 / Max: 53

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OnAVX-512 Off4080120160200SE +/- 0.33, N = 7SE +/- 0.22, N = 7SE +/- 0.38, N = 8SE +/- 0.30, N = 7152.54141.11200.90181.83

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OnAVX-512 Off0.10190.20380.30570.40760.50950.3320.3010.4530.403

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2815.76 / Max: 3509Min: 800 / Avg: 2689.74 / Max: 3510Min: 800 / Avg: 2950.63 / Max: 3901Min: 800 / Avg: 3148.94 / Max: 3908

Embree

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 124.87 / Avg: 459.53 / Max: 760.23Min: 121.15 / Avg: 469.47 / Max: 759.39Min: 99.6 / Avg: 443.11 / Max: 753.55Min: 198.42 / Avg: 451.72 / Max: 751.32

Embree

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 33 / Avg: 39.8 / Max: 45Min: 36 / Avg: 43.21 / Max: 49Min: 39 / Avg: 45.09 / Max: 50Min: 38 / Avg: 44.58 / Max: 51

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OnAVX-512 Off4080120160200SE +/- 0.26, N = 4SE +/- 0.21, N = 3SE +/- 0.52, N = 4SE +/- 0.19, N = 4131.85122.33174.38159.48

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OnAVX-512 Off0.11880.23760.35640.47520.5940.3220.2990.5280.456

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 3012.02 / Max: 3509Min: 800 / Avg: 3185.08 / Max: 3509Min: 800 / Avg: 3461.42 / Max: 3907Min: 800 / Avg: 3421.05 / Max: 3905

Embree

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 75.9 / Avg: 408.93 / Max: 760.89Min: 131.13 / Avg: 409.32 / Max: 758.21Min: 183.04 / Avg: 330.48 / Max: 754.13Min: 183.81 / Avg: 349.88 / Max: 758.31

Embree

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 32 / Avg: 36.48 / Max: 43Min: 34 / Avg: 39.36 / Max: 47Min: 36 / Avg: 39.47 / Max: 47Min: 36 / Avg: 39.76 / Max: 48

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 OnAVX-512 Off7001400210028003500SE +/- 3.84, N = 3SE +/- 4.04, N = 3SE +/- 30.78, N = 3SE +/- 6.36, N = 32705215532452365

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 OnAVX-512 Off1.1482.2963.4444.5925.744.2583.3565.1023.892

OpenVKL

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVKL 2.0.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 500 / Avg: 2843.9 / Max: 3519Min: 800 / Avg: 2872.62 / Max: 3515Min: 800 / Avg: 2934.37 / Max: 3913Min: 500 / Avg: 2909.25 / Max: 3917

OpenVKL

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 2.0.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 123.79 / Avg: 635.31 / Max: 760.66Min: 134.89 / Avg: 642.1 / Max: 759.51Min: 199.73 / Avg: 636.08 / Max: 754.77Min: 105.27 / Avg: 607.73 / Max: 758.79

OpenVKL

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVKL 2.0.0CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 30 / Avg: 51.4 / Max: 57Min: 34 / Avg: 54.24 / Max: 60Min: 35 / Avg: 56.19 / Max: 61Min: 36 / Avg: 54.42 / Max: 60

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OnAVX-512 Off1020304050SE +/- 0.20, N = 3SE +/- 0.09, N = 3SE +/- 0.19, N = 3SE +/- 0.07, N = 335.8923.6642.6523.41

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OnAVX-512 Off0.01490.02980.04470.05960.07450.0560.0380.0660.041

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2650.94 / Max: 3510Min: 800 / Avg: 2909.36 / Max: 3509Min: 800 / Avg: 2821.53 / Max: 3907Min: 2187 / Avg: 3001.49 / Max: 3907

OSPRay

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.12CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 135.38 / Avg: 645.46 / Max: 744.99Min: 132.38 / Avg: 625.29 / Max: 749.25Min: 206.8 / Avg: 642.59 / Max: 756.55Min: 199.85 / Avg: 565.77 / Max: 674.64

OSPRay

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.12CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 34 / Avg: 50.89 / Max: 55Min: 36 / Avg: 51.78 / Max: 57Min: 41 / Avg: 55.75 / Max: 60Min: 40 / Avg: 53.64 / Max: 58

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OnAVX-512 Off918273645SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.16, N = 335.2422.5241.6120.94

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OnAVX-512 Off0.01460.02920.04380.05840.0730.0550.0360.0650.039

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2633.09 / Max: 3514Min: 800 / Avg: 2856.21 / Max: 3506Min: 800 / Avg: 2789.09 / Max: 3900Min: 800 / Avg: 2860.32 / Max: 3908

OSPRay

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.12CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 140.03 / Avg: 641.68 / Max: 741.33Min: 134.53 / Avg: 625.67 / Max: 751Min: 199.86 / Avg: 642.78 / Max: 757.23Min: 200.25 / Avg: 530.92 / Max: 639.95

OSPRay

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.12CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 37 / Avg: 51.63 / Max: 56Min: 38 / Avg: 52.29 / Max: 57Min: 41 / Avg: 55.91 / Max: 60Min: 41 / Avg: 50.57 / Max: 56

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OnAVX-512 Off48121620SE +/- 0.14483, N = 15SE +/- 0.13104, N = 15SE +/- 0.20744, N = 4SE +/- 0.07557, N = 1515.083209.2252117.0409010.56674

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OnAVX-512 Off0.00650.0130.01950.0260.03250.0240.0150.0290.018

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2962.97 / Max: 3510Min: 800 / Avg: 2944.84 / Max: 3510Min: 800 / Avg: 3011.05 / Max: 3904Min: 800 / Avg: 3027.44 / Max: 3910

OSPRay

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.12CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 129.23 / Avg: 635.29 / Max: 759.02Min: 130.09 / Avg: 616.55 / Max: 735.34Min: 187.87 / Avg: 596.54 / Max: 711.75Min: 206.42 / Avg: 572.92 / Max: 683.35

OSPRay

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.12CPU Temperature MonitorAVX-512 OnAVX-512 Off1122334455Min: 38 / Avg: 50.81 / Max: 54Min: 38 / Avg: 50.91 / Max: 54Min: 41 / Avg: 52.31 / Max: 57Min: 40 / Avg: 51.3 / Max: 55

Y-Cruncher

Pi Digits To Calculate: 1B

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.2Pi Digits To Calculate: 1BAVX-512 OnAVX-512 Off246810SE +/- 0.003, N = 5SE +/- 0.007, N = 5SE +/- 0.021, N = 5SE +/- 0.026, N = 54.9146.3385.2336.540

Y-Cruncher

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2798.17 / Max: 3511Min: 800 / Avg: 2846.32 / Max: 3512Min: 800 / Avg: 3155.23 / Max: 3908Min: 800 / Avg: 3268.42 / Max: 3908

Y-Cruncher

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.2CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 139.77 / Avg: 425.32 / Max: 750.74Min: 134.09 / Avg: 451.69 / Max: 736.59Min: 204.3 / Avg: 399.57 / Max: 725.27Min: 103.71 / Avg: 430.76 / Max: 715.25

Y-Cruncher

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.2CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 36 / Avg: 40.69 / Max: 47Min: 37 / Avg: 42.99 / Max: 49Min: 41 / Avg: 44.12 / Max: 50Min: 40 / Avg: 44.62 / Max: 49

Y-Cruncher

Pi Digits To Calculate: 5B

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.2Pi Digits To Calculate: 5BAVX-512 OnAVX-512 Off816243240SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 328.6036.6427.0633.68

Y-Cruncher

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2736.78 / Max: 3509Min: 800 / Avg: 2783.21 / Max: 3509Min: 800 / Avg: 2830.68 / Max: 3904Min: 800 / Avg: 2895.61 / Max: 3907

Y-Cruncher

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.2CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 137.75 / Avg: 556.06 / Max: 742.94Min: 139.38 / Avg: 575.38 / Max: 737.4Min: 144.38 / Avg: 545.54 / Max: 739.45Min: 206.72 / Avg: 566.95 / Max: 745.43

Y-Cruncher

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.2CPU Temperature MonitorAVX-512 OnAVX-512 Off1122334455Min: 32 / Avg: 44.12 / Max: 51Min: 34 / Avg: 47.63 / Max: 55Min: 37 / Avg: 48.55 / Max: 55Min: 37 / Avg: 49.71 / Max: 57

Y-Cruncher

Pi Digits To Calculate: 500M

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.2Pi Digits To Calculate: 500MAVX-512 OnAVX-512 Off0.69951.3992.09852.7983.4975SE +/- 0.003, N = 7SE +/- 0.005, N = 7SE +/- 0.022, N = 7SE +/- 0.017, N = 72.2932.9072.7543.109

Y-Cruncher

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2850.7 / Max: 3510Min: 800 / Avg: 2852.57 / Max: 3515Min: 800 / Avg: 3445.48 / Max: 3908Min: 800 / Avg: 3313.53 / Max: 3907

Y-Cruncher

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.2CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 133.05 / Avg: 353.03 / Max: 753.25Min: 137.49 / Avg: 371.75 / Max: 732.24Min: 206.15 / Avg: 336.26 / Max: 671.34Min: 206.39 / Avg: 359.32 / Max: 686.83

Y-Cruncher

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.2CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 34 / Avg: 37.36 / Max: 43Min: 36 / Avg: 40.27 / Max: 47Min: 37 / Avg: 40.47 / Max: 46Min: 38 / Avg: 41.46 / Max: 47

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OnAVX-512 Off5001000150020002500SE +/- 10.80, N = 3SE +/- 6.64, N = 3SE +/- 31.97, N = 15SE +/- 54.32, N = 15830.96896.531331.742341.141. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2905.96 / Max: 3509Min: 800 / Avg: 2857.85 / Max: 3512Min: 800 / Avg: 2962.65 / Max: 3907Min: 800 / Avg: 2951.28 / Max: 3906

oneDNN

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.3CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 123.9 / Avg: 567.66 / Max: 734.19Min: 131.29 / Avg: 591.96 / Max: 755.76Min: 206.56 / Avg: 535.79 / Max: 754.55Min: 104.84 / Avg: 561.81 / Max: 756.79

oneDNN

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.3CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 36 / Avg: 47.82 / Max: 52Min: 38 / Avg: 50.66 / Max: 54Min: 35 / Avg: 52.1 / Max: 59Min: 35 / Avg: 52.63 / Max: 57

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off2004006008001000SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 1.20, N = 3SE +/- 2.03, N = 38891035749893

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2870.25 / Max: 3511Min: 800 / Avg: 2906.5 / Max: 3502Min: 800 / Avg: 2996.59 / Max: 3908Min: 800 / Avg: 2954.22 / Max: 3907

OSPRay Studio

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 124.77 / Avg: 593.3 / Max: 756.49Min: 143.22 / Avg: 588.6 / Max: 751.82Min: 144.81 / Avg: 586.48 / Max: 752.83Min: 206.7 / Avg: 571.85 / Max: 720.32

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 35 / Avg: 48.28 / Max: 54Min: 37 / Avg: 49.82 / Max: 57Min: 39 / Avg: 52.09 / Max: 59Min: 39 / Avg: 51.01 / Max: 59

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off30060090012001500SE +/- 0.00, N = 3SE +/- 1.67, N = 3SE +/- 0.88, N = 3SE +/- 6.17, N = 3106212268861055

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2894.68 / Max: 3510Min: 800 / Avg: 2934.05 / Max: 3501Min: 800 / Avg: 2999.39 / Max: 3906Min: 800 / Avg: 3008.77 / Max: 3904

OSPRay Studio

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 139.08 / Avg: 591.27 / Max: 757.85Min: 143.11 / Avg: 590.62 / Max: 754.02Min: 206.82 / Avg: 583.69 / Max: 755.21Min: 206.89 / Avg: 569.32 / Max: 725.89

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 36 / Avg: 48.71 / Max: 54Min: 37 / Avg: 49.96 / Max: 57Min: 39 / Avg: 52.36 / Max: 59Min: 39 / Avg: 51.38 / Max: 59

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off4K8K12K16K20KSE +/- 14.66, N = 3SE +/- 24.36, N = 3SE +/- 96.72, N = 3SE +/- 152.25, N = 514054164861212514257

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2759.25 / Max: 3516Min: 800 / Avg: 2899.72 / Max: 3511Min: 800 / Avg: 2984.18 / Max: 3906Min: 800 / Avg: 2854.58 / Max: 3904

OSPRay Studio

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 141.11 / Avg: 624.47 / Max: 765.04Min: 143.91 / Avg: 587.53 / Max: 760.59Min: 207.14 / Avg: 582.01 / Max: 756.24Min: 206.89 / Avg: 620.27 / Max: 751.57

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 36 / Avg: 51.11 / Max: 56Min: 37 / Avg: 49.91 / Max: 56Min: 41 / Avg: 52.42 / Max: 59Min: 39 / Avg: 54.76 / Max: 60

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off8K16K24K32K40KSE +/- 114.21, N = 3SE +/- 150.37, N = 3SE +/- 74.75, N = 3SE +/- 274.25, N = 333026383092382533603

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2898.85 / Max: 3501Min: 800 / Avg: 2936.5 / Max: 3509Min: 800 / Avg: 2818.6 / Max: 3903Min: 800 / Avg: 3089.22 / Max: 3904

OSPRay Studio

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 142.52 / Avg: 540.07 / Max: 762.44Min: 147.32 / Avg: 554.56 / Max: 759.36Min: 148.13 / Avg: 611.69 / Max: 755.87Min: 206.91 / Avg: 527.9 / Max: 734.93

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 37 / Avg: 46.03 / Max: 53Min: 38 / Avg: 48.12 / Max: 55Min: 40 / Avg: 54.1 / Max: 60Min: 40 / Avg: 49.28 / Max: 57

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off4K8K12K16K20KSE +/- 52.30, N = 3SE +/- 18.90, N = 3SE +/- 108.89, N = 15SE +/- 155.10, N = 716796196041434517151

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2839.81 / Max: 3512Min: 800 / Avg: 2890.48 / Max: 3509Min: 800 / Avg: 2852.57 / Max: 3908Min: 800 / Avg: 2959.45 / Max: 3908

OSPRay Studio

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 137.59 / Avg: 587.3 / Max: 760.63Min: 146.6 / Avg: 598.52 / Max: 758.88Min: 146.85 / Avg: 620.07 / Max: 762.64Min: 124.93 / Avg: 583.37 / Max: 757.25

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 36 / Avg: 48.42 / Max: 55Min: 37 / Avg: 50.57 / Max: 57Min: 40 / Avg: 55.23 / Max: 60Min: 39 / Avg: 52.4 / Max: 59

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off10K20K30K40K50KSE +/- 213.70, N = 3SE +/- 123.86, N = 3SE +/- 167.00, N = 3SE +/- 82.99, N = 338483444603272338787

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2910.39 / Max: 3509Min: 800 / Avg: 2969.61 / Max: 3515Min: 800 / Avg: 3036.33 / Max: 3904Min: 800 / Avg: 2986.32 / Max: 3905

OSPRay Studio

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 130.86 / Avg: 555.85 / Max: 759.56Min: 144.19 / Avg: 568.1 / Max: 759.38Min: 207.24 / Avg: 524.7 / Max: 756.03Min: 200.01 / Avg: 543.95 / Max: 744.29

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1122334455Min: 37 / Avg: 46.82 / Max: 53Min: 37 / Avg: 48.42 / Max: 55Min: 41 / Avg: 49.81 / Max: 57Min: 39 / Avg: 49.75 / Max: 57

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off60120180240300SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3226263189225

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2860.68 / Max: 3508Min: 800 / Avg: 2895.53 / Max: 3513Min: 800 / Avg: 2951.28 / Max: 3909Min: 800 / Avg: 2911.78 / Max: 3908

OSPRay Studio

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 136.35 / Avg: 609.29 / Max: 755.63Min: 141.14 / Avg: 609.71 / Max: 751.36Min: 207.24 / Avg: 601.24 / Max: 748.86Min: 207.17 / Avg: 588.7 / Max: 754.39

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 36 / Avg: 49.85 / Max: 56Min: 36 / Avg: 50.91 / Max: 57Min: 40 / Avg: 53.82 / Max: 60Min: 38 / Avg: 52.16 / Max: 59

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off70140210280350SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 2.41, N = 15268309223279

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2867.16 / Max: 3507Min: 800 / Avg: 2879.74 / Max: 3503Min: 800 / Avg: 2918.01 / Max: 3904Min: 500 / Avg: 2883.43 / Max: 3904

OSPRay Studio

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 139.84 / Avg: 612.34 / Max: 754.59Min: 144.32 / Avg: 611.95 / Max: 753.73Min: 207.07 / Avg: 607.95 / Max: 755.36Min: 148.8 / Avg: 569.63 / Max: 723.58

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 37 / Avg: 50.46 / Max: 56Min: 37 / Avg: 51.34 / Max: 57Min: 41 / Avg: 54.4 / Max: 60Min: 39 / Avg: 52.07 / Max: 59

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off9001800270036004500SE +/- 1.86, N = 3SE +/- 5.17, N = 3SE +/- 7.00, N = 3SE +/- 23.43, N = 33545416630173585

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2852.98 / Max: 3501Min: 800 / Avg: 2884.44 / Max: 3508Min: 800 / Avg: 2958.37 / Max: 3904Min: 800 / Avg: 2892.35 / Max: 3905

OSPRay Studio

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 144.54 / Avg: 607.87 / Max: 759.8Min: 144.87 / Avg: 607.3 / Max: 759.23Min: 207.21 / Avg: 604.78 / Max: 754.51Min: 206.92 / Avg: 595.58 / Max: 740.41

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 37 / Avg: 50 / Max: 56Min: 38 / Avg: 51.02 / Max: 57Min: 41 / Avg: 54.26 / Max: 60Min: 38 / Avg: 52.7 / Max: 59

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off2K4K6K8K10KSE +/- 17.64, N = 3SE +/- 8.69, N = 3SE +/- 27.24, N = 3SE +/- 60.01, N = 37089832660537218

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2805.89 / Max: 3503Min: 800 / Avg: 2861.55 / Max: 3512Min: 800 / Avg: 2907.46 / Max: 3904Min: 800 / Avg: 2863.16 / Max: 3903

OSPRay Studio

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 139.81 / Avg: 620.45 / Max: 760.44Min: 139.96 / Avg: 617.36 / Max: 759.01Min: 206.52 / Avg: 611.84 / Max: 754.94Min: 207.16 / Avg: 607.3 / Max: 756.05

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 37 / Avg: 50.95 / Max: 57Min: 38 / Avg: 51.41 / Max: 57Min: 40 / Avg: 54.65 / Max: 60Min: 39 / Avg: 53.47 / Max: 59

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off11002200330044005500SE +/- 2.40, N = 3SE +/- 8.21, N = 3SE +/- 10.48, N = 3SE +/- 19.40, N = 34231491735744242

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2842.13 / Max: 3513Min: 800 / Avg: 2863.77 / Max: 3508Min: 800 / Avg: 2897.66 / Max: 3904Min: 800 / Avg: 2897.48 / Max: 3904

OSPRay Studio

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 142 / Avg: 611.56 / Max: 759.31Min: 147.42 / Avg: 608 / Max: 759.43Min: 207.14 / Avg: 607.98 / Max: 755.1Min: 206.67 / Avg: 597.45 / Max: 757.34

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 37 / Avg: 50.46 / Max: 56Min: 37 / Avg: 50.95 / Max: 57Min: 41 / Avg: 54.44 / Max: 60Min: 39 / Avg: 52.8 / Max: 59

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off2K4K6K8K10KSE +/- 11.85, N = 3SE +/- 37.24, N = 3SE +/- 43.03, N = 3SE +/- 101.69, N = 38457993471468596

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2806.99 / Max: 3507Min: 800 / Avg: 2893.76 / Max: 3515Min: 800 / Avg: 2900.24 / Max: 3908Min: 800 / Avg: 2909.62 / Max: 3904

OSPRay Studio

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 133.08 / Avg: 619.07 / Max: 759.61Min: 142.4 / Avg: 606.92 / Max: 759.82Min: 206.71 / Avg: 617.43 / Max: 757Min: 206.63 / Avg: 608.46 / Max: 765.39

OSPRay Studio

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 37 / Avg: 50.81 / Max: 56Min: 37 / Avg: 50.92 / Max: 57Min: 41 / Avg: 54.83 / Max: 60Min: 39 / Avg: 53.61 / Max: 60

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OnAVX-512 Off1530456075SE +/- 0.31, N = 3SE +/- 0.28, N = 3SE +/- 0.41, N = 3SE +/- 0.20, N = 366.1847.2249.2639.06

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OnAVX-512 Off0.0320.0640.0960.1280.160.1420.0970.1240.094

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 3179.69 / Max: 3508Min: 800 / Avg: 3199.12 / Max: 3515Min: 800 / Avg: 3719.28 / Max: 3912Min: 800 / Avg: 3778.53 / Max: 3909

TensorFlow

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.12CPU Power Consumption MonitorAVX-512 OnAVX-512 Off100200300400500Min: 135.2 / Avg: 467.02 / Max: 544.28Min: 145.05 / Avg: 485.57 / Max: 544.2Min: 170.32 / Avg: 398.6 / Max: 450.75Min: 206.9 / Avg: 413.92 / Max: 462.77

TensorFlow

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.12CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 37 / Avg: 41.69 / Max: 44Min: 37 / Avg: 41.93 / Max: 46Min: 39 / Avg: 43.36 / Max: 45Min: 39 / Avg: 43.01 / Max: 49

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 32 - Model: ResNet-50AVX-512 OnAVX-512 Off20406080100SE +/- 0.22, N = 3SE +/- 0.36, N = 3SE +/- 0.13, N = 3SE +/- 0.14, N = 385.6457.8472.0653.60

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 32 - Model: ResNet-50AVX-512 OnAVX-512 Off0.0380.0760.1140.1520.190.1690.1130.1650.119

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 3011.19 / Max: 3516Min: 800 / Avg: 3205.24 / Max: 3500Min: 800 / Avg: 3656.93 / Max: 3909Min: 800 / Avg: 3797.09 / Max: 3912

TensorFlow

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.12CPU Power Consumption MonitorAVX-512 OnAVX-512 Off100200300400500Min: 133.66 / Avg: 507.68 / Max: 568.58Min: 83.76 / Avg: 510.59 / Max: 556.63Min: 206.81 / Avg: 437.84 / Max: 494.79Min: 206.73 / Avg: 448.87 / Max: 498.3

TensorFlow

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.12CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 34 / Avg: 42.48 / Max: 47Min: 33 / Avg: 42.52 / Max: 45Min: 37 / Avg: 43.39 / Max: 46Min: 36 / Avg: 43.72 / Max: 47

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OnAVX-512 Off20406080100SE +/- 0.75, N = 3SE +/- 0.39, N = 3SE +/- 0.16, N = 3SE +/- 0.58, N = 3103.2868.4297.8566.08

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OnAVX-512 Off0.04610.09220.13830.18440.23050.1880.1260.2050.138

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.12CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 3056.82 / Max: 3509Min: 800 / Avg: 3214.95 / Max: 3515Min: 800 / Avg: 3711.35 / Max: 3906Min: 800 / Avg: 3787.56 / Max: 3910

TensorFlow

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.12CPU Power Consumption MonitorAVX-512 OnAVX-512 Off110220330440550Min: 144.3 / Avg: 549.53 / Max: 606.11Min: 133.72 / Avg: 541.03 / Max: 580.13Min: 207.18 / Avg: 476.86 / Max: 531.76Min: 206.82 / Avg: 480.23 / Max: 511.44

TensorFlow

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.12CPU Temperature MonitorAVX-512 OnAVX-512 Off1020304050Min: 34 / Avg: 45.35 / Max: 49Min: 34 / Avg: 45.2 / Max: 50Min: 37 / Avg: 46.02 / Max: 51Min: 37 / Avg: 45.48 / Max: 50

OpenVINO

Model: Face Detection FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off50100150200250SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3218.6221.89236.1424.671. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off30060090012001500SE +/- 0.07, N = 3SE +/- 4.01, N = 3SE +/- 0.03, N = 3SE +/- 2.43, N = 3137.091355.33135.371287.111. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2489.2 / Max: 3512Min: 800 / Avg: 2872.4 / Max: 3515Min: 800 / Avg: 2665.33 / Max: 3908Min: 800 / Avg: 3007.46 / Max: 3907

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 144.55 / Avg: 649.2 / Max: 755.85Min: 143.98 / Avg: 644.15 / Max: 745.46Min: 103.58 / Avg: 645.19 / Max: 824.86Min: 206.75 / Avg: 643.09 / Max: 735.29

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 36 / Avg: 51.42 / Max: 56Min: 35 / Avg: 51.37 / Max: 57Min: 38 / Avg: 55.73 / Max: 60Min: 37 / Avg: 54.55 / Max: 60

OpenVINO

Model: Person Detection FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off160320480640800SE +/- 0.66, N = 3SE +/- 0.08, N = 3SE +/- 0.82, N = 3SE +/- 0.31, N = 3637.73214.94747.49238.221. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off306090120150SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 347.01139.4442.76134.181. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2822.65 / Max: 3514Min: 800 / Avg: 2904.53 / Max: 3509Min: 800 / Avg: 2567.68 / Max: 3908Min: 800 / Avg: 2892 / Max: 3908

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off150300450600750Min: 144.78 / Avg: 657.22 / Max: 758.3Min: 141.92 / Avg: 655.28 / Max: 742.22Min: 206.85 / Avg: 654.25 / Max: 835.93Min: 206.66 / Avg: 653.75 / Max: 749.75

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 51.7 / Max: 55Min: 37 / Avg: 51.8 / Max: 55Min: 41 / Avg: 56.47 / Max: 60Min: 40 / Avg: 55.35 / Max: 60

OpenVINO

Model: Person Detection FP32 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OnAVX-512 Off160320480640800SE +/- 0.38, N = 3SE +/- 0.26, N = 3SE +/- 1.03, N = 3SE +/- 0.09, N = 3637.78213.06747.77237.771. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP32 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OnAVX-512 Off306090120150SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 347.00140.6442.74134.441. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2808.74 / Max: 3515Min: 800 / Avg: 2785.33 / Max: 3510Min: 800 / Avg: 2545.34 / Max: 3903Min: 800 / Avg: 2830.49 / Max: 3910

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off160320480640800Min: 141.18 / Avg: 652.91 / Max: 759.25Min: 139.22 / Avg: 651.89 / Max: 746.8Min: 206.53 / Avg: 652.32 / Max: 894.8Min: 206.81 / Avg: 652 / Max: 753.73

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 51.96 / Max: 55Min: 37 / Avg: 52.1 / Max: 56Min: 42 / Avg: 56.49 / Max: 60Min: 40 / Avg: 55.88 / Max: 59

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off10002000300040005000SE +/- 1.67, N = 3SE +/- 0.53, N = 3SE +/- 1.59, N = 3SE +/- 1.56, N = 33887.301749.984765.952116.641. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off48121620SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 37.7017.126.6915.101. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2499.4 / Max: 3510Min: 800 / Avg: 2440.06 / Max: 3509Min: 800 / Avg: 2496.49 / Max: 3905Min: 800 / Avg: 2534.47 / Max: 3911

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 134.39 / Avg: 662.15 / Max: 766.17Min: 134.79 / Avg: 660.58 / Max: 760.14Min: 205.98 / Avg: 660.76 / Max: 798.87Min: 206.55 / Avg: 660.54 / Max: 758.96

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 52.28 / Max: 55Min: 37 / Avg: 51.81 / Max: 55Min: 42 / Avg: 56.43 / Max: 60Min: 40 / Avg: 56.14 / Max: 60

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off120240360480600SE +/- 2.15, N = 3SE +/- 0.06, N = 3SE +/- 0.53, N = 3SE +/- 0.10, N = 3412.8685.02538.2794.571. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off80160240320400SE +/- 1.52, N = 3SE +/- 0.22, N = 3SE +/- 0.24, N = 3SE +/- 0.38, N = 3290.15352.08237.36337.691. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2524.72 / Max: 3512Min: 800 / Avg: 2900.67 / Max: 3511Min: 800 / Avg: 2675.48 / Max: 3909Min: 800 / Avg: 2956.05 / Max: 3907

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 134.08 / Avg: 637.97 / Max: 751.47Min: 141.8 / Avg: 646.72 / Max: 748.88Min: 206.57 / Avg: 636.48 / Max: 766.86Min: 206.98 / Avg: 649.9 / Max: 748.52

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 51.9 / Max: 56Min: 38 / Avg: 52.8 / Max: 57Min: 42 / Avg: 55.99 / Max: 61Min: 41 / Avg: 56.46 / Max: 61

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUAVX-512 OnAVX-512 Off4K8K12K16K20KSE +/- 24.24, N = 3SE +/- 3.57, N = 3SE +/- 5.71, N = 3SE +/- 2.90, N = 314944.266859.8618384.838208.881. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUAVX-512 OnAVX-512 Off48121620SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 38.0217.466.9515.581. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2364.74 / Max: 3512Min: 800 / Avg: 2409.05 / Max: 3512Min: 800 / Avg: 2432.9 / Max: 3905Min: 800 / Avg: 2474.34 / Max: 3904

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 140.31 / Avg: 657.79 / Max: 763.65Min: 140.27 / Avg: 658.37 / Max: 759.99Min: 206.34 / Avg: 657.43 / Max: 769.68Min: 206.57 / Avg: 657.51 / Max: 759.7

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 37 / Avg: 52.35 / Max: 56Min: 36 / Avg: 51.8 / Max: 55Min: 41 / Avg: 56.27 / Max: 59Min: 41 / Avg: 56 / Max: 59

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUAVX-512 OnAVX-512 Off400800120016002000SE +/- 1.66, N = 3SE +/- 0.24, N = 3SE +/- 1.06, N = 3SE +/- 0.98, N = 31528.73923.471884.991159.931. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUAVX-512 OnAVX-512 Off816243240SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 319.6032.4516.9527.561. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2705.88 / Max: 3511Min: 800 / Avg: 2446.61 / Max: 3509Min: 800 / Avg: 2692.65 / Max: 3912Min: 800 / Avg: 2429.46 / Max: 3910

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 142.57 / Avg: 656.98 / Max: 759.7Min: 137.8 / Avg: 658.35 / Max: 760.45Min: 207.03 / Avg: 658.56 / Max: 763.43Min: 106.14 / Avg: 660.56 / Max: 759.78

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 52.34 / Max: 55Min: 37 / Avg: 52.15 / Max: 56Min: 41 / Avg: 56.66 / Max: 60Min: 41 / Avg: 56.23 / Max: 60

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off2K4K6K8K10KSE +/- 11.71, N = 3SE +/- 3.58, N = 3SE +/- 8.09, N = 3SE +/- 0.66, N = 35759.713688.328921.974277.311. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off816243240SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 320.7332.5114.3329.911. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2588.47 / Max: 3509Min: 800 / Avg: 2466.01 / Max: 3511Min: 800 / Avg: 2369.5 / Max: 3907Min: 800 / Avg: 2584.05 / Max: 3907

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 138.9 / Avg: 656.7 / Max: 754.94Min: 135.14 / Avg: 659.58 / Max: 759.65Min: 206.26 / Avg: 655.74 / Max: 760.38Min: 205.91 / Avg: 656.76 / Max: 757.26

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 52.42 / Max: 56Min: 37 / Avg: 52.7 / Max: 56Min: 42 / Avg: 56.5 / Max: 60Min: 41 / Avg: 56.01 / Max: 59

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off7K14K21K28K35KSE +/- 29.04, N = 3SE +/- 2.47, N = 3SE +/- 24.15, N = 3SE +/- 0.50, N = 326917.012463.9832234.042822.711. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off1122334455SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 34.3848.483.9345.321. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2246.35 / Max: 3510Min: 800 / Avg: 2823.12 / Max: 3513Min: 800 / Avg: 2334.49 / Max: 3904Min: 800 / Avg: 2912.9 / Max: 3907

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 141.93 / Avg: 659.08 / Max: 758.69Min: 140.04 / Avg: 656.62 / Max: 757.38Min: 206.16 / Avg: 658.43 / Max: 764.17Min: 206.6 / Avg: 658.75 / Max: 757.12

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 39 / Avg: 53.16 / Max: 57Min: 38 / Avg: 53.49 / Max: 57Min: 41 / Avg: 57.39 / Max: 61Min: 41 / Avg: 56.79 / Max: 60

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off5K10K15K20K25KSE +/- 25.65, N = 3SE +/- 9.76, N = 3SE +/- 20.85, N = 3SE +/- 8.51, N = 320980.6913852.8824769.1015101.291. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 35.718.655.158.461. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2335.95 / Max: 3514Min: 800 / Avg: 2890.23 / Max: 3515Min: 800 / Avg: 2523.87 / Max: 3907Min: 800 / Avg: 2937.64 / Max: 3910

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 138.22 / Avg: 655.8 / Max: 757.3Min: 141.2 / Avg: 657.6 / Max: 757.38Min: 206.88 / Avg: 654.08 / Max: 774.62Min: 206.93 / Avg: 656.65 / Max: 755.73

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 52.94 / Max: 56Min: 38 / Avg: 53.64 / Max: 57Min: 41 / Avg: 56.75 / Max: 60Min: 40 / Avg: 56.4 / Max: 60

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off5001000150020002500SE +/- 1.25, N = 3SE +/- 0.20, N = 3SE +/- 2.91, N = 3SE +/- 0.40, N = 31894.491645.032389.551882.971. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off1632486480SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 363.2772.8953.5167.931. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2452.95 / Max: 3510Min: 800 / Avg: 2542 / Max: 3511Min: 800 / Avg: 2552.5 / Max: 3909Min: 800 / Avg: 2654.51 / Max: 3908

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 138.92 / Avg: 650.5 / Max: 760.41Min: 143.33 / Avg: 649.87 / Max: 762.66Min: 206.86 / Avg: 651.28 / Max: 757.99Min: 206.89 / Avg: 649.79 / Max: 759.52

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 52.67 / Max: 57Min: 37 / Avg: 52.28 / Max: 56Min: 42 / Avg: 56.42 / Max: 60Min: 40 / Avg: 55.71 / Max: 59

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OnAVX-512 Off2004006008001000SE +/- 1.33, N = 3SE +/- 1.82, N = 3SE +/- 1.48, N = 3SE +/- 0.41, N = 3742.51212.631097.82276.631. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OnAVX-512 Off306090120150SE +/- 0.08, N = 3SE +/- 1.21, N = 3SE +/- 0.04, N = 3SE +/- 0.15, N = 340.19140.6829.07115.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2778.23 / Max: 3515Min: 800 / Avg: 2690.93 / Max: 3512Min: 800 / Avg: 2755.35 / Max: 3904Min: 800 / Avg: 2833.67 / Max: 3907

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 139.19 / Avg: 654.14 / Max: 728.45Min: 139.64 / Avg: 650.58 / Max: 751.9Min: 206.4 / Avg: 652.53 / Max: 745.49Min: 206.71 / Avg: 648.21 / Max: 747.87

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 52.23 / Max: 55Min: 38 / Avg: 51.99 / Max: 56Min: 42 / Avg: 56.51 / Max: 60Min: 41 / Avg: 55.93 / Max: 60

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off11K22K33K44K55KSE +/- 54.78, N = 3SE +/- 3.89, N = 3SE +/- 80.54, N = 3SE +/- 3.35, N = 347113.298773.9849132.999439.921. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off48121620SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 32.5313.662.4413.551. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2252.6 / Max: 3510Min: 800 / Avg: 2808.93 / Max: 3508Min: 800 / Avg: 2316.34 / Max: 3904Min: 800 / Avg: 2931.15 / Max: 3905

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 143.5 / Avg: 657.41 / Max: 756.56Min: 142.53 / Avg: 658.62 / Max: 757.75Min: 206.84 / Avg: 657.97 / Max: 768.07Min: 206.69 / Avg: 658.1 / Max: 752.9

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 53.03 / Max: 56Min: 38 / Avg: 53.43 / Max: 57Min: 43 / Avg: 57.32 / Max: 60Min: 41 / Avg: 57.06 / Max: 60

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off2K4K6K8K10KSE +/- 6.80, N = 3SE +/- 1.81, N = 3SE +/- 3.93, N = 3SE +/- 0.72, N = 37556.522564.0910161.312988.911. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off48121620SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 315.7611.6912.5510.691. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2456.27 / Max: 3513Min: 800 / Avg: 2849.9 / Max: 3513Min: 800 / Avg: 2526.74 / Max: 3905Min: 800 / Avg: 2825.64 / Max: 3908

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 143.35 / Avg: 648.95 / Max: 765.36Min: 146.73 / Avg: 654.43 / Max: 756.6Min: 206.59 / Avg: 645.49 / Max: 767.1Min: 206.9 / Avg: 657.33 / Max: 762.02

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 52.29 / Max: 56Min: 38 / Avg: 51.96 / Max: 56Min: 42 / Avg: 56.39 / Max: 61Min: 41 / Avg: 56.04 / Max: 60

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUAVX-512 OnAVX-512 Off11002200330044005500SE +/- 26.63, N = 3SE +/- 10.21, N = 15SE +/- 0.84, N = 3SE +/- 10.88, N = 74381.751075.655105.951166.181. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUAVX-512 OnAVX-512 Off20406080100SE +/- 0.15, N = 3SE +/- 1.05, N = 15SE +/- 0.01, N = 3SE +/- 1.00, N = 727.33111.6324.87109.751. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2457.57 / Max: 3510Min: 800 / Avg: 2813.17 / Max: 3514Min: 800 / Avg: 2629.98 / Max: 3905Min: 800 / Avg: 2890.31 / Max: 3904

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 142.04 / Avg: 656.81 / Max: 744.88Min: 134.97 / Avg: 663.13 / Max: 754.59Min: 206.5 / Avg: 658.68 / Max: 774.35Min: 171.5 / Avg: 663.12 / Max: 746.34

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 38 / Avg: 52.54 / Max: 56Min: 38 / Avg: 53.14 / Max: 56Min: 42 / Avg: 57.82 / Max: 61Min: 41 / Avg: 56.83 / Max: 60

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OnAVX-512 Off30K60K90K120K150KSE +/- 735.86, N = 3SE +/- 51.71, N = 3SE +/- 898.88, N = 3SE +/- 52.05, N = 3144820.3565805.38114369.6663672.971. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OnAVX-512 Off0.39380.78761.18141.57521.969SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 30.371.750.461.701. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2659.67 / Max: 3511Min: 800 / Avg: 2573.11 / Max: 3516Min: 800 / Avg: 3132.4 / Max: 3904Min: 800 / Avg: 2666.29 / Max: 3914

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 140.85 / Avg: 607.89 / Max: 662.55Min: 138.57 / Avg: 658.34 / Max: 759.74Min: 105.27 / Avg: 509.17 / Max: 614.46Min: 206.74 / Avg: 658.37 / Max: 772.16

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1224364860Min: 39 / Avg: 49.89 / Max: 52Min: 38 / Avg: 52.66 / Max: 56Min: 42 / Avg: 49.55 / Max: 52Min: 41 / Avg: 55.93 / Max: 59

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off30K60K90K120K150KSE +/- 547.74, N = 3SE +/- 1069.55, N = 3SE +/- 940.07, N = 3SE +/- 496.38, N = 3151891.46129576.78123447.74101244.001. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off0.14180.28360.42540.56720.709SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.290.570.400.631. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 800 / Avg: 2693.5 / Max: 3506Min: 800 / Avg: 2829.36 / Max: 3513Min: 800 / Avg: 3150.41 / Max: 3904Min: 800 / Avg: 3332.23 / Max: 3906

OpenVINO

CPU Power Consumption Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 137.76 / Avg: 545.79 / Max: 590.3Min: 145.72 / Avg: 655.91 / Max: 741.97Min: 206.49 / Avg: 469.31 / Max: 558.98Min: 207 / Avg: 514.86 / Max: 663.92

OpenVINO

CPU Temperature Monitor

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature MonitorAVX-512 OnAVX-512 Off1122334455Min: 38 / Avg: 46.79 / Max: 49Min: 30 / Avg: 49.93 / Max: 56Min: 41 / Avg: 46.95 / Max: 50Min: 41 / Avg: 52.35 / Max: 55

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Phoronix Test Suite System Monitoring

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringAVX-512 OnAVX-512 Off10002000300040005000Min: 500 / Avg: 2841.09 / Max: 3519Min: 800 / Avg: 2870.28 / Max: 5743Min: 800 / Avg: 2954.57 / Max: 3913Min: 500 / Avg: 3017.93 / Max: 3917

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 OnAVX-512 Off160320480640800Min: 72.02 / Avg: 574.93 / Max: 770.09Min: 67.03 / Avg: 598.76 / Max: 762.66Min: 99.6 / Avg: 589.71 / Max: 894.8Min: 103.63 / Avg: 583.08 / Max: 772.16

CPU Temperature Monitor

Phoronix Test Suite System Monitoring

Sapphire RapidsEmerald RapidsOpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringAVX-512 OnAVX-512 Off1326395265Min: 22 / Avg: 48.5 / Max: 59Min: 25 / Avg: 51.04 / Max: 61Min: 30 / Avg: 54 / Max: 64Min: 29 / Avg: 53.19 / Max: 66

Phoronix Test Suite v10.8.5