Sapphire Rapids AVX-512 Benchmarks

Ice Lake, Sapphire Rapids, Genoa AVX-512 benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2301176-NE-SAPPHIRER14&gru.

ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerVulkanCompilerFile-SystemScreen ResolutionXeon 8380Xeon 8490HEPYC 9654 AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads)Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS)Intel Ice Lake IEH512GB2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007ASPEEDVGA HDMI2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFPUbuntu 22.105.19.0-29-generic (x86_64)GNOME Shell 43.1X Server 1.21.1.41.3.224GCC 12.2.0ext41920x10802 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)Intel Device 1bce1008GB4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T2 x AMD EPYC 9654 96-Core @ 3.71GHz (192 Cores / 384 Threads)AMD Titanite_4G (RTI1002E BIOS)AMD Device 14a41520GBBroadcom NetXtreme BCM5720 PCIeOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseEnvironment Details- Xeon 8380: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" CFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile"- Xeon 8380: AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" - Xeon 8490H: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" CFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile"- Xeon 8490H: AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" - EPYC 9654: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" CFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile"- EPYC 9654: AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" Compiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Xeon 8380: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd000375- Xeon 8380: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd000375- Xeon 8490H: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0000c0- Xeon 8490H: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0000c0- EPYC 9654: AVX-512 Off: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa10110d- EPYC 9654: AVX-512 On: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa10110dPython Details- Python 3.10.7Security Details- Xeon 8380: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon 8380: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon 8490H: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon 8490H: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9654: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9654: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

minibude: OpenMP - BM1minibude: OpenMP - BM2openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Crownminibude: OpenMP - BM1minibude: OpenMP - BM2oidn: RT.hdr_alb_nrm.3840x2160oidn: RTLightmap.hdr.4096x4096openvkl: vklBenchmark ISPCospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timedeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamcpuminer-opt: scryptcpuminer-opt: Triple SHA-256, Onecoincpuminer-opt: Quad SHA-256, Pyritecpuminer-opt: x25xcpuminer-opt: Deepcoincpuminer-opt: Skeincoincpuminer-opt: LBC, LBRY Creditssmhasher: FarmHash32 x86_64 AVXlczero: BLASlczero: Eigensmhasher: FarmHash32 x86_64 AVXospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 16 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 16 - Path Tracerospray-studio: 3 - 4K - 32 - Path Traceronednn: Deconvolution Batch shapes_3d - f32 - CPUmnn: mobilenetV3mnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenfoam: drivaerFastback, Large Mesh Size - Mesh Timeopenfoam: drivaerFastback, Large Mesh Size - Execution TimeXeon 8380Xeon 8490HEPYC 9654 AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On71.84679.72350413.981750.301014.2796.344170.50791796.1591993.0672.071.0379214.345513.779219.9578183.8325379.5792113.3261541.861716.827543.114045.8547158.526169.7264247.273216.799643.16011122.746470333551731840.415793039935015708330330.534780470931.58414912394348165177028490627801.992861.7642.67818.1334.1951.5811.4119.68217.0993105.26248.815873.746359.4175916.936021.7973251.567814.3286161.334259.5159913.4196162.72306358.63124887.207627106.761193.573103.55067701.604442.951119.45106.179874.80332339.3232588.7582.941.4291721.224221.064025.5179227.4544455.0312228.1219835.784620.193348.413479.1405221.729483.4197318.792820.231348.23932307.4213285479240402650.366469061327341913333979.995524575031.08413082087241834156324927498470.8751961.7092.2977.9093.9991.164.4917.83175.691487.86584.375047.821649.5145819.532512.6264180.170411.9769125.163949.4208821.9588160.6645361.366881051.35257117.005999.225104.10673906.763878.791732.7490.395962.03772480.6072602.6522.951.48103423.174822.832832.4837264.7704584.1487187.6477832.854221.286266.754046.8614232.208584.8378405.723021.178966.72811623.8810926376873202166.909110767773326391737809.717542824323.2689801560131373117018608373002.012412.2883.55117.7165.2221.5730.9117.29226.2678102.61365.324271.934646.9735887.589321.3212257.562211.7823147.457847.2094889.3899169.84164194.789751039.31534319.1245143.451145.754103184.016206.723738.92122.526092.65123586.2733643.8404.191.99119636.364335.954442.9662424.2714875.6416281.23611492.884427.067092.021183.7008355.6686100.5397592.452226.843292.03283665.55207420014726204071.59105513107245367267742508.35106711113423.2738591358927204102916332327490.7368222.0552.7378.4964.4151.0419.318.01141.144568.43473.550940.140736.9382648.199511.9378168.22859.9734101.042537.2473647.7545159.67329195.47713847.910294305.1242207.697254.853114083.246218.253791.80177.6774153.18155192.4256371.3203.461.72117626.395325.309640.6658510.87751006.0824206.31711410.422230.8553120.514271.5088491.3426109.2581660.537130.4563120.51892947.94333885013343635712.58165240141306349278036458.319425816126.413705112162247583613341265411.736673.8897.56624.0819.2781.147.7112.64187.351595.16654.844467.901632.4024787.327013.9740194.71799.1835144.885832.8263787.7235146.75453110.94948867.3792803.5444290.962342.508118103.9411029.457420.49213.9512181.88897274.0508562.6943.481.66134143.708143.235854.1553613.93551205.1813191.33251966.405234.232284.8676100.2855704.5818126.0114809.075134.500884.39964816.31332628722525007691.781602901990790106899339795.369171908526.55158192601850069511058221200.9862143.8667.20414.7278.7620.964.346.46155.911879.49675.224048.700329.20291128.84509.9667135.99377.9604118.352528.97711132.6133145.89944112.38169996.777412849.611OpenBenchmarking.org

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Phoronix Test Suite System Monitoring

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On7001400210028003500Min: 802 / Avg: 3114.77 / Max: 3421Min: 804 / Avg: 2939.27 / Max: 3420Min: 1899 / Avg: 3041.53 / Max: 4080Min: 690 / Avg: 3000.31 / Max: 4081Min: 2336 / Avg: 3667.6 / Max: 4199Min: 2547 / Avg: 3615.9 / Max: 3772

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

Xeon 8380Xeon 8490HOpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On160320480640800Min: 57.8 / Avg: 365.97 / Max: 660.32Min: 60.6 / Avg: 451.19 / Max: 668.12Min: 101.7 / Avg: 588.67 / Max: 887.42Min: 102.55 / Avg: 582.55 / Max: 894.12

miniBUDE

Implementation: OpenMP - Input Deck: BM1

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On60120180240300SE +/- 0.14, N = 5SE +/- 0.25, N = 5SE +/- 0.27, N = 6SE +/- 0.53, N = 7SE +/- 1.12, N = 8SE +/- 0.38, N = 1071.8593.5799.23143.45207.70290.961. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On0.23040.46080.69120.92161.1520.1610.2180.1810.2920.6191.024

miniBUDE

Implementation: OpenMP - Input Deck: BM2

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On70140210280350SE +/- 0.49, N = 3SE +/- 0.54, N = 3SE +/- 0.99, N = 6SE +/- 0.36, N = 3SE +/- 1.86, N = 3SE +/- 1.89, N = 479.72103.55104.11145.75254.85342.511. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On0.15280.30560.45840.61120.7640.1560.2040.1700.2460.4810.679

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On30K60K90K120K150KSE +/- 38.18, N = 3SE +/- 42.04, N = 3SE +/- 74.60, N = 3SE +/- 153.42, N = 3SE +/- 673.74, N = 3SE +/- 1008.13, N = 350413.9867701.6073906.76103184.01114083.24118103.941. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 2.52, N = 3SE +/- 2.81, N = 3SE +/- 1.04, N = 3SE +/- 1.24, N = 3SE +/- 0.29, N = 3SE +/- 1.97, N = 31750.304442.953878.796206.726218.2511029.451. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On16003200480064008000SE +/- 0.71, N = 3SE +/- 0.97, N = 3SE +/- 0.62, N = 3SE +/- 1.23, N = 3SE +/- 2.86, N = 3SE +/- 1.27, N = 31014.271119.451732.743738.923791.807420.491. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On0.15530.31060.46590.62120.77650.2400.2720.1680.2550.5180.690

Embree

Binary: Pathtracer ISPC - Model: Crown

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On0.11450.2290.34350.4580.57250.1670.1840.1100.1930.4180.509

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On50100150200250SE +/- 0.42, N = 6SE +/- 0.56, N = 6SE +/- 0.50, N = 6SE +/- 0.64, N = 6SE +/- 0.11, N = 8SE +/- 0.25, N = 996.34106.1890.40122.53177.68213.95

Embree

Binary: Pathtracer ISPC - Model: Crown

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On4080120160200SE +/- 0.27, N = 5SE +/- 0.17, N = 5SE +/- 5.25, N = 15SE +/- 0.53, N = 6SE +/- 0.42, N = 7SE +/- 0.47, N = 870.5174.8062.0492.65153.18181.89

miniBUDE

Implementation: OpenMP - Input Deck: BM1

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On16003200480064008000SE +/- 3.51, N = 5SE +/- 6.26, N = 5SE +/- 6.63, N = 6SE +/- 13.13, N = 7SE +/- 27.90, N = 8SE +/- 9.60, N = 101796.162339.322480.613586.275192.437274.051. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 12.20, N = 3SE +/- 13.49, N = 3SE +/- 24.70, N = 6SE +/- 9.11, N = 3SE +/- 46.49, N = 3SE +/- 47.16, N = 41993.072588.762602.653643.846371.328562.691. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.hdr_alb_nrm.3840x2160AVX-512 OffAVX-512 On0.00270.00540.00810.01080.01350.0060.0090.0070.0100.0120.012

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 1.4.0Run: RTLightmap.hdr.4096x4096AVX-512 OffAVX-512 On0.00110.00220.00330.00440.00550.0030.0040.0030.0040.0050.005

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.hdr_alb_nrm.3840x2160AVX-512 OffAVX-512 On0.94281.88562.82843.77124.714SE +/- 0.01, N = 4SE +/- 0.01, N = 5SE +/- 0.02, N = 5SE +/- 0.02, N = 6SE +/- 0.02, N = 5SE +/- 0.01, N = 52.072.942.954.193.463.48

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RTLightmap.hdr.4096x4096AVX-512 OffAVX-512 On0.44780.89561.34341.79122.239SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 4SE +/- 0.00, N = 3SE +/- 0.00, N = 31.031.421.481.991.721.66

OpenVKL

Benchmark: vklBenchmark ISPC

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCAVX-512 OffAVX-512 On30060090012001500SE +/- 1.86, N = 3SE +/- 1.76, N = 3SE +/- 4.16, N = 3SE +/- 2.52, N = 3SE +/- 13.87, N = 3SE +/- 16.33, N = 37929171034119611761341

OpenVKL

Benchmark: vklBenchmark ISPC

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCAVX-512 OffAVX-512 On0.64671.29341.94012.58683.23351.7342.0141.7262.0572.4052.874

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On0.01690.03380.05070.06760.08450.0270.0400.0340.0540.0430.075

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On0.01670.03340.05010.06680.08350.0260.0400.0330.0530.0410.074

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On0.02070.04140.06210.08280.10350.0380.0490.0480.0640.0650.092

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On1020304050SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 314.3521.2223.1736.3626.4043.71

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On1020304050SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 313.7821.0622.8335.9525.3143.24

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On1224364860SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 319.9625.5232.4842.9740.6754.16

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On130260390520650SE +/- 0.52, N = 3SE +/- 0.49, N = 3SE +/- 0.93, N = 3SE +/- 0.95, N = 3SE +/- 0.22, N = 3SE +/- 0.55, N = 3183.83227.45264.77424.27510.88613.94

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On30060090012001500SE +/- 0.62, N = 3SE +/- 0.94, N = 3SE +/- 0.51, N = 3SE +/- 2.15, N = 3SE +/- 0.56, N = 3SE +/- 3.78, N = 3379.58455.03584.15875.641006.081205.18

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On60120180240300SE +/- 0.44, N = 3SE +/- 0.16, N = 3SE +/- 0.21, N = 3SE +/- 0.71, N = 3SE +/- 0.04, N = 3SE +/- 0.36, N = 3113.33228.12187.65281.24206.32191.33

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On400800120016002000SE +/- 1.47, N = 3SE +/- 0.98, N = 3SE +/- 0.84, N = 3SE +/- 1.88, N = 3SE +/- 0.94, N = 3SE +/- 1.71, N = 3541.86835.78832.851492.881410.421966.41

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On816243240SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 316.8320.1921.2927.0730.8634.23

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On306090120150SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 0.17, N = 3SE +/- 0.03, N = 3SE +/- 0.22, N = 3SE +/- 0.19, N = 343.1148.4166.7592.02120.5184.87

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On20406080100SE +/- 0.14, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.16, N = 3SE +/- 0.67, N = 345.8579.1446.8683.7071.51100.29

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On150300450600750SE +/- 0.92, N = 3SE +/- 0.18, N = 3SE +/- 0.51, N = 3SE +/- 1.22, N = 3SE +/- 1.03, N = 3SE +/- 5.42, N = 13158.53221.73232.21355.67491.34704.58

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On306090120150SE +/- 0.21, N = 3SE +/- 0.06, N = 3SE +/- 0.59, N = 3SE +/- 1.49, N = 15SE +/- 1.97, N = 15SE +/- 2.25, N = 1569.7383.4284.84100.54109.26126.01

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On2004006008001000SE +/- 0.62, N = 3SE +/- 0.38, N = 3SE +/- 0.43, N = 3SE +/- 0.33, N = 3SE +/- 0.26, N = 3SE +/- 2.56, N = 3247.27318.79405.72592.45660.54809.08

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On816243240SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 316.8020.2321.1826.8430.4634.50

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On306090120150SE +/- 0.16, N = 3SE +/- 0.01, N = 3SE +/- 0.23, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 343.1648.2466.7392.03120.5284.40

Cpuminer-Opt

Algorithm: scrypt

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptAVX-512 OffAVX-512 On10002000300040005000SE +/- 0.63, N = 3SE +/- 7.11, N = 3SE +/- 0.54, N = 3SE +/- 1.21, N = 3SE +/- 0.03, N = 3SE +/- 13.77, N = 31122.742307.421623.883665.552947.944816.311. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Triple SHA-256, Onecoin

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Triple SHA-256, OnecoinAVX-512 OffAVX-512 On700K1400K2100K2800K3500KSE +/- 579.55, N = 3SE +/- 8466.21, N = 3SE +/- 3398.36, N = 3SE +/- 18201.57, N = 3SE +/- 18173.37, N = 3SE +/- 23073.29, N = 15647033132854710926372074200333885033262871. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteAVX-512 OffAVX-512 On500K1000K1500K2000K2500KSE +/- 4107.35, N = 3SE +/- 1289.92, N = 3SE +/- 657.95, N = 3SE +/- 3990.27, N = 3SE +/- 7009.29, N = 3SE +/- 10844.37, N = 33551739240406873201472620133436322525001. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: scrypt

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptAVX-512 OffAVX-512 On2468102.2494.6272.6185.6365.4378.054

Cpuminer-Opt

Algorithm: Deepcoin

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: DeepcoinAVX-512 OffAVX-512 On60120180240300116.45130.17139.12161.98284.10274.20

Cpuminer-Opt

Algorithm: Skeincoin

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinAVX-512 OffAVX-512 On7001400210028003500800.441225.351035.241658.462428.443141.21

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsAVX-512 OffAVX-512 On400800120016002000314.92841.20404.761033.12834.911639.75

Cpuminer-Opt

Algorithm: x25x

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xAVX-512 OffAVX-512 On16003200480064008000SE +/- 4.47, N = 3SE +/- 4.49, N = 3SE +/- 21.26, N = 6SE +/- 26.18, N = 3SE +/- 0.55, N = 3SE +/- 54.56, N = 31840.412650.362166.904071.595712.587691.781. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Triple SHA-256, Onecoin

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: Triple SHA-256, OnecoinAVX-512 OffAVX-512 On120024003600480060001301.102672.901741.893203.655632.974975.70

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteAVX-512 OffAVX-512 On8001600240032004000710.081859.261053.062276.982351.123555.70

Cpuminer-Opt

Algorithm: x25x

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xAVX-512 OffAVX-512 On36912153.7135.3383.3136.32210.30213.447

Cpuminer-Opt

Algorithm: Deepcoin

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: DeepcoinAVX-512 OffAVX-512 On40K80K120K160K200KSE +/- 32.15, N = 3SE +/- 52.92, N = 3SE +/- 928.66, N = 3SE +/- 155.06, N = 3SE +/- 204.21, N = 3SE +/- 536.94, N = 35793064690911071055131652401602901. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Skeincoin

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinAVX-512 OffAVX-512 On400K800K1200K1600K2000KSE +/- 716.54, N = 3SE +/- 438.80, N = 3SE +/- 329.36, N = 3SE +/- 668.14, N = 3SE +/- 7503.92, N = 3SE +/- 4597.66, N = 33993506132736777331072453141306319907901. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsAVX-512 OffAVX-512 On200K400K600K800K1000KSE +/- 498.81, N = 3SE +/- 390.61, N = 3SE +/- 820.11, N = 3SE +/- 1047.73, N = 3SE +/- 1744.51, N = 3SE +/- 3825.46, N = 315708341913326391767267749278010689931. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2976.98 / Max: 3411Min: 2300 / Avg: 2795.9 / Max: 3409Min: 1900 / Avg: 3038.98 / Max: 3517Min: 1900 / Avg: 2810.29 / Max: 3515Min: 3709 / Avg: 3709 / Max: 3709Min: 3700 / Avg: 3708.95 / Max: 3709

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2912.11 / Max: 3406Min: 2300 / Avg: 2658.36 / Max: 3406Min: 1900 / Avg: 2946.44 / Max: 3517Min: 1900 / Avg: 2739.54 / Max: 3513Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2943.87 / Max: 3400Min: 2300 / Avg: 2506.26 / Max: 3400Min: 1900 / Avg: 3287.49 / Max: 3517Min: 1900 / Avg: 3360.23 / Max: 3516Min: 3698 / Avg: 3708.91 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2701.11 / Max: 3401Min: 2300 / Avg: 2582.73 / Max: 3401Min: 1900 / Avg: 2690.42 / Max: 3512Min: 1900 / Avg: 2613.81 / Max: 3508Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2813.09 / Max: 3401Min: 2300 / Avg: 2702.75 / Max: 3401Min: 1900 / Avg: 3376.77 / Max: 3517Min: 1900 / Avg: 3277.52 / Max: 3516Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2835.42 / Max: 3408Min: 2300 / Avg: 2731.23 / Max: 3408Min: 1900 / Avg: 2897.84 / Max: 3517Min: 1900 / Avg: 2758.89 / Max: 3517Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2936.97 / Max: 3405Min: 2300 / Avg: 2689.46 / Max: 3402Min: 1900 / Avg: 3338.2 / Max: 3518Min: 1900 / Avg: 3337.42 / Max: 3517Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2856.54 / Max: 3402Min: 2300 / Avg: 2704.63 / Max: 3402Min: 1900 / Avg: 2956.37 / Max: 3516Min: 1900 / Avg: 2821.77 / Max: 3515Min: 3703 / Avg: 3708.97 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 3086.6 / Max: 3400Min: 2300 / Avg: 2877.68 / Max: 3400Min: 1900 / Avg: 3335.14 / Max: 3516Min: 1900 / Avg: 3282.46 / Max: 3518Min: 3697 / Avg: 3708.98 / Max: 3709Min: 3700 / Avg: 3708.99 / Max: 3709

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2883.8 / Max: 3400Min: 2300 / Avg: 2672.86 / Max: 3410Min: 1900 / Avg: 2540.23 / Max: 3513Min: 1900 / Avg: 2474.62 / Max: 3509Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2834.61 / Max: 3407Min: 2300 / Avg: 2707.62 / Max: 3403Min: 1900 / Avg: 3338.32 / Max: 3520Min: 1900 / Avg: 3216.06 / Max: 3518Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2851.54 / Max: 3409Min: 2300 / Avg: 2747.12 / Max: 3411Min: 1900 / Avg: 2907.36 / Max: 3519Min: 1900 / Avg: 2733.68 / Max: 3518Min: 3709 / Avg: 3709 / Max: 3709Min: 3697 / Avg: 3708.93 / Max: 3709

LeelaChessZero

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.28CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 3292.51 / Max: 3407Min: 2300 / Avg: 3285.55 / Max: 3420Min: 1900 / Avg: 3429.01 / Max: 3524Min: 1900 / Avg: 3432.97 / Max: 3523Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709.02 / Max: 3731

LeelaChessZero

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.28CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 3281.52 / Max: 3416Min: 2300 / Avg: 3283.63 / Max: 3411Min: 1900 / Avg: 3415.13 / Max: 3542Min: 1900 / Avg: 3431.65 / Max: 3563Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3711

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2765.28 / Max: 3401Min: 2300 / Avg: 2565.14 / Max: 3400Min: 1900 / Avg: 3074.54 / Max: 3507Min: 1900 / Avg: 3148.38 / Max: 3511Min: 2833 / Avg: 3434 / Max: 3709Min: 2918 / Avg: 3474.26 / Max: 3709

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2850.31 / Max: 3400Min: 2300 / Avg: 2636.37 / Max: 3400Min: 1900 / Avg: 3070.52 / Max: 3512Min: 1900 / Avg: 3006.61 / Max: 3508Min: 2771 / Avg: 3462.8 / Max: 3709Min: 2763 / Avg: 3454.37 / Max: 3709

OpenVKL

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOpenVKL 1.3.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2988.69 / Max: 3410Min: 2262 / Avg: 2929.05 / Max: 3409Min: 1899 / Avg: 2931.06 / Max: 3519Min: 1169 / Avg: 2887.71 / Max: 3515Min: 2621 / Avg: 3442.04 / Max: 3709Min: 2591 / Avg: 3486.01 / Max: 3709

Intel Open Image Denoise

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterIntel Open Image Denoise 1.4.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2644.39 / Max: 3400Min: 2300 / Avg: 2484.49 / Max: 3123Min: 1900 / Avg: 2976.52 / Max: 3510Min: 1900 / Avg: 2985.41 / Max: 3510Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Intel Open Image Denoise

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterIntel Open Image Denoise 1.4.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2632.24 / Max: 3400Min: 2300 / Avg: 2543.96 / Max: 3400Min: 1900 / Avg: 2888.03 / Max: 3505Min: 1900 / Avg: 2755.84 / Max: 3503Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2855.45 / Max: 3400Min: 2300 / Avg: 2866.53 / Max: 3402Min: 1900 / Avg: 2900.68 / Max: 3504Min: 1900 / Avg: 2652.54 / Max: 3514Min: 2771 / Avg: 3210.13 / Max: 3709Min: 2802 / Avg: 3315.52 / Max: 3709

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2842.78 / Max: 3400Min: 2200 / Avg: 2873.43 / Max: 3400Min: 1900 / Avg: 2870.01 / Max: 3506Min: 1900 / Avg: 2689.91 / Max: 3502Min: 2771 / Avg: 3286.61 / Max: 3709Min: 2796 / Avg: 3267.78 / Max: 3709

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2293 / Avg: 2874.31 / Max: 3400Min: 2300 / Avg: 2590.11 / Max: 3402Min: 1900 / Avg: 2827.79 / Max: 3508Min: 1900 / Avg: 2769.32 / Max: 3512Min: 2690 / Avg: 3283.87 / Max: 3709Min: 2764 / Avg: 3287.4 / Max: 3772

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 1783 / Avg: 2893.57 / Max: 3403Min: 2300 / Avg: 2622.27 / Max: 3401Min: 1900 / Avg: 2891.42 / Max: 3545Min: 1900 / Avg: 2818.86 / Max: 3514Min: 2720 / Avg: 3276 / Max: 3709Min: 2646 / Avg: 3229.97 / Max: 3709

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 1631 / Avg: 2895.11 / Max: 3404Min: 2300 / Avg: 2639.14 / Max: 3403Min: 1900 / Avg: 2891.51 / Max: 3509Min: 1900 / Avg: 2766.18 / Max: 3509Min: 2773 / Avg: 3122.61 / Max: 3709Min: 2682 / Avg: 3157.82 / Max: 3709

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 1740 / Avg: 2881.42 / Max: 3403Min: 2300 / Avg: 2594.91 / Max: 3401Min: 1900 / Avg: 2877.33 / Max: 3513Min: 1900 / Avg: 2787.1 / Max: 3505Min: 2789 / Avg: 3177.76 / Max: 3709Min: 2771 / Avg: 3169.22 / Max: 3709

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 1947 / Avg: 2897.09 / Max: 3403Min: 2300 / Avg: 2609.05 / Max: 3401Min: 1900 / Avg: 2874.56 / Max: 3509Min: 1900 / Avg: 2823.98 / Max: 3514Min: 2721 / Avg: 3208.32 / Max: 3709Min: 2671 / Avg: 3308.27 / Max: 3711

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 1835 / Avg: 2867.88 / Max: 3402Min: 2300 / Avg: 2615.33 / Max: 3403Min: 1900 / Avg: 2836.9 / Max: 3512Min: 1900 / Avg: 2841.62 / Max: 3508Min: 2726 / Avg: 3186.89 / Max: 3709Min: 2777 / Avg: 3169.51 / Max: 3709

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 1597 / Avg: 2940.27 / Max: 3407Min: 2300 / Avg: 2577.91 / Max: 3401Min: 1900 / Avg: 2875.06 / Max: 3514Min: 1900 / Avg: 2803.99 / Max: 3513Min: 2721 / Avg: 3353.6 / Max: 3709Min: 2702 / Avg: 3343.21 / Max: 3709

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2610.75 / Max: 3145Min: 2300 / Avg: 2463.92 / Max: 3025Min: 1900 / Avg: 3132.72 / Max: 3511Min: 1900 / Avg: 3013.2 / Max: 3507Min: 3570 / Avg: 3666 / Max: 3709Min: 3403 / Avg: 3617.61 / Max: 3709

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2914.43 / Max: 3000Min: 2300 / Avg: 2665.18 / Max: 2970Min: 1900 / Avg: 2927.59 / Max: 3501Min: 1900 / Avg: 2817.46 / Max: 3508Min: 2936 / Avg: 3110.3 / Max: 3709Min: 2986 / Avg: 3249.64 / Max: 3709

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2888.78 / Max: 3283Min: 2300 / Avg: 2643.21 / Max: 3400Min: 1900 / Avg: 2957.05 / Max: 3510Min: 1900 / Avg: 2875.21 / Max: 3511Min: 3008 / Avg: 3335.89 / Max: 3709Min: 3178 / Avg: 3465.81 / Max: 3714

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2868.13 / Max: 3101Min: 2300 / Avg: 2651.15 / Max: 3400Min: 1900 / Avg: 2927.09 / Max: 3501Min: 1900 / Avg: 2857.47 / Max: 3507Min: 3033 / Avg: 3343.09 / Max: 3709Min: 3114 / Avg: 3410.31 / Max: 3709

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2916.53 / Max: 3305Min: 2300 / Avg: 2832.8 / Max: 3402Min: 1900 / Avg: 2906.57 / Max: 3511Min: 1900 / Avg: 2729.58 / Max: 3501Min: 3295 / Avg: 3487.56 / Max: 3709Min: 3132 / Avg: 3368.18 / Max: 3709

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2798.55 / Max: 3145Min: 2300 / Avg: 2779.27 / Max: 3400Min: 1900 / Avg: 2857.54 / Max: 3507Min: 1900 / Avg: 2936.48 / Max: 3508Min: 2899 / Avg: 3360.04 / Max: 3709Min: 3239 / Avg: 3515.22 / Max: 3709

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2776.23 / Max: 3195Min: 2300 / Avg: 2673.53 / Max: 3063Min: 1900 / Avg: 2872.56 / Max: 3501Min: 2700 / Avg: 2861.18 / Max: 3505Min: 2896 / Avg: 3299.49 / Max: 3709Min: 3001 / Avg: 3367.28 / Max: 3709

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2737.13 / Max: 3400Min: 2300 / Avg: 2623.57 / Max: 3400Min: 1900 / Avg: 2760.78 / Max: 3502Min: 1900 / Avg: 2817.16 / Max: 3501Min: 2733 / Avg: 3270.61 / Max: 3709Min: 3092 / Avg: 3394.73 / Max: 3709

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2585.83 / Max: 3400Min: 2300 / Avg: 2378.88 / Max: 3400Min: 1900 / Avg: 2584.6 / Max: 3508Min: 1900 / Avg: 2332.5 / Max: 3508Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2952.33 / Max: 3400Min: 2300 / Avg: 2464.76 / Max: 3400Min: 2327 / Avg: 2504.87 / Max: 3513Min: 1900 / Avg: 2571.73 / Max: 3502Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2788.99 / Max: 3402Min: 2300 / Avg: 2555.76 / Max: 3400Min: 1900 / Avg: 2479.96 / Max: 3506Min: 1900 / Avg: 2431.39 / Max: 3509Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2689.33 / Max: 3014Min: 2300 / Avg: 2694.51 / Max: 3194Min: 1900 / Avg: 2980.48 / Max: 3511Min: 1900 / Avg: 3105.81 / Max: 3512Min: 3145 / Avg: 3570.92 / Max: 3709Min: 3296 / Avg: 3597.25 / Max: 3709

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2943.56 / Max: 3400Min: 2300 / Avg: 2927.95 / Max: 3402Min: 1900 / Avg: 3016.33 / Max: 3515Min: 1900 / Avg: 2986.92 / Max: 3558Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

OpenFOAM

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2959.08 / Max: 3400Min: 2300 / Avg: 2948.55 / Max: 3400Min: 1900 / Avg: 2735.03 / Max: 3517Min: 1900 / Avg: 2718.73 / Max: 3515Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709.02 / Max: 3714

OpenFOAM

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2980.24 / Max: 3408Min: 2300 / Avg: 2974.56 / Max: 3400Min: 2491 / Avg: 2870.69 / Max: 3516Min: 2451 / Avg: 2868.19 / Max: 3513Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

SMHasher

Hash: FarmHash32 x86_64 AVX

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX-512 OffAVX-512 On9K18K27K36K45KSE +/- 181.36, N = 4SE +/- 1.95, N = 4SE +/- 181.17, N = 4SE +/- 68.33, N = 4SE +/- 41.48, N = 5SE +/- 0.56, N = 530330.5333979.9937809.7142508.3536458.3139795.361. (CXX) g++ options: -O3 -march=native -mno-amx-tile -flto=auto -fno-fat-lto-objects

LeelaChessZero

Backend: BLAS

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: BLASAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 47.46, N = 5SE +/- 68.15, N = 3SE +/- 61.68, N = 3SE +/- 133.67, N = 3SE +/- 92.33, N = 9SE +/- 36.09, N = 347805524754210671942591711. (CXX) g++ options: -flto -O3 -march=native -mno-amx-tile -pthread

LeelaChessZero

Backend: BLAS

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.28Backend: BLASAVX-512 OffAVX-512 On61218243012.0914.0114.1119.8124.7024.19

LeelaChessZero

Backend: Eigen

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.28Backend: EigenAVX-512 OffAVX-512 On61218243012.0614.5315.3820.6121.8924.74

LeelaChessZero

Backend: Eigen

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: EigenAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 58.86, N = 3SE +/- 64.32, N = 4SE +/- 63.14, N = 3SE +/- 151.11, N = 3SE +/- 66.84, N = 3SE +/- 35.63, N = 347095750824311134816190851. (CXX) g++ options: -flto -O3 -march=native -mno-amx-tile -pthread

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 39 / Avg: 62.34 / Max: 77Min: 37 / Avg: 61.39 / Max: 74Min: 36 / Avg: 46.12 / Max: 53Min: 37 / Avg: 47.32 / Max: 53Min: 29.25 / Avg: 48.39 / Max: 60.5Min: 31.88 / Avg: 48.49 / Max: 59.25

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 54 / Avg: 70.96 / Max: 78Min: 53 / Avg: 67.48 / Max: 74Min: 36 / Avg: 49.25 / Max: 54Min: 38 / Avg: 48.66 / Max: 53Min: 42.63 / Avg: 55.22 / Max: 61Min: 41.25 / Avg: 53.22 / Max: 60

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 55 / Avg: 72.43 / Max: 78Min: 53 / Avg: 69.21 / Max: 74Min: 36 / Avg: 47.99 / Max: 52Min: 38 / Avg: 48.31 / Max: 52Min: 43.5 / Avg: 54.68 / Max: 57.75Min: 43.5 / Avg: 51.97 / Max: 57.25

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 57 / Avg: 73.09 / Max: 77Min: 54 / Avg: 71.83 / Max: 77Min: 37 / Avg: 49.9 / Max: 54Min: 37 / Avg: 50.14 / Max: 54Min: 43 / Avg: 56.4 / Max: 61.38Min: 42.13 / Avg: 55.39 / Max: 60.88

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 53 / Avg: 66.51 / Max: 75Min: 54 / Avg: 67.84 / Max: 75Min: 36 / Avg: 46.86 / Max: 52Min: 37 / Avg: 47.84 / Max: 53Min: 44.38 / Avg: 53.07 / Max: 59.13Min: 43.5 / Avg: 52.39 / Max: 57.75

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 51 / Avg: 64.63 / Max: 73Min: 54 / Avg: 67.15 / Max: 75Min: 37 / Avg: 46.87 / Max: 52Min: 38 / Avg: 47.81 / Max: 53Min: 43.88 / Avg: 54.3 / Max: 62.25Min: 43.5 / Avg: 52.19 / Max: 59.13

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 51 / Avg: 65.88 / Max: 73Min: 52 / Avg: 66.78 / Max: 74Min: 35 / Avg: 46.14 / Max: 52Min: 37 / Avg: 47.74 / Max: 53Min: 43 / Avg: 52.81 / Max: 58.25Min: 43 / Avg: 52.83 / Max: 57.75

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 53 / Avg: 65.7 / Max: 74Min: 54 / Avg: 68.2 / Max: 75Min: 37 / Avg: 47.69 / Max: 53Min: 38 / Avg: 48.39 / Max: 53Min: 37.25 / Avg: 44.79 / Max: 51.25Min: 44.38 / Avg: 52.93 / Max: 60

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 51 / Avg: 66.11 / Max: 71Min: 54 / Avg: 65.21 / Max: 69Min: 36 / Avg: 45.53 / Max: 49Min: 38 / Avg: 45.45 / Max: 49Min: 34.13 / Avg: 42.84 / Max: 47.75Min: 36.38 / Avg: 42.68 / Max: 48

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 51 / Avg: 70.06 / Max: 77Min: 51 / Avg: 70.25 / Max: 76Min: 35 / Avg: 49.22 / Max: 53Min: 36 / Avg: 49.76 / Max: 54Min: 33.63 / Avg: 46.39 / Max: 50.63Min: 33.63 / Avg: 46.32 / Max: 50.63

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 51 / Avg: 65.39 / Max: 73Min: 53 / Avg: 67.31 / Max: 75Min: 36 / Avg: 46.62 / Max: 53Min: 37 / Avg: 47.75 / Max: 53Min: 34.63 / Avg: 43.61 / Max: 48.38Min: 34.13 / Avg: 43.31 / Max: 48

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 51 / Avg: 64.77 / Max: 74Min: 54 / Avg: 66.83 / Max: 75Min: 37 / Avg: 46.66 / Max: 54Min: 38 / Avg: 47.79 / Max: 53Min: 34.63 / Avg: 44.85 / Max: 55.13Min: 34.63 / Avg: 43.53 / Max: 49.5

LeelaChessZero

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.28CPU Temperature MonitorAVX-512 OffAVX-512 On1632486480Min: 45 / Avg: 60.47 / Max: 85Min: 54 / Avg: 71.37 / Max: 78Min: 36 / Avg: 48.76 / Max: 59Min: 35 / Avg: 44.16 / Max: 56Min: 33.63 / Avg: 46.72 / Max: 58.25Min: 33.25 / Avg: 40.84 / Max: 54.63

LeelaChessZero

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.28CPU Temperature MonitorAVX-512 OffAVX-512 On1632486480Min: 44 / Avg: 65.29 / Max: 84Min: 45 / Avg: 66.24 / Max: 82Min: 35 / Avg: 47.75 / Max: 56Min: 34 / Avg: 43.65 / Max: 56Min: 34.63 / Avg: 46.31 / Max: 59.13Min: 33.25 / Avg: 40.64 / Max: 53.75

Embree

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 44 / Avg: 57.26 / Max: 66Min: 50 / Avg: 59.72 / Max: 67Min: 39 / Avg: 46.46 / Max: 51Min: 34 / Avg: 41.38 / Max: 47Min: 35.88 / Avg: 41.18 / Max: 48Min: 32.38 / Avg: 37.98 / Max: 44.38

Embree

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 48 / Avg: 61.37 / Max: 69Min: 46 / Avg: 57.94 / Max: 65Min: 37 / Avg: 46.83 / Max: 51Min: 34 / Avg: 42.39 / Max: 48Min: 35 / Avg: 42.18 / Max: 48.88Min: 33.25 / Avg: 39.98 / Max: 46.63

OpenVKL

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVKL 1.3.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 50 / Avg: 69.77 / Max: 80Min: 46 / Avg: 69.3 / Max: 78Min: 36 / Avg: 49.72 / Max: 57Min: 35 / Avg: 48.73 / Max: 56Min: 35.5 / Avg: 47.03 / Max: 54.63Min: 34.13 / Avg: 45.24 / Max: 52.88

Intel Open Image Denoise

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 50 / Avg: 61.2 / Max: 75Min: 48 / Avg: 59.52 / Max: 72Min: 37 / Avg: 43.04 / Max: 50Min: 37 / Avg: 42.14 / Max: 50Min: 35.88 / Avg: 40.59 / Max: 46.63Min: 35 / Avg: 39.27 / Max: 45.5

Intel Open Image Denoise

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 47 / Avg: 59.15 / Max: 71Min: 45 / Avg: 57.82 / Max: 69Min: 35 / Avg: 43.41 / Max: 50Min: 35 / Avg: 42.32 / Max: 49Min: 34.63 / Avg: 40.87 / Max: 46.63Min: 33.25 / Avg: 39.68 / Max: 46.38

OSPRay

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 46 / Avg: 72.76 / Max: 79Min: 46 / Avg: 73.63 / Max: 80Min: 35 / Avg: 54.32 / Max: 58Min: 34 / Avg: 52.96 / Max: 57Min: 34.63 / Avg: 51.95 / Max: 55.25Min: 32.75 / Avg: 49.32 / Max: 52

OSPRay

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 56 / Avg: 72.16 / Max: 76Min: 52 / Avg: 71.64 / Max: 75Min: 39 / Avg: 55.05 / Max: 58Min: 40 / Avg: 53.77 / Max: 57Min: 37.75 / Avg: 52.77 / Max: 55.5Min: 35.88 / Avg: 49.7 / Max: 52.88

OSPRay

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 55 / Avg: 73.2 / Max: 77Min: 53 / Avg: 71.52 / Max: 75Min: 40 / Avg: 55.09 / Max: 58Min: 39 / Avg: 54.1 / Max: 58Min: 37.25 / Avg: 53.21 / Max: 56.88Min: 36.38 / Avg: 50.52 / Max: 53.25

OSPRay Studio

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 54 / Avg: 69.43 / Max: 76Min: 53 / Avg: 69.12 / Max: 75Min: 35 / Avg: 51.94 / Max: 57Min: 35 / Avg: 51.67 / Max: 57Min: 37.25 / Avg: 51.89 / Max: 55.5Min: 36.38 / Avg: 50.48 / Max: 53.75

OSPRay Studio

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 53 / Avg: 68.82 / Max: 75Min: 50 / Avg: 67.06 / Max: 74Min: 38 / Avg: 51.75 / Max: 57Min: 38 / Avg: 53.78 / Max: 58Min: 37.25 / Avg: 53.26 / Max: 58.25Min: 36.75 / Avg: 51.41 / Max: 55.25

OSPRay Studio

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 53 / Avg: 70.9 / Max: 77Min: 50 / Avg: 69.76 / Max: 75Min: 39 / Avg: 52.35 / Max: 57Min: 39 / Avg: 52.99 / Max: 57Min: 37.75 / Avg: 52.06 / Max: 55.5Min: 36.75 / Avg: 52.26 / Max: 54.63

OSPRay Studio

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 51 / Avg: 69.42 / Max: 76Min: 50 / Avg: 68.75 / Max: 75Min: 38 / Avg: 52.47 / Max: 57Min: 39 / Avg: 52.34 / Max: 57Min: 37.75 / Avg: 52.04 / Max: 55.5Min: 37.25 / Avg: 50.44 / Max: 53.75

OSPRay Studio

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 51 / Avg: 71.52 / Max: 77Min: 52 / Avg: 68.49 / Max: 74Min: 38 / Avg: 53.76 / Max: 58Min: 39 / Avg: 51.56 / Max: 57Min: 37.25 / Avg: 52.98 / Max: 56.38Min: 37.25 / Avg: 52.28 / Max: 56.38

OSPRay Studio

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 53 / Avg: 66.34 / Max: 73Min: 49 / Avg: 70.06 / Max: 75Min: 39 / Avg: 53.34 / Max: 58Min: 39 / Avg: 52.54 / Max: 57Min: 38.13 / Avg: 52.62 / Max: 59.25Min: 36.75 / Avg: 51.43 / Max: 54.63

oneDNN

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.0CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 50 / Avg: 57.62 / Max: 69Min: 51 / Avg: 59.32 / Max: 70Min: 33 / Avg: 39.82 / Max: 48Min: 36 / Avg: 40.95 / Max: 47Min: 33.63 / Avg: 36.99 / Max: 40.88Min: 34.13 / Avg: 37.73 / Max: 41.75

Cpuminer-Opt

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 49 / Avg: 68.06 / Max: 73Min: 48 / Avg: 68.72 / Max: 75Min: 37 / Avg: 50.54 / Max: 55Min: 36 / Avg: 51.1 / Max: 56Min: 34.13 / Avg: 48.03 / Max: 52Min: 34.13 / Avg: 50.14 / Max: 55.63

Cpuminer-Opt

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 51 / Avg: 69.9 / Max: 74Min: 51 / Avg: 70.07 / Max: 75Min: 40 / Avg: 51.93 / Max: 56Min: 39 / Avg: 52.28 / Max: 56Min: 35.88 / Avg: 50.93 / Max: 54.25Min: 36.75 / Avg: 55.17 / Max: 58.75

Cpuminer-Opt

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 51 / Avg: 70.21 / Max: 75Min: 52 / Avg: 70.84 / Max: 75Min: 39 / Avg: 53.91 / Max: 58Min: 39 / Avg: 52.72 / Max: 57Min: 36.38 / Avg: 50.97 / Max: 54.25Min: 38.13 / Avg: 52.94 / Max: 56.13

Cpuminer-Opt

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 53 / Avg: 69.68 / Max: 74Min: 51 / Avg: 69.47 / Max: 74Min: 40 / Avg: 53.43 / Max: 57Min: 38 / Avg: 52.08 / Max: 56Min: 36.75 / Avg: 50.8 / Max: 54.63Min: 37.25 / Avg: 52.15 / Max: 55.5

Cpuminer-Opt

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 53 / Avg: 70.18 / Max: 74Min: 52 / Avg: 70.34 / Max: 75Min: 42 / Avg: 54.53 / Max: 58Min: 39 / Avg: 53.02 / Max: 57Min: 36.38 / Avg: 50.56 / Max: 53.75Min: 36.63 / Avg: 50.78 / Max: 54.25

Cpuminer-Opt

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 51 / Avg: 69.73 / Max: 74Min: 52 / Avg: 71.11 / Max: 77Min: 40 / Avg: 53.91 / Max: 58Min: 39 / Avg: 52.76 / Max: 56Min: 36.38 / Avg: 50.92 / Max: 54.25Min: 36.38 / Avg: 52.6 / Max: 56.13

Cpuminer-Opt

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 52 / Avg: 69.81 / Max: 74Min: 52 / Avg: 70.74 / Max: 76Min: 40 / Avg: 54.02 / Max: 57Min: 39 / Avg: 52.42 / Max: 56Min: 36.75 / Avg: 51.26 / Max: 55.13Min: 37.25 / Avg: 53.37 / Max: 57.25

OpenVINO

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 54 / Avg: 73.27 / Max: 77Min: 54 / Avg: 73.47 / Max: 77Min: 40 / Avg: 53.81 / Max: 57Min: 39 / Avg: 52.99 / Max: 56Min: 36.75 / Avg: 50.69 / Max: 53.75Min: 36.38 / Avg: 50.87 / Max: 54.63

OpenVINO

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 54 / Avg: 74.99 / Max: 79Min: 53 / Avg: 74.24 / Max: 79Min: 40 / Avg: 53.23 / Max: 57Min: 40 / Avg: 52.32 / Max: 55Min: 37.25 / Avg: 52.53 / Max: 56Min: 37.75 / Avg: 51.65 / Max: 54.25

OpenVINO

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 54 / Avg: 72.7 / Max: 77Min: 54 / Avg: 72.62 / Max: 77Min: 40 / Avg: 53.53 / Max: 57Min: 40 / Avg: 52.8 / Max: 55Min: 37.25 / Avg: 50.88 / Max: 53.5Min: 37.13 / Avg: 52.63 / Max: 55.5

miniBUDE

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 50 / Avg: 65.07 / Max: 72Min: 52 / Avg: 65.79 / Max: 74Min: 39 / Avg: 48.48 / Max: 54Min: 40 / Avg: 46.05 / Max: 51Min: 35 / Avg: 42.25 / Max: 50.38Min: 35.88 / Avg: 41.15 / Max: 49

miniBUDE

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OffAVX-512 On1632486480Min: 46 / Avg: 72.36 / Max: 85Min: 47 / Avg: 72.68 / Max: 84Min: 37 / Avg: 52.39 / Max: 59Min: 37 / Avg: 48.68 / Max: 55Min: 34.13 / Avg: 48.71 / Max: 55.63Min: 34.13 / Avg: 47.83 / Max: 54.25

OpenFOAM

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 39 / Avg: 71.62 / Max: 78Min: 40 / Avg: 71.85 / Max: 80Min: 30 / Avg: 53.51 / Max: 59Min: 33 / Avg: 54.15 / Max: 59Min: 31.88 / Avg: 53.96 / Max: 60Min: 36.38 / Avg: 55.35 / Max: 60.88

OpenFOAM

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 51 / Avg: 70.16 / Max: 75Min: 50 / Avg: 69.77 / Max: 75Min: 39 / Avg: 54.29 / Max: 60Min: 40 / Avg: 54.65 / Max: 60Min: 36.75 / Avg: 54.3 / Max: 61.38Min: 37.75 / Avg: 55.54 / Max: 62.63

SMHasher

Hash: FarmHash32 x86_64 AVX

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX-512 OffAVX-512 On714212835SE +/- 0.01, N = 4SE +/- 0.02, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 5SE +/- 0.16, N = 531.5831.0823.2723.2726.4126.551. (CXX) g++ options: -O3 -march=native -mno-amx-tile -flto=auto -fno-fat-lto-objects

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On30060090012001500SE +/- 1.00, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 1.20, N = 3149113089808597055811. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On5K10K15K20K25KSE +/- 42.81, N = 3SE +/- 8.41, N = 3SE +/- 37.53, N = 3SE +/- 19.41, N = 3SE +/- 8.39, N = 3SE +/- 7.00, N = 3239432087215601135891121692601. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On10K20K30K40K50KSE +/- 10.69, N = 3SE +/- 44.00, N = 3SE +/- 69.83, N = 3SE +/- 11.72, N = 3SE +/- 50.78, N = 3SE +/- 30.61, N = 34816541834313732720422475185001. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On400800120016002000SE +/- 1.00, N = 3SE +/- 0.00, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 317701563117010298366951. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On6K12K18K24K30KSE +/- 46.52, N = 3SE +/- 18.50, N = 3SE +/- 45.36, N = 3SE +/- 25.54, N = 3SE +/- 32.66, N = 3SE +/- 3.79, N = 32849024927186081633213341110581. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On13K26K39K52K65KSE +/- 56.19, N = 3SE +/- 4.98, N = 3SE +/- 115.86, N = 3SE +/- 45.83, N = 3SE +/- 18.25, N = 3SE +/- 44.52, N = 36278049847373003274926541221201. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On0.45280.90561.35841.81122.264SE +/- 0.002804, N = 9SE +/- 0.001297, N = 9SE +/- 0.006513, N = 9SE +/- 0.001579, N = 9SE +/- 0.002552, N = 9SE +/- 0.003984, N = 91.9928600.8751962.0124100.7368221.7366700.9862141. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Mobile Neural Network

Model: mobilenetV3

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenetV3AVX-512 OffAVX-512 On0.8751.752.6253.54.375SE +/- 0.022, N = 10SE +/- 0.025, N = 15SE +/- 0.012, N = 3SE +/- 0.005, N = 3SE +/- 0.049, N = 3SE +/- 0.053, N = 91.7641.7092.2882.0553.8893.8661. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: squeezenetv1.1AVX-512 OffAVX-512 On246810SE +/- 0.039, N = 10SE +/- 0.064, N = 15SE +/- 0.008, N = 3SE +/- 0.072, N = 3SE +/- 0.137, N = 3SE +/- 0.219, N = 92.6782.2973.5512.7377.5667.2041. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: resnet-v2-50AVX-512 OffAVX-512 On612182430SE +/- 0.099, N = 10SE +/- 0.074, N = 15SE +/- 0.060, N = 3SE +/- 0.065, N = 3SE +/- 0.300, N = 3SE +/- 0.193, N = 918.1337.90917.7168.49624.08114.7271. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0AVX-512 OffAVX-512 On3691215SE +/- 0.056, N = 10SE +/- 0.080, N = 15SE +/- 0.105, N = 3SE +/- 0.082, N = 3SE +/- 0.132, N = 3SE +/- 0.234, N = 94.1953.9995.2224.4159.2788.7621. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On0.35550.7111.06651.4221.7775SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.581.161.571.041.140.961. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On714212835SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 311.414.4930.9119.317.714.341. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 319.6817.8317.298.0112.646.461. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On50100150200250SE +/- 0.69, N = 3SE +/- 0.35, N = 3SE +/- 0.84, N = 3SE +/- 0.32, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 3217.10175.69226.27141.14187.35155.91

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On20406080100SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 0.18, N = 3SE +/- 0.04, N = 3SE +/- 0.26, N = 3105.2687.87102.6168.4395.1779.50

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On246810SE +/- 0.0346, N = 3SE +/- 0.0029, N = 3SE +/- 0.0060, N = 3SE +/- 0.0091, N = 3SE +/- 0.0009, N = 3SE +/- 0.0099, N = 38.81584.37505.32423.55094.84445.2240

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On1632486480SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 373.7547.8271.9340.1467.9048.70

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On1326395265SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 359.4249.5146.9736.9432.4029.20

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On2004006008001000SE +/- 1.29, N = 3SE +/- 3.51, N = 3SE +/- 1.38, N = 3SE +/- 0.76, N = 3SE +/- 0.46, N = 3SE +/- 2.80, N = 3916.94819.53887.59648.20787.331128.85

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On510152025SE +/- 0.0648, N = 3SE +/- 0.0206, N = 3SE +/- 0.0534, N = 3SE +/- 0.0214, N = 3SE +/- 0.0319, N = 3SE +/- 0.0671, N = 321.797312.626421.321211.937813.97409.9667

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On60120180240300SE +/- 1.34, N = 3SE +/- 0.11, N = 3SE +/- 0.30, N = 3SE +/- 0.53, N = 3SE +/- 0.35, N = 3SE +/- 0.99, N = 13251.57180.17257.56168.23194.72135.99

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On48121620SE +/- 0.0435, N = 3SE +/- 0.0082, N = 3SE +/- 0.0817, N = 3SE +/- 0.1607, N = 15SE +/- 0.1629, N = 15SE +/- 0.1413, N = 1514.328611.976911.78239.97349.18357.9604

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On4080120160200SE +/- 0.40, N = 3SE +/- 0.17, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.36, N = 3161.33125.16147.46101.04144.89118.35

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On1326395265SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 359.5249.4247.2137.2532.8328.98

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On2004006008001000SE +/- 2.25, N = 3SE +/- 0.79, N = 3SE +/- 2.38, N = 3SE +/- 0.72, N = 3SE +/- 0.15, N = 3SE +/- 1.43, N = 3913.42821.96889.39647.75787.721132.61

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeAVX-512 OffAVX-512 On4080120160200162.72160.66169.84159.67146.75145.901. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeAVX-512 OffAVX-512 On80160240320400358.63361.37194.79195.48110.95112.381. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Large Mesh Size - Mesh Time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Large Mesh Size - Mesh TimeAVX-512 OffAVX-512 On2004006008001000887.211051.351039.32847.91867.38996.781. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Large Mesh Size - Execution Time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Large Mesh Size - Execution TimeAVX-512 OffAVX-512 On150030004500600075007106.767117.014319.124305.122803.542849.611. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 79.98 / Avg: 423.53 / Max: 591.06Min: 116.32 / Avg: 423.16 / Max: 593.15Min: 202.66 / Avg: 577.34 / Max: 773.65Min: 213.45 / Avg: 574.76 / Max: 771.15Min: 58.55 / Avg: 490.27 / Max: 722.41Min: 58.49 / Avg: 475.62 / Max: 691.71

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 122.8 / Avg: 469.84 / Max: 592.57Min: 101.9 / Avg: 468.91 / Max: 551.9Min: 203.11 / Avg: 619.84 / Max: 770.48Min: 211.14 / Avg: 618.61 / Max: 769.39Min: 60.72 / Avg: 532.23 / Max: 674.52Min: 31.6 / Avg: 498.87 / Max: 641.77

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 123.39 / Avg: 336.16 / Max: 377.19Min: 118.87 / Avg: 330.83 / Max: 360.91Min: 106.99 / Avg: 477.41 / Max: 537.73Min: 209.97 / Avg: 483.39 / Max: 522.36Min: 56.69 / Avg: 346.41 / Max: 397.2Min: 58.85 / Avg: 324.27 / Max: 371.22

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 130.88 / Avg: 488.76 / Max: 594.17Min: 116.14 / Avg: 490.29 / Max: 592.28Min: 207.09 / Avg: 636.05 / Max: 765.98Min: 212.93 / Avg: 636.94 / Max: 774.46Min: 32.8 / Avg: 552.07 / Max: 653.8Min: 56.51 / Avg: 539.83 / Max: 646.46

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 118.87 / Avg: 314.48 / Max: 389.2Min: 115.91 / Avg: 309.32 / Max: 374.48Min: 203.35 / Avg: 468.13 / Max: 563.99Min: 106.45 / Avg: 468.4 / Max: 556.72Min: 42.78 / Avg: 344.31 / Max: 430.71Min: 60.73 / Avg: 336.08 / Max: 425.61

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 121.91 / Avg: 423.91 / Max: 595.14Min: 109.29 / Avg: 424.09 / Max: 596.7Min: 205.49 / Avg: 579.26 / Max: 771.92Min: 111.58 / Avg: 575.15 / Max: 772.59Min: 60.66 / Avg: 500.64 / Max: 721.31Min: 61.67 / Avg: 453.86 / Max: 632.57

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 122.5 / Avg: 322.04 / Max: 389.14Min: 83.01 / Avg: 313.16 / Max: 365.89Min: 110.3 / Avg: 466.39 / Max: 569.05Min: 214.75 / Avg: 471.13 / Max: 544.51Min: 30.08 / Avg: 340.51 / Max: 417.91Min: 61.86 / Avg: 340.27 / Max: 413.32

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 124.13 / Avg: 437.31 / Max: 595.17Min: 103.25 / Avg: 453.02 / Max: 598.46Min: 211.06 / Avg: 598.84 / Max: 769.45Min: 184.38 / Avg: 608.53 / Max: 775.32Min: 32.05 / Avg: 494 / Max: 713.94Min: 31.38 / Avg: 537.92 / Max: 712.89

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On90180270360450Min: 120.42 / Avg: 314.45 / Max: 351.47Min: 114.08 / Avg: 296.11 / Max: 324.93Min: 207.58 / Avg: 466.79 / Max: 528.2Min: 110.94 / Avg: 442.49 / Max: 492.85Min: 54.8 / Avg: 320.85 / Max: 377.94Min: 32.99 / Avg: 316.15 / Max: 367.34

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 121.41 / Avg: 485.92 / Max: 594.32Min: 117.09 / Avg: 488.17 / Max: 595.98Min: 212.95 / Avg: 636.84 / Max: 773.77Min: 108.87 / Avg: 636.97 / Max: 776.52Min: 33.52 / Avg: 555.47 / Max: 671.66Min: 59.96 / Avg: 563.77 / Max: 673.82

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 116.53 / Avg: 308.23 / Max: 388.94Min: 116.85 / Avg: 307.49 / Max: 373.85Min: 209.04 / Avg: 468.14 / Max: 560.62Min: 206.44 / Avg: 463.48 / Max: 559.71Min: 58.11 / Avg: 334.36 / Max: 425.46Min: 56.93 / Avg: 328.16 / Max: 419.54

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 120.76 / Avg: 424.25 / Max: 596.15Min: 116.32 / Avg: 423.52 / Max: 596.26Min: 179.48 / Avg: 575.96 / Max: 772.34Min: 184.97 / Avg: 576.22 / Max: 776.65Min: 45.38 / Avg: 492.05 / Max: 716.77Min: 62.09 / Avg: 449.53 / Max: 626.83

LeelaChessZero

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.28CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 117.5 / Avg: 395.29 / Max: 593.12Min: 81.58 / Avg: 394.24 / Max: 583.5Min: 207.43 / Avg: 534.64 / Max: 715.83Min: 208.76 / Avg: 538.72 / Max: 765.81Min: 55.77 / Avg: 381.66 / Max: 520.36Min: 57.22 / Avg: 379.11 / Max: 511.65

LeelaChessZero

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.28CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 124.39 / Avg: 390.39 / Max: 591.33Min: 123.27 / Avg: 395.84 / Max: 585.79Min: 207.21 / Avg: 535.98 / Max: 730.58Min: 211.45 / Avg: 540.33 / Max: 766.98Min: 58.03 / Avg: 372.74 / Max: 519.8Min: 59.5 / Avg: 367.29 / Max: 503.22

Embree

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 101.95 / Avg: 400.96 / Max: 615.31Min: 122.75 / Avg: 389.97 / Max: 625.41Min: 205.64 / Avg: 537.44 / Max: 760.22Min: 207.22 / Avg: 480.24 / Max: 708.89Min: 26.98 / Avg: 343.25 / Max: 711.13Min: 37.38 / Avg: 310.11 / Max: 703.12

Embree

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 80.21 / Avg: 421.57 / Max: 583.55Min: 118.24 / Avg: 406.24 / Max: 561.45Min: 172.58 / Avg: 565.19 / Max: 755.21Min: 209.36 / Avg: 478.88 / Max: 665.78Min: 42.7 / Avg: 366.77 / Max: 692.37Min: 36.29 / Avg: 357.33 / Max: 701.32

OpenVKL

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 1.3.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 101.07 / Avg: 456.78 / Max: 652.79Min: 100.02 / Avg: 455.32 / Max: 653.28Min: 183.35 / Avg: 599.21 / Max: 804.94Min: 179.36 / Avg: 581.38 / Max: 785.63Min: 60.18 / Avg: 488.95 / Max: 748.42Min: 57.24 / Avg: 466.56 / Max: 706.65

Intel Open Image Denoise

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 117.02 / Avg: 351.27 / Max: 568.33Min: 78.9 / Avg: 329.46 / Max: 563.85Min: 190.83 / Avg: 446.72 / Max: 747.36Min: 121.92 / Avg: 432.92 / Max: 757.14Min: 55.38 / Avg: 291.64 / Max: 587.02Min: 59.83 / Avg: 288.89 / Max: 584.26

Intel Open Image Denoise

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 81.25 / Avg: 374.67 / Max: 565.97Min: 119.6 / Avg: 359.55 / Max: 567.51Min: 204.01 / Avg: 487.71 / Max: 755.13Min: 207.41 / Avg: 477.81 / Max: 753.94Min: 30.85 / Avg: 328.65 / Max: 583.24Min: 57.92 / Avg: 331.79 / Max: 581.42

OSPRay

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 119.36 / Avg: 524.83 / Max: 617.87Min: 119.41 / Avg: 530.36 / Max: 641.9Min: 107.51 / Avg: 689.16 / Max: 818.74Min: 209.17 / Avg: 676.18 / Max: 801.55Min: 56.53 / Avg: 614.11 / Max: 718.03Min: 56.1 / Avg: 580.71 / Max: 668.08

OSPRay

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 133.04 / Avg: 523.63 / Max: 645.71Min: 124.97 / Avg: 528.92 / Max: 632.61Min: 206.88 / Avg: 688.18 / Max: 807.45Min: 211.39 / Avg: 674.63 / Max: 797.32Min: 57.79 / Avg: 616.9 / Max: 718.46Min: 60.18 / Avg: 581.84 / Max: 672.96

OSPRay

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 122.95 / Avg: 530.21 / Max: 639.78Min: 80.49 / Avg: 523.67 / Max: 629.96Min: 205.85 / Avg: 679.41 / Max: 796.02Min: 210.52 / Avg: 667.18 / Max: 772.19Min: 61.53 / Avg: 624.39 / Max: 724.31Min: 60.05 / Avg: 591.62 / Max: 680.48

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 129.57 / Avg: 500.65 / Max: 657.6Min: 102.33 / Avg: 497.27 / Max: 661.94Min: 212.33 / Avg: 663.86 / Max: 880.6Min: 178.24 / Avg: 661.77 / Max: 876.06Min: 60.36 / Avg: 615.21 / Max: 792.28Min: 60.79 / Avg: 611.59 / Max: 770.42

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 129.76 / Avg: 497.33 / Max: 659.2Min: 122.89 / Avg: 488.82 / Max: 662.51Min: 206.26 / Avg: 650.1 / Max: 877.56Min: 214.67 / Avg: 684.96 / Max: 875.35Min: 61.33 / Avg: 648.16 / Max: 799.28Min: 56.6 / Avg: 627.16 / Max: 783.63

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On160320480640800Min: 130.23 / Avg: 517.4 / Max: 652.59Min: 101.37 / Avg: 511.05 / Max: 668.12Min: 209.5 / Avg: 662.67 / Max: 884.59Min: 114.26 / Avg: 669.91 / Max: 876.36Min: 58.52 / Avg: 614.53 / Max: 802.45Min: 32.83 / Avg: 631.84 / Max: 775.3

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 81.76 / Avg: 503.22 / Max: 657.11Min: 111.41 / Avg: 500.78 / Max: 666.67Min: 212.51 / Avg: 666.51 / Max: 879.7Min: 214.02 / Avg: 660.08 / Max: 874.86Min: 60.27 / Avg: 620.19 / Max: 789.77Min: 58.16 / Avg: 599.55 / Max: 773.94

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On160320480640800Min: 117.01 / Avg: 524.66 / Max: 656.47Min: 100.35 / Avg: 499.04 / Max: 664.34Min: 179.46 / Avg: 687.97 / Max: 887.42Min: 107.88 / Avg: 652.2 / Max: 894.12Min: 60.29 / Avg: 636.59 / Max: 798.92Min: 37.81 / Avg: 629.17 / Max: 778.51

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 123.88 / Avg: 460.86 / Max: 660.32Min: 102.13 / Avg: 519.61 / Max: 662.67Min: 180.6 / Avg: 673.37 / Max: 881.95Min: 211.24 / Avg: 659.15 / Max: 861.5Min: 31.18 / Avg: 618.56 / Max: 788.32Min: 61.78 / Avg: 592.07 / Max: 769.69

oneDNN

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 117.63 / Avg: 306.45 / Max: 584.73Min: 120.33 / Avg: 330.6 / Max: 647.31Min: 210.1 / Avg: 417.66 / Max: 769.29Min: 204.47 / Avg: 439.83 / Max: 838.42Min: 56.11 / Avg: 241.2 / Max: 540.52Min: 30.68 / Avg: 261.28 / Max: 580.04

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 123.97 / Avg: 499.12 / Max: 602.56Min: 114.85 / Avg: 498.71 / Max: 604.01Min: 108.05 / Avg: 620.23 / Max: 772.37Min: 205.47 / Avg: 650.33 / Max: 782.01Min: 52.42 / Avg: 542.18 / Max: 637.99Min: 59.62 / Avg: 597.99 / Max: 707.37

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 75.22 / Avg: 497.3 / Max: 601.9Min: 119.7 / Avg: 497.04 / Max: 601.36Min: 221.38 / Avg: 627.27 / Max: 771.94Min: 206.27 / Avg: 647.45 / Max: 782.3Min: 57.41 / Avg: 592.73 / Max: 701.33Min: 33.08 / Avg: 668.51 / Max: 793.29

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 120.7 / Avg: 500.19 / Max: 602.54Min: 79.08 / Avg: 496.99 / Max: 602.19Min: 220 / Avg: 652.69 / Max: 740.32Min: 206.88 / Avg: 646.74 / Max: 779.66Min: 54.9 / Avg: 567.54 / Max: 675.79Min: 32.24 / Avg: 633.49 / Max: 739.43

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 118.75 / Avg: 495.69 / Max: 593.22Min: 128.03 / Avg: 496.51 / Max: 596.23Min: 137.07 / Avg: 654.01 / Max: 765.2Min: 210.54 / Avg: 644.01 / Max: 768.58Min: 60.23 / Avg: 554.51 / Max: 659.93Min: 55.42 / Avg: 572.01 / Max: 668.33

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 88.2 / Avg: 497.46 / Max: 601.66Min: 71.69 / Avg: 496.96 / Max: 602.54Min: 212.39 / Avg: 654.88 / Max: 782.5Min: 202.83 / Avg: 651.38 / Max: 782.3Min: 60.67 / Avg: 581.62 / Max: 686.17Min: 31.65 / Avg: 584.57 / Max: 690.12

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 118.62 / Avg: 498.92 / Max: 601.83Min: 123.73 / Avg: 500.49 / Max: 601.47Min: 224.85 / Avg: 654.66 / Max: 780.76Min: 103.7 / Avg: 646.66 / Max: 782.6Min: 53.17 / Avg: 581.88 / Max: 686.77Min: 34.28 / Avg: 633.77 / Max: 745.91

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 119.65 / Avg: 498.8 / Max: 602.02Min: 123.8 / Avg: 498.26 / Max: 601.23Min: 132.94 / Avg: 652.03 / Max: 781.58Min: 205.28 / Avg: 651.11 / Max: 781.83Min: 58.49 / Avg: 590.22 / Max: 704.35Min: 31.53 / Avg: 651.92 / Max: 765.29

OpenVINO

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 120.36 / Avg: 516.2 / Max: 593.64Min: 119.8 / Avg: 517.02 / Max: 593.95Min: 225.78 / Avg: 674.16 / Max: 768.69Min: 211.51 / Avg: 670.46 / Max: 768.59Min: 30.32 / Avg: 579.7 / Max: 638.45Min: 61.47 / Avg: 583.01 / Max: 643.67

OpenVINO

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 124.05 / Avg: 517.82 / Max: 584.06Min: 127.49 / Avg: 518.52 / Max: 595.86Min: 209.15 / Avg: 668.46 / Max: 770.95Min: 211.57 / Avg: 667.99 / Max: 782.09Min: 57.68 / Avg: 622.09 / Max: 684.99Min: 57.77 / Avg: 594.48 / Max: 654.28

OpenVINO

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 121.86 / Avg: 518.5 / Max: 595.33Min: 124.75 / Avg: 518.86 / Max: 596.78Min: 208.74 / Avg: 674.93 / Max: 776.16Min: 209.62 / Avg: 674 / Max: 775.31Min: 54.82 / Avg: 604.27 / Max: 663.05Min: 38.84 / Avg: 638.51 / Max: 699.19

miniBUDE

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 112.89 / Avg: 447.53 / Max: 605.44Min: 76.52 / Avg: 430.19 / Max: 621.53Min: 204.3 / Avg: 549.62 / Max: 791.37Min: 111.28 / Avg: 491.9 / Max: 790.45Min: 50.93 / Avg: 335.56 / Max: 660.26Min: 60.57 / Avg: 284.05 / Max: 711.18

miniBUDE

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 114.01 / Avg: 512.58 / Max: 652.62Min: 122.79 / Avg: 508.57 / Max: 665.4Min: 109.04 / Avg: 612 / Max: 868.4Min: 209.21 / Avg: 593.08 / Max: 864.78Min: 54.45 / Avg: 530.15 / Max: 665.49Min: 59.34 / Avg: 504.56 / Max: 653.44

OpenFOAM

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOpenFOAM 10CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 122.02 / Avg: 539.74 / Max: 590.97Min: 102.2 / Avg: 540.67 / Max: 588.28Min: 211.03 / Avg: 696.05 / Max: 761.31Min: 210.74 / Avg: 695.05 / Max: 754.74Min: 57.64 / Avg: 661.82 / Max: 737.11Min: 61.7 / Avg: 659.15 / Max: 738.72

OpenFOAM

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOpenFOAM 10CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 127.05 / Avg: 547.75 / Max: 588.4Min: 129.82 / Avg: 547.41 / Max: 588.74Min: 208.95 / Avg: 709.42 / Max: 767.54Min: 214.57 / Avg: 709.53 / Max: 762.94Min: 58.28 / Avg: 650.61 / Max: 748.65Min: 62.76 / Avg: 655.07 / Max: 742.42

Phoronix Test Suite v10.8.5