Sapphire Rapids AVX-512 Benchmarks

Ice Lake, Sapphire Rapids, Genoa AVX-512 benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2301176-NE-SAPPHIRER14&grr.

ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerVulkanCompilerFile-SystemScreen ResolutionXeon 8380Xeon 8490HEPYC 9654 AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads)Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS)Intel Ice Lake IEH512GB2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007ASPEEDVGA HDMI2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFPUbuntu 22.105.19.0-29-generic (x86_64)GNOME Shell 43.1X Server 1.21.1.41.3.224GCC 12.2.0ext41920x10802 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)Intel Device 1bce1008GB4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T2 x AMD EPYC 9654 96-Core @ 3.71GHz (192 Cores / 384 Threads)AMD Titanite_4G (RTI1002E BIOS)AMD Device 14a41520GBBroadcom NetXtreme BCM5720 PCIeOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseEnvironment Details- Xeon 8380: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" CFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile"- Xeon 8380: AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" - Xeon 8490H: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" CFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile"- Xeon 8490H: AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" - EPYC 9654: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" CFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile"- EPYC 9654: AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" Compiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Xeon 8380: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd000375- Xeon 8380: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd000375- Xeon 8490H: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0000c0- Xeon 8490H: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0000c0- EPYC 9654: AVX-512 Off: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa10110d- EPYC 9654: AVX-512 On: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa10110dPython Details- Python 3.10.7Security Details- Xeon 8380: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon 8380: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon 8490H: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon 8490H: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9654: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9654: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

openfoam: drivaerFastback, Large Mesh Size - Execution Timeopenfoam: drivaerFastback, Large Mesh Size - Mesh Timelczero: BLASopenvkl: vklBenchmark ISPClczero: Eigenmnn: SqueezeNetV1.0mnn: resnet-v2-50mnn: squeezenetv1.1mnn: mobilenetV3ospray-studio: 3 - 4K - 16 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 1 - 4K - 16 - Path Tracerospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeospray-studio: 3 - 4K - 32 - Path Tracerospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamcpuminer-opt: Triple SHA-256, Onecoindeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamminibude: OpenMP - BM2minibude: OpenMP - BM2deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamcpuminer-opt: x25xcpuminer-opt: scryptcpuminer-opt: LBC, LBRY Creditscpuminer-opt: Skeincoincpuminer-opt: Deepcoincpuminer-opt: Quad SHA-256, Pyriteembree: Pathtracer ISPC - Crownoidn: RTLightmap.hdr.4096x4096oidn: RT.hdr_alb_nrm.3840x2160smhasher: FarmHash32 x86_64 AVXsmhasher: FarmHash32 x86_64 AVXminibude: OpenMP - BM1minibude: OpenMP - BM1embree: Pathtracer ISPC - Asian Dragononednn: Deconvolution Batch shapes_3d - f32 - CPUXeon 8380Xeon 8490HEPYC 9654 AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On7106.7611887.20762478079247094.19518.1332.6781.76428490481652394313.779219.957814.3455358.63124162.72306627801491177014.328669.7264251.5678158.526111.411750.301.5850413.9819.681014.27916.936043.1140913.419643.1601217.0993183.832564703359.515916.799679.7231993.06759.417516.827521.797345.8547105.2624379.579273.7463541.8617161.3342247.27328.8158113.32611840.411122.741570833993505793035517370.50791.032.0731.58430330.5371.8461796.15996.34411.992867117.00591051.3525552491757503.9997.9092.2971.70924927418342087221.064025.517921.2242361.36688160.6645498471308156311.976983.4197180.1704221.72944.494442.951.1667701.6017.831119.45819.532548.4134821.958848.2393175.6914227.4544132854749.420820.2313103.5502588.75849.514520.193312.626479.140587.8658455.031247.8216835.7846125.1639318.79284.3750228.12192650.362307.424191336132736469092404074.80331.422.9431.08433979.9993.5732339.323106.17980.8751964319.12451039.31537542103482435.22217.7163.5512.28818608313731560122.832832.483723.1748194.78975169.8416437300980117011.782384.8378257.5622232.208530.913878.791.5773906.7617.291732.74887.589366.7540889.389966.7281226.2678264.7704109263747.209421.1789104.1062602.65246.973521.286221.321246.8614102.6136584.148771.9346832.8542147.4578405.72305.3242187.64772166.901623.882639176777339110768732062.03771.482.9523.26837809.7199.2252480.60790.39592.012414305.1242847.91029106711196111344.4158.4962.7372.05516332272041358935.954442.966236.3643195.47713159.673293274985910299.9734100.5397168.2285355.668619.316206.721.04103184.018.013738.92648.199592.0211647.754592.0328141.1445424.2714207420037.247326.8432145.7543643.84036.938227.067011.937883.700868.4347875.641640.14071492.8844101.0425592.45223.5509281.23614071.593665.556726771072453105513147262092.65121.994.1923.27342508.35143.4513586.273122.52600.7368222803.5444867.3799425117681619.27824.0817.5663.88913341224751121625.309640.665826.3953110.94948146.75453265417058369.1835109.2581194.7179491.34267.716218.251.14114083.2412.643791.80787.3270120.5142787.7235120.5189187.3515510.8775333885032.826330.4563254.8536371.32032.402430.855313.974071.508895.16651006.082467.90161410.4222144.8858660.53714.8444206.31715712.582947.9449278014130631652401334363153.18151.723.4626.41336458.31207.6975192.425177.67741.736672849.611996.777419171134190858.76214.7277.2043.8661105818500926043.235854.155343.7081112.38169145.89944221205816957.9604126.0114135.9937704.58184.3411029.450.96118103.946.467420.491128.845084.86761132.613384.3996155.9118613.9355332628728.977134.5008342.5088562.69429.202934.23229.9667100.285579.49671205.181348.70031966.4052118.3525809.07515.2240191.33257691.784816.31106899319907901602902252500181.88891.663.4826.55139795.36290.9627274.050213.95120.986214OpenBenchmarking.org

OpenFOAM

Input: drivaerFastback, Large Mesh Size - Execution Time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Large Mesh Size - Execution TimeAVX-512 OffAVX-512 On150030004500600075007106.767117.014319.124305.122803.542849.611. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Large Mesh Size - Mesh Time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Large Mesh Size - Mesh TimeAVX-512 OffAVX-512 On2004006008001000887.211051.351039.32847.91867.38996.781. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

LeelaChessZero

Backend: BLAS

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: BLASAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 47.46, N = 5SE +/- 68.15, N = 3SE +/- 61.68, N = 3SE +/- 133.67, N = 3SE +/- 92.33, N = 9SE +/- 36.09, N = 347805524754210671942591711. (CXX) g++ options: -flto -O3 -march=native -mno-amx-tile -pthread

OpenVKL

Benchmark: vklBenchmark ISPC

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCAVX-512 OffAVX-512 On30060090012001500SE +/- 1.86, N = 3SE +/- 1.76, N = 3SE +/- 4.16, N = 3SE +/- 2.52, N = 3SE +/- 13.87, N = 3SE +/- 16.33, N = 37929171034119611761341

LeelaChessZero

Backend: Eigen

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: EigenAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 58.86, N = 3SE +/- 64.32, N = 4SE +/- 63.14, N = 3SE +/- 151.11, N = 3SE +/- 66.84, N = 3SE +/- 35.63, N = 347095750824311134816190851. (CXX) g++ options: -flto -O3 -march=native -mno-amx-tile -pthread

Mobile Neural Network

Model: SqueezeNetV1.0

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0AVX-512 OffAVX-512 On3691215SE +/- 0.056, N = 10SE +/- 0.080, N = 15SE +/- 0.105, N = 3SE +/- 0.082, N = 3SE +/- 0.132, N = 3SE +/- 0.234, N = 94.1953.9995.2224.4159.2788.7621. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: resnet-v2-50AVX-512 OffAVX-512 On612182430SE +/- 0.099, N = 10SE +/- 0.074, N = 15SE +/- 0.060, N = 3SE +/- 0.065, N = 3SE +/- 0.300, N = 3SE +/- 0.193, N = 918.1337.90917.7168.49624.08114.7271. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: squeezenetv1.1AVX-512 OffAVX-512 On246810SE +/- 0.039, N = 10SE +/- 0.064, N = 15SE +/- 0.008, N = 3SE +/- 0.072, N = 3SE +/- 0.137, N = 3SE +/- 0.219, N = 92.6782.2973.5512.7377.5667.2041. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenetV3

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenetV3AVX-512 OffAVX-512 On0.8751.752.6253.54.375SE +/- 0.022, N = 10SE +/- 0.025, N = 15SE +/- 0.012, N = 3SE +/- 0.005, N = 3SE +/- 0.049, N = 3SE +/- 0.053, N = 91.7641.7092.2882.0553.8893.8661. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On6K12K18K24K30KSE +/- 46.52, N = 3SE +/- 18.50, N = 3SE +/- 45.36, N = 3SE +/- 25.54, N = 3SE +/- 32.66, N = 3SE +/- 3.79, N = 32849024927186081633213341110581. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On10K20K30K40K50KSE +/- 10.69, N = 3SE +/- 44.00, N = 3SE +/- 69.83, N = 3SE +/- 11.72, N = 3SE +/- 50.78, N = 3SE +/- 30.61, N = 34816541834313732720422475185001. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On5K10K15K20K25KSE +/- 42.81, N = 3SE +/- 8.41, N = 3SE +/- 37.53, N = 3SE +/- 19.41, N = 3SE +/- 8.39, N = 3SE +/- 7.00, N = 3239432087215601135891121692601. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On1020304050SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 313.7821.0622.8335.9525.3143.24

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On1224364860SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 319.9625.5232.4842.9740.6754.16

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On1020304050SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 314.3521.2223.1736.3626.4043.71

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeAVX-512 OffAVX-512 On80160240320400358.63361.37194.79195.48110.95112.381. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeAVX-512 OffAVX-512 On4080120160200162.72160.66169.84159.67146.75145.901. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On13K26K39K52K65KSE +/- 56.19, N = 3SE +/- 4.98, N = 3SE +/- 115.86, N = 3SE +/- 45.83, N = 3SE +/- 18.25, N = 3SE +/- 44.52, N = 36278049847373003274926541221201. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On30060090012001500SE +/- 1.00, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 1.20, N = 3149113089808597055811. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On400800120016002000SE +/- 1.00, N = 3SE +/- 0.00, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 317701563117010298366951. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On48121620SE +/- 0.0435, N = 3SE +/- 0.0082, N = 3SE +/- 0.0817, N = 3SE +/- 0.1607, N = 15SE +/- 0.1629, N = 15SE +/- 0.1413, N = 1514.328611.976911.78239.97349.18357.9604

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On306090120150SE +/- 0.21, N = 3SE +/- 0.06, N = 3SE +/- 0.59, N = 3SE +/- 1.49, N = 15SE +/- 1.97, N = 15SE +/- 2.25, N = 1569.7383.4284.84100.54109.26126.01

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On60120180240300SE +/- 1.34, N = 3SE +/- 0.11, N = 3SE +/- 0.30, N = 3SE +/- 0.53, N = 3SE +/- 0.35, N = 3SE +/- 0.99, N = 13251.57180.17257.56168.23194.72135.99

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On150300450600750SE +/- 0.92, N = 3SE +/- 0.18, N = 3SE +/- 0.51, N = 3SE +/- 1.22, N = 3SE +/- 1.03, N = 3SE +/- 5.42, N = 13158.53221.73232.21355.67491.34704.58

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On714212835SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 311.414.4930.9119.317.714.341. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 2.52, N = 3SE +/- 2.81, N = 3SE +/- 1.04, N = 3SE +/- 1.24, N = 3SE +/- 0.29, N = 3SE +/- 1.97, N = 31750.304442.953878.796206.726218.2511029.451. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On0.35550.7111.06651.4221.7775SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.581.161.571.041.140.961. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On30K60K90K120K150KSE +/- 38.18, N = 3SE +/- 42.04, N = 3SE +/- 74.60, N = 3SE +/- 153.42, N = 3SE +/- 673.74, N = 3SE +/- 1008.13, N = 350413.9867701.6073906.76103184.01114083.24118103.941. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 319.6817.8317.298.0112.646.461. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On16003200480064008000SE +/- 0.71, N = 3SE +/- 0.97, N = 3SE +/- 0.62, N = 3SE +/- 1.23, N = 3SE +/- 2.86, N = 3SE +/- 1.27, N = 31014.271119.451732.743738.923791.807420.491. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On2004006008001000SE +/- 1.29, N = 3SE +/- 3.51, N = 3SE +/- 1.38, N = 3SE +/- 0.76, N = 3SE +/- 0.46, N = 3SE +/- 2.80, N = 3916.94819.53887.59648.20787.331128.85

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On306090120150SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 0.17, N = 3SE +/- 0.03, N = 3SE +/- 0.22, N = 3SE +/- 0.19, N = 343.1148.4166.7592.02120.5184.87

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On2004006008001000SE +/- 2.25, N = 3SE +/- 0.79, N = 3SE +/- 2.38, N = 3SE +/- 0.72, N = 3SE +/- 0.15, N = 3SE +/- 1.43, N = 3913.42821.96889.39647.75787.721132.61

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On306090120150SE +/- 0.16, N = 3SE +/- 0.01, N = 3SE +/- 0.23, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 343.1648.2466.7392.03120.5284.40

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On50100150200250SE +/- 0.69, N = 3SE +/- 0.35, N = 3SE +/- 0.84, N = 3SE +/- 0.32, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 3217.10175.69226.27141.14187.35155.91

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On130260390520650SE +/- 0.52, N = 3SE +/- 0.49, N = 3SE +/- 0.93, N = 3SE +/- 0.95, N = 3SE +/- 0.22, N = 3SE +/- 0.55, N = 3183.83227.45264.77424.27510.88613.94

Cpuminer-Opt

Algorithm: Triple SHA-256, Onecoin

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Triple SHA-256, OnecoinAVX-512 OffAVX-512 On700K1400K2100K2800K3500KSE +/- 579.55, N = 3SE +/- 8466.21, N = 3SE +/- 3398.36, N = 3SE +/- 18201.57, N = 3SE +/- 18173.37, N = 3SE +/- 23073.29, N = 15647033132854710926372074200333885033262871. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On1326395265SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 359.5249.4247.2137.2532.8328.98

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On816243240SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 316.8020.2321.1826.8430.4634.50

miniBUDE

Implementation: OpenMP - Input Deck: BM2

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On70140210280350SE +/- 0.49, N = 3SE +/- 0.54, N = 3SE +/- 0.99, N = 6SE +/- 0.36, N = 3SE +/- 1.86, N = 3SE +/- 1.89, N = 479.72103.55104.11145.75254.85342.511. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 12.20, N = 3SE +/- 13.49, N = 3SE +/- 24.70, N = 6SE +/- 9.11, N = 3SE +/- 46.49, N = 3SE +/- 47.16, N = 41993.072588.762602.653643.846371.328562.691. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On1326395265SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 359.4249.5146.9736.9432.4029.20

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On816243240SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 316.8320.1921.2927.0730.8634.23

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On510152025SE +/- 0.0648, N = 3SE +/- 0.0206, N = 3SE +/- 0.0534, N = 3SE +/- 0.0214, N = 3SE +/- 0.0319, N = 3SE +/- 0.0671, N = 321.797312.626421.321211.937813.97409.9667

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On20406080100SE +/- 0.14, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.16, N = 3SE +/- 0.67, N = 345.8579.1446.8683.7071.51100.29

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On20406080100SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 0.18, N = 3SE +/- 0.04, N = 3SE +/- 0.26, N = 3105.2687.87102.6168.4395.1779.50

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On30060090012001500SE +/- 0.62, N = 3SE +/- 0.94, N = 3SE +/- 0.51, N = 3SE +/- 2.15, N = 3SE +/- 0.56, N = 3SE +/- 3.78, N = 3379.58455.03584.15875.641006.081205.18

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On1632486480SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 373.7547.8271.9340.1467.9048.70

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On400800120016002000SE +/- 1.47, N = 3SE +/- 0.98, N = 3SE +/- 0.84, N = 3SE +/- 1.88, N = 3SE +/- 0.94, N = 3SE +/- 1.71, N = 3541.86835.78832.851492.881410.421966.41

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On4080120160200SE +/- 0.40, N = 3SE +/- 0.17, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.36, N = 3161.33125.16147.46101.04144.89118.35

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On2004006008001000SE +/- 0.62, N = 3SE +/- 0.38, N = 3SE +/- 0.43, N = 3SE +/- 0.33, N = 3SE +/- 0.26, N = 3SE +/- 2.56, N = 3247.27318.79405.72592.45660.54809.08

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On246810SE +/- 0.0346, N = 3SE +/- 0.0029, N = 3SE +/- 0.0060, N = 3SE +/- 0.0091, N = 3SE +/- 0.0009, N = 3SE +/- 0.0099, N = 38.81584.37505.32423.55094.84445.2240

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On60120180240300SE +/- 0.44, N = 3SE +/- 0.16, N = 3SE +/- 0.21, N = 3SE +/- 0.71, N = 3SE +/- 0.04, N = 3SE +/- 0.36, N = 3113.33228.12187.65281.24206.32191.33

Cpuminer-Opt

Algorithm: x25x

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xAVX-512 OffAVX-512 On16003200480064008000SE +/- 4.47, N = 3SE +/- 4.49, N = 3SE +/- 21.26, N = 6SE +/- 26.18, N = 3SE +/- 0.55, N = 3SE +/- 54.56, N = 31840.412650.362166.904071.595712.587691.781. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: scrypt

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptAVX-512 OffAVX-512 On10002000300040005000SE +/- 0.63, N = 3SE +/- 7.11, N = 3SE +/- 0.54, N = 3SE +/- 1.21, N = 3SE +/- 0.03, N = 3SE +/- 13.77, N = 31122.742307.421623.883665.552947.944816.311. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsAVX-512 OffAVX-512 On200K400K600K800K1000KSE +/- 498.81, N = 3SE +/- 390.61, N = 3SE +/- 820.11, N = 3SE +/- 1047.73, N = 3SE +/- 1744.51, N = 3SE +/- 3825.46, N = 315708341913326391767267749278010689931. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Skeincoin

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinAVX-512 OffAVX-512 On400K800K1200K1600K2000KSE +/- 716.54, N = 3SE +/- 438.80, N = 3SE +/- 329.36, N = 3SE +/- 668.14, N = 3SE +/- 7503.92, N = 3SE +/- 4597.66, N = 33993506132736777331072453141306319907901. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Deepcoin

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: DeepcoinAVX-512 OffAVX-512 On40K80K120K160K200KSE +/- 32.15, N = 3SE +/- 52.92, N = 3SE +/- 928.66, N = 3SE +/- 155.06, N = 3SE +/- 204.21, N = 3SE +/- 536.94, N = 35793064690911071055131652401602901. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteAVX-512 OffAVX-512 On500K1000K1500K2000K2500KSE +/- 4107.35, N = 3SE +/- 1289.92, N = 3SE +/- 657.95, N = 3SE +/- 3990.27, N = 3SE +/- 7009.29, N = 3SE +/- 10844.37, N = 33551739240406873201472620133436322525001. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Embree

Binary: Pathtracer ISPC - Model: Crown

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On4080120160200SE +/- 0.27, N = 5SE +/- 0.17, N = 5SE +/- 5.25, N = 15SE +/- 0.53, N = 6SE +/- 0.42, N = 7SE +/- 0.47, N = 870.5174.8062.0492.65153.18181.89

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RTLightmap.hdr.4096x4096AVX-512 OffAVX-512 On0.44780.89561.34341.79122.239SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 4SE +/- 0.00, N = 3SE +/- 0.00, N = 31.031.421.481.991.721.66

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.hdr_alb_nrm.3840x2160AVX-512 OffAVX-512 On0.94281.88562.82843.77124.714SE +/- 0.01, N = 4SE +/- 0.01, N = 5SE +/- 0.02, N = 5SE +/- 0.02, N = 6SE +/- 0.02, N = 5SE +/- 0.01, N = 52.072.942.954.193.463.48

SMHasher

Hash: FarmHash32 x86_64 AVX

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX-512 OffAVX-512 On714212835SE +/- 0.01, N = 4SE +/- 0.02, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 5SE +/- 0.16, N = 531.5831.0823.2723.2726.4126.551. (CXX) g++ options: -O3 -march=native -mno-amx-tile -flto=auto -fno-fat-lto-objects

SMHasher

Hash: FarmHash32 x86_64 AVX

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX-512 OffAVX-512 On9K18K27K36K45KSE +/- 181.36, N = 4SE +/- 1.95, N = 4SE +/- 181.17, N = 4SE +/- 68.33, N = 4SE +/- 41.48, N = 5SE +/- 0.56, N = 530330.5333979.9937809.7142508.3536458.3139795.361. (CXX) g++ options: -O3 -march=native -mno-amx-tile -flto=auto -fno-fat-lto-objects

miniBUDE

Implementation: OpenMP - Input Deck: BM1

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On60120180240300SE +/- 0.14, N = 5SE +/- 0.25, N = 5SE +/- 0.27, N = 6SE +/- 0.53, N = 7SE +/- 1.12, N = 8SE +/- 0.38, N = 1071.8593.5799.23143.45207.70290.961. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On16003200480064008000SE +/- 3.51, N = 5SE +/- 6.26, N = 5SE +/- 6.63, N = 6SE +/- 13.13, N = 7SE +/- 27.90, N = 8SE +/- 9.60, N = 101796.162339.322480.613586.275192.437274.051. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On50100150200250SE +/- 0.42, N = 6SE +/- 0.56, N = 6SE +/- 0.50, N = 6SE +/- 0.64, N = 6SE +/- 0.11, N = 8SE +/- 0.25, N = 996.34106.1890.40122.53177.68213.95

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On0.45280.90561.35841.81122.264SE +/- 0.002804, N = 9SE +/- 0.001297, N = 9SE +/- 0.006513, N = 9SE +/- 0.001579, N = 9SE +/- 0.002552, N = 9SE +/- 0.003984, N = 91.9928600.8751962.0124100.7368221.7366700.9862141. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

Xeon 8380Xeon 8490HOpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On160320480640800Min: 57.8 / Avg: 365.97 / Max: 660.32Min: 60.6 / Avg: 451.19 / Max: 668.12Min: 101.7 / Avg: 588.67 / Max: 887.42Min: 102.55 / Avg: 582.55 / Max: 894.12

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Phoronix Test Suite System Monitoring

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On7001400210028003500Min: 802 / Avg: 3114.77 / Max: 3421Min: 804 / Avg: 2939.27 / Max: 3420Min: 1899 / Avg: 3041.53 / Max: 4080Min: 690 / Avg: 3000.31 / Max: 4081Min: 2336 / Avg: 3667.6 / Max: 4199Min: 2547 / Avg: 3615.9 / Max: 3772

OpenFOAM

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 51 / Avg: 70.16 / Max: 75Min: 50 / Avg: 69.77 / Max: 75Min: 39 / Avg: 54.29 / Max: 60Min: 40 / Avg: 54.65 / Max: 60Min: 36.75 / Avg: 54.3 / Max: 61.38Min: 37.75 / Avg: 55.54 / Max: 62.63

OpenFOAM

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOpenFOAM 10CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 127.05 / Avg: 547.75 / Max: 588.4Min: 129.82 / Avg: 547.41 / Max: 588.74Min: 208.95 / Avg: 709.42 / Max: 767.54Min: 214.57 / Avg: 709.53 / Max: 762.94Min: 58.28 / Avg: 650.61 / Max: 748.65Min: 62.76 / Avg: 655.07 / Max: 742.42

OpenFOAM

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2980.24 / Max: 3408Min: 2300 / Avg: 2974.56 / Max: 3400Min: 2491 / Avg: 2870.69 / Max: 3516Min: 2451 / Avg: 2868.19 / Max: 3513Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

OpenFOAM

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 39 / Avg: 71.62 / Max: 78Min: 40 / Avg: 71.85 / Max: 80Min: 30 / Avg: 53.51 / Max: 59Min: 33 / Avg: 54.15 / Max: 59Min: 31.88 / Avg: 53.96 / Max: 60Min: 36.38 / Avg: 55.35 / Max: 60.88

OpenFOAM

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOpenFOAM 10CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 122.02 / Avg: 539.74 / Max: 590.97Min: 102.2 / Avg: 540.67 / Max: 588.28Min: 211.03 / Avg: 696.05 / Max: 761.31Min: 210.74 / Avg: 695.05 / Max: 754.74Min: 57.64 / Avg: 661.82 / Max: 737.11Min: 61.7 / Avg: 659.15 / Max: 738.72

OpenFOAM

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2959.08 / Max: 3400Min: 2300 / Avg: 2948.55 / Max: 3400Min: 1900 / Avg: 2735.03 / Max: 3517Min: 1900 / Avg: 2718.73 / Max: 3515Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709.02 / Max: 3714

miniBUDE

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OffAVX-512 On1632486480Min: 46 / Avg: 72.36 / Max: 85Min: 47 / Avg: 72.68 / Max: 84Min: 37 / Avg: 52.39 / Max: 59Min: 37 / Avg: 48.68 / Max: 55Min: 34.13 / Avg: 48.71 / Max: 55.63Min: 34.13 / Avg: 47.83 / Max: 54.25

miniBUDE

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 114.01 / Avg: 512.58 / Max: 652.62Min: 122.79 / Avg: 508.57 / Max: 665.4Min: 109.04 / Avg: 612 / Max: 868.4Min: 209.21 / Avg: 593.08 / Max: 864.78Min: 54.45 / Avg: 530.15 / Max: 665.49Min: 59.34 / Avg: 504.56 / Max: 653.44

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2943.56 / Max: 3400Min: 2300 / Avg: 2927.95 / Max: 3402Min: 1900 / Avg: 3016.33 / Max: 3515Min: 1900 / Avg: 2986.92 / Max: 3558Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

miniBUDE

Implementation: OpenMP - Input Deck: BM2

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On0.15280.30560.45840.61120.7640.1560.2040.1700.2460.4810.679

miniBUDE

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 50 / Avg: 65.07 / Max: 72Min: 52 / Avg: 65.79 / Max: 74Min: 39 / Avg: 48.48 / Max: 54Min: 40 / Avg: 46.05 / Max: 51Min: 35 / Avg: 42.25 / Max: 50.38Min: 35.88 / Avg: 41.15 / Max: 49

miniBUDE

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 112.89 / Avg: 447.53 / Max: 605.44Min: 76.52 / Avg: 430.19 / Max: 621.53Min: 204.3 / Avg: 549.62 / Max: 791.37Min: 111.28 / Avg: 491.9 / Max: 790.45Min: 50.93 / Avg: 335.56 / Max: 660.26Min: 60.57 / Avg: 284.05 / Max: 711.18

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2689.33 / Max: 3014Min: 2300 / Avg: 2694.51 / Max: 3194Min: 1900 / Avg: 2980.48 / Max: 3511Min: 1900 / Avg: 3105.81 / Max: 3512Min: 3145 / Avg: 3570.92 / Max: 3709Min: 3296 / Avg: 3597.25 / Max: 3709

miniBUDE

Implementation: OpenMP - Input Deck: BM1

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On0.23040.46080.69120.92161.1520.1610.2180.1810.2920.6191.024

OpenVINO

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 54 / Avg: 72.7 / Max: 77Min: 54 / Avg: 72.62 / Max: 77Min: 40 / Avg: 53.53 / Max: 57Min: 40 / Avg: 52.8 / Max: 55Min: 37.25 / Avg: 50.88 / Max: 53.5Min: 37.13 / Avg: 52.63 / Max: 55.5

OpenVINO

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 121.86 / Avg: 518.5 / Max: 595.33Min: 124.75 / Avg: 518.86 / Max: 596.78Min: 208.74 / Avg: 674.93 / Max: 776.16Min: 209.62 / Avg: 674 / Max: 775.31Min: 54.82 / Avg: 604.27 / Max: 663.05Min: 38.84 / Avg: 638.51 / Max: 699.19

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2788.99 / Max: 3402Min: 2300 / Avg: 2555.76 / Max: 3400Min: 1900 / Avg: 2479.96 / Max: 3506Min: 1900 / Avg: 2431.39 / Max: 3509Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

OpenVINO

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 54 / Avg: 74.99 / Max: 79Min: 53 / Avg: 74.24 / Max: 79Min: 40 / Avg: 53.23 / Max: 57Min: 40 / Avg: 52.32 / Max: 55Min: 37.25 / Avg: 52.53 / Max: 56Min: 37.75 / Avg: 51.65 / Max: 54.25

OpenVINO

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 124.05 / Avg: 517.82 / Max: 584.06Min: 127.49 / Avg: 518.52 / Max: 595.86Min: 209.15 / Avg: 668.46 / Max: 770.95Min: 211.57 / Avg: 667.99 / Max: 782.09Min: 57.68 / Avg: 622.09 / Max: 684.99Min: 57.77 / Avg: 594.48 / Max: 654.28

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2952.33 / Max: 3400Min: 2300 / Avg: 2464.76 / Max: 3400Min: 2327 / Avg: 2504.87 / Max: 3513Min: 1900 / Avg: 2571.73 / Max: 3502Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

OpenVINO

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 54 / Avg: 73.27 / Max: 77Min: 54 / Avg: 73.47 / Max: 77Min: 40 / Avg: 53.81 / Max: 57Min: 39 / Avg: 52.99 / Max: 56Min: 36.75 / Avg: 50.69 / Max: 53.75Min: 36.38 / Avg: 50.87 / Max: 54.63

OpenVINO

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 120.36 / Avg: 516.2 / Max: 593.64Min: 119.8 / Avg: 517.02 / Max: 593.95Min: 225.78 / Avg: 674.16 / Max: 768.69Min: 211.51 / Avg: 670.46 / Max: 768.59Min: 30.32 / Avg: 579.7 / Max: 638.45Min: 61.47 / Avg: 583.01 / Max: 643.67

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2585.83 / Max: 3400Min: 2300 / Avg: 2378.88 / Max: 3400Min: 1900 / Avg: 2584.6 / Max: 3508Min: 1900 / Avg: 2332.5 / Max: 3508Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Cpuminer-Opt

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 52 / Avg: 69.81 / Max: 74Min: 52 / Avg: 70.74 / Max: 76Min: 40 / Avg: 54.02 / Max: 57Min: 39 / Avg: 52.42 / Max: 56Min: 36.75 / Avg: 51.26 / Max: 55.13Min: 37.25 / Avg: 53.37 / Max: 57.25

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 119.65 / Avg: 498.8 / Max: 602.02Min: 123.8 / Avg: 498.26 / Max: 601.23Min: 132.94 / Avg: 652.03 / Max: 781.58Min: 205.28 / Avg: 651.11 / Max: 781.83Min: 58.49 / Avg: 590.22 / Max: 704.35Min: 31.53 / Avg: 651.92 / Max: 765.29

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2737.13 / Max: 3400Min: 2300 / Avg: 2623.57 / Max: 3400Min: 1900 / Avg: 2760.78 / Max: 3502Min: 1900 / Avg: 2817.16 / Max: 3501Min: 2733 / Avg: 3270.61 / Max: 3709Min: 3092 / Avg: 3394.73 / Max: 3709

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsAVX-512 OffAVX-512 On400800120016002000314.92841.20404.761033.12834.911639.75

Cpuminer-Opt

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 51 / Avg: 69.73 / Max: 74Min: 52 / Avg: 71.11 / Max: 77Min: 40 / Avg: 53.91 / Max: 58Min: 39 / Avg: 52.76 / Max: 56Min: 36.38 / Avg: 50.92 / Max: 54.25Min: 36.38 / Avg: 52.6 / Max: 56.13

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 118.62 / Avg: 498.92 / Max: 601.83Min: 123.73 / Avg: 500.49 / Max: 601.47Min: 224.85 / Avg: 654.66 / Max: 780.76Min: 103.7 / Avg: 646.66 / Max: 782.6Min: 53.17 / Avg: 581.88 / Max: 686.77Min: 34.28 / Avg: 633.77 / Max: 745.91

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2776.23 / Max: 3195Min: 2300 / Avg: 2673.53 / Max: 3063Min: 1900 / Avg: 2872.56 / Max: 3501Min: 2700 / Avg: 2861.18 / Max: 3505Min: 2896 / Avg: 3299.49 / Max: 3709Min: 3001 / Avg: 3367.28 / Max: 3709

Cpuminer-Opt

Algorithm: Skeincoin

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinAVX-512 OffAVX-512 On7001400210028003500800.441225.351035.241658.462428.443141.21

Cpuminer-Opt

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 53 / Avg: 70.18 / Max: 74Min: 52 / Avg: 70.34 / Max: 75Min: 42 / Avg: 54.53 / Max: 58Min: 39 / Avg: 53.02 / Max: 57Min: 36.38 / Avg: 50.56 / Max: 53.75Min: 36.63 / Avg: 50.78 / Max: 54.25

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 88.2 / Avg: 497.46 / Max: 601.66Min: 71.69 / Avg: 496.96 / Max: 602.54Min: 212.39 / Avg: 654.88 / Max: 782.5Min: 202.83 / Avg: 651.38 / Max: 782.3Min: 60.67 / Avg: 581.62 / Max: 686.17Min: 31.65 / Avg: 584.57 / Max: 690.12

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2798.55 / Max: 3145Min: 2300 / Avg: 2779.27 / Max: 3400Min: 1900 / Avg: 2857.54 / Max: 3507Min: 1900 / Avg: 2936.48 / Max: 3508Min: 2899 / Avg: 3360.04 / Max: 3709Min: 3239 / Avg: 3515.22 / Max: 3709

Cpuminer-Opt

Algorithm: Deepcoin

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: DeepcoinAVX-512 OffAVX-512 On60120180240300116.45130.17139.12161.98284.10274.20

Cpuminer-Opt

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 53 / Avg: 69.68 / Max: 74Min: 51 / Avg: 69.47 / Max: 74Min: 40 / Avg: 53.43 / Max: 57Min: 38 / Avg: 52.08 / Max: 56Min: 36.75 / Avg: 50.8 / Max: 54.63Min: 37.25 / Avg: 52.15 / Max: 55.5

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 118.75 / Avg: 495.69 / Max: 593.22Min: 128.03 / Avg: 496.51 / Max: 596.23Min: 137.07 / Avg: 654.01 / Max: 765.2Min: 210.54 / Avg: 644.01 / Max: 768.58Min: 60.23 / Avg: 554.51 / Max: 659.93Min: 55.42 / Avg: 572.01 / Max: 668.33

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2916.53 / Max: 3305Min: 2300 / Avg: 2832.8 / Max: 3402Min: 1900 / Avg: 2906.57 / Max: 3511Min: 1900 / Avg: 2729.58 / Max: 3501Min: 3295 / Avg: 3487.56 / Max: 3709Min: 3132 / Avg: 3368.18 / Max: 3709

Cpuminer-Opt

Algorithm: x25x

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xAVX-512 OffAVX-512 On36912153.7135.3383.3136.32210.30213.447

Cpuminer-Opt

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 51 / Avg: 70.21 / Max: 75Min: 52 / Avg: 70.84 / Max: 75Min: 39 / Avg: 53.91 / Max: 58Min: 39 / Avg: 52.72 / Max: 57Min: 36.38 / Avg: 50.97 / Max: 54.25Min: 38.13 / Avg: 52.94 / Max: 56.13

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 120.7 / Avg: 500.19 / Max: 602.54Min: 79.08 / Avg: 496.99 / Max: 602.19Min: 220 / Avg: 652.69 / Max: 740.32Min: 206.88 / Avg: 646.74 / Max: 779.66Min: 54.9 / Avg: 567.54 / Max: 675.79Min: 32.24 / Avg: 633.49 / Max: 739.43

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2868.13 / Max: 3101Min: 2300 / Avg: 2651.15 / Max: 3400Min: 1900 / Avg: 2927.09 / Max: 3501Min: 1900 / Avg: 2857.47 / Max: 3507Min: 3033 / Avg: 3343.09 / Max: 3709Min: 3114 / Avg: 3410.31 / Max: 3709

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteAVX-512 OffAVX-512 On8001600240032004000710.081859.261053.062276.982351.123555.70

Cpuminer-Opt

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 51 / Avg: 69.9 / Max: 74Min: 51 / Avg: 70.07 / Max: 75Min: 40 / Avg: 51.93 / Max: 56Min: 39 / Avg: 52.28 / Max: 56Min: 35.88 / Avg: 50.93 / Max: 54.25Min: 36.75 / Avg: 55.17 / Max: 58.75

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 75.22 / Avg: 497.3 / Max: 601.9Min: 119.7 / Avg: 497.04 / Max: 601.36Min: 221.38 / Avg: 627.27 / Max: 771.94Min: 206.27 / Avg: 647.45 / Max: 782.3Min: 57.41 / Avg: 592.73 / Max: 701.33Min: 33.08 / Avg: 668.51 / Max: 793.29

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2888.78 / Max: 3283Min: 2300 / Avg: 2643.21 / Max: 3400Min: 1900 / Avg: 2957.05 / Max: 3510Min: 1900 / Avg: 2875.21 / Max: 3511Min: 3008 / Avg: 3335.89 / Max: 3709Min: 3178 / Avg: 3465.81 / Max: 3714

Cpuminer-Opt

Algorithm: Triple SHA-256, Onecoin

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: Triple SHA-256, OnecoinAVX-512 OffAVX-512 On120024003600480060001301.102672.901741.893203.655632.974975.70

Cpuminer-Opt

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 49 / Avg: 68.06 / Max: 73Min: 48 / Avg: 68.72 / Max: 75Min: 37 / Avg: 50.54 / Max: 55Min: 36 / Avg: 51.1 / Max: 56Min: 34.13 / Avg: 48.03 / Max: 52Min: 34.13 / Avg: 50.14 / Max: 55.63

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 123.97 / Avg: 499.12 / Max: 602.56Min: 114.85 / Avg: 498.71 / Max: 604.01Min: 108.05 / Avg: 620.23 / Max: 772.37Min: 205.47 / Avg: 650.33 / Max: 782.01Min: 52.42 / Avg: 542.18 / Max: 637.99Min: 59.62 / Avg: 597.99 / Max: 707.37

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2914.43 / Max: 3000Min: 2300 / Avg: 2665.18 / Max: 2970Min: 1900 / Avg: 2927.59 / Max: 3501Min: 1900 / Avg: 2817.46 / Max: 3508Min: 2936 / Avg: 3110.3 / Max: 3709Min: 2986 / Avg: 3249.64 / Max: 3709

Cpuminer-Opt

Algorithm: scrypt

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptAVX-512 OffAVX-512 On2468102.2494.6272.6185.6365.4378.054

oneDNN

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.0CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 50 / Avg: 57.62 / Max: 69Min: 51 / Avg: 59.32 / Max: 70Min: 33 / Avg: 39.82 / Max: 48Min: 36 / Avg: 40.95 / Max: 47Min: 33.63 / Avg: 36.99 / Max: 40.88Min: 34.13 / Avg: 37.73 / Max: 41.75

oneDNN

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 117.63 / Avg: 306.45 / Max: 584.73Min: 120.33 / Avg: 330.6 / Max: 647.31Min: 210.1 / Avg: 417.66 / Max: 769.29Min: 204.47 / Avg: 439.83 / Max: 838.42Min: 56.11 / Avg: 241.2 / Max: 540.52Min: 30.68 / Avg: 261.28 / Max: 580.04

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2610.75 / Max: 3145Min: 2300 / Avg: 2463.92 / Max: 3025Min: 1900 / Avg: 3132.72 / Max: 3511Min: 1900 / Avg: 3013.2 / Max: 3507Min: 3570 / Avg: 3666 / Max: 3709Min: 3403 / Avg: 3617.61 / Max: 3709

OSPRay Studio

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 53 / Avg: 66.34 / Max: 73Min: 49 / Avg: 70.06 / Max: 75Min: 39 / Avg: 53.34 / Max: 58Min: 39 / Avg: 52.54 / Max: 57Min: 38.13 / Avg: 52.62 / Max: 59.25Min: 36.75 / Avg: 51.43 / Max: 54.63

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 123.88 / Avg: 460.86 / Max: 660.32Min: 102.13 / Avg: 519.61 / Max: 662.67Min: 180.6 / Avg: 673.37 / Max: 881.95Min: 211.24 / Avg: 659.15 / Max: 861.5Min: 31.18 / Avg: 618.56 / Max: 788.32Min: 61.78 / Avg: 592.07 / Max: 769.69

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 1597 / Avg: 2940.27 / Max: 3407Min: 2300 / Avg: 2577.91 / Max: 3401Min: 1900 / Avg: 2875.06 / Max: 3514Min: 1900 / Avg: 2803.99 / Max: 3513Min: 2721 / Avg: 3353.6 / Max: 3709Min: 2702 / Avg: 3343.21 / Max: 3709

OSPRay Studio

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 51 / Avg: 71.52 / Max: 77Min: 52 / Avg: 68.49 / Max: 74Min: 38 / Avg: 53.76 / Max: 58Min: 39 / Avg: 51.56 / Max: 57Min: 37.25 / Avg: 52.98 / Max: 56.38Min: 37.25 / Avg: 52.28 / Max: 56.38

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On160320480640800Min: 117.01 / Avg: 524.66 / Max: 656.47Min: 100.35 / Avg: 499.04 / Max: 664.34Min: 179.46 / Avg: 687.97 / Max: 887.42Min: 107.88 / Avg: 652.2 / Max: 894.12Min: 60.29 / Avg: 636.59 / Max: 798.92Min: 37.81 / Avg: 629.17 / Max: 778.51

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 1835 / Avg: 2867.88 / Max: 3402Min: 2300 / Avg: 2615.33 / Max: 3403Min: 1900 / Avg: 2836.9 / Max: 3512Min: 1900 / Avg: 2841.62 / Max: 3508Min: 2726 / Avg: 3186.89 / Max: 3709Min: 2777 / Avg: 3169.51 / Max: 3709

OSPRay Studio

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 51 / Avg: 69.42 / Max: 76Min: 50 / Avg: 68.75 / Max: 75Min: 38 / Avg: 52.47 / Max: 57Min: 39 / Avg: 52.34 / Max: 57Min: 37.75 / Avg: 52.04 / Max: 55.5Min: 37.25 / Avg: 50.44 / Max: 53.75

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 81.76 / Avg: 503.22 / Max: 657.11Min: 111.41 / Avg: 500.78 / Max: 666.67Min: 212.51 / Avg: 666.51 / Max: 879.7Min: 214.02 / Avg: 660.08 / Max: 874.86Min: 60.27 / Avg: 620.19 / Max: 789.77Min: 58.16 / Avg: 599.55 / Max: 773.94

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 1947 / Avg: 2897.09 / Max: 3403Min: 2300 / Avg: 2609.05 / Max: 3401Min: 1900 / Avg: 2874.56 / Max: 3509Min: 1900 / Avg: 2823.98 / Max: 3514Min: 2721 / Avg: 3208.32 / Max: 3709Min: 2671 / Avg: 3308.27 / Max: 3711

OSPRay Studio

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 53 / Avg: 70.9 / Max: 77Min: 50 / Avg: 69.76 / Max: 75Min: 39 / Avg: 52.35 / Max: 57Min: 39 / Avg: 52.99 / Max: 57Min: 37.75 / Avg: 52.06 / Max: 55.5Min: 36.75 / Avg: 52.26 / Max: 54.63

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On160320480640800Min: 130.23 / Avg: 517.4 / Max: 652.59Min: 101.37 / Avg: 511.05 / Max: 668.12Min: 209.5 / Avg: 662.67 / Max: 884.59Min: 114.26 / Avg: 669.91 / Max: 876.36Min: 58.52 / Avg: 614.53 / Max: 802.45Min: 32.83 / Avg: 631.84 / Max: 775.3

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 1740 / Avg: 2881.42 / Max: 3403Min: 2300 / Avg: 2594.91 / Max: 3401Min: 1900 / Avg: 2877.33 / Max: 3513Min: 1900 / Avg: 2787.1 / Max: 3505Min: 2789 / Avg: 3177.76 / Max: 3709Min: 2771 / Avg: 3169.22 / Max: 3709

OSPRay Studio

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 53 / Avg: 68.82 / Max: 75Min: 50 / Avg: 67.06 / Max: 74Min: 38 / Avg: 51.75 / Max: 57Min: 38 / Avg: 53.78 / Max: 58Min: 37.25 / Avg: 53.26 / Max: 58.25Min: 36.75 / Avg: 51.41 / Max: 55.25

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 129.76 / Avg: 497.33 / Max: 659.2Min: 122.89 / Avg: 488.82 / Max: 662.51Min: 206.26 / Avg: 650.1 / Max: 877.56Min: 214.67 / Avg: 684.96 / Max: 875.35Min: 61.33 / Avg: 648.16 / Max: 799.28Min: 56.6 / Avg: 627.16 / Max: 783.63

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 1631 / Avg: 2895.11 / Max: 3404Min: 2300 / Avg: 2639.14 / Max: 3403Min: 1900 / Avg: 2891.51 / Max: 3509Min: 1900 / Avg: 2766.18 / Max: 3509Min: 2773 / Avg: 3122.61 / Max: 3709Min: 2682 / Avg: 3157.82 / Max: 3709

OSPRay Studio

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 54 / Avg: 69.43 / Max: 76Min: 53 / Avg: 69.12 / Max: 75Min: 35 / Avg: 51.94 / Max: 57Min: 35 / Avg: 51.67 / Max: 57Min: 37.25 / Avg: 51.89 / Max: 55.5Min: 36.38 / Avg: 50.48 / Max: 53.75

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 129.57 / Avg: 500.65 / Max: 657.6Min: 102.33 / Avg: 497.27 / Max: 661.94Min: 212.33 / Avg: 663.86 / Max: 880.6Min: 178.24 / Avg: 661.77 / Max: 876.06Min: 60.36 / Avg: 615.21 / Max: 792.28Min: 60.79 / Avg: 611.59 / Max: 770.42

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 1783 / Avg: 2893.57 / Max: 3403Min: 2300 / Avg: 2622.27 / Max: 3401Min: 1900 / Avg: 2891.42 / Max: 3545Min: 1900 / Avg: 2818.86 / Max: 3514Min: 2720 / Avg: 3276 / Max: 3709Min: 2646 / Avg: 3229.97 / Max: 3709

OSPRay

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 55 / Avg: 73.2 / Max: 77Min: 53 / Avg: 71.52 / Max: 75Min: 40 / Avg: 55.09 / Max: 58Min: 39 / Avg: 54.1 / Max: 58Min: 37.25 / Avg: 53.21 / Max: 56.88Min: 36.38 / Avg: 50.52 / Max: 53.25

OSPRay

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 122.95 / Avg: 530.21 / Max: 639.78Min: 80.49 / Avg: 523.67 / Max: 629.96Min: 205.85 / Avg: 679.41 / Max: 796.02Min: 210.52 / Avg: 667.18 / Max: 772.19Min: 61.53 / Avg: 624.39 / Max: 724.31Min: 60.05 / Avg: 591.62 / Max: 680.48

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2293 / Avg: 2874.31 / Max: 3400Min: 2300 / Avg: 2590.11 / Max: 3402Min: 1900 / Avg: 2827.79 / Max: 3508Min: 1900 / Avg: 2769.32 / Max: 3512Min: 2690 / Avg: 3283.87 / Max: 3709Min: 2764 / Avg: 3287.4 / Max: 3772

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On0.02070.04140.06210.08280.10350.0380.0490.0480.0640.0650.092

OSPRay

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 56 / Avg: 72.16 / Max: 76Min: 52 / Avg: 71.64 / Max: 75Min: 39 / Avg: 55.05 / Max: 58Min: 40 / Avg: 53.77 / Max: 57Min: 37.75 / Avg: 52.77 / Max: 55.5Min: 35.88 / Avg: 49.7 / Max: 52.88

OSPRay

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 133.04 / Avg: 523.63 / Max: 645.71Min: 124.97 / Avg: 528.92 / Max: 632.61Min: 206.88 / Avg: 688.18 / Max: 807.45Min: 211.39 / Avg: 674.63 / Max: 797.32Min: 57.79 / Avg: 616.9 / Max: 718.46Min: 60.18 / Avg: 581.84 / Max: 672.96

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2842.78 / Max: 3400Min: 2200 / Avg: 2873.43 / Max: 3400Min: 1900 / Avg: 2870.01 / Max: 3506Min: 1900 / Avg: 2689.91 / Max: 3502Min: 2771 / Avg: 3286.61 / Max: 3709Min: 2796 / Avg: 3267.78 / Max: 3709

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On0.01670.03340.05010.06680.08350.0260.0400.0330.0530.0410.074

OSPRay

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 46 / Avg: 72.76 / Max: 79Min: 46 / Avg: 73.63 / Max: 80Min: 35 / Avg: 54.32 / Max: 58Min: 34 / Avg: 52.96 / Max: 57Min: 34.63 / Avg: 51.95 / Max: 55.25Min: 32.75 / Avg: 49.32 / Max: 52

OSPRay

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 119.36 / Avg: 524.83 / Max: 617.87Min: 119.41 / Avg: 530.36 / Max: 641.9Min: 107.51 / Avg: 689.16 / Max: 818.74Min: 209.17 / Avg: 676.18 / Max: 801.55Min: 56.53 / Avg: 614.11 / Max: 718.03Min: 56.1 / Avg: 580.71 / Max: 668.08

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2855.45 / Max: 3400Min: 2300 / Avg: 2866.53 / Max: 3402Min: 1900 / Avg: 2900.68 / Max: 3504Min: 1900 / Avg: 2652.54 / Max: 3514Min: 2771 / Avg: 3210.13 / Max: 3709Min: 2802 / Avg: 3315.52 / Max: 3709

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On0.01690.03380.05070.06760.08450.0270.0400.0340.0540.0430.075

Intel Open Image Denoise

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 47 / Avg: 59.15 / Max: 71Min: 45 / Avg: 57.82 / Max: 69Min: 35 / Avg: 43.41 / Max: 50Min: 35 / Avg: 42.32 / Max: 49Min: 34.63 / Avg: 40.87 / Max: 46.63Min: 33.25 / Avg: 39.68 / Max: 46.38

Intel Open Image Denoise

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 81.25 / Avg: 374.67 / Max: 565.97Min: 119.6 / Avg: 359.55 / Max: 567.51Min: 204.01 / Avg: 487.71 / Max: 755.13Min: 207.41 / Avg: 477.81 / Max: 753.94Min: 30.85 / Avg: 328.65 / Max: 583.24Min: 57.92 / Avg: 331.79 / Max: 581.42

Intel Open Image Denoise

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterIntel Open Image Denoise 1.4.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2632.24 / Max: 3400Min: 2300 / Avg: 2543.96 / Max: 3400Min: 1900 / Avg: 2888.03 / Max: 3505Min: 1900 / Avg: 2755.84 / Max: 3503Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 1.4.0Run: RTLightmap.hdr.4096x4096AVX-512 OffAVX-512 On0.00110.00220.00330.00440.00550.0030.0040.0030.0040.0050.005

Intel Open Image Denoise

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 50 / Avg: 61.2 / Max: 75Min: 48 / Avg: 59.52 / Max: 72Min: 37 / Avg: 43.04 / Max: 50Min: 37 / Avg: 42.14 / Max: 50Min: 35.88 / Avg: 40.59 / Max: 46.63Min: 35 / Avg: 39.27 / Max: 45.5

Intel Open Image Denoise

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 117.02 / Avg: 351.27 / Max: 568.33Min: 78.9 / Avg: 329.46 / Max: 563.85Min: 190.83 / Avg: 446.72 / Max: 747.36Min: 121.92 / Avg: 432.92 / Max: 757.14Min: 55.38 / Avg: 291.64 / Max: 587.02Min: 59.83 / Avg: 288.89 / Max: 584.26

Intel Open Image Denoise

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterIntel Open Image Denoise 1.4.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2644.39 / Max: 3400Min: 2300 / Avg: 2484.49 / Max: 3123Min: 1900 / Avg: 2976.52 / Max: 3510Min: 1900 / Avg: 2985.41 / Max: 3510Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.hdr_alb_nrm.3840x2160AVX-512 OffAVX-512 On0.00270.00540.00810.01080.01350.0060.0090.0070.0100.0120.012

OpenVKL

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVKL 1.3.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 50 / Avg: 69.77 / Max: 80Min: 46 / Avg: 69.3 / Max: 78Min: 36 / Avg: 49.72 / Max: 57Min: 35 / Avg: 48.73 / Max: 56Min: 35.5 / Avg: 47.03 / Max: 54.63Min: 34.13 / Avg: 45.24 / Max: 52.88

OpenVKL

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 1.3.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 101.07 / Avg: 456.78 / Max: 652.79Min: 100.02 / Avg: 455.32 / Max: 653.28Min: 183.35 / Avg: 599.21 / Max: 804.94Min: 179.36 / Avg: 581.38 / Max: 785.63Min: 60.18 / Avg: 488.95 / Max: 748.42Min: 57.24 / Avg: 466.56 / Max: 706.65

OpenVKL

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterOpenVKL 1.3.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2988.69 / Max: 3410Min: 2262 / Avg: 2929.05 / Max: 3409Min: 1899 / Avg: 2931.06 / Max: 3519Min: 1169 / Avg: 2887.71 / Max: 3515Min: 2621 / Avg: 3442.04 / Max: 3709Min: 2591 / Avg: 3486.01 / Max: 3709

OpenVKL

Benchmark: vklBenchmark ISPC

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCAVX-512 OffAVX-512 On0.64671.29341.94012.58683.23351.7342.0141.7262.0572.4052.874

Embree

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 48 / Avg: 61.37 / Max: 69Min: 46 / Avg: 57.94 / Max: 65Min: 37 / Avg: 46.83 / Max: 51Min: 34 / Avg: 42.39 / Max: 48Min: 35 / Avg: 42.18 / Max: 48.88Min: 33.25 / Avg: 39.98 / Max: 46.63

Embree

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 80.21 / Avg: 421.57 / Max: 583.55Min: 118.24 / Avg: 406.24 / Max: 561.45Min: 172.58 / Avg: 565.19 / Max: 755.21Min: 209.36 / Avg: 478.88 / Max: 665.78Min: 42.7 / Avg: 366.77 / Max: 692.37Min: 36.29 / Avg: 357.33 / Max: 701.32

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2850.31 / Max: 3400Min: 2300 / Avg: 2636.37 / Max: 3400Min: 1900 / Avg: 3070.52 / Max: 3512Min: 1900 / Avg: 3006.61 / Max: 3508Min: 2771 / Avg: 3462.8 / Max: 3709Min: 2763 / Avg: 3454.37 / Max: 3709

Embree

Binary: Pathtracer ISPC - Model: Crown

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On0.11450.2290.34350.4580.57250.1670.1840.1100.1930.4180.509

Embree

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 44 / Avg: 57.26 / Max: 66Min: 50 / Avg: 59.72 / Max: 67Min: 39 / Avg: 46.46 / Max: 51Min: 34 / Avg: 41.38 / Max: 47Min: 35.88 / Avg: 41.18 / Max: 48Min: 32.38 / Avg: 37.98 / Max: 44.38

Embree

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 101.95 / Avg: 400.96 / Max: 615.31Min: 122.75 / Avg: 389.97 / Max: 625.41Min: 205.64 / Avg: 537.44 / Max: 760.22Min: 207.22 / Avg: 480.24 / Max: 708.89Min: 26.98 / Avg: 343.25 / Max: 711.13Min: 37.38 / Avg: 310.11 / Max: 703.12

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2765.28 / Max: 3401Min: 2300 / Avg: 2565.14 / Max: 3400Min: 1900 / Avg: 3074.54 / Max: 3507Min: 1900 / Avg: 3148.38 / Max: 3511Min: 2833 / Avg: 3434 / Max: 3709Min: 2918 / Avg: 3474.26 / Max: 3709

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On0.15530.31060.46590.62120.77650.2400.2720.1680.2550.5180.690

LeelaChessZero

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.28CPU Temperature MonitorAVX-512 OffAVX-512 On1632486480Min: 44 / Avg: 65.29 / Max: 84Min: 45 / Avg: 66.24 / Max: 82Min: 35 / Avg: 47.75 / Max: 56Min: 34 / Avg: 43.65 / Max: 56Min: 34.63 / Avg: 46.31 / Max: 59.13Min: 33.25 / Avg: 40.64 / Max: 53.75

LeelaChessZero

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.28CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 124.39 / Avg: 390.39 / Max: 591.33Min: 123.27 / Avg: 395.84 / Max: 585.79Min: 207.21 / Avg: 535.98 / Max: 730.58Min: 211.45 / Avg: 540.33 / Max: 766.98Min: 58.03 / Avg: 372.74 / Max: 519.8Min: 59.5 / Avg: 367.29 / Max: 503.22

LeelaChessZero

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.28CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 3281.52 / Max: 3416Min: 2300 / Avg: 3283.63 / Max: 3411Min: 1900 / Avg: 3415.13 / Max: 3542Min: 1900 / Avg: 3431.65 / Max: 3563Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3711

LeelaChessZero

Backend: Eigen

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.28Backend: EigenAVX-512 OffAVX-512 On61218243012.0614.5315.3820.6121.8924.74

LeelaChessZero

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.28CPU Temperature MonitorAVX-512 OffAVX-512 On1632486480Min: 45 / Avg: 60.47 / Max: 85Min: 54 / Avg: 71.37 / Max: 78Min: 36 / Avg: 48.76 / Max: 59Min: 35 / Avg: 44.16 / Max: 56Min: 33.63 / Avg: 46.72 / Max: 58.25Min: 33.25 / Avg: 40.84 / Max: 54.63

LeelaChessZero

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.28CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 117.5 / Avg: 395.29 / Max: 593.12Min: 81.58 / Avg: 394.24 / Max: 583.5Min: 207.43 / Avg: 534.64 / Max: 715.83Min: 208.76 / Avg: 538.72 / Max: 765.81Min: 55.77 / Avg: 381.66 / Max: 520.36Min: 57.22 / Avg: 379.11 / Max: 511.65

LeelaChessZero

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.28CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 3292.51 / Max: 3407Min: 2300 / Avg: 3285.55 / Max: 3420Min: 1900 / Avg: 3429.01 / Max: 3524Min: 1900 / Avg: 3432.97 / Max: 3523Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709.02 / Max: 3731

LeelaChessZero

Backend: BLAS

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.28Backend: BLASAVX-512 OffAVX-512 On61218243012.0914.0114.1119.8124.7024.19

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 51 / Avg: 64.77 / Max: 74Min: 54 / Avg: 66.83 / Max: 75Min: 37 / Avg: 46.66 / Max: 54Min: 38 / Avg: 47.79 / Max: 53Min: 34.63 / Avg: 44.85 / Max: 55.13Min: 34.63 / Avg: 43.53 / Max: 49.5

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 120.76 / Avg: 424.25 / Max: 596.15Min: 116.32 / Avg: 423.52 / Max: 596.26Min: 179.48 / Avg: 575.96 / Max: 772.34Min: 184.97 / Avg: 576.22 / Max: 776.65Min: 45.38 / Avg: 492.05 / Max: 716.77Min: 62.09 / Avg: 449.53 / Max: 626.83

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2851.54 / Max: 3409Min: 2300 / Avg: 2747.12 / Max: 3411Min: 1900 / Avg: 2907.36 / Max: 3519Min: 1900 / Avg: 2733.68 / Max: 3518Min: 3709 / Avg: 3709 / Max: 3709Min: 3697 / Avg: 3708.93 / Max: 3709

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 51 / Avg: 65.39 / Max: 73Min: 53 / Avg: 67.31 / Max: 75Min: 36 / Avg: 46.62 / Max: 53Min: 37 / Avg: 47.75 / Max: 53Min: 34.63 / Avg: 43.61 / Max: 48.38Min: 34.13 / Avg: 43.31 / Max: 48

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 116.53 / Avg: 308.23 / Max: 388.94Min: 116.85 / Avg: 307.49 / Max: 373.85Min: 209.04 / Avg: 468.14 / Max: 560.62Min: 206.44 / Avg: 463.48 / Max: 559.71Min: 58.11 / Avg: 334.36 / Max: 425.46Min: 56.93 / Avg: 328.16 / Max: 419.54

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2834.61 / Max: 3407Min: 2300 / Avg: 2707.62 / Max: 3403Min: 1900 / Avg: 3338.32 / Max: 3520Min: 1900 / Avg: 3216.06 / Max: 3518Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 51 / Avg: 70.06 / Max: 77Min: 51 / Avg: 70.25 / Max: 76Min: 35 / Avg: 49.22 / Max: 53Min: 36 / Avg: 49.76 / Max: 54Min: 33.63 / Avg: 46.39 / Max: 50.63Min: 33.63 / Avg: 46.32 / Max: 50.63

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 121.41 / Avg: 485.92 / Max: 594.32Min: 117.09 / Avg: 488.17 / Max: 595.98Min: 212.95 / Avg: 636.84 / Max: 773.77Min: 108.87 / Avg: 636.97 / Max: 776.52Min: 33.52 / Avg: 555.47 / Max: 671.66Min: 59.96 / Avg: 563.77 / Max: 673.82

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2883.8 / Max: 3400Min: 2300 / Avg: 2672.86 / Max: 3410Min: 1900 / Avg: 2540.23 / Max: 3513Min: 1900 / Avg: 2474.62 / Max: 3509Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 51 / Avg: 66.11 / Max: 71Min: 54 / Avg: 65.21 / Max: 69Min: 36 / Avg: 45.53 / Max: 49Min: 38 / Avg: 45.45 / Max: 49Min: 34.13 / Avg: 42.84 / Max: 47.75Min: 36.38 / Avg: 42.68 / Max: 48

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On90180270360450Min: 120.42 / Avg: 314.45 / Max: 351.47Min: 114.08 / Avg: 296.11 / Max: 324.93Min: 207.58 / Avg: 466.79 / Max: 528.2Min: 110.94 / Avg: 442.49 / Max: 492.85Min: 54.8 / Avg: 320.85 / Max: 377.94Min: 32.99 / Avg: 316.15 / Max: 367.34

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 3086.6 / Max: 3400Min: 2300 / Avg: 2877.68 / Max: 3400Min: 1900 / Avg: 3335.14 / Max: 3516Min: 1900 / Avg: 3282.46 / Max: 3518Min: 3697 / Avg: 3708.98 / Max: 3709Min: 3700 / Avg: 3708.99 / Max: 3709

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 53 / Avg: 65.7 / Max: 74Min: 54 / Avg: 68.2 / Max: 75Min: 37 / Avg: 47.69 / Max: 53Min: 38 / Avg: 48.39 / Max: 53Min: 37.25 / Avg: 44.79 / Max: 51.25Min: 44.38 / Avg: 52.93 / Max: 60

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 124.13 / Avg: 437.31 / Max: 595.17Min: 103.25 / Avg: 453.02 / Max: 598.46Min: 211.06 / Avg: 598.84 / Max: 769.45Min: 184.38 / Avg: 608.53 / Max: 775.32Min: 32.05 / Avg: 494 / Max: 713.94Min: 31.38 / Avg: 537.92 / Max: 712.89

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2856.54 / Max: 3402Min: 2300 / Avg: 2704.63 / Max: 3402Min: 1900 / Avg: 2956.37 / Max: 3516Min: 1900 / Avg: 2821.77 / Max: 3515Min: 3703 / Avg: 3708.97 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 51 / Avg: 65.88 / Max: 73Min: 52 / Avg: 66.78 / Max: 74Min: 35 / Avg: 46.14 / Max: 52Min: 37 / Avg: 47.74 / Max: 53Min: 43 / Avg: 52.81 / Max: 58.25Min: 43 / Avg: 52.83 / Max: 57.75

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 122.5 / Avg: 322.04 / Max: 389.14Min: 83.01 / Avg: 313.16 / Max: 365.89Min: 110.3 / Avg: 466.39 / Max: 569.05Min: 214.75 / Avg: 471.13 / Max: 544.51Min: 30.08 / Avg: 340.51 / Max: 417.91Min: 61.86 / Avg: 340.27 / Max: 413.32

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2936.97 / Max: 3405Min: 2300 / Avg: 2689.46 / Max: 3402Min: 1900 / Avg: 3338.2 / Max: 3518Min: 1900 / Avg: 3337.42 / Max: 3517Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 51 / Avg: 64.63 / Max: 73Min: 54 / Avg: 67.15 / Max: 75Min: 37 / Avg: 46.87 / Max: 52Min: 38 / Avg: 47.81 / Max: 53Min: 43.88 / Avg: 54.3 / Max: 62.25Min: 43.5 / Avg: 52.19 / Max: 59.13

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 121.91 / Avg: 423.91 / Max: 595.14Min: 109.29 / Avg: 424.09 / Max: 596.7Min: 205.49 / Avg: 579.26 / Max: 771.92Min: 111.58 / Avg: 575.15 / Max: 772.59Min: 60.66 / Avg: 500.64 / Max: 721.31Min: 61.67 / Avg: 453.86 / Max: 632.57

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2835.42 / Max: 3408Min: 2300 / Avg: 2731.23 / Max: 3408Min: 1900 / Avg: 2897.84 / Max: 3517Min: 1900 / Avg: 2758.89 / Max: 3517Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 53 / Avg: 66.51 / Max: 75Min: 54 / Avg: 67.84 / Max: 75Min: 36 / Avg: 46.86 / Max: 52Min: 37 / Avg: 47.84 / Max: 53Min: 44.38 / Avg: 53.07 / Max: 59.13Min: 43.5 / Avg: 52.39 / Max: 57.75

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 118.87 / Avg: 314.48 / Max: 389.2Min: 115.91 / Avg: 309.32 / Max: 374.48Min: 203.35 / Avg: 468.13 / Max: 563.99Min: 106.45 / Avg: 468.4 / Max: 556.72Min: 42.78 / Avg: 344.31 / Max: 430.71Min: 60.73 / Avg: 336.08 / Max: 425.61

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2813.09 / Max: 3401Min: 2300 / Avg: 2702.75 / Max: 3401Min: 1900 / Avg: 3376.77 / Max: 3517Min: 1900 / Avg: 3277.52 / Max: 3516Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 57 / Avg: 73.09 / Max: 77Min: 54 / Avg: 71.83 / Max: 77Min: 37 / Avg: 49.9 / Max: 54Min: 37 / Avg: 50.14 / Max: 54Min: 43 / Avg: 56.4 / Max: 61.38Min: 42.13 / Avg: 55.39 / Max: 60.88

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 130.88 / Avg: 488.76 / Max: 594.17Min: 116.14 / Avg: 490.29 / Max: 592.28Min: 207.09 / Avg: 636.05 / Max: 765.98Min: 212.93 / Avg: 636.94 / Max: 774.46Min: 32.8 / Avg: 552.07 / Max: 653.8Min: 56.51 / Avg: 539.83 / Max: 646.46

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2701.11 / Max: 3401Min: 2300 / Avg: 2582.73 / Max: 3401Min: 1900 / Avg: 2690.42 / Max: 3512Min: 1900 / Avg: 2613.81 / Max: 3508Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 55 / Avg: 72.43 / Max: 78Min: 53 / Avg: 69.21 / Max: 74Min: 36 / Avg: 47.99 / Max: 52Min: 38 / Avg: 48.31 / Max: 52Min: 43.5 / Avg: 54.68 / Max: 57.75Min: 43.5 / Avg: 51.97 / Max: 57.25

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 123.39 / Avg: 336.16 / Max: 377.19Min: 118.87 / Avg: 330.83 / Max: 360.91Min: 106.99 / Avg: 477.41 / Max: 537.73Min: 209.97 / Avg: 483.39 / Max: 522.36Min: 56.69 / Avg: 346.41 / Max: 397.2Min: 58.85 / Avg: 324.27 / Max: 371.22

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2943.87 / Max: 3400Min: 2300 / Avg: 2506.26 / Max: 3400Min: 1900 / Avg: 3287.49 / Max: 3517Min: 1900 / Avg: 3360.23 / Max: 3516Min: 3698 / Avg: 3708.91 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 54 / Avg: 70.96 / Max: 78Min: 53 / Avg: 67.48 / Max: 74Min: 36 / Avg: 49.25 / Max: 54Min: 38 / Avg: 48.66 / Max: 53Min: 42.63 / Avg: 55.22 / Max: 61Min: 41.25 / Avg: 53.22 / Max: 60

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 122.8 / Avg: 469.84 / Max: 592.57Min: 101.9 / Avg: 468.91 / Max: 551.9Min: 203.11 / Avg: 619.84 / Max: 770.48Min: 211.14 / Avg: 618.61 / Max: 769.39Min: 60.72 / Avg: 532.23 / Max: 674.52Min: 31.6 / Avg: 498.87 / Max: 641.77

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2912.11 / Max: 3406Min: 2300 / Avg: 2658.36 / Max: 3406Min: 1900 / Avg: 2946.44 / Max: 3517Min: 1900 / Avg: 2739.54 / Max: 3513Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 39 / Avg: 62.34 / Max: 77Min: 37 / Avg: 61.39 / Max: 74Min: 36 / Avg: 46.12 / Max: 53Min: 37 / Avg: 47.32 / Max: 53Min: 29.25 / Avg: 48.39 / Max: 60.5Min: 31.88 / Avg: 48.49 / Max: 59.25

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 79.98 / Avg: 423.53 / Max: 591.06Min: 116.32 / Avg: 423.16 / Max: 593.15Min: 202.66 / Avg: 577.34 / Max: 773.65Min: 213.45 / Avg: 574.76 / Max: 771.15Min: 58.55 / Avg: 490.27 / Max: 722.41Min: 58.49 / Avg: 475.62 / Max: 691.71

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2300 / Avg: 2976.98 / Max: 3411Min: 2300 / Avg: 2795.9 / Max: 3409Min: 1900 / Avg: 3038.98 / Max: 3517Min: 1900 / Avg: 2810.29 / Max: 3515Min: 3709 / Avg: 3709 / Max: 3709Min: 3700 / Avg: 3708.95 / Max: 3709


Phoronix Test Suite v10.8.4