Sapphire Rapids AVX-512 Benchmarks

Ice Lake, Sapphire Rapids, Genoa AVX-512 benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2301176-NE-SAPPHIRER14&sor.

ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerVulkanCompilerFile-SystemScreen ResolutionXeon 8380Xeon 8490HEPYC 9654 AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads)Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS)Intel Ice Lake IEH512GB2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007ASPEEDVGA HDMI2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFPUbuntu 22.105.19.0-29-generic (x86_64)GNOME Shell 43.1X Server 1.21.1.41.3.224GCC 12.2.0ext41920x10802 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)Intel Device 1bce1008GB4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T2 x AMD EPYC 9654 96-Core @ 3.71GHz (192 Cores / 384 Threads)AMD Titanite_4G (RTI1002E BIOS)AMD Device 14a41520GBBroadcom NetXtreme BCM5720 PCIeOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseEnvironment Details- Xeon 8380: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" CFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile"- Xeon 8380: AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" - Xeon 8490H: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" CFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile"- Xeon 8490H: AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" - EPYC 9654: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" CFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile"- EPYC 9654: AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" Compiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Xeon 8380: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd000375- Xeon 8380: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd000375- Xeon 8490H: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0000c0- Xeon 8490H: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0000c0- EPYC 9654: AVX-512 Off: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa10110d- EPYC 9654: AVX-512 On: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa10110dPython Details- Python 3.10.7Security Details- Xeon 8380: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon 8380: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon 8490H: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon 8490H: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9654: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9654: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamlczero: BLASlczero: Eigenembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Crownopenvkl: vklBenchmark ISPCoidn: RT.hdr_alb_nrm.3840x2160oidn: RTLightmap.hdr.4096x4096ospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 16 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 16 - Path Tracerospray-studio: 3 - 4K - 32 - Path Traceronednn: Deconvolution Batch shapes_3d - f32 - CPUmnn: mobilenetV3mnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0cpuminer-opt: scryptcpuminer-opt: Triple SHA-256, Onecoincpuminer-opt: Quad SHA-256, Pyritecpuminer-opt: x25xcpuminer-opt: Deepcoincpuminer-opt: Skeincoincpuminer-opt: LBC, LBRY Creditsopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUminibude: OpenMP - BM1minibude: OpenMP - BM1minibude: OpenMP - BM2minibude: OpenMP - BM2openfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenfoam: drivaerFastback, Large Mesh Size - Mesh Timeopenfoam: drivaerFastback, Large Mesh Size - Execution Timesmhasher: FarmHash32 x86_64 AVXsmhasher: FarmHash32 x86_64 AVXXeon 8380Xeon 8490HEPYC 9654 AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On183.8325217.0993379.5792105.2624113.32618.8158541.861773.746316.827559.417543.1140916.936045.854721.7973158.5261251.567869.726414.3286247.2732161.334216.799659.515943.1601913.41964780470996.344170.50797922.071.0314.345513.779219.957814912394348165177028490627801.992861.7642.67818.1334.1951122.746470333551731840.415793039935015708350413.981.581750.3011.411014.2719.681796.15971.8461993.06779.723162.72306358.63124887.207627106.761130330.5331.584227.4544175.6914455.031287.8658228.12194.3750835.784647.821620.193349.514548.4134819.532579.140512.6264221.7294180.170483.419711.9769318.7928125.163920.231349.420848.2393821.958855245750106.179874.80339172.941.4221.224221.064025.517913082087241834156324927498470.8751961.7092.2977.9093.9992307.4213285479240402650.366469061327341913367701.601.164442.954.491119.4517.832339.32393.5732588.758103.550160.6645361.366881051.35257117.005933979.9931.084264.7704226.2678584.1487102.6136187.64775.3242832.854271.934621.286246.973566.7540887.589346.861421.3212232.2085257.562284.837811.7823405.7230147.457821.178947.209466.7281889.38997542824390.395962.037710342.951.4823.174822.832832.48379801560131373117018608373002.012412.2883.55117.7165.2221623.8810926376873202166.909110767773326391773906.761.573878.7930.911732.7417.292480.60799.2252602.652104.106169.84164194.789751039.31534319.124537809.7123.268424.2714141.1445875.641668.4347281.23613.55091492.884440.140727.067036.938292.0211648.199583.700811.9378355.6686168.2285100.53979.9734592.4522101.042526.843237.247392.0328647.75451067111134122.526092.651211964.191.9936.364335.954442.96628591358927204102916332327490.7368222.0552.7378.4964.4153665.55207420014726204071.591055131072453672677103184.011.046206.7219.313738.928.013586.273143.4513643.840145.754159.67329195.47713847.910294305.124242508.3523.273510.8775187.35151006.082495.1665206.31714.84441410.422267.901630.855332.4024120.5142787.327071.508813.9740491.3426194.7179109.25819.1835660.5371144.885830.456332.8263120.5189787.723594258161177.6774153.181511763.461.7226.395325.309640.6658705112162247583613341265411.736673.8897.56624.0819.2782947.94333885013343635712.581652401413063492780114083.241.146218.257.713791.8012.645192.425207.6976371.320254.853146.75453110.94948867.3792803.544436458.3126.413613.9355155.91181205.181379.4967191.33255.22401966.405248.700334.232229.202984.86761128.8450100.28559.9667704.5818135.9937126.01147.9604809.0751118.352534.500828.977184.39961132.613391719085213.9512181.888913413.481.6643.708143.235854.155358192601850069511058221200.9862143.8667.20414.7278.7624816.31332628722525007691.7816029019907901068993118103.940.9611029.454.347420.496.467274.050290.9628562.694342.508145.89944112.38169996.777412849.61139795.3626.551OpenBenchmarking.org

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OnAVX-512 Off130260390520650SE +/- 0.55, N = 3SE +/- 0.22, N = 3SE +/- 0.95, N = 3SE +/- 0.93, N = 3SE +/- 0.49, N = 3SE +/- 0.52, N = 3613.94510.88424.27264.77227.45183.83

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OnAVX-512 Off50100150200250SE +/- 0.32, N = 3SE +/- 0.84, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.35, N = 3SE +/- 0.69, N = 3141.14226.27155.91187.35175.69217.10

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3700 / Avg: 3708.95 / Max: 3709Min: 1900 / Avg: 3038.98 / Max: 3517Min: 1900 / Avg: 2810.29 / Max: 3515Min: 2300 / Avg: 2976.98 / Max: 3411Min: 2300 / Avg: 2795.9 / Max: 3409

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 116.32 / Avg: 423.16 / Max: 593.15Min: 79.98 / Avg: 423.53 / Max: 591.06Min: 58.49 / Avg: 475.62 / Max: 691.71Min: 58.55 / Avg: 490.27 / Max: 722.41Min: 213.45 / Avg: 574.76 / Max: 771.15Min: 202.66 / Avg: 577.34 / Max: 773.65

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 36 / Avg: 46.12 / Max: 53Min: 37 / Avg: 47.32 / Max: 53Min: 29.25 / Avg: 48.39 / Max: 60.5Min: 31.88 / Avg: 48.49 / Max: 59.25Min: 37 / Avg: 61.39 / Max: 74Min: 39 / Avg: 62.34 / Max: 77

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OnAVX-512 Off30060090012001500SE +/- 3.78, N = 3SE +/- 0.56, N = 3SE +/- 2.15, N = 3SE +/- 0.51, N = 3SE +/- 0.94, N = 3SE +/- 0.62, N = 31205.181006.08875.64584.15455.03379.58

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OnAVX-512 Off20406080100SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 0.26, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 3SE +/- 0.17, N = 368.43102.6179.5095.1787.87105.26

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 1900 / Avg: 2946.44 / Max: 3517Min: 1900 / Avg: 2739.54 / Max: 3513Min: 2300 / Avg: 2912.11 / Max: 3406Min: 2300 / Avg: 2658.36 / Max: 3406

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 101.9 / Avg: 468.91 / Max: 551.9Min: 122.8 / Avg: 469.84 / Max: 592.57Min: 31.6 / Avg: 498.87 / Max: 641.77Min: 60.72 / Avg: 532.23 / Max: 674.52Min: 211.14 / Avg: 618.61 / Max: 769.39Min: 203.11 / Avg: 619.84 / Max: 770.48

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OnAVX-512 Off1530456075Min: 38 / Avg: 48.66 / Max: 53Min: 36 / Avg: 49.25 / Max: 54Min: 41.25 / Avg: 53.22 / Max: 60Min: 42.63 / Avg: 55.22 / Max: 61Min: 53 / Avg: 67.48 / Max: 74Min: 54 / Avg: 70.96 / Max: 78

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

Xeon 8490HXeon 8380EPYC 9654OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamAVX-512 OnAVX-512 Off60120180240300SE +/- 0.71, N = 3SE +/- 0.21, N = 3SE +/- 0.16, N = 3SE +/- 0.44, N = 3SE +/- 0.04, N = 3SE +/- 0.36, N = 3281.24187.65228.12113.33206.32191.33

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

Xeon 8490HXeon 8380EPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamAVX-512 OnAVX-512 Off246810SE +/- 0.0091, N = 3SE +/- 0.0060, N = 3SE +/- 0.0029, N = 3SE +/- 0.0346, N = 3SE +/- 0.0009, N = 3SE +/- 0.0099, N = 33.55095.32424.37508.81584.84445.2240

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3698 / Avg: 3708.91 / Max: 3709Min: 1900 / Avg: 3360.23 / Max: 3516Min: 1900 / Avg: 3287.49 / Max: 3517Min: 2300 / Avg: 2943.87 / Max: 3400Min: 2300 / Avg: 2506.26 / Max: 3400

Neural Magic DeepSparse

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OnAVX-512 Off100200300400500Min: 58.85 / Avg: 324.27 / Max: 371.22Min: 56.69 / Avg: 346.41 / Max: 397.2Min: 118.87 / Avg: 330.83 / Max: 360.91Min: 123.39 / Avg: 336.16 / Max: 377.19Min: 106.99 / Avg: 477.41 / Max: 537.73Min: 209.97 / Avg: 483.39 / Max: 522.36

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 36 / Avg: 47.99 / Max: 52Min: 38 / Avg: 48.31 / Max: 52Min: 43.5 / Avg: 51.97 / Max: 57.25Min: 43.5 / Avg: 54.68 / Max: 57.75Min: 53 / Avg: 69.21 / Max: 74Min: 55 / Avg: 72.43 / Max: 78

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OnAVX-512 Off400800120016002000SE +/- 1.71, N = 3SE +/- 0.94, N = 3SE +/- 1.88, N = 3SE +/- 0.84, N = 3SE +/- 0.98, N = 3SE +/- 1.47, N = 31966.411410.421492.88832.85835.78541.86

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

Xeon 8490HXeon 8380EPYC 9654OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OnAVX-512 Off1632486480SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 340.1471.9347.8273.7548.7067.90

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2701.11 / Max: 3401Min: 2300 / Avg: 2582.73 / Max: 3401Min: 1900 / Avg: 2690.42 / Max: 3512Min: 1900 / Avg: 2613.81 / Max: 3508

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 130.88 / Avg: 488.76 / Max: 594.17Min: 116.14 / Avg: 490.29 / Max: 592.28Min: 56.51 / Avg: 539.83 / Max: 646.46Min: 32.8 / Avg: 552.07 / Max: 653.8Min: 207.09 / Avg: 636.05 / Max: 765.98Min: 212.93 / Avg: 636.94 / Max: 774.46

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 37 / Avg: 49.9 / Max: 54Min: 37 / Avg: 50.14 / Max: 54Min: 42.13 / Avg: 55.39 / Max: 60.88Min: 43 / Avg: 56.4 / Max: 61.38Min: 54 / Avg: 71.83 / Max: 77Min: 57 / Avg: 73.09 / Max: 77

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamAVX-512 OnAVX-512 Off816243240SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 334.2330.8627.0721.2920.1916.83

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamAVX-512 OnAVX-512 Off1326395265SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.20, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 329.2032.4036.9446.9749.5159.42

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 1900 / Avg: 3376.77 / Max: 3517Min: 1900 / Avg: 3277.52 / Max: 3516Min: 2300 / Avg: 2813.09 / Max: 3401Min: 2300 / Avg: 2702.75 / Max: 3401

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OnAVX-512 Off100200300400500Min: 115.91 / Avg: 309.32 / Max: 374.48Min: 118.87 / Avg: 314.48 / Max: 389.2Min: 60.73 / Avg: 336.08 / Max: 425.61Min: 42.78 / Avg: 344.31 / Max: 430.71Min: 203.35 / Avg: 468.13 / Max: 563.99Min: 106.45 / Avg: 468.4 / Max: 556.72

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 36 / Avg: 46.86 / Max: 52Min: 37 / Avg: 47.84 / Max: 53Min: 43.5 / Avg: 52.39 / Max: 57.75Min: 44.38 / Avg: 53.07 / Max: 59.13Min: 53 / Avg: 66.51 / Max: 75Min: 54 / Avg: 67.84 / Max: 75

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On306090120150SE +/- 0.22, N = 3SE +/- 0.19, N = 3SE +/- 0.03, N = 3SE +/- 0.17, N = 3SE +/- 0.21, N = 3SE +/- 0.10, N = 3120.5184.8792.0266.7548.4143.11

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamAVX-512 OnAVX-512 Off2004006008001000SE +/- 0.76, N = 3SE +/- 1.38, N = 3SE +/- 0.46, N = 3SE +/- 2.80, N = 3SE +/- 3.51, N = 3SE +/- 1.29, N = 3648.20887.59787.331128.85819.53916.94

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 1900 / Avg: 2897.84 / Max: 3517Min: 1900 / Avg: 2758.89 / Max: 3517Min: 2300 / Avg: 2835.42 / Max: 3408Min: 2300 / Avg: 2731.23 / Max: 3408

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 121.91 / Avg: 423.91 / Max: 595.14Min: 109.29 / Avg: 424.09 / Max: 596.7Min: 61.67 / Avg: 453.86 / Max: 632.57Min: 60.66 / Avg: 500.64 / Max: 721.31Min: 111.58 / Avg: 575.15 / Max: 772.59Min: 205.49 / Avg: 579.26 / Max: 771.92

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 37 / Avg: 46.87 / Max: 52Min: 38 / Avg: 47.81 / Max: 53Min: 43.5 / Avg: 52.19 / Max: 59.13Min: 43.88 / Avg: 54.3 / Max: 62.25Min: 51 / Avg: 64.63 / Max: 73Min: 54 / Avg: 67.15 / Max: 75

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OnAVX-512 Off20406080100SE +/- 0.67, N = 3SE +/- 0.16, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.14, N = 3100.2971.5183.7046.8679.1445.85

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OnAVX-512 Off510152025SE +/- 0.0671, N = 3SE +/- 0.0319, N = 3SE +/- 0.0214, N = 3SE +/- 0.0534, N = 3SE +/- 0.0206, N = 3SE +/- 0.0648, N = 39.966713.974011.937821.321212.626421.7973

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 1900 / Avg: 3338.2 / Max: 3518Min: 1900 / Avg: 3337.42 / Max: 3517Min: 2300 / Avg: 2936.97 / Max: 3405Min: 2300 / Avg: 2689.46 / Max: 3402

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OnAVX-512 Off100200300400500Min: 83.01 / Avg: 313.16 / Max: 365.89Min: 122.5 / Avg: 322.04 / Max: 389.14Min: 61.86 / Avg: 340.27 / Max: 413.32Min: 30.08 / Avg: 340.51 / Max: 417.91Min: 110.3 / Avg: 466.39 / Max: 569.05Min: 214.75 / Avg: 471.13 / Max: 544.51

Neural Magic DeepSparse

CPU Temperature Monitor

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 35 / Avg: 46.14 / Max: 52Min: 37 / Avg: 47.74 / Max: 53Min: 43 / Avg: 52.81 / Max: 58.25Min: 43 / Avg: 52.83 / Max: 57.75Min: 51 / Avg: 65.88 / Max: 73Min: 52 / Avg: 66.78 / Max: 74

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OnAVX-512 Off150300450600750SE +/- 5.42, N = 13SE +/- 1.03, N = 3SE +/- 1.22, N = 3SE +/- 0.51, N = 3SE +/- 0.18, N = 3SE +/- 0.92, N = 3704.58491.34355.67232.21221.73158.53

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OnAVX-512 Off60120180240300SE +/- 0.99, N = 13SE +/- 0.35, N = 3SE +/- 0.53, N = 3SE +/- 0.30, N = 3SE +/- 0.11, N = 3SE +/- 1.34, N = 3135.99194.72168.23257.56180.17251.57

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3703 / Avg: 3708.97 / Max: 3709Min: 1900 / Avg: 2956.37 / Max: 3516Min: 1900 / Avg: 2821.77 / Max: 3515Min: 2300 / Avg: 2856.54 / Max: 3402Min: 2300 / Avg: 2704.63 / Max: 3402

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 124.13 / Avg: 437.31 / Max: 595.17Min: 103.25 / Avg: 453.02 / Max: 598.46Min: 32.05 / Avg: 494 / Max: 713.94Min: 31.38 / Avg: 537.92 / Max: 712.89Min: 211.06 / Avg: 598.84 / Max: 769.45Min: 184.38 / Avg: 608.53 / Max: 775.32

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 37.25 / Avg: 44.79 / Max: 51.25Min: 44.38 / Avg: 52.93 / Max: 60Min: 37 / Avg: 47.69 / Max: 53Min: 38 / Avg: 48.39 / Max: 53Min: 53 / Avg: 65.7 / Max: 74Min: 54 / Avg: 68.2 / Max: 75

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OnAVX-512 Off306090120150SE +/- 2.25, N = 15SE +/- 1.97, N = 15SE +/- 1.49, N = 15SE +/- 0.59, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3126.01109.26100.5484.8483.4269.73

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OnAVX-512 Off48121620SE +/- 0.1413, N = 15SE +/- 0.1629, N = 15SE +/- 0.1607, N = 15SE +/- 0.0817, N = 3SE +/- 0.0082, N = 3SE +/- 0.0435, N = 37.96049.18359.973411.782311.976914.3286

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3700 / Avg: 3708.99 / Max: 3709Min: 3697 / Avg: 3708.98 / Max: 3709Min: 1900 / Avg: 3335.14 / Max: 3516Min: 1900 / Avg: 3282.46 / Max: 3518Min: 2300 / Avg: 3086.6 / Max: 3400Min: 2300 / Avg: 2877.68 / Max: 3400

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OnAVX-512 Off90180270360450Min: 114.08 / Avg: 296.11 / Max: 324.93Min: 120.42 / Avg: 314.45 / Max: 351.47Min: 32.99 / Avg: 316.15 / Max: 367.34Min: 54.8 / Avg: 320.85 / Max: 377.94Min: 110.94 / Avg: 442.49 / Max: 492.85Min: 207.58 / Avg: 466.79 / Max: 528.2

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OnAVX-512 Off1428425670Min: 36.38 / Avg: 42.68 / Max: 48Min: 34.13 / Avg: 42.84 / Max: 47.75Min: 38 / Avg: 45.45 / Max: 49Min: 36 / Avg: 45.53 / Max: 49Min: 54 / Avg: 65.21 / Max: 69Min: 51 / Avg: 66.11 / Max: 71

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OnAVX-512 Off2004006008001000SE +/- 2.56, N = 3SE +/- 0.26, N = 3SE +/- 0.33, N = 3SE +/- 0.43, N = 3SE +/- 0.38, N = 3SE +/- 0.62, N = 3809.08660.54592.45405.72318.79247.27

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OnAVX-512 Off4080120160200SE +/- 0.05, N = 3SE +/- 0.14, N = 3SE +/- 0.36, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 3SE +/- 0.40, N = 3101.04147.46118.35144.89125.16161.33

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2883.8 / Max: 3400Min: 2300 / Avg: 2672.86 / Max: 3410Min: 1900 / Avg: 2540.23 / Max: 3513Min: 1900 / Avg: 2474.62 / Max: 3509

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 121.41 / Avg: 485.92 / Max: 594.32Min: 117.09 / Avg: 488.17 / Max: 595.98Min: 33.52 / Avg: 555.47 / Max: 671.66Min: 59.96 / Avg: 563.77 / Max: 673.82Min: 212.95 / Avg: 636.84 / Max: 773.77Min: 108.87 / Avg: 636.97 / Max: 776.52

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OnAVX-512 Off1530456075Min: 33.63 / Avg: 46.32 / Max: 50.63Min: 33.63 / Avg: 46.39 / Max: 50.63Min: 35 / Avg: 49.22 / Max: 53Min: 36 / Avg: 49.76 / Max: 54Min: 51 / Avg: 70.06 / Max: 77Min: 51 / Avg: 70.25 / Max: 76

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamAVX-512 OnAVX-512 Off816243240SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 334.5030.4626.8421.1820.2316.80

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamAVX-512 OnAVX-512 Off1326395265SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 328.9832.8337.2547.2149.4259.52

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 1900 / Avg: 3338.32 / Max: 3520Min: 1900 / Avg: 3216.06 / Max: 3518Min: 2300 / Avg: 2834.61 / Max: 3407Min: 2300 / Avg: 2707.62 / Max: 3403

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OnAVX-512 Off100200300400500Min: 116.85 / Avg: 307.49 / Max: 373.85Min: 116.53 / Avg: 308.23 / Max: 388.94Min: 56.93 / Avg: 328.16 / Max: 419.54Min: 58.11 / Avg: 334.36 / Max: 425.46Min: 206.44 / Avg: 463.48 / Max: 559.71Min: 209.04 / Avg: 468.14 / Max: 560.62

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OnAVX-512 Off1428425670Min: 34.13 / Avg: 43.31 / Max: 48Min: 34.63 / Avg: 43.61 / Max: 48.38Min: 36 / Avg: 46.62 / Max: 53Min: 37 / Avg: 47.75 / Max: 53Min: 51 / Avg: 65.39 / Max: 73Min: 53 / Avg: 67.31 / Max: 75

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On306090120150SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 3SE +/- 0.23, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 3120.5284.4092.0366.7348.2443.16

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamAVX-512 OnAVX-512 Off2004006008001000SE +/- 0.72, N = 3SE +/- 2.38, N = 3SE +/- 0.15, N = 3SE +/- 1.43, N = 3SE +/- 0.79, N = 3SE +/- 2.25, N = 3647.75889.39787.721132.61821.96913.42

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3697 / Avg: 3708.93 / Max: 3709Min: 1900 / Avg: 2907.36 / Max: 3519Min: 1900 / Avg: 2733.68 / Max: 3518Min: 2300 / Avg: 2851.54 / Max: 3409Min: 2300 / Avg: 2747.12 / Max: 3411

Neural Magic DeepSparse

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 116.32 / Avg: 423.52 / Max: 596.26Min: 120.76 / Avg: 424.25 / Max: 596.15Min: 62.09 / Avg: 449.53 / Max: 626.83Min: 45.38 / Avg: 492.05 / Max: 716.77Min: 179.48 / Avg: 575.96 / Max: 772.34Min: 184.97 / Avg: 576.22 / Max: 776.65

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OnAVX-512 Off1428425670Min: 34.63 / Avg: 43.53 / Max: 49.5Min: 34.63 / Avg: 44.85 / Max: 55.13Min: 37 / Avg: 46.66 / Max: 54Min: 38 / Avg: 47.79 / Max: 53Min: 51 / Avg: 64.77 / Max: 74Min: 54 / Avg: 66.83 / Max: 75

LeelaChessZero

Backend: BLAS

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: BLASAVX-512 OnAVX-512 Off2K4K6K8K10KSE +/- 133.67, N = 3SE +/- 61.68, N = 3SE +/- 92.33, N = 9SE +/- 36.09, N = 3SE +/- 68.15, N = 3SE +/- 47.46, N = 510671754294259171552447801. (CXX) g++ options: -flto -O3 -march=native -mno-amx-tile -pthread

LeelaChessZero

Backend: BLAS

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.28Backend: BLASAVX-512 OffAVX-512 On61218243024.7024.1919.8114.1114.0112.09

LeelaChessZero

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.28CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709.02 / Max: 3731Min: 3709 / Avg: 3709 / Max: 3709Min: 1900 / Avg: 3432.97 / Max: 3523Min: 1900 / Avg: 3429.01 / Max: 3524Min: 2300 / Avg: 3292.51 / Max: 3407Min: 2300 / Avg: 3285.55 / Max: 3420

LeelaChessZero

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.28CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 57.22 / Avg: 379.11 / Max: 511.65Min: 55.77 / Avg: 381.66 / Max: 520.36Min: 81.58 / Avg: 394.24 / Max: 583.5Min: 117.5 / Avg: 395.29 / Max: 593.12Min: 207.43 / Avg: 534.64 / Max: 715.83Min: 208.76 / Avg: 538.72 / Max: 765.81

LeelaChessZero

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.28CPU Temperature MonitorAVX-512 OnAVX-512 Off1632486480Min: 33.25 / Avg: 40.84 / Max: 54.63Min: 33.63 / Avg: 46.72 / Max: 58.25Min: 35 / Avg: 44.16 / Max: 56Min: 36 / Avg: 48.76 / Max: 59Min: 45 / Avg: 60.47 / Max: 85Min: 54 / Avg: 71.37 / Max: 78

LeelaChessZero

Backend: Eigen

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: EigenAVX-512 OnAVX-512 Off2K4K6K8K10KSE +/- 151.11, N = 3SE +/- 63.14, N = 3SE +/- 35.63, N = 3SE +/- 66.84, N = 3SE +/- 64.32, N = 4SE +/- 58.86, N = 311134824390858161575047091. (CXX) g++ options: -flto -O3 -march=native -mno-amx-tile -pthread

LeelaChessZero

Backend: Eigen

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.28Backend: EigenAVX-512 OnAVX-512 Off61218243024.7421.8920.6115.3814.5312.06

LeelaChessZero

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.28CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3711Min: 3709 / Avg: 3709 / Max: 3709Min: 1900 / Avg: 3431.65 / Max: 3563Min: 1900 / Avg: 3415.13 / Max: 3542Min: 2300 / Avg: 3283.63 / Max: 3411Min: 2300 / Avg: 3281.52 / Max: 3416

LeelaChessZero

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.28CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 59.5 / Avg: 367.29 / Max: 503.22Min: 58.03 / Avg: 372.74 / Max: 519.8Min: 124.39 / Avg: 390.39 / Max: 591.33Min: 123.27 / Avg: 395.84 / Max: 585.79Min: 207.21 / Avg: 535.98 / Max: 730.58Min: 211.45 / Avg: 540.33 / Max: 766.98

LeelaChessZero

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.28CPU Temperature MonitorAVX-512 OnAVX-512 Off1632486480Min: 33.25 / Avg: 40.64 / Max: 53.75Min: 34.63 / Avg: 46.31 / Max: 59.13Min: 34 / Avg: 43.65 / Max: 56Min: 35 / Avg: 47.75 / Max: 56Min: 44 / Avg: 65.29 / Max: 84Min: 45 / Avg: 66.24 / Max: 82

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OnAVX-512 Off50100150200250SE +/- 0.25, N = 9SE +/- 0.11, N = 8SE +/- 0.64, N = 6SE +/- 0.50, N = 6SE +/- 0.56, N = 6SE +/- 0.42, N = 6213.95177.68122.5390.40106.1896.34

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OnAVX-512 Off0.15530.31060.46590.62120.77650.6900.5180.2720.2400.2550.168

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 2918 / Avg: 3474.26 / Max: 3709Min: 2833 / Avg: 3434 / Max: 3709Min: 1900 / Avg: 3148.38 / Max: 3511Min: 1900 / Avg: 3074.54 / Max: 3507Min: 2300 / Avg: 2765.28 / Max: 3401Min: 2300 / Avg: 2565.14 / Max: 3400

Embree

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 37.38 / Avg: 310.11 / Max: 703.12Min: 26.98 / Avg: 343.25 / Max: 711.13Min: 122.75 / Avg: 389.97 / Max: 625.41Min: 101.95 / Avg: 400.96 / Max: 615.31Min: 207.22 / Avg: 480.24 / Max: 708.89Min: 205.64 / Avg: 537.44 / Max: 760.22

Embree

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1326395265Min: 32.38 / Avg: 37.98 / Max: 44.38Min: 35.88 / Avg: 41.18 / Max: 48Min: 34 / Avg: 41.38 / Max: 47Min: 39 / Avg: 46.46 / Max: 51Min: 44 / Avg: 57.26 / Max: 66Min: 50 / Avg: 59.72 / Max: 67

Embree

Binary: Pathtracer ISPC - Model: Crown

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownAVX-512 OnAVX-512 Off4080120160200SE +/- 0.47, N = 8SE +/- 0.42, N = 7SE +/- 0.53, N = 6SE +/- 5.25, N = 15SE +/- 0.17, N = 5SE +/- 0.27, N = 5181.89153.1892.6562.0474.8070.51

Embree

Binary: Pathtracer ISPC - Model: Crown

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownAVX-512 OnAVX-512 Off0.11450.2290.34350.4580.57250.5090.4180.1930.1100.1840.167

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2771 / Avg: 3462.8 / Max: 3709Min: 2763 / Avg: 3454.37 / Max: 3709Min: 1900 / Avg: 3070.52 / Max: 3512Min: 1900 / Avg: 3006.61 / Max: 3508Min: 2300 / Avg: 2850.31 / Max: 3400Min: 2300 / Avg: 2636.37 / Max: 3400

Embree

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 36.29 / Avg: 357.33 / Max: 701.32Min: 42.7 / Avg: 366.77 / Max: 692.37Min: 118.24 / Avg: 406.24 / Max: 561.45Min: 80.21 / Avg: 421.57 / Max: 583.55Min: 209.36 / Avg: 478.88 / Max: 665.78Min: 172.58 / Avg: 565.19 / Max: 755.21

Embree

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature MonitorAVX-512 OnAVX-512 Off1326395265Min: 33.25 / Avg: 39.98 / Max: 46.63Min: 35 / Avg: 42.18 / Max: 48.88Min: 34 / Avg: 42.39 / Max: 48Min: 37 / Avg: 46.83 / Max: 51Min: 46 / Avg: 57.94 / Max: 65Min: 48 / Avg: 61.37 / Max: 69

OpenVKL

Benchmark: vklBenchmark ISPC

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCAVX-512 OnAVX-512 Off30060090012001500SE +/- 16.33, N = 3SE +/- 13.87, N = 3SE +/- 2.52, N = 3SE +/- 4.16, N = 3SE +/- 1.76, N = 3SE +/- 1.86, N = 31341117611961034917792

OpenVKL

Benchmark: vklBenchmark ISPC

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCAVX-512 OnAVX-512 Off0.64671.29341.94012.58683.23352.8742.4052.0571.7262.0141.734

OpenVKL

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOpenVKL 1.3.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 2591 / Avg: 3486.01 / Max: 3709Min: 2621 / Avg: 3442.04 / Max: 3709Min: 2300 / Avg: 2988.69 / Max: 3410Min: 2262 / Avg: 2929.05 / Max: 3409Min: 1899 / Avg: 2931.06 / Max: 3519Min: 1169 / Avg: 2887.71 / Max: 3515

OpenVKL

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 1.3.1CPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 100.02 / Avg: 455.32 / Max: 653.28Min: 101.07 / Avg: 456.78 / Max: 652.79Min: 57.24 / Avg: 466.56 / Max: 706.65Min: 60.18 / Avg: 488.95 / Max: 748.42Min: 179.36 / Avg: 581.38 / Max: 785.63Min: 183.35 / Avg: 599.21 / Max: 804.94

OpenVKL

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVKL 1.3.1CPU Temperature MonitorAVX-512 OnAVX-512 Off1530456075Min: 34.13 / Avg: 45.24 / Max: 52.88Min: 35.5 / Avg: 47.03 / Max: 54.63Min: 35 / Avg: 48.73 / Max: 56Min: 36 / Avg: 49.72 / Max: 57Min: 46 / Avg: 69.3 / Max: 78Min: 50 / Avg: 69.77 / Max: 80

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.hdr_alb_nrm.3840x2160AVX-512 OnAVX-512 Off0.94281.88562.82843.77124.714SE +/- 0.02, N = 6SE +/- 0.02, N = 5SE +/- 0.01, N = 5SE +/- 0.02, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 44.192.953.483.462.942.07

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.hdr_alb_nrm.3840x2160AVX-512 OnAVX-512 Off0.00270.00540.00810.01080.01350.0120.0120.0100.0070.0090.006

Intel Open Image Denoise

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterIntel Open Image Denoise 1.4.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 1900 / Avg: 2985.41 / Max: 3510Min: 1900 / Avg: 2976.52 / Max: 3510Min: 2300 / Avg: 2644.39 / Max: 3400Min: 2300 / Avg: 2484.49 / Max: 3123

Intel Open Image Denoise

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 59.83 / Avg: 288.89 / Max: 584.26Min: 55.38 / Avg: 291.64 / Max: 587.02Min: 78.9 / Avg: 329.46 / Max: 563.85Min: 117.02 / Avg: 351.27 / Max: 568.33Min: 121.92 / Avg: 432.92 / Max: 757.14Min: 190.83 / Avg: 446.72 / Max: 747.36

Intel Open Image Denoise

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Temperature MonitorAVX-512 OnAVX-512 Off1428425670Min: 35 / Avg: 39.27 / Max: 45.5Min: 35.88 / Avg: 40.59 / Max: 46.63Min: 37 / Avg: 42.14 / Max: 50Min: 37 / Avg: 43.04 / Max: 50Min: 48 / Avg: 59.52 / Max: 72Min: 50 / Avg: 61.2 / Max: 75

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RTLightmap.hdr.4096x4096AVX-512 OnAVX-512 Off0.44780.89561.34341.79122.239SE +/- 0.01, N = 4SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.991.481.721.661.421.03

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 1.4.0Run: RTLightmap.hdr.4096x4096AVX-512 OnAVX-512 Off0.00110.00220.00330.00440.00550.0050.0050.0040.0030.0040.003

Intel Open Image Denoise

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterIntel Open Image Denoise 1.4.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 1900 / Avg: 2888.03 / Max: 3505Min: 1900 / Avg: 2755.84 / Max: 3503Min: 2300 / Avg: 2632.24 / Max: 3400Min: 2300 / Avg: 2543.96 / Max: 3400

Intel Open Image Denoise

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 30.85 / Avg: 328.65 / Max: 583.24Min: 57.92 / Avg: 331.79 / Max: 581.42Min: 119.6 / Avg: 359.55 / Max: 567.51Min: 81.25 / Avg: 374.67 / Max: 565.97Min: 207.41 / Avg: 477.81 / Max: 753.94Min: 204.01 / Avg: 487.71 / Max: 755.13

Intel Open Image Denoise

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Temperature MonitorAVX-512 OnAVX-512 Off1428425670Min: 33.25 / Avg: 39.68 / Max: 46.38Min: 34.63 / Avg: 40.87 / Max: 46.63Min: 35 / Avg: 42.32 / Max: 49Min: 35 / Avg: 43.41 / Max: 50Min: 45 / Avg: 57.82 / Max: 69Min: 47 / Avg: 59.15 / Max: 71

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OnAVX-512 Off1020304050SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 343.7126.4036.3623.1721.2214.35

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OnAVX-512 Off0.01690.03380.05070.06760.08450.0750.0430.0540.0340.0400.027

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 2802 / Avg: 3315.52 / Max: 3709Min: 2771 / Avg: 3210.13 / Max: 3709Min: 1900 / Avg: 2900.68 / Max: 3504Min: 1900 / Avg: 2652.54 / Max: 3514Min: 2300 / Avg: 2866.53 / Max: 3402Min: 2300 / Avg: 2855.45 / Max: 3400

OSPRay

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 119.36 / Avg: 524.83 / Max: 617.87Min: 119.41 / Avg: 530.36 / Max: 641.9Min: 56.1 / Avg: 580.71 / Max: 668.08Min: 56.53 / Avg: 614.11 / Max: 718.03Min: 209.17 / Avg: 676.18 / Max: 801.55Min: 107.51 / Avg: 689.16 / Max: 818.74

OSPRay

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature MonitorAVX-512 OnAVX-512 Off1530456075Min: 32.75 / Avg: 49.32 / Max: 52Min: 34.63 / Avg: 51.95 / Max: 55.25Min: 34 / Avg: 52.96 / Max: 57Min: 35 / Avg: 54.32 / Max: 58Min: 46 / Avg: 72.76 / Max: 79Min: 46 / Avg: 73.63 / Max: 80

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OnAVX-512 Off1020304050SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 343.2425.3135.9522.8321.0613.78

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OnAVX-512 Off0.01670.03340.05010.06680.08350.0740.0410.0530.0330.0400.026

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2771 / Avg: 3286.61 / Max: 3709Min: 2796 / Avg: 3267.78 / Max: 3709Min: 2200 / Avg: 2873.43 / Max: 3400Min: 2300 / Avg: 2842.78 / Max: 3400Min: 1900 / Avg: 2870.01 / Max: 3506Min: 1900 / Avg: 2689.91 / Max: 3502

OSPRay

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 133.04 / Avg: 523.63 / Max: 645.71Min: 124.97 / Avg: 528.92 / Max: 632.61Min: 60.18 / Avg: 581.84 / Max: 672.96Min: 57.79 / Avg: 616.9 / Max: 718.46Min: 211.39 / Avg: 674.63 / Max: 797.32Min: 206.88 / Avg: 688.18 / Max: 807.45

OSPRay

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature MonitorAVX-512 OnAVX-512 Off1530456075Min: 35.88 / Avg: 49.7 / Max: 52.88Min: 37.75 / Avg: 52.77 / Max: 55.5Min: 40 / Avg: 53.77 / Max: 57Min: 39 / Avg: 55.05 / Max: 58Min: 52 / Avg: 71.64 / Max: 75Min: 56 / Avg: 72.16 / Max: 76

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OnAVX-512 Off1224364860SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 354.1640.6742.9732.4825.5219.96

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OnAVX-512 Off0.02070.04140.06210.08280.10350.0920.0650.0640.0480.0490.038

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off7001400210028003500Min: 2764 / Avg: 3287.4 / Max: 3772Min: 2690 / Avg: 3283.87 / Max: 3709Min: 2293 / Avg: 2874.31 / Max: 3400Min: 2300 / Avg: 2590.11 / Max: 3402Min: 1900 / Avg: 2827.79 / Max: 3508Min: 1900 / Avg: 2769.32 / Max: 3512

OSPRay

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 80.49 / Avg: 523.67 / Max: 629.96Min: 122.95 / Avg: 530.21 / Max: 639.78Min: 60.05 / Avg: 591.62 / Max: 680.48Min: 61.53 / Avg: 624.39 / Max: 724.31Min: 210.52 / Avg: 667.18 / Max: 772.19Min: 205.85 / Avg: 679.41 / Max: 796.02

OSPRay

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature MonitorAVX-512 OnAVX-512 Off1530456075Min: 36.38 / Avg: 50.52 / Max: 53.25Min: 37.25 / Avg: 53.21 / Max: 56.88Min: 39 / Avg: 54.1 / Max: 58Min: 40 / Avg: 55.09 / Max: 58Min: 53 / Avg: 71.52 / Max: 75Min: 55 / Avg: 73.2 / Max: 77

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OnAVX-512 Off30060090012001500SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 1.00, N = 3581705859980130814911. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2720 / Avg: 3276 / Max: 3709Min: 2646 / Avg: 3229.97 / Max: 3709Min: 1783 / Avg: 2893.57 / Max: 3403Min: 2300 / Avg: 2622.27 / Max: 3401Min: 1900 / Avg: 2891.42 / Max: 3545Min: 1900 / Avg: 2818.86 / Max: 3514

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OnAVX-512 Off150300450600750Min: 102.33 / Avg: 497.27 / Max: 661.94Min: 129.57 / Avg: 500.65 / Max: 657.6Min: 60.79 / Avg: 611.59 / Max: 770.42Min: 60.36 / Avg: 615.21 / Max: 792.28Min: 178.24 / Avg: 661.77 / Max: 876.06Min: 212.33 / Avg: 663.86 / Max: 880.6

OSPRay Studio

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OnAVX-512 Off1530456075Min: 36.38 / Avg: 50.48 / Max: 53.75Min: 37.25 / Avg: 51.89 / Max: 55.5Min: 35 / Avg: 51.67 / Max: 57Min: 35 / Avg: 51.94 / Max: 57Min: 53 / Avg: 69.12 / Max: 75Min: 54 / Avg: 69.43 / Max: 76

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OnAVX-512 Off5K10K15K20K25KSE +/- 7.00, N = 3SE +/- 8.39, N = 3SE +/- 19.41, N = 3SE +/- 37.53, N = 3SE +/- 8.41, N = 3SE +/- 42.81, N = 3926011216135891560120872239431. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 2682 / Avg: 3157.82 / Max: 3709Min: 2773 / Avg: 3122.61 / Max: 3709Min: 1631 / Avg: 2895.11 / Max: 3404Min: 2300 / Avg: 2639.14 / Max: 3403Min: 1900 / Avg: 2891.51 / Max: 3509Min: 1900 / Avg: 2766.18 / Max: 3509

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OnAVX-512 Off150300450600750Min: 122.89 / Avg: 488.82 / Max: 662.51Min: 129.76 / Avg: 497.33 / Max: 659.2Min: 56.6 / Avg: 627.16 / Max: 783.63Min: 61.33 / Avg: 648.16 / Max: 799.28Min: 206.26 / Avg: 650.1 / Max: 877.56Min: 214.67 / Avg: 684.96 / Max: 875.35

OSPRay Studio

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OnAVX-512 Off1428425670Min: 36.75 / Avg: 51.41 / Max: 55.25Min: 37.25 / Avg: 53.26 / Max: 58.25Min: 38 / Avg: 51.75 / Max: 57Min: 38 / Avg: 53.78 / Max: 58Min: 50 / Avg: 67.06 / Max: 74Min: 53 / Avg: 68.82 / Max: 75

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OnAVX-512 Off10K20K30K40K50KSE +/- 30.61, N = 3SE +/- 50.78, N = 3SE +/- 11.72, N = 3SE +/- 69.83, N = 3SE +/- 44.00, N = 3SE +/- 10.69, N = 31850022475272043137341834481651. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2789 / Avg: 3177.76 / Max: 3709Min: 2771 / Avg: 3169.22 / Max: 3709Min: 1740 / Avg: 2881.42 / Max: 3403Min: 2300 / Avg: 2594.91 / Max: 3401Min: 1900 / Avg: 2877.33 / Max: 3513Min: 1900 / Avg: 2787.1 / Max: 3505

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OnAVX-512 Off160320480640800Min: 101.37 / Avg: 511.05 / Max: 668.12Min: 130.23 / Avg: 517.4 / Max: 652.59Min: 58.52 / Avg: 614.53 / Max: 802.45Min: 32.83 / Avg: 631.84 / Max: 775.3Min: 209.5 / Avg: 662.67 / Max: 884.59Min: 114.26 / Avg: 669.91 / Max: 876.36

OSPRay Studio

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 37.75 / Avg: 52.06 / Max: 55.5Min: 36.75 / Avg: 52.26 / Max: 54.63Min: 39 / Avg: 52.35 / Max: 57Min: 39 / Avg: 52.99 / Max: 57Min: 50 / Avg: 69.76 / Max: 75Min: 53 / Avg: 70.9 / Max: 77

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OnAVX-512 Off400800120016002000SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 1.20, N = 3SE +/- 0.00, N = 3SE +/- 1.00, N = 369583610291170156317701. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 2671 / Avg: 3308.27 / Max: 3711Min: 2721 / Avg: 3208.32 / Max: 3709Min: 1947 / Avg: 2897.09 / Max: 3403Min: 2300 / Avg: 2609.05 / Max: 3401Min: 1900 / Avg: 2874.56 / Max: 3509Min: 1900 / Avg: 2823.98 / Max: 3514

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OnAVX-512 Off150300450600750Min: 111.41 / Avg: 500.78 / Max: 666.67Min: 81.76 / Avg: 503.22 / Max: 657.11Min: 58.16 / Avg: 599.55 / Max: 773.94Min: 60.27 / Avg: 620.19 / Max: 789.77Min: 214.02 / Avg: 660.08 / Max: 874.86Min: 212.51 / Avg: 666.51 / Max: 879.7

OSPRay Studio

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OnAVX-512 Off1530456075Min: 37.25 / Avg: 50.44 / Max: 53.75Min: 37.75 / Avg: 52.04 / Max: 55.5Min: 39 / Avg: 52.34 / Max: 57Min: 38 / Avg: 52.47 / Max: 57Min: 50 / Avg: 68.75 / Max: 75Min: 51 / Avg: 69.42 / Max: 76

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OnAVX-512 Off6K12K18K24K30KSE +/- 3.79, N = 3SE +/- 32.66, N = 3SE +/- 25.54, N = 3SE +/- 45.36, N = 3SE +/- 18.50, N = 3SE +/- 46.52, N = 31105813341163321860824927284901. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2726 / Avg: 3186.89 / Max: 3709Min: 2777 / Avg: 3169.51 / Max: 3709Min: 1835 / Avg: 2867.88 / Max: 3402Min: 2300 / Avg: 2615.33 / Max: 3403Min: 1900 / Avg: 2841.62 / Max: 3508Min: 1900 / Avg: 2836.9 / Max: 3512

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OnAVX-512 Off160320480640800Min: 100.35 / Avg: 499.04 / Max: 664.34Min: 117.01 / Avg: 524.66 / Max: 656.47Min: 37.81 / Avg: 629.17 / Max: 778.51Min: 60.29 / Avg: 636.59 / Max: 798.92Min: 107.88 / Avg: 652.2 / Max: 894.12Min: 179.46 / Avg: 687.97 / Max: 887.42

OSPRay Studio

CPU Temperature Monitor

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OnAVX-512 Off1530456075Min: 39 / Avg: 51.56 / Max: 57Min: 38 / Avg: 53.76 / Max: 58Min: 37.25 / Avg: 52.28 / Max: 56.38Min: 37.25 / Avg: 52.98 / Max: 56.38Min: 52 / Avg: 68.49 / Max: 74Min: 51 / Avg: 71.52 / Max: 77

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OnAVX-512 Off13K26K39K52K65KSE +/- 44.52, N = 3SE +/- 18.25, N = 3SE +/- 45.83, N = 3SE +/- 115.86, N = 3SE +/- 4.98, N = 3SE +/- 56.19, N = 32212026541327493730049847627801. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2721 / Avg: 3353.6 / Max: 3709Min: 2702 / Avg: 3343.21 / Max: 3709Min: 1597 / Avg: 2940.27 / Max: 3407Min: 2300 / Avg: 2577.91 / Max: 3401Min: 1900 / Avg: 2875.06 / Max: 3514Min: 1900 / Avg: 2803.99 / Max: 3513

OSPRay Studio

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 123.88 / Avg: 460.86 / Max: 660.32Min: 102.13 / Avg: 519.61 / Max: 662.67Min: 61.78 / Avg: 592.07 / Max: 769.69Min: 31.18 / Avg: 618.56 / Max: 788.32Min: 211.24 / Avg: 659.15 / Max: 861.5Min: 180.6 / Avg: 673.37 / Max: 881.95

OSPRay Studio

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OnAVX-512 Off1428425670Min: 36.75 / Avg: 51.43 / Max: 54.63Min: 38.13 / Avg: 52.62 / Max: 59.25Min: 39 / Avg: 52.54 / Max: 57Min: 39 / Avg: 53.34 / Max: 58Min: 53 / Avg: 66.34 / Max: 73Min: 49 / Avg: 70.06 / Max: 75

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

Xeon 8490HXeon 8380EPYC 9654OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUAVX-512 OnAVX-512 Off0.45280.90561.35841.81122.264SE +/- 0.001579, N = 9SE +/- 0.006513, N = 9SE +/- 0.001297, N = 9SE +/- 0.002804, N = 9SE +/- 0.003984, N = 9SE +/- 0.002552, N = 90.7368222.0124100.8751961.9928600.9862141.7366701. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3570 / Avg: 3666 / Max: 3709Min: 3403 / Avg: 3617.61 / Max: 3709Min: 1900 / Avg: 3132.72 / Max: 3511Min: 1900 / Avg: 3013.2 / Max: 3507Min: 2300 / Avg: 2610.75 / Max: 3145Min: 2300 / Avg: 2463.92 / Max: 3025

oneDNN

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 56.11 / Avg: 241.2 / Max: 540.52Min: 30.68 / Avg: 261.28 / Max: 580.04Min: 117.63 / Avg: 306.45 / Max: 584.73Min: 120.33 / Avg: 330.6 / Max: 647.31Min: 210.1 / Avg: 417.66 / Max: 769.29Min: 204.47 / Avg: 439.83 / Max: 838.42

oneDNN

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.0CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 33.63 / Avg: 36.99 / Max: 40.88Min: 34.13 / Avg: 37.73 / Max: 41.75Min: 33 / Avg: 39.82 / Max: 48Min: 36 / Avg: 40.95 / Max: 47Min: 50 / Avg: 57.62 / Max: 69Min: 51 / Avg: 59.32 / Max: 70

Mobile Neural Network

Model: mobilenetV3

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenetV3AVX-512 OnAVX-512 Off0.8751.752.6253.54.375SE +/- 0.025, N = 15SE +/- 0.022, N = 10SE +/- 0.005, N = 3SE +/- 0.012, N = 3SE +/- 0.053, N = 9SE +/- 0.049, N = 31.7091.7642.0552.2883.8663.8891. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: squeezenetv1.1AVX-512 OnAVX-512 Off246810SE +/- 0.064, N = 15SE +/- 0.039, N = 10SE +/- 0.072, N = 3SE +/- 0.008, N = 3SE +/- 0.219, N = 9SE +/- 0.137, N = 32.2972.6782.7373.5517.2047.5661. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: resnet-v2-50AVX-512 OnAVX-512 Off612182430SE +/- 0.074, N = 15SE +/- 0.099, N = 10SE +/- 0.065, N = 3SE +/- 0.060, N = 3SE +/- 0.193, N = 9SE +/- 0.300, N = 37.90918.1338.49617.71614.72724.0811. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0AVX-512 OnAVX-512 Off3691215SE +/- 0.080, N = 15SE +/- 0.056, N = 10SE +/- 0.082, N = 3SE +/- 0.105, N = 3SE +/- 0.234, N = 9SE +/- 0.132, N = 33.9994.1954.4155.2228.7629.2781. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Cpuminer-Opt

Algorithm: scrypt

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptAVX-512 OnAVX-512 Off10002000300040005000SE +/- 13.77, N = 3SE +/- 0.03, N = 3SE +/- 1.21, N = 3SE +/- 0.54, N = 3SE +/- 7.11, N = 3SE +/- 0.63, N = 34816.312947.943665.551623.882307.421122.741. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: scrypt

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptAVX-512 OnAVX-512 Off2468108.0545.4375.6362.6184.6272.249

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 2986 / Avg: 3249.64 / Max: 3709Min: 2936 / Avg: 3110.3 / Max: 3709Min: 1900 / Avg: 2927.59 / Max: 3501Min: 1900 / Avg: 2817.46 / Max: 3508Min: 2300 / Avg: 2914.43 / Max: 3000Min: 2300 / Avg: 2665.18 / Max: 2970

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 114.85 / Avg: 498.71 / Max: 604.01Min: 123.97 / Avg: 499.12 / Max: 602.56Min: 52.42 / Avg: 542.18 / Max: 637.99Min: 59.62 / Avg: 597.99 / Max: 707.37Min: 108.05 / Avg: 620.23 / Max: 772.37Min: 205.47 / Avg: 650.33 / Max: 782.01

Cpuminer-Opt

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 34.13 / Avg: 48.03 / Max: 52Min: 34.13 / Avg: 50.14 / Max: 55.63Min: 37 / Avg: 50.54 / Max: 55Min: 36 / Avg: 51.1 / Max: 56Min: 49 / Avg: 68.06 / Max: 73Min: 48 / Avg: 68.72 / Max: 75

Cpuminer-Opt

Algorithm: Triple SHA-256, Onecoin

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Triple SHA-256, OnecoinAVX-512 OffAVX-512 On700K1400K2100K2800K3500KSE +/- 18173.37, N = 3SE +/- 23073.29, N = 15SE +/- 18201.57, N = 3SE +/- 3398.36, N = 3SE +/- 8466.21, N = 3SE +/- 579.55, N = 3333885033262872074200109263713285476470331. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Triple SHA-256, Onecoin

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: Triple SHA-256, OnecoinAVX-512 OffAVX-512 On120024003600480060005632.974975.703203.651741.892672.901301.10

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3178 / Avg: 3465.81 / Max: 3714Min: 3008 / Avg: 3335.89 / Max: 3709Min: 1900 / Avg: 2957.05 / Max: 3510Min: 1900 / Avg: 2875.21 / Max: 3511Min: 2300 / Avg: 2888.78 / Max: 3283Min: 2300 / Avg: 2643.21 / Max: 3400

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 119.7 / Avg: 497.04 / Max: 601.36Min: 75.22 / Avg: 497.3 / Max: 601.9Min: 57.41 / Avg: 592.73 / Max: 701.33Min: 33.08 / Avg: 668.51 / Max: 793.29Min: 221.38 / Avg: 627.27 / Max: 771.94Min: 206.27 / Avg: 647.45 / Max: 782.3

Cpuminer-Opt

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 35.88 / Avg: 50.93 / Max: 54.25Min: 36.75 / Avg: 55.17 / Max: 58.75Min: 40 / Avg: 51.93 / Max: 56Min: 39 / Avg: 52.28 / Max: 56Min: 51 / Avg: 69.9 / Max: 74Min: 51 / Avg: 70.07 / Max: 75

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteAVX-512 OnAVX-512 Off500K1000K1500K2000K2500KSE +/- 10844.37, N = 3SE +/- 7009.29, N = 3SE +/- 3990.27, N = 3SE +/- 657.95, N = 3SE +/- 1289.92, N = 3SE +/- 4107.35, N = 32252500133436314726206873209240403551731. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteAVX-512 OnAVX-512 Off80016002400320040003555.702351.122276.981053.061859.26710.08

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3114 / Avg: 3410.31 / Max: 3709Min: 3033 / Avg: 3343.09 / Max: 3709Min: 1900 / Avg: 2927.09 / Max: 3501Min: 1900 / Avg: 2857.47 / Max: 3507Min: 2300 / Avg: 2868.13 / Max: 3101Min: 2300 / Avg: 2651.15 / Max: 3400

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 79.08 / Avg: 496.99 / Max: 602.19Min: 120.7 / Avg: 500.19 / Max: 602.54Min: 54.9 / Avg: 567.54 / Max: 675.79Min: 32.24 / Avg: 633.49 / Max: 739.43Min: 206.88 / Avg: 646.74 / Max: 779.66Min: 220 / Avg: 652.69 / Max: 740.32

Cpuminer-Opt

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 36.38 / Avg: 50.97 / Max: 54.25Min: 38.13 / Avg: 52.94 / Max: 56.13Min: 39 / Avg: 52.72 / Max: 57Min: 39 / Avg: 53.91 / Max: 58Min: 51 / Avg: 70.21 / Max: 75Min: 52 / Avg: 70.84 / Max: 75

Cpuminer-Opt

Algorithm: x25x

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xAVX-512 OnAVX-512 Off16003200480064008000SE +/- 54.56, N = 3SE +/- 0.55, N = 3SE +/- 26.18, N = 3SE +/- 21.26, N = 6SE +/- 4.49, N = 3SE +/- 4.47, N = 37691.785712.584071.592166.902650.361840.411. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: x25x

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xAVX-512 OnAVX-512 Off369121513.44710.3026.3223.3135.3383.713

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3295 / Avg: 3487.56 / Max: 3709Min: 3132 / Avg: 3368.18 / Max: 3709Min: 2300 / Avg: 2916.53 / Max: 3305Min: 2300 / Avg: 2832.8 / Max: 3402Min: 1900 / Avg: 2906.57 / Max: 3511Min: 1900 / Avg: 2729.58 / Max: 3501

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 118.75 / Avg: 495.69 / Max: 593.22Min: 128.03 / Avg: 496.51 / Max: 596.23Min: 60.23 / Avg: 554.51 / Max: 659.93Min: 55.42 / Avg: 572.01 / Max: 668.33Min: 210.54 / Avg: 644.01 / Max: 768.58Min: 137.07 / Avg: 654.01 / Max: 765.2

Cpuminer-Opt

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 36.75 / Avg: 50.8 / Max: 54.63Min: 37.25 / Avg: 52.15 / Max: 55.5Min: 38 / Avg: 52.08 / Max: 56Min: 40 / Avg: 53.43 / Max: 57Min: 51 / Avg: 69.47 / Max: 74Min: 53 / Avg: 69.68 / Max: 74

Cpuminer-Opt

Algorithm: Deepcoin

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: DeepcoinAVX-512 OffAVX-512 On40K80K120K160K200KSE +/- 204.21, N = 3SE +/- 536.94, N = 3SE +/- 155.06, N = 3SE +/- 928.66, N = 3SE +/- 52.92, N = 3SE +/- 32.15, N = 31652401602901055139110764690579301. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Deepcoin

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: DeepcoinAVX-512 OffAVX-512 On60120180240300284.10274.20161.98139.12130.17116.45

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3239 / Avg: 3515.22 / Max: 3709Min: 2899 / Avg: 3360.04 / Max: 3709Min: 1900 / Avg: 2936.48 / Max: 3508Min: 1900 / Avg: 2857.54 / Max: 3507Min: 2300 / Avg: 2798.55 / Max: 3145Min: 2300 / Avg: 2779.27 / Max: 3400

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 71.69 / Avg: 496.96 / Max: 602.54Min: 88.2 / Avg: 497.46 / Max: 601.66Min: 60.67 / Avg: 581.62 / Max: 686.17Min: 31.65 / Avg: 584.57 / Max: 690.12Min: 202.83 / Avg: 651.38 / Max: 782.3Min: 212.39 / Avg: 654.88 / Max: 782.5

Cpuminer-Opt

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 36.38 / Avg: 50.56 / Max: 53.75Min: 36.63 / Avg: 50.78 / Max: 54.25Min: 39 / Avg: 53.02 / Max: 57Min: 42 / Avg: 54.53 / Max: 58Min: 53 / Avg: 70.18 / Max: 74Min: 52 / Avg: 70.34 / Max: 75

Cpuminer-Opt

Algorithm: Skeincoin

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinAVX-512 OnAVX-512 Off400K800K1200K1600K2000KSE +/- 4597.66, N = 3SE +/- 7503.92, N = 3SE +/- 668.14, N = 3SE +/- 329.36, N = 3SE +/- 438.80, N = 3SE +/- 716.54, N = 31990790141306310724536777336132733993501. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Skeincoin

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinAVX-512 OnAVX-512 Off70014002100280035003141.212428.441658.461035.241225.35800.44

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3001 / Avg: 3367.28 / Max: 3709Min: 2896 / Avg: 3299.49 / Max: 3709Min: 1900 / Avg: 2872.56 / Max: 3501Min: 2700 / Avg: 2861.18 / Max: 3505Min: 2300 / Avg: 2776.23 / Max: 3195Min: 2300 / Avg: 2673.53 / Max: 3063

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 118.62 / Avg: 498.92 / Max: 601.83Min: 123.73 / Avg: 500.49 / Max: 601.47Min: 53.17 / Avg: 581.88 / Max: 686.77Min: 34.28 / Avg: 633.77 / Max: 745.91Min: 103.7 / Avg: 646.66 / Max: 782.6Min: 224.85 / Avg: 654.66 / Max: 780.76

Cpuminer-Opt

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 36.38 / Avg: 50.92 / Max: 54.25Min: 36.38 / Avg: 52.6 / Max: 56.13Min: 39 / Avg: 52.76 / Max: 56Min: 40 / Avg: 53.91 / Max: 58Min: 51 / Avg: 69.73 / Max: 74Min: 52 / Avg: 71.11 / Max: 77

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsAVX-512 OnAVX-512 Off200K400K600K800K1000KSE +/- 3825.46, N = 3SE +/- 1744.51, N = 3SE +/- 1047.73, N = 3SE +/- 820.11, N = 3SE +/- 390.61, N = 3SE +/- 498.81, N = 310689934927806726772639174191331570831. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsAVX-512 OnAVX-512 Off4008001200160020001639.75834.911033.12404.76841.20314.92

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3092 / Avg: 3394.73 / Max: 3709Min: 2733 / Avg: 3270.61 / Max: 3709Min: 1900 / Avg: 2817.16 / Max: 3501Min: 1900 / Avg: 2760.78 / Max: 3502Min: 2300 / Avg: 2737.13 / Max: 3400Min: 2300 / Avg: 2623.57 / Max: 3400

Cpuminer-Opt

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 123.8 / Avg: 498.26 / Max: 601.23Min: 119.65 / Avg: 498.8 / Max: 602.02Min: 58.49 / Avg: 590.22 / Max: 704.35Min: 31.53 / Avg: 651.92 / Max: 765.29Min: 205.28 / Avg: 651.11 / Max: 781.83Min: 132.94 / Avg: 652.03 / Max: 781.58

Cpuminer-Opt

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 36.75 / Avg: 51.26 / Max: 55.13Min: 37.25 / Avg: 53.37 / Max: 57.25Min: 39 / Avg: 52.42 / Max: 56Min: 40 / Avg: 54.02 / Max: 57Min: 52 / Avg: 69.81 / Max: 74Min: 52 / Avg: 70.74 / Max: 76

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off30K60K90K120K150KSE +/- 1008.13, N = 3SE +/- 673.74, N = 3SE +/- 153.42, N = 3SE +/- 74.60, N = 3SE +/- 42.04, N = 3SE +/- 38.18, N = 3118103.94114083.24103184.0173906.7667701.6050413.981. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off0.35550.7111.06651.4221.7775SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.961.141.041.571.161.581. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2585.83 / Max: 3400Min: 2300 / Avg: 2378.88 / Max: 3400Min: 1900 / Avg: 2584.6 / Max: 3508Min: 1900 / Avg: 2332.5 / Max: 3508

OpenVINO

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 120.36 / Avg: 516.2 / Max: 593.64Min: 119.8 / Avg: 517.02 / Max: 593.95Min: 30.32 / Avg: 579.7 / Max: 638.45Min: 61.47 / Avg: 583.01 / Max: 643.67Min: 211.51 / Avg: 670.46 / Max: 768.59Min: 225.78 / Avg: 674.16 / Max: 768.69

OpenVINO

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 36.75 / Avg: 50.69 / Max: 53.75Min: 36.38 / Avg: 50.87 / Max: 54.63Min: 39 / Avg: 52.99 / Max: 56Min: 40 / Avg: 53.81 / Max: 57Min: 54 / Avg: 73.27 / Max: 77Min: 54 / Avg: 73.47 / Max: 77

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off2K4K6K8K10KSE +/- 1.97, N = 3SE +/- 0.29, N = 3SE +/- 1.24, N = 3SE +/- 1.04, N = 3SE +/- 2.81, N = 3SE +/- 2.52, N = 311029.456218.256206.723878.794442.951750.301. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off714212835SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 34.347.714.4911.4119.3130.911. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2952.33 / Max: 3400Min: 2300 / Avg: 2464.76 / Max: 3400Min: 1900 / Avg: 2571.73 / Max: 3502Min: 2327 / Avg: 2504.87 / Max: 3513

OpenVINO

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 124.05 / Avg: 517.82 / Max: 584.06Min: 127.49 / Avg: 518.52 / Max: 595.86Min: 57.77 / Avg: 594.48 / Max: 654.28Min: 57.68 / Avg: 622.09 / Max: 684.99Min: 211.57 / Avg: 667.99 / Max: 782.09Min: 209.15 / Avg: 668.46 / Max: 770.95

OpenVINO

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature MonitorAVX-512 OnAVX-512 Off1530456075Min: 37.75 / Avg: 51.65 / Max: 54.25Min: 37.25 / Avg: 52.53 / Max: 56Min: 40 / Avg: 52.32 / Max: 55Min: 40 / Avg: 53.23 / Max: 57Min: 53 / Avg: 74.24 / Max: 79Min: 54 / Avg: 74.99 / Max: 79

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off16003200480064008000SE +/- 1.27, N = 3SE +/- 2.86, N = 3SE +/- 1.23, N = 3SE +/- 0.62, N = 3SE +/- 0.97, N = 3SE +/- 0.71, N = 37420.493791.803738.921732.741119.451014.271. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off510152025SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.4612.648.0117.2917.8319.681. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2788.99 / Max: 3402Min: 2300 / Avg: 2555.76 / Max: 3400Min: 1900 / Avg: 2479.96 / Max: 3506Min: 1900 / Avg: 2431.39 / Max: 3509

OpenVINO

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 121.86 / Avg: 518.5 / Max: 595.33Min: 124.75 / Avg: 518.86 / Max: 596.78Min: 54.82 / Avg: 604.27 / Max: 663.05Min: 38.84 / Avg: 638.51 / Max: 699.19Min: 209.62 / Avg: 674 / Max: 775.31Min: 208.74 / Avg: 674.93 / Max: 776.16

OpenVINO

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 37.25 / Avg: 50.88 / Max: 53.5Min: 37.13 / Avg: 52.63 / Max: 55.5Min: 40 / Avg: 52.8 / Max: 55Min: 40 / Avg: 53.53 / Max: 57Min: 54 / Avg: 72.62 / Max: 77Min: 54 / Avg: 72.7 / Max: 77

miniBUDE

Implementation: OpenMP - Input Deck: BM1

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OnAVX-512 Off16003200480064008000SE +/- 9.60, N = 10SE +/- 27.90, N = 8SE +/- 13.13, N = 7SE +/- 6.63, N = 6SE +/- 6.26, N = 5SE +/- 3.51, N = 57274.055192.433586.272480.612339.321796.161. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OnAVX-512 Off60120180240300SE +/- 0.38, N = 10SE +/- 1.12, N = 8SE +/- 0.53, N = 7SE +/- 0.27, N = 6SE +/- 0.25, N = 5SE +/- 0.14, N = 5290.96207.70143.4599.2393.5771.851. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OnAVX-512 Off0.23040.46080.69120.92161.1521.0240.6190.2920.1810.2180.161

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3296 / Avg: 3597.25 / Max: 3709Min: 3145 / Avg: 3570.92 / Max: 3709Min: 1900 / Avg: 3105.81 / Max: 3512Min: 1900 / Avg: 2980.48 / Max: 3511Min: 2300 / Avg: 2694.51 / Max: 3194Min: 2300 / Avg: 2689.33 / Max: 3014

miniBUDE

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OnAVX-512 Off140280420560700Min: 60.57 / Avg: 284.05 / Max: 711.18Min: 50.93 / Avg: 335.56 / Max: 660.26Min: 76.52 / Avg: 430.19 / Max: 621.53Min: 112.89 / Avg: 447.53 / Max: 605.44Min: 111.28 / Avg: 491.9 / Max: 790.45Min: 204.3 / Avg: 549.62 / Max: 791.37

miniBUDE

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OnAVX-512 Off1428425670Min: 35.88 / Avg: 41.15 / Max: 49Min: 35 / Avg: 42.25 / Max: 50.38Min: 40 / Avg: 46.05 / Max: 51Min: 39 / Avg: 48.48 / Max: 54Min: 50 / Avg: 65.07 / Max: 72Min: 52 / Avg: 65.79 / Max: 74

miniBUDE

Implementation: OpenMP - Input Deck: BM2

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OnAVX-512 Off2K4K6K8K10KSE +/- 47.16, N = 4SE +/- 46.49, N = 3SE +/- 9.11, N = 3SE +/- 24.70, N = 6SE +/- 13.49, N = 3SE +/- 12.20, N = 38562.696371.323643.842602.652588.761993.071. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OnAVX-512 Off70140210280350SE +/- 1.89, N = 4SE +/- 1.86, N = 3SE +/- 0.36, N = 3SE +/- 0.99, N = 6SE +/- 0.54, N = 3SE +/- 0.49, N = 3342.51254.85145.75104.11103.5579.721. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OnAVX-512 Off0.15280.30560.45840.61120.7640.6790.4810.2460.1700.2040.156

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 1900 / Avg: 3016.33 / Max: 3515Min: 1900 / Avg: 2986.92 / Max: 3558Min: 2300 / Avg: 2943.56 / Max: 3400Min: 2300 / Avg: 2927.95 / Max: 3402

miniBUDE

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OnAVX-512 Off150300450600750Min: 59.34 / Avg: 504.56 / Max: 653.44Min: 54.45 / Avg: 530.15 / Max: 665.49Min: 122.79 / Avg: 508.57 / Max: 665.4Min: 114.01 / Avg: 512.58 / Max: 652.62Min: 209.21 / Avg: 593.08 / Max: 864.78Min: 109.04 / Avg: 612 / Max: 868.4

miniBUDE

CPU Temperature Monitor

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OnAVX-512 Off1632486480Min: 34.13 / Avg: 47.83 / Max: 54.25Min: 34.13 / Avg: 48.71 / Max: 55.63Min: 37 / Avg: 48.68 / Max: 55Min: 37 / Avg: 52.39 / Max: 59Min: 46 / Avg: 72.36 / Max: 85Min: 47 / Avg: 72.68 / Max: 84

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeAVX-512 OnAVX-512 Off4080120160200145.90146.75159.67169.84160.66162.721. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -llagrangian -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeAVX-512 OffAVX-512 On80160240320400110.95112.38194.79195.48358.63361.371. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenFOAM

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709.02 / Max: 3714Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2959.08 / Max: 3400Min: 2300 / Avg: 2948.55 / Max: 3400Min: 1900 / Avg: 2735.03 / Max: 3517Min: 1900 / Avg: 2718.73 / Max: 3515

OpenFOAM

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOpenFOAM 10CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 122.02 / Avg: 539.74 / Max: 590.97Min: 102.2 / Avg: 540.67 / Max: 588.28Min: 61.7 / Avg: 659.15 / Max: 738.72Min: 57.64 / Avg: 661.82 / Max: 737.11Min: 210.74 / Avg: 695.05 / Max: 754.74Min: 211.03 / Avg: 696.05 / Max: 761.31

OpenFOAM

CPU Temperature Monitor

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 30 / Avg: 53.51 / Max: 59Min: 33 / Avg: 54.15 / Max: 59Min: 31.88 / Avg: 53.96 / Max: 60Min: 36.38 / Avg: 55.35 / Max: 60.88Min: 39 / Avg: 71.62 / Max: 78Min: 40 / Avg: 71.85 / Max: 80

OpenFOAM

Input: drivaerFastback, Large Mesh Size - Mesh Time

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Large Mesh Size - Mesh TimeAVX-512 OnAVX-512 Off2004006008001000847.911039.32867.38996.78887.211051.351. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -llagrangian -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Large Mesh Size - Execution Time

EPYC 9654Xeon 8490HXeon 8380OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Large Mesh Size - Execution TimeAVX-512 OffAVX-512 On150030004500600075002803.542849.614305.124319.127106.767117.011. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenFOAM

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2980.24 / Max: 3408Min: 2300 / Avg: 2974.56 / Max: 3400Min: 2491 / Avg: 2870.69 / Max: 3516Min: 2451 / Avg: 2868.19 / Max: 3513

OpenFOAM

CPU Power Consumption Monitor

Xeon 8380EPYC 9654Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOpenFOAM 10CPU Power Consumption MonitorAVX-512 OnAVX-512 Off130260390520650Min: 129.82 / Avg: 547.41 / Max: 588.74Min: 127.05 / Avg: 547.75 / Max: 588.4Min: 58.28 / Avg: 650.61 / Max: 748.65Min: 62.76 / Avg: 655.07 / Max: 742.42Min: 208.95 / Avg: 709.42 / Max: 767.54Min: 214.57 / Avg: 709.53 / Max: 762.94

OpenFOAM

CPU Temperature Monitor

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 39 / Avg: 54.29 / Max: 60Min: 40 / Avg: 54.65 / Max: 60Min: 36.75 / Avg: 54.3 / Max: 61.38Min: 37.75 / Avg: 55.54 / Max: 62.63Min: 50 / Avg: 69.77 / Max: 75Min: 51 / Avg: 70.16 / Max: 75

SMHasher

Hash: FarmHash32 x86_64 AVX

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX-512 OnAVX-512 Off9K18K27K36K45KSE +/- 68.33, N = 4SE +/- 181.17, N = 4SE +/- 0.56, N = 5SE +/- 41.48, N = 5SE +/- 1.95, N = 4SE +/- 181.36, N = 442508.3537809.7139795.3636458.3133979.9930330.531. (CXX) g++ options: -O3 -march=native -mno-amx-tile -flto=auto -fno-fat-lto-objects

SMHasher

Hash: FarmHash32 x86_64 AVX

Xeon 8490HEPYC 9654Xeon 8380OpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX-512 OffAVX-512 On714212835SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 5SE +/- 0.16, N = 5SE +/- 0.02, N = 4SE +/- 0.01, N = 423.2723.2726.4126.5531.0831.581. (CXX) g++ options: -O3 -march=native -mno-amx-tile -flto=auto -fno-fat-lto-objects

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Phoronix Test Suite System Monitoring

Xeon 8380Xeon 8490HEPYC 9654OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringAVX-512 OnAVX-512 Off7001400210028003500Min: 804 / Avg: 2939.27 / Max: 3420Min: 802 / Avg: 3114.77 / Max: 3421Min: 690 / Avg: 3000.31 / Max: 4081Min: 1899 / Avg: 3041.53 / Max: 4080Min: 2547 / Avg: 3615.9 / Max: 3772Min: 2336 / Avg: 3667.6 / Max: 4199

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

Xeon 8380Xeon 8490HOpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On160320480640800Min: 57.8 / Avg: 365.97 / Max: 660.32Min: 60.6 / Avg: 451.19 / Max: 668.12Min: 102.55 / Avg: 582.55 / Max: 894.12Min: 101.7 / Avg: 588.67 / Max: 887.42

Phoronix Test Suite v10.8.5