Sapphire Rapids AVX-512 Benchmarks

Ice Lake, Sapphire Rapids, Genoa AVX-512 benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2301176-NE-SAPPHIRER14&sro.

ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerVulkanCompilerFile-SystemScreen ResolutionXeon 8380Xeon 8490HEPYC 9654 AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads)Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS)Intel Ice Lake IEH512GB2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007ASPEEDVGA HDMI2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFPUbuntu 22.105.19.0-29-generic (x86_64)GNOME Shell 43.1X Server 1.21.1.41.3.224GCC 12.2.0ext41920x10802 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)Intel Device 1bce1008GB4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T2 x AMD EPYC 9654 96-Core @ 3.71GHz (192 Cores / 384 Threads)AMD Titanite_4G (RTI1002E BIOS)AMD Device 14a41520GBBroadcom NetXtreme BCM5720 PCIeOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseEnvironment Details- Xeon 8380: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" CFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile"- Xeon 8380: AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" - Xeon 8490H: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" CFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile"- Xeon 8490H: AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" - EPYC 9654: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" CFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile"- EPYC 9654: AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" Compiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Xeon 8380: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd000375- Xeon 8380: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd000375- Xeon 8490H: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0000c0- Xeon 8490H: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0000c0- EPYC 9654: AVX-512 Off: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa10110d- EPYC 9654: AVX-512 On: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa10110dPython Details- Python 3.10.7Security Details- Xeon 8380: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon 8380: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon 8490H: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon 8490H: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9654: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9654: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamlczero: BLASlczero: Eigenembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Crownopenvkl: vklBenchmark ISPCoidn: RT.hdr_alb_nrm.3840x2160oidn: RTLightmap.hdr.4096x4096ospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 16 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 16 - Path Tracerospray-studio: 3 - 4K - 32 - Path Traceronednn: Deconvolution Batch shapes_3d - f32 - CPUmnn: mobilenetV3mnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0cpuminer-opt: scryptcpuminer-opt: Triple SHA-256, Onecoincpuminer-opt: Quad SHA-256, Pyritecpuminer-opt: x25xcpuminer-opt: Deepcoincpuminer-opt: Skeincoincpuminer-opt: LBC, LBRY Creditsopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUminibude: OpenMP - BM1minibude: OpenMP - BM1minibude: OpenMP - BM2minibude: OpenMP - BM2openfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenfoam: drivaerFastback, Large Mesh Size - Mesh Timeopenfoam: drivaerFastback, Large Mesh Size - Execution Timesmhasher: FarmHash32 x86_64 AVXsmhasher: FarmHash32 x86_64 AVXXeon 8380Xeon 8490HEPYC 9654 AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On183.8325217.0993379.5792105.2624113.32618.8158541.861773.746316.827559.417543.1140916.936045.854721.7973158.5261251.567869.726414.3286247.2732161.334216.799659.515943.1601913.41964780470996.344170.50797922.071.0314.345513.779219.957814912394348165177028490627801.992861.7642.67818.1334.1951122.746470333551731840.415793039935015708350413.981.581750.3011.411014.2719.681796.15971.8461993.06779.723162.72306358.63124887.207627106.761130330.5331.584227.4544175.6914455.031287.8658228.12194.3750835.784647.821620.193349.514548.4134819.532579.140512.6264221.7294180.170483.419711.9769318.7928125.163920.231349.420848.2393821.958855245750106.179874.80339172.941.4221.224221.064025.517913082087241834156324927498470.8751961.7092.2977.9093.9992307.4213285479240402650.366469061327341913367701.601.164442.954.491119.4517.832339.32393.5732588.758103.550160.6645361.366881051.35257117.005933979.9931.084264.7704226.2678584.1487102.6136187.64775.3242832.854271.934621.286246.973566.7540887.589346.861421.3212232.2085257.562284.837811.7823405.7230147.457821.178947.209466.7281889.38997542824390.395962.037710342.951.4823.174822.832832.48379801560131373117018608373002.012412.2883.55117.7165.2221623.8810926376873202166.909110767773326391773906.761.573878.7930.911732.7417.292480.60799.2252602.652104.106169.84164194.789751039.31534319.124537809.7123.268424.2714141.1445875.641668.4347281.23613.55091492.884440.140727.067036.938292.0211648.199583.700811.9378355.6686168.2285100.53979.9734592.4522101.042526.843237.247392.0328647.75451067111134122.526092.651211964.191.9936.364335.954442.96628591358927204102916332327490.7368222.0552.7378.4964.4153665.55207420014726204071.591055131072453672677103184.011.046206.7219.313738.928.013586.273143.4513643.840145.754159.67329195.47713847.910294305.124242508.3523.273510.8775187.35151006.082495.1665206.31714.84441410.422267.901630.855332.4024120.5142787.327071.508813.9740491.3426194.7179109.25819.1835660.5371144.885830.456332.8263120.5189787.723594258161177.6774153.181511763.461.7226.395325.309640.6658705112162247583613341265411.736673.8897.56624.0819.2782947.94333885013343635712.581652401413063492780114083.241.146218.257.713791.8012.645192.425207.6976371.320254.853146.75453110.94948867.3792803.544436458.3126.413613.9355155.91181205.181379.4967191.33255.22401966.405248.700334.232229.202984.86761128.8450100.28559.9667704.5818135.9937126.01147.9604809.0751118.352534.500828.977184.39961132.613391719085213.9512181.888913413.481.6643.708143.235854.155358192601850069511058221200.9862143.8667.20414.7278.7624816.31332628722525007691.7816029019907901068993118103.940.9611029.454.347420.496.467274.050290.9628562.694342.508145.89944112.38169996.777412849.61139795.3626.551OpenBenchmarking.org

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On130260390520650SE +/- 0.22, N = 3SE +/- 0.55, N = 3SE +/- 0.52, N = 3SE +/- 0.49, N = 3SE +/- 0.93, N = 3SE +/- 0.95, N = 3510.88613.94183.83227.45264.77424.27

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On50100150200250SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.69, N = 3SE +/- 0.35, N = 3SE +/- 0.84, N = 3SE +/- 0.32, N = 3187.35155.91217.10175.69226.27141.14

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3700 / Avg: 3708.95 / Max: 3709Min: 2300 / Avg: 2976.98 / Max: 3411Min: 2300 / Avg: 2795.9 / Max: 3409Min: 1900 / Avg: 3038.98 / Max: 3517Min: 1900 / Avg: 2810.29 / Max: 3515

Neural Magic DeepSparse

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 58.55 / Avg: 490.27 / Max: 722.41Min: 58.49 / Avg: 475.62 / Max: 691.71Min: 79.98 / Avg: 423.53 / Max: 591.06Min: 116.32 / Avg: 423.16 / Max: 593.15Min: 202.66 / Avg: 577.34 / Max: 773.65Min: 213.45 / Avg: 574.76 / Max: 771.15

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 29.25 / Avg: 48.39 / Max: 60.5Min: 31.88 / Avg: 48.49 / Max: 59.25Min: 39 / Avg: 62.34 / Max: 77Min: 37 / Avg: 61.39 / Max: 74Min: 36 / Avg: 46.12 / Max: 53Min: 37 / Avg: 47.32 / Max: 53

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On30060090012001500SE +/- 0.56, N = 3SE +/- 3.78, N = 3SE +/- 0.62, N = 3SE +/- 0.94, N = 3SE +/- 0.51, N = 3SE +/- 2.15, N = 31006.081205.18379.58455.03584.15875.64

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On20406080100SE +/- 0.04, N = 3SE +/- 0.26, N = 3SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 0.18, N = 395.1779.50105.2687.87102.6168.43

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2912.11 / Max: 3406Min: 2300 / Avg: 2658.36 / Max: 3406Min: 1900 / Avg: 2946.44 / Max: 3517Min: 1900 / Avg: 2739.54 / Max: 3513

Neural Magic DeepSparse

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 60.72 / Avg: 532.23 / Max: 674.52Min: 31.6 / Avg: 498.87 / Max: 641.77Min: 122.8 / Avg: 469.84 / Max: 592.57Min: 101.9 / Avg: 468.91 / Max: 551.9Min: 203.11 / Avg: 619.84 / Max: 770.48Min: 211.14 / Avg: 618.61 / Max: 769.39

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 42.63 / Avg: 55.22 / Max: 61Min: 41.25 / Avg: 53.22 / Max: 60Min: 54 / Avg: 70.96 / Max: 78Min: 53 / Avg: 67.48 / Max: 74Min: 36 / Avg: 49.25 / Max: 54Min: 38 / Avg: 48.66 / Max: 53

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On60120180240300SE +/- 0.04, N = 3SE +/- 0.36, N = 3SE +/- 0.44, N = 3SE +/- 0.16, N = 3SE +/- 0.21, N = 3SE +/- 0.71, N = 3206.32191.33113.33228.12187.65281.24

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On246810SE +/- 0.0009, N = 3SE +/- 0.0099, N = 3SE +/- 0.0346, N = 3SE +/- 0.0029, N = 3SE +/- 0.0060, N = 3SE +/- 0.0091, N = 34.84445.22408.81584.37505.32423.5509

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3698 / Avg: 3708.91 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2943.87 / Max: 3400Min: 2300 / Avg: 2506.26 / Max: 3400Min: 1900 / Avg: 3287.49 / Max: 3517Min: 1900 / Avg: 3360.23 / Max: 3516

Neural Magic DeepSparse

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 56.69 / Avg: 346.41 / Max: 397.2Min: 58.85 / Avg: 324.27 / Max: 371.22Min: 123.39 / Avg: 336.16 / Max: 377.19Min: 118.87 / Avg: 330.83 / Max: 360.91Min: 106.99 / Avg: 477.41 / Max: 537.73Min: 209.97 / Avg: 483.39 / Max: 522.36

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 43.5 / Avg: 54.68 / Max: 57.75Min: 43.5 / Avg: 51.97 / Max: 57.25Min: 55 / Avg: 72.43 / Max: 78Min: 53 / Avg: 69.21 / Max: 74Min: 36 / Avg: 47.99 / Max: 52Min: 38 / Avg: 48.31 / Max: 52

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On400800120016002000SE +/- 0.94, N = 3SE +/- 1.71, N = 3SE +/- 1.47, N = 3SE +/- 0.98, N = 3SE +/- 0.84, N = 3SE +/- 1.88, N = 31410.421966.41541.86835.78832.851492.88

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On1632486480SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 367.9048.7073.7547.8271.9340.14

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2701.11 / Max: 3401Min: 2300 / Avg: 2582.73 / Max: 3401Min: 1900 / Avg: 2690.42 / Max: 3512Min: 1900 / Avg: 2613.81 / Max: 3508

Neural Magic DeepSparse

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 32.8 / Avg: 552.07 / Max: 653.8Min: 56.51 / Avg: 539.83 / Max: 646.46Min: 130.88 / Avg: 488.76 / Max: 594.17Min: 116.14 / Avg: 490.29 / Max: 592.28Min: 207.09 / Avg: 636.05 / Max: 765.98Min: 212.93 / Avg: 636.94 / Max: 774.46

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 43 / Avg: 56.4 / Max: 61.38Min: 42.13 / Avg: 55.39 / Max: 60.88Min: 57 / Avg: 73.09 / Max: 77Min: 54 / Avg: 71.83 / Max: 77Min: 37 / Avg: 49.9 / Max: 54Min: 37 / Avg: 50.14 / Max: 54

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On816243240SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 330.8634.2316.8320.1921.2927.07

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On1326395265SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.01, N = 332.4029.2059.4249.5146.9736.94

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2813.09 / Max: 3401Min: 2300 / Avg: 2702.75 / Max: 3401Min: 1900 / Avg: 3376.77 / Max: 3517Min: 1900 / Avg: 3277.52 / Max: 3516

Neural Magic DeepSparse

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 42.78 / Avg: 344.31 / Max: 430.71Min: 60.73 / Avg: 336.08 / Max: 425.61Min: 118.87 / Avg: 314.48 / Max: 389.2Min: 115.91 / Avg: 309.32 / Max: 374.48Min: 203.35 / Avg: 468.13 / Max: 563.99Min: 106.45 / Avg: 468.4 / Max: 556.72

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 44.38 / Avg: 53.07 / Max: 59.13Min: 43.5 / Avg: 52.39 / Max: 57.75Min: 53 / Avg: 66.51 / Max: 75Min: 54 / Avg: 67.84 / Max: 75Min: 36 / Avg: 46.86 / Max: 52Min: 37 / Avg: 47.84 / Max: 53

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On306090120150SE +/- 0.22, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 0.17, N = 3SE +/- 0.03, N = 3120.5184.8743.1148.4166.7592.02

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On2004006008001000SE +/- 0.46, N = 3SE +/- 2.80, N = 3SE +/- 1.29, N = 3SE +/- 3.51, N = 3SE +/- 1.38, N = 3SE +/- 0.76, N = 3787.331128.85916.94819.53887.59648.20

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2835.42 / Max: 3408Min: 2300 / Avg: 2731.23 / Max: 3408Min: 1900 / Avg: 2897.84 / Max: 3517Min: 1900 / Avg: 2758.89 / Max: 3517

Neural Magic DeepSparse

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 60.66 / Avg: 500.64 / Max: 721.31Min: 61.67 / Avg: 453.86 / Max: 632.57Min: 121.91 / Avg: 423.91 / Max: 595.14Min: 109.29 / Avg: 424.09 / Max: 596.7Min: 205.49 / Avg: 579.26 / Max: 771.92Min: 111.58 / Avg: 575.15 / Max: 772.59

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 43.88 / Avg: 54.3 / Max: 62.25Min: 43.5 / Avg: 52.19 / Max: 59.13Min: 51 / Avg: 64.63 / Max: 73Min: 54 / Avg: 67.15 / Max: 75Min: 37 / Avg: 46.87 / Max: 52Min: 38 / Avg: 47.81 / Max: 53

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On20406080100SE +/- 0.16, N = 3SE +/- 0.67, N = 3SE +/- 0.14, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 371.51100.2945.8579.1446.8683.70

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On510152025SE +/- 0.0319, N = 3SE +/- 0.0671, N = 3SE +/- 0.0648, N = 3SE +/- 0.0206, N = 3SE +/- 0.0534, N = 3SE +/- 0.0214, N = 313.97409.966721.797312.626421.321211.9378

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2936.97 / Max: 3405Min: 2300 / Avg: 2689.46 / Max: 3402Min: 1900 / Avg: 3338.2 / Max: 3518Min: 1900 / Avg: 3337.42 / Max: 3517

Neural Magic DeepSparse

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 30.08 / Avg: 340.51 / Max: 417.91Min: 61.86 / Avg: 340.27 / Max: 413.32Min: 122.5 / Avg: 322.04 / Max: 389.14Min: 83.01 / Avg: 313.16 / Max: 365.89Min: 110.3 / Avg: 466.39 / Max: 569.05Min: 214.75 / Avg: 471.13 / Max: 544.51

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 43 / Avg: 52.81 / Max: 58.25Min: 43 / Avg: 52.83 / Max: 57.75Min: 51 / Avg: 65.88 / Max: 73Min: 52 / Avg: 66.78 / Max: 74Min: 35 / Avg: 46.14 / Max: 52Min: 37 / Avg: 47.74 / Max: 53

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On150300450600750SE +/- 1.03, N = 3SE +/- 5.42, N = 13SE +/- 0.92, N = 3SE +/- 0.18, N = 3SE +/- 0.51, N = 3SE +/- 1.22, N = 3491.34704.58158.53221.73232.21355.67

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On60120180240300SE +/- 0.35, N = 3SE +/- 0.99, N = 13SE +/- 1.34, N = 3SE +/- 0.11, N = 3SE +/- 0.30, N = 3SE +/- 0.53, N = 3194.72135.99251.57180.17257.56168.23

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3703 / Avg: 3708.97 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2856.54 / Max: 3402Min: 2300 / Avg: 2704.63 / Max: 3402Min: 1900 / Avg: 2956.37 / Max: 3516Min: 1900 / Avg: 2821.77 / Max: 3515

Neural Magic DeepSparse

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 32.05 / Avg: 494 / Max: 713.94Min: 31.38 / Avg: 537.92 / Max: 712.89Min: 124.13 / Avg: 437.31 / Max: 595.17Min: 103.25 / Avg: 453.02 / Max: 598.46Min: 211.06 / Avg: 598.84 / Max: 769.45Min: 184.38 / Avg: 608.53 / Max: 775.32

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 37.25 / Avg: 44.79 / Max: 51.25Min: 44.38 / Avg: 52.93 / Max: 60Min: 53 / Avg: 65.7 / Max: 74Min: 54 / Avg: 68.2 / Max: 75Min: 37 / Avg: 47.69 / Max: 53Min: 38 / Avg: 48.39 / Max: 53

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On306090120150SE +/- 1.97, N = 15SE +/- 2.25, N = 15SE +/- 0.21, N = 3SE +/- 0.06, N = 3SE +/- 0.59, N = 3SE +/- 1.49, N = 15109.26126.0169.7383.4284.84100.54

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On48121620SE +/- 0.1629, N = 15SE +/- 0.1413, N = 15SE +/- 0.0435, N = 3SE +/- 0.0082, N = 3SE +/- 0.0817, N = 3SE +/- 0.1607, N = 159.18357.960414.328611.976911.78239.9734

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3697 / Avg: 3708.98 / Max: 3709Min: 3700 / Avg: 3708.99 / Max: 3709Min: 2300 / Avg: 3086.6 / Max: 3400Min: 2300 / Avg: 2877.68 / Max: 3400Min: 1900 / Avg: 3335.14 / Max: 3516Min: 1900 / Avg: 3282.46 / Max: 3518

Neural Magic DeepSparse

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On90180270360450Min: 54.8 / Avg: 320.85 / Max: 377.94Min: 32.99 / Avg: 316.15 / Max: 367.34Min: 120.42 / Avg: 314.45 / Max: 351.47Min: 114.08 / Avg: 296.11 / Max: 324.93Min: 207.58 / Avg: 466.79 / Max: 528.2Min: 110.94 / Avg: 442.49 / Max: 492.85

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 34.13 / Avg: 42.84 / Max: 47.75Min: 36.38 / Avg: 42.68 / Max: 48Min: 51 / Avg: 66.11 / Max: 71Min: 54 / Avg: 65.21 / Max: 69Min: 36 / Avg: 45.53 / Max: 49Min: 38 / Avg: 45.45 / Max: 49

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On2004006008001000SE +/- 0.26, N = 3SE +/- 2.56, N = 3SE +/- 0.62, N = 3SE +/- 0.38, N = 3SE +/- 0.43, N = 3SE +/- 0.33, N = 3660.54809.08247.27318.79405.72592.45

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On4080120160200SE +/- 0.05, N = 3SE +/- 0.36, N = 3SE +/- 0.40, N = 3SE +/- 0.17, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3144.89118.35161.33125.16147.46101.04

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2883.8 / Max: 3400Min: 2300 / Avg: 2672.86 / Max: 3410Min: 1900 / Avg: 2540.23 / Max: 3513Min: 1900 / Avg: 2474.62 / Max: 3509

Neural Magic DeepSparse

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 33.52 / Avg: 555.47 / Max: 671.66Min: 59.96 / Avg: 563.77 / Max: 673.82Min: 121.41 / Avg: 485.92 / Max: 594.32Min: 117.09 / Avg: 488.17 / Max: 595.98Min: 212.95 / Avg: 636.84 / Max: 773.77Min: 108.87 / Avg: 636.97 / Max: 776.52

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 33.63 / Avg: 46.39 / Max: 50.63Min: 33.63 / Avg: 46.32 / Max: 50.63Min: 51 / Avg: 70.06 / Max: 77Min: 51 / Avg: 70.25 / Max: 76Min: 35 / Avg: 49.22 / Max: 53Min: 36 / Avg: 49.76 / Max: 54

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On816243240SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.12, N = 330.4634.5016.8020.2321.1826.84

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On1326395265SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 332.8328.9859.5249.4247.2137.25

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2834.61 / Max: 3407Min: 2300 / Avg: 2707.62 / Max: 3403Min: 1900 / Avg: 3338.32 / Max: 3520Min: 1900 / Avg: 3216.06 / Max: 3518

Neural Magic DeepSparse

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 58.11 / Avg: 334.36 / Max: 425.46Min: 56.93 / Avg: 328.16 / Max: 419.54Min: 116.53 / Avg: 308.23 / Max: 388.94Min: 116.85 / Avg: 307.49 / Max: 373.85Min: 209.04 / Avg: 468.14 / Max: 560.62Min: 206.44 / Avg: 463.48 / Max: 559.71

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 34.63 / Avg: 43.61 / Max: 48.38Min: 34.13 / Avg: 43.31 / Max: 48Min: 51 / Avg: 65.39 / Max: 73Min: 53 / Avg: 67.31 / Max: 75Min: 36 / Avg: 46.62 / Max: 53Min: 37 / Avg: 47.75 / Max: 53

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On306090120150SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 3SE +/- 0.01, N = 3SE +/- 0.23, N = 3SE +/- 0.19, N = 3120.5284.4043.1648.2466.7392.03

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On2004006008001000SE +/- 0.15, N = 3SE +/- 1.43, N = 3SE +/- 2.25, N = 3SE +/- 0.79, N = 3SE +/- 2.38, N = 3SE +/- 0.72, N = 3787.721132.61913.42821.96889.39647.75

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3697 / Avg: 3708.93 / Max: 3709Min: 2300 / Avg: 2851.54 / Max: 3409Min: 2300 / Avg: 2747.12 / Max: 3411Min: 1900 / Avg: 2907.36 / Max: 3519Min: 1900 / Avg: 2733.68 / Max: 3518

Neural Magic DeepSparse

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 45.38 / Avg: 492.05 / Max: 716.77Min: 62.09 / Avg: 449.53 / Max: 626.83Min: 120.76 / Avg: 424.25 / Max: 596.15Min: 116.32 / Avg: 423.52 / Max: 596.26Min: 179.48 / Avg: 575.96 / Max: 772.34Min: 184.97 / Avg: 576.22 / Max: 776.65

Neural Magic DeepSparse

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 34.63 / Avg: 44.85 / Max: 55.13Min: 34.63 / Avg: 43.53 / Max: 49.5Min: 51 / Avg: 64.77 / Max: 74Min: 54 / Avg: 66.83 / Max: 75Min: 37 / Avg: 46.66 / Max: 54Min: 38 / Avg: 47.79 / Max: 53

LeelaChessZero

Backend: BLAS

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: BLASAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 92.33, N = 9SE +/- 36.09, N = 3SE +/- 47.46, N = 5SE +/- 68.15, N = 3SE +/- 61.68, N = 3SE +/- 133.67, N = 394259171478055247542106711. (CXX) g++ options: -flto -O3 -march=native -mno-amx-tile -pthread

LeelaChessZero

Backend: BLAS

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.28Backend: BLASAVX-512 OffAVX-512 On61218243024.7024.1912.0914.0114.1119.81

LeelaChessZero

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.28CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709.02 / Max: 3731Min: 2300 / Avg: 3292.51 / Max: 3407Min: 2300 / Avg: 3285.55 / Max: 3420Min: 1900 / Avg: 3429.01 / Max: 3524Min: 1900 / Avg: 3432.97 / Max: 3523

LeelaChessZero

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.28CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 55.77 / Avg: 381.66 / Max: 520.36Min: 57.22 / Avg: 379.11 / Max: 511.65Min: 117.5 / Avg: 395.29 / Max: 593.12Min: 81.58 / Avg: 394.24 / Max: 583.5Min: 207.43 / Avg: 534.64 / Max: 715.83Min: 208.76 / Avg: 538.72 / Max: 765.81

LeelaChessZero

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.28CPU Temperature MonitorAVX-512 OffAVX-512 On1632486480Min: 33.63 / Avg: 46.72 / Max: 58.25Min: 33.25 / Avg: 40.84 / Max: 54.63Min: 45 / Avg: 60.47 / Max: 85Min: 54 / Avg: 71.37 / Max: 78Min: 36 / Avg: 48.76 / Max: 59Min: 35 / Avg: 44.16 / Max: 56

LeelaChessZero

Backend: Eigen

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: EigenAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 66.84, N = 3SE +/- 35.63, N = 3SE +/- 58.86, N = 3SE +/- 64.32, N = 4SE +/- 63.14, N = 3SE +/- 151.11, N = 381619085470957508243111341. (CXX) g++ options: -flto -O3 -march=native -mno-amx-tile -pthread

LeelaChessZero

Backend: Eigen

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.28Backend: EigenAVX-512 OffAVX-512 On61218243021.8924.7412.0614.5315.3820.61

LeelaChessZero

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.28CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3711Min: 2300 / Avg: 3281.52 / Max: 3416Min: 2300 / Avg: 3283.63 / Max: 3411Min: 1900 / Avg: 3415.13 / Max: 3542Min: 1900 / Avg: 3431.65 / Max: 3563

LeelaChessZero

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.28CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 58.03 / Avg: 372.74 / Max: 519.8Min: 59.5 / Avg: 367.29 / Max: 503.22Min: 124.39 / Avg: 390.39 / Max: 591.33Min: 123.27 / Avg: 395.84 / Max: 585.79Min: 207.21 / Avg: 535.98 / Max: 730.58Min: 211.45 / Avg: 540.33 / Max: 766.98

LeelaChessZero

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.28CPU Temperature MonitorAVX-512 OffAVX-512 On1632486480Min: 34.63 / Avg: 46.31 / Max: 59.13Min: 33.25 / Avg: 40.64 / Max: 53.75Min: 44 / Avg: 65.29 / Max: 84Min: 45 / Avg: 66.24 / Max: 82Min: 35 / Avg: 47.75 / Max: 56Min: 34 / Avg: 43.65 / Max: 56

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On50100150200250SE +/- 0.11, N = 8SE +/- 0.25, N = 9SE +/- 0.42, N = 6SE +/- 0.56, N = 6SE +/- 0.50, N = 6SE +/- 0.64, N = 6177.68213.9596.34106.1890.40122.53

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On0.15530.31060.46590.62120.77650.5180.6900.2400.2720.1680.255

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2833 / Avg: 3434 / Max: 3709Min: 2918 / Avg: 3474.26 / Max: 3709Min: 2300 / Avg: 2765.28 / Max: 3401Min: 2300 / Avg: 2565.14 / Max: 3400Min: 1900 / Avg: 3074.54 / Max: 3507Min: 1900 / Avg: 3148.38 / Max: 3511

Embree

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 26.98 / Avg: 343.25 / Max: 711.13Min: 37.38 / Avg: 310.11 / Max: 703.12Min: 101.95 / Avg: 400.96 / Max: 615.31Min: 122.75 / Avg: 389.97 / Max: 625.41Min: 205.64 / Avg: 537.44 / Max: 760.22Min: 207.22 / Avg: 480.24 / Max: 708.89

Embree

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 35.88 / Avg: 41.18 / Max: 48Min: 32.38 / Avg: 37.98 / Max: 44.38Min: 44 / Avg: 57.26 / Max: 66Min: 50 / Avg: 59.72 / Max: 67Min: 39 / Avg: 46.46 / Max: 51Min: 34 / Avg: 41.38 / Max: 47

Embree

Binary: Pathtracer ISPC - Model: Crown

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On4080120160200SE +/- 0.42, N = 7SE +/- 0.47, N = 8SE +/- 0.27, N = 5SE +/- 0.17, N = 5SE +/- 5.25, N = 15SE +/- 0.53, N = 6153.18181.8970.5174.8062.0492.65

Embree

Binary: Pathtracer ISPC - Model: Crown

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On0.11450.2290.34350.4580.57250.4180.5090.1670.1840.1100.193

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2771 / Avg: 3462.8 / Max: 3709Min: 2763 / Avg: 3454.37 / Max: 3709Min: 2300 / Avg: 2850.31 / Max: 3400Min: 2300 / Avg: 2636.37 / Max: 3400Min: 1900 / Avg: 3070.52 / Max: 3512Min: 1900 / Avg: 3006.61 / Max: 3508

Embree

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 42.7 / Avg: 366.77 / Max: 692.37Min: 36.29 / Avg: 357.33 / Max: 701.32Min: 80.21 / Avg: 421.57 / Max: 583.55Min: 118.24 / Avg: 406.24 / Max: 561.45Min: 172.58 / Avg: 565.19 / Max: 755.21Min: 209.36 / Avg: 478.88 / Max: 665.78

Embree

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 35 / Avg: 42.18 / Max: 48.88Min: 33.25 / Avg: 39.98 / Max: 46.63Min: 48 / Avg: 61.37 / Max: 69Min: 46 / Avg: 57.94 / Max: 65Min: 37 / Avg: 46.83 / Max: 51Min: 34 / Avg: 42.39 / Max: 48

OpenVKL

Benchmark: vklBenchmark ISPC

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCAVX-512 OffAVX-512 On30060090012001500SE +/- 13.87, N = 3SE +/- 16.33, N = 3SE +/- 1.86, N = 3SE +/- 1.76, N = 3SE +/- 4.16, N = 3SE +/- 2.52, N = 31176134179291710341196

OpenVKL

Benchmark: vklBenchmark ISPC

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCAVX-512 OffAVX-512 On0.64671.29341.94012.58683.23352.4052.8741.7342.0141.7262.057

OpenVKL

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOpenVKL 1.3.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2621 / Avg: 3442.04 / Max: 3709Min: 2591 / Avg: 3486.01 / Max: 3709Min: 2300 / Avg: 2988.69 / Max: 3410Min: 2262 / Avg: 2929.05 / Max: 3409Min: 1899 / Avg: 2931.06 / Max: 3519Min: 1169 / Avg: 2887.71 / Max: 3515

OpenVKL

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 1.3.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 60.18 / Avg: 488.95 / Max: 748.42Min: 57.24 / Avg: 466.56 / Max: 706.65Min: 101.07 / Avg: 456.78 / Max: 652.79Min: 100.02 / Avg: 455.32 / Max: 653.28Min: 183.35 / Avg: 599.21 / Max: 804.94Min: 179.36 / Avg: 581.38 / Max: 785.63

OpenVKL

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVKL 1.3.1CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 35.5 / Avg: 47.03 / Max: 54.63Min: 34.13 / Avg: 45.24 / Max: 52.88Min: 50 / Avg: 69.77 / Max: 80Min: 46 / Avg: 69.3 / Max: 78Min: 36 / Avg: 49.72 / Max: 57Min: 35 / Avg: 48.73 / Max: 56

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.hdr_alb_nrm.3840x2160AVX-512 OffAVX-512 On0.94281.88562.82843.77124.714SE +/- 0.02, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 4SE +/- 0.01, N = 5SE +/- 0.02, N = 5SE +/- 0.02, N = 63.463.482.072.942.954.19

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.hdr_alb_nrm.3840x2160AVX-512 OffAVX-512 On0.00270.00540.00810.01080.01350.0120.0120.0060.0090.0070.010

Intel Open Image Denoise

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterIntel Open Image Denoise 1.4.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2644.39 / Max: 3400Min: 2300 / Avg: 2484.49 / Max: 3123Min: 1900 / Avg: 2976.52 / Max: 3510Min: 1900 / Avg: 2985.41 / Max: 3510

Intel Open Image Denoise

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 55.38 / Avg: 291.64 / Max: 587.02Min: 59.83 / Avg: 288.89 / Max: 584.26Min: 117.02 / Avg: 351.27 / Max: 568.33Min: 78.9 / Avg: 329.46 / Max: 563.85Min: 190.83 / Avg: 446.72 / Max: 747.36Min: 121.92 / Avg: 432.92 / Max: 757.14

Intel Open Image Denoise

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 35.88 / Avg: 40.59 / Max: 46.63Min: 35 / Avg: 39.27 / Max: 45.5Min: 50 / Avg: 61.2 / Max: 75Min: 48 / Avg: 59.52 / Max: 72Min: 37 / Avg: 43.04 / Max: 50Min: 37 / Avg: 42.14 / Max: 50

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RTLightmap.hdr.4096x4096AVX-512 OffAVX-512 On0.44780.89561.34341.79122.239SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 41.721.661.031.421.481.99

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 1.4.0Run: RTLightmap.hdr.4096x4096AVX-512 OffAVX-512 On0.00110.00220.00330.00440.00550.0050.0050.0030.0040.0030.004

Intel Open Image Denoise

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterIntel Open Image Denoise 1.4.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2632.24 / Max: 3400Min: 2300 / Avg: 2543.96 / Max: 3400Min: 1900 / Avg: 2888.03 / Max: 3505Min: 1900 / Avg: 2755.84 / Max: 3503

Intel Open Image Denoise

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 30.85 / Avg: 328.65 / Max: 583.24Min: 57.92 / Avg: 331.79 / Max: 581.42Min: 81.25 / Avg: 374.67 / Max: 565.97Min: 119.6 / Avg: 359.55 / Max: 567.51Min: 204.01 / Avg: 487.71 / Max: 755.13Min: 207.41 / Avg: 477.81 / Max: 753.94

Intel Open Image Denoise

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 34.63 / Avg: 40.87 / Max: 46.63Min: 33.25 / Avg: 39.68 / Max: 46.38Min: 47 / Avg: 59.15 / Max: 71Min: 45 / Avg: 57.82 / Max: 69Min: 35 / Avg: 43.41 / Max: 50Min: 35 / Avg: 42.32 / Max: 49

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On1020304050SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 326.4043.7114.3521.2223.1736.36

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On0.01690.03380.05070.06760.08450.0430.0750.0270.0400.0340.054

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2771 / Avg: 3210.13 / Max: 3709Min: 2802 / Avg: 3315.52 / Max: 3709Min: 2300 / Avg: 2855.45 / Max: 3400Min: 2300 / Avg: 2866.53 / Max: 3402Min: 1900 / Avg: 2900.68 / Max: 3504Min: 1900 / Avg: 2652.54 / Max: 3514

OSPRay

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 56.53 / Avg: 614.11 / Max: 718.03Min: 56.1 / Avg: 580.71 / Max: 668.08Min: 119.36 / Avg: 524.83 / Max: 617.87Min: 119.41 / Avg: 530.36 / Max: 641.9Min: 107.51 / Avg: 689.16 / Max: 818.74Min: 209.17 / Avg: 676.18 / Max: 801.55

OSPRay

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 34.63 / Avg: 51.95 / Max: 55.25Min: 32.75 / Avg: 49.32 / Max: 52Min: 46 / Avg: 72.76 / Max: 79Min: 46 / Avg: 73.63 / Max: 80Min: 35 / Avg: 54.32 / Max: 58Min: 34 / Avg: 52.96 / Max: 57

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On1020304050SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 325.3143.2413.7821.0622.8335.95

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On0.01670.03340.05010.06680.08350.0410.0740.0260.0400.0330.053

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2771 / Avg: 3286.61 / Max: 3709Min: 2796 / Avg: 3267.78 / Max: 3709Min: 2300 / Avg: 2842.78 / Max: 3400Min: 2200 / Avg: 2873.43 / Max: 3400Min: 1900 / Avg: 2870.01 / Max: 3506Min: 1900 / Avg: 2689.91 / Max: 3502

OSPRay

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 57.79 / Avg: 616.9 / Max: 718.46Min: 60.18 / Avg: 581.84 / Max: 672.96Min: 133.04 / Avg: 523.63 / Max: 645.71Min: 124.97 / Avg: 528.92 / Max: 632.61Min: 206.88 / Avg: 688.18 / Max: 807.45Min: 211.39 / Avg: 674.63 / Max: 797.32

OSPRay

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 37.75 / Avg: 52.77 / Max: 55.5Min: 35.88 / Avg: 49.7 / Max: 52.88Min: 56 / Avg: 72.16 / Max: 76Min: 52 / Avg: 71.64 / Max: 75Min: 39 / Avg: 55.05 / Max: 58Min: 40 / Avg: 53.77 / Max: 57

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On1224364860SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 340.6754.1619.9625.5232.4842.97

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On0.02070.04140.06210.08280.10350.0650.0920.0380.0490.0480.064

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2690 / Avg: 3283.87 / Max: 3709Min: 2764 / Avg: 3287.4 / Max: 3772Min: 2293 / Avg: 2874.31 / Max: 3400Min: 2300 / Avg: 2590.11 / Max: 3402Min: 1900 / Avg: 2827.79 / Max: 3508Min: 1900 / Avg: 2769.32 / Max: 3512

OSPRay

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 61.53 / Avg: 624.39 / Max: 724.31Min: 60.05 / Avg: 591.62 / Max: 680.48Min: 122.95 / Avg: 530.21 / Max: 639.78Min: 80.49 / Avg: 523.67 / Max: 629.96Min: 205.85 / Avg: 679.41 / Max: 796.02Min: 210.52 / Avg: 667.18 / Max: 772.19

OSPRay

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 37.25 / Avg: 53.21 / Max: 56.88Min: 36.38 / Avg: 50.52 / Max: 53.25Min: 55 / Avg: 73.2 / Max: 77Min: 53 / Avg: 71.52 / Max: 75Min: 40 / Avg: 55.09 / Max: 58Min: 39 / Avg: 54.1 / Max: 58

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On30060090012001500SE +/- 0.33, N = 3SE +/- 1.20, N = 3SE +/- 1.00, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3705581149113089808591. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2720 / Avg: 3276 / Max: 3709Min: 2646 / Avg: 3229.97 / Max: 3709Min: 1783 / Avg: 2893.57 / Max: 3403Min: 2300 / Avg: 2622.27 / Max: 3401Min: 1900 / Avg: 2891.42 / Max: 3545Min: 1900 / Avg: 2818.86 / Max: 3514

OSPRay Studio

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 60.36 / Avg: 615.21 / Max: 792.28Min: 60.79 / Avg: 611.59 / Max: 770.42Min: 129.57 / Avg: 500.65 / Max: 657.6Min: 102.33 / Avg: 497.27 / Max: 661.94Min: 212.33 / Avg: 663.86 / Max: 880.6Min: 178.24 / Avg: 661.77 / Max: 876.06

OSPRay Studio

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 37.25 / Avg: 51.89 / Max: 55.5Min: 36.38 / Avg: 50.48 / Max: 53.75Min: 54 / Avg: 69.43 / Max: 76Min: 53 / Avg: 69.12 / Max: 75Min: 35 / Avg: 51.94 / Max: 57Min: 35 / Avg: 51.67 / Max: 57

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On5K10K15K20K25KSE +/- 8.39, N = 3SE +/- 7.00, N = 3SE +/- 42.81, N = 3SE +/- 8.41, N = 3SE +/- 37.53, N = 3SE +/- 19.41, N = 3112169260239432087215601135891. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2773 / Avg: 3122.61 / Max: 3709Min: 2682 / Avg: 3157.82 / Max: 3709Min: 1631 / Avg: 2895.11 / Max: 3404Min: 2300 / Avg: 2639.14 / Max: 3403Min: 1900 / Avg: 2891.51 / Max: 3509Min: 1900 / Avg: 2766.18 / Max: 3509

OSPRay Studio

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 61.33 / Avg: 648.16 / Max: 799.28Min: 56.6 / Avg: 627.16 / Max: 783.63Min: 129.76 / Avg: 497.33 / Max: 659.2Min: 122.89 / Avg: 488.82 / Max: 662.51Min: 206.26 / Avg: 650.1 / Max: 877.56Min: 214.67 / Avg: 684.96 / Max: 875.35

OSPRay Studio

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 37.25 / Avg: 53.26 / Max: 58.25Min: 36.75 / Avg: 51.41 / Max: 55.25Min: 53 / Avg: 68.82 / Max: 75Min: 50 / Avg: 67.06 / Max: 74Min: 38 / Avg: 51.75 / Max: 57Min: 38 / Avg: 53.78 / Max: 58

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On10K20K30K40K50KSE +/- 50.78, N = 3SE +/- 30.61, N = 3SE +/- 10.69, N = 3SE +/- 44.00, N = 3SE +/- 69.83, N = 3SE +/- 11.72, N = 32247518500481654183431373272041. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2789 / Avg: 3177.76 / Max: 3709Min: 2771 / Avg: 3169.22 / Max: 3709Min: 1740 / Avg: 2881.42 / Max: 3403Min: 2300 / Avg: 2594.91 / Max: 3401Min: 1900 / Avg: 2877.33 / Max: 3513Min: 1900 / Avg: 2787.1 / Max: 3505

OSPRay Studio

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On160320480640800Min: 58.52 / Avg: 614.53 / Max: 802.45Min: 32.83 / Avg: 631.84 / Max: 775.3Min: 130.23 / Avg: 517.4 / Max: 652.59Min: 101.37 / Avg: 511.05 / Max: 668.12Min: 209.5 / Avg: 662.67 / Max: 884.59Min: 114.26 / Avg: 669.91 / Max: 876.36

OSPRay Studio

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 37.75 / Avg: 52.06 / Max: 55.5Min: 36.75 / Avg: 52.26 / Max: 54.63Min: 53 / Avg: 70.9 / Max: 77Min: 50 / Avg: 69.76 / Max: 75Min: 39 / Avg: 52.35 / Max: 57Min: 39 / Avg: 52.99 / Max: 57

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On400800120016002000SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 1.00, N = 3SE +/- 0.00, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 383669517701563117010291. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2721 / Avg: 3208.32 / Max: 3709Min: 2671 / Avg: 3308.27 / Max: 3711Min: 1947 / Avg: 2897.09 / Max: 3403Min: 2300 / Avg: 2609.05 / Max: 3401Min: 1900 / Avg: 2874.56 / Max: 3509Min: 1900 / Avg: 2823.98 / Max: 3514

OSPRay Studio

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 60.27 / Avg: 620.19 / Max: 789.77Min: 58.16 / Avg: 599.55 / Max: 773.94Min: 81.76 / Avg: 503.22 / Max: 657.11Min: 111.41 / Avg: 500.78 / Max: 666.67Min: 212.51 / Avg: 666.51 / Max: 879.7Min: 214.02 / Avg: 660.08 / Max: 874.86

OSPRay Studio

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 37.75 / Avg: 52.04 / Max: 55.5Min: 37.25 / Avg: 50.44 / Max: 53.75Min: 51 / Avg: 69.42 / Max: 76Min: 50 / Avg: 68.75 / Max: 75Min: 38 / Avg: 52.47 / Max: 57Min: 39 / Avg: 52.34 / Max: 57

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On6K12K18K24K30KSE +/- 32.66, N = 3SE +/- 3.79, N = 3SE +/- 46.52, N = 3SE +/- 18.50, N = 3SE +/- 45.36, N = 3SE +/- 25.54, N = 31334111058284902492718608163321. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2726 / Avg: 3186.89 / Max: 3709Min: 2777 / Avg: 3169.51 / Max: 3709Min: 1835 / Avg: 2867.88 / Max: 3402Min: 2300 / Avg: 2615.33 / Max: 3403Min: 1900 / Avg: 2836.9 / Max: 3512Min: 1900 / Avg: 2841.62 / Max: 3508

OSPRay Studio

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On160320480640800Min: 60.29 / Avg: 636.59 / Max: 798.92Min: 37.81 / Avg: 629.17 / Max: 778.51Min: 117.01 / Avg: 524.66 / Max: 656.47Min: 100.35 / Avg: 499.04 / Max: 664.34Min: 179.46 / Avg: 687.97 / Max: 887.42Min: 107.88 / Avg: 652.2 / Max: 894.12

OSPRay Studio

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 37.25 / Avg: 52.98 / Max: 56.38Min: 37.25 / Avg: 52.28 / Max: 56.38Min: 51 / Avg: 71.52 / Max: 77Min: 52 / Avg: 68.49 / Max: 74Min: 38 / Avg: 53.76 / Max: 58Min: 39 / Avg: 51.56 / Max: 57

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On13K26K39K52K65KSE +/- 18.25, N = 3SE +/- 44.52, N = 3SE +/- 56.19, N = 3SE +/- 4.98, N = 3SE +/- 115.86, N = 3SE +/- 45.83, N = 32654122120627804984737300327491. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2721 / Avg: 3353.6 / Max: 3709Min: 2702 / Avg: 3343.21 / Max: 3709Min: 1597 / Avg: 2940.27 / Max: 3407Min: 2300 / Avg: 2577.91 / Max: 3401Min: 1900 / Avg: 2875.06 / Max: 3514Min: 1900 / Avg: 2803.99 / Max: 3513

OSPRay Studio

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 31.18 / Avg: 618.56 / Max: 788.32Min: 61.78 / Avg: 592.07 / Max: 769.69Min: 123.88 / Avg: 460.86 / Max: 660.32Min: 102.13 / Avg: 519.61 / Max: 662.67Min: 180.6 / Avg: 673.37 / Max: 881.95Min: 211.24 / Avg: 659.15 / Max: 861.5

OSPRay Studio

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 38.13 / Avg: 52.62 / Max: 59.25Min: 36.75 / Avg: 51.43 / Max: 54.63Min: 53 / Avg: 66.34 / Max: 73Min: 49 / Avg: 70.06 / Max: 75Min: 39 / Avg: 53.34 / Max: 58Min: 39 / Avg: 52.54 / Max: 57

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On0.45280.90561.35841.81122.264SE +/- 0.002552, N = 9SE +/- 0.003984, N = 9SE +/- 0.002804, N = 9SE +/- 0.001297, N = 9SE +/- 0.006513, N = 9SE +/- 0.001579, N = 91.7366700.9862141.9928600.8751962.0124100.7368221. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3570 / Avg: 3666 / Max: 3709Min: 3403 / Avg: 3617.61 / Max: 3709Min: 2300 / Avg: 2610.75 / Max: 3145Min: 2300 / Avg: 2463.92 / Max: 3025Min: 1900 / Avg: 3132.72 / Max: 3511Min: 1900 / Avg: 3013.2 / Max: 3507

oneDNN

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 56.11 / Avg: 241.2 / Max: 540.52Min: 30.68 / Avg: 261.28 / Max: 580.04Min: 117.63 / Avg: 306.45 / Max: 584.73Min: 120.33 / Avg: 330.6 / Max: 647.31Min: 210.1 / Avg: 417.66 / Max: 769.29Min: 204.47 / Avg: 439.83 / Max: 838.42

oneDNN

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.0CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 33.63 / Avg: 36.99 / Max: 40.88Min: 34.13 / Avg: 37.73 / Max: 41.75Min: 50 / Avg: 57.62 / Max: 69Min: 51 / Avg: 59.32 / Max: 70Min: 33 / Avg: 39.82 / Max: 48Min: 36 / Avg: 40.95 / Max: 47

Mobile Neural Network

Model: mobilenetV3

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenetV3AVX-512 OffAVX-512 On0.8751.752.6253.54.375SE +/- 0.049, N = 3SE +/- 0.053, N = 9SE +/- 0.022, N = 10SE +/- 0.025, N = 15SE +/- 0.012, N = 3SE +/- 0.005, N = 33.8893.8661.7641.7092.2882.0551. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: squeezenetv1.1AVX-512 OffAVX-512 On246810SE +/- 0.137, N = 3SE +/- 0.219, N = 9SE +/- 0.039, N = 10SE +/- 0.064, N = 15SE +/- 0.008, N = 3SE +/- 0.072, N = 37.5667.2042.6782.2973.5512.7371. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: resnet-v2-50AVX-512 OffAVX-512 On612182430SE +/- 0.300, N = 3SE +/- 0.193, N = 9SE +/- 0.099, N = 10SE +/- 0.074, N = 15SE +/- 0.060, N = 3SE +/- 0.065, N = 324.08114.72718.1337.90917.7168.4961. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0AVX-512 OffAVX-512 On3691215SE +/- 0.132, N = 3SE +/- 0.234, N = 9SE +/- 0.056, N = 10SE +/- 0.080, N = 15SE +/- 0.105, N = 3SE +/- 0.082, N = 39.2788.7624.1953.9995.2224.4151. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Cpuminer-Opt

Algorithm: scrypt

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptAVX-512 OffAVX-512 On10002000300040005000SE +/- 0.03, N = 3SE +/- 13.77, N = 3SE +/- 0.63, N = 3SE +/- 7.11, N = 3SE +/- 0.54, N = 3SE +/- 1.21, N = 32947.944816.311122.742307.421623.883665.551. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: scrypt

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptAVX-512 OffAVX-512 On2468105.4378.0542.2494.6272.6185.636

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2936 / Avg: 3110.3 / Max: 3709Min: 2986 / Avg: 3249.64 / Max: 3709Min: 2300 / Avg: 2914.43 / Max: 3000Min: 2300 / Avg: 2665.18 / Max: 2970Min: 1900 / Avg: 2927.59 / Max: 3501Min: 1900 / Avg: 2817.46 / Max: 3508

Cpuminer-Opt

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 52.42 / Avg: 542.18 / Max: 637.99Min: 59.62 / Avg: 597.99 / Max: 707.37Min: 123.97 / Avg: 499.12 / Max: 602.56Min: 114.85 / Avg: 498.71 / Max: 604.01Min: 108.05 / Avg: 620.23 / Max: 772.37Min: 205.47 / Avg: 650.33 / Max: 782.01

Cpuminer-Opt

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 34.13 / Avg: 48.03 / Max: 52Min: 34.13 / Avg: 50.14 / Max: 55.63Min: 49 / Avg: 68.06 / Max: 73Min: 48 / Avg: 68.72 / Max: 75Min: 37 / Avg: 50.54 / Max: 55Min: 36 / Avg: 51.1 / Max: 56

Cpuminer-Opt

Algorithm: Triple SHA-256, Onecoin

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Triple SHA-256, OnecoinAVX-512 OffAVX-512 On700K1400K2100K2800K3500KSE +/- 18173.37, N = 3SE +/- 23073.29, N = 15SE +/- 579.55, N = 3SE +/- 8466.21, N = 3SE +/- 3398.36, N = 3SE +/- 18201.57, N = 3333885033262876470331328547109263720742001. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Triple SHA-256, Onecoin

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: Triple SHA-256, OnecoinAVX-512 OffAVX-512 On120024003600480060005632.974975.701301.102672.901741.893203.65

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3008 / Avg: 3335.89 / Max: 3709Min: 3178 / Avg: 3465.81 / Max: 3714Min: 2300 / Avg: 2888.78 / Max: 3283Min: 2300 / Avg: 2643.21 / Max: 3400Min: 1900 / Avg: 2957.05 / Max: 3510Min: 1900 / Avg: 2875.21 / Max: 3511

Cpuminer-Opt

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 57.41 / Avg: 592.73 / Max: 701.33Min: 33.08 / Avg: 668.51 / Max: 793.29Min: 75.22 / Avg: 497.3 / Max: 601.9Min: 119.7 / Avg: 497.04 / Max: 601.36Min: 221.38 / Avg: 627.27 / Max: 771.94Min: 206.27 / Avg: 647.45 / Max: 782.3

Cpuminer-Opt

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 35.88 / Avg: 50.93 / Max: 54.25Min: 36.75 / Avg: 55.17 / Max: 58.75Min: 51 / Avg: 69.9 / Max: 74Min: 51 / Avg: 70.07 / Max: 75Min: 40 / Avg: 51.93 / Max: 56Min: 39 / Avg: 52.28 / Max: 56

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteAVX-512 OffAVX-512 On500K1000K1500K2000K2500KSE +/- 7009.29, N = 3SE +/- 10844.37, N = 3SE +/- 4107.35, N = 3SE +/- 1289.92, N = 3SE +/- 657.95, N = 3SE +/- 3990.27, N = 31334363225250035517392404068732014726201. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteAVX-512 OffAVX-512 On80016002400320040002351.123555.70710.081859.261053.062276.98

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3033 / Avg: 3343.09 / Max: 3709Min: 3114 / Avg: 3410.31 / Max: 3709Min: 2300 / Avg: 2868.13 / Max: 3101Min: 2300 / Avg: 2651.15 / Max: 3400Min: 1900 / Avg: 2927.09 / Max: 3501Min: 1900 / Avg: 2857.47 / Max: 3507

Cpuminer-Opt

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 54.9 / Avg: 567.54 / Max: 675.79Min: 32.24 / Avg: 633.49 / Max: 739.43Min: 120.7 / Avg: 500.19 / Max: 602.54Min: 79.08 / Avg: 496.99 / Max: 602.19Min: 220 / Avg: 652.69 / Max: 740.32Min: 206.88 / Avg: 646.74 / Max: 779.66

Cpuminer-Opt

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 36.38 / Avg: 50.97 / Max: 54.25Min: 38.13 / Avg: 52.94 / Max: 56.13Min: 51 / Avg: 70.21 / Max: 75Min: 52 / Avg: 70.84 / Max: 75Min: 39 / Avg: 53.91 / Max: 58Min: 39 / Avg: 52.72 / Max: 57

Cpuminer-Opt

Algorithm: x25x

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xAVX-512 OffAVX-512 On16003200480064008000SE +/- 0.55, N = 3SE +/- 54.56, N = 3SE +/- 4.47, N = 3SE +/- 4.49, N = 3SE +/- 21.26, N = 6SE +/- 26.18, N = 35712.587691.781840.412650.362166.904071.591. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: x25x

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xAVX-512 OffAVX-512 On369121510.30213.4473.7135.3383.3136.322

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3295 / Avg: 3487.56 / Max: 3709Min: 3132 / Avg: 3368.18 / Max: 3709Min: 2300 / Avg: 2916.53 / Max: 3305Min: 2300 / Avg: 2832.8 / Max: 3402Min: 1900 / Avg: 2906.57 / Max: 3511Min: 1900 / Avg: 2729.58 / Max: 3501

Cpuminer-Opt

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 60.23 / Avg: 554.51 / Max: 659.93Min: 55.42 / Avg: 572.01 / Max: 668.33Min: 118.75 / Avg: 495.69 / Max: 593.22Min: 128.03 / Avg: 496.51 / Max: 596.23Min: 137.07 / Avg: 654.01 / Max: 765.2Min: 210.54 / Avg: 644.01 / Max: 768.58

Cpuminer-Opt

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 36.75 / Avg: 50.8 / Max: 54.63Min: 37.25 / Avg: 52.15 / Max: 55.5Min: 53 / Avg: 69.68 / Max: 74Min: 51 / Avg: 69.47 / Max: 74Min: 40 / Avg: 53.43 / Max: 57Min: 38 / Avg: 52.08 / Max: 56

Cpuminer-Opt

Algorithm: Deepcoin

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: DeepcoinAVX-512 OffAVX-512 On40K80K120K160K200KSE +/- 204.21, N = 3SE +/- 536.94, N = 3SE +/- 32.15, N = 3SE +/- 52.92, N = 3SE +/- 928.66, N = 3SE +/- 155.06, N = 31652401602905793064690911071055131. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Deepcoin

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: DeepcoinAVX-512 OffAVX-512 On60120180240300284.10274.20116.45130.17139.12161.98

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2899 / Avg: 3360.04 / Max: 3709Min: 3239 / Avg: 3515.22 / Max: 3709Min: 2300 / Avg: 2798.55 / Max: 3145Min: 2300 / Avg: 2779.27 / Max: 3400Min: 1900 / Avg: 2857.54 / Max: 3507Min: 1900 / Avg: 2936.48 / Max: 3508

Cpuminer-Opt

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 60.67 / Avg: 581.62 / Max: 686.17Min: 31.65 / Avg: 584.57 / Max: 690.12Min: 88.2 / Avg: 497.46 / Max: 601.66Min: 71.69 / Avg: 496.96 / Max: 602.54Min: 212.39 / Avg: 654.88 / Max: 782.5Min: 202.83 / Avg: 651.38 / Max: 782.3

Cpuminer-Opt

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 36.38 / Avg: 50.56 / Max: 53.75Min: 36.63 / Avg: 50.78 / Max: 54.25Min: 53 / Avg: 70.18 / Max: 74Min: 52 / Avg: 70.34 / Max: 75Min: 42 / Avg: 54.53 / Max: 58Min: 39 / Avg: 53.02 / Max: 57

Cpuminer-Opt

Algorithm: Skeincoin

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinAVX-512 OffAVX-512 On400K800K1200K1600K2000KSE +/- 7503.92, N = 3SE +/- 4597.66, N = 3SE +/- 716.54, N = 3SE +/- 438.80, N = 3SE +/- 329.36, N = 3SE +/- 668.14, N = 31413063199079039935061327367773310724531. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Skeincoin

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinAVX-512 OffAVX-512 On70014002100280035002428.443141.21800.441225.351035.241658.46

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2896 / Avg: 3299.49 / Max: 3709Min: 3001 / Avg: 3367.28 / Max: 3709Min: 2300 / Avg: 2776.23 / Max: 3195Min: 2300 / Avg: 2673.53 / Max: 3063Min: 1900 / Avg: 2872.56 / Max: 3501Min: 2700 / Avg: 2861.18 / Max: 3505

Cpuminer-Opt

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 53.17 / Avg: 581.88 / Max: 686.77Min: 34.28 / Avg: 633.77 / Max: 745.91Min: 118.62 / Avg: 498.92 / Max: 601.83Min: 123.73 / Avg: 500.49 / Max: 601.47Min: 224.85 / Avg: 654.66 / Max: 780.76Min: 103.7 / Avg: 646.66 / Max: 782.6

Cpuminer-Opt

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 36.38 / Avg: 50.92 / Max: 54.25Min: 36.38 / Avg: 52.6 / Max: 56.13Min: 51 / Avg: 69.73 / Max: 74Min: 52 / Avg: 71.11 / Max: 77Min: 40 / Avg: 53.91 / Max: 58Min: 39 / Avg: 52.76 / Max: 56

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsAVX-512 OffAVX-512 On200K400K600K800K1000KSE +/- 1744.51, N = 3SE +/- 3825.46, N = 3SE +/- 498.81, N = 3SE +/- 390.61, N = 3SE +/- 820.11, N = 3SE +/- 1047.73, N = 349278010689931570834191332639176726771. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsAVX-512 OffAVX-512 On400800120016002000834.911639.75314.92841.20404.761033.12

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2733 / Avg: 3270.61 / Max: 3709Min: 3092 / Avg: 3394.73 / Max: 3709Min: 2300 / Avg: 2737.13 / Max: 3400Min: 2300 / Avg: 2623.57 / Max: 3400Min: 1900 / Avg: 2760.78 / Max: 3502Min: 1900 / Avg: 2817.16 / Max: 3501

Cpuminer-Opt

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 58.49 / Avg: 590.22 / Max: 704.35Min: 31.53 / Avg: 651.92 / Max: 765.29Min: 119.65 / Avg: 498.8 / Max: 602.02Min: 123.8 / Avg: 498.26 / Max: 601.23Min: 132.94 / Avg: 652.03 / Max: 781.58Min: 205.28 / Avg: 651.11 / Max: 781.83

Cpuminer-Opt

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 36.75 / Avg: 51.26 / Max: 55.13Min: 37.25 / Avg: 53.37 / Max: 57.25Min: 52 / Avg: 69.81 / Max: 74Min: 52 / Avg: 70.74 / Max: 76Min: 40 / Avg: 54.02 / Max: 57Min: 39 / Avg: 52.42 / Max: 56

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On30K60K90K120K150KSE +/- 673.74, N = 3SE +/- 1008.13, N = 3SE +/- 38.18, N = 3SE +/- 42.04, N = 3SE +/- 74.60, N = 3SE +/- 153.42, N = 3114083.24118103.9450413.9867701.6073906.76103184.011. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On0.35550.7111.06651.4221.7775SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.140.961.581.161.571.041. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2585.83 / Max: 3400Min: 2300 / Avg: 2378.88 / Max: 3400Min: 1900 / Avg: 2584.6 / Max: 3508Min: 1900 / Avg: 2332.5 / Max: 3508

OpenVINO

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 30.32 / Avg: 579.7 / Max: 638.45Min: 61.47 / Avg: 583.01 / Max: 643.67Min: 120.36 / Avg: 516.2 / Max: 593.64Min: 119.8 / Avg: 517.02 / Max: 593.95Min: 225.78 / Avg: 674.16 / Max: 768.69Min: 211.51 / Avg: 670.46 / Max: 768.59

OpenVINO

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 36.75 / Avg: 50.69 / Max: 53.75Min: 36.38 / Avg: 50.87 / Max: 54.63Min: 54 / Avg: 73.27 / Max: 77Min: 54 / Avg: 73.47 / Max: 77Min: 40 / Avg: 53.81 / Max: 57Min: 39 / Avg: 52.99 / Max: 56

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 0.29, N = 3SE +/- 1.97, N = 3SE +/- 2.52, N = 3SE +/- 2.81, N = 3SE +/- 1.04, N = 3SE +/- 1.24, N = 36218.2511029.451750.304442.953878.796206.721. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On714212835SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 37.714.3411.414.4930.9119.311. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2952.33 / Max: 3400Min: 2300 / Avg: 2464.76 / Max: 3400Min: 2327 / Avg: 2504.87 / Max: 3513Min: 1900 / Avg: 2571.73 / Max: 3502

OpenVINO

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 57.68 / Avg: 622.09 / Max: 684.99Min: 57.77 / Avg: 594.48 / Max: 654.28Min: 124.05 / Avg: 517.82 / Max: 584.06Min: 127.49 / Avg: 518.52 / Max: 595.86Min: 209.15 / Avg: 668.46 / Max: 770.95Min: 211.57 / Avg: 667.99 / Max: 782.09

OpenVINO

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 37.25 / Avg: 52.53 / Max: 56Min: 37.75 / Avg: 51.65 / Max: 54.25Min: 54 / Avg: 74.99 / Max: 79Min: 53 / Avg: 74.24 / Max: 79Min: 40 / Avg: 53.23 / Max: 57Min: 40 / Avg: 52.32 / Max: 55

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On16003200480064008000SE +/- 2.86, N = 3SE +/- 1.27, N = 3SE +/- 0.71, N = 3SE +/- 0.97, N = 3SE +/- 0.62, N = 3SE +/- 1.23, N = 33791.807420.491014.271119.451732.743738.921. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On510152025SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 312.646.4619.6817.8317.298.011. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2788.99 / Max: 3402Min: 2300 / Avg: 2555.76 / Max: 3400Min: 1900 / Avg: 2479.96 / Max: 3506Min: 1900 / Avg: 2431.39 / Max: 3509

OpenVINO

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 54.82 / Avg: 604.27 / Max: 663.05Min: 38.84 / Avg: 638.51 / Max: 699.19Min: 121.86 / Avg: 518.5 / Max: 595.33Min: 124.75 / Avg: 518.86 / Max: 596.78Min: 208.74 / Avg: 674.93 / Max: 776.16Min: 209.62 / Avg: 674 / Max: 775.31

OpenVINO

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 37.25 / Avg: 50.88 / Max: 53.5Min: 37.13 / Avg: 52.63 / Max: 55.5Min: 54 / Avg: 72.7 / Max: 77Min: 54 / Avg: 72.62 / Max: 77Min: 40 / Avg: 53.53 / Max: 57Min: 40 / Avg: 52.8 / Max: 55

miniBUDE

Implementation: OpenMP - Input Deck: BM1

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On16003200480064008000SE +/- 27.90, N = 8SE +/- 9.60, N = 10SE +/- 3.51, N = 5SE +/- 6.26, N = 5SE +/- 6.63, N = 6SE +/- 13.13, N = 75192.437274.051796.162339.322480.613586.271. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On60120180240300SE +/- 1.12, N = 8SE +/- 0.38, N = 10SE +/- 0.14, N = 5SE +/- 0.25, N = 5SE +/- 0.27, N = 6SE +/- 0.53, N = 7207.70290.9671.8593.5799.23143.451. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On0.23040.46080.69120.92161.1520.6191.0240.1610.2180.1810.292

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3145 / Avg: 3570.92 / Max: 3709Min: 3296 / Avg: 3597.25 / Max: 3709Min: 2300 / Avg: 2689.33 / Max: 3014Min: 2300 / Avg: 2694.51 / Max: 3194Min: 1900 / Avg: 2980.48 / Max: 3511Min: 1900 / Avg: 3105.81 / Max: 3512

miniBUDE

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OffAVX-512 On140280420560700Min: 50.93 / Avg: 335.56 / Max: 660.26Min: 60.57 / Avg: 284.05 / Max: 711.18Min: 112.89 / Avg: 447.53 / Max: 605.44Min: 76.52 / Avg: 430.19 / Max: 621.53Min: 204.3 / Avg: 549.62 / Max: 791.37Min: 111.28 / Avg: 491.9 / Max: 790.45

miniBUDE

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 35 / Avg: 42.25 / Max: 50.38Min: 35.88 / Avg: 41.15 / Max: 49Min: 50 / Avg: 65.07 / Max: 72Min: 52 / Avg: 65.79 / Max: 74Min: 39 / Avg: 48.48 / Max: 54Min: 40 / Avg: 46.05 / Max: 51

miniBUDE

Implementation: OpenMP - Input Deck: BM2

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 46.49, N = 3SE +/- 47.16, N = 4SE +/- 12.20, N = 3SE +/- 13.49, N = 3SE +/- 24.70, N = 6SE +/- 9.11, N = 36371.328562.691993.072588.762602.653643.841. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On70140210280350SE +/- 1.86, N = 3SE +/- 1.89, N = 4SE +/- 0.49, N = 3SE +/- 0.54, N = 3SE +/- 0.99, N = 6SE +/- 0.36, N = 3254.85342.5179.72103.55104.11145.751. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On0.15280.30560.45840.61120.7640.4810.6790.1560.2040.1700.246

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2943.56 / Max: 3400Min: 2300 / Avg: 2927.95 / Max: 3402Min: 1900 / Avg: 3016.33 / Max: 3515Min: 1900 / Avg: 2986.92 / Max: 3558

miniBUDE

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OffAVX-512 On150300450600750Min: 54.45 / Avg: 530.15 / Max: 665.49Min: 59.34 / Avg: 504.56 / Max: 653.44Min: 114.01 / Avg: 512.58 / Max: 652.62Min: 122.79 / Avg: 508.57 / Max: 665.4Min: 109.04 / Avg: 612 / Max: 868.4Min: 209.21 / Avg: 593.08 / Max: 864.78

miniBUDE

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OffAVX-512 On1632486480Min: 34.13 / Avg: 48.71 / Max: 55.63Min: 34.13 / Avg: 47.83 / Max: 54.25Min: 46 / Avg: 72.36 / Max: 85Min: 47 / Avg: 72.68 / Max: 84Min: 37 / Avg: 52.39 / Max: 59Min: 37 / Avg: 48.68 / Max: 55

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeAVX-512 OffAVX-512 On4080120160200146.75145.90162.72160.66169.84159.671. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeAVX-512 OffAVX-512 On80160240320400110.95112.38358.63361.37194.79195.481. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709.02 / Max: 3714Min: 2300 / Avg: 2959.08 / Max: 3400Min: 2300 / Avg: 2948.55 / Max: 3400Min: 1900 / Avg: 2735.03 / Max: 3517Min: 1900 / Avg: 2718.73 / Max: 3515

OpenFOAM

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOpenFOAM 10CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 57.64 / Avg: 661.82 / Max: 737.11Min: 61.7 / Avg: 659.15 / Max: 738.72Min: 122.02 / Avg: 539.74 / Max: 590.97Min: 102.2 / Avg: 540.67 / Max: 588.28Min: 211.03 / Avg: 696.05 / Max: 761.31Min: 210.74 / Avg: 695.05 / Max: 754.74

OpenFOAM

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 31.88 / Avg: 53.96 / Max: 60Min: 36.38 / Avg: 55.35 / Max: 60.88Min: 39 / Avg: 71.62 / Max: 78Min: 40 / Avg: 71.85 / Max: 80Min: 30 / Avg: 53.51 / Max: 59Min: 33 / Avg: 54.15 / Max: 59

OpenFOAM

Input: drivaerFastback, Large Mesh Size - Mesh Time

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Large Mesh Size - Mesh TimeAVX-512 OffAVX-512 On2004006008001000867.38996.78887.211051.351039.32847.911. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Large Mesh Size - Execution Time

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Large Mesh Size - Execution TimeAVX-512 OffAVX-512 On150030004500600075002803.542849.617106.767117.014319.124305.121. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

CPU Peak Freq (Highest CPU Core Frequency) Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 3709 / Avg: 3709 / Max: 3709Min: 3709 / Avg: 3709 / Max: 3709Min: 2300 / Avg: 2980.24 / Max: 3408Min: 2300 / Avg: 2974.56 / Max: 3400Min: 2491 / Avg: 2870.69 / Max: 3516Min: 2451 / Avg: 2868.19 / Max: 3513

OpenFOAM

CPU Power Consumption Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgWatts, Fewer Is BetterOpenFOAM 10CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 58.28 / Avg: 650.61 / Max: 748.65Min: 62.76 / Avg: 655.07 / Max: 742.42Min: 127.05 / Avg: 547.75 / Max: 588.4Min: 129.82 / Avg: 547.41 / Max: 588.74Min: 208.95 / Avg: 709.42 / Max: 767.54Min: 214.57 / Avg: 709.53 / Max: 762.94

OpenFOAM

CPU Temperature Monitor

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 36.75 / Avg: 54.3 / Max: 61.38Min: 37.75 / Avg: 55.54 / Max: 62.63Min: 51 / Avg: 70.16 / Max: 75Min: 50 / Avg: 69.77 / Max: 75Min: 39 / Avg: 54.29 / Max: 60Min: 40 / Avg: 54.65 / Max: 60

SMHasher

Hash: FarmHash32 x86_64 AVX

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX-512 OffAVX-512 On9K18K27K36K45KSE +/- 41.48, N = 5SE +/- 0.56, N = 5SE +/- 181.36, N = 4SE +/- 1.95, N = 4SE +/- 181.17, N = 4SE +/- 68.33, N = 436458.3139795.3630330.5333979.9937809.7142508.351. (CXX) g++ options: -O3 -march=native -mno-amx-tile -flto=auto -fno-fat-lto-objects

SMHasher

Hash: FarmHash32 x86_64 AVX

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX-512 OffAVX-512 On714212835SE +/- 0.00, N = 5SE +/- 0.16, N = 5SE +/- 0.01, N = 4SE +/- 0.02, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 426.4126.5531.5831.0823.2723.271. (CXX) g++ options: -O3 -march=native -mno-amx-tile -flto=auto -fno-fat-lto-objects

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Phoronix Test Suite System Monitoring

EPYC 9654Xeon 8380Xeon 8490HOpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On7001400210028003500Min: 2336 / Avg: 3667.6 / Max: 4199Min: 2547 / Avg: 3615.9 / Max: 3772Min: 802 / Avg: 3114.77 / Max: 3421Min: 804 / Avg: 2939.27 / Max: 3420Min: 1899 / Avg: 3041.53 / Max: 4080Min: 690 / Avg: 3000.31 / Max: 4081

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

Xeon 8380Xeon 8490HOpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On160320480640800Min: 57.8 / Avg: 365.97 / Max: 660.32Min: 60.6 / Avg: 451.19 / Max: 668.12Min: 101.7 / Avg: 588.67 / Max: 887.42Min: 102.55 / Avg: 582.55 / Max: 894.12

Phoronix Test Suite v10.8.4