Ice Lake, Sapphire Rapids, Genoa AVX-512 benchmarks by Michael Larabel for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2301176-NE-SAPPHIRER14 Sapphire Rapids AVX-512 Benchmarks - Phoronix Test Suite Sapphire Rapids AVX-512 Benchmarks Ice Lake, Sapphire Rapids, Genoa AVX-512 benchmarks by Michael Larabel for a future article.
HTML result view exported from: https://openbenchmarking.org/result/2301176-NE-SAPPHIRER14&sro&gru .
Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernel Desktop Display Server Vulkan Compiler File-System Screen Resolution Xeon 8380 Xeon 8490H EPYC 9654 AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads) Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS) Intel Ice Lake IEH 512GB 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 ASPEED VGA HDMI 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP Ubuntu 22.10 5.19.0-29-generic (x86_64) GNOME Shell 43.1 X Server 1.21.1.4 1.3.224 GCC 12.2.0 ext4 1920x1080 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads) Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS) Intel Device 1bce 1008GB 4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T 2 x AMD EPYC 9654 96-Core @ 3.71GHz (192 Cores / 384 Threads) AMD Titanite_4G (RTI1002E BIOS) AMD Device 14a4 1520GB Broadcom NetXtreme BCM5720 PCIe OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Environment Details - Xeon 8380: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" CFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" - Xeon 8380: AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" - Xeon 8490H: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" CFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" - Xeon 8490H: AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" - EPYC 9654: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" CFLAGS="-O3 -march=native -mno-avx512f -mno-amx-tile" - EPYC 9654: AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512 -mno-amx-tile" Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Xeon 8380: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd000375 - Xeon 8380: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd000375 - Xeon 8490H: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0000c0 - Xeon 8490H: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0000c0 - EPYC 9654: AVX-512 Off: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa10110d - EPYC 9654: AVX-512 On: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa10110d Python Details - Python 3.10.7 Security Details - Xeon 8380: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon 8380: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon 8490H: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon 8490H: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9654: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9654: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
minibude: OpenMP - BM1 minibude: OpenMP - BM2 openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16 - CPU embree: Pathtracer ISPC - Asian Dragon embree: Pathtracer ISPC - Crown minibude: OpenMP - BM1 minibude: OpenMP - BM2 oidn: RT.hdr_alb_nrm.3840x2160 oidn: RTLightmap.hdr.4096x4096 openvkl: vklBenchmark ISPC ospray: gravity_spheres_volume/dim_512/ao/real_time ospray: gravity_spheres_volume/dim_512/scivis/real_time ospray: gravity_spheres_volume/dim_512/pathtracer/real_time deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream cpuminer-opt: scrypt cpuminer-opt: Triple SHA-256, Onecoin cpuminer-opt: Quad SHA-256, Pyrite cpuminer-opt: x25x cpuminer-opt: Deepcoin cpuminer-opt: Skeincoin cpuminer-opt: LBC, LBRY Credits smhasher: FarmHash32 x86_64 AVX lczero: BLAS lczero: Eigen smhasher: FarmHash32 x86_64 AVX ospray-studio: 1 - 4K - 1 - Path Tracer ospray-studio: 1 - 4K - 16 - Path Tracer ospray-studio: 1 - 4K - 32 - Path Tracer ospray-studio: 3 - 4K - 1 - Path Tracer ospray-studio: 3 - 4K - 16 - Path Tracer ospray-studio: 3 - 4K - 32 - Path Tracer onednn: Deconvolution Batch shapes_3d - f32 - CPU mnn: mobilenetV3 mnn: squeezenetv1.1 mnn: resnet-v2-50 mnn: SqueezeNetV1.0 openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16 - CPU deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream openfoam: drivaerFastback, Medium Mesh Size - Mesh Time openfoam: drivaerFastback, Medium Mesh Size - Execution Time openfoam: drivaerFastback, Large Mesh Size - Mesh Time openfoam: drivaerFastback, Large Mesh Size - Execution Time Xeon 8380 Xeon 8490H EPYC 9654 AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On 71.846 79.723 50413.98 1750.30 1014.27 96.3441 70.5079 1796.159 1993.067 2.07 1.03 792 14.3455 13.7792 19.9578 183.8325 379.5792 113.3261 541.8617 16.8275 43.1140 45.8547 158.5261 69.7264 247.2732 16.7996 43.1601 1122.74 647033 355173 1840.41 57930 399350 157083 30330.53 4780 4709 31.584 1491 23943 48165 1770 28490 62780 1.99286 1.764 2.678 18.133 4.195 1.58 11.41 19.68 217.0993 105.2624 8.8158 73.7463 59.4175 916.9360 21.7973 251.5678 14.3286 161.3342 59.5159 913.4196 162.72306 358.63124 887.20762 7106.7611 93.573 103.550 67701.60 4442.95 1119.45 106.1798 74.8033 2339.323 2588.758 2.94 1.42 917 21.2242 21.0640 25.5179 227.4544 455.0312 228.1219 835.7846 20.1933 48.4134 79.1405 221.7294 83.4197 318.7928 20.2313 48.2393 2307.42 1328547 924040 2650.36 64690 613273 419133 33979.99 5524 5750 31.084 1308 20872 41834 1563 24927 49847 0.875196 1.709 2.297 7.909 3.999 1.16 4.49 17.83 175.6914 87.8658 4.3750 47.8216 49.5145 819.5325 12.6264 180.1704 11.9769 125.1639 49.4208 821.9588 160.6645 361.36688 1051.3525 7117.0059 99.225 104.106 73906.76 3878.79 1732.74 90.3959 62.0377 2480.607 2602.652 2.95 1.48 1034 23.1748 22.8328 32.4837 264.7704 584.1487 187.6477 832.8542 21.2862 66.7540 46.8614 232.2085 84.8378 405.7230 21.1789 66.7281 1623.88 1092637 687320 2166.90 91107 677733 263917 37809.71 7542 8243 23.268 980 15601 31373 1170 18608 37300 2.01241 2.288 3.551 17.716 5.222 1.57 30.91 17.29 226.2678 102.6136 5.3242 71.9346 46.9735 887.5893 21.3212 257.5622 11.7823 147.4578 47.2094 889.3899 169.84164 194.78975 1039.3153 4319.1245 143.451 145.754 103184.01 6206.72 3738.92 122.5260 92.6512 3586.273 3643.840 4.19 1.99 1196 36.3643 35.9544 42.9662 424.2714 875.6416 281.2361 1492.8844 27.0670 92.0211 83.7008 355.6686 100.5397 592.4522 26.8432 92.0328 3665.55 2074200 1472620 4071.59 105513 1072453 672677 42508.35 10671 11134 23.273 859 13589 27204 1029 16332 32749 0.736822 2.055 2.737 8.496 4.415 1.04 19.31 8.01 141.1445 68.4347 3.5509 40.1407 36.9382 648.1995 11.9378 168.2285 9.9734 101.0425 37.2473 647.7545 159.67329 195.47713 847.91029 4305.1242 207.697 254.853 114083.24 6218.25 3791.80 177.6774 153.1815 5192.425 6371.320 3.46 1.72 1176 26.3953 25.3096 40.6658 510.8775 1006.0824 206.3171 1410.4222 30.8553 120.5142 71.5088 491.3426 109.2581 660.5371 30.4563 120.5189 2947.94 3338850 1334363 5712.58 165240 1413063 492780 36458.31 9425 8161 26.413 705 11216 22475 836 13341 26541 1.73667 3.889 7.566 24.081 9.278 1.14 7.71 12.64 187.3515 95.1665 4.8444 67.9016 32.4024 787.3270 13.9740 194.7179 9.1835 144.8858 32.8263 787.7235 146.75453 110.94948 867.379 2803.5444 290.962 342.508 118103.94 11029.45 7420.49 213.9512 181.8889 7274.050 8562.694 3.48 1.66 1341 43.7081 43.2358 54.1553 613.9355 1205.1813 191.3325 1966.4052 34.2322 84.8676 100.2855 704.5818 126.0114 809.0751 34.5008 84.3996 4816.31 3326287 2252500 7691.78 160290 1990790 1068993 39795.36 9171 9085 26.551 581 9260 18500 695 11058 22120 0.986214 3.866 7.204 14.727 8.762 0.96 4.34 6.46 155.9118 79.4967 5.2240 48.7003 29.2029 1128.8450 9.9667 135.9937 7.9604 118.3525 28.9771 1132.6133 145.89944 112.38169 996.77741 2849.611 OpenBenchmarking.org
CPU Peak Freq (Highest CPU Core Frequency) Monitor Phoronix Test Suite System Monitoring EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz CPU Peak Freq (Highest CPU Core Frequency) Monitor Phoronix Test Suite System Monitoring AVX-512 Off AVX-512 On 700 1400 2100 2800 3500 Min: 2336 / Avg: 3667.6 / Max: 4199 Min: 2547 / Avg: 3615.9 / Max: 3772 Min: 802 / Avg: 3114.77 / Max: 3421 Min: 804 / Avg: 2939.27 / Max: 3420 Min: 1899 / Avg: 3041.53 / Max: 4080 Min: 690 / Avg: 3000.31 / Max: 4081
CPU Power Consumption Monitor Phoronix Test Suite System Monitoring Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts CPU Power Consumption Monitor Phoronix Test Suite System Monitoring AVX-512 Off AVX-512 On 160 320 480 640 800 Min: 57.8 / Avg: 365.97 / Max: 660.32 Min: 60.6 / Avg: 451.19 / Max: 668.12 Min: 101.7 / Avg: 588.67 / Max: 887.42 Min: 102.55 / Avg: 582.55 / Max: 894.12
miniBUDE Implementation: OpenMP - Input Deck: BM1 EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 AVX-512 Off AVX-512 On 60 120 180 240 300 SE +/- 1.12, N = 8 SE +/- 0.38, N = 10 SE +/- 0.14, N = 5 SE +/- 0.25, N = 5 SE +/- 0.27, N = 6 SE +/- 0.53, N = 7 207.70 290.96 71.85 93.57 99.23 143.45 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM1 EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Billion Interactions/s Per Watt, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 AVX-512 Off AVX-512 On 0.2304 0.4608 0.6912 0.9216 1.152 0.619 1.024 0.161 0.218 0.181 0.292
miniBUDE Implementation: OpenMP - Input Deck: BM2 EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 AVX-512 Off AVX-512 On 70 140 210 280 350 SE +/- 1.86, N = 3 SE +/- 1.89, N = 4 SE +/- 0.49, N = 3 SE +/- 0.54, N = 3 SE +/- 0.99, N = 6 SE +/- 0.36, N = 3 254.85 342.51 79.72 103.55 104.11 145.75 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM2 EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Billion Interactions/s Per Watt, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 AVX-512 Off AVX-512 On 0.1528 0.3056 0.4584 0.6112 0.764 0.481 0.679 0.156 0.204 0.170 0.246
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On 30K 60K 90K 120K 150K SE +/- 673.74, N = 3 SE +/- 1008.13, N = 3 SE +/- 38.18, N = 3 SE +/- 42.04, N = 3 SE +/- 74.60, N = 3 SE +/- 153.42, N = 3 114083.24 118103.94 50413.98 67701.60 73906.76 103184.01 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On 2K 4K 6K 8K 10K SE +/- 0.29, N = 3 SE +/- 1.97, N = 3 SE +/- 2.52, N = 3 SE +/- 2.81, N = 3 SE +/- 1.04, N = 3 SE +/- 1.24, N = 3 6218.25 11029.45 1750.30 4442.95 3878.79 6206.72 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv
OpenVINO Model: Vehicle Detection FP16 - Device: CPU EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU AVX-512 Off AVX-512 On 1600 3200 4800 6400 8000 SE +/- 2.86, N = 3 SE +/- 1.27, N = 3 SE +/- 0.71, N = 3 SE +/- 0.97, N = 3 SE +/- 0.62, N = 3 SE +/- 1.23, N = 3 3791.80 7420.49 1014.27 1119.45 1732.74 3738.92 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv
Embree Binary: Pathtracer ISPC - Model: Asian Dragon EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon AVX-512 Off AVX-512 On 0.1553 0.3106 0.4659 0.6212 0.7765 0.518 0.690 0.240 0.272 0.168 0.255
Embree Binary: Pathtracer ISPC - Model: Crown EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Crown AVX-512 Off AVX-512 On 0.1145 0.229 0.3435 0.458 0.5725 0.418 0.509 0.167 0.184 0.110 0.193
Embree Binary: Pathtracer ISPC - Model: Asian Dragon EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon AVX-512 Off AVX-512 On 50 100 150 200 250 SE +/- 0.11, N = 8 SE +/- 0.25, N = 9 SE +/- 0.42, N = 6 SE +/- 0.56, N = 6 SE +/- 0.50, N = 6 SE +/- 0.64, N = 6 177.68 213.95 96.34 106.18 90.40 122.53
Embree Binary: Pathtracer ISPC - Model: Crown EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Crown AVX-512 Off AVX-512 On 40 80 120 160 200 SE +/- 0.42, N = 7 SE +/- 0.47, N = 8 SE +/- 0.27, N = 5 SE +/- 0.17, N = 5 SE +/- 5.25, N = 15 SE +/- 0.53, N = 6 153.18 181.89 70.51 74.80 62.04 92.65
miniBUDE Implementation: OpenMP - Input Deck: BM1 EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 AVX-512 Off AVX-512 On 1600 3200 4800 6400 8000 SE +/- 27.90, N = 8 SE +/- 9.60, N = 10 SE +/- 3.51, N = 5 SE +/- 6.26, N = 5 SE +/- 6.63, N = 6 SE +/- 13.13, N = 7 5192.43 7274.05 1796.16 2339.32 2480.61 3586.27 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM2 EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 AVX-512 Off AVX-512 On 2K 4K 6K 8K 10K SE +/- 46.49, N = 3 SE +/- 47.16, N = 4 SE +/- 12.20, N = 3 SE +/- 13.49, N = 3 SE +/- 24.70, N = 6 SE +/- 9.11, N = 3 6371.32 8562.69 1993.07 2588.76 2602.65 3643.84 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
Intel Open Image Denoise Run: RT.hdr_alb_nrm.3840x2160 EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.hdr_alb_nrm.3840x2160 AVX-512 Off AVX-512 On 0.0027 0.0054 0.0081 0.0108 0.0135 0.012 0.012 0.006 0.009 0.007 0.010
Intel Open Image Denoise Run: RTLightmap.hdr.4096x4096 EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RTLightmap.hdr.4096x4096 AVX-512 Off AVX-512 On 0.0011 0.0022 0.0033 0.0044 0.0055 0.005 0.005 0.003 0.004 0.003 0.004
Intel Open Image Denoise Run: RT.hdr_alb_nrm.3840x2160 EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.hdr_alb_nrm.3840x2160 AVX-512 Off AVX-512 On 0.9428 1.8856 2.8284 3.7712 4.714 SE +/- 0.02, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 4 SE +/- 0.01, N = 5 SE +/- 0.02, N = 5 SE +/- 0.02, N = 6 3.46 3.48 2.07 2.94 2.95 4.19
Intel Open Image Denoise Run: RTLightmap.hdr.4096x4096 EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RTLightmap.hdr.4096x4096 AVX-512 Off AVX-512 On 0.4478 0.8956 1.3434 1.7912 2.239 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 4 1.72 1.66 1.03 1.42 1.48 1.99
OpenVKL Benchmark: vklBenchmark ISPC EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC AVX-512 Off AVX-512 On 300 600 900 1200 1500 SE +/- 13.87, N = 3 SE +/- 16.33, N = 3 SE +/- 1.86, N = 3 SE +/- 1.76, N = 3 SE +/- 4.16, N = 3 SE +/- 2.52, N = 3 1176 1341 792 917 1034 1196
OpenVKL Benchmark: vklBenchmark ISPC EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Items / Sec Per Watt, More Is Better OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC AVX-512 Off AVX-512 On 0.6467 1.2934 1.9401 2.5868 3.2335 2.405 2.874 1.734 2.014 1.726 2.057
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time AVX-512 Off AVX-512 On 0.0169 0.0338 0.0507 0.0676 0.0845 0.043 0.075 0.027 0.040 0.034 0.054
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time AVX-512 Off AVX-512 On 0.0167 0.0334 0.0501 0.0668 0.0835 0.041 0.074 0.026 0.040 0.033 0.053
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time AVX-512 Off AVX-512 On 0.0207 0.0414 0.0621 0.0828 0.1035 0.065 0.092 0.038 0.049 0.048 0.064
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time AVX-512 Off AVX-512 On 10 20 30 40 50 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 26.40 43.71 14.35 21.22 23.17 36.36
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time AVX-512 Off AVX-512 On 10 20 30 40 50 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 25.31 43.24 13.78 21.06 22.83 35.95
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time AVX-512 Off AVX-512 On 12 24 36 48 60 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 40.67 54.16 19.96 25.52 32.48 42.97
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 130 260 390 520 650 SE +/- 0.22, N = 3 SE +/- 0.55, N = 3 SE +/- 0.52, N = 3 SE +/- 0.49, N = 3 SE +/- 0.93, N = 3 SE +/- 0.95, N = 3 510.88 613.94 183.83 227.45 264.77 424.27
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 300 600 900 1200 1500 SE +/- 0.56, N = 3 SE +/- 3.78, N = 3 SE +/- 0.62, N = 3 SE +/- 0.94, N = 3 SE +/- 0.51, N = 3 SE +/- 2.15, N = 3 1006.08 1205.18 379.58 455.03 584.15 875.64
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 60 120 180 240 300 SE +/- 0.04, N = 3 SE +/- 0.36, N = 3 SE +/- 0.44, N = 3 SE +/- 0.16, N = 3 SE +/- 0.21, N = 3 SE +/- 0.71, N = 3 206.32 191.33 113.33 228.12 187.65 281.24
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 400 800 1200 1600 2000 SE +/- 0.94, N = 3 SE +/- 1.71, N = 3 SE +/- 1.47, N = 3 SE +/- 0.98, N = 3 SE +/- 0.84, N = 3 SE +/- 1.88, N = 3 1410.42 1966.41 541.86 835.78 832.85 1492.88
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 8 16 24 32 40 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 30.86 34.23 16.83 20.19 21.29 27.07
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 30 60 90 120 150 SE +/- 0.22, N = 3 SE +/- 0.19, N = 3 SE +/- 0.10, N = 3 SE +/- 0.21, N = 3 SE +/- 0.17, N = 3 SE +/- 0.03, N = 3 120.51 84.87 43.11 48.41 66.75 92.02
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 20 40 60 80 100 SE +/- 0.16, N = 3 SE +/- 0.67, N = 3 SE +/- 0.14, N = 3 SE +/- 0.13, N = 3 SE +/- 0.12, N = 3 SE +/- 0.15, N = 3 71.51 100.29 45.85 79.14 46.86 83.70
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 150 300 450 600 750 SE +/- 1.03, N = 3 SE +/- 5.42, N = 13 SE +/- 0.92, N = 3 SE +/- 0.18, N = 3 SE +/- 0.51, N = 3 SE +/- 1.22, N = 3 491.34 704.58 158.53 221.73 232.21 355.67
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 30 60 90 120 150 SE +/- 1.97, N = 15 SE +/- 2.25, N = 15 SE +/- 0.21, N = 3 SE +/- 0.06, N = 3 SE +/- 0.59, N = 3 SE +/- 1.49, N = 15 109.26 126.01 69.73 83.42 84.84 100.54
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 200 400 600 800 1000 SE +/- 0.26, N = 3 SE +/- 2.56, N = 3 SE +/- 0.62, N = 3 SE +/- 0.38, N = 3 SE +/- 0.43, N = 3 SE +/- 0.33, N = 3 660.54 809.08 247.27 318.79 405.72 592.45
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 8 16 24 32 40 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.12, N = 3 30.46 34.50 16.80 20.23 21.18 26.84
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 30 60 90 120 150 SE +/- 0.10, N = 3 SE +/- 0.10, N = 3 SE +/- 0.16, N = 3 SE +/- 0.01, N = 3 SE +/- 0.23, N = 3 SE +/- 0.19, N = 3 120.52 84.40 43.16 48.24 66.73 92.03
Cpuminer-Opt Algorithm: scrypt EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: scrypt AVX-512 Off AVX-512 On 1000 2000 3000 4000 5000 SE +/- 0.03, N = 3 SE +/- 13.77, N = 3 SE +/- 0.63, N = 3 SE +/- 7.11, N = 3 SE +/- 0.54, N = 3 SE +/- 1.21, N = 3 2947.94 4816.31 1122.74 2307.42 1623.88 3665.55 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Triple SHA-256, Onecoin EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Triple SHA-256, Onecoin AVX-512 Off AVX-512 On 700K 1400K 2100K 2800K 3500K SE +/- 18173.37, N = 3 SE +/- 23073.29, N = 15 SE +/- 579.55, N = 3 SE +/- 8466.21, N = 3 SE +/- 3398.36, N = 3 SE +/- 18201.57, N = 3 3338850 3326287 647033 1328547 1092637 2074200 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Quad SHA-256, Pyrite EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Quad SHA-256, Pyrite AVX-512 Off AVX-512 On 500K 1000K 1500K 2000K 2500K SE +/- 7009.29, N = 3 SE +/- 10844.37, N = 3 SE +/- 4107.35, N = 3 SE +/- 1289.92, N = 3 SE +/- 657.95, N = 3 SE +/- 3990.27, N = 3 1334363 2252500 355173 924040 687320 1472620 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: scrypt EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: scrypt AVX-512 Off AVX-512 On 2 4 6 8 10 5.437 8.054 2.249 4.627 2.618 5.636
Cpuminer-Opt Algorithm: Deepcoin EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Deepcoin AVX-512 Off AVX-512 On 60 120 180 240 300 284.10 274.20 116.45 130.17 139.12 161.98
Cpuminer-Opt Algorithm: Skeincoin EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Skeincoin AVX-512 Off AVX-512 On 700 1400 2100 2800 3500 2428.44 3141.21 800.44 1225.35 1035.24 1658.46
Cpuminer-Opt Algorithm: LBC, LBRY Credits EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: LBC, LBRY Credits AVX-512 Off AVX-512 On 400 800 1200 1600 2000 834.91 1639.75 314.92 841.20 404.76 1033.12
Cpuminer-Opt Algorithm: x25x EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: x25x AVX-512 Off AVX-512 On 1600 3200 4800 6400 8000 SE +/- 0.55, N = 3 SE +/- 54.56, N = 3 SE +/- 4.47, N = 3 SE +/- 4.49, N = 3 SE +/- 21.26, N = 6 SE +/- 26.18, N = 3 5712.58 7691.78 1840.41 2650.36 2166.90 4071.59 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Triple SHA-256, Onecoin EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Triple SHA-256, Onecoin AVX-512 Off AVX-512 On 1200 2400 3600 4800 6000 5632.97 4975.70 1301.10 2672.90 1741.89 3203.65
Cpuminer-Opt Algorithm: Quad SHA-256, Pyrite EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Quad SHA-256, Pyrite AVX-512 Off AVX-512 On 800 1600 2400 3200 4000 2351.12 3555.70 710.08 1859.26 1053.06 2276.98
Cpuminer-Opt Algorithm: x25x EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: x25x AVX-512 Off AVX-512 On 3 6 9 12 15 10.302 13.447 3.713 5.338 3.313 6.322
Cpuminer-Opt Algorithm: Deepcoin EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Deepcoin AVX-512 Off AVX-512 On 40K 80K 120K 160K 200K SE +/- 204.21, N = 3 SE +/- 536.94, N = 3 SE +/- 32.15, N = 3 SE +/- 52.92, N = 3 SE +/- 928.66, N = 3 SE +/- 155.06, N = 3 165240 160290 57930 64690 91107 105513 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Skeincoin EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Skeincoin AVX-512 Off AVX-512 On 400K 800K 1200K 1600K 2000K SE +/- 7503.92, N = 3 SE +/- 4597.66, N = 3 SE +/- 716.54, N = 3 SE +/- 438.80, N = 3 SE +/- 329.36, N = 3 SE +/- 668.14, N = 3 1413063 1990790 399350 613273 677733 1072453 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: LBC, LBRY Credits EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: LBC, LBRY Credits AVX-512 Off AVX-512 On 200K 400K 600K 800K 1000K SE +/- 1744.51, N = 3 SE +/- 3825.46, N = 3 SE +/- 498.81, N = 3 SE +/- 390.61, N = 3 SE +/- 820.11, N = 3 SE +/- 1047.73, N = 3 492780 1068993 157083 419133 263917 672677 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3700 / Avg: 3708.95 / Max: 3709 Min: 2300 / Avg: 2976.98 / Max: 3411 Min: 2300 / Avg: 2795.9 / Max: 3409 Min: 1900 / Avg: 3038.98 / Max: 3517 Min: 1900 / Avg: 2810.29 / Max: 3515
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3709 Min: 2300 / Avg: 2912.11 / Max: 3406 Min: 2300 / Avg: 2658.36 / Max: 3406 Min: 1900 / Avg: 2946.44 / Max: 3517 Min: 1900 / Avg: 2739.54 / Max: 3513
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3698 / Avg: 3708.91 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3709 Min: 2300 / Avg: 2943.87 / Max: 3400 Min: 2300 / Avg: 2506.26 / Max: 3400 Min: 1900 / Avg: 3287.49 / Max: 3517 Min: 1900 / Avg: 3360.23 / Max: 3516
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3709 Min: 2300 / Avg: 2701.11 / Max: 3401 Min: 2300 / Avg: 2582.73 / Max: 3401 Min: 1900 / Avg: 2690.42 / Max: 3512 Min: 1900 / Avg: 2613.81 / Max: 3508
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3709 Min: 2300 / Avg: 2813.09 / Max: 3401 Min: 2300 / Avg: 2702.75 / Max: 3401 Min: 1900 / Avg: 3376.77 / Max: 3517 Min: 1900 / Avg: 3277.52 / Max: 3516
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3709 Min: 2300 / Avg: 2835.42 / Max: 3408 Min: 2300 / Avg: 2731.23 / Max: 3408 Min: 1900 / Avg: 2897.84 / Max: 3517 Min: 1900 / Avg: 2758.89 / Max: 3517
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3709 Min: 2300 / Avg: 2936.97 / Max: 3405 Min: 2300 / Avg: 2689.46 / Max: 3402 Min: 1900 / Avg: 3338.2 / Max: 3518 Min: 1900 / Avg: 3337.42 / Max: 3517
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3703 / Avg: 3708.97 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3709 Min: 2300 / Avg: 2856.54 / Max: 3402 Min: 2300 / Avg: 2704.63 / Max: 3402 Min: 1900 / Avg: 2956.37 / Max: 3516 Min: 1900 / Avg: 2821.77 / Max: 3515
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3697 / Avg: 3708.98 / Max: 3709 Min: 3700 / Avg: 3708.99 / Max: 3709 Min: 2300 / Avg: 3086.6 / Max: 3400 Min: 2300 / Avg: 2877.68 / Max: 3400 Min: 1900 / Avg: 3335.14 / Max: 3516 Min: 1900 / Avg: 3282.46 / Max: 3518
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3709 Min: 2300 / Avg: 2883.8 / Max: 3400 Min: 2300 / Avg: 2672.86 / Max: 3410 Min: 1900 / Avg: 2540.23 / Max: 3513 Min: 1900 / Avg: 2474.62 / Max: 3509
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3709 Min: 2300 / Avg: 2834.61 / Max: 3407 Min: 2300 / Avg: 2707.62 / Max: 3403 Min: 1900 / Avg: 3338.32 / Max: 3520 Min: 1900 / Avg: 3216.06 / Max: 3518
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3697 / Avg: 3708.93 / Max: 3709 Min: 2300 / Avg: 2851.54 / Max: 3409 Min: 2300 / Avg: 2747.12 / Max: 3411 Min: 1900 / Avg: 2907.36 / Max: 3519 Min: 1900 / Avg: 2733.68 / Max: 3518
LeelaChessZero CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better LeelaChessZero 0.28 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709.02 / Max: 3731 Min: 2300 / Avg: 3292.51 / Max: 3407 Min: 2300 / Avg: 3285.55 / Max: 3420 Min: 1900 / Avg: 3429.01 / Max: 3524 Min: 1900 / Avg: 3432.97 / Max: 3523
LeelaChessZero CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better LeelaChessZero 0.28 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3711 Min: 2300 / Avg: 3281.52 / Max: 3416 Min: 2300 / Avg: 3283.63 / Max: 3411 Min: 1900 / Avg: 3415.13 / Max: 3542 Min: 1900 / Avg: 3431.65 / Max: 3563
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 2833 / Avg: 3434 / Max: 3709 Min: 2918 / Avg: 3474.26 / Max: 3709 Min: 2300 / Avg: 2765.28 / Max: 3401 Min: 2300 / Avg: 2565.14 / Max: 3400 Min: 1900 / Avg: 3074.54 / Max: 3507 Min: 1900 / Avg: 3148.38 / Max: 3511
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 2771 / Avg: 3462.8 / Max: 3709 Min: 2763 / Avg: 3454.37 / Max: 3709 Min: 2300 / Avg: 2850.31 / Max: 3400 Min: 2300 / Avg: 2636.37 / Max: 3400 Min: 1900 / Avg: 3070.52 / Max: 3512 Min: 1900 / Avg: 3006.61 / Max: 3508
OpenVKL CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better OpenVKL 1.3.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 2621 / Avg: 3442.04 / Max: 3709 Min: 2591 / Avg: 3486.01 / Max: 3709 Min: 2300 / Avg: 2988.69 / Max: 3410 Min: 2262 / Avg: 2929.05 / Max: 3409 Min: 1899 / Avg: 2931.06 / Max: 3519 Min: 1169 / Avg: 2887.71 / Max: 3515
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3709 Min: 2300 / Avg: 2644.39 / Max: 3400 Min: 2300 / Avg: 2484.49 / Max: 3123 Min: 1900 / Avg: 2976.52 / Max: 3510 Min: 1900 / Avg: 2985.41 / Max: 3510
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3709 Min: 2300 / Avg: 2632.24 / Max: 3400 Min: 2300 / Avg: 2543.96 / Max: 3400 Min: 1900 / Avg: 2888.03 / Max: 3505 Min: 1900 / Avg: 2755.84 / Max: 3503
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 2771 / Avg: 3210.13 / Max: 3709 Min: 2802 / Avg: 3315.52 / Max: 3709 Min: 2300 / Avg: 2855.45 / Max: 3400 Min: 2300 / Avg: 2866.53 / Max: 3402 Min: 1900 / Avg: 2900.68 / Max: 3504 Min: 1900 / Avg: 2652.54 / Max: 3514
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 2771 / Avg: 3286.61 / Max: 3709 Min: 2796 / Avg: 3267.78 / Max: 3709 Min: 2300 / Avg: 2842.78 / Max: 3400 Min: 2200 / Avg: 2873.43 / Max: 3400 Min: 1900 / Avg: 2870.01 / Max: 3506 Min: 1900 / Avg: 2689.91 / Max: 3502
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 700 1400 2100 2800 3500 Min: 2690 / Avg: 3283.87 / Max: 3709 Min: 2764 / Avg: 3287.4 / Max: 3772 Min: 2293 / Avg: 2874.31 / Max: 3400 Min: 2300 / Avg: 2590.11 / Max: 3402 Min: 1900 / Avg: 2827.79 / Max: 3508 Min: 1900 / Avg: 2769.32 / Max: 3512
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 2720 / Avg: 3276 / Max: 3709 Min: 2646 / Avg: 3229.97 / Max: 3709 Min: 1783 / Avg: 2893.57 / Max: 3403 Min: 2300 / Avg: 2622.27 / Max: 3401 Min: 1900 / Avg: 2891.42 / Max: 3545 Min: 1900 / Avg: 2818.86 / Max: 3514
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 2773 / Avg: 3122.61 / Max: 3709 Min: 2682 / Avg: 3157.82 / Max: 3709 Min: 1631 / Avg: 2895.11 / Max: 3404 Min: 2300 / Avg: 2639.14 / Max: 3403 Min: 1900 / Avg: 2891.51 / Max: 3509 Min: 1900 / Avg: 2766.18 / Max: 3509
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 2789 / Avg: 3177.76 / Max: 3709 Min: 2771 / Avg: 3169.22 / Max: 3709 Min: 1740 / Avg: 2881.42 / Max: 3403 Min: 2300 / Avg: 2594.91 / Max: 3401 Min: 1900 / Avg: 2877.33 / Max: 3513 Min: 1900 / Avg: 2787.1 / Max: 3505
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 2721 / Avg: 3208.32 / Max: 3709 Min: 2671 / Avg: 3308.27 / Max: 3711 Min: 1947 / Avg: 2897.09 / Max: 3403 Min: 2300 / Avg: 2609.05 / Max: 3401 Min: 1900 / Avg: 2874.56 / Max: 3509 Min: 1900 / Avg: 2823.98 / Max: 3514
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 2726 / Avg: 3186.89 / Max: 3709 Min: 2777 / Avg: 3169.51 / Max: 3709 Min: 1835 / Avg: 2867.88 / Max: 3402 Min: 2300 / Avg: 2615.33 / Max: 3403 Min: 1900 / Avg: 2836.9 / Max: 3512 Min: 1900 / Avg: 2841.62 / Max: 3508
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 2721 / Avg: 3353.6 / Max: 3709 Min: 2702 / Avg: 3343.21 / Max: 3709 Min: 1597 / Avg: 2940.27 / Max: 3407 Min: 2300 / Avg: 2577.91 / Max: 3401 Min: 1900 / Avg: 2875.06 / Max: 3514 Min: 1900 / Avg: 2803.99 / Max: 3513
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better oneDNN 3.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3570 / Avg: 3666 / Max: 3709 Min: 3403 / Avg: 3617.61 / Max: 3709 Min: 2300 / Avg: 2610.75 / Max: 3145 Min: 2300 / Avg: 2463.92 / Max: 3025 Min: 1900 / Avg: 3132.72 / Max: 3511 Min: 1900 / Avg: 3013.2 / Max: 3507
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 2936 / Avg: 3110.3 / Max: 3709 Min: 2986 / Avg: 3249.64 / Max: 3709 Min: 2300 / Avg: 2914.43 / Max: 3000 Min: 2300 / Avg: 2665.18 / Max: 2970 Min: 1900 / Avg: 2927.59 / Max: 3501 Min: 1900 / Avg: 2817.46 / Max: 3508
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3008 / Avg: 3335.89 / Max: 3709 Min: 3178 / Avg: 3465.81 / Max: 3714 Min: 2300 / Avg: 2888.78 / Max: 3283 Min: 2300 / Avg: 2643.21 / Max: 3400 Min: 1900 / Avg: 2957.05 / Max: 3510 Min: 1900 / Avg: 2875.21 / Max: 3511
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3033 / Avg: 3343.09 / Max: 3709 Min: 3114 / Avg: 3410.31 / Max: 3709 Min: 2300 / Avg: 2868.13 / Max: 3101 Min: 2300 / Avg: 2651.15 / Max: 3400 Min: 1900 / Avg: 2927.09 / Max: 3501 Min: 1900 / Avg: 2857.47 / Max: 3507
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3295 / Avg: 3487.56 / Max: 3709 Min: 3132 / Avg: 3368.18 / Max: 3709 Min: 2300 / Avg: 2916.53 / Max: 3305 Min: 2300 / Avg: 2832.8 / Max: 3402 Min: 1900 / Avg: 2906.57 / Max: 3511 Min: 1900 / Avg: 2729.58 / Max: 3501
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 2899 / Avg: 3360.04 / Max: 3709 Min: 3239 / Avg: 3515.22 / Max: 3709 Min: 2300 / Avg: 2798.55 / Max: 3145 Min: 2300 / Avg: 2779.27 / Max: 3400 Min: 1900 / Avg: 2857.54 / Max: 3507 Min: 1900 / Avg: 2936.48 / Max: 3508
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 2896 / Avg: 3299.49 / Max: 3709 Min: 3001 / Avg: 3367.28 / Max: 3709 Min: 2300 / Avg: 2776.23 / Max: 3195 Min: 2300 / Avg: 2673.53 / Max: 3063 Min: 1900 / Avg: 2872.56 / Max: 3501 Min: 2700 / Avg: 2861.18 / Max: 3505
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 2733 / Avg: 3270.61 / Max: 3709 Min: 3092 / Avg: 3394.73 / Max: 3709 Min: 2300 / Avg: 2737.13 / Max: 3400 Min: 2300 / Avg: 2623.57 / Max: 3400 Min: 1900 / Avg: 2760.78 / Max: 3502 Min: 1900 / Avg: 2817.16 / Max: 3501
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3709 Min: 2300 / Avg: 2585.83 / Max: 3400 Min: 2300 / Avg: 2378.88 / Max: 3400 Min: 1900 / Avg: 2584.6 / Max: 3508 Min: 1900 / Avg: 2332.5 / Max: 3508
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3709 Min: 2300 / Avg: 2952.33 / Max: 3400 Min: 2300 / Avg: 2464.76 / Max: 3400 Min: 2327 / Avg: 2504.87 / Max: 3513 Min: 1900 / Avg: 2571.73 / Max: 3502
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3709 Min: 2300 / Avg: 2788.99 / Max: 3402 Min: 2300 / Avg: 2555.76 / Max: 3400 Min: 1900 / Avg: 2479.96 / Max: 3506 Min: 1900 / Avg: 2431.39 / Max: 3509
miniBUDE CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better miniBUDE 20210901 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3145 / Avg: 3570.92 / Max: 3709 Min: 3296 / Avg: 3597.25 / Max: 3709 Min: 2300 / Avg: 2689.33 / Max: 3014 Min: 2300 / Avg: 2694.51 / Max: 3194 Min: 1900 / Avg: 2980.48 / Max: 3511 Min: 1900 / Avg: 3105.81 / Max: 3512
miniBUDE CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better miniBUDE 20210901 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3709 Min: 2300 / Avg: 2943.56 / Max: 3400 Min: 2300 / Avg: 2927.95 / Max: 3402 Min: 1900 / Avg: 3016.33 / Max: 3515 Min: 1900 / Avg: 2986.92 / Max: 3558
OpenFOAM CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better OpenFOAM 10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709.02 / Max: 3714 Min: 2300 / Avg: 2959.08 / Max: 3400 Min: 2300 / Avg: 2948.55 / Max: 3400 Min: 1900 / Avg: 2735.03 / Max: 3517 Min: 1900 / Avg: 2718.73 / Max: 3515
OpenFOAM CPU Peak Freq (Highest CPU Core Frequency) Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Megahertz, More Is Better OpenFOAM 10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 Min: 3709 / Avg: 3709 / Max: 3709 Min: 3709 / Avg: 3709 / Max: 3709 Min: 2300 / Avg: 2980.24 / Max: 3408 Min: 2300 / Avg: 2974.56 / Max: 3400 Min: 2491 / Avg: 2870.69 / Max: 3516 Min: 2451 / Avg: 2868.19 / Max: 3513
SMHasher Hash: FarmHash32 x86_64 AVX EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org MiB/sec, More Is Better SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX AVX-512 Off AVX-512 On 9K 18K 27K 36K 45K SE +/- 41.48, N = 5 SE +/- 0.56, N = 5 SE +/- 181.36, N = 4 SE +/- 1.95, N = 4 SE +/- 181.17, N = 4 SE +/- 68.33, N = 4 36458.31 39795.36 30330.53 33979.99 37809.71 42508.35 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -flto=auto -fno-fat-lto-objects
LeelaChessZero Backend: BLAS EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: BLAS AVX-512 Off AVX-512 On 2K 4K 6K 8K 10K SE +/- 92.33, N = 9 SE +/- 36.09, N = 3 SE +/- 47.46, N = 5 SE +/- 68.15, N = 3 SE +/- 61.68, N = 3 SE +/- 133.67, N = 3 9425 9171 4780 5524 7542 10671 1. (CXX) g++ options: -flto -O3 -march=native -mno-amx-tile -pthread
LeelaChessZero Backend: BLAS EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better LeelaChessZero 0.28 Backend: BLAS AVX-512 Off AVX-512 On 6 12 18 24 30 24.70 24.19 12.09 14.01 14.11 19.81
LeelaChessZero Backend: Eigen EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better LeelaChessZero 0.28 Backend: Eigen AVX-512 Off AVX-512 On 6 12 18 24 30 21.89 24.74 12.06 14.53 15.38 20.61
LeelaChessZero Backend: Eigen EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: Eigen AVX-512 Off AVX-512 On 2K 4K 6K 8K 10K SE +/- 66.84, N = 3 SE +/- 35.63, N = 3 SE +/- 58.86, N = 3 SE +/- 64.32, N = 4 SE +/- 63.14, N = 3 SE +/- 151.11, N = 3 8161 9085 4709 5750 8243 11134 1. (CXX) g++ options: -flto -O3 -march=native -mno-amx-tile -pthread
Neural Magic DeepSparse CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 29.25 / Avg: 48.39 / Max: 60.5 Min: 31.88 / Avg: 48.49 / Max: 59.25 Min: 39 / Avg: 62.34 / Max: 77 Min: 37 / Avg: 61.39 / Max: 74 Min: 36 / Avg: 46.12 / Max: 53 Min: 37 / Avg: 47.32 / Max: 53
Neural Magic DeepSparse CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 42.63 / Avg: 55.22 / Max: 61 Min: 41.25 / Avg: 53.22 / Max: 60 Min: 54 / Avg: 70.96 / Max: 78 Min: 53 / Avg: 67.48 / Max: 74 Min: 36 / Avg: 49.25 / Max: 54 Min: 38 / Avg: 48.66 / Max: 53
Neural Magic DeepSparse CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 43.5 / Avg: 54.68 / Max: 57.75 Min: 43.5 / Avg: 51.97 / Max: 57.25 Min: 55 / Avg: 72.43 / Max: 78 Min: 53 / Avg: 69.21 / Max: 74 Min: 36 / Avg: 47.99 / Max: 52 Min: 38 / Avg: 48.31 / Max: 52
Neural Magic DeepSparse CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 43 / Avg: 56.4 / Max: 61.38 Min: 42.13 / Avg: 55.39 / Max: 60.88 Min: 57 / Avg: 73.09 / Max: 77 Min: 54 / Avg: 71.83 / Max: 77 Min: 37 / Avg: 49.9 / Max: 54 Min: 37 / Avg: 50.14 / Max: 54
Neural Magic DeepSparse CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 44.38 / Avg: 53.07 / Max: 59.13 Min: 43.5 / Avg: 52.39 / Max: 57.75 Min: 53 / Avg: 66.51 / Max: 75 Min: 54 / Avg: 67.84 / Max: 75 Min: 36 / Avg: 46.86 / Max: 52 Min: 37 / Avg: 47.84 / Max: 53
Neural Magic DeepSparse CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 43.88 / Avg: 54.3 / Max: 62.25 Min: 43.5 / Avg: 52.19 / Max: 59.13 Min: 51 / Avg: 64.63 / Max: 73 Min: 54 / Avg: 67.15 / Max: 75 Min: 37 / Avg: 46.87 / Max: 52 Min: 38 / Avg: 47.81 / Max: 53
Neural Magic DeepSparse CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 43 / Avg: 52.81 / Max: 58.25 Min: 43 / Avg: 52.83 / Max: 57.75 Min: 51 / Avg: 65.88 / Max: 73 Min: 52 / Avg: 66.78 / Max: 74 Min: 35 / Avg: 46.14 / Max: 52 Min: 37 / Avg: 47.74 / Max: 53
Neural Magic DeepSparse CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 37.25 / Avg: 44.79 / Max: 51.25 Min: 44.38 / Avg: 52.93 / Max: 60 Min: 53 / Avg: 65.7 / Max: 74 Min: 54 / Avg: 68.2 / Max: 75 Min: 37 / Avg: 47.69 / Max: 53 Min: 38 / Avg: 48.39 / Max: 53
Neural Magic DeepSparse CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 34.13 / Avg: 42.84 / Max: 47.75 Min: 36.38 / Avg: 42.68 / Max: 48 Min: 51 / Avg: 66.11 / Max: 71 Min: 54 / Avg: 65.21 / Max: 69 Min: 36 / Avg: 45.53 / Max: 49 Min: 38 / Avg: 45.45 / Max: 49
Neural Magic DeepSparse CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 33.63 / Avg: 46.39 / Max: 50.63 Min: 33.63 / Avg: 46.32 / Max: 50.63 Min: 51 / Avg: 70.06 / Max: 77 Min: 51 / Avg: 70.25 / Max: 76 Min: 35 / Avg: 49.22 / Max: 53 Min: 36 / Avg: 49.76 / Max: 54
Neural Magic DeepSparse CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 34.63 / Avg: 43.61 / Max: 48.38 Min: 34.13 / Avg: 43.31 / Max: 48 Min: 51 / Avg: 65.39 / Max: 73 Min: 53 / Avg: 67.31 / Max: 75 Min: 36 / Avg: 46.62 / Max: 53 Min: 37 / Avg: 47.75 / Max: 53
Neural Magic DeepSparse CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 34.63 / Avg: 44.85 / Max: 55.13 Min: 34.63 / Avg: 43.53 / Max: 49.5 Min: 51 / Avg: 64.77 / Max: 74 Min: 54 / Avg: 66.83 / Max: 75 Min: 37 / Avg: 46.66 / Max: 54 Min: 38 / Avg: 47.79 / Max: 53
LeelaChessZero CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better LeelaChessZero 0.28 CPU Temperature Monitor AVX-512 Off AVX-512 On 16 32 48 64 80 Min: 33.63 / Avg: 46.72 / Max: 58.25 Min: 33.25 / Avg: 40.84 / Max: 54.63 Min: 45 / Avg: 60.47 / Max: 85 Min: 54 / Avg: 71.37 / Max: 78 Min: 36 / Avg: 48.76 / Max: 59 Min: 35 / Avg: 44.16 / Max: 56
LeelaChessZero CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better LeelaChessZero 0.28 CPU Temperature Monitor AVX-512 Off AVX-512 On 16 32 48 64 80 Min: 34.63 / Avg: 46.31 / Max: 59.13 Min: 33.25 / Avg: 40.64 / Max: 53.75 Min: 44 / Avg: 65.29 / Max: 84 Min: 45 / Avg: 66.24 / Max: 82 Min: 35 / Avg: 47.75 / Max: 56 Min: 34 / Avg: 43.65 / Max: 56
Embree CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor AVX-512 Off AVX-512 On 13 26 39 52 65 Min: 35.88 / Avg: 41.18 / Max: 48 Min: 32.38 / Avg: 37.98 / Max: 44.38 Min: 44 / Avg: 57.26 / Max: 66 Min: 50 / Avg: 59.72 / Max: 67 Min: 39 / Avg: 46.46 / Max: 51 Min: 34 / Avg: 41.38 / Max: 47
Embree CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor AVX-512 Off AVX-512 On 13 26 39 52 65 Min: 35 / Avg: 42.18 / Max: 48.88 Min: 33.25 / Avg: 39.98 / Max: 46.63 Min: 48 / Avg: 61.37 / Max: 69 Min: 46 / Avg: 57.94 / Max: 65 Min: 37 / Avg: 46.83 / Max: 51 Min: 34 / Avg: 42.39 / Max: 48
OpenVKL CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better OpenVKL 1.3.1 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 35.5 / Avg: 47.03 / Max: 54.63 Min: 34.13 / Avg: 45.24 / Max: 52.88 Min: 50 / Avg: 69.77 / Max: 80 Min: 46 / Avg: 69.3 / Max: 78 Min: 36 / Avg: 49.72 / Max: 57 Min: 35 / Avg: 48.73 / Max: 56
Intel Open Image Denoise CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 35.88 / Avg: 40.59 / Max: 46.63 Min: 35 / Avg: 39.27 / Max: 45.5 Min: 50 / Avg: 61.2 / Max: 75 Min: 48 / Avg: 59.52 / Max: 72 Min: 37 / Avg: 43.04 / Max: 50 Min: 37 / Avg: 42.14 / Max: 50
Intel Open Image Denoise CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 34.63 / Avg: 40.87 / Max: 46.63 Min: 33.25 / Avg: 39.68 / Max: 46.38 Min: 47 / Avg: 59.15 / Max: 71 Min: 45 / Avg: 57.82 / Max: 69 Min: 35 / Avg: 43.41 / Max: 50 Min: 35 / Avg: 42.32 / Max: 49
OSPRay CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 34.63 / Avg: 51.95 / Max: 55.25 Min: 32.75 / Avg: 49.32 / Max: 52 Min: 46 / Avg: 72.76 / Max: 79 Min: 46 / Avg: 73.63 / Max: 80 Min: 35 / Avg: 54.32 / Max: 58 Min: 34 / Avg: 52.96 / Max: 57
OSPRay CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 37.75 / Avg: 52.77 / Max: 55.5 Min: 35.88 / Avg: 49.7 / Max: 52.88 Min: 56 / Avg: 72.16 / Max: 76 Min: 52 / Avg: 71.64 / Max: 75 Min: 39 / Avg: 55.05 / Max: 58 Min: 40 / Avg: 53.77 / Max: 57
OSPRay CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 37.25 / Avg: 53.21 / Max: 56.88 Min: 36.38 / Avg: 50.52 / Max: 53.25 Min: 55 / Avg: 73.2 / Max: 77 Min: 53 / Avg: 71.52 / Max: 75 Min: 40 / Avg: 55.09 / Max: 58 Min: 39 / Avg: 54.1 / Max: 58
OSPRay Studio CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 37.25 / Avg: 51.89 / Max: 55.5 Min: 36.38 / Avg: 50.48 / Max: 53.75 Min: 54 / Avg: 69.43 / Max: 76 Min: 53 / Avg: 69.12 / Max: 75 Min: 35 / Avg: 51.94 / Max: 57 Min: 35 / Avg: 51.67 / Max: 57
OSPRay Studio CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 37.25 / Avg: 53.26 / Max: 58.25 Min: 36.75 / Avg: 51.41 / Max: 55.25 Min: 53 / Avg: 68.82 / Max: 75 Min: 50 / Avg: 67.06 / Max: 74 Min: 38 / Avg: 51.75 / Max: 57 Min: 38 / Avg: 53.78 / Max: 58
OSPRay Studio CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 37.75 / Avg: 52.06 / Max: 55.5 Min: 36.75 / Avg: 52.26 / Max: 54.63 Min: 53 / Avg: 70.9 / Max: 77 Min: 50 / Avg: 69.76 / Max: 75 Min: 39 / Avg: 52.35 / Max: 57 Min: 39 / Avg: 52.99 / Max: 57
OSPRay Studio CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 37.75 / Avg: 52.04 / Max: 55.5 Min: 37.25 / Avg: 50.44 / Max: 53.75 Min: 51 / Avg: 69.42 / Max: 76 Min: 50 / Avg: 68.75 / Max: 75 Min: 38 / Avg: 52.47 / Max: 57 Min: 39 / Avg: 52.34 / Max: 57
OSPRay Studio CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 37.25 / Avg: 52.98 / Max: 56.38 Min: 37.25 / Avg: 52.28 / Max: 56.38 Min: 51 / Avg: 71.52 / Max: 77 Min: 52 / Avg: 68.49 / Max: 74 Min: 38 / Avg: 53.76 / Max: 58 Min: 39 / Avg: 51.56 / Max: 57
OSPRay Studio CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 38.13 / Avg: 52.62 / Max: 59.25 Min: 36.75 / Avg: 51.43 / Max: 54.63 Min: 53 / Avg: 66.34 / Max: 73 Min: 49 / Avg: 70.06 / Max: 75 Min: 39 / Avg: 53.34 / Max: 58 Min: 39 / Avg: 52.54 / Max: 57
oneDNN CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 3.0 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 33.63 / Avg: 36.99 / Max: 40.88 Min: 34.13 / Avg: 37.73 / Max: 41.75 Min: 50 / Avg: 57.62 / Max: 69 Min: 51 / Avg: 59.32 / Max: 70 Min: 33 / Avg: 39.82 / Max: 48 Min: 36 / Avg: 40.95 / Max: 47
Cpuminer-Opt CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 34.13 / Avg: 48.03 / Max: 52 Min: 34.13 / Avg: 50.14 / Max: 55.63 Min: 49 / Avg: 68.06 / Max: 73 Min: 48 / Avg: 68.72 / Max: 75 Min: 37 / Avg: 50.54 / Max: 55 Min: 36 / Avg: 51.1 / Max: 56
Cpuminer-Opt CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 35.88 / Avg: 50.93 / Max: 54.25 Min: 36.75 / Avg: 55.17 / Max: 58.75 Min: 51 / Avg: 69.9 / Max: 74 Min: 51 / Avg: 70.07 / Max: 75 Min: 40 / Avg: 51.93 / Max: 56 Min: 39 / Avg: 52.28 / Max: 56
Cpuminer-Opt CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 36.38 / Avg: 50.97 / Max: 54.25 Min: 38.13 / Avg: 52.94 / Max: 56.13 Min: 51 / Avg: 70.21 / Max: 75 Min: 52 / Avg: 70.84 / Max: 75 Min: 39 / Avg: 53.91 / Max: 58 Min: 39 / Avg: 52.72 / Max: 57
Cpuminer-Opt CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 36.75 / Avg: 50.8 / Max: 54.63 Min: 37.25 / Avg: 52.15 / Max: 55.5 Min: 53 / Avg: 69.68 / Max: 74 Min: 51 / Avg: 69.47 / Max: 74 Min: 40 / Avg: 53.43 / Max: 57 Min: 38 / Avg: 52.08 / Max: 56
Cpuminer-Opt CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 36.38 / Avg: 50.56 / Max: 53.75 Min: 36.63 / Avg: 50.78 / Max: 54.25 Min: 53 / Avg: 70.18 / Max: 74 Min: 52 / Avg: 70.34 / Max: 75 Min: 42 / Avg: 54.53 / Max: 58 Min: 39 / Avg: 53.02 / Max: 57
Cpuminer-Opt CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 36.38 / Avg: 50.92 / Max: 54.25 Min: 36.38 / Avg: 52.6 / Max: 56.13 Min: 51 / Avg: 69.73 / Max: 74 Min: 52 / Avg: 71.11 / Max: 77 Min: 40 / Avg: 53.91 / Max: 58 Min: 39 / Avg: 52.76 / Max: 56
Cpuminer-Opt CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 36.75 / Avg: 51.26 / Max: 55.13 Min: 37.25 / Avg: 53.37 / Max: 57.25 Min: 52 / Avg: 69.81 / Max: 74 Min: 52 / Avg: 70.74 / Max: 76 Min: 40 / Avg: 54.02 / Max: 57 Min: 39 / Avg: 52.42 / Max: 56
OpenVINO CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.3 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 36.75 / Avg: 50.69 / Max: 53.75 Min: 36.38 / Avg: 50.87 / Max: 54.63 Min: 54 / Avg: 73.27 / Max: 77 Min: 54 / Avg: 73.47 / Max: 77 Min: 40 / Avg: 53.81 / Max: 57 Min: 39 / Avg: 52.99 / Max: 56
OpenVINO CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.3 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 37.25 / Avg: 52.53 / Max: 56 Min: 37.75 / Avg: 51.65 / Max: 54.25 Min: 54 / Avg: 74.99 / Max: 79 Min: 53 / Avg: 74.24 / Max: 79 Min: 40 / Avg: 53.23 / Max: 57 Min: 40 / Avg: 52.32 / Max: 55
OpenVINO CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.3 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 37.25 / Avg: 50.88 / Max: 53.5 Min: 37.13 / Avg: 52.63 / Max: 55.5 Min: 54 / Avg: 72.7 / Max: 77 Min: 54 / Avg: 72.62 / Max: 77 Min: 40 / Avg: 53.53 / Max: 57 Min: 40 / Avg: 52.8 / Max: 55
miniBUDE CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better miniBUDE 20210901 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 35 / Avg: 42.25 / Max: 50.38 Min: 35.88 / Avg: 41.15 / Max: 49 Min: 50 / Avg: 65.07 / Max: 72 Min: 52 / Avg: 65.79 / Max: 74 Min: 39 / Avg: 48.48 / Max: 54 Min: 40 / Avg: 46.05 / Max: 51
miniBUDE CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better miniBUDE 20210901 CPU Temperature Monitor AVX-512 Off AVX-512 On 16 32 48 64 80 Min: 34.13 / Avg: 48.71 / Max: 55.63 Min: 34.13 / Avg: 47.83 / Max: 54.25 Min: 46 / Avg: 72.36 / Max: 85 Min: 47 / Avg: 72.68 / Max: 84 Min: 37 / Avg: 52.39 / Max: 59 Min: 37 / Avg: 48.68 / Max: 55
OpenFOAM CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better OpenFOAM 10 CPU Temperature Monitor AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 31.88 / Avg: 53.96 / Max: 60 Min: 36.38 / Avg: 55.35 / Max: 60.88 Min: 39 / Avg: 71.62 / Max: 78 Min: 40 / Avg: 71.85 / Max: 80 Min: 30 / Avg: 53.51 / Max: 59 Min: 33 / Avg: 54.15 / Max: 59
OpenFOAM CPU Temperature Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Celsius, Fewer Is Better OpenFOAM 10 CPU Temperature Monitor AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 36.75 / Avg: 54.3 / Max: 61.38 Min: 37.75 / Avg: 55.54 / Max: 62.63 Min: 51 / Avg: 70.16 / Max: 75 Min: 50 / Avg: 69.77 / Max: 75 Min: 39 / Avg: 54.29 / Max: 60 Min: 40 / Avg: 54.65 / Max: 60
SMHasher Hash: FarmHash32 x86_64 AVX EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org cycles/hash, Fewer Is Better SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX AVX-512 Off AVX-512 On 7 14 21 28 35 SE +/- 0.00, N = 5 SE +/- 0.16, N = 5 SE +/- 0.01, N = 4 SE +/- 0.02, N = 4 SE +/- 0.00, N = 4 SE +/- 0.00, N = 4 26.41 26.55 31.58 31.08 23.27 23.27 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -flto=auto -fno-fat-lto-objects
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 Off AVX-512 On 300 600 900 1200 1500 SE +/- 0.33, N = 3 SE +/- 1.20, N = 3 SE +/- 1.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 SE +/- 0.33, N = 3 705 581 1491 1308 980 859 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 Off AVX-512 On 5K 10K 15K 20K 25K SE +/- 8.39, N = 3 SE +/- 7.00, N = 3 SE +/- 42.81, N = 3 SE +/- 8.41, N = 3 SE +/- 37.53, N = 3 SE +/- 19.41, N = 3 11216 9260 23943 20872 15601 13589 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 Off AVX-512 On 10K 20K 30K 40K 50K SE +/- 50.78, N = 3 SE +/- 30.61, N = 3 SE +/- 10.69, N = 3 SE +/- 44.00, N = 3 SE +/- 69.83, N = 3 SE +/- 11.72, N = 3 22475 18500 48165 41834 31373 27204 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 Off AVX-512 On 400 800 1200 1600 2000 SE +/- 0.67, N = 3 SE +/- 0.33, N = 3 SE +/- 1.00, N = 3 SE +/- 0.00, N = 3 SE +/- 1.20, N = 3 SE +/- 0.33, N = 3 836 695 1770 1563 1170 1029 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 Off AVX-512 On 6K 12K 18K 24K 30K SE +/- 32.66, N = 3 SE +/- 3.79, N = 3 SE +/- 46.52, N = 3 SE +/- 18.50, N = 3 SE +/- 45.36, N = 3 SE +/- 25.54, N = 3 13341 11058 28490 24927 18608 16332 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 Off AVX-512 On 13K 26K 39K 52K 65K SE +/- 18.25, N = 3 SE +/- 44.52, N = 3 SE +/- 56.19, N = 3 SE +/- 4.98, N = 3 SE +/- 115.86, N = 3 SE +/- 45.83, N = 3 26541 22120 62780 49847 37300 32749 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -ldl
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On 0.4528 0.9056 1.3584 1.8112 2.264 SE +/- 0.002552, N = 9 SE +/- 0.003984, N = 9 SE +/- 0.002804, N = 9 SE +/- 0.001297, N = 9 SE +/- 0.006513, N = 9 SE +/- 0.001579, N = 9 1.736670 0.986214 1.992860 0.875196 2.012410 0.736822 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Mobile Neural Network Model: mobilenetV3 EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: mobilenetV3 AVX-512 Off AVX-512 On 0.875 1.75 2.625 3.5 4.375 SE +/- 0.049, N = 3 SE +/- 0.053, N = 9 SE +/- 0.022, N = 10 SE +/- 0.025, N = 15 SE +/- 0.012, N = 3 SE +/- 0.005, N = 3 3.889 3.866 1.764 1.709 2.288 2.055 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: squeezenetv1.1 EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: squeezenetv1.1 AVX-512 Off AVX-512 On 2 4 6 8 10 SE +/- 0.137, N = 3 SE +/- 0.219, N = 9 SE +/- 0.039, N = 10 SE +/- 0.064, N = 15 SE +/- 0.008, N = 3 SE +/- 0.072, N = 3 7.566 7.204 2.678 2.297 3.551 2.737 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: resnet-v2-50 EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: resnet-v2-50 AVX-512 Off AVX-512 On 6 12 18 24 30 SE +/- 0.300, N = 3 SE +/- 0.193, N = 9 SE +/- 0.099, N = 10 SE +/- 0.074, N = 15 SE +/- 0.060, N = 3 SE +/- 0.065, N = 3 24.081 14.727 18.133 7.909 17.716 8.496 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: SqueezeNetV1.0 EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: SqueezeNetV1.0 AVX-512 Off AVX-512 On 3 6 9 12 15 SE +/- 0.132, N = 3 SE +/- 0.234, N = 9 SE +/- 0.056, N = 10 SE +/- 0.080, N = 15 SE +/- 0.105, N = 3 SE +/- 0.082, N = 3 9.278 8.762 4.195 3.999 5.222 4.415 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On 0.3555 0.711 1.0665 1.422 1.7775 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.14 0.96 1.58 1.16 1.57 1.04 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On 7 14 21 28 35 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 7.71 4.34 11.41 4.49 30.91 19.31 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv
OpenVINO Model: Vehicle Detection FP16 - Device: CPU EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU AVX-512 Off AVX-512 On 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 12.64 6.46 19.68 17.83 17.29 8.01 1. (CXX) g++ options: -O3 -march=native -mno-amx-tile -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 50 100 150 200 250 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.69, N = 3 SE +/- 0.35, N = 3 SE +/- 0.84, N = 3 SE +/- 0.32, N = 3 187.35 155.91 217.10 175.69 226.27 141.14
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 20 40 60 80 100 SE +/- 0.04, N = 3 SE +/- 0.26, N = 3 SE +/- 0.17, N = 3 SE +/- 0.18, N = 3 SE +/- 0.06, N = 3 SE +/- 0.18, N = 3 95.17 79.50 105.26 87.87 102.61 68.43
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 2 4 6 8 10 SE +/- 0.0009, N = 3 SE +/- 0.0099, N = 3 SE +/- 0.0346, N = 3 SE +/- 0.0029, N = 3 SE +/- 0.0060, N = 3 SE +/- 0.0091, N = 3 4.8444 5.2240 8.8158 4.3750 5.3242 3.5509
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 16 32 48 64 80 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.18, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 67.90 48.70 73.75 47.82 71.93 40.14
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 13 26 39 52 65 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.20, N = 3 SE +/- 0.01, N = 3 32.40 29.20 59.42 49.51 46.97 36.94
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 200 400 600 800 1000 SE +/- 0.46, N = 3 SE +/- 2.80, N = 3 SE +/- 1.29, N = 3 SE +/- 3.51, N = 3 SE +/- 1.38, N = 3 SE +/- 0.76, N = 3 787.33 1128.85 916.94 819.53 887.59 648.20
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 5 10 15 20 25 SE +/- 0.0319, N = 3 SE +/- 0.0671, N = 3 SE +/- 0.0648, N = 3 SE +/- 0.0206, N = 3 SE +/- 0.0534, N = 3 SE +/- 0.0214, N = 3 13.9740 9.9667 21.7973 12.6264 21.3212 11.9378
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 60 120 180 240 300 SE +/- 0.35, N = 3 SE +/- 0.99, N = 13 SE +/- 1.34, N = 3 SE +/- 0.11, N = 3 SE +/- 0.30, N = 3 SE +/- 0.53, N = 3 194.72 135.99 251.57 180.17 257.56 168.23
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 4 8 12 16 20 SE +/- 0.1629, N = 15 SE +/- 0.1413, N = 15 SE +/- 0.0435, N = 3 SE +/- 0.0082, N = 3 SE +/- 0.0817, N = 3 SE +/- 0.1607, N = 15 9.1835 7.9604 14.3286 11.9769 11.7823 9.9734
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 40 80 120 160 200 SE +/- 0.05, N = 3 SE +/- 0.36, N = 3 SE +/- 0.40, N = 3 SE +/- 0.17, N = 3 SE +/- 0.14, N = 3 SE +/- 0.05, N = 3 144.89 118.35 161.33 125.16 147.46 101.04
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 13 26 39 52 65 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.09, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.17, N = 3 32.83 28.98 59.52 49.42 47.21 37.25
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 200 400 600 800 1000 SE +/- 0.15, N = 3 SE +/- 1.43, N = 3 SE +/- 2.25, N = 3 SE +/- 0.79, N = 3 SE +/- 2.38, N = 3 SE +/- 0.72, N = 3 787.72 1132.61 913.42 821.96 889.39 647.75
OpenFOAM Input: drivaerFastback, Medium Mesh Size - Mesh Time EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Mesh Time AVX-512 Off AVX-512 On 40 80 120 160 200 146.75 145.90 162.72 160.66 169.84 159.67 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenFOAM Input: drivaerFastback, Medium Mesh Size - Execution Time EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Execution Time AVX-512 Off AVX-512 On 80 160 240 320 400 110.95 112.38 358.63 361.37 194.79 195.48 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenFOAM Input: drivaerFastback, Large Mesh Size - Mesh Time EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Large Mesh Size - Mesh Time AVX-512 Off AVX-512 On 200 400 600 800 1000 867.38 996.78 887.21 1051.35 1039.32 847.91 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenFOAM Input: drivaerFastback, Large Mesh Size - Execution Time EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Large Mesh Size - Execution Time AVX-512 Off AVX-512 On 1500 3000 4500 6000 7500 2803.54 2849.61 7106.76 7117.01 4319.12 4305.12 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
Neural Magic DeepSparse CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 58.55 / Avg: 490.27 / Max: 722.41 Min: 58.49 / Avg: 475.62 / Max: 691.71 Min: 79.98 / Avg: 423.53 / Max: 591.06 Min: 116.32 / Avg: 423.16 / Max: 593.15 Min: 202.66 / Avg: 577.34 / Max: 773.65 Min: 213.45 / Avg: 574.76 / Max: 771.15
Neural Magic DeepSparse CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 60.72 / Avg: 532.23 / Max: 674.52 Min: 31.6 / Avg: 498.87 / Max: 641.77 Min: 122.8 / Avg: 469.84 / Max: 592.57 Min: 101.9 / Avg: 468.91 / Max: 551.9 Min: 203.11 / Avg: 619.84 / Max: 770.48 Min: 211.14 / Avg: 618.61 / Max: 769.39
Neural Magic DeepSparse CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 100 200 300 400 500 Min: 56.69 / Avg: 346.41 / Max: 397.2 Min: 58.85 / Avg: 324.27 / Max: 371.22 Min: 123.39 / Avg: 336.16 / Max: 377.19 Min: 118.87 / Avg: 330.83 / Max: 360.91 Min: 106.99 / Avg: 477.41 / Max: 537.73 Min: 209.97 / Avg: 483.39 / Max: 522.36
Neural Magic DeepSparse CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 32.8 / Avg: 552.07 / Max: 653.8 Min: 56.51 / Avg: 539.83 / Max: 646.46 Min: 130.88 / Avg: 488.76 / Max: 594.17 Min: 116.14 / Avg: 490.29 / Max: 592.28 Min: 207.09 / Avg: 636.05 / Max: 765.98 Min: 212.93 / Avg: 636.94 / Max: 774.46
Neural Magic DeepSparse CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 100 200 300 400 500 Min: 42.78 / Avg: 344.31 / Max: 430.71 Min: 60.73 / Avg: 336.08 / Max: 425.61 Min: 118.87 / Avg: 314.48 / Max: 389.2 Min: 115.91 / Avg: 309.32 / Max: 374.48 Min: 203.35 / Avg: 468.13 / Max: 563.99 Min: 106.45 / Avg: 468.4 / Max: 556.72
Neural Magic DeepSparse CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 60.66 / Avg: 500.64 / Max: 721.31 Min: 61.67 / Avg: 453.86 / Max: 632.57 Min: 121.91 / Avg: 423.91 / Max: 595.14 Min: 109.29 / Avg: 424.09 / Max: 596.7 Min: 205.49 / Avg: 579.26 / Max: 771.92 Min: 111.58 / Avg: 575.15 / Max: 772.59
Neural Magic DeepSparse CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 100 200 300 400 500 Min: 30.08 / Avg: 340.51 / Max: 417.91 Min: 61.86 / Avg: 340.27 / Max: 413.32 Min: 122.5 / Avg: 322.04 / Max: 389.14 Min: 83.01 / Avg: 313.16 / Max: 365.89 Min: 110.3 / Avg: 466.39 / Max: 569.05 Min: 214.75 / Avg: 471.13 / Max: 544.51
Neural Magic DeepSparse CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 32.05 / Avg: 494 / Max: 713.94 Min: 31.38 / Avg: 537.92 / Max: 712.89 Min: 124.13 / Avg: 437.31 / Max: 595.17 Min: 103.25 / Avg: 453.02 / Max: 598.46 Min: 211.06 / Avg: 598.84 / Max: 769.45 Min: 184.38 / Avg: 608.53 / Max: 775.32
Neural Magic DeepSparse CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 90 180 270 360 450 Min: 54.8 / Avg: 320.85 / Max: 377.94 Min: 32.99 / Avg: 316.15 / Max: 367.34 Min: 120.42 / Avg: 314.45 / Max: 351.47 Min: 114.08 / Avg: 296.11 / Max: 324.93 Min: 207.58 / Avg: 466.79 / Max: 528.2 Min: 110.94 / Avg: 442.49 / Max: 492.85
Neural Magic DeepSparse CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 33.52 / Avg: 555.47 / Max: 671.66 Min: 59.96 / Avg: 563.77 / Max: 673.82 Min: 121.41 / Avg: 485.92 / Max: 594.32 Min: 117.09 / Avg: 488.17 / Max: 595.98 Min: 212.95 / Avg: 636.84 / Max: 773.77 Min: 108.87 / Avg: 636.97 / Max: 776.52
Neural Magic DeepSparse CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 100 200 300 400 500 Min: 58.11 / Avg: 334.36 / Max: 425.46 Min: 56.93 / Avg: 328.16 / Max: 419.54 Min: 116.53 / Avg: 308.23 / Max: 388.94 Min: 116.85 / Avg: 307.49 / Max: 373.85 Min: 209.04 / Avg: 468.14 / Max: 560.62 Min: 206.44 / Avg: 463.48 / Max: 559.71
Neural Magic DeepSparse CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 45.38 / Avg: 492.05 / Max: 716.77 Min: 62.09 / Avg: 449.53 / Max: 626.83 Min: 120.76 / Avg: 424.25 / Max: 596.15 Min: 116.32 / Avg: 423.52 / Max: 596.26 Min: 179.48 / Avg: 575.96 / Max: 772.34 Min: 184.97 / Avg: 576.22 / Max: 776.65
LeelaChessZero CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better LeelaChessZero 0.28 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 130 260 390 520 650 Min: 55.77 / Avg: 381.66 / Max: 520.36 Min: 57.22 / Avg: 379.11 / Max: 511.65 Min: 117.5 / Avg: 395.29 / Max: 593.12 Min: 81.58 / Avg: 394.24 / Max: 583.5 Min: 207.43 / Avg: 534.64 / Max: 715.83 Min: 208.76 / Avg: 538.72 / Max: 765.81
LeelaChessZero CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better LeelaChessZero 0.28 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 130 260 390 520 650 Min: 58.03 / Avg: 372.74 / Max: 519.8 Min: 59.5 / Avg: 367.29 / Max: 503.22 Min: 124.39 / Avg: 390.39 / Max: 591.33 Min: 123.27 / Avg: 395.84 / Max: 585.79 Min: 207.21 / Avg: 535.98 / Max: 730.58 Min: 211.45 / Avg: 540.33 / Max: 766.98
Embree CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 130 260 390 520 650 Min: 26.98 / Avg: 343.25 / Max: 711.13 Min: 37.38 / Avg: 310.11 / Max: 703.12 Min: 101.95 / Avg: 400.96 / Max: 615.31 Min: 122.75 / Avg: 389.97 / Max: 625.41 Min: 205.64 / Avg: 537.44 / Max: 760.22 Min: 207.22 / Avg: 480.24 / Max: 708.89
Embree CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 130 260 390 520 650 Min: 42.7 / Avg: 366.77 / Max: 692.37 Min: 36.29 / Avg: 357.33 / Max: 701.32 Min: 80.21 / Avg: 421.57 / Max: 583.55 Min: 118.24 / Avg: 406.24 / Max: 561.45 Min: 172.58 / Avg: 565.19 / Max: 755.21 Min: 209.36 / Avg: 478.88 / Max: 665.78
OpenVKL CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better OpenVKL 1.3.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 60.18 / Avg: 488.95 / Max: 748.42 Min: 57.24 / Avg: 466.56 / Max: 706.65 Min: 101.07 / Avg: 456.78 / Max: 652.79 Min: 100.02 / Avg: 455.32 / Max: 653.28 Min: 183.35 / Avg: 599.21 / Max: 804.94 Min: 179.36 / Avg: 581.38 / Max: 785.63
Intel Open Image Denoise CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 130 260 390 520 650 Min: 55.38 / Avg: 291.64 / Max: 587.02 Min: 59.83 / Avg: 288.89 / Max: 584.26 Min: 117.02 / Avg: 351.27 / Max: 568.33 Min: 78.9 / Avg: 329.46 / Max: 563.85 Min: 190.83 / Avg: 446.72 / Max: 747.36 Min: 121.92 / Avg: 432.92 / Max: 757.14
Intel Open Image Denoise CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 130 260 390 520 650 Min: 30.85 / Avg: 328.65 / Max: 583.24 Min: 57.92 / Avg: 331.79 / Max: 581.42 Min: 81.25 / Avg: 374.67 / Max: 565.97 Min: 119.6 / Avg: 359.55 / Max: 567.51 Min: 204.01 / Avg: 487.71 / Max: 755.13 Min: 207.41 / Avg: 477.81 / Max: 753.94
OSPRay CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 56.53 / Avg: 614.11 / Max: 718.03 Min: 56.1 / Avg: 580.71 / Max: 668.08 Min: 119.36 / Avg: 524.83 / Max: 617.87 Min: 119.41 / Avg: 530.36 / Max: 641.9 Min: 107.51 / Avg: 689.16 / Max: 818.74 Min: 209.17 / Avg: 676.18 / Max: 801.55
OSPRay CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 57.79 / Avg: 616.9 / Max: 718.46 Min: 60.18 / Avg: 581.84 / Max: 672.96 Min: 133.04 / Avg: 523.63 / Max: 645.71 Min: 124.97 / Avg: 528.92 / Max: 632.61 Min: 206.88 / Avg: 688.18 / Max: 807.45 Min: 211.39 / Avg: 674.63 / Max: 797.32
OSPRay CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 61.53 / Avg: 624.39 / Max: 724.31 Min: 60.05 / Avg: 591.62 / Max: 680.48 Min: 122.95 / Avg: 530.21 / Max: 639.78 Min: 80.49 / Avg: 523.67 / Max: 629.96 Min: 205.85 / Avg: 679.41 / Max: 796.02 Min: 210.52 / Avg: 667.18 / Max: 772.19
OSPRay Studio CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 150 300 450 600 750 Min: 60.36 / Avg: 615.21 / Max: 792.28 Min: 60.79 / Avg: 611.59 / Max: 770.42 Min: 129.57 / Avg: 500.65 / Max: 657.6 Min: 102.33 / Avg: 497.27 / Max: 661.94 Min: 212.33 / Avg: 663.86 / Max: 880.6 Min: 178.24 / Avg: 661.77 / Max: 876.06
OSPRay Studio CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 150 300 450 600 750 Min: 61.33 / Avg: 648.16 / Max: 799.28 Min: 56.6 / Avg: 627.16 / Max: 783.63 Min: 129.76 / Avg: 497.33 / Max: 659.2 Min: 122.89 / Avg: 488.82 / Max: 662.51 Min: 206.26 / Avg: 650.1 / Max: 877.56 Min: 214.67 / Avg: 684.96 / Max: 875.35
OSPRay Studio CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 160 320 480 640 800 Min: 58.52 / Avg: 614.53 / Max: 802.45 Min: 32.83 / Avg: 631.84 / Max: 775.3 Min: 130.23 / Avg: 517.4 / Max: 652.59 Min: 101.37 / Avg: 511.05 / Max: 668.12 Min: 209.5 / Avg: 662.67 / Max: 884.59 Min: 114.26 / Avg: 669.91 / Max: 876.36
OSPRay Studio CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 150 300 450 600 750 Min: 60.27 / Avg: 620.19 / Max: 789.77 Min: 58.16 / Avg: 599.55 / Max: 773.94 Min: 81.76 / Avg: 503.22 / Max: 657.11 Min: 111.41 / Avg: 500.78 / Max: 666.67 Min: 212.51 / Avg: 666.51 / Max: 879.7 Min: 214.02 / Avg: 660.08 / Max: 874.86
OSPRay Studio CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 160 320 480 640 800 Min: 60.29 / Avg: 636.59 / Max: 798.92 Min: 37.81 / Avg: 629.17 / Max: 778.51 Min: 117.01 / Avg: 524.66 / Max: 656.47 Min: 100.35 / Avg: 499.04 / Max: 664.34 Min: 179.46 / Avg: 687.97 / Max: 887.42 Min: 107.88 / Avg: 652.2 / Max: 894.12
OSPRay Studio CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 150 300 450 600 750 Min: 31.18 / Avg: 618.56 / Max: 788.32 Min: 61.78 / Avg: 592.07 / Max: 769.69 Min: 123.88 / Avg: 460.86 / Max: 660.32 Min: 102.13 / Avg: 519.61 / Max: 662.67 Min: 180.6 / Avg: 673.37 / Max: 881.95 Min: 211.24 / Avg: 659.15 / Max: 861.5
oneDNN CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better oneDNN 3.0 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 150 300 450 600 750 Min: 56.11 / Avg: 241.2 / Max: 540.52 Min: 30.68 / Avg: 261.28 / Max: 580.04 Min: 117.63 / Avg: 306.45 / Max: 584.73 Min: 120.33 / Avg: 330.6 / Max: 647.31 Min: 210.1 / Avg: 417.66 / Max: 769.29 Min: 204.47 / Avg: 439.83 / Max: 838.42
Cpuminer-Opt CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 52.42 / Avg: 542.18 / Max: 637.99 Min: 59.62 / Avg: 597.99 / Max: 707.37 Min: 123.97 / Avg: 499.12 / Max: 602.56 Min: 114.85 / Avg: 498.71 / Max: 604.01 Min: 108.05 / Avg: 620.23 / Max: 772.37 Min: 205.47 / Avg: 650.33 / Max: 782.01
Cpuminer-Opt CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 57.41 / Avg: 592.73 / Max: 701.33 Min: 33.08 / Avg: 668.51 / Max: 793.29 Min: 75.22 / Avg: 497.3 / Max: 601.9 Min: 119.7 / Avg: 497.04 / Max: 601.36 Min: 221.38 / Avg: 627.27 / Max: 771.94 Min: 206.27 / Avg: 647.45 / Max: 782.3
Cpuminer-Opt CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 54.9 / Avg: 567.54 / Max: 675.79 Min: 32.24 / Avg: 633.49 / Max: 739.43 Min: 120.7 / Avg: 500.19 / Max: 602.54 Min: 79.08 / Avg: 496.99 / Max: 602.19 Min: 220 / Avg: 652.69 / Max: 740.32 Min: 206.88 / Avg: 646.74 / Max: 779.66
Cpuminer-Opt CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 60.23 / Avg: 554.51 / Max: 659.93 Min: 55.42 / Avg: 572.01 / Max: 668.33 Min: 118.75 / Avg: 495.69 / Max: 593.22 Min: 128.03 / Avg: 496.51 / Max: 596.23 Min: 137.07 / Avg: 654.01 / Max: 765.2 Min: 210.54 / Avg: 644.01 / Max: 768.58
Cpuminer-Opt CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 60.67 / Avg: 581.62 / Max: 686.17 Min: 31.65 / Avg: 584.57 / Max: 690.12 Min: 88.2 / Avg: 497.46 / Max: 601.66 Min: 71.69 / Avg: 496.96 / Max: 602.54 Min: 212.39 / Avg: 654.88 / Max: 782.5 Min: 202.83 / Avg: 651.38 / Max: 782.3
Cpuminer-Opt CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 53.17 / Avg: 581.88 / Max: 686.77 Min: 34.28 / Avg: 633.77 / Max: 745.91 Min: 118.62 / Avg: 498.92 / Max: 601.83 Min: 123.73 / Avg: 500.49 / Max: 601.47 Min: 224.85 / Avg: 654.66 / Max: 780.76 Min: 103.7 / Avg: 646.66 / Max: 782.6
Cpuminer-Opt CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 58.49 / Avg: 590.22 / Max: 704.35 Min: 31.53 / Avg: 651.92 / Max: 765.29 Min: 119.65 / Avg: 498.8 / Max: 602.02 Min: 123.8 / Avg: 498.26 / Max: 601.23 Min: 132.94 / Avg: 652.03 / Max: 781.58 Min: 205.28 / Avg: 651.11 / Max: 781.83
OpenVINO CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.3 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 30.32 / Avg: 579.7 / Max: 638.45 Min: 61.47 / Avg: 583.01 / Max: 643.67 Min: 120.36 / Avg: 516.2 / Max: 593.64 Min: 119.8 / Avg: 517.02 / Max: 593.95 Min: 225.78 / Avg: 674.16 / Max: 768.69 Min: 211.51 / Avg: 670.46 / Max: 768.59
OpenVINO CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.3 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 57.68 / Avg: 622.09 / Max: 684.99 Min: 57.77 / Avg: 594.48 / Max: 654.28 Min: 124.05 / Avg: 517.82 / Max: 584.06 Min: 127.49 / Avg: 518.52 / Max: 595.86 Min: 209.15 / Avg: 668.46 / Max: 770.95 Min: 211.57 / Avg: 667.99 / Max: 782.09
OpenVINO CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.3 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 54.82 / Avg: 604.27 / Max: 663.05 Min: 38.84 / Avg: 638.51 / Max: 699.19 Min: 121.86 / Avg: 518.5 / Max: 595.33 Min: 124.75 / Avg: 518.86 / Max: 596.78 Min: 208.74 / Avg: 674.93 / Max: 776.16 Min: 209.62 / Avg: 674 / Max: 775.31
miniBUDE CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better miniBUDE 20210901 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 140 280 420 560 700 Min: 50.93 / Avg: 335.56 / Max: 660.26 Min: 60.57 / Avg: 284.05 / Max: 711.18 Min: 112.89 / Avg: 447.53 / Max: 605.44 Min: 76.52 / Avg: 430.19 / Max: 621.53 Min: 204.3 / Avg: 549.62 / Max: 791.37 Min: 111.28 / Avg: 491.9 / Max: 790.45
miniBUDE CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better miniBUDE 20210901 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 150 300 450 600 750 Min: 54.45 / Avg: 530.15 / Max: 665.49 Min: 59.34 / Avg: 504.56 / Max: 653.44 Min: 114.01 / Avg: 512.58 / Max: 652.62 Min: 122.79 / Avg: 508.57 / Max: 665.4 Min: 109.04 / Avg: 612 / Max: 868.4 Min: 209.21 / Avg: 593.08 / Max: 864.78
OpenFOAM CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better OpenFOAM 10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 130 260 390 520 650 Min: 57.64 / Avg: 661.82 / Max: 737.11 Min: 61.7 / Avg: 659.15 / Max: 738.72 Min: 122.02 / Avg: 539.74 / Max: 590.97 Min: 102.2 / Avg: 540.67 / Max: 588.28 Min: 211.03 / Avg: 696.05 / Max: 761.31 Min: 210.74 / Avg: 695.05 / Max: 754.74
OpenFOAM CPU Power Consumption Monitor EPYC 9654 Xeon 8380 Xeon 8490H OpenBenchmarking.org Watts, Fewer Is Better OpenFOAM 10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 130 260 390 520 650 Min: 58.28 / Avg: 650.61 / Max: 748.65 Min: 62.76 / Avg: 655.07 / Max: 742.42 Min: 127.05 / Avg: 547.75 / Max: 588.4 Min: 129.82 / Avg: 547.41 / Max: 588.74 Min: 208.95 / Avg: 709.42 / Max: 767.54 Min: 214.57 / Avg: 709.53 / Max: 762.94
Phoronix Test Suite v10.8.4