2023 Tests Benchmarks for a future article. 2 x AMD EPYC 7343 16-Core testing with a Supermicro H12DSi-N6 v1.02 (2.3 BIOS) and astdrmfb on AlmaLinux 9.1 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2305035-PTS-UPEARLY506&grr&sro .
2023 Tests Processor Motherboard Memory Disk Graphics Monitor OS Kernel Compiler File-System Screen Resolution EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P AMD EPYC 7343 16-Core @ 3.20GHz (16 Cores / 32 Threads) Supermicro H12SSL-i v1.02 (2.4 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07 astdrmfb DELL E207WFP AlmaLinux 9.1 5.14.0-162.12.1.el9_1.x86_64 (x86_64) GCC 11.3.1 20220421 ext4 1680x1050 2 x AMD EPYC 7343 16-Core @ 3.20GHz (32 Cores / 64 Threads) Supermicro H12DSi-N6 v1.02 (2.3 BIOS) 16 x 32 GB DDR4-3200MT/s Samsung M393A4K40EB3-CWE 5.14.0-162.18.1.el9_1.x86_64 (x86_64) 1280x1024 AMD EPYC 7413 24-Core @ 2.65GHz (24 Cores / 48 Threads) Supermicro H12SSL-i v1.02 (2.4 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 5.14.0-162.12.1.el9_1.x86_64 (x86_64) 1024x768 2 x AMD EPYC 7413 24-Core @ 2.65GHz (48 Cores / 96 Threads) Supermicro H12DSi-N6 v1.02 (2.3 BIOS) 512GB 5.14.0-162.18.1.el9_1.x86_64 (x86_64) AMD EPYC 7513 32-Core @ 2.60GHz (32 Cores / 64 Threads) Supermicro H12SSL-i v1.02 (2.4 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 5.14.0-162.12.1.el9_1.x86_64 (x86_64) 2 x AMD EPYC 7513 32-Core @ 2.60GHz (64 Cores / 128 Threads) Supermicro H12DSi-N6 v1.02 (2.3 BIOS) 512GB 5.14.0-162.18.1.el9_1.x86_64 (x86_64) AMD EPYC 7543 32-Core @ 2.80GHz (32 Cores / 64 Threads) Supermicro H12SSL-i v1.02 (2.4 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE DELL E207WFP 5.14.0-162.12.1.el9_1.x86_64 (x86_64) 1680x1050 AMD EPYC 7713P 64-Core @ 2.00GHz (64 Cores / 128 Threads) 1024x768 Intel Xeon Gold 6338 @ 3.20GHz (32 Cores / 64 Threads) Supermicro X12SPO-NTF v2.00 (1.2 BIOS) DELL E207WFP 1280x1024 2 x Intel Xeon Gold 6338 @ 3.20GHz (64 Cores / 128 Threads) Supermicro X12DPi-N6 v1.01 (1.4 BIOS) 16 x 32 GB DDR4-3200MT/s Samsung M393A4K40EB3-CWE Intel Xeon Gold 6342 @ 3.50GHz (24 Cores / 48 Threads) Supermicro X12SPO-NTF v2.00 (1.2 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 2 x Intel Xeon Gold 6342 @ 3.50GHz (48 Cores / 96 Threads) Supermicro X12DPi-N6 v1.01 (1.4 BIOS) 16 x 32 GB DDR4-3200MT/s Samsung M393A4K40EB3-CWE Intel Xeon Gold 6346 @ 3.60GHz (16 Cores / 32 Threads) Supermicro X12SPO-NTF v2.00 (1.2 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 2 x Intel Xeon Gold 6346 @ 3.60GHz (32 Cores / 64 Threads) Supermicro X12DPi-N6 v1.01 (1.4 BIOS) 16 x 32 GB DDR4-3200MT/s Samsung M393A4K40EB3-CWE 1024x768 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: always Compiler Details - --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl Processor Details - EPYC 7343: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7343 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7413: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7413 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7513: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7513 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7543: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7713P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - Xeon Gold 6338: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 - Xeon Gold 6338 2P: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 - Xeon Gold 6342: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 - Xeon Gold 6342 2P: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 - Xeon Gold 6346: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 - Xeon Gold 6346 2P: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 Java Details - OpenJDK Runtime Environment (Red_Hat-11.0.18.0.10-2.el9_1) (build 11.0.18+10-LTS) Python Details - Python 3.9.14 Security Details - EPYC 7343: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7343 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7413: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7413 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7513: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7513 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7543: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7713P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6338: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6338 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6342: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6342 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6346: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6346 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
2023 Tests cloudsuite-da: 512 tensorflow: CPU - 512 - ResNet-50 cloudsuite-da: 256 nwchem: C240 Buckyball tensorflow: CPU - 256 - ResNet-50 incompact3d: X3D-benchmarking input.i3d cloudsuite-da: 128 tensorflow: CPU - 512 - GoogLeNet blender: Barbershop - CPU-Only pgbench: 1000 - 800 - Read Only - Average Latency pgbench: 1000 - 800 - Read Only cloudsuite-da: 64 pgbench: 1000 - 1000 - Read Only - Average Latency pgbench: 1000 - 1000 - Read Only cloudsuite-ws: 500 cloudsuite-ga: Triangle Count graph500: 26 graph500: 26 graph500: 26 graph500: 26 pgbench: 1000 - 1000 - Read Write - Average Latency pgbench: 1000 - 1000 - Read Write pgbench: 1000 - 800 - Read Write - Average Latency pgbench: 1000 - 800 - Read Write build-llvm: Unix Makefiles cloudsuite-ws: 400 cloudsuite-da: 32 tensorflow: CPU - 256 - GoogLeNet ffmpeg: libx264 - Upload ffmpeg: libx264 - Upload build-gem5: Time To Compile clickhouse: 100M Rows Hits Dataset, Third Run clickhouse: 100M Rows Hits Dataset, Second Run clickhouse: 100M Rows Hits Dataset, First Run / Cold Cache tensorflow: CPU - 512 - AlexNet cloudsuite-da: 8 build-nodejs: Time To Compile build-llvm: Ninja openradioss: INIVOL and Fluid Structure Interaction Drop Container cloudsuite-da: 4 cloudsuite-ma: Large ffmpeg: libx264 - Video On Demand ffmpeg: libx264 - Video On Demand ffmpeg: libx264 - Platform ffmpeg: libx264 - Platform ffmpeg: libx265 - Video On Demand ffmpeg: libx265 - Video On Demand ffmpeg: libx265 - Platform ffmpeg: libx265 - Platform ffmpeg: libx265 - Upload ffmpeg: libx265 - Upload openssl: SHA256 hpcg: nekrs: TurboPipe Periodic memcached: 1:100 openradioss: Bird Strike on Windshield rocksdb: Seq Fill ospray-studio: 3 - 4K - 32 - Path Tracer onednn: Recurrent Neural Network Inference - f32 - CPU tensorflow: CPU - 256 - AlexNet vvenc: Bosphorus 4K - Fast rocksdb: Read While Writing ospray-studio: 3 - 4K - 1 - Path Tracer ospray-studio: 1 - 4K - 32 - Path Tracer blender: Classroom - CPU-Only ospray-studio: 1 - 4K - 1 - Path Tracer onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPU memcached: 1:5 cassandra: Writes memcached: 1:10 onednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPU cloudsuite-ws: 100 cloudsuite-ga: Connected Components svt-hevc: 1 - Bosphorus 4K onednn: Recurrent Neural Network Training - f32 - CPU gpaw: Carbon Nanotube rocksdb: Rand Fill rocksdb: Update Rand nginx: 500 nginx: 200 openradioss: Bumper Beam openradioss: Rubber O-Ring Seal Installation luxcorerender: LuxCore Benchmark - CPU cloudsuite-ga: Page Rank nginx: 1000 rocksdb: Read Rand Write Rand rocksdb: Rand Fill Sync cloudsuite-ma: Small nginx: 100 vvenc: Bosphorus 4K - Faster openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU luxcorerender: Danish Mood - CPU openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU ffmpeg: libx265 - Live ffmpeg: libx265 - Live luxcorerender: Orange Juice - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU vvenc: Bosphorus 1080p - Fast openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openssl: RSA4096 openssl: RSA4096 deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream rocksdb: Rand Read deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream build-linux-kernel: defconfig deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream onednn: IP Shapes 1D - f32 - CPU svt-av1: Preset 4 - Bosphorus 4K uvg266: Bosphorus 4K - Slow build-godot: Time To Compile blender: BMW27 - CPU-Only openradioss: Cell Phone Drop Test gromacs: MPI CPU - water_GMX50_bare uvg266: Bosphorus 4K - Medium ffmpeg: libx264 - Live ffmpeg: libx264 - Live deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream incompact3d: input.i3d 193 Cells Per Direction deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream namd: ATPase Simulation - 327,506 Atoms onednn: Matrix Multiply Batch Shapes Transformer - f32 - CPU kvazaar: Bosphorus 4K - Medium luxcorerender: Rainbow Colors and Prism - CPU luxcorerender: DLSC - CPU phpbench: PHP Benchmark Suite vvenc: Bosphorus 1080p - Faster svt-vp9: VMAF Optimized - Bosphorus 4K onednn: Deconvolution Batch shapes_1d - f32 - CPU kvazaar: Bosphorus 4K - Ultra Fast kvazaar: Bosphorus 4K - Super Fast pennant: sedovbig x265: Bosphorus 4K onednn: IP Shapes 1D - bf16bf16bf16 - CPU onednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPU cloudsuite-da: 1 onednn: IP Shapes 3D - f32 - CPU embree: Pathtracer ISPC - Crown embree: Pathtracer - Crown embree: Pathtracer - Asian Dragon build-apache: Time To Compile kvazaar: Bosphorus 4K - Very Fast uvg266: Bosphorus 4K - Very Fast uvg266: Bosphorus 4K - Super Fast embree: Pathtracer ISPC - Asian Dragon uvg266: Bosphorus 1080p - Slow uvg266: Bosphorus 4K - Ultra Fast lulesh: svt-av1: Preset 8 - Bosphorus 4K minibude: OpenMP - BM1 minibude: OpenMP - BM1 uvg266: Bosphorus 1080p - Medium pennant: leblancbig svt-vp9: PSNR/SSIM Optimized - Bosphorus 4K onednn: Convolution Batch Shapes Auto - f32 - CPU svt-vp9: Visual Quality Optimized - Bosphorus 4K svt-hevc: 7 - Bosphorus 4K svt-hevc: 10 - Bosphorus 4K svt-av1: Preset 12 - Bosphorus 4K deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream uvg266: Bosphorus 1080p - Super Fast uvg266: Bosphorus 1080p - Very Fast onednn: IP Shapes 3D - bf16bf16bf16 - CPU deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream svt-av1: Preset 13 - Bosphorus 4K uvg266: Bosphorus 1080p - Ultra Fast onednn: Deconvolution Batch shapes_3d - f32 - CPU onednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPU onednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPU onednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPU wrf: conus 2.5km EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 89452 22.91 25186 5397.8 22.37 880.639262 101630 63.82 815.39 1.150 695761 19072 1.459 685239 11.6 108988 312989000 149710000 114295000 309817000 40.294 24821 31.158 25679 392.194 11.833 18906 64.03 12.68 199.10 267.883 345.53 346.00 336.88 142.79 19259 337.220 347.363 352.52 19011 122575 48.75 155.37 48.73 155.46 49.82 152.05 49.89 151.85 24.29 103.96 24891101267 18.1367 1610909.22 218.07 265238 138.96 4.310 8172 224298 219.83 6805 2199582.80 172713 2548333.19 7.333 15718 3.79 118.30 103.03 2.72 11525 13995 9.370 2790.52 2.84 2813.45 2.82 2.48 1850.23 4.27 123.76 40.81 5.05 854.22 9.36 10.496 162.40 49.20 12.37 646.15 12.22 654.14 19.76 404.56 1.11 14256.40 17.50 913.75 20.51 389.71 1.21 13149.71 287549.0 4398.6 450.6033 17.7432 152.8306 52.2641 629.1859 12.6466 48.8605 163.5554 627.6853 12.6201 63.491 148.9584 53.5991 3.444 9.26 74.949 82.60 66.29 10.42 217.86 23.18 75.4144 105.9576 35.5556106 55.4127 144.2282 1.14340 14.94 12.12 732752 25.092 111.82 53.29 41.24 26.92807 24.86 18792 20.0067 21.2170 23.7647 17.698 32.35 28.94 30.00 23.0613 38.52 35.28 10323.176 48.378 43.11 16.69242 115.80 83.73 71.41 143.45 179.068 116.79 110.98 172.161 130.30 1306974 25.43 977380 24.03 484.985402 870117 71.90 435.02 0.935 855642 915672 1.178 849019 11.217 77278 444474000 218986000 174219000 422529000 119.682 8356 94.590 8492 240.493 11.433 1025584 70.56 12.74 198.235232573 443.72 443.07 423.79 147.17 1338669 190.997 190.969 1314712 147944 48.74 155.42 48.75 155.38 46.84 161.72 46.66 162.339168912 23.56 107.19 49694000047 35.3196 166901000000 2373328.37 323598 142611 1837.89 143.84 4.899 4864299 4336 120264 109.64 3628 2900.06 2421891.74 236544 2826219.16 1754.12 5.55 14547 7.28 2958.98 444.071 316199 481479 157128.24 155325.61 4.46 9820 151418.97 2195191 170828 46059 146481.53 10.051 1445.13 5.53 1447.06 5.52 4.10 1028.98 7.76 103.93 48.59 8.59 423.55 18.85 11.054 84.87 94.18 7.05 1132.27 6.42 1243.24 10.13 788.14 1.14 27742.34 16.53 1934.07 10.88 734.99 1.23 25795.58 574456.9 8794.6 475.8713 33.4196 164.1407 97.1983 181223940 636.2769 24.9183 56.9767 280.4317 634.7296 25.0243 38.974 152.1486 104.8912 1.66142 3.779 14.89 41.30 4.083 16.78 215.69 23.41 77.3427 206.5323 18.0244586 55.5978 287.1813 0.59260 8.35869 22.50 13.03 5.74 735624 24.194 152.31 6.26194 63.34 57.13 13.47434 23.06 58173 3.09624 35.4898 37.7503 38.9667 18.218 45.86 41.20 42.95 38.0109 43.92 46.65 27713.943 66.077 55.936 1398.411 49.15 7.618046 158.14 1.18840 130.23 116.56 191.99 204.549 142.78 134.43 191.017 155.33 2.82788 1296994 24.16 1263825 4463.3 23.43 766.720540 1324795 65.67 616.51 0.877 912427 1296065 1.131 884213 14.583 84114 38.970 25674 33.213 24251 320.942 14.733 1326319 65.49 11.77 214.55 229.595 360.64 363.28 351.34 150.98 1265492 270.840 275.254 291.34 874335 124002 45.33 167.10 45.39 166.90 47.31 160.13 47.38 159.89 23.21 108.80 33095407800 17.8487 112350333333 2309617.42 201.13 821279 200057 1070.14 144.99 4.415 4117643 6067 170190 165.39 5121 1795.39 2917560.70 224875 3431617.24 1073.72 7.583 14011 4.89 1797.92 740490 638378 131406.38 129033.29 105.44 88.65 3.68 9815 129682.72 2369439 199221 23575 127405.11 9.431 3275.51 3.61 3280.27 3.59 3.33 2183.99 5.44 117.23 43.08 6.56 979.21 12.17 10.188 197.58 60.67 15.57 769.91 14.38 833.99 23.18 517.32 1.27 18711.92 19.80 1211.31 25.03 479.00 1.39 17211.28 390326.3 5947.9 515.0566 23.2903 178.2114 67.2045 120400741 729.3104 16.3219 53.0316 226.0494 729.0602 16.3700 52.718 170.1636 70.4128 1.75252 3.496 10.54 64.734 62.03 54.23 3.005 11.87 202.95 24.88 86.0790 139.2719 32.3950857 62.1975 192.6805 0.88677 2.35438 16.10 15.11 670928 24.360 140.28 4.70749 55.36 43.02 21.41936 27.01 58158 2.79700 25.8301 27.4240 31.8965 18.992 33.41 31.30 33.10 30.4535 38.45 38.88 9682.7993 58.920 36.074 901.850 43.27 12.95789 143.85 2.13731 107.77 85.67 181.39 210.554 91.6820 125.26 118.56 130.7157 195.798 138.79 3.28030 1447278 25.36 1456236 24.04 700.101786 1393156 71.43 330.02 1.051 765090 1462648 1.377 728184 12.083 74003 601120000 294782000 225284000 584034000 102.073 9798 91.602 8736 216.184 11.967 1337500 70.39 11.71 215.59 440.92 437.50 429.39 146.48 1386712 165.471 161.530 928018 225855 44.94 168.57 44.82 169.02 43.84 172.81 43.80 172.96 22.07 114.41 66206231957 27.6326 194221666667 2952893.82 286858 110558 1604.83 143.50 4.658 6957204 3252 93834 82.55 2722 2840.00 2164592.24 225784 3691244.97 1602.68 5.3 14426 9.18 2774.02 417.506 306931 336131 133788.29 135890.54 5.56 9831 2190994 165480 111224 144891.45 9.526 1688.62 7.01 1689.48 7.01 5.14 1190.68 10.06 98.37 51.34 11.24 483.37 24.72 10.393 100.17 119.68 9.12 1313.76 7.63 1570.38 11.70 1024.68 1.30 36411.01 18.66 2570.67 14.07 852.08 1.4 34019.21 778483.0 11846.8 544.6158 43.9125 187.6814 127.5406 238439429 738.7817 32.2500 62.3607 384.2896 739.7624 32.2535 33.819 174.6170 137.0417 2.19750 3.510 16.00 31.80 4.820 18.06 200.05 25.24 88.6308 270.2740 15.6894077 64.7191 370.1937 0.47053 9.13000 23.20 15.73 7.17 680136 23.346 154.60 7.89700 64.72 61.75 10.79851 22.13 61767 4.00035 46.5974 49.9496 48.3491 20.996 48.93 45.98 48.07 46.2930 59.52 49.77 25716.768 65.954 68.757 1718.936 66.47 5.976653 161.19 0.940455 145.30 136.95 208.59 217.432 163.18 164.25 193.778 165.33 1.88334 1380314 24.66 1288469 3660.2 23.77 784.797160 1378719 70.20 482.82 0.822 984394 1315834 1.024 976332 15.267 77893 528200000 226239000 176371000 517810000 72.399 13865 58.070 13777 282.423 14.883 1282987 69.02 11.97 211.010138953 210.643 379.67 377.03 362.00 156.46 1323129 226.631 230.689 245.34 1295214 134575 46.04 164.52 46.16 164.12 47.73 158.71 47.61 159.12 23.35 108.16 42284954430 17.6803 128904333333 2981451.32 186.94 864802 159097 1109.99 151.07 4.582 5130684 4769 135636 130.35 4014 1975.47 3632495.02 263627 4198464.11 1124.53 7.417 13102 6.22 1957.83 809625 707656 159784.56 160998.23 96.53 84.32 4.64 9917 156398.74 2750066 238127 36808 152248.92 9.736 3561.39 4.44 3537.87 4.45 4.35 2369.52 6.67 118.65 42.56 8.18 1038.36 15.29 10.350 212.22 75.28 16.18 987.77 14.86 1076.30 24.55 651.20 1.37 23116.82 21.03 1520.46 26.50 603.36 1.49 21308.51 501938.9 7637.8 546.2807 29.2692 193.4699 82.5527 150974278 791.9745 19.8959 56.3260 283.7118 792.4571 19.9788 44.751 183.7170 86.9371 1.59445 3.669 13.43 57.582 49.24 45.63 3.547 15.10 207.35 24.35 92.5433 172.7305 30.7356491 66.4697 240.4095 0.71585 2.32302 20.33 17.44 678084 24.712 161.26 4.64782 62.27 52.81 17.88689 28.24 58645 3.63115 33.1430 34.1845 40.2107 18.861 42.32 39.52 41.46 38.3505 40.52 46.07 18098.804 66.633 47.103 1177.571 45.60 10.83575 164.17 1.95016 129.22 111.95 207.54 231.540 113.8532 138.95 129.79 140.2311 210.235 153.97 3.17840 1425667 23.96 974407 22.75 432.073659 1030733 63.68 262.94 1.178 690019 910021 1.569 638731 11.817 70042 691983000 322475000 255036000 665655000 93.903 10651 97.517 8552 199.575 11.2 1118115 62.34 11.99 210.67 435.85 436.77 412.09 144.20 1397332 143.597 140.277 905105 301630 45.95 164.86 46.08 164.38 44.16 171.53 44.19 171.41 22.20 113.72 84365767223 34.5344 218603000000 3518612.74 299732 86704 1606.42 141.81 4.688 8063050 2538 74566 64.96 2150 5033.87 1867112.74 245226 4105338.27 1615.13 5.417 13891 11.56 5074.57 398.988 328435 351517 140932.43 151573.48 6.75 9587 135921.70 2204871 197227 181349 9.445 1803.09 8.82 1804.95 8.81 6.43 1272.58 12.55 101.05 49.98 13.40 507.62 31.43 10.329 105.07 152.10 9.32 1713.90 7.62 2097.59 13.32 1196.03 1.39 45746.27 19.64 3255.75 13.62 1173.42 1.50 42487.49 1003089.4 15222.3 575.3658 55.4706 204.2260 156.2377 299129297 803.4468 39.5929 65.3924 488.6254 802.1569 39.6557 29.784 187.5171 170.2562 2.66698 3.604 17.26 25.46 5.589 19.59 206.46 24.46 95.0848 335.9890 15.8133430 68.1249 468.9263 0.36716 12.28794 25.02 17.44 9.12 686597 22.956 163.58 10.00962 65.39 63.53 8.761462 22.65 62262 4.26599 58.9004 62.3560 53.8116 19.699 54.13 51.05 51.46 51.9364 63.00 53.21 37170.855 71.454 93.350 2333.755 70.75 4.827648 165.46 0.786803 148.84 149.01 201.76 217.701 173.74 173.58 193.151 175.35 2.04048 1307991 26.26 1332491 3488.4 25.34 716.618001 1337915 73.86 456.27 0.745 1074765 1312741 0.991 1008741 13.05 74250 554082000 268016000 204519000 544342000 83.024 12068 67.538 11845 260.908 13.8 1356145 72.46 12.02 210.02 198.426 425.48 425.45 410.64 160.32 1279022 209.943 212.302 224.14 1252851 130123 46.70 162.21 46.55 162.71 47.82 158.41 47.87 158.24 23.40 107.90 44324823090 19.3385 149115333333 2848831.24 173.03 774765 148990 1106.75 155.25 4.724 5147499 4486 127078 122.97 3767 1989.75 3574540.35 246339 3481927.79 1092.81 6.583 13358 6.69 1974.31 743355 688172 165787.42 161270.01 93.97 79.17 4.74 9247 165810.67 2690298 233743 37315 147786.59 9.984 3186.87 4.95 3217.57 4.94 4.36 2162.68 7.32 113.57 44.47 8.42 961.41 16.56 10.555 190.87 83.73 14.37 1112.62 13.70 1166.69 22.30 716.95 1.27 25079.41 19.63 1628.99 23.66 675.88 1.37 23118.27 522787.3 7963.1 507.6631 31.3942 174.3602 91.5684 161712224 716.0241 22.0707 54.3162 294.2079 716.1195 22.1183 42.087 169.9349 93.9657 1.49498 3.635 14.00 55.114 46.24 41.25 4.001 15.77 211.67 23.86 85.8688 186.0887 24.1082433 62.2907 256.5235 0.65554 4.31859 21.04 16.69 687000 24.844 171.65 4.86899 63.28 54.27 15.39717 27.63 59400 2.02266 35.1162 37.2804 41.9519 18.834 43.25 40.67 42.81 40.5096 41.09 47.24 21129.412 67.153 50.458 1261.441 46.14 8.575596 175.18 1.30138 137.52 119.84 219.43 237.131 124.1286 139.65 130.26 128.6660 214.387 154.38 2.98900 1296643 21.85 1321064 2799.5 20.70 663.825195 1377599 60.82 297.72 0.963 835087 1353066 1.386 721335 15.283 70089 715154000 288959000 227175000 691348000 64.500 15683 65.348 12245 225.698 13.267 952995 58.23 12.02 210.12 190.758 380.10 375.36 365.79 136.28 1351560 166.988 163.543 191.58 1318693 250115 46.35 163.44 46.36 163.38 43.46 174.28 43.44 174.39 21.32 118.46 69715833097 19.0558 170229333333 3893409.95 167.45 452291 98653 1183.30 130.65 4.455 7932933 2874 84001 79.30 2424 2712.50 3378044.12 253058 4786407.25 1186.00 7.1 13169 9.79 2720.07 455327 436633 156012.00 167224.22 91.55 89.74 6.70 9112 151997.72 2761836 267282 136721 9.110 4538.43 6.92 4533.12 6.92 6.10 3072.39 10.33 105.50 47.87 12.44 1279.15 24.81 9.553 274.66 116.30 20.72 1542.73 18.42 1735.57 30.95 1033.39 1.74 34339.21 25.83 2475.95 34.00 940.29 1.9 33271.17 823388.7 12568.1 684.8470 46.6790 241.3333 132.2972 246464521 1010.0008 31.4455 70.2051 455.1184 1010.5833 31.4000 33.746 230.9178 138.1362 2.04640 3.421 13.99 50.802 30.36 36.39 5.098 15.71 208.64 24.20 117.4838 271.8806 23.0942440 86.4635 369.5420 0.45591 6.48681 19.03 18.73 678966 22.513 172.24 6.94903 57.99 50.67 11.31944 27.16 60941 3.78466 51.6795 52.7477 62.5656 20.388 41.59 42.56 45.49 60.0978 56.07 48.31 22242.530 67.308 76.510 1912.744 61.66 6.246704 179.74 0.937918 146.48 138.52 224.80 231.997 177.6432 180.55 168.38 179.6763 203.194 196.33 3.25137 93771 68.38 43513 4747.9 68.08 626.976115 121626 205.17 604.76 0.712 1123663 20909 0.927 1078586 13.317 93231 519294000 213096000 168374000 510587000 44.552 22446 35.995 22228 323.073 12.383 20822 203.92 10.21 247.388378655 244.251 325.93 325.13 311.11 489.77 20809 272.730 268.944 287.21 20697 163851 39.44 192.08 39.45 192.02 42.08 180.03 41.92 180.71 20.59 122.64 20888915973 19.8931 127809333333 2937926.06 207.10 1269946 133650 521.572 475.07 3.776 4793137 3967 113149 161.50 3314 907.291 4271575.65 176284 4262554.19 520.564 7.517 14285 4.4 901.436 1088420 793742 160307.52 160541.79 111.00 108.37 3.67 11245 164486.94 2770547 297029 36646 151274.54 7.981 2962.18 5.36 3023.56 5.26 3.47 1771.70 8.96 112.80 44.77 7.01 450.58 35.43 8.394 142.53 112.12 17.77 899.05 9.61 1661.48 35.34 904.01 1.23 25216.38 9.55 3345.71 33.19 481.60 1.38 22808.14 419447.9 6442.7 471.6297 33.8978 173.2014 92.2695 113495056 855.9968 18.6692 44.1261 362.2935 855.7781 18.6943 51.838 191.3088 83.6220 1.39521 3.034 9.76 69.243 59.55 59.09 3.717 10.88 178.82 28.24 92.0537 173.7712 33.0038337 49.9551 320.0058 0.70215 0.521446 13.69 13.20 719675 20.147 143.42 4.48936 38.52 33.71 30.86947 25.70 3.34833 3.88765 20565 1.64248 35.8362 29.8397 35.9078 22.423 27.47 26.79 28.50 45.7947 28.13 31.67 18868.723 56.031 40.411 1010.277 31.35 14.44702 148.73 1.71129 111.92 91.70 171.63 194.141 94.98 87.55 1.81562 176.036 105.96 1.92380 7.86162 5.74487 7.88371 29960 74.68 34651 3009.9 73.49 357.235290 122135 257.04 302.14 1.066 750218 21632 1.348 754104 9.6 78150 667982000 295010000 238460000 655675000 51.774 19322 40.942 19540 227.371 11.933 21685 253.31 10.09 250.35 199.485 407.09 405.08 388.39 575.90 21431 168.425 160.399 199.83 21284 287528 38.64 196.032349446 38.74 195.55 41.63 181.97 41.89 180.82 20.89 120.86 42653381293 39.1363 242295666667 2802626.26 162.88 488659 69538 472.891 547.55 4.045 7436444 1979 52646 80.17 1641 690.752 3270779.44 156487 3551712.12 457.949 7.35 14751 8.25 681.159 481703 466697 180812.11 205570.62 91.34 89.85 6.57 11235 178255.95 2579926 307133 147653 8.128 1467.67 10.84 1495.92 10.63 6.09 862.09 18.48 111.60 45.25 12.30 217.18 73.58 8.721 78.16 204.17 9.85 1619.83 4.69 3402.82 35.12 1813.34 1.16 54275.42 8.86 7209.16 17.01 939.07 1.32 47801.07 838351.8 12874.9 488.4066 65.2131 179.8852 177.5939 226944746 847.3755 37.6996 45.3578 704.9499 848.9104 37.6297 33.036 190.8367 167.3832 1.66443 3.049 12.56 54.704 29.66 37.73 7.379 14.12 173.30 29.14 92.6396 345.1816 14.6863581 49.9661 639.7687 0.35502 0.255235 17.63 11.33 722240 20.641 137.47 6.56164 43.33 41.44 19.64620 24.42 3.67592 10.56278 21324 2.40282 69.5889 58.3269 67.1266 22.114 36.47 36.01 37.22 84.8635 44.48 38.92 39798.691 63.096 80.389 2009.716 49.39 7.347379 144.22 2.46627 131.90 128.72 176.67 201.074 133.13 131.93 1.88632 180.919 136.60 1.14313 4.33315 2.92655 5.02585 80304 62.18 27079 4925.4 61.90 659.145325 104512 191.35 680.31 0.813 983473 18776 1.078 927858 15.433 87786 39.409 25377 32.842 24360 346.264 14.7 18923 189.89 11.11 227.36 244.566 325.08 321.66 312.11 432.47 18852 295.587 292.729 301.70 18674 140252 42.77 177.11 42.81 176.95 45.28 167.31 45.13 167.86 22.21 113.70 20256398000 18.8044 117791000000 2842403.96 204.18 1443216 152061 642.826 410.32 4.093 3825346 4621 127865 176.55 3769 1076.71 4068619.97 200958 4053902.81 638.132 7.517 13542 4.09 1086.78 1272718 743700 141031.60 141544.55 110.30 107.07 3.29 10340 153700.70 2420422 277553 21960 140495.61 8.830 2358.37 5.03 2400.77 4.95 3.04 1413.05 8.43 122.36 41.27 6.46 360.49 33.22 9.153 116.82 102.67 14.78 810.68 7.75 1544.95 28.09 853.15 1.05 22510.58 7.75 3090.28 26.68 449.39 1.19 20000.76 398769.3 6109.7 386.8811 31.0113 144.3061 83.0341 104010467 689.6754 17.3928 40.6830 294.7603 690.2354 17.3843 55.485 158.5557 75.6723 1.47649 3.209 9.37 70.288 64.90 62.82 3.376 10.51 193.69 26.07 76.1206 157.5969 33.3006439 41.8063 286.8784 0.75173 0.587102 13.17 13.77 788731 22.274 141.68 3.28994 42.41 34.35 31.83193 27.77 4.48183 2.80481 18581 1.66931 29.1748 25.3454 31.0113 20.239 27.03 26.65 28.82 40.9761 33.02 33.30 9964.4105 59.414 35.561 889.014 37.08 15.69182 148.12 1.82190 109.31 85.66 173.16 206.814 106.29 98.13 2.22071 190.736 118.47 1.99051 8.61404 6.03750 8.29712 31922 66.12 34180 2846.4 66.43 461.110891 99997 234.54 342.37 0.953 850161 19706 1.176 851464 12.717 73459 45.177 22138 36.483 21929 220.500 11.7 19751 231.32 10.96 230.436500344 190.648 425.45 433.55 411.38 510.92 19477 175.006 166.310 179.68 19473 196790 41.79 181.28 41.79 181.25 45.18 167.658087463 45.31 167.16 22.57 111.87 40355102327 37.0155 227635333333 2971169.05 155.37 597465 80780 430.603 486.36 4.393 6230967 2330 67775 87.28 1956 703.715 3701213.86 190873 3969670.99 442.011 7.183 13551 7.90 703.511 590231 640738 204325.45 205476.78 85.45 78.89 6.16 10381 200467.73 2779890 367162 82287 225527.80 8.908 1198.22 9.94 1217.97 9.78 5.84 689.05 17.34 121.08 41.71 11.19 177.69 67.44 9.430 65.81 181.98 8.65 1382.22 3.98 3005.72 28.73 1664.20 0.99 47664.17 7.30 6564.47 14.19 844.38 1.14 41669.50 798077.1 12235.1 399.3327 59.9668 151.8582 157.8120 210724462 685.9576 34.7862 40.6995 589.2842 686.4476 34.8550 33.790 159.7519 150.0890 1.088780 3.316 14.22 51.926 32.25 36.51 6.761 16.00 186.41 27.09 76.5637 313.1405 16.5087767 41.4567 578.2529 0.38091 0.255585 19.27 12.60 789297 22.265 139.88 4.76230 49.75 47.49 18.26646 25.54 3.97631 6.98945 19397 2.39962 61.1833 51.3945 59.6775 20.063 39.25 39.03 41.73 75.2485 51.74 44.24 26940.976 68.969 68.509 1712.718 57.70 7.523824 148.45 2.99340 138.19 136.71 176.18 213.420 152.28 150.71 2.42969 200.381 155.38 1.15641 4.66619 3.10763 4.24724 22380 50.01 58137 6074.2 49.28 889.882751 118445 151.03 889.71 1.072 746302 18205 1.347 742550 12.95 127015 362918000 154209000 117919000 359689000 35.896 27861 28.723 27853 421.485 13.55 18027 148.57 11.67 216.38 289.721 295.42 294.82 283.16 332.04 18342 374.171 373.677 383.74 18119 148896 44.82 169.00 44.87 168.80 45.51 166.43 45.66 165.89 22.29 113.29 14614638730 16.1504 96712533333 2164237.05 231.85 1508607 207128 722.166 311.20 3.862 3142066 6321 171646 233.90 5199 1294.14 3346967.77 177347 3159962.47 717.807 7.383 17820 3.11 1289.58 1300143 700379 113630.04 118110.63 122.43 124.37 2.59 13034 109860.58 2311235 208713 13855 118699.47 8.552 2047.93 3.87 2081.75 3.80 2.34 1232.64 6.43 124.46 40.58 5.01 313.14 25.52 9.107 102.51 77.99 12.93 617.71 6.79 1175.72 24.93 640.88 0.92 17148.89 6.8 2347.83 21.72 368.02 1.04 15262.36 286703.7 4397.2 338.9830 23.5945 126.1607 63.3500 77391048 605.6665 13.2078 33.0304 242.0444 605.5730 13.2099 67.647 143.4873 55.7478 1.69470 3.070 8.18 83.059 86.38 74.50 2.619 9.16 202.08 24.99 69.1881 115.5983 40.5520172 37.0399 215.8422 0.98742 0.806671 12.21 11.45 812732 22.233 109.47 3.77644 42.98 33.93 41.96762 24.96 4.20681 2.21622 18046 1.84770 23.1655 19.7589 23.3890 19.678 26.64 24.70 26.26 29.3139 33.05 31.03 10152.757 47.122 27.619 690.470 37.00 19.49328 115.37 1.94200 83.38 65.82 134.34 173.290 100.87 93.17 1.80606 166.785 113.18 2.62403 11.4152 8.24165 11.4399 23267 56.73 31262 3643.3 54.33 725.346436 118993 188.90 445.24 0.750 1067716 19126 1.002 997957 12.3 84608 571793000 245053000 187654000 562172000 42.423 23580 34.360 23290 256.364 11.733 19218 182.71 11.51 219.39 200.960 379.26 378.61 360.92 402.63 19183 209.370 204.227 224.24 18808 157229 43.74 173.17 43.75 173.16 45.89 165.06 46.10 164.33 22.81 110.71 29415210430 26.3786 190369000000 2874778.00 165.35 966189 103047 413.290 376.10 4.417 4943670 3001 87290 115.77 2534 701.324 3597757.55 171138 3912323.12 416.416 7.533 14408 6.12 702.689 908869 803231 207339.64 207770.19 94.03 83.81 4.68 10597 199978.55 2762454 289896 41096 199748.09 8.929 1043.48 7.62 1072.35 7.42 4.46 604.17 13.20 121.92 41.42 8.77 155.15 51.51 9.609 55.49 144.01 7.41 1076.16 3.41 2339.16 24.61 1296.57 0.86 36784.83 6.41 4979.27 11.49 695.06 0.99 32137.13 580306.3 8906.1 350.6344 45.5497 127.1627 125.5955 154099244 599.8080 26.5391 33.1059 482.9247 600.7246 26.5164 40.403 141.3563 113.0712 1.17864 3.438 13.45 56.716 42.35 43.84 5.391 15.05 193.90 26.04 69.0371 231.5126 21.2240649 36.3820 439.3341 0.49354 0.394611 18.39 12.05 809727 22.161 141.50 3.69104 50.50 45.17 22.14267 25.04 3.01823 5.50135 18850 2.21782 46.2704 38.9043 43.5077 19.447 36.84 35.89 38.46 55.4091 38.43 42.08 22099.324 67.608 54.917 1372.933 43.04 9.733065 150.48 3.34125 130.49 117.26 176.86 211.627 127.62 116.97 1.62390 200.424 139.86 1.37242 5.86134 4.23272 5.92201 OpenBenchmarking.org
CloudSuite Data Analytics Hadoop Slaves: 512 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 512 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 89452 1306974 1296994 1447278 1380314 1425667 1307991 1296643 93771 29960 80304 31922 22380 23267
TensorFlow Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: ResNet-50 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.37, N = 3 SE +/- 0.03, N = 3 SE +/- 0.52, N = 3 SE +/- 0.02, N = 3 SE +/- 0.15, N = 3 22.91 25.43 24.16 25.36 24.66 23.96 26.26 21.85 68.38 74.68 62.18 66.12 50.01 56.73
CloudSuite Data Analytics Hadoop Slaves: 256 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 256 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 25186 977380 1263825 1456236 1288469 974407 1332491 1321064 43513 34651 27079 34180 58137 31262
NWChem Input: C240 Buckyball OpenBenchmarking.org Seconds, Fewer Is Better NWChem 7.0.2 Input: C240 Buckyball EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1300 2600 3900 5200 6500 5397.8 4463.3 3660.2 3488.4 2799.5 4747.9 3009.9 4925.4 2846.4 6074.2 3643.3 1. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lcomex -lm -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2
TensorFlow Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: ResNet-50 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 16 32 48 64 80 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.21, N = 3 SE +/- 0.03, N = 3 SE +/- 0.23, N = 3 SE +/- 0.02, N = 3 SE +/- 0.10, N = 3 22.37 24.03 23.43 24.04 23.77 22.75 25.34 20.70 68.08 73.49 61.90 66.43 49.28 54.33
Xcompact3d Incompact3d Input: X3D-benchmarking input.i3d OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: X3D-benchmarking input.i3d EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200 400 600 800 1000 SE +/- 0.88, N = 3 SE +/- 0.39, N = 3 SE +/- 5.59, N = 3 SE +/- 9.39, N = 3 SE +/- 0.87, N = 3 SE +/- 0.45, N = 3 SE +/- 1.05, N = 3 SE +/- 0.20, N = 3 SE +/- 0.51, N = 3 SE +/- 0.43, N = 3 SE +/- 9.17, N = 3 SE +/- 3.99, N = 9 SE +/- 0.67, N = 3 SE +/- 0.98, N = 3 880.64 484.99 766.72 700.10 784.80 432.07 716.62 663.83 626.98 357.24 659.15 461.11 889.88 725.35 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi
CloudSuite Data Analytics Hadoop Slaves: 128 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 128 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 101630 870117 1324795 1393156 1378719 1030733 1337915 1377599 121626 122135 104512 99997 118445 118993
TensorFlow Device: CPU - Batch Size: 512 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: GoogLeNet EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60 120 180 240 300 SE +/- 0.09, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.17, N = 3 SE +/- 0.65, N = 3 SE +/- 0.15, N = 3 SE +/- 0.31, N = 3 SE +/- 0.02, N = 3 SE +/- 0.84, N = 3 63.82 71.90 65.67 71.43 70.20 63.68 73.86 60.82 205.17 257.04 191.35 234.54 151.03 188.90
Blender Blend File: Barbershop - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Barbershop - Compute: CPU-Only EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200 400 600 800 1000 SE +/- 0.57, N = 3 SE +/- 0.53, N = 3 SE +/- 2.04, N = 3 SE +/- 0.36, N = 3 SE +/- 0.04, N = 3 SE +/- 0.82, N = 3 SE +/- 0.45, N = 3 SE +/- 0.59, N = 3 SE +/- 0.64, N = 3 SE +/- 0.29, N = 3 SE +/- 3.07, N = 3 SE +/- 0.18, N = 3 SE +/- 0.21, N = 3 SE +/- 0.38, N = 3 815.39 435.02 616.51 330.02 482.82 262.94 456.27 297.72 604.76 302.14 680.31 342.37 889.71 445.24
PostgreSQL Scaling Factor: 1000 - Clients: 800 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 800 - Mode: Read Only - Average Latency EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.2651 0.5302 0.7953 1.0604 1.3255 SE +/- 0.012, N = 3 SE +/- 0.011, N = 3 SE +/- 0.002, N = 3 SE +/- 0.025, N = 9 SE +/- 0.032, N = 11 SE +/- 0.060, N = 6 SE +/- 0.003, N = 3 SE +/- 0.020, N = 12 SE +/- 0.000, N = 3 SE +/- 0.006, N = 3 SE +/- 0.001, N = 3 SE +/- 0.031, N = 12 SE +/- 0.006, N = 3 SE +/- 0.008, N = 12 1.150 0.935 0.877 1.051 0.822 1.178 0.745 0.963 0.712 1.066 0.813 0.953 1.072 0.750 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1000 - Clients: 800 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 800 - Mode: Read Only EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200K 400K 600K 800K 1000K SE +/- 7215.33, N = 3 SE +/- 9801.20, N = 3 SE +/- 2318.40, N = 3 SE +/- 19094.08, N = 9 SE +/- 28926.74, N = 11 SE +/- 41984.11, N = 6 SE +/- 4126.34, N = 3 SE +/- 19623.01, N = 12 SE +/- 137.25, N = 3 SE +/- 4309.16, N = 3 SE +/- 1328.10, N = 3 SE +/- 30362.30, N = 12 SE +/- 4113.36, N = 3 SE +/- 10990.82, N = 12 695761 855642 912427 765090 984394 690019 1074765 835087 1123663 750218 983473 850161 746302 1067716 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
CloudSuite Data Analytics Hadoop Slaves: 64 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 64 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 19072 915672 1296065 1462648 1315834 910021 1312741 1353066 20909 21632 18776 19706 18205 19126
PostgreSQL Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only - Average Latency EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.353 0.706 1.059 1.412 1.765 SE +/- 0.003, N = 3 SE +/- 0.005, N = 3 SE +/- 0.010, N = 3 SE +/- 0.021, N = 12 SE +/- 0.002, N = 3 SE +/- 0.027, N = 9 SE +/- 0.004, N = 3 SE +/- 0.009, N = 3 SE +/- 0.004, N = 3 SE +/- 0.050, N = 12 SE +/- 0.001, N = 3 SE +/- 0.014, N = 12 SE +/- 0.003, N = 3 SE +/- 0.008, N = 3 1.459 1.178 1.131 1.377 1.024 1.569 0.991 1.386 0.927 1.348 1.078 1.176 1.347 1.002 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200K 400K 600K 800K 1000K SE +/- 1636.62, N = 3 SE +/- 3271.24, N = 3 SE +/- 7500.42, N = 3 SE +/- 11363.61, N = 12 SE +/- 2084.66, N = 3 SE +/- 10642.91, N = 9 SE +/- 4439.63, N = 3 SE +/- 4640.40, N = 3 SE +/- 4354.62, N = 3 SE +/- 30718.02, N = 12 SE +/- 1181.85, N = 3 SE +/- 10454.75, N = 12 SE +/- 1889.54, N = 3 SE +/- 8418.28, N = 3 685239 849019 884213 728184 976332 638731 1008741 721335 1078586 754104 927858 851464 742550 997957 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
CloudSuite Web Serving Load Scale: 500 OpenBenchmarking.org ops/sec, More Is Better CloudSuite Web Serving Load Scale: 500 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 4 8 12 16 20 11.600 11.217 14.583 12.083 15.267 11.817 13.050 15.283 13.317 9.600 15.433 12.717 12.950 12.300
CloudSuite Graph Analytics GraphX Algorithm: Triangle Count OpenBenchmarking.org ms, Fewer Is Better CloudSuite Graph Analytics 4.0 GraphX Algorithm: Triangle Count EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30K 60K 90K 120K 150K SE +/- 192.25, N = 3 SE +/- 2111.36, N = 15 SE +/- 911.07, N = 15 SE +/- 4547.27, N = 12 SE +/- 844.55, N = 3 SE +/- 3129.18, N = 15 SE +/- 816.75, N = 5 SE +/- 1101.67, N = 15 SE +/- 1190.06, N = 15 SE +/- 1737.14, N = 15 SE +/- 969.69, N = 3 SE +/- 486.76, N = 3 SE +/- 2880.79, N = 12 SE +/- 1088.95, N = 15 108988 77278 84114 74003 77893 70042 74250 70089 93231 78150 87786 73459 127015 84608
Graph500 Scale: 26 OpenBenchmarking.org bfs max_TEPS, More Is Better Graph500 3.0 Scale: 26 EPYC 7343 EPYC 7343 2P EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6346 Xeon Gold 6346 2P 150M 300M 450M 600M 750M 312989000 444474000 601120000 528200000 691983000 554082000 715154000 519294000 667982000 362918000 571793000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org sssp max_TEPS, More Is Better Graph500 3.0 Scale: 26 EPYC 7343 EPYC 7343 2P EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6346 Xeon Gold 6346 2P 70M 140M 210M 280M 350M 149710000 218986000 294782000 226239000 322475000 268016000 288959000 213096000 295010000 154209000 245053000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org sssp median_TEPS, More Is Better Graph500 3.0 Scale: 26 EPYC 7343 EPYC 7343 2P EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6346 Xeon Gold 6346 2P 50M 100M 150M 200M 250M 114295000 174219000 225284000 176371000 255036000 204519000 227175000 168374000 238460000 117919000 187654000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org bfs median_TEPS, More Is Better Graph500 3.0 Scale: 26 EPYC 7343 EPYC 7343 2P EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6346 Xeon Gold 6346 2P 150M 300M 450M 600M 750M 309817000 422529000 584034000 517810000 665655000 544342000 691348000 510587000 655675000 359689000 562172000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
PostgreSQL Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write - Average Latency EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.34, N = 3 SE +/- 0.63, N = 3 SE +/- 0.37, N = 7 SE +/- 0.71, N = 3 SE +/- 1.40, N = 12 SE +/- 0.78, N = 3 SE +/- 1.07, N = 12 SE +/- 2.55, N = 9 SE +/- 0.17, N = 3 SE +/- 0.71, N = 3 SE +/- 0.23, N = 3 SE +/- 0.37, N = 3 SE +/- 0.27, N = 3 SE +/- 0.54, N = 3 40.29 119.68 38.97 102.07 72.40 93.90 83.02 64.50 44.55 51.77 39.41 45.18 35.90 42.42 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6K 12K 18K 24K 30K SE +/- 210.94, N = 3 SE +/- 43.57, N = 3 SE +/- 239.71, N = 7 SE +/- 68.86, N = 3 SE +/- 246.74, N = 12 SE +/- 88.49, N = 3 SE +/- 167.15, N = 12 SE +/- 567.20, N = 9 SE +/- 84.27, N = 3 SE +/- 265.07, N = 3 SE +/- 144.91, N = 3 SE +/- 180.74, N = 3 SE +/- 212.63, N = 3 SE +/- 300.77, N = 3 24821 8356 25674 9798 13865 10651 12068 15683 22446 19322 25377 22138 27861 23580 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1000 - Clients: 800 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 800 - Mode: Read Write - Average Latency EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.26, N = 3 SE +/- 1.69, N = 12 SE +/- 0.81, N = 12 SE +/- 1.13, N = 3 SE +/- 0.22, N = 3 SE +/- 7.23, N = 9 SE +/- 0.15, N = 3 SE +/- 0.72, N = 3 SE +/- 0.31, N = 3 SE +/- 0.18, N = 3 SE +/- 0.18, N = 3 SE +/- 0.22, N = 3 SE +/- 0.06, N = 3 SE +/- 0.44, N = 3 31.16 94.59 33.21 91.60 58.07 97.52 67.54 65.35 36.00 40.94 32.84 36.48 28.72 34.36 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1000 - Clients: 800 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 800 - Mode: Read Write EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6K 12K 18K 24K 30K SE +/- 214.52, N = 3 SE +/- 176.72, N = 12 SE +/- 611.47, N = 12 SE +/- 109.43, N = 3 SE +/- 52.15, N = 3 SE +/- 590.01, N = 9 SE +/- 26.13, N = 3 SE +/- 136.50, N = 3 SE +/- 190.25, N = 3 SE +/- 83.93, N = 3 SE +/- 132.14, N = 3 SE +/- 131.27, N = 3 SE +/- 55.23, N = 3 SE +/- 299.85, N = 3 25679 8492 24251 8736 13777 8552 11845 12245 22228 19540 24360 21929 27853 23290 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Timed LLVM Compilation Build System: Unix Makefiles OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 13.0 Build System: Unix Makefiles EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 90 180 270 360 450 SE +/- 1.84, N = 3 SE +/- 3.14, N = 3 SE +/- 3.55, N = 5 SE +/- 0.83, N = 3 SE +/- 1.45, N = 3 SE +/- 1.00, N = 3 SE +/- 2.17, N = 9 SE +/- 0.36, N = 3 SE +/- 1.83, N = 3 SE +/- 0.66, N = 3 SE +/- 2.99, N = 3 SE +/- 1.05, N = 3 SE +/- 3.03, N = 3 SE +/- 2.63, N = 5 392.19 240.49 320.94 216.18 282.42 199.58 260.91 225.70 323.07 227.37 346.26 220.50 421.49 256.36
CloudSuite Web Serving Load Scale: 400 OpenBenchmarking.org ops/sec, More Is Better CloudSuite Web Serving Load Scale: 400 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 4 8 12 16 20 11.83 11.43 14.73 11.97 14.88 11.20 13.80 13.27 12.38 11.93 14.70 11.70 13.55 11.73
CloudSuite Data Analytics Hadoop Slaves: 32 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 32 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 18906 1025584 1326319 1337500 1282987 1118115 1356145 952995 20822 21685 18923 19751 18027 19218
TensorFlow Device: CPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: GoogLeNet EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60 120 180 240 300 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.15, N = 3 SE +/- 0.14, N = 3 SE +/- 0.14, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.33, N = 3 SE +/- 0.11, N = 3 SE +/- 0.20, N = 3 SE +/- 0.10, N = 3 SE +/- 0.11, N = 3 64.03 70.56 65.49 70.39 69.02 62.34 72.46 58.23 203.92 253.31 189.89 231.32 148.57 182.71
FFmpeg Encoder: libx264 - Scenario: Upload OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Upload EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 12.68 12.74 11.77 11.71 11.97 11.99 12.02 12.02 10.21 10.09 11.11 10.96 11.67 11.51 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Upload OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Upload EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.28, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.21, N = 3 SE +/- 0.12, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.08, N = 3 SE +/- 0.09, N = 3 SE +/- 0.21, N = 3 SE +/- 0.05, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.15, N = 3 199.10 198.24 214.55 215.59 211.01 210.67 210.02 210.12 247.39 250.35 227.36 230.44 216.38 219.39 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
Timed Gem5 Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Gem5 Compilation 21.2 Time To Compile EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60 120 180 240 300 SE +/- 0.29, N = 3 SE +/- 0.06, N = 3 SE +/- 1.70, N = 12 SE +/- 1.47, N = 12 SE +/- 1.75, N = 3 SE +/- 3.04, N = 4 SE +/- 0.86, N = 3 SE +/- 0.19, N = 3 SE +/- 1.87, N = 6 SE +/- 0.04, N = 3 SE +/- 1.48, N = 3 267.88 229.60 210.64 198.43 190.76 244.25 199.49 244.57 190.65 289.72 200.96
ClickHouse 100M Rows Hits Dataset, Third Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 100 200 300 400 500 SE +/- 1.99, N = 3 SE +/- 1.18, N = 3 SE +/- 2.07, N = 3 SE +/- 5.82, N = 3 SE +/- 2.21, N = 3 SE +/- 2.98, N = 3 SE +/- 0.23, N = 3 SE +/- 1.15, N = 3 SE +/- 1.64, N = 3 SE +/- 4.19, N = 3 SE +/- 1.90, N = 3 SE +/- 3.32, N = 3 SE +/- 1.18, N = 3 SE +/- 9.11, N = 12 345.53 443.72 360.64 440.92 379.67 435.85 425.48 380.10 325.93 407.09 325.08 425.45 295.42 379.26 MIN: 13.57 / MAX: 7500 MIN: 24.16 / MAX: 6000 MIN: 17.17 / MAX: 6666.67 MIN: 31.68 / MAX: 4615.38 MIN: 21.33 / MAX: 6666.67 MIN: 35.71 / MAX: 4615.38 MIN: 22.74 / MAX: 6000 MIN: 31.95 / MAX: 6000 MIN: 15.81 / MAX: 6000 MIN: 29.41 / MAX: 5454.55 MIN: 14.7 / MAX: 6666.67 MIN: 28.42 / MAX: 5000 MIN: 10.91 / MAX: 7500 MIN: 20.98 / MAX: 6000
ClickHouse 100M Rows Hits Dataset, Second Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 100 200 300 400 500 SE +/- 3.50, N = 3 SE +/- 1.63, N = 3 SE +/- 2.06, N = 3 SE +/- 7.88, N = 3 SE +/- 1.23, N = 3 SE +/- 2.78, N = 3 SE +/- 0.54, N = 3 SE +/- 3.18, N = 3 SE +/- 2.19, N = 3 SE +/- 5.74, N = 3 SE +/- 3.16, N = 3 SE +/- 2.05, N = 3 SE +/- 1.01, N = 3 SE +/- 9.42, N = 12 346.00 443.07 363.28 437.50 377.03 436.77 425.45 375.36 325.13 405.08 321.66 433.55 294.82 378.61 MIN: 13.53 / MAX: 7500 MIN: 23.91 / MAX: 5454.55 MIN: 17.19 / MAX: 7500 MIN: 31.66 / MAX: 5000 MIN: 21.37 / MAX: 6666.67 MIN: 35.19 / MAX: 5454.55 MIN: 22.68 / MAX: 6666.67 MIN: 32 / MAX: 6000 MIN: 15.85 / MAX: 5454.55 MIN: 29.11 / MAX: 5000 MIN: 14.82 / MAX: 6666.67 MIN: 28.48 / MAX: 6000 MIN: 10.95 / MAX: 7500 MIN: 20.51 / MAX: 6666.67
ClickHouse 100M Rows Hits Dataset, First Run / Cold Cache OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 90 180 270 360 450 SE +/- 2.07, N = 3 SE +/- 2.96, N = 3 SE +/- 1.47, N = 3 SE +/- 0.97, N = 3 SE +/- 3.29, N = 3 SE +/- 2.43, N = 3 SE +/- 1.20, N = 3 SE +/- 3.48, N = 3 SE +/- 1.98, N = 3 SE +/- 2.01, N = 3 SE +/- 3.58, N = 3 SE +/- 1.29, N = 3 SE +/- 0.53, N = 3 SE +/- 9.20, N = 12 336.88 423.79 351.34 429.39 362.00 412.09 410.64 365.79 311.11 388.39 312.11 411.38 283.16 360.92 MIN: 13.48 / MAX: 7500 MIN: 23.78 / MAX: 4285.71 MIN: 17.17 / MAX: 6666.67 MIN: 31.35 / MAX: 5000 MIN: 21.03 / MAX: 6000 MIN: 34.8 / MAX: 4000 MIN: 22.56 / MAX: 6666.67 MIN: 31.86 / MAX: 5454.55 MIN: 15.86 / MAX: 5454.55 MIN: 29.17 / MAX: 5454.55 MIN: 14.74 / MAX: 6666.67 MIN: 28.04 / MAX: 5000 MIN: 10.81 / MAX: 6666.67 MIN: 20.41 / MAX: 6000
TensorFlow Device: CPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: AlexNet EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 120 240 360 480 600 SE +/- 0.30, N = 3 SE +/- 0.34, N = 3 SE +/- 0.69, N = 3 SE +/- 0.23, N = 3 SE +/- 0.17, N = 3 SE +/- 0.27, N = 3 SE +/- 0.27, N = 3 SE +/- 0.22, N = 3 SE +/- 0.42, N = 3 SE +/- 0.62, N = 3 SE +/- 0.13, N = 3 SE +/- 0.75, N = 3 SE +/- 0.70, N = 3 SE +/- 2.14, N = 3 142.79 147.17 150.98 146.48 156.46 144.20 160.32 136.28 489.77 575.90 432.47 510.92 332.04 402.63
CloudSuite Data Analytics Hadoop Slaves: 8 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 8 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 19259 1338669 1265492 1386712 1323129 1397332 1279022 1351560 20809 21431 18852 19477 18342 19183
Timed Node.js Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 18.8 Time To Compile EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 80 160 240 320 400 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.25, N = 3 SE +/- 0.52, N = 3 SE +/- 0.19, N = 3 SE +/- 0.62, N = 3 SE +/- 0.36, N = 3 SE +/- 0.38, N = 3 SE +/- 0.06, N = 3 SE +/- 0.55, N = 3 SE +/- 0.37, N = 3 SE +/- 0.41, N = 3 337.22 191.00 270.84 165.47 226.63 143.60 209.94 166.99 272.73 168.43 295.59 175.01 374.17 209.37
Timed LLVM Compilation Build System: Ninja OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 13.0 Build System: Ninja EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 80 160 240 320 400 SE +/- 0.08, N = 3 SE +/- 0.24, N = 3 SE +/- 0.09, N = 3 SE +/- 0.67, N = 3 SE +/- 0.43, N = 3 SE +/- 0.09, N = 3 SE +/- 0.16, N = 3 SE +/- 0.16, N = 3 SE +/- 0.32, N = 3 SE +/- 0.33, N = 3 SE +/- 0.11, N = 3 SE +/- 0.64, N = 3 SE +/- 0.12, N = 3 SE +/- 0.24, N = 3 347.36 190.97 275.25 161.53 230.69 140.28 212.30 163.54 268.94 160.40 292.73 166.31 373.68 204.23
OpenRadioss Model: INIVOL and Fluid Structure Interaction Drop Container OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 80 160 240 320 400 SE +/- 0.61, N = 3 SE +/- 0.90, N = 3 SE +/- 0.35, N = 3 SE +/- 0.19, N = 3 SE +/- 0.28, N = 3 SE +/- 0.39, N = 3 SE +/- 0.22, N = 3 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.47, N = 3 SE +/- 0.59, N = 3 352.52 291.34 245.34 224.14 191.58 287.21 199.83 301.70 179.68 383.74 224.24
CloudSuite Data Analytics Hadoop Slaves: 4 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 4 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 19011 1314712 874335 928018 1295214 905105 1252851 1318693 20697 21284 18674 19473 18119 18808
CloudSuite In-Memory Analytics Training Set Size: Large OpenBenchmarking.org ms, Fewer Is Better CloudSuite In-Memory Analytics 4.0 Training Set Size: Large EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60K 120K 180K 240K 300K SE +/- 535.64, N = 3 SE +/- 1774.21, N = 4 SE +/- 235.29, N = 3 SE +/- 530.20, N = 3 SE +/- 796.65, N = 3 SE +/- 859.70, N = 3 SE +/- 210.33, N = 3 SE +/- 955.82, N = 3 SE +/- 2349.58, N = 3 SE +/- 775.32, N = 3 SE +/- 623.63, N = 3 SE +/- 546.89, N = 3 SE +/- 800.80, N = 3 SE +/- 725.41, N = 3 122575 147944 124002 225855 134575 301630 130123 250115 163851 287528 140252 196790 148896 157229
FFmpeg Encoder: libx264 - Scenario: Video On Demand OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Video On Demand EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 11 22 33 44 55 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 48.75 48.74 45.33 44.94 46.04 45.95 46.70 46.35 39.44 38.64 42.77 41.79 44.82 43.74 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Video On Demand OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Video On Demand EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.18, N = 3 SE +/- 0.08, N = 3 SE +/- 0.34, N = 3 SE +/- 0.22, N = 3 SE +/- 0.22, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.17, N = 3 SE +/- 0.18, N = 3 SE +/- 0.02, N = 3 SE +/- 0.13, N = 3 SE +/- 0.23, N = 3 155.37 155.42 167.10 168.57 164.52 164.86 162.21 163.44 192.08 196.03 177.11 181.28 169.00 173.17 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Platform OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Platform EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 11 22 33 44 55 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.12, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 48.73 48.75 45.39 44.82 46.16 46.08 46.55 46.36 39.45 38.74 42.81 41.79 44.87 43.75 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Platform OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Platform EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.15, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.14, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.42, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.09, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.14, N = 3 SE +/- 0.08, N = 3 155.46 155.38 166.90 169.02 164.12 164.38 162.71 163.38 192.02 195.55 176.95 181.25 168.80 173.16 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Video On Demand OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Video On Demand EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 11 22 33 44 55 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 49.82 46.84 47.31 43.84 47.73 44.16 47.82 43.46 42.08 41.63 45.28 45.18 45.51 45.89 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Video On Demand OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Video On Demand EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.16, N = 3 SE +/- 0.38, N = 3 SE +/- 0.13, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.58, N = 3 SE +/- 0.13, N = 3 SE +/- 0.04, N = 3 SE +/- 0.24, N = 3 SE +/- 0.22, N = 3 SE +/- 0.33, N = 3 SE +/- 0.17, N = 3 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 152.05 161.72 160.13 172.81 158.71 171.53 158.41 174.28 180.03 181.97 167.31 167.66 166.43 165.06 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Platform OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Platform EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 11 22 33 44 55 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 49.89 46.66 47.38 43.80 47.61 44.19 47.87 43.44 41.92 41.89 45.13 45.31 45.66 46.10 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Platform OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Platform EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.09, N = 3 SE +/- 0.17, N = 3 SE +/- 0.12, N = 3 SE +/- 0.14, N = 3 SE +/- 0.05, N = 3 SE +/- 0.19, N = 3 SE +/- 0.06, N = 3 SE +/- 0.19, N = 3 SE +/- 0.09, N = 3 SE +/- 0.23, N = 3 SE +/- 0.27, N = 3 SE +/- 0.11, N = 3 SE +/- 0.16, N = 3 SE +/- 0.36, N = 3 151.85 162.34 159.89 172.96 159.12 171.41 158.24 174.39 180.71 180.82 167.86 167.16 165.89 164.33 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Upload OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Upload EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6 12 18 24 30 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 24.29 23.56 23.21 22.07 23.35 22.20 23.40 21.32 20.59 20.89 22.21 22.57 22.29 22.81 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Upload OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Upload EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.07, N = 3 SE +/- 0.20, N = 3 SE +/- 0.07, N = 3 SE +/- 0.13, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 3 SE +/- 0.30, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.25, N = 3 SE +/- 0.22, N = 3 103.96 107.19 108.80 114.41 108.16 113.72 107.90 118.46 122.64 120.86 113.70 111.87 113.29 110.71 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
OpenSSL Algorithm: SHA256 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.0 Algorithm: SHA256 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20000M 40000M 60000M 80000M 100000M SE +/- 29163674.08, N = 3 SE +/- 24582365.01, N = 3 SE +/- 27629858.10, N = 3 SE +/- 54030773.40, N = 3 SE +/- 68531235.70, N = 3 SE +/- 316349484.45, N = 3 SE +/- 186860140.69, N = 3 SE +/- 8398498.36, N = 3 SE +/- 10848440.04, N = 3 SE +/- 10952442.61, N = 3 SE +/- 11924426.00, N = 3 SE +/- 3033485.03, N = 3 SE +/- 9109685.37, N = 3 SE +/- 1989217.69, N = 3 24891101267 49694000047 33095407800 66206231957 42284954430 84365767223 44324823090 69715833097 20888915973 42653381293 20256398000 40355102327 14614638730 29415210430 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
High Performance Conjugate Gradient OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.1 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 9 18 27 36 45 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.21, N = 5 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 18.14 35.32 17.85 27.63 17.68 34.53 19.34 19.06 19.89 39.14 18.80 37.02 16.15 26.38 1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi
nekRS Input: TurboPipe Periodic OpenBenchmarking.org FLOP/s, More Is Better nekRS 22.0 Input: TurboPipe Periodic EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50000M 100000M 150000M 200000M 250000M SE +/- 194054116.16, N = 3 SE +/- 1160248871.77, N = 3 SE +/- 716743639.28, N = 3 SE +/- 130435595.01, N = 3 SE +/- 716358150.65, N = 3 SE +/- 37382408.22, N = 3 SE +/- 603340791.85, N = 3 SE +/- 165905930.51, N = 3 SE +/- 1194804633.03, N = 3 SE +/- 206475987.30, N = 3 SE +/- 233956073.75, N = 3 SE +/- 285712164.79, N = 3 SE +/- 124957326.05, N = 3 166901000000 112350333333 194221666667 128904333333 218603000000 149115333333 170229333333 127809333333 242295666667 117791000000 227635333333 96712533333 190369000000 1. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi
Memcached Set To Get Ratio: 1:100 OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:100 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 800K 1600K 2400K 3200K 4000K SE +/- 9721.14, N = 3 SE +/- 4664.77, N = 3 SE +/- 18487.99, N = 3 SE +/- 22542.41, N = 15 SE +/- 20057.86, N = 3 SE +/- 1121.75, N = 3 SE +/- 40574.62, N = 3 SE +/- 31526.72, N = 9 SE +/- 34881.31, N = 3 SE +/- 60239.97, N = 15 SE +/- 34942.45, N = 3 SE +/- 43191.93, N = 15 SE +/- 27101.83, N = 15 SE +/- 24448.73, N = 3 1610909.22 2373328.37 2309617.42 2952893.82 2981451.32 3518612.74 2848831.24 3893409.95 2937926.06 2802626.26 2842403.96 2971169.05 2164237.05 2874778.00 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenRadioss Model: Bird Strike on Windshield OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bird Strike on Windshield EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.17, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.12, N = 3 SE +/- 0.30, N = 3 SE +/- 0.23, N = 3 SE +/- 0.08, N = 3 SE +/- 0.20, N = 3 SE +/- 0.20, N = 3 SE +/- 0.06, N = 3 SE +/- 0.16, N = 3 218.07 201.13 186.94 173.03 167.45 207.10 162.88 204.18 155.37 231.85 165.35
RocksDB Test: Sequential Fill OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Sequential Fill EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K SE +/- 532.43, N = 3 SE +/- 3079.56, N = 3 SE +/- 319.69, N = 3 SE +/- 2451.41, N = 3 SE +/- 597.87, N = 3 SE +/- 1902.35, N = 3 SE +/- 106.07, N = 3 SE +/- 4969.08, N = 3 SE +/- 3588.97, N = 3 SE +/- 1492.53, N = 3 SE +/- 4947.74, N = 3 SE +/- 2179.57, N = 3 SE +/- 6746.06, N = 3 323598 821279 286858 864802 299732 774765 452291 1269946 488659 1443216 597465 1508607 966189 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60K 120K 180K 240K 300K SE +/- 981.14, N = 3 SE +/- 359.93, N = 3 SE +/- 1060.89, N = 3 SE +/- 865.73, N = 3 SE +/- 453.13, N = 3 SE +/- 337.67, N = 3 SE +/- 601.99, N = 3 SE +/- 89.37, N = 3 SE +/- 384.33, N = 3 SE +/- 150.12, N = 3 SE +/- 873.63, N = 3 SE +/- 207.56, N = 3 SE +/- 339.77, N = 3 SE +/- 152.22, N = 3 265238 142611 200057 110558 159097 86704 148990 98653 133650 69538 152061 80780 207128 103047 1. (CXX) g++ options: -O3 -lm -ldl
oneDNN Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 400 800 1200 1600 2000 SE +/- 16.64, N = 3 SE +/- 6.23, N = 3 SE +/- 15.21, N = 15 SE +/- 9.52, N = 3 SE +/- 20.35, N = 15 SE +/- 6.02, N = 3 SE +/- 6.16, N = 3 SE +/- 1.92, N = 3 SE +/- 5.30, N = 3 SE +/- 4.35, N = 15 SE +/- 4.97, N = 3 SE +/- 3.31, N = 3 SE +/- 3.56, N = 3 1837.89 1070.14 1604.83 1109.99 1606.42 1106.75 1183.30 521.57 472.89 642.83 430.60 722.17 413.29 MIN: 1460.53 MIN: 1010.54 MIN: 1222.24 MIN: 1036.06 MIN: 1227.37 MIN: 1032.76 MIN: 1108.19 MIN: 489.81 MIN: 446.12 MIN: 575.4 MIN: 402.38 MIN: 673.5 MIN: 389.55 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
TensorFlow Device: CPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: AlexNet EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 120 240 360 480 600 SE +/- 0.23, N = 3 SE +/- 0.14, N = 3 SE +/- 0.05, N = 3 SE +/- 0.21, N = 3 SE +/- 0.25, N = 3 SE +/- 0.45, N = 3 SE +/- 0.23, N = 3 SE +/- 0.10, N = 3 SE +/- 0.91, N = 3 SE +/- 1.40, N = 3 SE +/- 0.74, N = 3 SE +/- 0.36, N = 3 SE +/- 0.48, N = 3 SE +/- 1.21, N = 3 138.96 143.84 144.99 143.50 151.07 141.81 155.25 130.65 475.07 547.55 410.32 486.36 311.20 376.10
VVenC Video Input: Bosphorus 4K - Video Preset: Fast OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1.1023 2.2046 3.3069 4.4092 5.5115 SE +/- 0.006, N = 3 SE +/- 0.005, N = 3 SE +/- 0.011, N = 3 SE +/- 0.018, N = 3 SE +/- 0.008, N = 3 SE +/- 0.021, N = 3 SE +/- 0.007, N = 3 SE +/- 0.010, N = 3 SE +/- 0.005, N = 3 SE +/- 0.003, N = 3 SE +/- 0.004, N = 3 SE +/- 0.014, N = 3 SE +/- 0.005, N = 3 SE +/- 0.008, N = 3 4.310 4.899 4.415 4.658 4.582 4.688 4.724 4.455 3.776 4.045 4.093 4.393 3.862 4.417 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
RocksDB Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Read While Writing EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2M 4M 6M 8M 10M SE +/- 76523.17, N = 13 SE +/- 43415.41, N = 4 SE +/- 142144.80, N = 15 SE +/- 32029.62, N = 3 SE +/- 135593.38, N = 15 SE +/- 15721.89, N = 3 SE +/- 68024.06, N = 3 SE +/- 22775.73, N = 3 SE +/- 153728.35, N = 12 SE +/- 40873.57, N = 5 SE +/- 44785.37, N = 3 SE +/- 23057.76, N = 3 SE +/- 42331.24, N = 15 4864299 4117643 6957204 5130684 8063050 5147499 7932933 4793137 7436444 3825346 6230967 3142066 4943670 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2K 4K 6K 8K 10K SE +/- 14.64, N = 3 SE +/- 5.04, N = 3 SE +/- 17.21, N = 3 SE +/- 6.98, N = 3 SE +/- 22.62, N = 3 SE +/- 12.06, N = 3 SE +/- 6.51, N = 3 SE +/- 8.33, N = 3 SE +/- 15.01, N = 3 SE +/- 0.88, N = 3 SE +/- 16.80, N = 3 SE +/- 11.06, N = 3 SE +/- 7.21, N = 3 SE +/- 12.78, N = 3 8172 4336 6067 3252 4769 2538 4486 2874 3967 1979 4621 2330 6321 3001 1. (CXX) g++ options: -O3 -lm -ldl
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50K 100K 150K 200K 250K SE +/- 1066.52, N = 3 SE +/- 322.54, N = 3 SE +/- 660.98, N = 3 SE +/- 593.91, N = 3 SE +/- 22.36, N = 3 SE +/- 95.38, N = 3 SE +/- 100.17, N = 3 SE +/- 129.50, N = 3 SE +/- 153.33, N = 3 SE +/- 247.04, N = 3 SE +/- 380.50, N = 3 SE +/- 130.77, N = 3 SE +/- 433.96, N = 3 SE +/- 405.08, N = 3 224298 120264 170190 93834 135636 74566 127078 84001 113149 52646 127865 67775 171646 87290 1. (CXX) g++ options: -O3 -lm -ldl
Blender Blend File: Classroom - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Classroom - Compute: CPU-Only EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.29, N = 3 SE +/- 0.30, N = 3 SE +/- 0.20, N = 3 SE +/- 0.18, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 SE +/- 0.25, N = 3 SE +/- 0.14, N = 3 SE +/- 0.13, N = 3 SE +/- 0.37, N = 3 SE +/- 0.14, N = 3 219.83 109.64 165.39 82.55 130.35 64.96 122.97 79.30 161.50 80.17 176.55 87.28 233.90 115.77
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1500 3000 4500 6000 7500 SE +/- 30.83, N = 3 SE +/- 15.06, N = 3 SE +/- 10.48, N = 3 SE +/- 4.18, N = 3 SE +/- 19.73, N = 3 SE +/- 0.33, N = 3 SE +/- 5.24, N = 3 SE +/- 2.96, N = 3 SE +/- 17.29, N = 3 SE +/- 10.00, N = 3 SE +/- 6.57, N = 3 SE +/- 3.18, N = 3 SE +/- 34.35, N = 3 SE +/- 7.69, N = 3 6805 3628 5121 2722 4014 2150 3767 2424 3314 1641 3769 1956 5199 2534 1. (CXX) g++ options: -O3 -lm -ldl
oneDNN Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1100 2200 3300 4400 5500 SE +/- 18.38, N = 3 SE +/- 2.38, N = 3 SE +/- 39.18, N = 3 SE +/- 9.33, N = 3 SE +/- 37.47, N = 15 SE +/- 14.60, N = 3 SE +/- 26.36, N = 15 SE +/- 2.21, N = 3 SE +/- 7.44, N = 5 SE +/- 8.46, N = 3 SE +/- 5.69, N = 3 SE +/- 3.49, N = 3 SE +/- 2.28, N = 3 2900.06 1795.39 2840.00 1975.47 5033.87 1989.75 2712.50 907.29 690.75 1076.71 703.72 1294.14 701.32 MIN: 2610.36 MIN: 1733.94 MIN: 2260.17 MIN: 1894.9 MIN: 4268.26 MIN: 1902.82 MIN: 2373.24 MIN: 846.78 MIN: 635.03 MIN: 974.49 MIN: 663.96 MIN: 1216.99 MIN: 665.02 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Memcached Set To Get Ratio: 1:5 OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:5 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 900K 1800K 2700K 3600K 4500K SE +/- 3957.77, N = 3 SE +/- 24137.01, N = 3 SE +/- 20367.20, N = 3 SE +/- 51036.74, N = 15 SE +/- 6378.36, N = 3 SE +/- 36603.84, N = 15 SE +/- 6964.53, N = 3 SE +/- 47663.26, N = 3 SE +/- 26712.28, N = 3 SE +/- 21079.66, N = 14 SE +/- 34848.84, N = 8 SE +/- 28979.64, N = 3 SE +/- 27130.94, N = 3 SE +/- 20598.32, N = 3 2199582.80 2421891.74 2917560.70 2164592.24 3632495.02 1867112.74 3574540.35 3378044.12 4271575.65 3270779.44 4068619.97 3701213.86 3346967.77 3597757.55 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Apache Cassandra Test: Writes OpenBenchmarking.org Op/s, More Is Better Apache Cassandra 4.0 Test: Writes EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60K 120K 180K 240K 300K SE +/- 902.56, N = 3 SE +/- 2617.59, N = 3 SE +/- 369.63, N = 3 SE +/- 1215.21, N = 3 SE +/- 591.09, N = 3 SE +/- 432.91, N = 3 SE +/- 1364.13, N = 3 SE +/- 1599.50, N = 3 SE +/- 104.54, N = 3 SE +/- 515.32, N = 3 SE +/- 408.15, N = 3 SE +/- 950.77, N = 3 SE +/- 609.52, N = 3 SE +/- 894.00, N = 3 172713 236544 224875 225784 263627 245226 246339 253058 176284 156487 200958 190873 177347 171138
Memcached Set To Get Ratio: 1:10 OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:10 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1000K 2000K 3000K 4000K 5000K SE +/- 6608.23, N = 3 SE +/- 10464.07, N = 3 SE +/- 9446.47, N = 3 SE +/- 12992.60, N = 3 SE +/- 10592.08, N = 3 SE +/- 10361.68, N = 3 SE +/- 16723.87, N = 3 SE +/- 53174.54, N = 4 SE +/- 14309.07, N = 3 SE +/- 79008.26, N = 15 SE +/- 13454.68, N = 3 SE +/- 44938.98, N = 15 SE +/- 23174.23, N = 3 SE +/- 36081.97, N = 15 2548333.19 2826219.16 3431617.24 3691244.97 4198464.11 4105338.27 3481927.79 4786407.25 4262554.19 3551712.12 4053902.81 3969670.99 3159962.47 3912323.12 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
oneDNN Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 400 800 1200 1600 2000 SE +/- 7.96, N = 3 SE +/- 4.33, N = 3 SE +/- 19.63, N = 3 SE +/- 7.84, N = 3 SE +/- 14.95, N = 15 SE +/- 8.28, N = 3 SE +/- 13.60, N = 3 SE +/- 0.27, N = 3 SE +/- 3.44, N = 15 SE +/- 3.92, N = 3 SE +/- 6.32, N = 3 SE +/- 2.43, N = 3 SE +/- 1.64, N = 3 1754.12 1073.72 1602.68 1124.53 1615.13 1092.81 1186.00 520.56 457.95 638.13 442.01 717.81 416.42 MIN: 1418.92 MIN: 1016.27 MIN: 1268.13 MIN: 1050.25 MIN: 1226.35 MIN: 1014.43 MIN: 1109.52 MIN: 491.07 MIN: 415.28 MIN: 586.68 MIN: 414.92 MIN: 671.06 MIN: 392.54 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
CloudSuite Web Serving Load Scale: 100 OpenBenchmarking.org ops/sec, More Is Better CloudSuite Web Serving Load Scale: 100 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2 4 6 8 10 7.333 5.550 7.583 5.300 7.417 5.417 6.583 7.100 7.517 7.350 7.517 7.183 7.383 7.533
CloudSuite Graph Analytics GraphX Algorithm: Connected Components OpenBenchmarking.org ms, Fewer Is Better CloudSuite Graph Analytics 4.0 GraphX Algorithm: Connected Components EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 4K 8K 12K 16K 20K SE +/- 216.00, N = 15 SE +/- 400.63, N = 15 SE +/- 188.00, N = 15 SE +/- 176.86, N = 15 SE +/- 194.18, N = 13 SE +/- 134.07, N = 3 SE +/- 220.91, N = 15 SE +/- 128.32, N = 15 SE +/- 97.53, N = 3 SE +/- 180.53, N = 15 SE +/- 140.39, N = 15 SE +/- 57.52, N = 3 SE +/- 155.90, N = 15 SE +/- 268.97, N = 12 15718 14547 14011 14426 13102 13891 13358 13169 14285 14751 13542 13551 17820 14408
SVT-HEVC Tuning: 1 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-HEVC 1.5.0 Tuning: 1 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 3.79 7.28 4.89 9.18 6.22 11.56 6.69 9.79 4.40 8.25 4.09 7.90 3.11 6.12 1. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt
oneDNN Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1100 2200 3300 4400 5500 SE +/- 10.84, N = 3 SE +/- 10.97, N = 3 SE +/- 26.23, N = 3 SE +/- 21.33, N = 15 SE +/- 16.16, N = 3 SE +/- 4.18, N = 3 SE +/- 24.77, N = 3 SE +/- 2.55, N = 3 SE +/- 7.95, N = 4 SE +/- 8.94, N = 3 SE +/- 2.77, N = 3 SE +/- 4.00, N = 3 SE +/- 5.21, N = 3 2958.98 1797.92 2774.02 1957.83 5074.57 1974.31 2720.07 901.44 681.16 1086.78 703.51 1289.58 702.69 MIN: 2682.11 MIN: 1725.59 MIN: 2185.12 MIN: 1702.97 MIN: 4606.82 MIN: 1898.4 MIN: 2539.45 MIN: 839.85 MIN: 629.82 MIN: 977.32 MIN: 667.26 MIN: 1210.65 MIN: 661.24 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
GPAW Input: Carbon Nanotube OpenBenchmarking.org Seconds, Fewer Is Better GPAW 22.1 Input: Carbon Nanotube EPYC 7343 2P EPYC 7413 2P EPYC 7513 2P 100 200 300 400 500 SE +/- 0.65, N = 3 SE +/- 0.96, N = 3 SE +/- 1.19, N = 3 444.07 417.51 398.99 1. (CC) gcc options: -shared -lxc -lblas -lmpi -O2 -fexceptions -pipe -m64 -march=x86-64-v2 -mtune=generic -fcf-protection -fPIC -fwrapv -UNDEBUG -std=c99
RocksDB Test: Random Fill OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Fill EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K SE +/- 582.91, N = 3 SE +/- 6147.44, N = 3 SE +/- 1471.77, N = 3 SE +/- 1896.83, N = 3 SE +/- 4422.55, N = 15 SE +/- 1034.90, N = 3 SE +/- 2590.86, N = 3 SE +/- 2134.61, N = 3 SE +/- 1945.00, N = 3 SE +/- 2897.98, N = 3 SE +/- 5000.73, N = 3 SE +/- 3806.40, N = 3 SE +/- 6232.77, N = 15 316199 740490 306931 809625 328435 743355 455327 1088420 481703 1272718 590231 1300143 908869 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
RocksDB Test: Update Random OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Update Random EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200K 400K 600K 800K 1000K SE +/- 17553.74, N = 12 SE +/- 708.38, N = 3 SE +/- 3018.40, N = 3 SE +/- 1717.10, N = 3 SE +/- 3148.37, N = 3 SE +/- 2864.72, N = 3 SE +/- 339.25, N = 3 SE +/- 1039.48, N = 3 SE +/- 379.98, N = 3 SE +/- 1500.76, N = 3 SE +/- 9205.01, N = 15 SE +/- 648.59, N = 3 SE +/- 1819.77, N = 3 481479 638378 336131 707656 351517 688172 436633 793742 466697 743700 640738 700379 803231 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
nginx Connections: 500 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 500 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40K 80K 120K 160K 200K SE +/- 185.36, N = 3 SE +/- 37.87, N = 3 SE +/- 279.41, N = 3 SE +/- 89.54, N = 3 SE +/- 800.94, N = 3 SE +/- 72.87, N = 3 SE +/- 309.16, N = 3 SE +/- 37.98, N = 3 SE +/- 313.96, N = 3 SE +/- 169.87, N = 3 SE +/- 580.70, N = 3 SE +/- 92.60, N = 3 SE +/- 232.73, N = 3 157128.24 131406.38 133788.29 159784.56 140932.43 165787.42 156012.00 160307.52 180812.11 141031.60 204325.45 113630.04 207339.64 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl
nginx Connections: 200 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 200 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40K 80K 120K 160K 200K SE +/- 248.07, N = 3 SE +/- 83.69, N = 3 SE +/- 288.51, N = 3 SE +/- 142.56, N = 3 SE +/- 704.77, N = 3 SE +/- 73.04, N = 3 SE +/- 498.75, N = 3 SE +/- 41.84, N = 3 SE +/- 271.76, N = 3 SE +/- 76.21, N = 3 SE +/- 512.32, N = 3 SE +/- 24.68, N = 3 SE +/- 149.37, N = 3 155325.61 129033.29 135890.54 160998.23 151573.48 161270.01 167224.22 160541.79 205570.62 141544.55 205476.78 118110.63 207770.19 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl
OpenRadioss Model: Bumper Beam OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bumper Beam EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.28, N = 3 SE +/- 0.10, N = 3 SE +/- 0.17, N = 3 SE +/- 0.15, N = 3 SE +/- 0.04, N = 3 SE +/- 0.14, N = 3 SE +/- 0.20, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 3 SE +/- 0.32, N = 3 SE +/- 0.04, N = 3 118.30 105.44 96.53 93.97 91.55 111.00 91.34 110.30 85.45 122.43 94.03
OpenRadioss Model: Rubber O-Ring Seal Installation OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.25, N = 3 SE +/- 0.08, N = 3 SE +/- 0.61, N = 3 SE +/- 0.18, N = 3 SE +/- 0.11, N = 3 SE +/- 0.35, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 SE +/- 0.00, N = 3 SE +/- 0.15, N = 3 SE +/- 0.30, N = 3 103.03 88.65 84.32 79.17 89.74 108.37 89.85 107.07 78.89 124.37 83.81
LuxCoreRender Scene: LuxCore Benchmark - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: LuxCore Benchmark - Acceleration: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 15 2.72 4.46 3.68 5.56 4.64 6.75 4.74 6.70 3.67 6.57 3.29 6.16 2.59 4.68 MIN: 0.96 / MAX: 3.2 MIN: 1.61 / MAX: 5.3 MIN: 1.36 / MAX: 4.33 MIN: 1.97 / MAX: 6.64 MIN: 1.79 / MAX: 5.4 MIN: 2.41 / MAX: 8.1 MIN: 1.8 / MAX: 5.56 MIN: 2.57 / MAX: 7.82 MIN: 1.31 / MAX: 4.39 MIN: 2.6 / MAX: 7.71 MIN: 1.23 / MAX: 3.85 MIN: 2.54 / MAX: 7.19 MIN: 0.88 / MAX: 3.07 MIN: 1.67 / MAX: 5.69
CloudSuite Graph Analytics GraphX Algorithm: Page Rank OpenBenchmarking.org ms, Fewer Is Better CloudSuite Graph Analytics 4.0 GraphX Algorithm: Page Rank EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3K 6K 9K 12K 15K SE +/- 84.93, N = 3 SE +/- 190.69, N = 13 SE +/- 82.57, N = 15 SE +/- 184.92, N = 15 SE +/- 135.36, N = 3 SE +/- 118.51, N = 3 SE +/- 79.02, N = 3 SE +/- 49.21, N = 3 SE +/- 115.60, N = 15 SE +/- 108.31, N = 15 SE +/- 106.07, N = 15 SE +/- 69.03, N = 14 SE +/- 97.49, N = 15 SE +/- 39.28, N = 3 11525 9820 9815 9831 9917 9587 9247 9112 11245 11235 10340 10381 13034 10597
nginx Connections: 1000 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 1000 EPYC 7343 2P EPYC 7413 EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40K 80K 120K 160K 200K SE +/- 189.01, N = 3 SE +/- 1390.17, N = 3 SE +/- 94.36, N = 3 SE +/- 336.74, N = 3 SE +/- 148.74, N = 3 SE +/- 323.88, N = 3 SE +/- 234.38, N = 3 SE +/- 416.78, N = 3 SE +/- 108.10, N = 3 SE +/- 520.06, N = 3 SE +/- 58.40, N = 3 SE +/- 140.88, N = 3 151418.97 129682.72 156398.74 135921.70 165810.67 151997.72 164486.94 178255.95 153700.70 200467.73 109860.58 199978.55 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl
RocksDB Test: Read Random Write Random OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Read Random Write Random EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 600K 1200K 1800K 2400K 3000K SE +/- 3492.11, N = 3 SE +/- 2301.51, N = 3 SE +/- 6678.29, N = 3 SE +/- 1879.76, N = 3 SE +/- 5136.66, N = 3 SE +/- 17808.71, N = 3 SE +/- 27203.96, N = 6 SE +/- 2675.18, N = 3 SE +/- 17390.98, N = 15 SE +/- 4554.38, N = 3 SE +/- 14296.96, N = 3 SE +/- 2003.10, N = 3 SE +/- 37734.79, N = 3 2195191 2369439 2190994 2750066 2204871 2690298 2761836 2770547 2579926 2420422 2779890 2311235 2762454 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
RocksDB Test: Random Fill Sync OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Fill Sync EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 80K 160K 240K 320K 400K SE +/- 335.00, N = 3 SE +/- 831.59, N = 3 SE +/- 1013.52, N = 3 SE +/- 911.55, N = 3 SE +/- 1581.82, N = 3 SE +/- 1077.11, N = 3 SE +/- 1530.69, N = 3 SE +/- 79.36, N = 3 SE +/- 931.26, N = 3 SE +/- 194.11, N = 3 SE +/- 6251.07, N = 15 SE +/- 98.97, N = 3 SE +/- 2669.53, N = 3 170828 199221 165480 238127 197227 233743 267282 297029 307133 277553 367162 208713 289896 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
CloudSuite In-Memory Analytics Training Set Size: Small OpenBenchmarking.org ms, Fewer Is Better CloudSuite In-Memory Analytics 4.0 Training Set Size: Small EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40K 80K 120K 160K 200K SE +/- 13.02, N = 3 SE +/- 136.22, N = 3 SE +/- 159.06, N = 3 SE +/- 1128.62, N = 3 SE +/- 101.02, N = 3 SE +/- 409.71, N = 3 SE +/- 151.00, N = 3 SE +/- 820.85, N = 3 SE +/- 84.36, N = 3 SE +/- 90.73, N = 3 SE +/- 80.23, N = 3 SE +/- 445.33, N = 3 SE +/- 48.64, N = 3 SE +/- 203.67, N = 3 13995 46059 23575 111224 36808 181349 37315 136721 36646 147653 21960 82287 13855 41096
nginx Connections: 100 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 100 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7543 Xeon Gold 6338 Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50K 100K 150K 200K 250K SE +/- 889.98, N = 3 SE +/- 7.14, N = 3 SE +/- 1585.18, N = 5 SE +/- 66.37, N = 3 SE +/- 118.51, N = 3 SE +/- 57.06, N = 3 SE +/- 68.69, N = 3 SE +/- 497.21, N = 3 SE +/- 93.41, N = 3 SE +/- 249.31, N = 3 146481.53 127405.11 144891.45 152248.92 147786.59 151274.54 140495.61 225527.80 118699.47 199748.09 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl
VVenC Video Input: Bosphorus 4K - Video Preset: Faster OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Faster EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.024, N = 3 SE +/- 0.069, N = 3 SE +/- 0.011, N = 3 SE +/- 0.066, N = 3 SE +/- 0.005, N = 3 SE +/- 0.032, N = 3 SE +/- 0.013, N = 3 SE +/- 0.013, N = 3 SE +/- 0.012, N = 3 SE +/- 0.036, N = 3 SE +/- 0.010, N = 3 SE +/- 0.007, N = 3 SE +/- 0.002, N = 3 SE +/- 0.011, N = 3 9.370 10.051 9.431 9.526 9.736 9.445 9.984 9.110 7.981 8.128 8.830 8.908 8.552 8.929 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1000 2000 3000 4000 5000 SE +/- 10.65, N = 3 SE +/- 0.75, N = 3 SE +/- 4.10, N = 3 SE +/- 0.56, N = 3 SE +/- 9.18, N = 3 SE +/- 2.22, N = 3 SE +/- 7.16, N = 3 SE +/- 5.09, N = 3 SE +/- 0.75, N = 3 SE +/- 0.75, N = 3 SE +/- 0.81, N = 3 SE +/- 1.46, N = 3 SE +/- 0.68, N = 3 SE +/- 0.85, N = 3 2790.52 1445.13 3275.51 1688.62 3561.39 1803.09 3186.87 4538.43 2962.18 1467.67 2358.37 1198.22 2047.93 1043.48 MIN: 2485.81 / MAX: 2884.12 MIN: 1428.3 / MAX: 1517.31 MIN: 2779.4 / MAX: 3463.81 MIN: 1420.61 / MAX: 1780.64 MIN: 3211.28 / MAX: 3765.97 MIN: 1636.35 / MAX: 1876.9 MIN: 2866.19 / MAX: 3374.03 MIN: 3564.16 / MAX: 4986.6 MIN: 2252.85 / MAX: 3160.04 MIN: 1203.01 / MAX: 1562.63 MIN: 1772.66 / MAX: 2525.32 MIN: 911.32 / MAX: 1454.11 MIN: 1604.74 / MAX: 2166.44 MIN: 886.86 / MAX: 1166.18 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 2.84 5.53 3.61 7.01 4.44 8.82 4.95 6.92 5.36 10.84 5.03 9.94 3.87 7.62 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1000 2000 3000 4000 5000 SE +/- 1.49, N = 3 SE +/- 1.35, N = 3 SE +/- 7.34, N = 3 SE +/- 0.39, N = 3 SE +/- 3.85, N = 3 SE +/- 2.09, N = 3 SE +/- 4.08, N = 3 SE +/- 2.29, N = 3 SE +/- 2.23, N = 3 SE +/- 0.13, N = 3 SE +/- 0.31, N = 3 SE +/- 1.27, N = 3 SE +/- 1.13, N = 3 SE +/- 3.51, N = 3 2813.45 1447.06 3280.27 1689.48 3537.87 1804.95 3217.57 4533.12 3023.56 1495.92 2400.77 1217.97 2081.75 1072.35 MIN: 2640.81 / MAX: 2908.21 MIN: 1431.68 / MAX: 1476.13 MIN: 1686.07 / MAX: 3445.04 MIN: 1404.52 / MAX: 1764.68 MIN: 1864.67 / MAX: 3792.11 MIN: 1665.93 / MAX: 1885.89 MIN: 2966.37 / MAX: 3376.92 MIN: 3616.62 / MAX: 4976.85 MIN: 2431.21 / MAX: 3241.15 MIN: 1185.61 / MAX: 1589.83 MIN: 1826.07 / MAX: 2573.73 MIN: 940.6 / MAX: 1321.99 MIN: 951.54 / MAX: 2214.54 MIN: 885.75 / MAX: 1124.15 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 2.82 5.52 3.59 7.01 4.45 8.81 4.94 6.92 5.26 10.63 4.95 9.78 3.80 7.42 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
LuxCoreRender Scene: Danish Mood - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Danish Mood - Acceleration: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 5 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 2.48 4.10 3.33 5.14 4.35 6.43 4.36 6.10 3.47 6.09 3.04 5.84 2.34 4.46 MIN: 0.84 / MAX: 2.91 MIN: 1.58 / MAX: 4.79 MIN: 1.21 / MAX: 3.89 MIN: 1.96 / MAX: 6.18 MIN: 1.68 / MAX: 5.04 MIN: 2.55 / MAX: 7.63 MIN: 1.72 / MAX: 5.07 MIN: 2.45 / MAX: 7.16 MIN: 1.22 / MAX: 4.08 MIN: 2.47 / MAX: 7.28 MIN: 1.09 / MAX: 3.58 MIN: 2.6 / MAX: 6.73 MIN: 0.74 / MAX: 2.79 MIN: 1.83 / MAX: 5.18
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 700 1400 2100 2800 3500 SE +/- 3.34, N = 3 SE +/- 0.58, N = 3 SE +/- 2.73, N = 3 SE +/- 1.48, N = 3 SE +/- 2.40, N = 3 SE +/- 1.75, N = 3 SE +/- 9.46, N = 3 SE +/- 4.99, N = 3 SE +/- 6.05, N = 3 SE +/- 1.93, N = 3 SE +/- 7.34, N = 3 SE +/- 0.46, N = 3 SE +/- 3.43, N = 3 SE +/- 1.08, N = 3 1850.23 1028.98 2183.99 1190.68 2369.52 1272.58 2162.68 3072.39 1771.70 862.09 1413.05 689.05 1232.64 604.17 MIN: 1073.49 / MAX: 1950.78 MIN: 1009.62 / MAX: 1100.65 MIN: 1919.34 / MAX: 2280.72 MIN: 1162.02 / MAX: 1273 MIN: 1311.77 / MAX: 2481.25 MIN: 1233.3 / MAX: 1361.68 MIN: 1785 / MAX: 2247.11 MIN: 2717.45 / MAX: 3200.51 MIN: 1362.81 / MAX: 1851.05 MIN: 623.51 / MAX: 953.92 MIN: 686.62 / MAX: 1507.17 MIN: 523.39 / MAX: 772.01 MIN: 935.61 / MAX: 1312.43 MIN: 472.25 / MAX: 677.41 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 4.27 7.76 5.44 10.06 6.67 12.55 7.32 10.33 8.96 18.48 8.43 17.34 6.43 13.20 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
FFmpeg Encoder: libx265 - Scenario: Live OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Live EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.52, N = 3 SE +/- 0.09, N = 3 SE +/- 0.19, N = 3 SE +/- 0.17, N = 3 SE +/- 0.16, N = 3 SE +/- 0.48, N = 3 SE +/- 0.11, N = 3 SE +/- 0.21, N = 3 SE +/- 0.10, N = 3 SE +/- 0.13, N = 3 SE +/- 0.10, N = 3 SE +/- 0.21, N = 3 SE +/- 0.44, N = 3 SE +/- 0.19, N = 3 123.76 103.93 117.23 98.37 118.65 101.05 113.57 105.50 112.80 111.60 122.36 121.08 124.46 121.92 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Live OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Live EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12 24 36 48 60 SE +/- 0.17, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.24, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.14, N = 3 SE +/- 0.06, N = 3 40.81 48.59 43.08 51.34 42.56 49.98 44.47 47.87 44.77 45.25 41.27 41.71 40.58 41.42 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
LuxCoreRender Scene: Orange Juice - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Orange Juice - Acceleration: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.16, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 5.05 8.59 6.56 11.24 8.18 13.40 8.42 12.44 7.01 12.30 6.46 11.19 5.01 8.77 MIN: 4.74 / MAX: 5.15 MIN: 7.51 / MAX: 9.26 MIN: 5.93 / MAX: 6.83 MIN: 9.76 / MAX: 12.48 MIN: 7.2 / MAX: 8.7 MIN: 11.54 / MAX: 15.77 MIN: 7.45 / MAX: 9.01 MIN: 10.8 / MAX: 14.28 MIN: 6.3 / MAX: 7.56 MIN: 10.28 / MAX: 14.34 MIN: 5.76 / MAX: 7.02 MIN: 9.51 / MAX: 13.26 MIN: 4.73 / MAX: 5.13 MIN: 7.63 / MAX: 9.54
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300 600 900 1200 1500 SE +/- 0.21, N = 3 SE +/- 0.12, N = 3 SE +/- 0.56, N = 3 SE +/- 0.04, N = 3 SE +/- 0.48, N = 3 SE +/- 0.49, N = 3 SE +/- 1.20, N = 3 SE +/- 0.66, N = 3 SE +/- 0.13, N = 3 SE +/- 0.07, N = 3 SE +/- 0.25, N = 3 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 854.22 423.55 979.21 483.37 1038.36 507.62 961.41 1279.15 450.58 217.18 360.49 177.69 313.14 155.15 MIN: 777.98 / MAX: 878.94 MIN: 415.99 / MAX: 455.1 MIN: 861.53 / MAX: 1015.88 MIN: 438.12 / MAX: 515.6 MIN: 906.21 / MAX: 1056.67 MIN: 474.68 / MAX: 549.27 MIN: 831.19 / MAX: 978.3 MIN: 1018.37 / MAX: 1317.05 MIN: 338.75 / MAX: 484.67 MIN: 164.55 / MAX: 257.56 MIN: 257.91 / MAX: 392.73 MIN: 141.05 / MAX: 204.41 MIN: 185.19 / MAX: 336.95 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 16 32 48 64 80 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 9.36 18.85 12.17 24.72 15.29 31.43 16.56 24.81 35.43 73.58 33.22 67.44 25.52 51.51 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
VVenC Video Input: Bosphorus 1080p - Video Preset: Fast OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.023, N = 3 SE +/- 0.025, N = 3 SE +/- 0.021, N = 3 SE +/- 0.008, N = 3 SE +/- 0.009, N = 3 SE +/- 0.008, N = 3 SE +/- 0.008, N = 3 SE +/- 0.010, N = 3 SE +/- 0.015, N = 3 SE +/- 0.021, N = 3 SE +/- 0.012, N = 3 SE +/- 0.009, N = 3 SE +/- 0.004, N = 3 SE +/- 0.019, N = 3 10.496 11.054 10.188 10.393 10.350 10.329 10.555 9.553 8.394 8.721 9.153 9.430 9.107 9.609 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60 120 180 240 300 SE +/- 0.41, N = 3 SE +/- 0.16, N = 3 SE +/- 0.94, N = 3 SE +/- 0.14, N = 3 SE +/- 0.84, N = 3 SE +/- 0.13, N = 3 SE +/- 1.43, N = 3 SE +/- 0.24, N = 3 SE +/- 0.16, N = 3 SE +/- 0.13, N = 3 SE +/- 0.26, N = 3 SE +/- 0.14, N = 3 SE +/- 0.09, N = 3 SE +/- 0.07, N = 3 162.40 84.87 197.58 100.17 212.22 105.07 190.87 274.66 142.53 78.16 116.82 65.81 102.51 55.49 MIN: 81.47 / MAX: 190.75 MIN: 79.52 / MAX: 104.17 MIN: 108.45 / MAX: 224.88 MIN: 87.19 / MAX: 120.18 MIN: 102.13 / MAX: 251.51 MIN: 87.23 / MAX: 132.74 MIN: 91.92 / MAX: 221.58 MIN: 113.93 / MAX: 346.09 MIN: 52.25 / MAX: 172.52 MIN: 70.17 / MAX: 99.06 MIN: 63.95 / MAX: 139.61 MIN: 58.3 / MAX: 79.61 MIN: 56.14 / MAX: 121.15 MIN: 48.46 / MAX: 70.39 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.13, N = 3 SE +/- 0.19, N = 3 SE +/- 0.29, N = 3 SE +/- 0.17, N = 3 SE +/- 0.31, N = 3 SE +/- 0.21, N = 3 SE +/- 0.65, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 3 SE +/- 0.33, N = 3 SE +/- 0.24, N = 3 SE +/- 0.38, N = 3 SE +/- 0.06, N = 3 SE +/- 0.18, N = 3 49.20 94.18 60.67 119.68 75.28 152.10 83.73 116.30 112.12 204.17 102.67 181.98 77.99 144.01 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 12.37 7.05 15.57 9.12 16.18 9.32 14.37 20.72 17.77 9.85 14.78 8.65 12.93 7.41 MIN: 7.65 / MAX: 28.74 MIN: 6.43 / MAX: 17.91 MIN: 8.87 / MAX: 31.65 MIN: 7.26 / MAX: 24.13 MIN: 8.55 / MAX: 33.46 MIN: 7.86 / MAX: 22.87 MIN: 8.67 / MAX: 30.82 MIN: 16.73 / MAX: 74.02 MIN: 9.82 / MAX: 36.18 MIN: 8.63 / MAX: 22.81 MIN: 8.27 / MAX: 28.31 MIN: 7.32 / MAX: 20.32 MIN: 7.44 / MAX: 25.18 MIN: 6.33 / MAX: 18.13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 400 800 1200 1600 2000 SE +/- 2.63, N = 3 SE +/- 1.01, N = 3 SE +/- 0.50, N = 3 SE +/- 0.70, N = 3 SE +/- 0.76, N = 3 SE +/- 3.83, N = 3 SE +/- 3.78, N = 3 SE +/- 1.02, N = 3 SE +/- 0.64, N = 3 SE +/- 2.61, N = 3 SE +/- 1.01, N = 3 SE +/- 1.68, N = 3 SE +/- 0.53, N = 3 SE +/- 1.01, N = 3 646.15 1132.27 769.91 1313.76 987.77 1713.90 1112.62 1542.73 899.05 1619.83 810.68 1382.22 617.71 1076.16 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 12.22 6.42 14.38 7.63 14.86 7.62 13.70 18.42 9.61 4.69 7.75 3.98 6.79 3.41 MIN: 8.5 / MAX: 28.01 MIN: 6.15 / MAX: 15.78 MIN: 8.17 / MAX: 28.75 MIN: 6.86 / MAX: 22.57 MIN: 8.08 / MAX: 33.72 MIN: 7.15 / MAX: 31.91 MIN: 7.41 / MAX: 31.1 MIN: 9.93 / MAX: 52.04 MIN: 5.23 / MAX: 31.29 MIN: 4.17 / MAX: 21.97 MIN: 4.25 / MAX: 40.39 MIN: 3.28 / MAX: 15.38 MIN: 3.7 / MAX: 21.83 MIN: 2.97 / MAX: 14.93 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 700 1400 2100 2800 3500 SE +/- 0.19, N = 3 SE +/- 0.73, N = 3 SE +/- 1.37, N = 3 SE +/- 7.85, N = 3 SE +/- 0.12, N = 3 SE +/- 0.29, N = 3 SE +/- 0.71, N = 3 SE +/- 1.60, N = 3 SE +/- 1.15, N = 3 SE +/- 1.96, N = 3 SE +/- 1.94, N = 3 SE +/- 5.21, N = 3 SE +/- 0.17, N = 3 SE +/- 1.91, N = 3 654.14 1243.24 833.99 1570.38 1076.30 2097.59 1166.69 1735.57 1661.48 3402.82 1544.95 3005.72 1175.72 2339.16 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 8 16 24 32 40 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 19.76 10.13 23.18 11.70 24.55 13.32 22.30 30.95 35.34 35.12 28.09 28.73 24.93 24.61 MIN: 10.1 / MAX: 35.55 MIN: 9.28 / MAX: 20.91 MIN: 12.53 / MAX: 39.62 MIN: 10.76 / MAX: 20.03 MIN: 13.09 / MAX: 41.71 MIN: 10.8 / MAX: 27.29 MIN: 11.46 / MAX: 38.87 MIN: 16.7 / MAX: 61.98 MIN: 17.29 / MAX: 68.72 MIN: 31.16 / MAX: 58.07 MIN: 13.13 / MAX: 55.07 MIN: 25.35 / MAX: 48.34 MIN: 12.1 / MAX: 57.1 MIN: 21.31 / MAX: 35.8 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 400 800 1200 1600 2000 SE +/- 0.27, N = 3 SE +/- 0.57, N = 3 SE +/- 0.42, N = 3 SE +/- 0.89, N = 3 SE +/- 0.67, N = 3 SE +/- 1.42, N = 3 SE +/- 0.47, N = 3 SE +/- 0.61, N = 3 SE +/- 1.35, N = 3 SE +/- 2.62, N = 3 SE +/- 0.30, N = 3 SE +/- 1.17, N = 3 SE +/- 1.16, N = 3 SE +/- 1.02, N = 3 404.56 788.14 517.32 1024.68 651.20 1196.03 716.95 1033.39 904.01 1813.34 853.15 1664.20 640.88 1296.57 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.3915 0.783 1.1745 1.566 1.9575 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.11 1.14 1.27 1.30 1.37 1.39 1.27 1.74 1.23 1.16 1.05 0.99 0.92 0.86 MIN: 0.62 / MAX: 14.15 MIN: 0.96 / MAX: 12.95 MIN: 0.72 / MAX: 14.84 MIN: 1.07 / MAX: 14.22 MIN: 0.85 / MAX: 19.76 MIN: 1.14 / MAX: 14.4 MIN: 0.71 / MAX: 14.55 MIN: 0.91 / MAX: 22.45 MIN: 0.58 / MAX: 21.43 MIN: 0.91 / MAX: 14.56 MIN: 0.49 / MAX: 15.59 MIN: 0.73 / MAX: 14.31 MIN: 0.52 / MAX: 14.11 MIN: 0.67 / MAX: 13.21 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12K 24K 36K 48K 60K SE +/- 3.86, N = 3 SE +/- 47.15, N = 3 SE +/- 25.63, N = 3 SE +/- 96.63, N = 3 SE +/- 36.34, N = 3 SE +/- 31.93, N = 3 SE +/- 28.61, N = 3 SE +/- 463.83, N = 3 SE +/- 22.82, N = 3 SE +/- 28.36, N = 3 SE +/- 19.47, N = 3 SE +/- 11.43, N = 3 SE +/- 12.78, N = 3 SE +/- 51.11, N = 3 14256.40 27742.34 18711.92 36411.01 23116.82 45746.27 25079.41 34339.21 25216.38 54275.42 22510.58 47664.17 17148.89 36784.83 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6 12 18 24 30 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 17.50 16.53 19.80 18.66 21.03 19.64 19.63 25.83 9.55 8.86 7.75 7.30 6.80 6.41 MIN: 9.9 / MAX: 31.67 MIN: 15.85 / MAX: 27.79 MIN: 9.47 / MAX: 32.84 MIN: 17.49 / MAX: 31.43 MIN: 10.07 / MAX: 37.02 MIN: 17.9 / MAX: 30.08 MIN: 10.05 / MAX: 32.68 MIN: 12.36 / MAX: 42.4 MIN: 5.64 / MAX: 161.27 MIN: 7.46 / MAX: 22.29 MIN: 4.53 / MAX: 25.85 MIN: 6.03 / MAX: 21.33 MIN: 4.77 / MAX: 21.69 MIN: 5.31 / MAX: 19.26 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1500 3000 4500 6000 7500 SE +/- 0.17, N = 3 SE +/- 0.17, N = 3 SE +/- 0.09, N = 3 SE +/- 0.28, N = 3 SE +/- 0.26, N = 3 SE +/- 1.61, N = 3 SE +/- 0.33, N = 3 SE +/- 1.30, N = 3 SE +/- 1.10, N = 3 SE +/- 0.75, N = 3 SE +/- 0.53, N = 3 SE +/- 3.20, N = 3 SE +/- 0.48, N = 3 SE +/- 2.46, N = 3 913.75 1934.07 1211.31 2570.67 1520.46 3255.75 1628.99 2475.95 3345.71 7209.16 3090.28 6564.47 2347.83 4979.27 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 8 16 24 32 40 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.10, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 20.51 10.88 25.03 14.07 26.50 13.62 23.66 34.00 33.19 17.01 26.68 14.19 21.72 11.49 MIN: 10.96 / MAX: 31.38 MIN: 9.85 / MAX: 18.79 MIN: 17.49 / MAX: 46.59 MIN: 11.6 / MAX: 34.29 MIN: 15.94 / MAX: 62.11 MIN: 11.93 / MAX: 37.05 MIN: 13.21 / MAX: 47.37 MIN: 20.86 / MAX: 90.26 MIN: 14.88 / MAX: 64.4 MIN: 12.34 / MAX: 32.47 MIN: 13.7 / MAX: 43.32 MIN: 10.82 / MAX: 27.29 MIN: 10.48 / MAX: 36.43 MIN: 9.55 / MAX: 23.06 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300 600 900 1200 1500 SE +/- 0.47, N = 3 SE +/- 1.53, N = 3 SE +/- 0.91, N = 3 SE +/- 1.28, N = 3 SE +/- 2.26, N = 3 SE +/- 0.46, N = 3 SE +/- 0.75, N = 3 SE +/- 0.33, N = 3 SE +/- 0.77, N = 3 SE +/- 0.97, N = 3 SE +/- 0.55, N = 3 SE +/- 0.67, N = 3 SE +/- 0.43, N = 3 SE +/- 1.91, N = 3 389.71 734.99 479.00 852.08 603.36 1173.42 675.88 940.29 481.60 939.07 449.39 844.38 368.02 695.06 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.4275 0.855 1.2825 1.71 2.1375 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.21 1.23 1.39 1.40 1.49 1.50 1.37 1.90 1.38 1.32 1.19 1.14 1.04 0.99 MIN: 0.71 / MAX: 41.75 MIN: 1.03 / MAX: 14.15 MIN: 0.77 / MAX: 14.54 MIN: 1.13 / MAX: 14.36 MIN: 0.7 / MAX: 73.62 MIN: 1.19 / MAX: 14.26 MIN: 0.75 / MAX: 14.85 MIN: 0.99 / MAX: 27.38 MIN: 0.61 / MAX: 20.84 MIN: 1.02 / MAX: 14.4 MIN: 0.57 / MAX: 16.29 MIN: 0.85 / MAX: 14.64 MIN: 0.63 / MAX: 14.02 MIN: 0.73 / MAX: 12.92 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 10K 20K 30K 40K 50K SE +/- 16.19, N = 3 SE +/- 47.98, N = 3 SE +/- 2.86, N = 3 SE +/- 25.78, N = 3 SE +/- 9.24, N = 3 SE +/- 39.42, N = 3 SE +/- 8.38, N = 3 SE +/- 113.09, N = 3 SE +/- 9.27, N = 3 SE +/- 9.04, N = 3 SE +/- 22.59, N = 3 SE +/- 46.35, N = 3 SE +/- 6.67, N = 3 SE +/- 51.77, N = 3 13149.71 25795.58 17211.28 34019.21 21308.51 42487.49 23118.27 33271.17 22808.14 47801.07 20000.76 41669.50 15262.36 32137.13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenSSL Algorithm: RSA4096 OpenBenchmarking.org verify/s, More Is Better OpenSSL 3.0 Algorithm: RSA4096 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200K 400K 600K 800K 1000K SE +/- 27.40, N = 3 SE +/- 36.78, N = 3 SE +/- 51.25, N = 3 SE +/- 52.75, N = 3 SE +/- 556.85, N = 3 SE +/- 55.88, N = 3 SE +/- 34.51, N = 3 SE +/- 53.07, N = 3 SE +/- 41.22, N = 3 SE +/- 40.84, N = 3 SE +/- 54.53, N = 3 SE +/- 292.45, N = 3 SE +/- 83.11, N = 3 SE +/- 232.08, N = 3 287549.0 574456.9 390326.3 778483.0 501938.9 1003089.4 522787.3 823388.7 419447.9 838351.8 398769.3 798077.1 286703.7 580306.3 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenSSL Algorithm: RSA4096 OpenBenchmarking.org sign/s, More Is Better OpenSSL 3.0 Algorithm: RSA4096 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3K 6K 9K 12K 15K SE +/- 3.48, N = 3 SE +/- 5.12, N = 3 SE +/- 0.09, N = 3 SE +/- 9.47, N = 3 SE +/- 5.98, N = 3 SE +/- 12.10, N = 3 SE +/- 7.21, N = 3 SE +/- 10.29, N = 3 SE +/- 0.27, N = 3 SE +/- 0.24, N = 3 SE +/- 13.25, N = 3 SE +/- 5.32, N = 3 SE +/- 0.18, N = 3 SE +/- 0.90, N = 3 4398.6 8794.6 5947.9 11846.8 7637.8 15222.3 7963.1 12568.1 6442.7 12874.9 6109.7 12235.1 4397.2 8906.1 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 150 300 450 600 750 SE +/- 0.07, N = 3 SE +/- 0.14, N = 3 SE +/- 0.16, N = 3 SE +/- 0.27, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.64, N = 3 SE +/- 0.21, N = 3 SE +/- 0.50, N = 3 SE +/- 0.38, N = 3 SE +/- 0.45, N = 3 SE +/- 0.27, N = 3 SE +/- 0.17, N = 3 450.60 475.87 515.06 544.62 546.28 575.37 507.66 684.85 471.63 488.41 386.88 399.33 338.98 350.63
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 15 30 45 60 75 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 17.74 33.42 23.29 43.91 29.27 55.47 31.39 46.68 33.90 65.21 31.01 59.97 23.59 45.55
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.33, N = 3 SE +/- 0.07, N = 3 SE +/- 0.15, N = 3 SE +/- 0.16, N = 3 SE +/- 0.21, N = 3 SE +/- 1.13, N = 3 SE +/- 0.50, N = 3 SE +/- 0.17, N = 3 SE +/- 0.38, N = 3 SE +/- 0.95, N = 3 SE +/- 0.70, N = 3 SE +/- 0.98, N = 3 SE +/- 0.99, N = 3 SE +/- 0.32, N = 3 152.83 164.14 178.21 187.68 193.47 204.23 174.36 241.33 173.20 179.89 144.31 151.86 126.16 127.16
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.12, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.85, N = 3 SE +/- 0.28, N = 3 SE +/- 0.05, N = 3 SE +/- 0.15, N = 3 SE +/- 0.99, N = 3 SE +/- 0.41, N = 3 SE +/- 1.12, N = 3 SE +/- 0.53, N = 3 SE +/- 0.30, N = 3 52.26 97.20 67.20 127.54 82.55 156.24 91.57 132.30 92.27 177.59 83.03 157.81 63.35 125.60
RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Read EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60M 120M 180M 240M 300M SE +/- 286135.95, N = 3 SE +/- 547389.34, N = 3 SE +/- 885950.65, N = 3 SE +/- 207267.91, N = 3 SE +/- 716630.49, N = 3 SE +/- 275956.06, N = 3 SE +/- 795243.99, N = 3 SE +/- 260236.87, N = 3 SE +/- 2092706.33, N = 3 SE +/- 594128.06, N = 3 SE +/- 1248520.83, N = 3 SE +/- 427323.28, N = 3 SE +/- 779454.00, N = 3 181223940 120400741 238439429 150974278 299129297 161712224 246464521 113495056 226944746 104010467 210724462 77391048 154099244 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200 400 600 800 1000 SE +/- 0.72, N = 3 SE +/- 0.41, N = 3 SE +/- 0.56, N = 3 SE +/- 0.21, N = 3 SE +/- 0.05, N = 3 SE +/- 0.46, N = 3 SE +/- 0.25, N = 3 SE +/- 0.92, N = 3 SE +/- 0.28, N = 3 SE +/- 0.23, N = 3 SE +/- 0.47, N = 3 SE +/- 0.92, N = 3 SE +/- 0.43, N = 3 SE +/- 0.43, N = 3 629.19 636.28 729.31 738.78 791.97 803.45 716.02 1010.00 856.00 847.38 689.68 685.96 605.67 599.81
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 9 18 27 36 45 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 12.65 24.92 16.32 32.25 19.90 39.59 22.07 31.45 18.67 37.70 17.39 34.79 13.21 26.54
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 16 32 48 64 80 SE +/- 0.01, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.15, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.29, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 48.86 56.98 53.03 62.36 56.33 65.39 54.32 70.21 44.13 45.36 40.68 40.70 33.03 33.11
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 150 300 450 600 750 SE +/- 0.06, N = 3 SE +/- 0.45, N = 3 SE +/- 0.29, N = 3 SE +/- 0.51, N = 3 SE +/- 0.19, N = 3 SE +/- 0.82, N = 3 SE +/- 0.08, N = 3 SE +/- 0.43, N = 3 SE +/- 1.30, N = 3 SE +/- 1.61, N = 3 SE +/- 0.55, N = 3 SE +/- 4.23, N = 3 SE +/- 0.24, N = 3 SE +/- 1.35, N = 3 163.56 280.43 226.05 384.29 283.71 488.63 294.21 455.12 362.29 704.95 294.76 589.28 242.04 482.92
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200 400 600 800 1000 SE +/- 0.24, N = 3 SE +/- 0.25, N = 3 SE +/- 0.30, N = 3 SE +/- 0.75, N = 3 SE +/- 0.93, N = 3 SE +/- 0.61, N = 3 SE +/- 0.33, N = 3 SE +/- 0.83, N = 3 SE +/- 0.54, N = 3 SE +/- 0.68, N = 3 SE +/- 0.32, N = 3 SE +/- 0.49, N = 3 SE +/- 0.26, N = 3 SE +/- 0.72, N = 3 627.69 634.73 729.06 739.76 792.46 802.16 716.12 1010.58 855.78 848.91 690.24 686.45 605.57 600.72
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 9 18 27 36 45 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.10, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 12.62 25.02 16.37 32.25 19.98 39.66 22.12 31.40 18.69 37.63 17.38 34.86 13.21 26.52
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build: defconfig EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 15 30 45 60 75 SE +/- 0.47, N = 3 SE +/- 0.47, N = 3 SE +/- 0.50, N = 3 SE +/- 0.36, N = 5 SE +/- 0.51, N = 3 SE +/- 0.32, N = 5 SE +/- 0.50, N = 3 SE +/- 0.34, N = 6 SE +/- 0.61, N = 3 SE +/- 0.37, N = 5 SE +/- 0.56, N = 3 SE +/- 0.34, N = 5 SE +/- 0.52, N = 3 SE +/- 0.54, N = 3 63.49 38.97 52.72 33.82 44.75 29.78 42.09 33.75 51.84 33.04 55.49 33.79 67.65 40.40
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.09, N = 3 SE +/- 0.17, N = 3 SE +/- 0.15, N = 3 SE +/- 0.11, N = 3 SE +/- 0.41, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.59, N = 3 SE +/- 0.18, N = 3 SE +/- 0.33, N = 3 SE +/- 0.13, N = 3 SE +/- 0.51, N = 3 SE +/- 0.56, N = 3 SE +/- 0.10, N = 3 148.96 152.15 170.16 174.62 183.72 187.52 169.93 230.92 191.31 190.84 158.56 159.75 143.49 141.36
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.21, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.30, N = 3 SE +/- 0.08, N = 3 SE +/- 0.37, N = 3 SE +/- 0.06, N = 3 SE +/- 0.50, N = 3 SE +/- 0.22, N = 3 SE +/- 0.13, N = 3 53.60 104.89 70.41 137.04 86.94 170.26 93.97 138.14 83.62 167.38 75.67 150.09 55.75 113.07
oneDNN Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.6001 1.2002 1.8003 2.4004 3.0005 SE +/- 0.013668, N = 4 SE +/- 0.014584, N = 9 SE +/- 0.084917, N = 15 SE +/- 0.030750, N = 15 SE +/- 0.151936, N = 15 SE +/- 0.019283, N = 15 SE +/- 0.089162, N = 15 SE +/- 0.015644, N = 4 SE +/- 0.084321, N = 15 SE +/- 0.007581, N = 4 SE +/- 0.023972, N = 12 SE +/- 0.006714, N = 4 SE +/- 0.025234, N = 15 1.661420 1.752520 2.197500 1.594450 2.666980 1.494980 2.046400 1.395210 1.664430 1.476490 1.088780 1.694700 1.178640 MIN: 1.24 MIN: 1.5 MIN: 1.4 MIN: 1.3 MIN: 1.38 MIN: 1.25 MIN: 1.33 MIN: 1.18 MIN: 1.04 MIN: 1.22 MIN: 0.84 MIN: 1.42 MIN: 0.89 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 4 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.8503 1.7006 2.5509 3.4012 4.2515 SE +/- 0.012, N = 3 SE +/- 0.010, N = 3 SE +/- 0.016, N = 3 SE +/- 0.031, N = 3 SE +/- 0.011, N = 3 SE +/- 0.006, N = 3 SE +/- 0.007, N = 3 SE +/- 0.017, N = 3 SE +/- 0.013, N = 3 SE +/- 0.015, N = 3 SE +/- 0.013, N = 3 SE +/- 0.025, N = 3 SE +/- 0.017, N = 3 SE +/- 0.023, N = 3 3.444 3.779 3.496 3.510 3.669 3.604 3.635 3.421 3.034 3.049 3.209 3.316 3.070 3.438 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
uvg266 Video Input: Bosphorus 4K - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 9.26 14.89 10.54 16.00 13.43 17.26 14.00 13.99 9.76 12.56 9.37 14.22 8.18 13.45
Timed Godot Game Engine Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Godot Game Engine Compilation 3.2.3 Time To Compile EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.25, N = 3 SE +/- 0.05, N = 3 SE +/- 0.15, N = 3 SE +/- 0.11, N = 3 SE +/- 0.14, N = 3 74.95 64.73 57.58 55.11 50.80 69.24 54.70 70.29 51.93 83.06 56.72
Blender Blend File: BMW27 - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: BMW27 - Compute: CPU-Only EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.13, N = 3 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.12, N = 3 82.60 41.30 62.03 31.80 49.24 25.46 46.24 30.36 59.55 29.66 64.90 32.25 86.38 42.35
OpenRadioss Model: Cell Phone Drop Test OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Cell Phone Drop Test EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.14, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.07, N = 3 SE +/- 0.29, N = 3 SE +/- 0.03, N = 3 66.29 54.23 45.63 41.25 36.39 59.09 37.73 62.82 36.51 74.50 43.84
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2023 Implementation: MPI CPU - Input: water_GMX50_bare EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2 4 6 8 10 SE +/- 0.009, N = 3 SE +/- 0.003, N = 3 SE +/- 0.015, N = 3 SE +/- 0.006, N = 3 SE +/- 0.019, N = 3 SE +/- 0.013, N = 3 SE +/- 0.008, N = 3 SE +/- 0.025, N = 3 SE +/- 0.011, N = 3 SE +/- 0.004, N = 3 SE +/- 0.019, N = 3 SE +/- 0.001, N = 3 SE +/- 0.018, N = 3 4.083 3.005 4.820 3.547 5.589 4.001 5.098 3.717 7.379 3.376 6.761 2.619 5.391 1. (CXX) g++ options: -O3
uvg266 Video Input: Bosphorus 4K - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 10.42 16.78 11.87 18.06 15.10 19.59 15.77 15.71 10.88 14.12 10.51 16.00 9.16 15.05
FFmpeg Encoder: libx264 - Scenario: Live OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Live EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.23, N = 3 SE +/- 0.15, N = 3 SE +/- 0.51, N = 3 SE +/- 0.49, N = 3 SE +/- 0.18, N = 3 SE +/- 0.23, N = 3 SE +/- 0.09, N = 3 SE +/- 0.14, N = 3 SE +/- 0.25, N = 3 SE +/- 0.46, N = 3 SE +/- 0.19, N = 3 SE +/- 0.18, N = 3 SE +/- 0.19, N = 3 SE +/- 0.30, N = 3 217.86 215.69 202.95 200.05 207.35 206.46 211.67 208.64 178.82 173.30 193.69 186.41 202.08 193.90 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Live OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Live EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 7 14 21 28 35 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 23.18 23.41 24.88 25.24 24.35 24.46 23.86 24.20 28.24 29.14 26.07 27.09 24.99 26.04 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.12, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.13, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.36, N = 3 SE +/- 0.20, N = 3 SE +/- 0.15, N = 3 SE +/- 0.29, N = 3 SE +/- 0.09, N = 3 SE +/- 0.14, N = 3 SE +/- 0.09, N = 3 75.41 77.34 86.08 88.63 92.54 95.08 85.87 117.48 92.05 92.64 76.12 76.56 69.19 69.04
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 80 160 240 320 400 SE +/- 0.16, N = 3 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.27, N = 3 SE +/- 0.28, N = 3 SE +/- 0.20, N = 3 SE +/- 0.11, N = 3 SE +/- 0.86, N = 3 SE +/- 0.37, N = 3 SE +/- 0.54, N = 3 SE +/- 0.61, N = 3 SE +/- 0.35, N = 3 SE +/- 0.23, N = 3 SE +/- 0.29, N = 3 105.96 206.53 139.27 270.27 172.73 335.99 186.09 271.88 173.77 345.18 157.60 313.14 115.60 231.51
Xcompact3d Incompact3d Input: input.i3d 193 Cells Per Direction OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 193 Cells Per Direction EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 9 18 27 36 45 SE +/- 0.14, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.28, N = 15 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.42, N = 3 SE +/- 0.19, N = 4 SE +/- 0.08, N = 3 SE +/- 0.44, N = 15 35.56 18.02 32.40 15.69 30.74 15.81 24.11 23.09 33.00 14.69 33.30 16.51 40.55 21.22 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.16, N = 3 SE +/- 0.21, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.12, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 55.41 55.60 62.20 64.72 66.47 68.12 62.29 86.46 49.96 49.97 41.81 41.46 37.04 36.38
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 140 280 420 560 700 SE +/- 0.25, N = 3 SE +/- 0.20, N = 3 SE +/- 0.51, N = 3 SE +/- 1.20, N = 3 SE +/- 0.61, N = 3 SE +/- 0.50, N = 3 SE +/- 0.36, N = 3 SE +/- 0.55, N = 3 SE +/- 0.07, N = 3 SE +/- 0.15, N = 3 SE +/- 0.25, N = 3 SE +/- 2.27, N = 3 SE +/- 0.23, N = 3 SE +/- 0.08, N = 3 144.23 287.18 192.68 370.19 240.41 468.93 256.52 369.54 320.01 639.77 286.88 578.25 215.84 439.33
NAMD ATPase Simulation - 327,506 Atoms OpenBenchmarking.org days/ns, Fewer Is Better NAMD 2.14 ATPase Simulation - 327,506 Atoms EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.2573 0.5146 0.7719 1.0292 1.2865 SE +/- 0.00059, N = 3 SE +/- 0.00060, N = 3 SE +/- 0.00216, N = 3 SE +/- 0.00231, N = 3 SE +/- 0.00039, N = 3 SE +/- 0.00049, N = 3 SE +/- 0.00115, N = 3 SE +/- 0.00061, N = 3 SE +/- 0.00160, N = 3 SE +/- 0.00053, N = 3 SE +/- 0.00023, N = 3 SE +/- 0.00083, N = 3 SE +/- 0.00172, N = 3 SE +/- 0.00067, N = 3 1.14340 0.59260 0.88677 0.47053 0.71585 0.36716 0.65554 0.45591 0.70215 0.35502 0.75173 0.38091 0.98742 0.49354
oneDNN Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.837375, N = 15 SE +/- 0.206028, N = 15 SE +/- 1.007343, N = 15 SE +/- 0.393240, N = 12 SE +/- 1.169116, N = 15 SE +/- 0.559435, N = 15 SE +/- 0.912376, N = 12 SE +/- 0.001079, N = 4 SE +/- 0.001294, N = 4 SE +/- 0.002543, N = 4 SE +/- 0.000460, N = 4 SE +/- 0.004663, N = 4 SE +/- 0.001288, N = 4 8.358690 2.354380 9.130000 2.323020 12.287940 4.318590 6.486810 0.521446 0.255235 0.587102 0.255585 0.806671 0.394611 MIN: 2.64 MIN: 1.2 MIN: 3.45 MIN: 1.19 MIN: 4.19 MIN: 1.39 MIN: 2.12 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Kvazaar Video Input: Bosphorus 4K - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Medium EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6 12 18 24 30 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.26, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 14.94 22.50 16.10 23.20 20.33 25.02 21.04 19.03 13.69 17.63 13.17 19.27 12.21 18.39 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
LuxCoreRender Scene: Rainbow Colors and Prism - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Rainbow Colors and Prism - Acceleration: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.08, N = 4 SE +/- 0.12, N = 4 SE +/- 0.12, N = 5 SE +/- 0.09, N = 4 SE +/- 0.05, N = 5 SE +/- 0.18, N = 6 SE +/- 0.18, N = 4 SE +/- 0.13, N = 5 SE +/- 0.11, N = 9 SE +/- 0.23, N = 15 SE +/- 0.13, N = 5 SE +/- 0.24, N = 15 SE +/- 0.07, N = 4 SE +/- 0.20, N = 15 12.12 13.03 15.11 15.73 17.44 17.44 16.69 18.73 13.20 11.33 13.77 12.60 11.45 12.05 MIN: 11.11 / MAX: 12.32 MIN: 11.85 / MAX: 13.27 MIN: 13.66 / MAX: 15.57 MIN: 14.3 / MAX: 16.13 MIN: 15.75 / MAX: 17.95 MIN: 15.46 / MAX: 18.02 MIN: 15.03 / MAX: 17.36 MIN: 18.24 / MAX: 19.11 MIN: 11.71 / MAX: 14.29 MIN: 9.36 / MAX: 12.19 MIN: 12.72 / MAX: 14.53 MIN: 10.6 / MAX: 13.91 MIN: 10.45 / MAX: 11.99 MIN: 10.43 / MAX: 13.24
LuxCoreRender Scene: DLSC - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: DLSC - Acceleration: CPU EPYC 7343 2P EPYC 7413 2P EPYC 7513 2P 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 15 5.74 7.17 9.12 MIN: 5.6 / MAX: 6.16 MIN: 6.95 / MAX: 7.96 MIN: 8.49 / MAX: 10.09
PHPBench PHP Benchmark Suite OpenBenchmarking.org Score, More Is Better PHPBench 0.8.1 PHP Benchmark Suite EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200K 400K 600K 800K 1000K SE +/- 1077.87, N = 3 SE +/- 2797.29, N = 3 SE +/- 1332.81, N = 3 SE +/- 4937.26, N = 3 SE +/- 4086.10, N = 3 SE +/- 1938.22, N = 3 SE +/- 1437.74, N = 3 SE +/- 3010.31, N = 3 SE +/- 1918.32, N = 3 SE +/- 340.03, N = 3 SE +/- 581.13, N = 3 SE +/- 580.18, N = 3 SE +/- 678.65, N = 3 SE +/- 1806.45, N = 3 732752 735624 670928 680136 678084 686597 687000 678966 719675 722240 788731 789297 812732 809727
VVenC Video Input: Bosphorus 1080p - Video Preset: Faster OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Faster EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6 12 18 24 30 SE +/- 0.04, N = 3 SE +/- 0.27, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.29, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 25.09 24.19 24.36 23.35 24.71 22.96 24.84 22.51 20.15 20.64 22.27 22.27 22.23 22.16 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
SVT-VP9 Tuning: VMAF Optimized - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-VP9 0.3 Tuning: VMAF Optimized - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.79, N = 6 SE +/- 1.45, N = 15 SE +/- 1.16, N = 8 SE +/- 4.20, N = 15 SE +/- 0.92, N = 15 SE +/- 1.60, N = 15 SE +/- 1.40, N = 15 SE +/- 1.46, N = 15 SE +/- 1.38, N = 15 SE +/- 1.44, N = 15 SE +/- 1.09, N = 15 SE +/- 1.39, N = 15 SE +/- 0.57, N = 6 SE +/- 1.32, N = 6 111.82 152.31 140.28 154.60 161.26 163.58 171.65 172.24 143.42 137.47 141.68 139.88 109.47 141.50 1. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.06890, N = 5 SE +/- 0.03643, N = 15 SE +/- 0.09795, N = 3 SE +/- 0.01665, N = 3 SE +/- 0.02793, N = 3 SE +/- 0.01466, N = 3 SE +/- 0.03340, N = 3 SE +/- 0.04992, N = 3 SE +/- 0.03026, N = 3 SE +/- 0.00667, N = 3 SE +/- 0.06310, N = 3 SE +/- 0.00784, N = 3 SE +/- 0.00229, N = 3 6.26194 4.70749 7.89700 4.64782 10.00962 4.86899 6.94903 4.48936 6.56164 3.28994 4.76230 3.77644 3.69104 MIN: 4.39 MIN: 3.51 MIN: 6.4 MIN: 3.7 MIN: 7.97 MIN: 3.71 MIN: 4.75 MIN: 3.05 MIN: 5.75 MIN: 2.86 MIN: 3.24 MIN: 3.04 MIN: 3.12 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Kvazaar Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Ultra Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 15 30 45 60 75 SE +/- 0.04, N = 5 SE +/- 0.47, N = 11 SE +/- 0.08, N = 5 SE +/- 0.65, N = 5 SE +/- 0.09, N = 5 SE +/- 0.63, N = 6 SE +/- 0.10, N = 5 SE +/- 0.78, N = 15 SE +/- 0.15, N = 4 SE +/- 0.34, N = 15 SE +/- 0.03, N = 4 SE +/- 0.29, N = 4 SE +/- 0.05, N = 4 SE +/- 0.31, N = 4 53.29 63.34 55.36 64.72 62.27 65.39 63.28 57.99 38.52 43.33 42.41 49.75 42.98 50.50 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Kvazaar Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Super Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 14 28 42 56 70 SE +/- 0.03, N = 4 SE +/- 0.18, N = 5 SE +/- 0.04, N = 4 SE +/- 0.24, N = 5 SE +/- 0.17, N = 5 SE +/- 0.55, N = 5 SE +/- 0.09, N = 5 SE +/- 0.39, N = 15 SE +/- 0.09, N = 3 SE +/- 0.40, N = 15 SE +/- 0.03, N = 3 SE +/- 0.39, N = 4 SE +/- 0.04, N = 3 SE +/- 0.05, N = 4 41.24 57.13 43.02 61.75 52.81 63.53 54.27 50.67 33.71 41.44 34.35 47.49 33.93 45.17 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Pennant Test: sedovbig OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: sedovbig EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 10 20 30 40 50 SE +/- 0.053422, N = 3 SE +/- 0.078086, N = 4 SE +/- 0.083410, N = 3 SE +/- 0.029276, N = 4 SE +/- 0.031210, N = 3 SE +/- 0.049248, N = 5 SE +/- 0.049389, N = 3 SE +/- 0.083702, N = 4 SE +/- 0.015982, N = 3 SE +/- 0.024622, N = 3 SE +/- 0.024301, N = 3 SE +/- 0.015004, N = 3 SE +/- 0.018190, N = 3 SE +/- 0.016802, N = 3 26.928070 13.474340 21.419360 10.798510 17.886890 8.761462 15.397170 11.319440 30.869470 19.646200 31.831930 18.266460 41.967620 22.142670 1. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
x265 Video Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better x265 3.4 Video Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 7 14 21 28 35 SE +/- 0.02, N = 3 SE +/- 0.17, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.29, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 SE +/- 0.13, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 24.86 23.06 27.01 22.13 28.24 22.65 27.63 27.16 25.70 24.42 27.77 25.54 24.96 25.04 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
oneDNN Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1.0084 2.0168 3.0252 4.0336 5.042 SE +/- 0.07340, N = 15 SE +/- 0.05784, N = 15 SE +/- 0.02674, N = 4 SE +/- 0.04593, N = 15 SE +/- 0.01308, N = 4 SE +/- 0.10360, N = 12 3.34833 3.67592 4.48183 3.97631 4.20681 3.01823 MIN: 2.87 MIN: 2.72 MIN: 4.14 MIN: 3.34 MIN: 4.02 MIN: 2.29 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.29445, N = 15 SE +/- 0.76540, N = 12 SE +/- 0.24995, N = 12 SE +/- 0.45466, N = 15 SE +/- 0.12995, N = 12 SE +/- 0.39591, N = 12 3.88765 10.56278 2.80481 6.98945 2.21622 5.50135 MIN: 2 MIN: 4.94 MIN: 1.46 MIN: 3.99 MIN: 1.72 MIN: 3.49 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
CloudSuite Data Analytics Hadoop Slaves: 1 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 1 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 13K 26K 39K 52K 65K 18792 58173 58158 61767 58645 62262 59400 60941 20565 21324 18581 19397 18046 18850
oneDNN Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.9598 1.9196 2.8794 3.8392 4.799 SE +/- 0.02810, N = 5 SE +/- 0.00276, N = 5 SE +/- 0.02328, N = 5 SE +/- 0.01307, N = 5 SE +/- 0.03491, N = 15 SE +/- 0.00978, N = 5 SE +/- 0.01496, N = 5 SE +/- 0.01676, N = 6 SE +/- 0.02635, N = 15 SE +/- 0.01211, N = 5 SE +/- 0.02380, N = 15 SE +/- 0.01253, N = 5 SE +/- 0.01988, N = 7 3.09624 2.79700 4.00035 3.63115 4.26599 2.02266 3.78466 1.64248 2.40282 1.66931 2.39962 1.84770 2.21782 MIN: 2.38 MIN: 2.65 MIN: 3.18 MIN: 3.48 MIN: 3.76 MIN: 1.82 MIN: 3.41 MIN: 1.54 MIN: 2.02 MIN: 1.57 MIN: 2.1 MIN: 1.71 MIN: 2.07 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Crown EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 15 30 45 60 75 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.08, N = 4 SE +/- 0.11, N = 3 SE +/- 0.07, N = 5 SE +/- 0.03, N = 3 SE +/- 0.10, N = 4 SE +/- 0.07, N = 3 SE +/- 0.07, N = 5 SE +/- 0.04, N = 3 SE +/- 0.33, N = 5 SE +/- 0.08, N = 3 SE +/- 0.05, N = 4 20.01 35.49 25.83 46.60 33.14 58.90 35.12 51.68 35.84 69.59 29.17 61.18 23.17 46.27 MIN: 19.68 / MAX: 20.39 MIN: 35 / MAX: 36.16 MIN: 25.36 / MAX: 26.62 MIN: 45.29 / MAX: 47.9 MIN: 32.13 / MAX: 34.24 MIN: 57.6 / MAX: 61.52 MIN: 34.38 / MAX: 36.15 MIN: 48.53 / MAX: 56.01 MIN: 34.73 / MAX: 37.86 MIN: 67.34 / MAX: 73.46 MIN: 28.31 / MAX: 34.1 MIN: 57.63 / MAX: 66.74 MIN: 22.47 / MAX: 25.37 MIN: 45.19 / MAX: 48.79
Embree Binary: Pathtracer - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer - Model: Crown EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 14 28 42 56 70 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.13, N = 3 SE +/- 0.05, N = 4 SE +/- 0.02, N = 3 SE +/- 0.22, N = 5 SE +/- 0.04, N = 3 SE +/- 0.16, N = 4 SE +/- 0.08, N = 3 SE +/- 0.05, N = 4 SE +/- 0.01, N = 3 SE +/- 0.06, N = 4 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 21.22 37.75 27.42 49.95 34.18 62.36 37.28 52.75 29.84 58.33 25.35 51.39 19.76 38.90 MIN: 20.8 / MAX: 21.59 MIN: 37.14 / MAX: 38.79 MIN: 26.84 / MAX: 28.27 MIN: 48.86 / MAX: 51.27 MIN: 33.8 / MAX: 34.89 MIN: 60.41 / MAX: 65.16 MIN: 36.31 / MAX: 38.34 MIN: 51.1 / MAX: 58.19 MIN: 29.02 / MAX: 31.34 MIN: 56.72 / MAX: 61.53 MIN: 24.68 / MAX: 28.35 MIN: 49.55 / MAX: 55.56 MIN: 19.56 / MAX: 20.64 MIN: 38.2 / MAX: 40.63
Embree Binary: Pathtracer - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer - Model: Asian Dragon EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 15 30 45 60 75 SE +/- 0.14, N = 3 SE +/- 0.05, N = 3 SE +/- 0.13, N = 3 SE +/- 0.06, N = 4 SE +/- 0.04, N = 4 SE +/- 0.09, N = 4 SE +/- 0.05, N = 4 SE +/- 0.03, N = 5 SE +/- 0.09, N = 3 SE +/- 0.05, N = 5 SE +/- 0.04, N = 3 SE +/- 0.06, N = 5 SE +/- 0.02, N = 3 SE +/- 0.05, N = 4 23.76 38.97 31.90 48.35 40.21 53.81 41.95 62.57 35.91 67.13 31.01 59.68 23.39 43.51 MIN: 23.41 / MAX: 24.11 MIN: 38.53 / MAX: 40.01 MIN: 31.52 / MAX: 32.65 MIN: 47.63 / MAX: 49.46 MIN: 39.78 / MAX: 40.88 MIN: 52.99 / MAX: 56.35 MIN: 41.57 / MAX: 42.56 MIN: 61.2 / MAX: 64.08 MIN: 34.65 / MAX: 37.75 MIN: 65.98 / MAX: 70.89 MIN: 29.86 / MAX: 33.48 MIN: 58.54 / MAX: 62.25 MIN: 23.25 / MAX: 24.1 MIN: 43 / MAX: 44.91
Timed Apache Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Apache Compilation 2.4.41 Time To Compile EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 17.70 18.22 18.99 21.00 18.86 19.70 18.83 20.39 22.42 22.11 20.24 20.06 19.68 19.45
Kvazaar Video Input: Bosphorus 4K - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Very Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12 24 36 48 60 SE +/- 0.07, N = 3 SE +/- 0.09, N = 4 SE +/- 0.05, N = 3 SE +/- 0.08, N = 4 SE +/- 0.07, N = 4 SE +/- 0.06, N = 5 SE +/- 0.09, N = 4 SE +/- 0.05, N = 4 SE +/- 0.04, N = 3 SE +/- 0.14, N = 4 SE +/- 0.04, N = 3 SE +/- 0.04, N = 4 SE +/- 0.02, N = 3 SE +/- 0.03, N = 4 32.35 45.86 33.41 48.93 42.32 54.13 43.25 41.59 27.47 36.47 27.03 39.25 26.64 36.84 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
uvg266 Video Input: Bosphorus 4K - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12 24 36 48 60 SE +/- 0.06, N = 3 SE +/- 0.13, N = 4 SE +/- 0.08, N = 3 SE +/- 0.11, N = 4 SE +/- 0.07, N = 4 SE +/- 0.15, N = 4 SE +/- 0.03, N = 4 SE +/- 0.08, N = 4 SE +/- 0.03, N = 3 SE +/- 0.11, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 4 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 28.94 41.20 31.30 45.98 39.52 51.05 40.67 42.56 26.79 36.01 26.65 39.03 24.70 35.89
uvg266 Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12 24 36 48 60 SE +/- 0.03, N = 3 SE +/- 0.12, N = 4 SE +/- 0.15, N = 3 SE +/- 0.11, N = 4 SE +/- 0.01, N = 4 SE +/- 0.22, N = 4 SE +/- 0.09, N = 4 SE +/- 0.28, N = 4 SE +/- 0.01, N = 3 SE +/- 0.38, N = 4 SE +/- 0.05, N = 3 SE +/- 0.06, N = 4 SE +/- 0.03, N = 3 SE +/- 0.05, N = 4 30.00 42.95 33.10 48.07 41.46 51.46 42.81 45.49 28.50 37.22 28.82 41.73 26.26 38.46
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Asian Dragon EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 4 SE +/- 0.05, N = 3 SE +/- 0.13, N = 4 SE +/- 0.03, N = 4 SE +/- 0.04, N = 5 SE +/- 0.04, N = 4 SE +/- 0.09, N = 6 SE +/- 0.06, N = 4 SE +/- 0.02, N = 5 SE +/- 0.03, N = 3 SE +/- 0.03, N = 4 23.06 38.01 30.45 46.29 38.35 51.94 40.51 60.10 45.79 84.86 40.98 75.25 29.31 55.41 MIN: 22.91 / MAX: 23.57 MIN: 37.62 / MAX: 38.66 MIN: 30.17 / MAX: 30.93 MIN: 45.68 / MAX: 47.36 MIN: 37.95 / MAX: 38.96 MIN: 50.91 / MAX: 54.47 MIN: 40.15 / MAX: 41.05 MIN: 59.02 / MAX: 61.86 MIN: 45.07 / MAX: 48.58 MIN: 82.99 / MAX: 89.58 MIN: 39.96 / MAX: 43 MIN: 73.81 / MAX: 79.52 MIN: 28.56 / MAX: 31.49 MIN: 54.58 / MAX: 57.85
uvg266 Video Input: Bosphorus 1080p - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Slow EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 14 28 42 56 70 SE +/- 0.05, N = 4 SE +/- 0.09, N = 4 SE +/- 0.03, N = 4 SE +/- 0.15, N = 5 SE +/- 0.05, N = 4 SE +/- 0.11, N = 5 SE +/- 0.05, N = 4 SE +/- 0.13, N = 5 SE +/- 0.04, N = 3 SE +/- 0.15, N = 4 SE +/- 0.07, N = 3 SE +/- 0.13, N = 4 SE +/- 0.04, N = 3 SE +/- 0.06, N = 4 38.52 43.92 38.45 59.52 40.52 63.00 41.09 56.07 28.13 44.48 33.02 51.74 33.05 38.43
uvg266 Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12 24 36 48 60 SE +/- 0.07, N = 3 SE +/- 0.07, N = 4 SE +/- 0.08, N = 4 SE +/- 0.34, N = 4 SE +/- 0.06, N = 4 SE +/- 0.28, N = 5 SE +/- 0.10, N = 4 SE +/- 0.27, N = 4 SE +/- 0.01, N = 3 SE +/- 0.48, N = 4 SE +/- 0.03, N = 3 SE +/- 0.18, N = 4 SE +/- 0.05, N = 3 SE +/- 0.03, N = 4 35.28 46.65 38.88 49.77 46.07 53.21 47.24 48.31 31.67 38.92 33.30 44.24 31.03 42.08
LULESH OpenBenchmarking.org z/s, More Is Better LULESH 2.0.3 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 9K 18K 27K 36K 45K SE +/- 24.59, N = 6 SE +/- 149.46, N = 6 SE +/- 25.11, N = 6 SE +/- 276.03, N = 15 SE +/- 101.13, N = 5 SE +/- 90.00, N = 4 SE +/- 138.07, N = 5 SE +/- 29.51, N = 3 SE +/- 85.02, N = 5 SE +/- 13.51, N = 4 SE +/- 26.68, N = 6 SE +/- 38.77, N = 6 SE +/- 11.87, N = 6 SE +/- 40.17, N = 5 10323.18 27713.94 9682.80 25716.77 18098.80 37170.86 21129.41 22242.53 18868.72 39798.69 9964.41 26940.98 10152.76 22099.32 1. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 8 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 16 32 48 64 80 SE +/- 0.11, N = 4 SE +/- 0.28, N = 5 SE +/- 0.10, N = 4 SE +/- 0.67, N = 5 SE +/- 0.12, N = 5 SE +/- 0.38, N = 5 SE +/- 0.30, N = 5 SE +/- 0.27, N = 5 SE +/- 0.22, N = 4 SE +/- 0.54, N = 4 SE +/- 0.24, N = 4 SE +/- 0.42, N = 4 SE +/- 0.23, N = 4 SE +/- 0.17, N = 4 48.38 66.08 58.92 65.95 66.63 71.45 67.15 67.31 56.03 63.10 59.41 68.97 47.12 67.61 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.48, N = 4 SE +/- 0.02, N = 3 SE +/- 0.13, N = 4 SE +/- 0.01, N = 3 SE +/- 0.16, N = 5 SE +/- 0.04, N = 4 SE +/- 0.15, N = 5 SE +/- 0.03, N = 3 SE +/- 0.17, N = 5 SE +/- 0.06, N = 3 SE +/- 0.31, N = 4 SE +/- 0.05, N = 3 SE +/- 0.03, N = 4 55.94 36.07 68.76 47.10 93.35 50.46 76.51 40.41 80.39 35.56 68.51 27.62 54.92 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 500 1000 1500 2000 2500 SE +/- 11.90, N = 4 SE +/- 0.56, N = 3 SE +/- 3.16, N = 4 SE +/- 0.14, N = 3 SE +/- 4.00, N = 5 SE +/- 1.10, N = 4 SE +/- 3.71, N = 5 SE +/- 0.83, N = 3 SE +/- 4.35, N = 5 SE +/- 1.48, N = 3 SE +/- 7.83, N = 4 SE +/- 1.38, N = 3 SE +/- 0.78, N = 4 1398.41 901.85 1718.94 1177.57 2333.76 1261.44 1912.74 1010.28 2009.72 889.01 1712.72 690.47 1372.93 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
uvg266 Video Input: Bosphorus 1080p - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Medium EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 16 32 48 64 80 SE +/- 0.16, N = 4 SE +/- 0.08, N = 4 SE +/- 0.09, N = 4 SE +/- 0.08, N = 5 SE +/- 0.04, N = 4 SE +/- 0.19, N = 5 SE +/- 0.10, N = 4 SE +/- 0.19, N = 5 SE +/- 0.02, N = 3 SE +/- 0.08, N = 4 SE +/- 0.02, N = 4 SE +/- 0.14, N = 5 SE +/- 0.04, N = 4 SE +/- 0.09, N = 4 43.11 49.15 43.27 66.47 45.60 70.75 46.14 61.66 31.35 49.39 37.08 57.70 37.00 43.04
Pennant Test: leblancbig OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: leblancbig EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.027516, N = 3 SE +/- 0.016342, N = 5 SE +/- 0.066993, N = 4 SE +/- 0.020399, N = 6 SE +/- 0.065044, N = 4 SE +/- 0.022993, N = 6 SE +/- 0.028009, N = 5 SE +/- 0.054440, N = 6 SE +/- 0.017732, N = 4 SE +/- 0.011875, N = 5 SE +/- 0.025498, N = 3 SE +/- 0.022667, N = 5 SE +/- 0.006168, N = 3 SE +/- 0.008469, N = 5 16.692420 7.618046 12.957890 5.976653 10.835750 4.827648 8.575596 6.246704 14.447020 7.347379 15.691820 7.523824 19.493280 9.733065 1. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
SVT-VP9 Tuning: PSNR/SSIM Optimized - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-VP9 0.3 Tuning: PSNR/SSIM Optimized - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.17, N = 7 SE +/- 0.22, N = 7 SE +/- 0.24, N = 7 SE +/- 0.94, N = 6 SE +/- 0.48, N = 7 SE +/- 2.12, N = 15 SE +/- 0.17, N = 7 SE +/- 0.20, N = 7 SE +/- 0.14, N = 7 SE +/- 0.19, N = 5 SE +/- 0.26, N = 7 SE +/- 0.52, N = 6 SE +/- 0.11, N = 6 SE +/- 0.27, N = 7 115.80 158.14 143.85 161.19 164.17 165.46 175.18 179.74 148.73 144.22 148.12 148.45 115.37 150.48 1. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.7518 1.5036 2.2554 3.0072 3.759 SE +/- 0.003169, N = 7 SE +/- 0.003897, N = 7 SE +/- 0.001690, N = 7 SE +/- 0.002206, N = 7 SE +/- 0.004296, N = 7 SE +/- 0.001763, N = 7 SE +/- 0.000877, N = 7 SE +/- 0.007172, N = 7 SE +/- 0.018972, N = 10 SE +/- 0.009698, N = 7 SE +/- 0.026790, N = 7 SE +/- 0.003371, N = 7 SE +/- 0.028591, N = 15 1.188400 2.137310 0.940455 1.950160 0.786803 1.301380 0.937918 1.711290 2.466270 1.821900 2.993400 1.942000 3.341250 MIN: 0.94 MIN: 1.86 MIN: 0.75 MIN: 1.75 MIN: 0.68 MIN: 1.15 MIN: 0.87 MIN: 1.58 MIN: 2.29 MIN: 1.68 MIN: 2.81 MIN: 1.73 MIN: 3.07 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
SVT-VP9 Tuning: Visual Quality Optimized - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-VP9 0.3 Tuning: Visual Quality Optimized - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.08, N = 6 SE +/- 0.49, N = 6 SE +/- 0.18, N = 6 SE +/- 0.32, N = 6 SE +/- 0.14, N = 7 SE +/- 0.59, N = 6 SE +/- 0.25, N = 7 SE +/- 0.28, N = 6 SE +/- 0.18, N = 6 SE +/- 0.88, N = 5 SE +/- 0.23, N = 6 SE +/- 0.33, N = 6 SE +/- 0.07, N = 6 SE +/- 0.17, N = 6 83.73 130.23 107.77 145.30 129.22 148.84 137.52 146.48 111.92 131.90 109.31 138.19 83.38 130.49 1. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm
SVT-HEVC Tuning: 7 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-HEVC 1.5.0 Tuning: 7 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.07, N = 5 SE +/- 0.14, N = 7 SE +/- 0.04, N = 6 SE +/- 0.12, N = 7 SE +/- 0.12, N = 7 SE +/- 0.43, N = 7 SE +/- 0.19, N = 7 SE +/- 0.16, N = 7 SE +/- 0.05, N = 6 SE +/- 0.31, N = 7 SE +/- 0.10, N = 6 SE +/- 0.32, N = 7 SE +/- 0.06, N = 5 SE +/- 0.06, N = 7 71.41 116.56 85.67 136.95 111.95 149.01 119.84 138.52 91.70 128.72 85.66 136.71 65.82 117.26 1. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt
SVT-HEVC Tuning: 10 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-HEVC 1.5.0 Tuning: 10 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.23, N = 8 SE +/- 1.02, N = 8 SE +/- 0.39, N = 8 SE +/- 1.90, N = 15 SE +/- 0.27, N = 8 SE +/- 2.94, N = 15 SE +/- 0.23, N = 9 SE +/- 0.70, N = 9 SE +/- 0.18, N = 8 SE +/- 0.96, N = 8 SE +/- 0.23, N = 8 SE +/- 1.35, N = 15 SE +/- 0.06, N = 7 SE +/- 1.19, N = 15 143.45 191.99 181.39 208.59 207.54 201.76 219.43 224.80 171.63 176.67 173.16 176.18 134.34 176.86 1. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 12 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.47, N = 8 SE +/- 0.36, N = 7 SE +/- 0.80, N = 8 SE +/- 0.76, N = 7 SE +/- 0.86, N = 8 SE +/- 1.43, N = 7 SE +/- 0.47, N = 8 SE +/- 1.31, N = 8 SE +/- 0.49, N = 7 SE +/- 0.71, N = 7 SE +/- 0.50, N = 7 SE +/- 1.23, N = 7 SE +/- 0.44, N = 8 SE +/- 0.70, N = 7 179.07 204.55 210.55 217.43 231.54 217.70 237.13 232.00 194.14 201.07 206.81 213.42 173.29 211.63 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P 40 80 120 160 200 SE +/- 0.07, N = 3 SE +/- 0.14, N = 3 SE +/- 0.07, N = 3 SE +/- 0.26, N = 3 91.68 113.85 124.13 177.64
uvg266 Video Input: Bosphorus 1080p - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Super Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.23, N = 7 SE +/- 0.15, N = 8 SE +/- 0.15, N = 8 SE +/- 0.48, N = 9 SE +/- 0.09, N = 8 SE +/- 0.59, N = 9 SE +/- 0.17, N = 8 SE +/- 1.30, N = 15 SE +/- 0.13, N = 6 SE +/- 0.62, N = 8 SE +/- 0.06, N = 7 SE +/- 0.61, N = 8 SE +/- 0.08, N = 7 SE +/- 0.15, N = 8 116.79 142.78 125.26 163.18 138.95 173.74 139.65 180.55 94.98 133.13 106.29 152.28 100.87 127.62
uvg266 Video Input: Bosphorus 1080p - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Very Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.15, N = 7 SE +/- 0.22, N = 8 SE +/- 0.17, N = 7 SE +/- 0.70, N = 9 SE +/- 0.17, N = 8 SE +/- 0.87, N = 9 SE +/- 0.17, N = 8 SE +/- 0.24, N = 9 SE +/- 0.05, N = 6 SE +/- 0.79, N = 8 SE +/- 0.07, N = 7 SE +/- 0.51, N = 8 SE +/- 0.10, N = 6 SE +/- 0.07, N = 7 110.98 134.43 118.56 164.25 129.79 173.58 130.26 168.38 87.55 131.93 98.13 150.71 93.17 116.97
oneDNN Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.5467 1.0934 1.6401 2.1868 2.7335 SE +/- 0.01302, N = 5 SE +/- 0.04314, N = 12 SE +/- 0.00547, N = 5 SE +/- 0.02225, N = 15 SE +/- 0.00397, N = 5 SE +/- 0.02196, N = 12 1.81562 1.88632 2.22071 2.42969 1.80606 1.62390 MIN: 1.43 MIN: 1.28 MIN: 1.86 MIN: 1.94 MIN: 1.69 MIN: 1.37 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P 40 80 120 160 200 SE +/- 0.07, N = 3 SE +/- 0.18, N = 3 SE +/- 0.07, N = 3 SE +/- 0.26, N = 3 130.72 140.23 128.67 179.68
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 13 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.40, N = 8 SE +/- 0.41, N = 8 SE +/- 0.31, N = 8 SE +/- 0.58, N = 8 SE +/- 0.62, N = 8 SE +/- 1.18, N = 8 SE +/- 0.51, N = 8 SE +/- 0.85, N = 8 SE +/- 0.37, N = 8 SE +/- 1.06, N = 7 SE +/- 0.47, N = 8 SE +/- 1.17, N = 8 SE +/- 0.40, N = 8 SE +/- 1.08, N = 8 172.16 191.02 195.80 193.78 210.24 193.15 214.39 203.19 176.04 180.92 190.74 200.38 166.79 200.42 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
uvg266 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.10, N = 8 SE +/- 0.28, N = 8 SE +/- 0.17, N = 8 SE +/- 0.88, N = 9 SE +/- 0.24, N = 8 SE +/- 0.58, N = 9 SE +/- 0.15, N = 8 SE +/- 1.44, N = 9 SE +/- 0.15, N = 7 SE +/- 0.92, N = 8 SE +/- 0.25, N = 7 SE +/- 0.69, N = 8 SE +/- 0.07, N = 7 SE +/- 0.20, N = 8 130.30 155.33 138.79 165.33 153.97 175.35 154.38 196.33 105.96 136.60 118.47 155.38 113.18 139.86
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.7381 1.4762 2.2143 2.9524 3.6905 SE +/- 0.00873, N = 9 SE +/- 0.00656, N = 9 SE +/- 0.00706, N = 9 SE +/- 0.00505, N = 9 SE +/- 0.01467, N = 15 SE +/- 0.00439, N = 9 SE +/- 0.02517, N = 15 SE +/- 0.00280, N = 9 SE +/- 0.00134, N = 9 SE +/- 0.00359, N = 9 SE +/- 0.00211, N = 9 SE +/- 0.01627, N = 9 SE +/- 0.00228, N = 9 2.82788 3.28030 1.88334 3.17840 2.04048 2.98900 3.25137 1.92380 1.14313 1.99051 1.15641 2.62403 1.37242 MIN: 2.42 MIN: 2.8 MIN: 1.51 MIN: 2.9 MIN: 1.66 MIN: 2.73 MIN: 1.97 MIN: 1.66 MIN: 1.04 MIN: 1.71 MIN: 0.96 MIN: 2.27 MIN: 1.2 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.01350, N = 3 SE +/- 0.00935, N = 3 SE +/- 0.04067, N = 3 SE +/- 0.04874, N = 3 SE +/- 0.01258, N = 3 SE +/- 0.00555, N = 3 7.86162 4.33315 8.61404 4.66619 11.41520 5.86134 MIN: 7.58 MIN: 4.14 MIN: 8.14 MIN: 4.34 MIN: 11.11 MIN: 5.72 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2 4 6 8 10 SE +/- 0.01186, N = 7 SE +/- 0.00326, N = 7 SE +/- 0.02123, N = 7 SE +/- 0.00414, N = 7 SE +/- 0.00522, N = 7 SE +/- 0.00127, N = 7 5.74487 2.92655 6.03750 3.10763 8.24165 4.23272 MIN: 5.58 MIN: 2.88 MIN: 5.8 MIN: 3.01 MIN: 8.12 MIN: 4.15 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.01476, N = 9 SE +/- 0.00722, N = 9 SE +/- 0.00908, N = 9 SE +/- 0.00319, N = 9 SE +/- 0.00399, N = 9 SE +/- 0.00667, N = 9 7.88371 5.02585 8.29712 4.24724 11.43990 5.92201 MIN: 7.66 MIN: 4.84 MIN: 8.01 MIN: 4.13 MIN: 11.21 MIN: 5.79 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Phoronix Test Suite v10.8.5