2023 Tests Benchmarks for a future article. 2 x AMD EPYC 7343 16-Core testing with a Supermicro H12DSi-N6 v1.02 (2.3 BIOS) and astdrmfb on AlmaLinux 9.1 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2305035-PTS-UPEARLY506&grs&sro .
2023 Tests Processor Motherboard Memory Disk Graphics Monitor OS Kernel Compiler File-System Screen Resolution EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P AMD EPYC 7343 16-Core @ 3.20GHz (16 Cores / 32 Threads) Supermicro H12SSL-i v1.02 (2.4 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07 astdrmfb DELL E207WFP AlmaLinux 9.1 5.14.0-162.12.1.el9_1.x86_64 (x86_64) GCC 11.3.1 20220421 ext4 1680x1050 2 x AMD EPYC 7343 16-Core @ 3.20GHz (32 Cores / 64 Threads) Supermicro H12DSi-N6 v1.02 (2.3 BIOS) 16 x 32 GB DDR4-3200MT/s Samsung M393A4K40EB3-CWE 5.14.0-162.18.1.el9_1.x86_64 (x86_64) 1280x1024 AMD EPYC 7413 24-Core @ 2.65GHz (24 Cores / 48 Threads) Supermicro H12SSL-i v1.02 (2.4 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 5.14.0-162.12.1.el9_1.x86_64 (x86_64) 1024x768 2 x AMD EPYC 7413 24-Core @ 2.65GHz (48 Cores / 96 Threads) Supermicro H12DSi-N6 v1.02 (2.3 BIOS) 512GB 5.14.0-162.18.1.el9_1.x86_64 (x86_64) AMD EPYC 7513 32-Core @ 2.60GHz (32 Cores / 64 Threads) Supermicro H12SSL-i v1.02 (2.4 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 5.14.0-162.12.1.el9_1.x86_64 (x86_64) 2 x AMD EPYC 7513 32-Core @ 2.60GHz (64 Cores / 128 Threads) Supermicro H12DSi-N6 v1.02 (2.3 BIOS) 512GB 5.14.0-162.18.1.el9_1.x86_64 (x86_64) AMD EPYC 7543 32-Core @ 2.80GHz (32 Cores / 64 Threads) Supermicro H12SSL-i v1.02 (2.4 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE DELL E207WFP 5.14.0-162.12.1.el9_1.x86_64 (x86_64) 1680x1050 AMD EPYC 7713P 64-Core @ 2.00GHz (64 Cores / 128 Threads) 1024x768 Intel Xeon Gold 6338 @ 3.20GHz (32 Cores / 64 Threads) Supermicro X12SPO-NTF v2.00 (1.2 BIOS) DELL E207WFP 1280x1024 2 x Intel Xeon Gold 6338 @ 3.20GHz (64 Cores / 128 Threads) Supermicro X12DPi-N6 v1.01 (1.4 BIOS) 16 x 32 GB DDR4-3200MT/s Samsung M393A4K40EB3-CWE Intel Xeon Gold 6342 @ 3.50GHz (24 Cores / 48 Threads) Supermicro X12SPO-NTF v2.00 (1.2 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 2 x Intel Xeon Gold 6342 @ 3.50GHz (48 Cores / 96 Threads) Supermicro X12DPi-N6 v1.01 (1.4 BIOS) 16 x 32 GB DDR4-3200MT/s Samsung M393A4K40EB3-CWE Intel Xeon Gold 6346 @ 3.60GHz (16 Cores / 32 Threads) Supermicro X12SPO-NTF v2.00 (1.2 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 2 x Intel Xeon Gold 6346 @ 3.60GHz (32 Cores / 64 Threads) Supermicro X12DPi-N6 v1.01 (1.4 BIOS) 16 x 32 GB DDR4-3200MT/s Samsung M393A4K40EB3-CWE 1024x768 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: always Compiler Details - --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl Processor Details - EPYC 7343: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7343 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7413: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7413 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7513: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7513 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7543: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7713P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - Xeon Gold 6338: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 - Xeon Gold 6338 2P: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 - Xeon Gold 6342: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 - Xeon Gold 6342 2P: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 - Xeon Gold 6346: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 - Xeon Gold 6346 2P: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 Java Details - OpenJDK Runtime Environment (Red_Hat-11.0.18.0.10-2.el9_1) (build 11.0.18+10-LTS) Python Details - Python 3.9.14 Security Details - EPYC 7343: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7343 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7413: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7413 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7513: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7513 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7543: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7713P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6338: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6338 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6342: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6342 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6346: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6346 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
2023 Tests cloudsuite-da: 64 openvino: Face Detection FP16-INT8 - CPU cloudsuite-da: 8 cloudsuite-da: 32 cloudsuite-da: 4 openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU onednn: Recurrent Neural Network Training - f32 - CPU onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPU cloudsuite-da: 512 cloudsuite-da: 256 openssl: SHA256 openvino: Vehicle Detection FP16-INT8 - CPU rocksdb: Seq Fill openvino: Vehicle Detection FP16-INT8 - CPU openvino: Face Detection FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU pennant: sedovbig openvino: Weld Porosity Detection FP16 - CPU onednn: Recurrent Neural Network Inference - f32 - CPU deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream tensorflow: CPU - 256 - GoogLeNet openvino: Person Detection FP16 - CPU openvino: Face Detection FP16 - CPU deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream ospray-studio: 1 - 4K - 32 - Path Tracer onednn: Convolution Batch Shapes Auto - f32 - CPU rocksdb: Rand Fill openvino: Person Detection FP32 - CPU tensorflow: CPU - 512 - GoogLeNet tensorflow: CPU - 512 - AlexNet onednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPU tensorflow: CPU - 256 - AlexNet openvino: Machine Translation EN To DE FP16 - CPU ospray-studio: 1 - 4K - 1 - Path Tracer ospray-studio: 3 - 4K - 1 - Path Tracer lulesh: pennant: leblancbig openvino: Weld Porosity Detection FP16-INT8 - CPU rocksdb: Rand Read openvino: Person Detection FP16 - CPU ospray-studio: 3 - 4K - 32 - Path Tracer openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Person Detection FP32 - CPU svt-hevc: 1 - Bosphorus 4K embree: Pathtracer ISPC - Asian Dragon deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream openvino: Age Gender Recognition Retail 0013 FP16 - CPU blender: Classroom - CPU-Only tensorflow: CPU - 256 - ResNet-50 openssl: RSA4096 openvino: Weld Porosity Detection FP16 - CPU embree: Pathtracer ISPC - Crown openssl: RSA4096 cloudsuite-da: 1 tensorflow: CPU - 512 - ResNet-50 deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream pgbench: 1000 - 800 - Read Write - Average Latency blender: BMW27 - CPU-Only blender: Barbershop - CPU-Only minibude: OpenMP - BM1 minibude: OpenMP - BM1 pgbench: 1000 - 1000 - Read Write pgbench: 1000 - 1000 - Read Write - Average Latency pgbench: 1000 - 800 - Read Write deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream namd: ATPase Simulation - 327,506 Atoms openvino: Vehicle Detection FP16 - CPU deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream embree: Pathtracer - Crown deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream openvino: Vehicle Detection FP16 - CPU onednn: Deconvolution Batch shapes_1d - f32 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU embree: Pathtracer - Asian Dragon onednn: Deconvolution Batch shapes_3d - f32 - CPU gromacs: MPI CPU - water_GMX50_bare onednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU incompact3d: input.i3d 193 Cells Per Direction luxcorerender: Danish Mood - CPU onednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPU luxcorerender: Orange Juice - CPU build-llvm: Ninja onednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPU luxcorerender: LuxCore Benchmark - CPU build-nodejs: Time To Compile onednn: IP Shapes 3D - f32 - CPU rocksdb: Read While Writing nekrs: TurboPipe Periodic incompact3d: X3D-benchmarking input.i3d cloudsuite-ma: Large hpcg: memcached: 1:100 rocksdb: Update Rand deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream memcached: 1:5 graph500: 26 build-linux-kernel: defconfig svt-hevc: 7 - Bosphorus 4K uvg266: Bosphorus 1080p - Medium uvg266: Bosphorus 1080p - Slow graph500: 26 graph500: 26 rocksdb: Rand Fill Sync nwchem: C240 Buckyball graph500: 26 uvg266: Bosphorus 4K - Medium openradioss: INIVOL and Fluid Structure Interaction Drop Container deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream build-llvm: Unix Makefiles uvg266: Bosphorus 4K - Slow uvg266: Bosphorus 4K - Very Fast kvazaar: Bosphorus 4K - Medium openradioss: Cell Phone Drop Test kvazaar: Bosphorus 4K - Very Fast openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream cloudsuite-da: 128 cloudsuite-ma: Small uvg266: Bosphorus 1080p - Very Fast uvg266: Bosphorus 4K - Super Fast deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream openvino: Age Gender Recognition Retail 0013 FP16 - CPU deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream uvg266: Bosphorus 1080p - Super Fast nginx: 100 kvazaar: Bosphorus 4K - Super Fast memcached: 1:10 uvg266: Bosphorus 1080p - Ultra Fast nginx: 1000 nginx: 500 svt-vp9: Visual Quality Optimized - Bosphorus 4K nginx: 200 uvg266: Bosphorus 4K - Ultra Fast deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream kvazaar: Bosphorus 4K - Ultra Fast pgbench: 1000 - 1000 - Read Only - Average Latency pgbench: 1000 - 1000 - Read Only cassandra: Writes deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream svt-hevc: 10 - Bosphorus 4K luxcorerender: Rainbow Colors and Prism - CPU build-godot: Time To Compile deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream cloudsuite-ws: 500 luxcorerender: DLSC - CPU openradioss: Rubber O-Ring Seal Installation svt-vp9: VMAF Optimized - Bosphorus 4K svt-vp9: PSNR/SSIM Optimized - Bosphorus 4K build-gem5: Time To Compile clickhouse: 100M Rows Hits Dataset, First Run / Cold Cache svt-av1: Preset 8 - Bosphorus 4K clickhouse: 100M Rows Hits Dataset, Second Run clickhouse: 100M Rows Hits Dataset, Third Run onednn: IP Shapes 3D - bf16bf16bf16 - CPU openradioss: Bird Strike on Windshield onednn: IP Shapes 1D - bf16bf16bf16 - CPU openradioss: Bumper Beam cloudsuite-ws: 100 cloudsuite-ga: Page Rank deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream svt-av1: Preset 12 - Bosphorus 4K cloudsuite-ga: Connected Components cloudsuite-ws: 400 vvenc: Bosphorus 1080p - Fast vvenc: Bosphorus 4K - Fast svt-av1: Preset 13 - Bosphorus 4K x265: Bosphorus 4K rocksdb: Read Rand Write Rand build-apache: Time To Compile ffmpeg: libx265 - Live ffmpeg: libx265 - Live ffmpeg: libx264 - Upload ffmpeg: libx264 - Upload ffmpeg: libx264 - Video On Demand ffmpeg: libx264 - Video On Demand vvenc: Bosphorus 4K - Faster ffmpeg: libx264 - Platform ffmpeg: libx264 - Platform ffmpeg: libx264 - Live ffmpeg: libx264 - Live svt-av1: Preset 4 - Bosphorus 4K vvenc: Bosphorus 1080p - Faster phpbench: PHP Benchmark Suite ffmpeg: libx265 - Video On Demand ffmpeg: libx265 - Video On Demand ffmpeg: libx265 - Platform ffmpeg: libx265 - Platform ffmpeg: libx265 - Upload ffmpeg: libx265 - Upload gpaw: Carbon Nanotube cloudsuite-ga: Triangle Count pgbench: 1000 - 800 - Read Only - Average Latency pgbench: 1000 - 800 - Read Only onednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPU onednn: Matrix Multiply Batch Shapes Transformer - f32 - CPU onednn: IP Shapes 1D - f32 - CPU openfoam: drivaerFastback, Large Mesh Size EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 19072 854.22 19259 18906 19011 913.75 9.36 89452 25186 24891101267 12.22 654.14 1850.23 162.40 26.92807 404.56 144.2282 64.03 2790.52 4.27 163.5554 224298 2813.45 63.82 142.79 138.96 49.20 6805 8172 10323.176 16.69242 17.50 2.84 265238 14256.40 2.82 3.79 23.0613 17.7432 13149.71 219.83 22.37 287549.0 19.76 20.0067 4398.6 18792 22.91 52.2641 31.158 82.60 815.39 24821 40.294 25679 105.9576 1.14340 389.71 53.5991 21.2170 12.6201 12.6466 20.51 12.37 23.7647 646.15 35.5556106 2.48 5.05 347.363 2.72 337.220 880.639262 122575 18.1367 1610909.22 55.4127 2199582.80 312989000 63.491 71.41 43.11 38.52 309817000 114295000 5397.8 149710000 10.42 352.52 48.8605 392.194 9.26 28.94 14.94 66.29 32.35 1.11 450.6033 101630 13995 110.98 30.00 1.21 152.8306 116.79 41.24 2548333.19 130.30 83.73 35.28 75.4144 53.29 1.459 685239 172713 629.1859 627.6853 143.45 12.12 74.949 148.9584 11.6 103.03 111.82 115.80 267.883 336.88 48.378 346.00 345.53 218.07 118.30 7.333 11525 179.068 15718 11.833 10.496 4.310 172.161 24.86 17.698 123.76 40.81 199.10 12.68 155.37 48.75 9.370 155.46 48.73 217.86 23.18 3.444 25.092 732752 152.05 49.82 49.89 151.85 24.29 103.96 108988 1.150 695761 915672 423.55 1338669 1025584 1314712 1934.07 18.85 2958.98 2900.06 1306974 977380 49694000047 6.42 323598 1243.24 1028.98 84.87 13.47434 788.14 1837.89 287.1813 70.56 1445.13 7.76 280.4317 120264 1.18840 316199 1447.06 71.90 147.17 1754.12 143.84 94.18 3628 4336 27713.943 7.618046 16.53 181223940 5.53 142611 27742.34 5.52 7.28 38.0109 33.4196 25795.58 109.64 24.03 574456.9 10.13 35.4898 8794.6 58173 25.43 97.1983 94.590 41.30 435.02 1398.411 55.936 8356 119.682 8492 206.5323 0.59260 734.99 104.8912 37.7503 25.0243 24.9183 10.88 6.26194 7.05 38.9667 2.82788 4.083 1132.27 18.0244586 4.10 8.59 190.969 4.46 190.997 3.09624 4864299 166901000000 484.985402 147944 35.3196 2373328.37 481479 55.5978 2421891.74 444474000 38.974 116.56 49.15 43.92 422529000 174219000 170828 218986000 16.78 56.9767 240.493 14.89 41.20 22.50 45.86 1.14 475.8713 870117 46059 134.43 42.95 1.23 164.1407 142.78 146481.53 57.13 2826219.16 155.33 151418.97 157128.24 130.23 155325.61 46.65 77.3427 63.34 1.178 849019 236544 636.2769 634.7296 191.99 13.03 152.1486 11.217 5.74 152.31 158.14 423.79 66.077 443.07 443.72 5.55 9820 204.549 14547 11.433 11.054 4.899 191.017 23.06 2195191 18.218 103.93 48.59 198.235232573 12.74 155.42 48.74 10.051 155.38 48.75 215.69 23.41 3.779 24.194 735624 161.72 46.84 46.66 162.339168912 23.56 107.19 444.071 77278 0.935 855642 8.35869 1.66142 1296065 979.21 1265492 1326319 874335 1211.31 12.17 1797.92 1795.39 1296994 1263825 33095407800 14.38 821279 833.99 2183.99 197.58 21.41936 517.32 1070.14 192.6805 65.49 3275.51 5.44 226.0494 170190 2.13731 740490 3280.27 65.67 150.98 1073.72 144.99 60.67 5121 6067 9682.7993 12.95789 19.80 120400741 3.61 200057 18711.92 3.59 4.89 30.4535 23.2903 17211.28 165.39 23.43 390326.3 23.18 25.8301 5947.9 58158 24.16 67.2045 33.213 62.03 616.51 901.850 36.074 25674 38.970 24251 139.2719 0.88677 479.00 70.4128 27.4240 16.3700 16.3219 25.03 4.70749 15.57 31.8965 3.28030 3.005 769.91 32.3950857 3.33 6.56 275.254 3.68 270.840 2.79700 4117643 112350333333 766.720540 124002 17.8487 2309617.42 638378 62.1975 2917560.70 52.718 85.67 43.27 38.45 199221 4463.3 11.87 291.34 53.0316 320.942 10.54 31.30 16.10 54.23 33.41 1.27 515.0566 1324795 23575 118.56 33.10 91.6820 1.39 178.2114 125.26 127405.11 43.02 3431617.24 138.79 129682.72 131406.38 107.77 129033.29 38.88 86.0790 55.36 1.131 884213 224875 729.3104 729.0602 181.39 15.11 64.734 170.1636 14.583 88.65 140.28 143.85 229.595 351.34 58.920 363.28 360.64 201.13 105.44 7.583 9815 130.7157 210.554 14011 14.733 10.188 4.415 195.798 27.01 2369439 18.992 117.23 43.08 214.55 11.77 167.10 45.33 9.431 166.90 45.39 202.95 24.88 3.496 24.360 670928 160.13 47.31 47.38 159.89 23.21 108.80 84114 0.877 912427 2.35438 1.75252 1462648 483.37 1386712 1337500 928018 2570.67 24.72 2774.02 2840.00 1447278 1456236 66206231957 7.63 286858 1570.38 1190.68 100.17 10.79851 1024.68 1604.83 370.1937 70.39 1688.62 10.06 384.2896 93834 0.940455 306931 1689.48 71.43 146.48 1602.68 143.50 119.68 2722 3252 25716.768 5.976653 18.66 238439429 7.01 110558 36411.01 7.01 9.18 46.2930 43.9125 34019.21 82.55 24.04 778483.0 11.70 46.5974 11846.8 61767 25.36 127.5406 91.602 31.80 330.02 1718.936 68.757 9798 102.073 8736 270.2740 0.47053 852.08 137.0417 49.9496 32.2535 32.2500 14.07 7.89700 9.12 48.3491 1.88334 4.820 1313.76 15.6894077 5.14 11.24 161.530 5.56 165.471 4.00035 6957204 194221666667 700.101786 225855 27.6326 2952893.82 336131 64.7191 2164592.24 601120000 33.819 136.95 66.47 59.52 584034000 225284000 165480 294782000 18.06 62.3607 216.184 16.00 45.98 23.20 48.93 1.30 544.6158 1393156 111224 164.25 48.07 1.4 187.6814 163.18 144891.45 61.75 3691244.97 165.33 133788.29 145.30 135890.54 49.77 88.6308 64.72 1.377 728184 225784 738.7817 739.7624 208.59 15.73 174.6170 12.083 7.17 154.60 161.19 429.39 65.954 437.50 440.92 5.3 9831 217.432 14426 11.967 10.393 4.658 193.778 22.13 2190994 20.996 98.37 51.34 215.59 11.71 168.57 44.94 9.526 169.02 44.82 200.05 25.24 3.510 23.346 680136 172.81 43.84 43.80 172.96 22.07 114.41 417.506 74003 1.051 765090 9.13000 2.19750 1315834 1038.36 1323129 1282987 1295214 1520.46 15.29 1957.83 1975.47 1380314 1288469 42284954430 14.86 864802 1076.30 2369.52 212.22 17.88689 651.20 1109.99 240.4095 69.02 3561.39 6.67 283.7118 135636 1.95016 809625 3537.87 70.20 156.46 1124.53 151.07 75.28 4014 4769 18098.804 10.83575 21.03 150974278 4.44 159097 23116.82 4.45 6.22 38.3505 29.2692 21308.51 130.35 23.77 501938.9 24.55 33.1430 7637.8 58645 24.66 82.5527 58.070 49.24 482.82 1177.571 47.103 13865 72.399 13777 172.7305 0.71585 603.36 86.9371 34.1845 19.9788 19.8959 26.50 4.64782 16.18 40.2107 3.17840 3.547 987.77 30.7356491 4.35 8.18 230.689 4.64 226.631 3.63115 5130684 128904333333 784.797160 134575 17.6803 2981451.32 707656 66.4697 3632495.02 528200000 44.751 111.95 45.60 40.52 517810000 176371000 238127 3660.2 226239000 15.10 245.34 56.3260 282.423 13.43 39.52 20.33 45.63 42.32 1.37 546.2807 1378719 36808 129.79 41.46 113.8532 1.49 193.4699 138.95 152248.92 52.81 4198464.11 153.97 156398.74 159784.56 129.22 160998.23 46.07 92.5433 62.27 1.024 976332 263627 791.9745 792.4571 207.54 17.44 57.582 183.7170 15.267 84.32 161.26 164.17 210.643 362.00 66.633 377.03 379.67 186.94 96.53 7.417 9917 140.2311 231.540 13102 14.883 10.350 4.582 210.235 28.24 2750066 18.861 118.65 42.56 211.010138953 11.97 164.52 46.04 9.736 164.12 46.16 207.35 24.35 3.669 24.712 678084 158.71 47.73 47.61 159.12 23.35 108.16 77893 0.822 984394 2.32302 1.59445 910021 507.62 1397332 1118115 905105 3255.75 31.43 5074.57 5033.87 1425667 974407 84365767223 7.62 299732 2097.59 1272.58 105.07 8.761462 1196.03 1606.42 468.9263 62.34 1803.09 12.55 488.6254 74566 0.786803 328435 1804.95 63.68 144.20 1615.13 141.81 152.10 2150 2538 37170.855 4.827648 19.64 299129297 8.82 86704 45746.27 8.81 11.56 51.9364 55.4706 42487.49 64.96 22.75 1003089.4 13.32 58.9004 15222.3 62262 23.96 156.2377 97.517 25.46 262.94 2333.755 93.350 10651 93.903 8552 335.9890 0.36716 1173.42 170.2562 62.3560 39.6557 39.5929 13.62 10.00962 9.32 53.8116 2.04048 5.589 1713.90 15.8133430 6.43 13.40 140.277 6.75 143.597 4.26599 8063050 218603000000 432.073659 301630 34.5344 3518612.74 351517 68.1249 1867112.74 691983000 29.784 149.01 70.75 63.00 665655000 255036000 197227 322475000 19.59 65.3924 199.575 17.26 51.05 25.02 54.13 1.39 575.3658 1030733 181349 173.58 51.46 1.50 204.2260 173.74 63.53 4105338.27 175.35 135921.70 140932.43 148.84 151573.48 53.21 95.0848 65.39 1.569 638731 245226 803.4468 802.1569 201.76 17.44 187.5171 11.817 9.12 163.58 165.46 412.09 71.454 436.77 435.85 5.417 9587 217.701 13891 11.2 10.329 4.688 193.151 22.65 2204871 19.699 101.05 49.98 210.67 11.99 164.86 45.95 9.445 164.38 46.08 206.46 24.46 3.604 22.956 686597 171.53 44.16 44.19 171.41 22.20 113.72 398.988 70042 1.178 690019 12.28794 2.66698 1312741 961.41 1279022 1356145 1252851 1628.99 16.56 1974.31 1989.75 1307991 1332491 44324823090 13.70 774765 1166.69 2162.68 190.87 15.39717 716.95 1106.75 256.5235 72.46 3186.87 7.32 294.2079 127078 1.30138 743355 3217.57 73.86 160.32 1092.81 155.25 83.73 3767 4486 21129.412 8.575596 19.63 161712224 4.95 148990 25079.41 4.94 6.69 40.5096 31.3942 23118.27 122.97 25.34 522787.3 22.30 35.1162 7963.1 59400 26.26 91.5684 67.538 46.24 456.27 1261.441 50.458 12068 83.024 11845 186.0887 0.65554 675.88 93.9657 37.2804 22.1183 22.0707 23.66 4.86899 14.37 41.9519 2.98900 4.001 1112.62 24.1082433 4.36 8.42 212.302 4.74 209.943 2.02266 5147499 149115333333 716.618001 130123 19.3385 2848831.24 688172 62.2907 3574540.35 554082000 42.087 119.84 46.14 41.09 544342000 204519000 233743 3488.4 268016000 15.77 224.14 54.3162 260.908 14.00 40.67 21.04 41.25 43.25 1.27 507.6631 1337915 37315 130.26 42.81 124.1286 1.37 174.3602 139.65 147786.59 54.27 3481927.79 154.38 165810.67 165787.42 137.52 161270.01 47.24 85.8688 63.28 0.991 1008741 246339 716.0241 716.1195 219.43 16.69 55.114 169.9349 13.05 79.17 171.65 175.18 198.426 410.64 67.153 425.45 425.48 173.03 93.97 6.583 9247 128.6660 237.131 13358 13.8 10.555 4.724 214.387 27.63 2690298 18.834 113.57 44.47 210.02 12.02 162.21 46.70 9.984 162.71 46.55 211.67 23.86 3.635 24.844 687000 158.41 47.82 47.87 158.24 23.40 107.90 74250 0.745 1074765 4.31859 1.49498 1353066 1279.15 1351560 952995 1318693 2475.95 24.81 2720.07 2712.50 1296643 1321064 69715833097 18.42 452291 1735.57 3072.39 274.66 11.31944 1033.39 1183.30 369.5420 58.23 4538.43 10.33 455.1184 84001 0.937918 455327 4533.12 60.82 136.28 1186.00 130.65 116.30 2424 2874 22242.530 6.246704 25.83 246464521 6.92 98653 34339.21 6.92 9.79 60.0978 46.6790 33271.17 79.30 20.70 823388.7 30.95 51.6795 12568.1 60941 21.85 132.2972 65.348 30.36 297.72 1912.744 76.510 15683 64.500 12245 271.8806 0.45591 940.29 138.1362 52.7477 31.4000 31.4455 34.00 6.94903 20.72 62.5656 3.25137 5.098 1542.73 23.0942440 6.10 12.44 163.543 6.70 166.988 3.78466 7932933 170229333333 663.825195 250115 19.0558 3893409.95 436633 86.4635 3378044.12 715154000 33.746 138.52 61.66 56.07 691348000 227175000 267282 2799.5 288959000 15.71 191.58 70.2051 225.698 13.99 42.56 19.03 36.39 41.59 1.74 684.8470 1377599 136721 168.38 45.49 177.6432 1.9 241.3333 180.55 50.67 4786407.25 196.33 151997.72 156012.00 146.48 167224.22 48.31 117.4838 57.99 1.386 721335 253058 1010.0008 1010.5833 224.80 18.73 50.802 230.9178 15.283 89.74 172.24 179.74 190.758 365.79 67.308 375.36 380.10 167.45 91.55 7.1 9112 179.6763 231.997 13169 13.267 9.553 4.455 203.194 27.16 2761836 20.388 105.50 47.87 210.12 12.02 163.44 46.35 9.110 163.38 46.36 208.64 24.20 3.421 22.513 678966 174.28 43.46 43.44 174.39 21.32 118.46 70089 0.963 835087 6.48681 2.04640 20909 450.58 20809 20822 20697 3345.71 35.43 901.436 907.291 93771 43513 20888915973 9.61 1269946 1661.48 1771.70 142.53 30.86947 904.01 521.572 320.0058 203.92 2962.18 8.96 362.2935 113149 1.71129 1088420 3023.56 205.17 489.77 520.564 475.07 112.12 3314 3967 18868.723 14.44702 9.55 113495056 5.36 133650 25216.38 5.26 4.4 45.7947 33.8978 22808.14 161.50 68.08 419447.9 35.34 35.8362 6442.7 20565 68.38 92.2695 35.995 59.55 604.76 1010.277 40.411 22446 44.552 22228 173.7712 0.70215 481.60 83.6220 29.8397 18.6943 18.6692 33.19 4.48936 17.77 35.9078 1.92380 3.717 5.74487 899.05 33.0038337 3.47 7.88371 7.01 268.944 7.86162 3.67 272.730 1.64248 4793137 127809333333 626.976115 163851 19.8931 2937926.06 793742 49.9551 4271575.65 519294000 51.838 91.70 31.35 28.13 510587000 168374000 297029 4747.9 213096000 10.88 287.21 44.1261 323.073 9.76 26.79 13.69 59.09 27.47 1.23 471.6297 121626 36646 87.55 28.50 1.38 173.2014 94.98 151274.54 33.71 4262554.19 105.96 164486.94 160307.52 111.92 160541.79 31.67 92.0537 38.52 0.927 1078586 176284 855.9968 855.7781 171.63 13.20 69.243 191.3088 13.317 108.37 143.42 148.73 244.251 311.11 56.031 325.13 325.93 1.81562 207.10 3.34833 111.00 7.517 11245 194.141 14285 12.383 8.394 3.776 176.036 25.70 2770547 22.423 112.80 44.77 247.388378655 10.21 192.08 39.44 7.981 192.02 39.45 178.82 28.24 3.034 20.147 719675 180.03 42.08 41.92 180.71 20.59 122.64 93231 0.712 1123663 3.88765 0.521446 1.39521 21632 217.18 21431 21685 21284 7209.16 73.58 681.159 690.752 29960 34651 42653381293 4.69 488659 3402.82 862.09 78.16 19.64620 1813.34 472.891 639.7687 253.31 1467.67 18.48 704.9499 52646 2.46627 481703 1495.92 257.04 575.90 457.949 547.55 204.17 1641 1979 39798.691 7.347379 8.86 226944746 10.84 69538 54275.42 10.63 8.25 84.8635 65.2131 47801.07 80.17 73.49 838351.8 35.12 69.5889 12874.9 21324 74.68 177.5939 40.942 29.66 302.14 2009.716 80.389 19322 51.774 19540 345.1816 0.35502 939.07 167.3832 58.3269 37.6297 37.6996 17.01 6.56164 9.85 67.1266 1.14313 7.379 2.92655 1619.83 14.6863581 6.09 5.02585 12.30 160.399 4.33315 6.57 168.425 2.40282 7436444 242295666667 357.235290 287528 39.1363 2802626.26 466697 49.9661 3270779.44 667982000 33.036 128.72 49.39 44.48 655675000 238460000 307133 3009.9 295010000 14.12 199.83 45.3578 227.371 12.56 36.01 17.63 37.73 36.47 1.16 488.4066 122135 147653 131.93 37.22 1.32 179.8852 133.13 41.44 3551712.12 136.60 178255.95 180812.11 131.90 205570.62 38.92 92.6396 43.33 1.348 754104 156487 847.3755 848.9104 176.67 11.33 54.704 190.8367 9.6 89.85 137.47 144.22 199.485 388.39 63.096 405.08 407.09 1.88632 162.88 3.67592 91.34 7.35 11235 201.074 14751 11.933 8.721 4.045 180.919 24.42 2579926 22.114 111.60 45.25 250.35 10.09 196.032349446 38.64 8.128 195.55 38.74 173.30 29.14 3.049 20.641 722240 181.97 41.63 41.89 180.82 20.89 120.86 78150 1.066 750218 10.56278 0.255235 1.66443 18776 360.49 18852 18923 18674 3090.28 33.22 1086.78 1076.71 80304 27079 20256398000 7.75 1443216 1544.95 1413.05 116.82 31.83193 853.15 642.826 286.8784 189.89 2358.37 8.43 294.7603 127865 1.82190 1272718 2400.77 191.35 432.47 638.132 410.32 102.67 3769 4621 9964.4105 15.69182 7.75 104010467 5.03 152061 22510.58 4.95 4.09 40.9761 31.0113 20000.76 176.55 61.90 398769.3 28.09 29.1748 6109.7 18581 62.18 83.0341 32.842 64.90 680.31 889.014 35.561 25377 39.409 24360 157.5969 0.75173 449.39 75.6723 25.3454 17.3843 17.3928 26.68 3.28994 14.78 31.0113 1.99051 3.376 6.03750 810.68 33.3006439 3.04 8.29712 6.46 292.729 8.61404 3.29 295.587 1.66931 3825346 117791000000 659.145325 140252 18.8044 2842403.96 743700 41.8063 4068619.97 55.485 85.66 37.08 33.02 277553 4925.4 10.51 301.70 40.6830 346.264 9.37 26.65 13.17 62.82 27.03 1.05 386.8811 104512 21960 98.13 28.82 1.19 144.3061 106.29 140495.61 34.35 4053902.81 118.47 153700.70 141031.60 109.31 141544.55 33.30 76.1206 42.41 1.078 927858 200958 689.6754 690.2354 173.16 13.77 70.288 158.5557 15.433 107.07 141.68 148.12 244.566 312.11 59.414 321.66 325.08 2.22071 204.18 4.48183 110.30 7.517 10340 206.814 13542 14.7 9.153 4.093 190.736 27.77 2420422 20.239 122.36 41.27 227.36 11.11 177.11 42.77 8.830 176.95 42.81 193.69 26.07 3.209 22.274 788731 167.31 45.28 45.13 167.86 22.21 113.70 87786 0.813 983473 2.80481 0.587102 1.47649 19706 177.69 19477 19751 19473 6564.47 67.44 703.511 703.715 31922 34180 40355102327 3.98 597465 3005.72 689.05 65.81 18.26646 1664.20 430.603 578.2529 231.32 1198.22 17.34 589.2842 67775 2.99340 590231 1217.97 234.54 510.92 442.011 486.36 181.98 1956 2330 26940.976 7.523824 7.30 210724462 9.94 80780 47664.17 9.78 7.90 75.2485 59.9668 41669.50 87.28 66.43 798077.1 28.73 61.1833 12235.1 19397 66.12 157.8120 36.483 32.25 342.37 1712.718 68.509 22138 45.177 21929 313.1405 0.38091 844.38 150.0890 51.3945 34.8550 34.7862 14.19 4.76230 8.65 59.6775 1.15641 6.761 3.10763 1382.22 16.5087767 5.84 4.24724 11.19 166.310 4.66619 6.16 175.006 2.39962 6230967 227635333333 461.110891 196790 37.0155 2971169.05 640738 41.4567 3701213.86 33.790 136.71 57.70 51.74 367162 2846.4 16.00 179.68 40.6995 220.500 14.22 39.03 19.27 36.51 39.25 0.99 399.3327 99997 82287 150.71 41.73 1.14 151.8582 152.28 225527.80 47.49 3969670.99 155.38 200467.73 204325.45 138.19 205476.78 44.24 76.5637 49.75 1.176 851464 190873 685.9576 686.4476 176.18 12.60 51.926 159.7519 12.717 78.89 139.88 148.45 190.648 411.38 68.969 433.55 425.45 2.42969 155.37 3.97631 85.45 7.183 10381 213.420 13551 11.7 9.430 4.393 200.381 25.54 2779890 20.063 121.08 41.71 230.436500344 10.96 181.28 41.79 8.908 181.25 41.79 186.41 27.09 3.316 22.265 789297 167.658087463 45.18 45.31 167.16 22.57 111.87 73459 0.953 850161 6.98945 0.255585 1.088780 18205 313.14 18342 18027 18119 2347.83 25.52 1289.58 1294.14 22380 58137 14614638730 6.79 1508607 1175.72 1232.64 102.51 41.96762 640.88 722.166 215.8422 148.57 2047.93 6.43 242.0444 171646 1.94200 1300143 2081.75 151.03 332.04 717.807 311.20 77.99 5199 6321 10152.757 19.49328 6.8 77391048 3.87 207128 17148.89 3.80 3.11 29.3139 23.5945 15262.36 233.90 49.28 286703.7 24.93 23.1655 4397.2 18046 50.01 63.3500 28.723 86.38 889.71 690.470 27.619 27861 35.896 27853 115.5983 0.98742 368.02 55.7478 19.7589 13.2099 13.2078 21.72 3.77644 12.93 23.3890 2.62403 2.619 8.24165 617.71 40.5520172 2.34 11.4399 5.01 373.677 11.4152 2.59 374.171 1.84770 3142066 96712533333 889.882751 148896 16.1504 2164237.05 700379 37.0399 3346967.77 362918000 67.647 65.82 37.00 33.05 359689000 117919000 208713 6074.2 154209000 9.16 383.74 33.0304 421.485 8.18 24.70 12.21 74.50 26.64 0.92 338.9830 118445 13855 93.17 26.26 1.04 126.1607 100.87 118699.47 33.93 3159962.47 113.18 109860.58 113630.04 83.38 118110.63 31.03 69.1881 42.98 1.347 742550 177347 605.6665 605.5730 134.34 11.45 83.059 143.4873 12.95 124.37 109.47 115.37 289.721 283.16 47.122 294.82 295.42 1.80606 231.85 4.20681 122.43 7.383 13034 173.290 17820 13.55 9.107 3.862 166.785 24.96 2311235 19.678 124.46 40.58 216.38 11.67 169.00 44.82 8.552 168.80 44.87 202.08 24.99 3.070 22.233 812732 166.43 45.51 45.66 165.89 22.29 113.29 127015 1.072 746302 2.21622 0.806671 1.69470 19126 155.15 19183 19218 18808 4979.27 51.51 702.689 701.324 23267 31262 29415210430 3.41 966189 2339.16 604.17 55.49 22.14267 1296.57 413.290 439.3341 182.71 1043.48 13.20 482.9247 87290 3.34125 908869 1072.35 188.90 402.63 416.416 376.10 144.01 2534 3001 22099.324 9.733065 6.41 154099244 7.62 103047 36784.83 7.42 6.12 55.4091 45.5497 32137.13 115.77 54.33 580306.3 24.61 46.2704 8906.1 18850 56.73 125.5955 34.360 42.35 445.24 1372.933 54.917 23580 42.423 23290 231.5126 0.49354 695.06 113.0712 38.9043 26.5164 26.5391 11.49 3.69104 7.41 43.5077 1.37242 5.391 4.23272 1076.16 21.2240649 4.46 5.92201 8.77 204.227 5.86134 4.68 209.370 2.21782 4943670 190369000000 725.346436 157229 26.3786 2874778.00 803231 36.3820 3597757.55 571793000 40.403 117.26 43.04 38.43 562172000 187654000 289896 3643.3 245053000 15.05 224.24 33.1059 256.364 13.45 35.89 18.39 43.84 36.84 0.86 350.6344 118993 41096 116.97 38.46 0.99 127.1627 127.62 199748.09 45.17 3912323.12 139.86 199978.55 207339.64 130.49 207770.19 42.08 69.0371 50.50 1.002 997957 171138 599.8080 600.7246 176.86 12.05 56.716 141.3563 12.3 83.81 141.50 150.48 200.960 360.92 67.608 378.61 379.26 1.62390 165.35 3.01823 94.03 7.533 10597 211.627 14408 11.733 9.609 4.417 200.424 25.04 2762454 19.447 121.92 41.42 219.39 11.51 173.17 43.74 8.929 173.16 43.75 193.90 26.04 3.438 22.161 809727 165.06 45.89 46.10 164.33 22.81 110.71 84608 0.750 1067716 5.50135 0.394611 1.17864 OpenBenchmarking.org
CloudSuite Data Analytics Hadoop Slaves: 64 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 64 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 19072 915672 1296065 1462648 1315834 910021 1312741 1353066 20909 21632 18776 19706 18205 19126
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300 600 900 1200 1500 SE +/- 0.21, N = 3 SE +/- 0.12, N = 3 SE +/- 0.56, N = 3 SE +/- 0.04, N = 3 SE +/- 0.48, N = 3 SE +/- 0.49, N = 3 SE +/- 1.20, N = 3 SE +/- 0.66, N = 3 SE +/- 0.13, N = 3 SE +/- 0.07, N = 3 SE +/- 0.25, N = 3 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 854.22 423.55 979.21 483.37 1038.36 507.62 961.41 1279.15 450.58 217.18 360.49 177.69 313.14 155.15 MIN: 777.98 / MAX: 878.94 MIN: 415.99 / MAX: 455.1 MIN: 861.53 / MAX: 1015.88 MIN: 438.12 / MAX: 515.6 MIN: 906.21 / MAX: 1056.67 MIN: 474.68 / MAX: 549.27 MIN: 831.19 / MAX: 978.3 MIN: 1018.37 / MAX: 1317.05 MIN: 338.75 / MAX: 484.67 MIN: 164.55 / MAX: 257.56 MIN: 257.91 / MAX: 392.73 MIN: 141.05 / MAX: 204.41 MIN: 185.19 / MAX: 336.95 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
CloudSuite Data Analytics Hadoop Slaves: 8 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 8 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 19259 1338669 1265492 1386712 1323129 1397332 1279022 1351560 20809 21431 18852 19477 18342 19183
CloudSuite Data Analytics Hadoop Slaves: 32 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 32 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 18906 1025584 1326319 1337500 1282987 1118115 1356145 952995 20822 21685 18923 19751 18027 19218
CloudSuite Data Analytics Hadoop Slaves: 4 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 4 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 19011 1314712 874335 928018 1295214 905105 1252851 1318693 20697 21284 18674 19473 18119 18808
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1500 3000 4500 6000 7500 SE +/- 0.17, N = 3 SE +/- 0.17, N = 3 SE +/- 0.09, N = 3 SE +/- 0.28, N = 3 SE +/- 0.26, N = 3 SE +/- 1.61, N = 3 SE +/- 0.33, N = 3 SE +/- 1.30, N = 3 SE +/- 1.10, N = 3 SE +/- 0.75, N = 3 SE +/- 0.53, N = 3 SE +/- 3.20, N = 3 SE +/- 0.48, N = 3 SE +/- 2.46, N = 3 913.75 1934.07 1211.31 2570.67 1520.46 3255.75 1628.99 2475.95 3345.71 7209.16 3090.28 6564.47 2347.83 4979.27 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 16 32 48 64 80 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 9.36 18.85 12.17 24.72 15.29 31.43 16.56 24.81 35.43 73.58 33.22 67.44 25.52 51.51 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
oneDNN Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1100 2200 3300 4400 5500 SE +/- 10.84, N = 3 SE +/- 10.97, N = 3 SE +/- 26.23, N = 3 SE +/- 21.33, N = 15 SE +/- 16.16, N = 3 SE +/- 4.18, N = 3 SE +/- 24.77, N = 3 SE +/- 2.55, N = 3 SE +/- 7.95, N = 4 SE +/- 8.94, N = 3 SE +/- 2.77, N = 3 SE +/- 4.00, N = 3 SE +/- 5.21, N = 3 2958.98 1797.92 2774.02 1957.83 5074.57 1974.31 2720.07 901.44 681.16 1086.78 703.51 1289.58 702.69 MIN: 2682.11 MIN: 1725.59 MIN: 2185.12 MIN: 1702.97 MIN: 4606.82 MIN: 1898.4 MIN: 2539.45 MIN: 839.85 MIN: 629.82 MIN: 977.32 MIN: 667.26 MIN: 1210.65 MIN: 661.24 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1100 2200 3300 4400 5500 SE +/- 18.38, N = 3 SE +/- 2.38, N = 3 SE +/- 39.18, N = 3 SE +/- 9.33, N = 3 SE +/- 37.47, N = 15 SE +/- 14.60, N = 3 SE +/- 26.36, N = 15 SE +/- 2.21, N = 3 SE +/- 7.44, N = 5 SE +/- 8.46, N = 3 SE +/- 5.69, N = 3 SE +/- 3.49, N = 3 SE +/- 2.28, N = 3 2900.06 1795.39 2840.00 1975.47 5033.87 1989.75 2712.50 907.29 690.75 1076.71 703.72 1294.14 701.32 MIN: 2610.36 MIN: 1733.94 MIN: 2260.17 MIN: 1894.9 MIN: 4268.26 MIN: 1902.82 MIN: 2373.24 MIN: 846.78 MIN: 635.03 MIN: 974.49 MIN: 663.96 MIN: 1216.99 MIN: 665.02 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
CloudSuite Data Analytics Hadoop Slaves: 512 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 512 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 89452 1306974 1296994 1447278 1380314 1425667 1307991 1296643 93771 29960 80304 31922 22380 23267
CloudSuite Data Analytics Hadoop Slaves: 256 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 256 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 25186 977380 1263825 1456236 1288469 974407 1332491 1321064 43513 34651 27079 34180 58137 31262
OpenSSL Algorithm: SHA256 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.0 Algorithm: SHA256 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20000M 40000M 60000M 80000M 100000M SE +/- 29163674.08, N = 3 SE +/- 24582365.01, N = 3 SE +/- 27629858.10, N = 3 SE +/- 54030773.40, N = 3 SE +/- 68531235.70, N = 3 SE +/- 316349484.45, N = 3 SE +/- 186860140.69, N = 3 SE +/- 8398498.36, N = 3 SE +/- 10848440.04, N = 3 SE +/- 10952442.61, N = 3 SE +/- 11924426.00, N = 3 SE +/- 3033485.03, N = 3 SE +/- 9109685.37, N = 3 SE +/- 1989217.69, N = 3 24891101267 49694000047 33095407800 66206231957 42284954430 84365767223 44324823090 69715833097 20888915973 42653381293 20256398000 40355102327 14614638730 29415210430 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 12.22 6.42 14.38 7.63 14.86 7.62 13.70 18.42 9.61 4.69 7.75 3.98 6.79 3.41 MIN: 8.5 / MAX: 28.01 MIN: 6.15 / MAX: 15.78 MIN: 8.17 / MAX: 28.75 MIN: 6.86 / MAX: 22.57 MIN: 8.08 / MAX: 33.72 MIN: 7.15 / MAX: 31.91 MIN: 7.41 / MAX: 31.1 MIN: 9.93 / MAX: 52.04 MIN: 5.23 / MAX: 31.29 MIN: 4.17 / MAX: 21.97 MIN: 4.25 / MAX: 40.39 MIN: 3.28 / MAX: 15.38 MIN: 3.7 / MAX: 21.83 MIN: 2.97 / MAX: 14.93 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
RocksDB Test: Sequential Fill OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Sequential Fill EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K SE +/- 532.43, N = 3 SE +/- 3079.56, N = 3 SE +/- 319.69, N = 3 SE +/- 2451.41, N = 3 SE +/- 597.87, N = 3 SE +/- 1902.35, N = 3 SE +/- 106.07, N = 3 SE +/- 4969.08, N = 3 SE +/- 3588.97, N = 3 SE +/- 1492.53, N = 3 SE +/- 4947.74, N = 3 SE +/- 2179.57, N = 3 SE +/- 6746.06, N = 3 323598 821279 286858 864802 299732 774765 452291 1269946 488659 1443216 597465 1508607 966189 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 700 1400 2100 2800 3500 SE +/- 0.19, N = 3 SE +/- 0.73, N = 3 SE +/- 1.37, N = 3 SE +/- 7.85, N = 3 SE +/- 0.12, N = 3 SE +/- 0.29, N = 3 SE +/- 0.71, N = 3 SE +/- 1.60, N = 3 SE +/- 1.15, N = 3 SE +/- 1.96, N = 3 SE +/- 1.94, N = 3 SE +/- 5.21, N = 3 SE +/- 0.17, N = 3 SE +/- 1.91, N = 3 654.14 1243.24 833.99 1570.38 1076.30 2097.59 1166.69 1735.57 1661.48 3402.82 1544.95 3005.72 1175.72 2339.16 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 700 1400 2100 2800 3500 SE +/- 3.34, N = 3 SE +/- 0.58, N = 3 SE +/- 2.73, N = 3 SE +/- 1.48, N = 3 SE +/- 2.40, N = 3 SE +/- 1.75, N = 3 SE +/- 9.46, N = 3 SE +/- 4.99, N = 3 SE +/- 6.05, N = 3 SE +/- 1.93, N = 3 SE +/- 7.34, N = 3 SE +/- 0.46, N = 3 SE +/- 3.43, N = 3 SE +/- 1.08, N = 3 1850.23 1028.98 2183.99 1190.68 2369.52 1272.58 2162.68 3072.39 1771.70 862.09 1413.05 689.05 1232.64 604.17 MIN: 1073.49 / MAX: 1950.78 MIN: 1009.62 / MAX: 1100.65 MIN: 1919.34 / MAX: 2280.72 MIN: 1162.02 / MAX: 1273 MIN: 1311.77 / MAX: 2481.25 MIN: 1233.3 / MAX: 1361.68 MIN: 1785 / MAX: 2247.11 MIN: 2717.45 / MAX: 3200.51 MIN: 1362.81 / MAX: 1851.05 MIN: 623.51 / MAX: 953.92 MIN: 686.62 / MAX: 1507.17 MIN: 523.39 / MAX: 772.01 MIN: 935.61 / MAX: 1312.43 MIN: 472.25 / MAX: 677.41 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60 120 180 240 300 SE +/- 0.41, N = 3 SE +/- 0.16, N = 3 SE +/- 0.94, N = 3 SE +/- 0.14, N = 3 SE +/- 0.84, N = 3 SE +/- 0.13, N = 3 SE +/- 1.43, N = 3 SE +/- 0.24, N = 3 SE +/- 0.16, N = 3 SE +/- 0.13, N = 3 SE +/- 0.26, N = 3 SE +/- 0.14, N = 3 SE +/- 0.09, N = 3 SE +/- 0.07, N = 3 162.40 84.87 197.58 100.17 212.22 105.07 190.87 274.66 142.53 78.16 116.82 65.81 102.51 55.49 MIN: 81.47 / MAX: 190.75 MIN: 79.52 / MAX: 104.17 MIN: 108.45 / MAX: 224.88 MIN: 87.19 / MAX: 120.18 MIN: 102.13 / MAX: 251.51 MIN: 87.23 / MAX: 132.74 MIN: 91.92 / MAX: 221.58 MIN: 113.93 / MAX: 346.09 MIN: 52.25 / MAX: 172.52 MIN: 70.17 / MAX: 99.06 MIN: 63.95 / MAX: 139.61 MIN: 58.3 / MAX: 79.61 MIN: 56.14 / MAX: 121.15 MIN: 48.46 / MAX: 70.39 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
Pennant Test: sedovbig OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: sedovbig EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 10 20 30 40 50 SE +/- 0.053422, N = 3 SE +/- 0.078086, N = 4 SE +/- 0.083410, N = 3 SE +/- 0.029276, N = 4 SE +/- 0.031210, N = 3 SE +/- 0.049248, N = 5 SE +/- 0.049389, N = 3 SE +/- 0.083702, N = 4 SE +/- 0.015982, N = 3 SE +/- 0.024622, N = 3 SE +/- 0.024301, N = 3 SE +/- 0.015004, N = 3 SE +/- 0.018190, N = 3 SE +/- 0.016802, N = 3 26.928070 13.474340 21.419360 10.798510 17.886890 8.761462 15.397170 11.319440 30.869470 19.646200 31.831930 18.266460 41.967620 22.142670 1. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 400 800 1200 1600 2000 SE +/- 0.27, N = 3 SE +/- 0.57, N = 3 SE +/- 0.42, N = 3 SE +/- 0.89, N = 3 SE +/- 0.67, N = 3 SE +/- 1.42, N = 3 SE +/- 0.47, N = 3 SE +/- 0.61, N = 3 SE +/- 1.35, N = 3 SE +/- 2.62, N = 3 SE +/- 0.30, N = 3 SE +/- 1.17, N = 3 SE +/- 1.16, N = 3 SE +/- 1.02, N = 3 404.56 788.14 517.32 1024.68 651.20 1196.03 716.95 1033.39 904.01 1813.34 853.15 1664.20 640.88 1296.57 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
oneDNN Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 400 800 1200 1600 2000 SE +/- 16.64, N = 3 SE +/- 6.23, N = 3 SE +/- 15.21, N = 15 SE +/- 9.52, N = 3 SE +/- 20.35, N = 15 SE +/- 6.02, N = 3 SE +/- 6.16, N = 3 SE +/- 1.92, N = 3 SE +/- 5.30, N = 3 SE +/- 4.35, N = 15 SE +/- 4.97, N = 3 SE +/- 3.31, N = 3 SE +/- 3.56, N = 3 1837.89 1070.14 1604.83 1109.99 1606.42 1106.75 1183.30 521.57 472.89 642.83 430.60 722.17 413.29 MIN: 1460.53 MIN: 1010.54 MIN: 1222.24 MIN: 1036.06 MIN: 1227.37 MIN: 1032.76 MIN: 1108.19 MIN: 489.81 MIN: 446.12 MIN: 575.4 MIN: 402.38 MIN: 673.5 MIN: 389.55 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 140 280 420 560 700 SE +/- 0.25, N = 3 SE +/- 0.20, N = 3 SE +/- 0.51, N = 3 SE +/- 1.20, N = 3 SE +/- 0.61, N = 3 SE +/- 0.50, N = 3 SE +/- 0.36, N = 3 SE +/- 0.55, N = 3 SE +/- 0.07, N = 3 SE +/- 0.15, N = 3 SE +/- 0.25, N = 3 SE +/- 2.27, N = 3 SE +/- 0.23, N = 3 SE +/- 0.08, N = 3 144.23 287.18 192.68 370.19 240.41 468.93 256.52 369.54 320.01 639.77 286.88 578.25 215.84 439.33
TensorFlow Device: CPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: GoogLeNet EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60 120 180 240 300 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.15, N = 3 SE +/- 0.14, N = 3 SE +/- 0.14, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.33, N = 3 SE +/- 0.11, N = 3 SE +/- 0.20, N = 3 SE +/- 0.10, N = 3 SE +/- 0.11, N = 3 64.03 70.56 65.49 70.39 69.02 62.34 72.46 58.23 203.92 253.31 189.89 231.32 148.57 182.71
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1000 2000 3000 4000 5000 SE +/- 10.65, N = 3 SE +/- 0.75, N = 3 SE +/- 4.10, N = 3 SE +/- 0.56, N = 3 SE +/- 9.18, N = 3 SE +/- 2.22, N = 3 SE +/- 7.16, N = 3 SE +/- 5.09, N = 3 SE +/- 0.75, N = 3 SE +/- 0.75, N = 3 SE +/- 0.81, N = 3 SE +/- 1.46, N = 3 SE +/- 0.68, N = 3 SE +/- 0.85, N = 3 2790.52 1445.13 3275.51 1688.62 3561.39 1803.09 3186.87 4538.43 2962.18 1467.67 2358.37 1198.22 2047.93 1043.48 MIN: 2485.81 / MAX: 2884.12 MIN: 1428.3 / MAX: 1517.31 MIN: 2779.4 / MAX: 3463.81 MIN: 1420.61 / MAX: 1780.64 MIN: 3211.28 / MAX: 3765.97 MIN: 1636.35 / MAX: 1876.9 MIN: 2866.19 / MAX: 3374.03 MIN: 3564.16 / MAX: 4986.6 MIN: 2252.85 / MAX: 3160.04 MIN: 1203.01 / MAX: 1562.63 MIN: 1772.66 / MAX: 2525.32 MIN: 911.32 / MAX: 1454.11 MIN: 1604.74 / MAX: 2166.44 MIN: 886.86 / MAX: 1166.18 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 4.27 7.76 5.44 10.06 6.67 12.55 7.32 10.33 8.96 18.48 8.43 17.34 6.43 13.20 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 150 300 450 600 750 SE +/- 0.06, N = 3 SE +/- 0.45, N = 3 SE +/- 0.29, N = 3 SE +/- 0.51, N = 3 SE +/- 0.19, N = 3 SE +/- 0.82, N = 3 SE +/- 0.08, N = 3 SE +/- 0.43, N = 3 SE +/- 1.30, N = 3 SE +/- 1.61, N = 3 SE +/- 0.55, N = 3 SE +/- 4.23, N = 3 SE +/- 0.24, N = 3 SE +/- 1.35, N = 3 163.56 280.43 226.05 384.29 283.71 488.63 294.21 455.12 362.29 704.95 294.76 589.28 242.04 482.92
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50K 100K 150K 200K 250K SE +/- 1066.52, N = 3 SE +/- 322.54, N = 3 SE +/- 660.98, N = 3 SE +/- 593.91, N = 3 SE +/- 22.36, N = 3 SE +/- 95.38, N = 3 SE +/- 100.17, N = 3 SE +/- 129.50, N = 3 SE +/- 153.33, N = 3 SE +/- 247.04, N = 3 SE +/- 380.50, N = 3 SE +/- 130.77, N = 3 SE +/- 433.96, N = 3 SE +/- 405.08, N = 3 224298 120264 170190 93834 135636 74566 127078 84001 113149 52646 127865 67775 171646 87290 1. (CXX) g++ options: -O3 -lm -ldl
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.7518 1.5036 2.2554 3.0072 3.759 SE +/- 0.003169, N = 7 SE +/- 0.003897, N = 7 SE +/- 0.001690, N = 7 SE +/- 0.002206, N = 7 SE +/- 0.004296, N = 7 SE +/- 0.001763, N = 7 SE +/- 0.000877, N = 7 SE +/- 0.007172, N = 7 SE +/- 0.018972, N = 10 SE +/- 0.009698, N = 7 SE +/- 0.026790, N = 7 SE +/- 0.003371, N = 7 SE +/- 0.028591, N = 15 1.188400 2.137310 0.940455 1.950160 0.786803 1.301380 0.937918 1.711290 2.466270 1.821900 2.993400 1.942000 3.341250 MIN: 0.94 MIN: 1.86 MIN: 0.75 MIN: 1.75 MIN: 0.68 MIN: 1.15 MIN: 0.87 MIN: 1.58 MIN: 2.29 MIN: 1.68 MIN: 2.81 MIN: 1.73 MIN: 3.07 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
RocksDB Test: Random Fill OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Fill EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K SE +/- 582.91, N = 3 SE +/- 6147.44, N = 3 SE +/- 1471.77, N = 3 SE +/- 1896.83, N = 3 SE +/- 4422.55, N = 15 SE +/- 1034.90, N = 3 SE +/- 2590.86, N = 3 SE +/- 2134.61, N = 3 SE +/- 1945.00, N = 3 SE +/- 2897.98, N = 3 SE +/- 5000.73, N = 3 SE +/- 3806.40, N = 3 SE +/- 6232.77, N = 15 316199 740490 306931 809625 328435 743355 455327 1088420 481703 1272718 590231 1300143 908869 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1000 2000 3000 4000 5000 SE +/- 1.49, N = 3 SE +/- 1.35, N = 3 SE +/- 7.34, N = 3 SE +/- 0.39, N = 3 SE +/- 3.85, N = 3 SE +/- 2.09, N = 3 SE +/- 4.08, N = 3 SE +/- 2.29, N = 3 SE +/- 2.23, N = 3 SE +/- 0.13, N = 3 SE +/- 0.31, N = 3 SE +/- 1.27, N = 3 SE +/- 1.13, N = 3 SE +/- 3.51, N = 3 2813.45 1447.06 3280.27 1689.48 3537.87 1804.95 3217.57 4533.12 3023.56 1495.92 2400.77 1217.97 2081.75 1072.35 MIN: 2640.81 / MAX: 2908.21 MIN: 1431.68 / MAX: 1476.13 MIN: 1686.07 / MAX: 3445.04 MIN: 1404.52 / MAX: 1764.68 MIN: 1864.67 / MAX: 3792.11 MIN: 1665.93 / MAX: 1885.89 MIN: 2966.37 / MAX: 3376.92 MIN: 3616.62 / MAX: 4976.85 MIN: 2431.21 / MAX: 3241.15 MIN: 1185.61 / MAX: 1589.83 MIN: 1826.07 / MAX: 2573.73 MIN: 940.6 / MAX: 1321.99 MIN: 951.54 / MAX: 2214.54 MIN: 885.75 / MAX: 1124.15 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
TensorFlow Device: CPU - Batch Size: 512 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: GoogLeNet EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60 120 180 240 300 SE +/- 0.09, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.17, N = 3 SE +/- 0.65, N = 3 SE +/- 0.15, N = 3 SE +/- 0.31, N = 3 SE +/- 0.02, N = 3 SE +/- 0.84, N = 3 63.82 71.90 65.67 71.43 70.20 63.68 73.86 60.82 205.17 257.04 191.35 234.54 151.03 188.90
TensorFlow Device: CPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: AlexNet EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 120 240 360 480 600 SE +/- 0.30, N = 3 SE +/- 0.34, N = 3 SE +/- 0.69, N = 3 SE +/- 0.23, N = 3 SE +/- 0.17, N = 3 SE +/- 0.27, N = 3 SE +/- 0.27, N = 3 SE +/- 0.22, N = 3 SE +/- 0.42, N = 3 SE +/- 0.62, N = 3 SE +/- 0.13, N = 3 SE +/- 0.75, N = 3 SE +/- 0.70, N = 3 SE +/- 2.14, N = 3 142.79 147.17 150.98 146.48 156.46 144.20 160.32 136.28 489.77 575.90 432.47 510.92 332.04 402.63
oneDNN Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 400 800 1200 1600 2000 SE +/- 7.96, N = 3 SE +/- 4.33, N = 3 SE +/- 19.63, N = 3 SE +/- 7.84, N = 3 SE +/- 14.95, N = 15 SE +/- 8.28, N = 3 SE +/- 13.60, N = 3 SE +/- 0.27, N = 3 SE +/- 3.44, N = 15 SE +/- 3.92, N = 3 SE +/- 6.32, N = 3 SE +/- 2.43, N = 3 SE +/- 1.64, N = 3 1754.12 1073.72 1602.68 1124.53 1615.13 1092.81 1186.00 520.56 457.95 638.13 442.01 717.81 416.42 MIN: 1418.92 MIN: 1016.27 MIN: 1268.13 MIN: 1050.25 MIN: 1226.35 MIN: 1014.43 MIN: 1109.52 MIN: 491.07 MIN: 415.28 MIN: 586.68 MIN: 414.92 MIN: 671.06 MIN: 392.54 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
TensorFlow Device: CPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: AlexNet EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 120 240 360 480 600 SE +/- 0.23, N = 3 SE +/- 0.14, N = 3 SE +/- 0.05, N = 3 SE +/- 0.21, N = 3 SE +/- 0.25, N = 3 SE +/- 0.45, N = 3 SE +/- 0.23, N = 3 SE +/- 0.10, N = 3 SE +/- 0.91, N = 3 SE +/- 1.40, N = 3 SE +/- 0.74, N = 3 SE +/- 0.36, N = 3 SE +/- 0.48, N = 3 SE +/- 1.21, N = 3 138.96 143.84 144.99 143.50 151.07 141.81 155.25 130.65 475.07 547.55 410.32 486.36 311.20 376.10
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.13, N = 3 SE +/- 0.19, N = 3 SE +/- 0.29, N = 3 SE +/- 0.17, N = 3 SE +/- 0.31, N = 3 SE +/- 0.21, N = 3 SE +/- 0.65, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 3 SE +/- 0.33, N = 3 SE +/- 0.24, N = 3 SE +/- 0.38, N = 3 SE +/- 0.06, N = 3 SE +/- 0.18, N = 3 49.20 94.18 60.67 119.68 75.28 152.10 83.73 116.30 112.12 204.17 102.67 181.98 77.99 144.01 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1500 3000 4500 6000 7500 SE +/- 30.83, N = 3 SE +/- 15.06, N = 3 SE +/- 10.48, N = 3 SE +/- 4.18, N = 3 SE +/- 19.73, N = 3 SE +/- 0.33, N = 3 SE +/- 5.24, N = 3 SE +/- 2.96, N = 3 SE +/- 17.29, N = 3 SE +/- 10.00, N = 3 SE +/- 6.57, N = 3 SE +/- 3.18, N = 3 SE +/- 34.35, N = 3 SE +/- 7.69, N = 3 6805 3628 5121 2722 4014 2150 3767 2424 3314 1641 3769 1956 5199 2534 1. (CXX) g++ options: -O3 -lm -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2K 4K 6K 8K 10K SE +/- 14.64, N = 3 SE +/- 5.04, N = 3 SE +/- 17.21, N = 3 SE +/- 6.98, N = 3 SE +/- 22.62, N = 3 SE +/- 12.06, N = 3 SE +/- 6.51, N = 3 SE +/- 8.33, N = 3 SE +/- 15.01, N = 3 SE +/- 0.88, N = 3 SE +/- 16.80, N = 3 SE +/- 11.06, N = 3 SE +/- 7.21, N = 3 SE +/- 12.78, N = 3 8172 4336 6067 3252 4769 2538 4486 2874 3967 1979 4621 2330 6321 3001 1. (CXX) g++ options: -O3 -lm -ldl
LULESH OpenBenchmarking.org z/s, More Is Better LULESH 2.0.3 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 9K 18K 27K 36K 45K SE +/- 24.59, N = 6 SE +/- 149.46, N = 6 SE +/- 25.11, N = 6 SE +/- 276.03, N = 15 SE +/- 101.13, N = 5 SE +/- 90.00, N = 4 SE +/- 138.07, N = 5 SE +/- 29.51, N = 3 SE +/- 85.02, N = 5 SE +/- 13.51, N = 4 SE +/- 26.68, N = 6 SE +/- 38.77, N = 6 SE +/- 11.87, N = 6 SE +/- 40.17, N = 5 10323.18 27713.94 9682.80 25716.77 18098.80 37170.86 21129.41 22242.53 18868.72 39798.69 9964.41 26940.98 10152.76 22099.32 1. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi
Pennant Test: leblancbig OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: leblancbig EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.027516, N = 3 SE +/- 0.016342, N = 5 SE +/- 0.066993, N = 4 SE +/- 0.020399, N = 6 SE +/- 0.065044, N = 4 SE +/- 0.022993, N = 6 SE +/- 0.028009, N = 5 SE +/- 0.054440, N = 6 SE +/- 0.017732, N = 4 SE +/- 0.011875, N = 5 SE +/- 0.025498, N = 3 SE +/- 0.022667, N = 5 SE +/- 0.006168, N = 3 SE +/- 0.008469, N = 5 16.692420 7.618046 12.957890 5.976653 10.835750 4.827648 8.575596 6.246704 14.447020 7.347379 15.691820 7.523824 19.493280 9.733065 1. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6 12 18 24 30 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 17.50 16.53 19.80 18.66 21.03 19.64 19.63 25.83 9.55 8.86 7.75 7.30 6.80 6.41 MIN: 9.9 / MAX: 31.67 MIN: 15.85 / MAX: 27.79 MIN: 9.47 / MAX: 32.84 MIN: 17.49 / MAX: 31.43 MIN: 10.07 / MAX: 37.02 MIN: 17.9 / MAX: 30.08 MIN: 10.05 / MAX: 32.68 MIN: 12.36 / MAX: 42.4 MIN: 5.64 / MAX: 161.27 MIN: 7.46 / MAX: 22.29 MIN: 4.53 / MAX: 25.85 MIN: 6.03 / MAX: 21.33 MIN: 4.77 / MAX: 21.69 MIN: 5.31 / MAX: 19.26 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Read EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60M 120M 180M 240M 300M SE +/- 286135.95, N = 3 SE +/- 547389.34, N = 3 SE +/- 885950.65, N = 3 SE +/- 207267.91, N = 3 SE +/- 716630.49, N = 3 SE +/- 275956.06, N = 3 SE +/- 795243.99, N = 3 SE +/- 260236.87, N = 3 SE +/- 2092706.33, N = 3 SE +/- 594128.06, N = 3 SE +/- 1248520.83, N = 3 SE +/- 427323.28, N = 3 SE +/- 779454.00, N = 3 181223940 120400741 238439429 150974278 299129297 161712224 246464521 113495056 226944746 104010467 210724462 77391048 154099244 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 2.84 5.53 3.61 7.01 4.44 8.82 4.95 6.92 5.36 10.84 5.03 9.94 3.87 7.62 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60K 120K 180K 240K 300K SE +/- 981.14, N = 3 SE +/- 359.93, N = 3 SE +/- 1060.89, N = 3 SE +/- 865.73, N = 3 SE +/- 453.13, N = 3 SE +/- 337.67, N = 3 SE +/- 601.99, N = 3 SE +/- 89.37, N = 3 SE +/- 384.33, N = 3 SE +/- 150.12, N = 3 SE +/- 873.63, N = 3 SE +/- 207.56, N = 3 SE +/- 339.77, N = 3 SE +/- 152.22, N = 3 265238 142611 200057 110558 159097 86704 148990 98653 133650 69538 152061 80780 207128 103047 1. (CXX) g++ options: -O3 -lm -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12K 24K 36K 48K 60K SE +/- 3.86, N = 3 SE +/- 47.15, N = 3 SE +/- 25.63, N = 3 SE +/- 96.63, N = 3 SE +/- 36.34, N = 3 SE +/- 31.93, N = 3 SE +/- 28.61, N = 3 SE +/- 463.83, N = 3 SE +/- 22.82, N = 3 SE +/- 28.36, N = 3 SE +/- 19.47, N = 3 SE +/- 11.43, N = 3 SE +/- 12.78, N = 3 SE +/- 51.11, N = 3 14256.40 27742.34 18711.92 36411.01 23116.82 45746.27 25079.41 34339.21 25216.38 54275.42 22510.58 47664.17 17148.89 36784.83 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 2.82 5.52 3.59 7.01 4.45 8.81 4.94 6.92 5.26 10.63 4.95 9.78 3.80 7.42 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
SVT-HEVC Tuning: 1 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-HEVC 1.5.0 Tuning: 1 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 3.79 7.28 4.89 9.18 6.22 11.56 6.69 9.79 4.40 8.25 4.09 7.90 3.11 6.12 1. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Asian Dragon EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 4 SE +/- 0.05, N = 3 SE +/- 0.13, N = 4 SE +/- 0.03, N = 4 SE +/- 0.04, N = 5 SE +/- 0.04, N = 4 SE +/- 0.09, N = 6 SE +/- 0.06, N = 4 SE +/- 0.02, N = 5 SE +/- 0.03, N = 3 SE +/- 0.03, N = 4 23.06 38.01 30.45 46.29 38.35 51.94 40.51 60.10 45.79 84.86 40.98 75.25 29.31 55.41 MIN: 22.91 / MAX: 23.57 MIN: 37.62 / MAX: 38.66 MIN: 30.17 / MAX: 30.93 MIN: 45.68 / MAX: 47.36 MIN: 37.95 / MAX: 38.96 MIN: 50.91 / MAX: 54.47 MIN: 40.15 / MAX: 41.05 MIN: 59.02 / MAX: 61.86 MIN: 45.07 / MAX: 48.58 MIN: 82.99 / MAX: 89.58 MIN: 39.96 / MAX: 43 MIN: 73.81 / MAX: 79.52 MIN: 28.56 / MAX: 31.49 MIN: 54.58 / MAX: 57.85
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 15 30 45 60 75 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 17.74 33.42 23.29 43.91 29.27 55.47 31.39 46.68 33.90 65.21 31.01 59.97 23.59 45.55
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 10K 20K 30K 40K 50K SE +/- 16.19, N = 3 SE +/- 47.98, N = 3 SE +/- 2.86, N = 3 SE +/- 25.78, N = 3 SE +/- 9.24, N = 3 SE +/- 39.42, N = 3 SE +/- 8.38, N = 3 SE +/- 113.09, N = 3 SE +/- 9.27, N = 3 SE +/- 9.04, N = 3 SE +/- 22.59, N = 3 SE +/- 46.35, N = 3 SE +/- 6.67, N = 3 SE +/- 51.77, N = 3 13149.71 25795.58 17211.28 34019.21 21308.51 42487.49 23118.27 33271.17 22808.14 47801.07 20000.76 41669.50 15262.36 32137.13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
Blender Blend File: Classroom - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Classroom - Compute: CPU-Only EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.29, N = 3 SE +/- 0.30, N = 3 SE +/- 0.20, N = 3 SE +/- 0.18, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 SE +/- 0.25, N = 3 SE +/- 0.14, N = 3 SE +/- 0.13, N = 3 SE +/- 0.37, N = 3 SE +/- 0.14, N = 3 219.83 109.64 165.39 82.55 130.35 64.96 122.97 79.30 161.50 80.17 176.55 87.28 233.90 115.77
TensorFlow Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: ResNet-50 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 16 32 48 64 80 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.21, N = 3 SE +/- 0.03, N = 3 SE +/- 0.23, N = 3 SE +/- 0.02, N = 3 SE +/- 0.10, N = 3 22.37 24.03 23.43 24.04 23.77 22.75 25.34 20.70 68.08 73.49 61.90 66.43 49.28 54.33
OpenSSL Algorithm: RSA4096 OpenBenchmarking.org verify/s, More Is Better OpenSSL 3.0 Algorithm: RSA4096 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200K 400K 600K 800K 1000K SE +/- 27.40, N = 3 SE +/- 36.78, N = 3 SE +/- 51.25, N = 3 SE +/- 52.75, N = 3 SE +/- 556.85, N = 3 SE +/- 55.88, N = 3 SE +/- 34.51, N = 3 SE +/- 53.07, N = 3 SE +/- 41.22, N = 3 SE +/- 40.84, N = 3 SE +/- 54.53, N = 3 SE +/- 292.45, N = 3 SE +/- 83.11, N = 3 SE +/- 232.08, N = 3 287549.0 574456.9 390326.3 778483.0 501938.9 1003089.4 522787.3 823388.7 419447.9 838351.8 398769.3 798077.1 286703.7 580306.3 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 8 16 24 32 40 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 19.76 10.13 23.18 11.70 24.55 13.32 22.30 30.95 35.34 35.12 28.09 28.73 24.93 24.61 MIN: 10.1 / MAX: 35.55 MIN: 9.28 / MAX: 20.91 MIN: 12.53 / MAX: 39.62 MIN: 10.76 / MAX: 20.03 MIN: 13.09 / MAX: 41.71 MIN: 10.8 / MAX: 27.29 MIN: 11.46 / MAX: 38.87 MIN: 16.7 / MAX: 61.98 MIN: 17.29 / MAX: 68.72 MIN: 31.16 / MAX: 58.07 MIN: 13.13 / MAX: 55.07 MIN: 25.35 / MAX: 48.34 MIN: 12.1 / MAX: 57.1 MIN: 21.31 / MAX: 35.8 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Crown EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 15 30 45 60 75 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.08, N = 4 SE +/- 0.11, N = 3 SE +/- 0.07, N = 5 SE +/- 0.03, N = 3 SE +/- 0.10, N = 4 SE +/- 0.07, N = 3 SE +/- 0.07, N = 5 SE +/- 0.04, N = 3 SE +/- 0.33, N = 5 SE +/- 0.08, N = 3 SE +/- 0.05, N = 4 20.01 35.49 25.83 46.60 33.14 58.90 35.12 51.68 35.84 69.59 29.17 61.18 23.17 46.27 MIN: 19.68 / MAX: 20.39 MIN: 35 / MAX: 36.16 MIN: 25.36 / MAX: 26.62 MIN: 45.29 / MAX: 47.9 MIN: 32.13 / MAX: 34.24 MIN: 57.6 / MAX: 61.52 MIN: 34.38 / MAX: 36.15 MIN: 48.53 / MAX: 56.01 MIN: 34.73 / MAX: 37.86 MIN: 67.34 / MAX: 73.46 MIN: 28.31 / MAX: 34.1 MIN: 57.63 / MAX: 66.74 MIN: 22.47 / MAX: 25.37 MIN: 45.19 / MAX: 48.79
OpenSSL Algorithm: RSA4096 OpenBenchmarking.org sign/s, More Is Better OpenSSL 3.0 Algorithm: RSA4096 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3K 6K 9K 12K 15K SE +/- 3.48, N = 3 SE +/- 5.12, N = 3 SE +/- 0.09, N = 3 SE +/- 9.47, N = 3 SE +/- 5.98, N = 3 SE +/- 12.10, N = 3 SE +/- 7.21, N = 3 SE +/- 10.29, N = 3 SE +/- 0.27, N = 3 SE +/- 0.24, N = 3 SE +/- 13.25, N = 3 SE +/- 5.32, N = 3 SE +/- 0.18, N = 3 SE +/- 0.90, N = 3 4398.6 8794.6 5947.9 11846.8 7637.8 15222.3 7963.1 12568.1 6442.7 12874.9 6109.7 12235.1 4397.2 8906.1 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
CloudSuite Data Analytics Hadoop Slaves: 1 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 1 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 13K 26K 39K 52K 65K 18792 58173 58158 61767 58645 62262 59400 60941 20565 21324 18581 19397 18046 18850
TensorFlow Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: ResNet-50 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.37, N = 3 SE +/- 0.03, N = 3 SE +/- 0.52, N = 3 SE +/- 0.02, N = 3 SE +/- 0.15, N = 3 22.91 25.43 24.16 25.36 24.66 23.96 26.26 21.85 68.38 74.68 62.18 66.12 50.01 56.73
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.12, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.85, N = 3 SE +/- 0.28, N = 3 SE +/- 0.05, N = 3 SE +/- 0.15, N = 3 SE +/- 0.99, N = 3 SE +/- 0.41, N = 3 SE +/- 1.12, N = 3 SE +/- 0.53, N = 3 SE +/- 0.30, N = 3 52.26 97.20 67.20 127.54 82.55 156.24 91.57 132.30 92.27 177.59 83.03 157.81 63.35 125.60
PostgreSQL Scaling Factor: 1000 - Clients: 800 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 800 - Mode: Read Write - Average Latency EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.26, N = 3 SE +/- 1.69, N = 12 SE +/- 0.81, N = 12 SE +/- 1.13, N = 3 SE +/- 0.22, N = 3 SE +/- 7.23, N = 9 SE +/- 0.15, N = 3 SE +/- 0.72, N = 3 SE +/- 0.31, N = 3 SE +/- 0.18, N = 3 SE +/- 0.18, N = 3 SE +/- 0.22, N = 3 SE +/- 0.06, N = 3 SE +/- 0.44, N = 3 31.16 94.59 33.21 91.60 58.07 97.52 67.54 65.35 36.00 40.94 32.84 36.48 28.72 34.36 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Blender Blend File: BMW27 - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: BMW27 - Compute: CPU-Only EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.13, N = 3 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.12, N = 3 82.60 41.30 62.03 31.80 49.24 25.46 46.24 30.36 59.55 29.66 64.90 32.25 86.38 42.35
Blender Blend File: Barbershop - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Barbershop - Compute: CPU-Only EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200 400 600 800 1000 SE +/- 0.57, N = 3 SE +/- 0.53, N = 3 SE +/- 2.04, N = 3 SE +/- 0.36, N = 3 SE +/- 0.04, N = 3 SE +/- 0.82, N = 3 SE +/- 0.45, N = 3 SE +/- 0.59, N = 3 SE +/- 0.64, N = 3 SE +/- 0.29, N = 3 SE +/- 3.07, N = 3 SE +/- 0.18, N = 3 SE +/- 0.21, N = 3 SE +/- 0.38, N = 3 815.39 435.02 616.51 330.02 482.82 262.94 456.27 297.72 604.76 302.14 680.31 342.37 889.71 445.24
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 500 1000 1500 2000 2500 SE +/- 11.90, N = 4 SE +/- 0.56, N = 3 SE +/- 3.16, N = 4 SE +/- 0.14, N = 3 SE +/- 4.00, N = 5 SE +/- 1.10, N = 4 SE +/- 3.71, N = 5 SE +/- 0.83, N = 3 SE +/- 4.35, N = 5 SE +/- 1.48, N = 3 SE +/- 7.83, N = 4 SE +/- 1.38, N = 3 SE +/- 0.78, N = 4 1398.41 901.85 1718.94 1177.57 2333.76 1261.44 1912.74 1010.28 2009.72 889.01 1712.72 690.47 1372.93 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.48, N = 4 SE +/- 0.02, N = 3 SE +/- 0.13, N = 4 SE +/- 0.01, N = 3 SE +/- 0.16, N = 5 SE +/- 0.04, N = 4 SE +/- 0.15, N = 5 SE +/- 0.03, N = 3 SE +/- 0.17, N = 5 SE +/- 0.06, N = 3 SE +/- 0.31, N = 4 SE +/- 0.05, N = 3 SE +/- 0.03, N = 4 55.94 36.07 68.76 47.10 93.35 50.46 76.51 40.41 80.39 35.56 68.51 27.62 54.92 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
PostgreSQL Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6K 12K 18K 24K 30K SE +/- 210.94, N = 3 SE +/- 43.57, N = 3 SE +/- 239.71, N = 7 SE +/- 68.86, N = 3 SE +/- 246.74, N = 12 SE +/- 88.49, N = 3 SE +/- 167.15, N = 12 SE +/- 567.20, N = 9 SE +/- 84.27, N = 3 SE +/- 265.07, N = 3 SE +/- 144.91, N = 3 SE +/- 180.74, N = 3 SE +/- 212.63, N = 3 SE +/- 300.77, N = 3 24821 8356 25674 9798 13865 10651 12068 15683 22446 19322 25377 22138 27861 23580 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write - Average Latency EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.34, N = 3 SE +/- 0.63, N = 3 SE +/- 0.37, N = 7 SE +/- 0.71, N = 3 SE +/- 1.40, N = 12 SE +/- 0.78, N = 3 SE +/- 1.07, N = 12 SE +/- 2.55, N = 9 SE +/- 0.17, N = 3 SE +/- 0.71, N = 3 SE +/- 0.23, N = 3 SE +/- 0.37, N = 3 SE +/- 0.27, N = 3 SE +/- 0.54, N = 3 40.29 119.68 38.97 102.07 72.40 93.90 83.02 64.50 44.55 51.77 39.41 45.18 35.90 42.42 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1000 - Clients: 800 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 800 - Mode: Read Write EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6K 12K 18K 24K 30K SE +/- 214.52, N = 3 SE +/- 176.72, N = 12 SE +/- 611.47, N = 12 SE +/- 109.43, N = 3 SE +/- 52.15, N = 3 SE +/- 590.01, N = 9 SE +/- 26.13, N = 3 SE +/- 136.50, N = 3 SE +/- 190.25, N = 3 SE +/- 83.93, N = 3 SE +/- 132.14, N = 3 SE +/- 131.27, N = 3 SE +/- 55.23, N = 3 SE +/- 299.85, N = 3 25679 8492 24251 8736 13777 8552 11845 12245 22228 19540 24360 21929 27853 23290 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 80 160 240 320 400 SE +/- 0.16, N = 3 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.27, N = 3 SE +/- 0.28, N = 3 SE +/- 0.20, N = 3 SE +/- 0.11, N = 3 SE +/- 0.86, N = 3 SE +/- 0.37, N = 3 SE +/- 0.54, N = 3 SE +/- 0.61, N = 3 SE +/- 0.35, N = 3 SE +/- 0.23, N = 3 SE +/- 0.29, N = 3 105.96 206.53 139.27 270.27 172.73 335.99 186.09 271.88 173.77 345.18 157.60 313.14 115.60 231.51
NAMD ATPase Simulation - 327,506 Atoms OpenBenchmarking.org days/ns, Fewer Is Better NAMD 2.14 ATPase Simulation - 327,506 Atoms EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.2573 0.5146 0.7719 1.0292 1.2865 SE +/- 0.00059, N = 3 SE +/- 0.00060, N = 3 SE +/- 0.00216, N = 3 SE +/- 0.00231, N = 3 SE +/- 0.00039, N = 3 SE +/- 0.00049, N = 3 SE +/- 0.00115, N = 3 SE +/- 0.00061, N = 3 SE +/- 0.00160, N = 3 SE +/- 0.00053, N = 3 SE +/- 0.00023, N = 3 SE +/- 0.00083, N = 3 SE +/- 0.00172, N = 3 SE +/- 0.00067, N = 3 1.14340 0.59260 0.88677 0.47053 0.71585 0.36716 0.65554 0.45591 0.70215 0.35502 0.75173 0.38091 0.98742 0.49354
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300 600 900 1200 1500 SE +/- 0.47, N = 3 SE +/- 1.53, N = 3 SE +/- 0.91, N = 3 SE +/- 1.28, N = 3 SE +/- 2.26, N = 3 SE +/- 0.46, N = 3 SE +/- 0.75, N = 3 SE +/- 0.33, N = 3 SE +/- 0.77, N = 3 SE +/- 0.97, N = 3 SE +/- 0.55, N = 3 SE +/- 0.67, N = 3 SE +/- 0.43, N = 3 SE +/- 1.91, N = 3 389.71 734.99 479.00 852.08 603.36 1173.42 675.88 940.29 481.60 939.07 449.39 844.38 368.02 695.06 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.21, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.30, N = 3 SE +/- 0.08, N = 3 SE +/- 0.37, N = 3 SE +/- 0.06, N = 3 SE +/- 0.50, N = 3 SE +/- 0.22, N = 3 SE +/- 0.13, N = 3 53.60 104.89 70.41 137.04 86.94 170.26 93.97 138.14 83.62 167.38 75.67 150.09 55.75 113.07
Embree Binary: Pathtracer - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer - Model: Crown EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 14 28 42 56 70 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.13, N = 3 SE +/- 0.05, N = 4 SE +/- 0.02, N = 3 SE +/- 0.22, N = 5 SE +/- 0.04, N = 3 SE +/- 0.16, N = 4 SE +/- 0.08, N = 3 SE +/- 0.05, N = 4 SE +/- 0.01, N = 3 SE +/- 0.06, N = 4 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 21.22 37.75 27.42 49.95 34.18 62.36 37.28 52.75 29.84 58.33 25.35 51.39 19.76 38.90 MIN: 20.8 / MAX: 21.59 MIN: 37.14 / MAX: 38.79 MIN: 26.84 / MAX: 28.27 MIN: 48.86 / MAX: 51.27 MIN: 33.8 / MAX: 34.89 MIN: 60.41 / MAX: 65.16 MIN: 36.31 / MAX: 38.34 MIN: 51.1 / MAX: 58.19 MIN: 29.02 / MAX: 31.34 MIN: 56.72 / MAX: 61.53 MIN: 24.68 / MAX: 28.35 MIN: 49.55 / MAX: 55.56 MIN: 19.56 / MAX: 20.64 MIN: 38.2 / MAX: 40.63
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 9 18 27 36 45 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.10, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 12.62 25.02 16.37 32.25 19.98 39.66 22.12 31.40 18.69 37.63 17.38 34.86 13.21 26.52
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 9 18 27 36 45 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 12.65 24.92 16.32 32.25 19.90 39.59 22.07 31.45 18.67 37.70 17.39 34.79 13.21 26.54
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 8 16 24 32 40 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.10, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 20.51 10.88 25.03 14.07 26.50 13.62 23.66 34.00 33.19 17.01 26.68 14.19 21.72 11.49 MIN: 10.96 / MAX: 31.38 MIN: 9.85 / MAX: 18.79 MIN: 17.49 / MAX: 46.59 MIN: 11.6 / MAX: 34.29 MIN: 15.94 / MAX: 62.11 MIN: 11.93 / MAX: 37.05 MIN: 13.21 / MAX: 47.37 MIN: 20.86 / MAX: 90.26 MIN: 14.88 / MAX: 64.4 MIN: 12.34 / MAX: 32.47 MIN: 13.7 / MAX: 43.32 MIN: 10.82 / MAX: 27.29 MIN: 10.48 / MAX: 36.43 MIN: 9.55 / MAX: 23.06 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.06890, N = 5 SE +/- 0.03643, N = 15 SE +/- 0.09795, N = 3 SE +/- 0.01665, N = 3 SE +/- 0.02793, N = 3 SE +/- 0.01466, N = 3 SE +/- 0.03340, N = 3 SE +/- 0.04992, N = 3 SE +/- 0.03026, N = 3 SE +/- 0.00667, N = 3 SE +/- 0.06310, N = 3 SE +/- 0.00784, N = 3 SE +/- 0.00229, N = 3 6.26194 4.70749 7.89700 4.64782 10.00962 4.86899 6.94903 4.48936 6.56164 3.28994 4.76230 3.77644 3.69104 MIN: 4.39 MIN: 3.51 MIN: 6.4 MIN: 3.7 MIN: 7.97 MIN: 3.71 MIN: 4.75 MIN: 3.05 MIN: 5.75 MIN: 2.86 MIN: 3.24 MIN: 3.04 MIN: 3.12 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 12.37 7.05 15.57 9.12 16.18 9.32 14.37 20.72 17.77 9.85 14.78 8.65 12.93 7.41 MIN: 7.65 / MAX: 28.74 MIN: 6.43 / MAX: 17.91 MIN: 8.87 / MAX: 31.65 MIN: 7.26 / MAX: 24.13 MIN: 8.55 / MAX: 33.46 MIN: 7.86 / MAX: 22.87 MIN: 8.67 / MAX: 30.82 MIN: 16.73 / MAX: 74.02 MIN: 9.82 / MAX: 36.18 MIN: 8.63 / MAX: 22.81 MIN: 8.27 / MAX: 28.31 MIN: 7.32 / MAX: 20.32 MIN: 7.44 / MAX: 25.18 MIN: 6.33 / MAX: 18.13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
Embree Binary: Pathtracer - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer - Model: Asian Dragon EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 15 30 45 60 75 SE +/- 0.14, N = 3 SE +/- 0.05, N = 3 SE +/- 0.13, N = 3 SE +/- 0.06, N = 4 SE +/- 0.04, N = 4 SE +/- 0.09, N = 4 SE +/- 0.05, N = 4 SE +/- 0.03, N = 5 SE +/- 0.09, N = 3 SE +/- 0.05, N = 5 SE +/- 0.04, N = 3 SE +/- 0.06, N = 5 SE +/- 0.02, N = 3 SE +/- 0.05, N = 4 23.76 38.97 31.90 48.35 40.21 53.81 41.95 62.57 35.91 67.13 31.01 59.68 23.39 43.51 MIN: 23.41 / MAX: 24.11 MIN: 38.53 / MAX: 40.01 MIN: 31.52 / MAX: 32.65 MIN: 47.63 / MAX: 49.46 MIN: 39.78 / MAX: 40.88 MIN: 52.99 / MAX: 56.35 MIN: 41.57 / MAX: 42.56 MIN: 61.2 / MAX: 64.08 MIN: 34.65 / MAX: 37.75 MIN: 65.98 / MAX: 70.89 MIN: 29.86 / MAX: 33.48 MIN: 58.54 / MAX: 62.25 MIN: 23.25 / MAX: 24.1 MIN: 43 / MAX: 44.91
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.7381 1.4762 2.2143 2.9524 3.6905 SE +/- 0.00873, N = 9 SE +/- 0.00656, N = 9 SE +/- 0.00706, N = 9 SE +/- 0.00505, N = 9 SE +/- 0.01467, N = 15 SE +/- 0.00439, N = 9 SE +/- 0.02517, N = 15 SE +/- 0.00280, N = 9 SE +/- 0.00134, N = 9 SE +/- 0.00359, N = 9 SE +/- 0.00211, N = 9 SE +/- 0.01627, N = 9 SE +/- 0.00228, N = 9 2.82788 3.28030 1.88334 3.17840 2.04048 2.98900 3.25137 1.92380 1.14313 1.99051 1.15641 2.62403 1.37242 MIN: 2.42 MIN: 2.8 MIN: 1.51 MIN: 2.9 MIN: 1.66 MIN: 2.73 MIN: 1.97 MIN: 1.66 MIN: 1.04 MIN: 1.71 MIN: 0.96 MIN: 2.27 MIN: 1.2 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2023 Implementation: MPI CPU - Input: water_GMX50_bare EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2 4 6 8 10 SE +/- 0.009, N = 3 SE +/- 0.003, N = 3 SE +/- 0.015, N = 3 SE +/- 0.006, N = 3 SE +/- 0.019, N = 3 SE +/- 0.013, N = 3 SE +/- 0.008, N = 3 SE +/- 0.025, N = 3 SE +/- 0.011, N = 3 SE +/- 0.004, N = 3 SE +/- 0.019, N = 3 SE +/- 0.001, N = 3 SE +/- 0.018, N = 3 4.083 3.005 4.820 3.547 5.589 4.001 5.098 3.717 7.379 3.376 6.761 2.619 5.391 1. (CXX) g++ options: -O3
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2 4 6 8 10 SE +/- 0.01186, N = 7 SE +/- 0.00326, N = 7 SE +/- 0.02123, N = 7 SE +/- 0.00414, N = 7 SE +/- 0.00522, N = 7 SE +/- 0.00127, N = 7 5.74487 2.92655 6.03750 3.10763 8.24165 4.23272 MIN: 5.58 MIN: 2.88 MIN: 5.8 MIN: 3.01 MIN: 8.12 MIN: 4.15 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 400 800 1200 1600 2000 SE +/- 2.63, N = 3 SE +/- 1.01, N = 3 SE +/- 0.50, N = 3 SE +/- 0.70, N = 3 SE +/- 0.76, N = 3 SE +/- 3.83, N = 3 SE +/- 3.78, N = 3 SE +/- 1.02, N = 3 SE +/- 0.64, N = 3 SE +/- 2.61, N = 3 SE +/- 1.01, N = 3 SE +/- 1.68, N = 3 SE +/- 0.53, N = 3 SE +/- 1.01, N = 3 646.15 1132.27 769.91 1313.76 987.77 1713.90 1112.62 1542.73 899.05 1619.83 810.68 1382.22 617.71 1076.16 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
Xcompact3d Incompact3d Input: input.i3d 193 Cells Per Direction OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 193 Cells Per Direction EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 9 18 27 36 45 SE +/- 0.14, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.28, N = 15 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.42, N = 3 SE +/- 0.19, N = 4 SE +/- 0.08, N = 3 SE +/- 0.44, N = 15 35.56 18.02 32.40 15.69 30.74 15.81 24.11 23.09 33.00 14.69 33.30 16.51 40.55 21.22 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi
LuxCoreRender Scene: Danish Mood - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Danish Mood - Acceleration: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 5 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 2.48 4.10 3.33 5.14 4.35 6.43 4.36 6.10 3.47 6.09 3.04 5.84 2.34 4.46 MIN: 0.84 / MAX: 2.91 MIN: 1.58 / MAX: 4.79 MIN: 1.21 / MAX: 3.89 MIN: 1.96 / MAX: 6.18 MIN: 1.68 / MAX: 5.04 MIN: 2.55 / MAX: 7.63 MIN: 1.72 / MAX: 5.07 MIN: 2.45 / MAX: 7.16 MIN: 1.22 / MAX: 4.08 MIN: 2.47 / MAX: 7.28 MIN: 1.09 / MAX: 3.58 MIN: 2.6 / MAX: 6.73 MIN: 0.74 / MAX: 2.79 MIN: 1.83 / MAX: 5.18
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.01476, N = 9 SE +/- 0.00722, N = 9 SE +/- 0.00908, N = 9 SE +/- 0.00319, N = 9 SE +/- 0.00399, N = 9 SE +/- 0.00667, N = 9 7.88371 5.02585 8.29712 4.24724 11.43990 5.92201 MIN: 7.66 MIN: 4.84 MIN: 8.01 MIN: 4.13 MIN: 11.21 MIN: 5.79 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
LuxCoreRender Scene: Orange Juice - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Orange Juice - Acceleration: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.16, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 5.05 8.59 6.56 11.24 8.18 13.40 8.42 12.44 7.01 12.30 6.46 11.19 5.01 8.77 MIN: 4.74 / MAX: 5.15 MIN: 7.51 / MAX: 9.26 MIN: 5.93 / MAX: 6.83 MIN: 9.76 / MAX: 12.48 MIN: 7.2 / MAX: 8.7 MIN: 11.54 / MAX: 15.77 MIN: 7.45 / MAX: 9.01 MIN: 10.8 / MAX: 14.28 MIN: 6.3 / MAX: 7.56 MIN: 10.28 / MAX: 14.34 MIN: 5.76 / MAX: 7.02 MIN: 9.51 / MAX: 13.26 MIN: 4.73 / MAX: 5.13 MIN: 7.63 / MAX: 9.54
Timed LLVM Compilation Build System: Ninja OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 13.0 Build System: Ninja EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 80 160 240 320 400 SE +/- 0.08, N = 3 SE +/- 0.24, N = 3 SE +/- 0.09, N = 3 SE +/- 0.67, N = 3 SE +/- 0.43, N = 3 SE +/- 0.09, N = 3 SE +/- 0.16, N = 3 SE +/- 0.16, N = 3 SE +/- 0.32, N = 3 SE +/- 0.33, N = 3 SE +/- 0.11, N = 3 SE +/- 0.64, N = 3 SE +/- 0.12, N = 3 SE +/- 0.24, N = 3 347.36 190.97 275.25 161.53 230.69 140.28 212.30 163.54 268.94 160.40 292.73 166.31 373.68 204.23
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.01350, N = 3 SE +/- 0.00935, N = 3 SE +/- 0.04067, N = 3 SE +/- 0.04874, N = 3 SE +/- 0.01258, N = 3 SE +/- 0.00555, N = 3 7.86162 4.33315 8.61404 4.66619 11.41520 5.86134 MIN: 7.58 MIN: 4.14 MIN: 8.14 MIN: 4.34 MIN: 11.11 MIN: 5.72 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
LuxCoreRender Scene: LuxCore Benchmark - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: LuxCore Benchmark - Acceleration: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 15 2.72 4.46 3.68 5.56 4.64 6.75 4.74 6.70 3.67 6.57 3.29 6.16 2.59 4.68 MIN: 0.96 / MAX: 3.2 MIN: 1.61 / MAX: 5.3 MIN: 1.36 / MAX: 4.33 MIN: 1.97 / MAX: 6.64 MIN: 1.79 / MAX: 5.4 MIN: 2.41 / MAX: 8.1 MIN: 1.8 / MAX: 5.56 MIN: 2.57 / MAX: 7.82 MIN: 1.31 / MAX: 4.39 MIN: 2.6 / MAX: 7.71 MIN: 1.23 / MAX: 3.85 MIN: 2.54 / MAX: 7.19 MIN: 0.88 / MAX: 3.07 MIN: 1.67 / MAX: 5.69
Timed Node.js Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 18.8 Time To Compile EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 80 160 240 320 400 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.25, N = 3 SE +/- 0.52, N = 3 SE +/- 0.19, N = 3 SE +/- 0.62, N = 3 SE +/- 0.36, N = 3 SE +/- 0.38, N = 3 SE +/- 0.06, N = 3 SE +/- 0.55, N = 3 SE +/- 0.37, N = 3 SE +/- 0.41, N = 3 337.22 191.00 270.84 165.47 226.63 143.60 209.94 166.99 272.73 168.43 295.59 175.01 374.17 209.37
oneDNN Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.9598 1.9196 2.8794 3.8392 4.799 SE +/- 0.02810, N = 5 SE +/- 0.00276, N = 5 SE +/- 0.02328, N = 5 SE +/- 0.01307, N = 5 SE +/- 0.03491, N = 15 SE +/- 0.00978, N = 5 SE +/- 0.01496, N = 5 SE +/- 0.01676, N = 6 SE +/- 0.02635, N = 15 SE +/- 0.01211, N = 5 SE +/- 0.02380, N = 15 SE +/- 0.01253, N = 5 SE +/- 0.01988, N = 7 3.09624 2.79700 4.00035 3.63115 4.26599 2.02266 3.78466 1.64248 2.40282 1.66931 2.39962 1.84770 2.21782 MIN: 2.38 MIN: 2.65 MIN: 3.18 MIN: 3.48 MIN: 3.76 MIN: 1.82 MIN: 3.41 MIN: 1.54 MIN: 2.02 MIN: 1.57 MIN: 2.1 MIN: 1.71 MIN: 2.07 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
RocksDB Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Read While Writing EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2M 4M 6M 8M 10M SE +/- 76523.17, N = 13 SE +/- 43415.41, N = 4 SE +/- 142144.80, N = 15 SE +/- 32029.62, N = 3 SE +/- 135593.38, N = 15 SE +/- 15721.89, N = 3 SE +/- 68024.06, N = 3 SE +/- 22775.73, N = 3 SE +/- 153728.35, N = 12 SE +/- 40873.57, N = 5 SE +/- 44785.37, N = 3 SE +/- 23057.76, N = 3 SE +/- 42331.24, N = 15 4864299 4117643 6957204 5130684 8063050 5147499 7932933 4793137 7436444 3825346 6230967 3142066 4943670 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
nekRS Input: TurboPipe Periodic OpenBenchmarking.org FLOP/s, More Is Better nekRS 22.0 Input: TurboPipe Periodic EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50000M 100000M 150000M 200000M 250000M SE +/- 194054116.16, N = 3 SE +/- 1160248871.77, N = 3 SE +/- 716743639.28, N = 3 SE +/- 130435595.01, N = 3 SE +/- 716358150.65, N = 3 SE +/- 37382408.22, N = 3 SE +/- 603340791.85, N = 3 SE +/- 165905930.51, N = 3 SE +/- 1194804633.03, N = 3 SE +/- 206475987.30, N = 3 SE +/- 233956073.75, N = 3 SE +/- 285712164.79, N = 3 SE +/- 124957326.05, N = 3 166901000000 112350333333 194221666667 128904333333 218603000000 149115333333 170229333333 127809333333 242295666667 117791000000 227635333333 96712533333 190369000000 1. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi
Xcompact3d Incompact3d Input: X3D-benchmarking input.i3d OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: X3D-benchmarking input.i3d EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200 400 600 800 1000 SE +/- 0.88, N = 3 SE +/- 0.39, N = 3 SE +/- 5.59, N = 3 SE +/- 9.39, N = 3 SE +/- 0.87, N = 3 SE +/- 0.45, N = 3 SE +/- 1.05, N = 3 SE +/- 0.20, N = 3 SE +/- 0.51, N = 3 SE +/- 0.43, N = 3 SE +/- 9.17, N = 3 SE +/- 3.99, N = 9 SE +/- 0.67, N = 3 SE +/- 0.98, N = 3 880.64 484.99 766.72 700.10 784.80 432.07 716.62 663.83 626.98 357.24 659.15 461.11 889.88 725.35 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi
CloudSuite In-Memory Analytics Training Set Size: Large OpenBenchmarking.org ms, Fewer Is Better CloudSuite In-Memory Analytics 4.0 Training Set Size: Large EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60K 120K 180K 240K 300K SE +/- 535.64, N = 3 SE +/- 1774.21, N = 4 SE +/- 235.29, N = 3 SE +/- 530.20, N = 3 SE +/- 796.65, N = 3 SE +/- 859.70, N = 3 SE +/- 210.33, N = 3 SE +/- 955.82, N = 3 SE +/- 2349.58, N = 3 SE +/- 775.32, N = 3 SE +/- 623.63, N = 3 SE +/- 546.89, N = 3 SE +/- 800.80, N = 3 SE +/- 725.41, N = 3 122575 147944 124002 225855 134575 301630 130123 250115 163851 287528 140252 196790 148896 157229
High Performance Conjugate Gradient OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.1 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 9 18 27 36 45 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.21, N = 5 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 18.14 35.32 17.85 27.63 17.68 34.53 19.34 19.06 19.89 39.14 18.80 37.02 16.15 26.38 1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi
Memcached Set To Get Ratio: 1:100 OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:100 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 800K 1600K 2400K 3200K 4000K SE +/- 9721.14, N = 3 SE +/- 4664.77, N = 3 SE +/- 18487.99, N = 3 SE +/- 22542.41, N = 15 SE +/- 20057.86, N = 3 SE +/- 1121.75, N = 3 SE +/- 40574.62, N = 3 SE +/- 31526.72, N = 9 SE +/- 34881.31, N = 3 SE +/- 60239.97, N = 15 SE +/- 34942.45, N = 3 SE +/- 43191.93, N = 15 SE +/- 27101.83, N = 15 SE +/- 24448.73, N = 3 1610909.22 2373328.37 2309617.42 2952893.82 2981451.32 3518612.74 2848831.24 3893409.95 2937926.06 2802626.26 2842403.96 2971169.05 2164237.05 2874778.00 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
RocksDB Test: Update Random OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Update Random EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200K 400K 600K 800K 1000K SE +/- 17553.74, N = 12 SE +/- 708.38, N = 3 SE +/- 3018.40, N = 3 SE +/- 1717.10, N = 3 SE +/- 3148.37, N = 3 SE +/- 2864.72, N = 3 SE +/- 339.25, N = 3 SE +/- 1039.48, N = 3 SE +/- 379.98, N = 3 SE +/- 1500.76, N = 3 SE +/- 9205.01, N = 15 SE +/- 648.59, N = 3 SE +/- 1819.77, N = 3 481479 638378 336131 707656 351517 688172 436633 793742 466697 743700 640738 700379 803231 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.16, N = 3 SE +/- 0.21, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.12, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 55.41 55.60 62.20 64.72 66.47 68.12 62.29 86.46 49.96 49.97 41.81 41.46 37.04 36.38
Memcached Set To Get Ratio: 1:5 OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:5 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 900K 1800K 2700K 3600K 4500K SE +/- 3957.77, N = 3 SE +/- 24137.01, N = 3 SE +/- 20367.20, N = 3 SE +/- 51036.74, N = 15 SE +/- 6378.36, N = 3 SE +/- 36603.84, N = 15 SE +/- 6964.53, N = 3 SE +/- 47663.26, N = 3 SE +/- 26712.28, N = 3 SE +/- 21079.66, N = 14 SE +/- 34848.84, N = 8 SE +/- 28979.64, N = 3 SE +/- 27130.94, N = 3 SE +/- 20598.32, N = 3 2199582.80 2421891.74 2917560.70 2164592.24 3632495.02 1867112.74 3574540.35 3378044.12 4271575.65 3270779.44 4068619.97 3701213.86 3346967.77 3597757.55 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Graph500 Scale: 26 OpenBenchmarking.org bfs max_TEPS, More Is Better Graph500 3.0 Scale: 26 EPYC 7343 EPYC 7343 2P EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6346 Xeon Gold 6346 2P 150M 300M 450M 600M 750M 312989000 444474000 601120000 528200000 691983000 554082000 715154000 519294000 667982000 362918000 571793000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build: defconfig EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 15 30 45 60 75 SE +/- 0.47, N = 3 SE +/- 0.47, N = 3 SE +/- 0.50, N = 3 SE +/- 0.36, N = 5 SE +/- 0.51, N = 3 SE +/- 0.32, N = 5 SE +/- 0.50, N = 3 SE +/- 0.34, N = 6 SE +/- 0.61, N = 3 SE +/- 0.37, N = 5 SE +/- 0.56, N = 3 SE +/- 0.34, N = 5 SE +/- 0.52, N = 3 SE +/- 0.54, N = 3 63.49 38.97 52.72 33.82 44.75 29.78 42.09 33.75 51.84 33.04 55.49 33.79 67.65 40.40
SVT-HEVC Tuning: 7 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-HEVC 1.5.0 Tuning: 7 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.07, N = 5 SE +/- 0.14, N = 7 SE +/- 0.04, N = 6 SE +/- 0.12, N = 7 SE +/- 0.12, N = 7 SE +/- 0.43, N = 7 SE +/- 0.19, N = 7 SE +/- 0.16, N = 7 SE +/- 0.05, N = 6 SE +/- 0.31, N = 7 SE +/- 0.10, N = 6 SE +/- 0.32, N = 7 SE +/- 0.06, N = 5 SE +/- 0.06, N = 7 71.41 116.56 85.67 136.95 111.95 149.01 119.84 138.52 91.70 128.72 85.66 136.71 65.82 117.26 1. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt
uvg266 Video Input: Bosphorus 1080p - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Medium EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 16 32 48 64 80 SE +/- 0.16, N = 4 SE +/- 0.08, N = 4 SE +/- 0.09, N = 4 SE +/- 0.08, N = 5 SE +/- 0.04, N = 4 SE +/- 0.19, N = 5 SE +/- 0.10, N = 4 SE +/- 0.19, N = 5 SE +/- 0.02, N = 3 SE +/- 0.08, N = 4 SE +/- 0.02, N = 4 SE +/- 0.14, N = 5 SE +/- 0.04, N = 4 SE +/- 0.09, N = 4 43.11 49.15 43.27 66.47 45.60 70.75 46.14 61.66 31.35 49.39 37.08 57.70 37.00 43.04
uvg266 Video Input: Bosphorus 1080p - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Slow EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 14 28 42 56 70 SE +/- 0.05, N = 4 SE +/- 0.09, N = 4 SE +/- 0.03, N = 4 SE +/- 0.15, N = 5 SE +/- 0.05, N = 4 SE +/- 0.11, N = 5 SE +/- 0.05, N = 4 SE +/- 0.13, N = 5 SE +/- 0.04, N = 3 SE +/- 0.15, N = 4 SE +/- 0.07, N = 3 SE +/- 0.13, N = 4 SE +/- 0.04, N = 3 SE +/- 0.06, N = 4 38.52 43.92 38.45 59.52 40.52 63.00 41.09 56.07 28.13 44.48 33.02 51.74 33.05 38.43
Graph500 Scale: 26 OpenBenchmarking.org bfs median_TEPS, More Is Better Graph500 3.0 Scale: 26 EPYC 7343 EPYC 7343 2P EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6346 Xeon Gold 6346 2P 150M 300M 450M 600M 750M 309817000 422529000 584034000 517810000 665655000 544342000 691348000 510587000 655675000 359689000 562172000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org sssp median_TEPS, More Is Better Graph500 3.0 Scale: 26 EPYC 7343 EPYC 7343 2P EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6346 Xeon Gold 6346 2P 50M 100M 150M 200M 250M 114295000 174219000 225284000 176371000 255036000 204519000 227175000 168374000 238460000 117919000 187654000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
RocksDB Test: Random Fill Sync OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Fill Sync EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 80K 160K 240K 320K 400K SE +/- 335.00, N = 3 SE +/- 831.59, N = 3 SE +/- 1013.52, N = 3 SE +/- 911.55, N = 3 SE +/- 1581.82, N = 3 SE +/- 1077.11, N = 3 SE +/- 1530.69, N = 3 SE +/- 79.36, N = 3 SE +/- 931.26, N = 3 SE +/- 194.11, N = 3 SE +/- 6251.07, N = 15 SE +/- 98.97, N = 3 SE +/- 2669.53, N = 3 170828 199221 165480 238127 197227 233743 267282 297029 307133 277553 367162 208713 289896 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
NWChem Input: C240 Buckyball OpenBenchmarking.org Seconds, Fewer Is Better NWChem 7.0.2 Input: C240 Buckyball EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1300 2600 3900 5200 6500 5397.8 4463.3 3660.2 3488.4 2799.5 4747.9 3009.9 4925.4 2846.4 6074.2 3643.3 1. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lcomex -lm -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2
Graph500 Scale: 26 OpenBenchmarking.org sssp max_TEPS, More Is Better Graph500 3.0 Scale: 26 EPYC 7343 EPYC 7343 2P EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6346 Xeon Gold 6346 2P 70M 140M 210M 280M 350M 149710000 218986000 294782000 226239000 322475000 268016000 288959000 213096000 295010000 154209000 245053000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
uvg266 Video Input: Bosphorus 4K - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 10.42 16.78 11.87 18.06 15.10 19.59 15.77 15.71 10.88 14.12 10.51 16.00 9.16 15.05
OpenRadioss Model: INIVOL and Fluid Structure Interaction Drop Container OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 80 160 240 320 400 SE +/- 0.61, N = 3 SE +/- 0.90, N = 3 SE +/- 0.35, N = 3 SE +/- 0.19, N = 3 SE +/- 0.28, N = 3 SE +/- 0.39, N = 3 SE +/- 0.22, N = 3 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.47, N = 3 SE +/- 0.59, N = 3 352.52 291.34 245.34 224.14 191.58 287.21 199.83 301.70 179.68 383.74 224.24
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 16 32 48 64 80 SE +/- 0.01, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.15, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.29, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 48.86 56.98 53.03 62.36 56.33 65.39 54.32 70.21 44.13 45.36 40.68 40.70 33.03 33.11
Timed LLVM Compilation Build System: Unix Makefiles OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 13.0 Build System: Unix Makefiles EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 90 180 270 360 450 SE +/- 1.84, N = 3 SE +/- 3.14, N = 3 SE +/- 3.55, N = 5 SE +/- 0.83, N = 3 SE +/- 1.45, N = 3 SE +/- 1.00, N = 3 SE +/- 2.17, N = 9 SE +/- 0.36, N = 3 SE +/- 1.83, N = 3 SE +/- 0.66, N = 3 SE +/- 2.99, N = 3 SE +/- 1.05, N = 3 SE +/- 3.03, N = 3 SE +/- 2.63, N = 5 392.19 240.49 320.94 216.18 282.42 199.58 260.91 225.70 323.07 227.37 346.26 220.50 421.49 256.36
uvg266 Video Input: Bosphorus 4K - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 9.26 14.89 10.54 16.00 13.43 17.26 14.00 13.99 9.76 12.56 9.37 14.22 8.18 13.45
uvg266 Video Input: Bosphorus 4K - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12 24 36 48 60 SE +/- 0.06, N = 3 SE +/- 0.13, N = 4 SE +/- 0.08, N = 3 SE +/- 0.11, N = 4 SE +/- 0.07, N = 4 SE +/- 0.15, N = 4 SE +/- 0.03, N = 4 SE +/- 0.08, N = 4 SE +/- 0.03, N = 3 SE +/- 0.11, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 4 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 28.94 41.20 31.30 45.98 39.52 51.05 40.67 42.56 26.79 36.01 26.65 39.03 24.70 35.89
Kvazaar Video Input: Bosphorus 4K - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Medium EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6 12 18 24 30 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.26, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 14.94 22.50 16.10 23.20 20.33 25.02 21.04 19.03 13.69 17.63 13.17 19.27 12.21 18.39 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenRadioss Model: Cell Phone Drop Test OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Cell Phone Drop Test EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.14, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.07, N = 3 SE +/- 0.29, N = 3 SE +/- 0.03, N = 3 66.29 54.23 45.63 41.25 36.39 59.09 37.73 62.82 36.51 74.50 43.84
Kvazaar Video Input: Bosphorus 4K - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Very Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12 24 36 48 60 SE +/- 0.07, N = 3 SE +/- 0.09, N = 4 SE +/- 0.05, N = 3 SE +/- 0.08, N = 4 SE +/- 0.07, N = 4 SE +/- 0.06, N = 5 SE +/- 0.09, N = 4 SE +/- 0.05, N = 4 SE +/- 0.04, N = 3 SE +/- 0.14, N = 4 SE +/- 0.04, N = 3 SE +/- 0.04, N = 4 SE +/- 0.02, N = 3 SE +/- 0.03, N = 4 32.35 45.86 33.41 48.93 42.32 54.13 43.25 41.59 27.47 36.47 27.03 39.25 26.64 36.84 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.3915 0.783 1.1745 1.566 1.9575 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.11 1.14 1.27 1.30 1.37 1.39 1.27 1.74 1.23 1.16 1.05 0.99 0.92 0.86 MIN: 0.62 / MAX: 14.15 MIN: 0.96 / MAX: 12.95 MIN: 0.72 / MAX: 14.84 MIN: 1.07 / MAX: 14.22 MIN: 0.85 / MAX: 19.76 MIN: 1.14 / MAX: 14.4 MIN: 0.71 / MAX: 14.55 MIN: 0.91 / MAX: 22.45 MIN: 0.58 / MAX: 21.43 MIN: 0.91 / MAX: 14.56 MIN: 0.49 / MAX: 15.59 MIN: 0.73 / MAX: 14.31 MIN: 0.52 / MAX: 14.11 MIN: 0.67 / MAX: 13.21 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 150 300 450 600 750 SE +/- 0.07, N = 3 SE +/- 0.14, N = 3 SE +/- 0.16, N = 3 SE +/- 0.27, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.64, N = 3 SE +/- 0.21, N = 3 SE +/- 0.50, N = 3 SE +/- 0.38, N = 3 SE +/- 0.45, N = 3 SE +/- 0.27, N = 3 SE +/- 0.17, N = 3 450.60 475.87 515.06 544.62 546.28 575.37 507.66 684.85 471.63 488.41 386.88 399.33 338.98 350.63
CloudSuite Data Analytics Hadoop Slaves: 128 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 128 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 101630 870117 1324795 1393156 1378719 1030733 1337915 1377599 121626 122135 104512 99997 118445 118993
CloudSuite In-Memory Analytics Training Set Size: Small OpenBenchmarking.org ms, Fewer Is Better CloudSuite In-Memory Analytics 4.0 Training Set Size: Small EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40K 80K 120K 160K 200K SE +/- 13.02, N = 3 SE +/- 136.22, N = 3 SE +/- 159.06, N = 3 SE +/- 1128.62, N = 3 SE +/- 101.02, N = 3 SE +/- 409.71, N = 3 SE +/- 151.00, N = 3 SE +/- 820.85, N = 3 SE +/- 84.36, N = 3 SE +/- 90.73, N = 3 SE +/- 80.23, N = 3 SE +/- 445.33, N = 3 SE +/- 48.64, N = 3 SE +/- 203.67, N = 3 13995 46059 23575 111224 36808 181349 37315 136721 36646 147653 21960 82287 13855 41096
uvg266 Video Input: Bosphorus 1080p - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Very Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.15, N = 7 SE +/- 0.22, N = 8 SE +/- 0.17, N = 7 SE +/- 0.70, N = 9 SE +/- 0.17, N = 8 SE +/- 0.87, N = 9 SE +/- 0.17, N = 8 SE +/- 0.24, N = 9 SE +/- 0.05, N = 6 SE +/- 0.79, N = 8 SE +/- 0.07, N = 7 SE +/- 0.51, N = 8 SE +/- 0.10, N = 6 SE +/- 0.07, N = 7 110.98 134.43 118.56 164.25 129.79 173.58 130.26 168.38 87.55 131.93 98.13 150.71 93.17 116.97
uvg266 Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12 24 36 48 60 SE +/- 0.03, N = 3 SE +/- 0.12, N = 4 SE +/- 0.15, N = 3 SE +/- 0.11, N = 4 SE +/- 0.01, N = 4 SE +/- 0.22, N = 4 SE +/- 0.09, N = 4 SE +/- 0.28, N = 4 SE +/- 0.01, N = 3 SE +/- 0.38, N = 4 SE +/- 0.05, N = 3 SE +/- 0.06, N = 4 SE +/- 0.03, N = 3 SE +/- 0.05, N = 4 30.00 42.95 33.10 48.07 41.46 51.46 42.81 45.49 28.50 37.22 28.82 41.73 26.26 38.46
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P 40 80 120 160 200 SE +/- 0.07, N = 3 SE +/- 0.14, N = 3 SE +/- 0.07, N = 3 SE +/- 0.26, N = 3 91.68 113.85 124.13 177.64
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.4275 0.855 1.2825 1.71 2.1375 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.21 1.23 1.39 1.40 1.49 1.50 1.37 1.90 1.38 1.32 1.19 1.14 1.04 0.99 MIN: 0.71 / MAX: 41.75 MIN: 1.03 / MAX: 14.15 MIN: 0.77 / MAX: 14.54 MIN: 1.13 / MAX: 14.36 MIN: 0.7 / MAX: 73.62 MIN: 1.19 / MAX: 14.26 MIN: 0.75 / MAX: 14.85 MIN: 0.99 / MAX: 27.38 MIN: 0.61 / MAX: 20.84 MIN: 1.02 / MAX: 14.4 MIN: 0.57 / MAX: 16.29 MIN: 0.85 / MAX: 14.64 MIN: 0.63 / MAX: 14.02 MIN: 0.73 / MAX: 12.92 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.33, N = 3 SE +/- 0.07, N = 3 SE +/- 0.15, N = 3 SE +/- 0.16, N = 3 SE +/- 0.21, N = 3 SE +/- 1.13, N = 3 SE +/- 0.50, N = 3 SE +/- 0.17, N = 3 SE +/- 0.38, N = 3 SE +/- 0.95, N = 3 SE +/- 0.70, N = 3 SE +/- 0.98, N = 3 SE +/- 0.99, N = 3 SE +/- 0.32, N = 3 152.83 164.14 178.21 187.68 193.47 204.23 174.36 241.33 173.20 179.89 144.31 151.86 126.16 127.16
uvg266 Video Input: Bosphorus 1080p - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Super Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.23, N = 7 SE +/- 0.15, N = 8 SE +/- 0.15, N = 8 SE +/- 0.48, N = 9 SE +/- 0.09, N = 8 SE +/- 0.59, N = 9 SE +/- 0.17, N = 8 SE +/- 1.30, N = 15 SE +/- 0.13, N = 6 SE +/- 0.62, N = 8 SE +/- 0.06, N = 7 SE +/- 0.61, N = 8 SE +/- 0.08, N = 7 SE +/- 0.15, N = 8 116.79 142.78 125.26 163.18 138.95 173.74 139.65 180.55 94.98 133.13 106.29 152.28 100.87 127.62
nginx Connections: 100 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 100 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7543 Xeon Gold 6338 Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50K 100K 150K 200K 250K SE +/- 889.98, N = 3 SE +/- 7.14, N = 3 SE +/- 1585.18, N = 5 SE +/- 66.37, N = 3 SE +/- 118.51, N = 3 SE +/- 57.06, N = 3 SE +/- 68.69, N = 3 SE +/- 497.21, N = 3 SE +/- 93.41, N = 3 SE +/- 249.31, N = 3 146481.53 127405.11 144891.45 152248.92 147786.59 151274.54 140495.61 225527.80 118699.47 199748.09 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl
Kvazaar Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Super Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 14 28 42 56 70 SE +/- 0.03, N = 4 SE +/- 0.18, N = 5 SE +/- 0.04, N = 4 SE +/- 0.24, N = 5 SE +/- 0.17, N = 5 SE +/- 0.55, N = 5 SE +/- 0.09, N = 5 SE +/- 0.39, N = 15 SE +/- 0.09, N = 3 SE +/- 0.40, N = 15 SE +/- 0.03, N = 3 SE +/- 0.39, N = 4 SE +/- 0.04, N = 3 SE +/- 0.05, N = 4 41.24 57.13 43.02 61.75 52.81 63.53 54.27 50.67 33.71 41.44 34.35 47.49 33.93 45.17 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Memcached Set To Get Ratio: 1:10 OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:10 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1000K 2000K 3000K 4000K 5000K SE +/- 6608.23, N = 3 SE +/- 10464.07, N = 3 SE +/- 9446.47, N = 3 SE +/- 12992.60, N = 3 SE +/- 10592.08, N = 3 SE +/- 10361.68, N = 3 SE +/- 16723.87, N = 3 SE +/- 53174.54, N = 4 SE +/- 14309.07, N = 3 SE +/- 79008.26, N = 15 SE +/- 13454.68, N = 3 SE +/- 44938.98, N = 15 SE +/- 23174.23, N = 3 SE +/- 36081.97, N = 15 2548333.19 2826219.16 3431617.24 3691244.97 4198464.11 4105338.27 3481927.79 4786407.25 4262554.19 3551712.12 4053902.81 3969670.99 3159962.47 3912323.12 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
uvg266 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.10, N = 8 SE +/- 0.28, N = 8 SE +/- 0.17, N = 8 SE +/- 0.88, N = 9 SE +/- 0.24, N = 8 SE +/- 0.58, N = 9 SE +/- 0.15, N = 8 SE +/- 1.44, N = 9 SE +/- 0.15, N = 7 SE +/- 0.92, N = 8 SE +/- 0.25, N = 7 SE +/- 0.69, N = 8 SE +/- 0.07, N = 7 SE +/- 0.20, N = 8 130.30 155.33 138.79 165.33 153.97 175.35 154.38 196.33 105.96 136.60 118.47 155.38 113.18 139.86
nginx Connections: 1000 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 1000 EPYC 7343 2P EPYC 7413 EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40K 80K 120K 160K 200K SE +/- 189.01, N = 3 SE +/- 1390.17, N = 3 SE +/- 94.36, N = 3 SE +/- 336.74, N = 3 SE +/- 148.74, N = 3 SE +/- 323.88, N = 3 SE +/- 234.38, N = 3 SE +/- 416.78, N = 3 SE +/- 108.10, N = 3 SE +/- 520.06, N = 3 SE +/- 58.40, N = 3 SE +/- 140.88, N = 3 151418.97 129682.72 156398.74 135921.70 165810.67 151997.72 164486.94 178255.95 153700.70 200467.73 109860.58 199978.55 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl
nginx Connections: 500 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 500 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40K 80K 120K 160K 200K SE +/- 185.36, N = 3 SE +/- 37.87, N = 3 SE +/- 279.41, N = 3 SE +/- 89.54, N = 3 SE +/- 800.94, N = 3 SE +/- 72.87, N = 3 SE +/- 309.16, N = 3 SE +/- 37.98, N = 3 SE +/- 313.96, N = 3 SE +/- 169.87, N = 3 SE +/- 580.70, N = 3 SE +/- 92.60, N = 3 SE +/- 232.73, N = 3 157128.24 131406.38 133788.29 159784.56 140932.43 165787.42 156012.00 160307.52 180812.11 141031.60 204325.45 113630.04 207339.64 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl
SVT-VP9 Tuning: Visual Quality Optimized - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-VP9 0.3 Tuning: Visual Quality Optimized - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.08, N = 6 SE +/- 0.49, N = 6 SE +/- 0.18, N = 6 SE +/- 0.32, N = 6 SE +/- 0.14, N = 7 SE +/- 0.59, N = 6 SE +/- 0.25, N = 7 SE +/- 0.28, N = 6 SE +/- 0.18, N = 6 SE +/- 0.88, N = 5 SE +/- 0.23, N = 6 SE +/- 0.33, N = 6 SE +/- 0.07, N = 6 SE +/- 0.17, N = 6 83.73 130.23 107.77 145.30 129.22 148.84 137.52 146.48 111.92 131.90 109.31 138.19 83.38 130.49 1. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm
nginx Connections: 200 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 200 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40K 80K 120K 160K 200K SE +/- 248.07, N = 3 SE +/- 83.69, N = 3 SE +/- 288.51, N = 3 SE +/- 142.56, N = 3 SE +/- 704.77, N = 3 SE +/- 73.04, N = 3 SE +/- 498.75, N = 3 SE +/- 41.84, N = 3 SE +/- 271.76, N = 3 SE +/- 76.21, N = 3 SE +/- 512.32, N = 3 SE +/- 24.68, N = 3 SE +/- 149.37, N = 3 155325.61 129033.29 135890.54 160998.23 151573.48 161270.01 167224.22 160541.79 205570.62 141544.55 205476.78 118110.63 207770.19 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl
uvg266 Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12 24 36 48 60 SE +/- 0.07, N = 3 SE +/- 0.07, N = 4 SE +/- 0.08, N = 4 SE +/- 0.34, N = 4 SE +/- 0.06, N = 4 SE +/- 0.28, N = 5 SE +/- 0.10, N = 4 SE +/- 0.27, N = 4 SE +/- 0.01, N = 3 SE +/- 0.48, N = 4 SE +/- 0.03, N = 3 SE +/- 0.18, N = 4 SE +/- 0.05, N = 3 SE +/- 0.03, N = 4 35.28 46.65 38.88 49.77 46.07 53.21 47.24 48.31 31.67 38.92 33.30 44.24 31.03 42.08
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.12, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.13, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.36, N = 3 SE +/- 0.20, N = 3 SE +/- 0.15, N = 3 SE +/- 0.29, N = 3 SE +/- 0.09, N = 3 SE +/- 0.14, N = 3 SE +/- 0.09, N = 3 75.41 77.34 86.08 88.63 92.54 95.08 85.87 117.48 92.05 92.64 76.12 76.56 69.19 69.04
Kvazaar Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Ultra Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 15 30 45 60 75 SE +/- 0.04, N = 5 SE +/- 0.47, N = 11 SE +/- 0.08, N = 5 SE +/- 0.65, N = 5 SE +/- 0.09, N = 5 SE +/- 0.63, N = 6 SE +/- 0.10, N = 5 SE +/- 0.78, N = 15 SE +/- 0.15, N = 4 SE +/- 0.34, N = 15 SE +/- 0.03, N = 4 SE +/- 0.29, N = 4 SE +/- 0.05, N = 4 SE +/- 0.31, N = 4 53.29 63.34 55.36 64.72 62.27 65.39 63.28 57.99 38.52 43.33 42.41 49.75 42.98 50.50 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
PostgreSQL Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only - Average Latency EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.353 0.706 1.059 1.412 1.765 SE +/- 0.003, N = 3 SE +/- 0.005, N = 3 SE +/- 0.010, N = 3 SE +/- 0.021, N = 12 SE +/- 0.002, N = 3 SE +/- 0.027, N = 9 SE +/- 0.004, N = 3 SE +/- 0.009, N = 3 SE +/- 0.004, N = 3 SE +/- 0.050, N = 12 SE +/- 0.001, N = 3 SE +/- 0.014, N = 12 SE +/- 0.003, N = 3 SE +/- 0.008, N = 3 1.459 1.178 1.131 1.377 1.024 1.569 0.991 1.386 0.927 1.348 1.078 1.176 1.347 1.002 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200K 400K 600K 800K 1000K SE +/- 1636.62, N = 3 SE +/- 3271.24, N = 3 SE +/- 7500.42, N = 3 SE +/- 11363.61, N = 12 SE +/- 2084.66, N = 3 SE +/- 10642.91, N = 9 SE +/- 4439.63, N = 3 SE +/- 4640.40, N = 3 SE +/- 4354.62, N = 3 SE +/- 30718.02, N = 12 SE +/- 1181.85, N = 3 SE +/- 10454.75, N = 12 SE +/- 1889.54, N = 3 SE +/- 8418.28, N = 3 685239 849019 884213 728184 976332 638731 1008741 721335 1078586 754104 927858 851464 742550 997957 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Apache Cassandra Test: Writes OpenBenchmarking.org Op/s, More Is Better Apache Cassandra 4.0 Test: Writes EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60K 120K 180K 240K 300K SE +/- 902.56, N = 3 SE +/- 2617.59, N = 3 SE +/- 369.63, N = 3 SE +/- 1215.21, N = 3 SE +/- 591.09, N = 3 SE +/- 432.91, N = 3 SE +/- 1364.13, N = 3 SE +/- 1599.50, N = 3 SE +/- 104.54, N = 3 SE +/- 515.32, N = 3 SE +/- 408.15, N = 3 SE +/- 950.77, N = 3 SE +/- 609.52, N = 3 SE +/- 894.00, N = 3 172713 236544 224875 225784 263627 245226 246339 253058 176284 156487 200958 190873 177347 171138
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200 400 600 800 1000 SE +/- 0.72, N = 3 SE +/- 0.41, N = 3 SE +/- 0.56, N = 3 SE +/- 0.21, N = 3 SE +/- 0.05, N = 3 SE +/- 0.46, N = 3 SE +/- 0.25, N = 3 SE +/- 0.92, N = 3 SE +/- 0.28, N = 3 SE +/- 0.23, N = 3 SE +/- 0.47, N = 3 SE +/- 0.92, N = 3 SE +/- 0.43, N = 3 SE +/- 0.43, N = 3 629.19 636.28 729.31 738.78 791.97 803.45 716.02 1010.00 856.00 847.38 689.68 685.96 605.67 599.81
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200 400 600 800 1000 SE +/- 0.24, N = 3 SE +/- 0.25, N = 3 SE +/- 0.30, N = 3 SE +/- 0.75, N = 3 SE +/- 0.93, N = 3 SE +/- 0.61, N = 3 SE +/- 0.33, N = 3 SE +/- 0.83, N = 3 SE +/- 0.54, N = 3 SE +/- 0.68, N = 3 SE +/- 0.32, N = 3 SE +/- 0.49, N = 3 SE +/- 0.26, N = 3 SE +/- 0.72, N = 3 627.69 634.73 729.06 739.76 792.46 802.16 716.12 1010.58 855.78 848.91 690.24 686.45 605.57 600.72
SVT-HEVC Tuning: 10 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-HEVC 1.5.0 Tuning: 10 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.23, N = 8 SE +/- 1.02, N = 8 SE +/- 0.39, N = 8 SE +/- 1.90, N = 15 SE +/- 0.27, N = 8 SE +/- 2.94, N = 15 SE +/- 0.23, N = 9 SE +/- 0.70, N = 9 SE +/- 0.18, N = 8 SE +/- 0.96, N = 8 SE +/- 0.23, N = 8 SE +/- 1.35, N = 15 SE +/- 0.06, N = 7 SE +/- 1.19, N = 15 143.45 191.99 181.39 208.59 207.54 201.76 219.43 224.80 171.63 176.67 173.16 176.18 134.34 176.86 1. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt
LuxCoreRender Scene: Rainbow Colors and Prism - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Rainbow Colors and Prism - Acceleration: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.08, N = 4 SE +/- 0.12, N = 4 SE +/- 0.12, N = 5 SE +/- 0.09, N = 4 SE +/- 0.05, N = 5 SE +/- 0.18, N = 6 SE +/- 0.18, N = 4 SE +/- 0.13, N = 5 SE +/- 0.11, N = 9 SE +/- 0.23, N = 15 SE +/- 0.13, N = 5 SE +/- 0.24, N = 15 SE +/- 0.07, N = 4 SE +/- 0.20, N = 15 12.12 13.03 15.11 15.73 17.44 17.44 16.69 18.73 13.20 11.33 13.77 12.60 11.45 12.05 MIN: 11.11 / MAX: 12.32 MIN: 11.85 / MAX: 13.27 MIN: 13.66 / MAX: 15.57 MIN: 14.3 / MAX: 16.13 MIN: 15.75 / MAX: 17.95 MIN: 15.46 / MAX: 18.02 MIN: 15.03 / MAX: 17.36 MIN: 18.24 / MAX: 19.11 MIN: 11.71 / MAX: 14.29 MIN: 9.36 / MAX: 12.19 MIN: 12.72 / MAX: 14.53 MIN: 10.6 / MAX: 13.91 MIN: 10.45 / MAX: 11.99 MIN: 10.43 / MAX: 13.24
Timed Godot Game Engine Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Godot Game Engine Compilation 3.2.3 Time To Compile EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.25, N = 3 SE +/- 0.05, N = 3 SE +/- 0.15, N = 3 SE +/- 0.11, N = 3 SE +/- 0.14, N = 3 74.95 64.73 57.58 55.11 50.80 69.24 54.70 70.29 51.93 83.06 56.72
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.09, N = 3 SE +/- 0.17, N = 3 SE +/- 0.15, N = 3 SE +/- 0.11, N = 3 SE +/- 0.41, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.59, N = 3 SE +/- 0.18, N = 3 SE +/- 0.33, N = 3 SE +/- 0.13, N = 3 SE +/- 0.51, N = 3 SE +/- 0.56, N = 3 SE +/- 0.10, N = 3 148.96 152.15 170.16 174.62 183.72 187.52 169.93 230.92 191.31 190.84 158.56 159.75 143.49 141.36
CloudSuite Web Serving Load Scale: 500 OpenBenchmarking.org ops/sec, More Is Better CloudSuite Web Serving Load Scale: 500 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 4 8 12 16 20 11.600 11.217 14.583 12.083 15.267 11.817 13.050 15.283 13.317 9.600 15.433 12.717 12.950 12.300
LuxCoreRender Scene: DLSC - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: DLSC - Acceleration: CPU EPYC 7343 2P EPYC 7413 2P EPYC 7513 2P 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 15 5.74 7.17 9.12 MIN: 5.6 / MAX: 6.16 MIN: 6.95 / MAX: 7.96 MIN: 8.49 / MAX: 10.09
OpenRadioss Model: Rubber O-Ring Seal Installation OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.25, N = 3 SE +/- 0.08, N = 3 SE +/- 0.61, N = 3 SE +/- 0.18, N = 3 SE +/- 0.11, N = 3 SE +/- 0.35, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 SE +/- 0.00, N = 3 SE +/- 0.15, N = 3 SE +/- 0.30, N = 3 103.03 88.65 84.32 79.17 89.74 108.37 89.85 107.07 78.89 124.37 83.81
SVT-VP9 Tuning: VMAF Optimized - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-VP9 0.3 Tuning: VMAF Optimized - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.79, N = 6 SE +/- 1.45, N = 15 SE +/- 1.16, N = 8 SE +/- 4.20, N = 15 SE +/- 0.92, N = 15 SE +/- 1.60, N = 15 SE +/- 1.40, N = 15 SE +/- 1.46, N = 15 SE +/- 1.38, N = 15 SE +/- 1.44, N = 15 SE +/- 1.09, N = 15 SE +/- 1.39, N = 15 SE +/- 0.57, N = 6 SE +/- 1.32, N = 6 111.82 152.31 140.28 154.60 161.26 163.58 171.65 172.24 143.42 137.47 141.68 139.88 109.47 141.50 1. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm
SVT-VP9 Tuning: PSNR/SSIM Optimized - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-VP9 0.3 Tuning: PSNR/SSIM Optimized - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.17, N = 7 SE +/- 0.22, N = 7 SE +/- 0.24, N = 7 SE +/- 0.94, N = 6 SE +/- 0.48, N = 7 SE +/- 2.12, N = 15 SE +/- 0.17, N = 7 SE +/- 0.20, N = 7 SE +/- 0.14, N = 7 SE +/- 0.19, N = 5 SE +/- 0.26, N = 7 SE +/- 0.52, N = 6 SE +/- 0.11, N = 6 SE +/- 0.27, N = 7 115.80 158.14 143.85 161.19 164.17 165.46 175.18 179.74 148.73 144.22 148.12 148.45 115.37 150.48 1. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm
Timed Gem5 Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Gem5 Compilation 21.2 Time To Compile EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60 120 180 240 300 SE +/- 0.29, N = 3 SE +/- 0.06, N = 3 SE +/- 1.70, N = 12 SE +/- 1.47, N = 12 SE +/- 1.75, N = 3 SE +/- 3.04, N = 4 SE +/- 0.86, N = 3 SE +/- 0.19, N = 3 SE +/- 1.87, N = 6 SE +/- 0.04, N = 3 SE +/- 1.48, N = 3 267.88 229.60 210.64 198.43 190.76 244.25 199.49 244.57 190.65 289.72 200.96
ClickHouse 100M Rows Hits Dataset, First Run / Cold Cache OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 90 180 270 360 450 SE +/- 2.07, N = 3 SE +/- 2.96, N = 3 SE +/- 1.47, N = 3 SE +/- 0.97, N = 3 SE +/- 3.29, N = 3 SE +/- 2.43, N = 3 SE +/- 1.20, N = 3 SE +/- 3.48, N = 3 SE +/- 1.98, N = 3 SE +/- 2.01, N = 3 SE +/- 3.58, N = 3 SE +/- 1.29, N = 3 SE +/- 0.53, N = 3 SE +/- 9.20, N = 12 336.88 423.79 351.34 429.39 362.00 412.09 410.64 365.79 311.11 388.39 312.11 411.38 283.16 360.92 MIN: 13.48 / MAX: 7500 MIN: 23.78 / MAX: 4285.71 MIN: 17.17 / MAX: 6666.67 MIN: 31.35 / MAX: 5000 MIN: 21.03 / MAX: 6000 MIN: 34.8 / MAX: 4000 MIN: 22.56 / MAX: 6666.67 MIN: 31.86 / MAX: 5454.55 MIN: 15.86 / MAX: 5454.55 MIN: 29.17 / MAX: 5454.55 MIN: 14.74 / MAX: 6666.67 MIN: 28.04 / MAX: 5000 MIN: 10.81 / MAX: 6666.67 MIN: 20.41 / MAX: 6000
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 8 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 16 32 48 64 80 SE +/- 0.11, N = 4 SE +/- 0.28, N = 5 SE +/- 0.10, N = 4 SE +/- 0.67, N = 5 SE +/- 0.12, N = 5 SE +/- 0.38, N = 5 SE +/- 0.30, N = 5 SE +/- 0.27, N = 5 SE +/- 0.22, N = 4 SE +/- 0.54, N = 4 SE +/- 0.24, N = 4 SE +/- 0.42, N = 4 SE +/- 0.23, N = 4 SE +/- 0.17, N = 4 48.38 66.08 58.92 65.95 66.63 71.45 67.15 67.31 56.03 63.10 59.41 68.97 47.12 67.61 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
ClickHouse 100M Rows Hits Dataset, Second Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 100 200 300 400 500 SE +/- 3.50, N = 3 SE +/- 1.63, N = 3 SE +/- 2.06, N = 3 SE +/- 7.88, N = 3 SE +/- 1.23, N = 3 SE +/- 2.78, N = 3 SE +/- 0.54, N = 3 SE +/- 3.18, N = 3 SE +/- 2.19, N = 3 SE +/- 5.74, N = 3 SE +/- 3.16, N = 3 SE +/- 2.05, N = 3 SE +/- 1.01, N = 3 SE +/- 9.42, N = 12 346.00 443.07 363.28 437.50 377.03 436.77 425.45 375.36 325.13 405.08 321.66 433.55 294.82 378.61 MIN: 13.53 / MAX: 7500 MIN: 23.91 / MAX: 5454.55 MIN: 17.19 / MAX: 7500 MIN: 31.66 / MAX: 5000 MIN: 21.37 / MAX: 6666.67 MIN: 35.19 / MAX: 5454.55 MIN: 22.68 / MAX: 6666.67 MIN: 32 / MAX: 6000 MIN: 15.85 / MAX: 5454.55 MIN: 29.11 / MAX: 5000 MIN: 14.82 / MAX: 6666.67 MIN: 28.48 / MAX: 6000 MIN: 10.95 / MAX: 7500 MIN: 20.51 / MAX: 6666.67
ClickHouse 100M Rows Hits Dataset, Third Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 100 200 300 400 500 SE +/- 1.99, N = 3 SE +/- 1.18, N = 3 SE +/- 2.07, N = 3 SE +/- 5.82, N = 3 SE +/- 2.21, N = 3 SE +/- 2.98, N = 3 SE +/- 0.23, N = 3 SE +/- 1.15, N = 3 SE +/- 1.64, N = 3 SE +/- 4.19, N = 3 SE +/- 1.90, N = 3 SE +/- 3.32, N = 3 SE +/- 1.18, N = 3 SE +/- 9.11, N = 12 345.53 443.72 360.64 440.92 379.67 435.85 425.48 380.10 325.93 407.09 325.08 425.45 295.42 379.26 MIN: 13.57 / MAX: 7500 MIN: 24.16 / MAX: 6000 MIN: 17.17 / MAX: 6666.67 MIN: 31.68 / MAX: 4615.38 MIN: 21.33 / MAX: 6666.67 MIN: 35.71 / MAX: 4615.38 MIN: 22.74 / MAX: 6000 MIN: 31.95 / MAX: 6000 MIN: 15.81 / MAX: 6000 MIN: 29.41 / MAX: 5454.55 MIN: 14.7 / MAX: 6666.67 MIN: 28.42 / MAX: 5000 MIN: 10.91 / MAX: 7500 MIN: 20.98 / MAX: 6000
oneDNN Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.5467 1.0934 1.6401 2.1868 2.7335 SE +/- 0.01302, N = 5 SE +/- 0.04314, N = 12 SE +/- 0.00547, N = 5 SE +/- 0.02225, N = 15 SE +/- 0.00397, N = 5 SE +/- 0.02196, N = 12 1.81562 1.88632 2.22071 2.42969 1.80606 1.62390 MIN: 1.43 MIN: 1.28 MIN: 1.86 MIN: 1.94 MIN: 1.69 MIN: 1.37 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenRadioss Model: Bird Strike on Windshield OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bird Strike on Windshield EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.17, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.12, N = 3 SE +/- 0.30, N = 3 SE +/- 0.23, N = 3 SE +/- 0.08, N = 3 SE +/- 0.20, N = 3 SE +/- 0.20, N = 3 SE +/- 0.06, N = 3 SE +/- 0.16, N = 3 218.07 201.13 186.94 173.03 167.45 207.10 162.88 204.18 155.37 231.85 165.35
oneDNN Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1.0084 2.0168 3.0252 4.0336 5.042 SE +/- 0.07340, N = 15 SE +/- 0.05784, N = 15 SE +/- 0.02674, N = 4 SE +/- 0.04593, N = 15 SE +/- 0.01308, N = 4 SE +/- 0.10360, N = 12 3.34833 3.67592 4.48183 3.97631 4.20681 3.01823 MIN: 2.87 MIN: 2.72 MIN: 4.14 MIN: 3.34 MIN: 4.02 MIN: 2.29 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenRadioss Model: Bumper Beam OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bumper Beam EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.28, N = 3 SE +/- 0.10, N = 3 SE +/- 0.17, N = 3 SE +/- 0.15, N = 3 SE +/- 0.04, N = 3 SE +/- 0.14, N = 3 SE +/- 0.20, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 3 SE +/- 0.32, N = 3 SE +/- 0.04, N = 3 118.30 105.44 96.53 93.97 91.55 111.00 91.34 110.30 85.45 122.43 94.03
CloudSuite Web Serving Load Scale: 100 OpenBenchmarking.org ops/sec, More Is Better CloudSuite Web Serving Load Scale: 100 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2 4 6 8 10 7.333 5.550 7.583 5.300 7.417 5.417 6.583 7.100 7.517 7.350 7.517 7.183 7.383 7.533
CloudSuite Graph Analytics GraphX Algorithm: Page Rank OpenBenchmarking.org ms, Fewer Is Better CloudSuite Graph Analytics 4.0 GraphX Algorithm: Page Rank EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3K 6K 9K 12K 15K SE +/- 84.93, N = 3 SE +/- 190.69, N = 13 SE +/- 82.57, N = 15 SE +/- 184.92, N = 15 SE +/- 135.36, N = 3 SE +/- 118.51, N = 3 SE +/- 79.02, N = 3 SE +/- 49.21, N = 3 SE +/- 115.60, N = 15 SE +/- 108.31, N = 15 SE +/- 106.07, N = 15 SE +/- 69.03, N = 14 SE +/- 97.49, N = 15 SE +/- 39.28, N = 3 11525 9820 9815 9831 9917 9587 9247 9112 11245 11235 10340 10381 13034 10597
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P 40 80 120 160 200 SE +/- 0.07, N = 3 SE +/- 0.18, N = 3 SE +/- 0.07, N = 3 SE +/- 0.26, N = 3 130.72 140.23 128.67 179.68
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 12 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.47, N = 8 SE +/- 0.36, N = 7 SE +/- 0.80, N = 8 SE +/- 0.76, N = 7 SE +/- 0.86, N = 8 SE +/- 1.43, N = 7 SE +/- 0.47, N = 8 SE +/- 1.31, N = 8 SE +/- 0.49, N = 7 SE +/- 0.71, N = 7 SE +/- 0.50, N = 7 SE +/- 1.23, N = 7 SE +/- 0.44, N = 8 SE +/- 0.70, N = 7 179.07 204.55 210.55 217.43 231.54 217.70 237.13 232.00 194.14 201.07 206.81 213.42 173.29 211.63 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
CloudSuite Graph Analytics GraphX Algorithm: Connected Components OpenBenchmarking.org ms, Fewer Is Better CloudSuite Graph Analytics 4.0 GraphX Algorithm: Connected Components EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 4K 8K 12K 16K 20K SE +/- 216.00, N = 15 SE +/- 400.63, N = 15 SE +/- 188.00, N = 15 SE +/- 176.86, N = 15 SE +/- 194.18, N = 13 SE +/- 134.07, N = 3 SE +/- 220.91, N = 15 SE +/- 128.32, N = 15 SE +/- 97.53, N = 3 SE +/- 180.53, N = 15 SE +/- 140.39, N = 15 SE +/- 57.52, N = 3 SE +/- 155.90, N = 15 SE +/- 268.97, N = 12 15718 14547 14011 14426 13102 13891 13358 13169 14285 14751 13542 13551 17820 14408
CloudSuite Web Serving Load Scale: 400 OpenBenchmarking.org ops/sec, More Is Better CloudSuite Web Serving Load Scale: 400 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 4 8 12 16 20 11.83 11.43 14.73 11.97 14.88 11.20 13.80 13.27 12.38 11.93 14.70 11.70 13.55 11.73
VVenC Video Input: Bosphorus 1080p - Video Preset: Fast OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.023, N = 3 SE +/- 0.025, N = 3 SE +/- 0.021, N = 3 SE +/- 0.008, N = 3 SE +/- 0.009, N = 3 SE +/- 0.008, N = 3 SE +/- 0.008, N = 3 SE +/- 0.010, N = 3 SE +/- 0.015, N = 3 SE +/- 0.021, N = 3 SE +/- 0.012, N = 3 SE +/- 0.009, N = 3 SE +/- 0.004, N = 3 SE +/- 0.019, N = 3 10.496 11.054 10.188 10.393 10.350 10.329 10.555 9.553 8.394 8.721 9.153 9.430 9.107 9.609 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
VVenC Video Input: Bosphorus 4K - Video Preset: Fast OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1.1023 2.2046 3.3069 4.4092 5.5115 SE +/- 0.006, N = 3 SE +/- 0.005, N = 3 SE +/- 0.011, N = 3 SE +/- 0.018, N = 3 SE +/- 0.008, N = 3 SE +/- 0.021, N = 3 SE +/- 0.007, N = 3 SE +/- 0.010, N = 3 SE +/- 0.005, N = 3 SE +/- 0.003, N = 3 SE +/- 0.004, N = 3 SE +/- 0.014, N = 3 SE +/- 0.005, N = 3 SE +/- 0.008, N = 3 4.310 4.899 4.415 4.658 4.582 4.688 4.724 4.455 3.776 4.045 4.093 4.393 3.862 4.417 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 13 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.40, N = 8 SE +/- 0.41, N = 8 SE +/- 0.31, N = 8 SE +/- 0.58, N = 8 SE +/- 0.62, N = 8 SE +/- 1.18, N = 8 SE +/- 0.51, N = 8 SE +/- 0.85, N = 8 SE +/- 0.37, N = 8 SE +/- 1.06, N = 7 SE +/- 0.47, N = 8 SE +/- 1.17, N = 8 SE +/- 0.40, N = 8 SE +/- 1.08, N = 8 172.16 191.02 195.80 193.78 210.24 193.15 214.39 203.19 176.04 180.92 190.74 200.38 166.79 200.42 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
x265 Video Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better x265 3.4 Video Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 7 14 21 28 35 SE +/- 0.02, N = 3 SE +/- 0.17, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.29, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 SE +/- 0.13, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 24.86 23.06 27.01 22.13 28.24 22.65 27.63 27.16 25.70 24.42 27.77 25.54 24.96 25.04 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
RocksDB Test: Read Random Write Random OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Read Random Write Random EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 600K 1200K 1800K 2400K 3000K SE +/- 3492.11, N = 3 SE +/- 2301.51, N = 3 SE +/- 6678.29, N = 3 SE +/- 1879.76, N = 3 SE +/- 5136.66, N = 3 SE +/- 17808.71, N = 3 SE +/- 27203.96, N = 6 SE +/- 2675.18, N = 3 SE +/- 17390.98, N = 15 SE +/- 4554.38, N = 3 SE +/- 14296.96, N = 3 SE +/- 2003.10, N = 3 SE +/- 37734.79, N = 3 2195191 2369439 2190994 2750066 2204871 2690298 2761836 2770547 2579926 2420422 2779890 2311235 2762454 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
Timed Apache Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Apache Compilation 2.4.41 Time To Compile EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 17.70 18.22 18.99 21.00 18.86 19.70 18.83 20.39 22.42 22.11 20.24 20.06 19.68 19.45
FFmpeg Encoder: libx265 - Scenario: Live OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Live EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.52, N = 3 SE +/- 0.09, N = 3 SE +/- 0.19, N = 3 SE +/- 0.17, N = 3 SE +/- 0.16, N = 3 SE +/- 0.48, N = 3 SE +/- 0.11, N = 3 SE +/- 0.21, N = 3 SE +/- 0.10, N = 3 SE +/- 0.13, N = 3 SE +/- 0.10, N = 3 SE +/- 0.21, N = 3 SE +/- 0.44, N = 3 SE +/- 0.19, N = 3 123.76 103.93 117.23 98.37 118.65 101.05 113.57 105.50 112.80 111.60 122.36 121.08 124.46 121.92 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Live OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Live EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12 24 36 48 60 SE +/- 0.17, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.24, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.14, N = 3 SE +/- 0.06, N = 3 40.81 48.59 43.08 51.34 42.56 49.98 44.47 47.87 44.77 45.25 41.27 41.71 40.58 41.42 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Upload OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Upload EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.28, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.21, N = 3 SE +/- 0.12, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.08, N = 3 SE +/- 0.09, N = 3 SE +/- 0.21, N = 3 SE +/- 0.05, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.15, N = 3 199.10 198.24 214.55 215.59 211.01 210.67 210.02 210.12 247.39 250.35 227.36 230.44 216.38 219.39 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Upload OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Upload EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 12.68 12.74 11.77 11.71 11.97 11.99 12.02 12.02 10.21 10.09 11.11 10.96 11.67 11.51 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Video On Demand OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Video On Demand EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.18, N = 3 SE +/- 0.08, N = 3 SE +/- 0.34, N = 3 SE +/- 0.22, N = 3 SE +/- 0.22, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.17, N = 3 SE +/- 0.18, N = 3 SE +/- 0.02, N = 3 SE +/- 0.13, N = 3 SE +/- 0.23, N = 3 155.37 155.42 167.10 168.57 164.52 164.86 162.21 163.44 192.08 196.03 177.11 181.28 169.00 173.17 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Video On Demand OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Video On Demand EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 11 22 33 44 55 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 48.75 48.74 45.33 44.94 46.04 45.95 46.70 46.35 39.44 38.64 42.77 41.79 44.82 43.74 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
VVenC Video Input: Bosphorus 4K - Video Preset: Faster OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Faster EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.024, N = 3 SE +/- 0.069, N = 3 SE +/- 0.011, N = 3 SE +/- 0.066, N = 3 SE +/- 0.005, N = 3 SE +/- 0.032, N = 3 SE +/- 0.013, N = 3 SE +/- 0.013, N = 3 SE +/- 0.012, N = 3 SE +/- 0.036, N = 3 SE +/- 0.010, N = 3 SE +/- 0.007, N = 3 SE +/- 0.002, N = 3 SE +/- 0.011, N = 3 9.370 10.051 9.431 9.526 9.736 9.445 9.984 9.110 7.981 8.128 8.830 8.908 8.552 8.929 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
FFmpeg Encoder: libx264 - Scenario: Platform OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Platform EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.15, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.14, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.42, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.09, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.14, N = 3 SE +/- 0.08, N = 3 155.46 155.38 166.90 169.02 164.12 164.38 162.71 163.38 192.02 195.55 176.95 181.25 168.80 173.16 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Platform OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Platform EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 11 22 33 44 55 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.12, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 48.73 48.75 45.39 44.82 46.16 46.08 46.55 46.36 39.45 38.74 42.81 41.79 44.87 43.75 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Live OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Live EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.23, N = 3 SE +/- 0.15, N = 3 SE +/- 0.51, N = 3 SE +/- 0.49, N = 3 SE +/- 0.18, N = 3 SE +/- 0.23, N = 3 SE +/- 0.09, N = 3 SE +/- 0.14, N = 3 SE +/- 0.25, N = 3 SE +/- 0.46, N = 3 SE +/- 0.19, N = 3 SE +/- 0.18, N = 3 SE +/- 0.19, N = 3 SE +/- 0.30, N = 3 217.86 215.69 202.95 200.05 207.35 206.46 211.67 208.64 178.82 173.30 193.69 186.41 202.08 193.90 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Live OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Live EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 7 14 21 28 35 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 23.18 23.41 24.88 25.24 24.35 24.46 23.86 24.20 28.24 29.14 26.07 27.09 24.99 26.04 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 4 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.8503 1.7006 2.5509 3.4012 4.2515 SE +/- 0.012, N = 3 SE +/- 0.010, N = 3 SE +/- 0.016, N = 3 SE +/- 0.031, N = 3 SE +/- 0.011, N = 3 SE +/- 0.006, N = 3 SE +/- 0.007, N = 3 SE +/- 0.017, N = 3 SE +/- 0.013, N = 3 SE +/- 0.015, N = 3 SE +/- 0.013, N = 3 SE +/- 0.025, N = 3 SE +/- 0.017, N = 3 SE +/- 0.023, N = 3 3.444 3.779 3.496 3.510 3.669 3.604 3.635 3.421 3.034 3.049 3.209 3.316 3.070 3.438 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
VVenC Video Input: Bosphorus 1080p - Video Preset: Faster OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Faster EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6 12 18 24 30 SE +/- 0.04, N = 3 SE +/- 0.27, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.29, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 25.09 24.19 24.36 23.35 24.71 22.96 24.84 22.51 20.15 20.64 22.27 22.27 22.23 22.16 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
PHPBench PHP Benchmark Suite OpenBenchmarking.org Score, More Is Better PHPBench 0.8.1 PHP Benchmark Suite EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200K 400K 600K 800K 1000K SE +/- 1077.87, N = 3 SE +/- 2797.29, N = 3 SE +/- 1332.81, N = 3 SE +/- 4937.26, N = 3 SE +/- 4086.10, N = 3 SE +/- 1938.22, N = 3 SE +/- 1437.74, N = 3 SE +/- 3010.31, N = 3 SE +/- 1918.32, N = 3 SE +/- 340.03, N = 3 SE +/- 581.13, N = 3 SE +/- 580.18, N = 3 SE +/- 678.65, N = 3 SE +/- 1806.45, N = 3 732752 735624 670928 680136 678084 686597 687000 678966 719675 722240 788731 789297 812732 809727
FFmpeg Encoder: libx265 - Scenario: Video On Demand OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Video On Demand EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.16, N = 3 SE +/- 0.38, N = 3 SE +/- 0.13, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.58, N = 3 SE +/- 0.13, N = 3 SE +/- 0.04, N = 3 SE +/- 0.24, N = 3 SE +/- 0.22, N = 3 SE +/- 0.33, N = 3 SE +/- 0.17, N = 3 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 152.05 161.72 160.13 172.81 158.71 171.53 158.41 174.28 180.03 181.97 167.31 167.66 166.43 165.06 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Video On Demand OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Video On Demand EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 11 22 33 44 55 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 49.82 46.84 47.31 43.84 47.73 44.16 47.82 43.46 42.08 41.63 45.28 45.18 45.51 45.89 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Platform OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Platform EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 11 22 33 44 55 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 49.89 46.66 47.38 43.80 47.61 44.19 47.87 43.44 41.92 41.89 45.13 45.31 45.66 46.10 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Platform OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Platform EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.09, N = 3 SE +/- 0.17, N = 3 SE +/- 0.12, N = 3 SE +/- 0.14, N = 3 SE +/- 0.05, N = 3 SE +/- 0.19, N = 3 SE +/- 0.06, N = 3 SE +/- 0.19, N = 3 SE +/- 0.09, N = 3 SE +/- 0.23, N = 3 SE +/- 0.27, N = 3 SE +/- 0.11, N = 3 SE +/- 0.16, N = 3 SE +/- 0.36, N = 3 151.85 162.34 159.89 172.96 159.12 171.41 158.24 174.39 180.71 180.82 167.86 167.16 165.89 164.33 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Upload OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Upload EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6 12 18 24 30 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 24.29 23.56 23.21 22.07 23.35 22.20 23.40 21.32 20.59 20.89 22.21 22.57 22.29 22.81 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Upload OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Upload EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.07, N = 3 SE +/- 0.20, N = 3 SE +/- 0.07, N = 3 SE +/- 0.13, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 3 SE +/- 0.30, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.25, N = 3 SE +/- 0.22, N = 3 103.96 107.19 108.80 114.41 108.16 113.72 107.90 118.46 122.64 120.86 113.70 111.87 113.29 110.71 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
GPAW Input: Carbon Nanotube OpenBenchmarking.org Seconds, Fewer Is Better GPAW 22.1 Input: Carbon Nanotube EPYC 7343 2P EPYC 7413 2P EPYC 7513 2P 100 200 300 400 500 SE +/- 0.65, N = 3 SE +/- 0.96, N = 3 SE +/- 1.19, N = 3 444.07 417.51 398.99 1. (CC) gcc options: -shared -lxc -lblas -lmpi -O2 -fexceptions -pipe -m64 -march=x86-64-v2 -mtune=generic -fcf-protection -fPIC -fwrapv -UNDEBUG -std=c99
CloudSuite Graph Analytics GraphX Algorithm: Triangle Count OpenBenchmarking.org ms, Fewer Is Better CloudSuite Graph Analytics 4.0 GraphX Algorithm: Triangle Count EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30K 60K 90K 120K 150K SE +/- 192.25, N = 3 SE +/- 2111.36, N = 15 SE +/- 911.07, N = 15 SE +/- 4547.27, N = 12 SE +/- 844.55, N = 3 SE +/- 3129.18, N = 15 SE +/- 816.75, N = 5 SE +/- 1101.67, N = 15 SE +/- 1190.06, N = 15 SE +/- 1737.14, N = 15 SE +/- 969.69, N = 3 SE +/- 486.76, N = 3 SE +/- 2880.79, N = 12 SE +/- 1088.95, N = 15 108988 77278 84114 74003 77893 70042 74250 70089 93231 78150 87786 73459 127015 84608
PostgreSQL Scaling Factor: 1000 - Clients: 800 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 800 - Mode: Read Only - Average Latency EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.2651 0.5302 0.7953 1.0604 1.3255 SE +/- 0.012, N = 3 SE +/- 0.011, N = 3 SE +/- 0.002, N = 3 SE +/- 0.025, N = 9 SE +/- 0.032, N = 11 SE +/- 0.060, N = 6 SE +/- 0.003, N = 3 SE +/- 0.020, N = 12 SE +/- 0.000, N = 3 SE +/- 0.006, N = 3 SE +/- 0.001, N = 3 SE +/- 0.031, N = 12 SE +/- 0.006, N = 3 SE +/- 0.008, N = 12 1.150 0.935 0.877 1.051 0.822 1.178 0.745 0.963 0.712 1.066 0.813 0.953 1.072 0.750 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1000 - Clients: 800 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 800 - Mode: Read Only EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200K 400K 600K 800K 1000K SE +/- 7215.33, N = 3 SE +/- 9801.20, N = 3 SE +/- 2318.40, N = 3 SE +/- 19094.08, N = 9 SE +/- 28926.74, N = 11 SE +/- 41984.11, N = 6 SE +/- 4126.34, N = 3 SE +/- 19623.01, N = 12 SE +/- 137.25, N = 3 SE +/- 4309.16, N = 3 SE +/- 1328.10, N = 3 SE +/- 30362.30, N = 12 SE +/- 4113.36, N = 3 SE +/- 10990.82, N = 12 695761 855642 912427 765090 984394 690019 1074765 835087 1123663 750218 983473 850161 746302 1067716 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
oneDNN Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.29445, N = 15 SE +/- 0.76540, N = 12 SE +/- 0.24995, N = 12 SE +/- 0.45466, N = 15 SE +/- 0.12995, N = 12 SE +/- 0.39591, N = 12 3.88765 10.56278 2.80481 6.98945 2.21622 5.50135 MIN: 2 MIN: 4.94 MIN: 1.46 MIN: 3.99 MIN: 1.72 MIN: 3.49 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.837375, N = 15 SE +/- 0.206028, N = 15 SE +/- 1.007343, N = 15 SE +/- 0.393240, N = 12 SE +/- 1.169116, N = 15 SE +/- 0.559435, N = 15 SE +/- 0.912376, N = 12 SE +/- 0.001079, N = 4 SE +/- 0.001294, N = 4 SE +/- 0.002543, N = 4 SE +/- 0.000460, N = 4 SE +/- 0.004663, N = 4 SE +/- 0.001288, N = 4 8.358690 2.354380 9.130000 2.323020 12.287940 4.318590 6.486810 0.521446 0.255235 0.587102 0.255585 0.806671 0.394611 MIN: 2.64 MIN: 1.2 MIN: 3.45 MIN: 1.19 MIN: 4.19 MIN: 1.39 MIN: 2.12 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.6001 1.2002 1.8003 2.4004 3.0005 SE +/- 0.013668, N = 4 SE +/- 0.014584, N = 9 SE +/- 0.084917, N = 15 SE +/- 0.030750, N = 15 SE +/- 0.151936, N = 15 SE +/- 0.019283, N = 15 SE +/- 0.089162, N = 15 SE +/- 0.015644, N = 4 SE +/- 0.084321, N = 15 SE +/- 0.007581, N = 4 SE +/- 0.023972, N = 12 SE +/- 0.006714, N = 4 SE +/- 0.025234, N = 15 1.661420 1.752520 2.197500 1.594450 2.666980 1.494980 2.046400 1.395210 1.664430 1.476490 1.088780 1.694700 1.178640 MIN: 1.24 MIN: 1.5 MIN: 1.4 MIN: 1.3 MIN: 1.38 MIN: 1.25 MIN: 1.33 MIN: 1.18 MIN: 1.04 MIN: 1.22 MIN: 0.84 MIN: 1.42 MIN: 0.89 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Phoronix Test Suite v10.8.5