2023 Tests Benchmarks for a future article. 2 x AMD EPYC 7343 16-Core testing with a Supermicro H12DSi-N6 v1.02 (2.3 BIOS) and astdrmfb on AlmaLinux 9.1 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2305035-PTS-UPEARLY506 .
2023 Tests Processor Motherboard Memory Disk Graphics Monitor OS Kernel Compiler File-System Screen Resolution EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P AMD EPYC 7343 16-Core @ 3.20GHz (16 Cores / 32 Threads) Supermicro H12SSL-i v1.02 (2.4 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07 astdrmfb DELL E207WFP AlmaLinux 9.1 5.14.0-162.12.1.el9_1.x86_64 (x86_64) GCC 11.3.1 20220421 ext4 1680x1050 2 x AMD EPYC 7343 16-Core @ 3.20GHz (32 Cores / 64 Threads) Supermicro H12DSi-N6 v1.02 (2.3 BIOS) 16 x 32 GB DDR4-3200MT/s Samsung M393A4K40EB3-CWE 5.14.0-162.18.1.el9_1.x86_64 (x86_64) 1280x1024 AMD EPYC 7413 24-Core @ 2.65GHz (24 Cores / 48 Threads) Supermicro H12SSL-i v1.02 (2.4 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 5.14.0-162.12.1.el9_1.x86_64 (x86_64) 1024x768 2 x AMD EPYC 7413 24-Core @ 2.65GHz (48 Cores / 96 Threads) Supermicro H12DSi-N6 v1.02 (2.3 BIOS) 512GB 5.14.0-162.18.1.el9_1.x86_64 (x86_64) AMD EPYC 7513 32-Core @ 2.60GHz (32 Cores / 64 Threads) Supermicro H12SSL-i v1.02 (2.4 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 5.14.0-162.12.1.el9_1.x86_64 (x86_64) 2 x AMD EPYC 7513 32-Core @ 2.60GHz (64 Cores / 128 Threads) Supermicro H12DSi-N6 v1.02 (2.3 BIOS) 512GB 5.14.0-162.18.1.el9_1.x86_64 (x86_64) AMD EPYC 7543 32-Core @ 2.80GHz (32 Cores / 64 Threads) Supermicro H12SSL-i v1.02 (2.4 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE DELL E207WFP 5.14.0-162.12.1.el9_1.x86_64 (x86_64) 1680x1050 AMD EPYC 7713P 64-Core @ 2.00GHz (64 Cores / 128 Threads) 1024x768 Intel Xeon Gold 6338 @ 3.20GHz (32 Cores / 64 Threads) Supermicro X12SPO-NTF v2.00 (1.2 BIOS) DELL E207WFP 1280x1024 2 x Intel Xeon Gold 6338 @ 3.20GHz (64 Cores / 128 Threads) Supermicro X12DPi-N6 v1.01 (1.4 BIOS) 16 x 32 GB DDR4-3200MT/s Samsung M393A4K40EB3-CWE Intel Xeon Gold 6342 @ 3.50GHz (24 Cores / 48 Threads) Supermicro X12SPO-NTF v2.00 (1.2 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 2 x Intel Xeon Gold 6342 @ 3.50GHz (48 Cores / 96 Threads) Supermicro X12DPi-N6 v1.01 (1.4 BIOS) 16 x 32 GB DDR4-3200MT/s Samsung M393A4K40EB3-CWE Intel Xeon Gold 6346 @ 3.60GHz (16 Cores / 32 Threads) Supermicro X12SPO-NTF v2.00 (1.2 BIOS) 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 2 x Intel Xeon Gold 6346 @ 3.60GHz (32 Cores / 64 Threads) Supermicro X12DPi-N6 v1.01 (1.4 BIOS) 16 x 32 GB DDR4-3200MT/s Samsung M393A4K40EB3-CWE 1024x768 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: always Compiler Details - --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl Processor Details - EPYC 7343: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7343 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7413: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7413 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7513: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7513 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7543: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - EPYC 7713P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 - Xeon Gold 6338: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 - Xeon Gold 6338 2P: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 - Xeon Gold 6342: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 - Xeon Gold 6342 2P: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 - Xeon Gold 6346: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 - Xeon Gold 6346 2P: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375 Java Details - OpenJDK Runtime Environment (Red_Hat-11.0.18.0.10-2.el9_1) (build 11.0.18+10-LTS) Python Details - Python 3.9.14 Security Details - EPYC 7343: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7343 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7413: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7413 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7513: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7513 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7543: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 7713P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6338: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6338 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6342: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6342 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6346: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Gold 6346 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
2023 Tests hpcg: minibude: OpenMP - BM1 minibude: OpenMP - BM1 namd: ATPase Simulation - 327,506 Atoms nekrs: TurboPipe Periodic pennant: sedovbig pennant: leblancbig nwchem: C240 Buckyball incompact3d: X3D-benchmarking input.i3d incompact3d: input.i3d 193 Cells Per Direction openradioss: Bumper Beam openradioss: Cell Phone Drop Test openradioss: Bird Strike on Windshield openradioss: Rubber O-Ring Seal Installation openradioss: INIVOL and Fluid Structure Interaction Drop Container lulesh: luxcorerender: DLSC - CPU luxcorerender: Danish Mood - CPU luxcorerender: Orange Juice - CPU luxcorerender: LuxCore Benchmark - CPU luxcorerender: Rainbow Colors and Prism - CPU embree: Pathtracer - Crown embree: Pathtracer ISPC - Crown embree: Pathtracer - Asian Dragon embree: Pathtracer ISPC - Asian Dragon kvazaar: Bosphorus 4K - Medium kvazaar: Bosphorus 4K - Very Fast kvazaar: Bosphorus 4K - Super Fast kvazaar: Bosphorus 4K - Ultra Fast svt-av1: Preset 4 - Bosphorus 4K svt-av1: Preset 8 - Bosphorus 4K svt-av1: Preset 12 - Bosphorus 4K svt-av1: Preset 13 - Bosphorus 4K svt-hevc: 1 - Bosphorus 4K svt-hevc: 7 - Bosphorus 4K svt-hevc: 10 - Bosphorus 4K svt-vp9: VMAF Optimized - Bosphorus 4K svt-vp9: PSNR/SSIM Optimized - Bosphorus 4K svt-vp9: Visual Quality Optimized - Bosphorus 4K uvg266: Bosphorus 4K - Slow uvg266: Bosphorus 4K - Medium uvg266: Bosphorus 1080p - Slow uvg266: Bosphorus 1080p - Medium uvg266: Bosphorus 4K - Very Fast uvg266: Bosphorus 4K - Super Fast uvg266: Bosphorus 4K - Ultra Fast uvg266: Bosphorus 1080p - Very Fast uvg266: Bosphorus 1080p - Super Fast uvg266: Bosphorus 1080p - Ultra Fast vvenc: Bosphorus 4K - Fast vvenc: Bosphorus 4K - Faster vvenc: Bosphorus 1080p - Fast vvenc: Bosphorus 1080p - Faster x265: Bosphorus 4K build-apache: Time To Compile build-gem5: Time To Compile build-godot: Time To Compile build-linux-kernel: defconfig build-llvm: Ninja build-llvm: Unix Makefiles build-nodejs: Time To Compile onednn: IP Shapes 1D - f32 - CPU onednn: IP Shapes 3D - f32 - CPU onednn: IP Shapes 1D - bf16bf16bf16 - CPU onednn: IP Shapes 3D - bf16bf16bf16 - CPU onednn: Convolution Batch Shapes Auto - f32 - CPU onednn: Deconvolution Batch shapes_1d - f32 - CPU onednn: Deconvolution Batch shapes_3d - f32 - CPU onednn: Recurrent Neural Network Training - f32 - CPU onednn: Recurrent Neural Network Inference - f32 - CPU onednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPU onednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPU onednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPU onednn: Matrix Multiply Batch Shapes Transformer - f32 - CPU onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPU onednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPU onednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPU ospray-studio: 1 - 4K - 1 - Path Tracer ospray-studio: 3 - 4K - 1 - Path Tracer ospray-studio: 1 - 4K - 32 - Path Tracer ospray-studio: 3 - 4K - 32 - Path Tracer ffmpeg: libx264 - Live ffmpeg: libx264 - Live ffmpeg: libx265 - Live ffmpeg: libx265 - Live ffmpeg: libx264 - Upload ffmpeg: libx264 - Upload ffmpeg: libx265 - Upload ffmpeg: libx265 - Upload ffmpeg: libx264 - Platform ffmpeg: libx264 - Platform ffmpeg: libx265 - Platform ffmpeg: libx265 - Platform ffmpeg: libx264 - Video On Demand ffmpeg: libx264 - Video On Demand ffmpeg: libx265 - Video On Demand ffmpeg: libx265 - Video On Demand openssl: SHA256 openssl: RSA4096 openssl: RSA4096 clickhouse: 100M Rows Hits Dataset, First Run / Cold Cache clickhouse: 100M Rows Hits Dataset, Second Run clickhouse: 100M Rows Hits Dataset, Third Run memcached: 1:5 memcached: 1:10 memcached: 1:100 graph500: 26 graph500: 26 graph500: 26 graph500: 26 gromacs: MPI CPU - water_GMX50_bare pgbench: 1000 - 800 - Read Only pgbench: 1000 - 800 - Read Only - Average Latency pgbench: 1000 - 1000 - Read Only pgbench: 1000 - 1000 - Read Only - Average Latency pgbench: 1000 - 800 - Read Write pgbench: 1000 - 800 - Read Write - Average Latency pgbench: 1000 - 1000 - Read Write pgbench: 1000 - 1000 - Read Write - Average Latency tensorflow: CPU - 256 - AlexNet tensorflow: CPU - 512 - AlexNet tensorflow: CPU - 256 - GoogLeNet tensorflow: CPU - 256 - ResNet-50 tensorflow: CPU - 512 - GoogLeNet tensorflow: CPU - 512 - ResNet-50 deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream gpaw: Carbon Nanotube blender: BMW27 - CPU-Only blender: Classroom - CPU-Only blender: Barbershop - CPU-Only cloudsuite-da: 1 cloudsuite-da: 4 cloudsuite-da: 8 cloudsuite-da: 32 cloudsuite-da: 64 cloudsuite-da: 128 cloudsuite-da: 256 cloudsuite-da: 512 cloudsuite-ga: Page Rank cloudsuite-ga: Triangle Count cloudsuite-ga: Connected Components cloudsuite-ma: Large cloudsuite-ma: Small cloudsuite-ws: 100 cloudsuite-ws: 400 cloudsuite-ws: 500 openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU cassandra: Writes rocksdb: Rand Fill rocksdb: Rand Read rocksdb: Update Rand rocksdb: Seq Fill rocksdb: Rand Fill Sync rocksdb: Read While Writing rocksdb: Read Rand Write Rand nginx: 100 nginx: 200 nginx: 500 nginx: 1000 phpbench: PHP Benchmark Suite EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 18.1367 1.14340 26.92807 16.69242 5397.8 880.639262 35.5556106 118.30 66.29 218.07 103.03 352.52 10323.176 2.48 5.05 2.72 12.12 21.2170 20.0067 23.7647 23.0613 14.94 32.35 41.24 53.29 3.444 48.378 179.068 172.161 3.79 71.41 143.45 111.82 115.80 83.73 9.26 10.42 38.52 43.11 28.94 30.00 35.28 110.98 116.79 130.30 4.310 9.370 10.496 25.092 24.86 17.698 267.883 74.949 63.491 347.363 392.194 337.220 6805 8172 224298 265238 23.18 217.86 40.81 123.76 199.10 12.68 103.96 24.29 155.46 48.73 151.85 49.89 155.37 48.75 152.05 49.82 24891101267 4398.6 287549.0 336.88 346.00 345.53 2199582.80 2548333.19 1610909.22 309817000 312989000 114295000 149710000 695761 1.150 685239 1.459 25679 31.158 24821 40.294 138.96 142.79 64.03 22.37 63.82 22.91 12.6466 629.1859 163.5554 48.8605 52.2641 152.8306 144.2282 55.4127 105.9576 75.4144 17.7432 450.6033 53.5991 148.9584 12.6201 627.6853 82.60 219.83 815.39 18792 19011 19259 18906 19072 101630 25186 89452 11525 108988 15718 122575 13995 7.333 11.833 11.6 4.27 1850.23 2.84 2790.52 2.82 2813.45 389.71 20.51 9.36 854.22 654.14 12.22 404.56 19.76 49.20 162.40 913.75 17.50 646.15 12.37 13149.71 1.21 14256.40 1.11 172713 732752 35.3196 1398.411 55.936 0.59260 166901000000 13.47434 7.618046 484.985402 18.0244586 27713.943 5.74 4.10 8.59 4.46 13.03 37.7503 35.4898 38.9667 38.0109 22.50 45.86 57.13 63.34 3.779 66.077 204.549 191.017 7.28 116.56 191.99 152.31 158.14 130.23 14.89 16.78 43.92 49.15 41.20 42.95 46.65 134.43 142.78 155.33 4.899 10.051 11.054 24.194 23.06 18.218 38.974 190.969 240.493 190.997 1.66142 3.09624 1.18840 6.26194 2.82788 2958.98 1837.89 8.35869 2900.06 1754.12 3628 4336 120264 142611 23.41 215.69 48.59 103.93 198.235232573 12.74 107.19 23.56 155.38 48.75 162.339168912 46.66 155.42 48.74 161.72 46.84 49694000047 8794.6 574456.9 423.79 443.07 443.72 2421891.74 2826219.16 2373328.37 422529000 444474000 174219000 218986000 4.083 855642 0.935 849019 1.178 8492 94.590 8356 119.682 143.84 147.17 70.56 24.03 71.90 25.43 24.9183 636.2769 280.4317 56.9767 97.1983 164.1407 287.1813 55.5978 206.5323 77.3427 33.4196 475.8713 104.8912 152.1486 25.0243 634.7296 444.071 41.30 109.64 435.02 58173 1314712 1338669 1025584 915672 870117 977380 1306974 9820 77278 14547 147944 46059 5.55 11.433 11.217 7.76 1028.98 5.53 1445.13 5.52 1447.06 734.99 10.88 18.85 423.55 1243.24 6.42 788.14 10.13 94.18 84.87 1934.07 16.53 1132.27 7.05 25795.58 1.23 27742.34 1.14 236544 316199 181223940 481479 323598 170828 4864299 2195191 146481.53 155325.61 157128.24 151418.97 735624 17.8487 901.850 36.074 0.88677 112350333333 21.41936 12.95789 4463.3 766.720540 32.3950857 105.44 54.23 201.13 88.65 291.34 9682.7993 3.33 6.56 3.68 15.11 27.4240 25.8301 31.8965 30.4535 16.10 33.41 43.02 55.36 3.496 58.920 210.554 195.798 4.89 85.67 181.39 140.28 143.85 107.77 10.54 11.87 38.45 43.27 31.30 33.10 38.88 118.56 125.26 138.79 4.415 9.431 10.188 24.360 27.01 18.992 229.595 64.734 52.718 275.254 320.942 270.840 1.75252 2.79700 2.13731 4.70749 3.28030 1797.92 1070.14 2.35438 1795.39 1073.72 5121 6067 170190 200057 24.88 202.95 43.08 117.23 214.55 11.77 108.80 23.21 166.90 45.39 159.89 47.38 167.10 45.33 160.13 47.31 33095407800 5947.9 390326.3 351.34 363.28 360.64 2917560.70 3431617.24 2309617.42 3.005 912427 0.877 884213 1.131 24251 33.213 25674 38.970 144.99 150.98 65.49 23.43 65.67 24.16 16.3219 729.3104 226.0494 53.0316 67.2045 178.2114 91.6820 130.7157 192.6805 62.1975 139.2719 86.0790 23.2903 515.0566 70.4128 170.1636 16.3700 729.0602 62.03 165.39 616.51 58158 874335 1265492 1326319 1296065 1324795 1263825 1296994 9815 84114 14011 124002 23575 7.583 14.733 14.583 5.44 2183.99 3.61 3275.51 3.59 3280.27 479.00 25.03 12.17 979.21 833.99 14.38 517.32 23.18 60.67 197.58 1211.31 19.80 769.91 15.57 17211.28 1.39 18711.92 1.27 224875 740490 120400741 638378 821279 199221 4117643 2369439 127405.11 129033.29 131406.38 129682.72 670928 27.6326 1718.936 68.757 0.47053 194221666667 10.79851 5.976653 700.101786 15.6894077 25716.768 7.17 5.14 11.24 5.56 15.73 49.9496 46.5974 48.3491 46.2930 23.20 48.93 61.75 64.72 3.510 65.954 217.432 193.778 9.18 136.95 208.59 154.60 161.19 145.30 16.00 18.06 59.52 66.47 45.98 48.07 49.77 164.25 163.18 165.33 4.658 9.526 10.393 23.346 22.13 20.996 33.819 161.530 216.184 165.471 2.19750 4.00035 0.940455 7.89700 1.88334 2774.02 1604.83 9.13000 2840.00 1602.68 2722 3252 93834 110558 25.24 200.05 51.34 98.37 215.59 11.71 114.41 22.07 169.02 44.82 172.96 43.80 168.57 44.94 172.81 43.84 66206231957 11846.8 778483.0 429.39 437.50 440.92 2164592.24 3691244.97 2952893.82 584034000 601120000 225284000 294782000 4.820 765090 1.051 728184 1.377 8736 91.602 9798 102.073 143.50 146.48 70.39 24.04 71.43 25.36 32.2500 738.7817 384.2896 62.3607 127.5406 187.6814 370.1937 64.7191 270.2740 88.6308 43.9125 544.6158 137.0417 174.6170 32.2535 739.7624 417.506 31.80 82.55 330.02 61767 928018 1386712 1337500 1462648 1393156 1456236 1447278 9831 74003 14426 225855 111224 5.3 11.967 12.083 10.06 1190.68 7.01 1688.62 7.01 1689.48 852.08 14.07 24.72 483.37 1570.38 7.63 1024.68 11.70 119.68 100.17 2570.67 18.66 1313.76 9.12 34019.21 1.4 36411.01 1.30 225784 306931 238439429 336131 286858 165480 6957204 2190994 144891.45 135890.54 133788.29 680136 17.6803 1177.571 47.103 0.71585 128904333333 17.88689 10.83575 3660.2 784.797160 30.7356491 96.53 45.63 186.94 84.32 245.34 18098.804 4.35 8.18 4.64 17.44 34.1845 33.1430 40.2107 38.3505 20.33 42.32 52.81 62.27 3.669 66.633 231.540 210.235 6.22 111.95 207.54 161.26 164.17 129.22 13.43 15.10 40.52 45.60 39.52 41.46 46.07 129.79 138.95 153.97 4.582 9.736 10.350 24.712 28.24 18.861 210.643 57.582 44.751 230.689 282.423 226.631 1.59445 3.63115 1.95016 4.64782 3.17840 1957.83 1109.99 2.32302 1975.47 1124.53 4014 4769 135636 159097 24.35 207.35 42.56 118.65 211.010138953 11.97 108.16 23.35 164.12 46.16 159.12 47.61 164.52 46.04 158.71 47.73 42284954430 7637.8 501938.9 362.00 377.03 379.67 3632495.02 4198464.11 2981451.32 517810000 528200000 176371000 226239000 3.547 984394 0.822 976332 1.024 13777 58.070 13865 72.399 151.07 156.46 69.02 23.77 70.20 24.66 19.8959 791.9745 283.7118 56.3260 82.5527 193.4699 113.8532 140.2311 240.4095 66.4697 172.7305 92.5433 29.2692 546.2807 86.9371 183.7170 19.9788 792.4571 49.24 130.35 482.82 58645 1295214 1323129 1282987 1315834 1378719 1288469 1380314 9917 77893 13102 134575 36808 7.417 14.883 15.267 6.67 2369.52 4.44 3561.39 4.45 3537.87 603.36 26.50 15.29 1038.36 1076.30 14.86 651.20 24.55 75.28 212.22 1520.46 21.03 987.77 16.18 21308.51 1.49 23116.82 1.37 263627 809625 150974278 707656 864802 238127 5130684 2750066 152248.92 160998.23 159784.56 156398.74 678084 34.5344 2333.755 93.350 0.36716 218603000000 8.761462 4.827648 432.073659 15.8133430 37170.855 9.12 6.43 13.40 6.75 17.44 62.3560 58.9004 53.8116 51.9364 25.02 54.13 63.53 65.39 3.604 71.454 217.701 193.151 11.56 149.01 201.76 163.58 165.46 148.84 17.26 19.59 63.00 70.75 51.05 51.46 53.21 173.58 173.74 175.35 4.688 9.445 10.329 22.956 22.65 19.699 29.784 140.277 199.575 143.597 2.66698 4.26599 0.786803 10.00962 2.04048 5074.57 1606.42 12.28794 5033.87 1615.13 2150 2538 74566 86704 24.46 206.46 49.98 101.05 210.67 11.99 113.72 22.20 164.38 46.08 171.41 44.19 164.86 45.95 171.53 44.16 84365767223 15222.3 1003089.4 412.09 436.77 435.85 1867112.74 4105338.27 3518612.74 665655000 691983000 255036000 322475000 5.589 690019 1.178 638731 1.569 8552 97.517 10651 93.903 141.81 144.20 62.34 22.75 63.68 23.96 39.5929 803.4468 488.6254 65.3924 156.2377 204.2260 468.9263 68.1249 335.9890 95.0848 55.4706 575.3658 170.2562 187.5171 39.6557 802.1569 398.988 25.46 64.96 262.94 62262 905105 1397332 1118115 910021 1030733 974407 1425667 9587 70042 13891 301630 181349 5.417 11.2 11.817 12.55 1272.58 8.82 1803.09 8.81 1804.95 1173.42 13.62 31.43 507.62 2097.59 7.62 1196.03 13.32 152.10 105.07 3255.75 19.64 1713.90 9.32 42487.49 1.50 45746.27 1.39 245226 328435 299129297 351517 299732 197227 8063050 2204871 151573.48 140932.43 135921.70 686597 19.3385 1261.441 50.458 0.65554 149115333333 15.39717 8.575596 3488.4 716.618001 24.1082433 93.97 41.25 173.03 79.17 224.14 21129.412 4.36 8.42 4.74 16.69 37.2804 35.1162 41.9519 40.5096 21.04 43.25 54.27 63.28 3.635 67.153 237.131 214.387 6.69 119.84 219.43 171.65 175.18 137.52 14.00 15.77 41.09 46.14 40.67 42.81 47.24 130.26 139.65 154.38 4.724 9.984 10.555 24.844 27.63 18.834 198.426 55.114 42.087 212.302 260.908 209.943 1.49498 2.02266 1.30138 4.86899 2.98900 1974.31 1106.75 4.31859 1989.75 1092.81 3767 4486 127078 148990 23.86 211.67 44.47 113.57 210.02 12.02 107.90 23.40 162.71 46.55 158.24 47.87 162.21 46.70 158.41 47.82 44324823090 7963.1 522787.3 410.64 425.45 425.48 3574540.35 3481927.79 2848831.24 544342000 554082000 204519000 268016000 4.001 1074765 0.745 1008741 0.991 11845 67.538 12068 83.024 155.25 160.32 72.46 25.34 73.86 26.26 22.0707 716.0241 294.2079 54.3162 91.5684 174.3602 124.1286 128.6660 256.5235 62.2907 186.0887 85.8688 31.3942 507.6631 93.9657 169.9349 22.1183 716.1195 46.24 122.97 456.27 59400 1252851 1279022 1356145 1312741 1337915 1332491 1307991 9247 74250 13358 130123 37315 6.583 13.8 13.05 7.32 2162.68 4.95 3186.87 4.94 3217.57 675.88 23.66 16.56 961.41 1166.69 13.70 716.95 22.30 83.73 190.87 1628.99 19.63 1112.62 14.37 23118.27 1.37 25079.41 1.27 246339 743355 161712224 688172 774765 233743 5147499 2690298 147786.59 161270.01 165787.42 165810.67 687000 19.0558 1912.744 76.510 0.45591 170229333333 11.31944 6.246704 2799.5 663.825195 23.0942440 91.55 36.39 167.45 89.74 191.58 22242.530 6.10 12.44 6.70 18.73 52.7477 51.6795 62.5656 60.0978 19.03 41.59 50.67 57.99 3.421 67.308 231.997 203.194 9.79 138.52 224.80 172.24 179.74 146.48 13.99 15.71 56.07 61.66 42.56 45.49 48.31 168.38 180.55 196.33 4.455 9.110 9.553 22.513 27.16 20.388 190.758 50.802 33.746 163.543 225.698 166.988 2.04640 3.78466 0.937918 6.94903 3.25137 2720.07 1183.30 6.48681 2712.50 1186.00 2424 2874 84001 98653 24.20 208.64 47.87 105.50 210.12 12.02 118.46 21.32 163.38 46.36 174.39 43.44 163.44 46.35 174.28 43.46 69715833097 12568.1 823388.7 365.79 375.36 380.10 3378044.12 4786407.25 3893409.95 691348000 715154000 227175000 288959000 5.098 835087 0.963 721335 1.386 12245 65.348 15683 64.500 130.65 136.28 58.23 20.70 60.82 21.85 31.4455 1010.0008 455.1184 70.2051 132.2972 241.3333 177.6432 179.6763 369.5420 86.4635 271.8806 117.4838 46.6790 684.8470 138.1362 230.9178 31.4000 1010.5833 30.36 79.30 297.72 60941 1318693 1351560 952995 1353066 1377599 1321064 1296643 9112 70089 13169 250115 136721 7.1 13.267 15.283 10.33 3072.39 6.92 4538.43 6.92 4533.12 940.29 34.00 24.81 1279.15 1735.57 18.42 1033.39 30.95 116.30 274.66 2475.95 25.83 1542.73 20.72 33271.17 1.9 34339.21 1.74 253058 455327 246464521 436633 452291 267282 7932933 2761836 167224.22 156012.00 151997.72 678966 19.8931 1010.277 40.411 0.70215 127809333333 30.86947 14.44702 4747.9 626.976115 33.0038337 111.00 59.09 207.10 108.37 287.21 18868.723 3.47 7.01 3.67 13.20 29.8397 35.8362 35.9078 45.7947 13.69 27.47 33.71 38.52 3.034 56.031 194.141 176.036 4.4 91.70 171.63 143.42 148.73 111.92 9.76 10.88 28.13 31.35 26.79 28.50 31.67 87.55 94.98 105.96 3.776 7.981 8.394 20.147 25.70 22.423 244.251 69.243 51.838 268.944 323.073 272.730 1.39521 1.64248 3.34833 1.81562 1.71129 4.48936 1.92380 901.436 521.572 5.74487 7.86162 7.88371 0.521446 907.291 520.564 3.88765 3314 3967 113149 133650 28.24 178.82 44.77 112.80 247.388378655 10.21 122.64 20.59 192.02 39.45 180.71 41.92 192.08 39.44 180.03 42.08 20888915973 6442.7 419447.9 311.11 325.13 325.93 4271575.65 4262554.19 2937926.06 510587000 519294000 168374000 213096000 3.717 1123663 0.712 1078586 0.927 22228 35.995 22446 44.552 475.07 489.77 203.92 68.08 205.17 68.38 18.6692 855.9968 362.2935 44.1261 92.2695 173.2014 320.0058 49.9551 173.7712 92.0537 33.8978 471.6297 83.6220 191.3088 18.6943 855.7781 59.55 161.50 604.76 20565 20697 20809 20822 20909 121626 43513 93771 11245 93231 14285 163851 36646 7.517 12.383 13.317 8.96 1771.70 5.36 2962.18 5.26 3023.56 481.60 33.19 35.43 450.58 1661.48 9.61 904.01 35.34 112.12 142.53 3345.71 9.55 899.05 17.77 22808.14 1.38 25216.38 1.23 176284 1088420 113495056 793742 1269946 297029 4793137 2770547 151274.54 160541.79 160307.52 164486.94 719675 39.1363 2009.716 80.389 0.35502 242295666667 19.64620 7.347379 3009.9 357.235290 14.6863581 91.34 37.73 162.88 89.85 199.83 39798.691 6.09 12.30 6.57 11.33 58.3269 69.5889 67.1266 84.8635 17.63 36.47 41.44 43.33 3.049 63.096 201.074 180.919 8.25 128.72 176.67 137.47 144.22 131.90 12.56 14.12 44.48 49.39 36.01 37.22 38.92 131.93 133.13 136.60 4.045 8.128 8.721 20.641 24.42 22.114 199.485 54.704 33.036 160.399 227.371 168.425 1.66443 2.40282 3.67592 1.88632 2.46627 6.56164 1.14313 681.159 472.891 2.92655 4.33315 5.02585 0.255235 690.752 457.949 10.56278 1641 1979 52646 69538 29.14 173.30 45.25 111.60 250.35 10.09 120.86 20.89 195.55 38.74 180.82 41.89 196.032349446 38.64 181.97 41.63 42653381293 12874.9 838351.8 388.39 405.08 407.09 3270779.44 3551712.12 2802626.26 655675000 667982000 238460000 295010000 7.379 750218 1.066 754104 1.348 19540 40.942 19322 51.774 547.55 575.90 253.31 73.49 257.04 74.68 37.6996 847.3755 704.9499 45.3578 177.5939 179.8852 639.7687 49.9661 345.1816 92.6396 65.2131 488.4066 167.3832 190.8367 37.6297 848.9104 29.66 80.17 302.14 21324 21284 21431 21685 21632 122135 34651 29960 11235 78150 14751 287528 147653 7.35 11.933 9.6 18.48 862.09 10.84 1467.67 10.63 1495.92 939.07 17.01 73.58 217.18 3402.82 4.69 1813.34 35.12 204.17 78.16 7209.16 8.86 1619.83 9.85 47801.07 1.32 54275.42 1.16 156487 481703 226944746 466697 488659 307133 7436444 2579926 205570.62 180812.11 178255.95 722240 18.8044 889.014 35.561 0.75173 117791000000 31.83193 15.69182 4925.4 659.145325 33.3006439 110.30 62.82 204.18 107.07 301.70 9964.4105 3.04 6.46 3.29 13.77 25.3454 29.1748 31.0113 40.9761 13.17 27.03 34.35 42.41 3.209 59.414 206.814 190.736 4.09 85.66 173.16 141.68 148.12 109.31 9.37 10.51 33.02 37.08 26.65 28.82 33.30 98.13 106.29 118.47 4.093 8.830 9.153 22.274 27.77 20.239 244.566 70.288 55.485 292.729 346.264 295.587 1.47649 1.66931 4.48183 2.22071 1.82190 3.28994 1.99051 1086.78 642.826 6.03750 8.61404 8.29712 0.587102 1076.71 638.132 2.80481 3769 4621 127865 152061 26.07 193.69 41.27 122.36 227.36 11.11 113.70 22.21 176.95 42.81 167.86 45.13 177.11 42.77 167.31 45.28 20256398000 6109.7 398769.3 312.11 321.66 325.08 4068619.97 4053902.81 2842403.96 3.376 983473 0.813 927858 1.078 24360 32.842 25377 39.409 410.32 432.47 189.89 61.90 191.35 62.18 17.3928 689.6754 294.7603 40.6830 83.0341 144.3061 286.8784 41.8063 157.5969 76.1206 31.0113 386.8811 75.6723 158.5557 17.3843 690.2354 64.90 176.55 680.31 18581 18674 18852 18923 18776 104512 27079 80304 10340 87786 13542 140252 21960 7.517 14.7 15.433 8.43 1413.05 5.03 2358.37 4.95 2400.77 449.39 26.68 33.22 360.49 1544.95 7.75 853.15 28.09 102.67 116.82 3090.28 7.75 810.68 14.78 20000.76 1.19 22510.58 1.05 200958 1272718 104010467 743700 1443216 277553 3825346 2420422 140495.61 141544.55 141031.60 153700.70 788731 37.0155 1712.718 68.509 0.38091 227635333333 18.26646 7.523824 2846.4 461.110891 16.5087767 85.45 36.51 155.37 78.89 179.68 26940.976 5.84 11.19 6.16 12.60 51.3945 61.1833 59.6775 75.2485 19.27 39.25 47.49 49.75 3.316 68.969 213.420 200.381 7.90 136.71 176.18 139.88 148.45 138.19 14.22 16.00 51.74 57.70 39.03 41.73 44.24 150.71 152.28 155.38 4.393 8.908 9.430 22.265 25.54 20.063 190.648 51.926 33.790 166.310 220.500 175.006 1.088780 2.39962 3.97631 2.42969 2.99340 4.76230 1.15641 703.511 430.603 3.10763 4.66619 4.24724 0.255585 703.715 442.011 6.98945 1956 2330 67775 80780 27.09 186.41 41.71 121.08 230.436500344 10.96 111.87 22.57 181.25 41.79 167.16 45.31 181.28 41.79 167.658087463 45.18 40355102327 12235.1 798077.1 411.38 433.55 425.45 3701213.86 3969670.99 2971169.05 6.761 850161 0.953 851464 1.176 21929 36.483 22138 45.177 486.36 510.92 231.32 66.43 234.54 66.12 34.7862 685.9576 589.2842 40.6995 157.8120 151.8582 578.2529 41.4567 313.1405 76.5637 59.9668 399.3327 150.0890 159.7519 34.8550 686.4476 32.25 87.28 342.37 19397 19473 19477 19751 19706 99997 34180 31922 10381 73459 13551 196790 82287 7.183 11.7 12.717 17.34 689.05 9.94 1198.22 9.78 1217.97 844.38 14.19 67.44 177.69 3005.72 3.98 1664.20 28.73 181.98 65.81 6564.47 7.30 1382.22 8.65 41669.50 1.14 47664.17 0.99 190873 590231 210724462 640738 597465 367162 6230967 2779890 225527.80 205476.78 204325.45 200467.73 789297 16.1504 690.470 27.619 0.98742 96712533333 41.96762 19.49328 6074.2 889.882751 40.5520172 122.43 74.50 231.85 124.37 383.74 10152.757 2.34 5.01 2.59 11.45 19.7589 23.1655 23.3890 29.3139 12.21 26.64 33.93 42.98 3.070 47.122 173.290 166.785 3.11 65.82 134.34 109.47 115.37 83.38 8.18 9.16 33.05 37.00 24.70 26.26 31.03 93.17 100.87 113.18 3.862 8.552 9.107 22.233 24.96 19.678 289.721 83.059 67.647 373.677 421.485 374.171 1.69470 1.84770 4.20681 1.80606 1.94200 3.77644 2.62403 1289.58 722.166 8.24165 11.4152 11.4399 0.806671 1294.14 717.807 2.21622 5199 6321 171646 207128 24.99 202.08 40.58 124.46 216.38 11.67 113.29 22.29 168.80 44.87 165.89 45.66 169.00 44.82 166.43 45.51 14614638730 4397.2 286703.7 283.16 294.82 295.42 3346967.77 3159962.47 2164237.05 359689000 362918000 117919000 154209000 2.619 746302 1.072 742550 1.347 27853 28.723 27861 35.896 311.20 332.04 148.57 49.28 151.03 50.01 13.2078 605.6665 242.0444 33.0304 63.3500 126.1607 215.8422 37.0399 115.5983 69.1881 23.5945 338.9830 55.7478 143.4873 13.2099 605.5730 86.38 233.90 889.71 18046 18119 18342 18027 18205 118445 58137 22380 13034 127015 17820 148896 13855 7.383 13.55 12.95 6.43 1232.64 3.87 2047.93 3.80 2081.75 368.02 21.72 25.52 313.14 1175.72 6.79 640.88 24.93 77.99 102.51 2347.83 6.8 617.71 12.93 15262.36 1.04 17148.89 0.92 177347 1300143 77391048 700379 1508607 208713 3142066 2311235 118699.47 118110.63 113630.04 109860.58 812732 26.3786 1372.933 54.917 0.49354 190369000000 22.14267 9.733065 3643.3 725.346436 21.2240649 94.03 43.84 165.35 83.81 224.24 22099.324 4.46 8.77 4.68 12.05 38.9043 46.2704 43.5077 55.4091 18.39 36.84 45.17 50.50 3.438 67.608 211.627 200.424 6.12 117.26 176.86 141.50 150.48 130.49 13.45 15.05 38.43 43.04 35.89 38.46 42.08 116.97 127.62 139.86 4.417 8.929 9.609 22.161 25.04 19.447 200.960 56.716 40.403 204.227 256.364 209.370 1.17864 2.21782 3.01823 1.62390 3.34125 3.69104 1.37242 702.689 413.290 4.23272 5.86134 5.92201 0.394611 701.324 416.416 5.50135 2534 3001 87290 103047 26.04 193.90 41.42 121.92 219.39 11.51 110.71 22.81 173.16 43.75 164.33 46.10 173.17 43.74 165.06 45.89 29415210430 8906.1 580306.3 360.92 378.61 379.26 3597757.55 3912323.12 2874778.00 562172000 571793000 187654000 245053000 5.391 1067716 0.750 997957 1.002 23290 34.360 23580 42.423 376.10 402.63 182.71 54.33 188.90 56.73 26.5391 599.8080 482.9247 33.1059 125.5955 127.1627 439.3341 36.3820 231.5126 69.0371 45.5497 350.6344 113.0712 141.3563 26.5164 600.7246 42.35 115.77 445.24 18850 18808 19183 19218 19126 118993 31262 23267 10597 84608 14408 157229 41096 7.533 11.733 12.3 13.20 604.17 7.62 1043.48 7.42 1072.35 695.06 11.49 51.51 155.15 2339.16 3.41 1296.57 24.61 144.01 55.49 4979.27 6.41 1076.16 7.41 32137.13 0.99 36784.83 0.86 171138 908869 154099244 803231 966189 289896 4943670 2762454 199748.09 207770.19 207339.64 199978.55 809727 OpenBenchmarking.org
High Performance Conjugate Gradient OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.1 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 9 18 27 36 45 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.21, N = 5 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 18.14 35.32 17.85 27.63 17.68 34.53 19.34 19.06 19.89 39.14 18.80 37.02 16.15 26.38 1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 500 1000 1500 2000 2500 SE +/- 11.90, N = 4 SE +/- 0.56, N = 3 SE +/- 3.16, N = 4 SE +/- 0.14, N = 3 SE +/- 4.00, N = 5 SE +/- 1.10, N = 4 SE +/- 3.71, N = 5 SE +/- 0.83, N = 3 SE +/- 4.35, N = 5 SE +/- 1.48, N = 3 SE +/- 7.83, N = 4 SE +/- 1.38, N = 3 SE +/- 0.78, N = 4 1398.41 901.85 1718.94 1177.57 2333.76 1261.44 1912.74 1010.28 2009.72 889.01 1712.72 690.47 1372.93 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.48, N = 4 SE +/- 0.02, N = 3 SE +/- 0.13, N = 4 SE +/- 0.01, N = 3 SE +/- 0.16, N = 5 SE +/- 0.04, N = 4 SE +/- 0.15, N = 5 SE +/- 0.03, N = 3 SE +/- 0.17, N = 5 SE +/- 0.06, N = 3 SE +/- 0.31, N = 4 SE +/- 0.05, N = 3 SE +/- 0.03, N = 4 55.94 36.07 68.76 47.10 93.35 50.46 76.51 40.41 80.39 35.56 68.51 27.62 54.92 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
NAMD ATPase Simulation - 327,506 Atoms OpenBenchmarking.org days/ns, Fewer Is Better NAMD 2.14 ATPase Simulation - 327,506 Atoms EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.2573 0.5146 0.7719 1.0292 1.2865 SE +/- 0.00059, N = 3 SE +/- 0.00060, N = 3 SE +/- 0.00216, N = 3 SE +/- 0.00231, N = 3 SE +/- 0.00039, N = 3 SE +/- 0.00049, N = 3 SE +/- 0.00115, N = 3 SE +/- 0.00061, N = 3 SE +/- 0.00160, N = 3 SE +/- 0.00053, N = 3 SE +/- 0.00023, N = 3 SE +/- 0.00083, N = 3 SE +/- 0.00172, N = 3 SE +/- 0.00067, N = 3 1.14340 0.59260 0.88677 0.47053 0.71585 0.36716 0.65554 0.45591 0.70215 0.35502 0.75173 0.38091 0.98742 0.49354
nekRS Input: TurboPipe Periodic OpenBenchmarking.org FLOP/s, More Is Better nekRS 22.0 Input: TurboPipe Periodic EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50000M 100000M 150000M 200000M 250000M SE +/- 194054116.16, N = 3 SE +/- 1160248871.77, N = 3 SE +/- 716743639.28, N = 3 SE +/- 130435595.01, N = 3 SE +/- 716358150.65, N = 3 SE +/- 37382408.22, N = 3 SE +/- 603340791.85, N = 3 SE +/- 165905930.51, N = 3 SE +/- 1194804633.03, N = 3 SE +/- 206475987.30, N = 3 SE +/- 233956073.75, N = 3 SE +/- 285712164.79, N = 3 SE +/- 124957326.05, N = 3 166901000000 112350333333 194221666667 128904333333 218603000000 149115333333 170229333333 127809333333 242295666667 117791000000 227635333333 96712533333 190369000000 1. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi
Pennant Test: sedovbig OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: sedovbig EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 10 20 30 40 50 SE +/- 0.053422, N = 3 SE +/- 0.078086, N = 4 SE +/- 0.083410, N = 3 SE +/- 0.029276, N = 4 SE +/- 0.031210, N = 3 SE +/- 0.049248, N = 5 SE +/- 0.049389, N = 3 SE +/- 0.083702, N = 4 SE +/- 0.015982, N = 3 SE +/- 0.024622, N = 3 SE +/- 0.024301, N = 3 SE +/- 0.015004, N = 3 SE +/- 0.018190, N = 3 SE +/- 0.016802, N = 3 26.928070 13.474340 21.419360 10.798510 17.886890 8.761462 15.397170 11.319440 30.869470 19.646200 31.831930 18.266460 41.967620 22.142670 1. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
Pennant Test: leblancbig OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: leblancbig EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.027516, N = 3 SE +/- 0.016342, N = 5 SE +/- 0.066993, N = 4 SE +/- 0.020399, N = 6 SE +/- 0.065044, N = 4 SE +/- 0.022993, N = 6 SE +/- 0.028009, N = 5 SE +/- 0.054440, N = 6 SE +/- 0.017732, N = 4 SE +/- 0.011875, N = 5 SE +/- 0.025498, N = 3 SE +/- 0.022667, N = 5 SE +/- 0.006168, N = 3 SE +/- 0.008469, N = 5 16.692420 7.618046 12.957890 5.976653 10.835750 4.827648 8.575596 6.246704 14.447020 7.347379 15.691820 7.523824 19.493280 9.733065 1. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
NWChem Input: C240 Buckyball OpenBenchmarking.org Seconds, Fewer Is Better NWChem 7.0.2 Input: C240 Buckyball EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1300 2600 3900 5200 6500 5397.8 4463.3 3660.2 3488.4 2799.5 4747.9 3009.9 4925.4 2846.4 6074.2 3643.3 1. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lcomex -lm -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2
Xcompact3d Incompact3d Input: X3D-benchmarking input.i3d OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: X3D-benchmarking input.i3d EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200 400 600 800 1000 SE +/- 0.88, N = 3 SE +/- 0.39, N = 3 SE +/- 5.59, N = 3 SE +/- 9.39, N = 3 SE +/- 0.87, N = 3 SE +/- 0.45, N = 3 SE +/- 1.05, N = 3 SE +/- 0.20, N = 3 SE +/- 0.51, N = 3 SE +/- 0.43, N = 3 SE +/- 9.17, N = 3 SE +/- 3.99, N = 9 SE +/- 0.67, N = 3 SE +/- 0.98, N = 3 880.64 484.99 766.72 700.10 784.80 432.07 716.62 663.83 626.98 357.24 659.15 461.11 889.88 725.35 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi
Xcompact3d Incompact3d Input: input.i3d 193 Cells Per Direction OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 193 Cells Per Direction EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 9 18 27 36 45 SE +/- 0.14, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.28, N = 15 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.42, N = 3 SE +/- 0.19, N = 4 SE +/- 0.08, N = 3 SE +/- 0.44, N = 15 35.56 18.02 32.40 15.69 30.74 15.81 24.11 23.09 33.00 14.69 33.30 16.51 40.55 21.22 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi
OpenRadioss Model: Bumper Beam OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bumper Beam EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.28, N = 3 SE +/- 0.10, N = 3 SE +/- 0.17, N = 3 SE +/- 0.15, N = 3 SE +/- 0.04, N = 3 SE +/- 0.14, N = 3 SE +/- 0.20, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 3 SE +/- 0.32, N = 3 SE +/- 0.04, N = 3 118.30 105.44 96.53 93.97 91.55 111.00 91.34 110.30 85.45 122.43 94.03
OpenRadioss Model: Cell Phone Drop Test OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Cell Phone Drop Test EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.14, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.07, N = 3 SE +/- 0.29, N = 3 SE +/- 0.03, N = 3 66.29 54.23 45.63 41.25 36.39 59.09 37.73 62.82 36.51 74.50 43.84
OpenRadioss Model: Bird Strike on Windshield OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bird Strike on Windshield EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.17, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.12, N = 3 SE +/- 0.30, N = 3 SE +/- 0.23, N = 3 SE +/- 0.08, N = 3 SE +/- 0.20, N = 3 SE +/- 0.20, N = 3 SE +/- 0.06, N = 3 SE +/- 0.16, N = 3 218.07 201.13 186.94 173.03 167.45 207.10 162.88 204.18 155.37 231.85 165.35
OpenRadioss Model: Rubber O-Ring Seal Installation OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.25, N = 3 SE +/- 0.08, N = 3 SE +/- 0.61, N = 3 SE +/- 0.18, N = 3 SE +/- 0.11, N = 3 SE +/- 0.35, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 SE +/- 0.00, N = 3 SE +/- 0.15, N = 3 SE +/- 0.30, N = 3 103.03 88.65 84.32 79.17 89.74 108.37 89.85 107.07 78.89 124.37 83.81
OpenRadioss Model: INIVOL and Fluid Structure Interaction Drop Container OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 80 160 240 320 400 SE +/- 0.61, N = 3 SE +/- 0.90, N = 3 SE +/- 0.35, N = 3 SE +/- 0.19, N = 3 SE +/- 0.28, N = 3 SE +/- 0.39, N = 3 SE +/- 0.22, N = 3 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.47, N = 3 SE +/- 0.59, N = 3 352.52 291.34 245.34 224.14 191.58 287.21 199.83 301.70 179.68 383.74 224.24
LULESH OpenBenchmarking.org z/s, More Is Better LULESH 2.0.3 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 9K 18K 27K 36K 45K SE +/- 24.59, N = 6 SE +/- 149.46, N = 6 SE +/- 25.11, N = 6 SE +/- 276.03, N = 15 SE +/- 101.13, N = 5 SE +/- 90.00, N = 4 SE +/- 138.07, N = 5 SE +/- 29.51, N = 3 SE +/- 85.02, N = 5 SE +/- 13.51, N = 4 SE +/- 26.68, N = 6 SE +/- 38.77, N = 6 SE +/- 11.87, N = 6 SE +/- 40.17, N = 5 10323.18 27713.94 9682.80 25716.77 18098.80 37170.86 21129.41 22242.53 18868.72 39798.69 9964.41 26940.98 10152.76 22099.32 1. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi
LuxCoreRender Scene: DLSC - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: DLSC - Acceleration: CPU EPYC 7343 2P EPYC 7413 2P EPYC 7513 2P 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 15 5.74 7.17 9.12 MIN: 5.6 / MAX: 6.16 MIN: 6.95 / MAX: 7.96 MIN: 8.49 / MAX: 10.09
LuxCoreRender Scene: Danish Mood - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Danish Mood - Acceleration: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 5 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 2.48 4.10 3.33 5.14 4.35 6.43 4.36 6.10 3.47 6.09 3.04 5.84 2.34 4.46 MIN: 0.84 / MAX: 2.91 MIN: 1.58 / MAX: 4.79 MIN: 1.21 / MAX: 3.89 MIN: 1.96 / MAX: 6.18 MIN: 1.68 / MAX: 5.04 MIN: 2.55 / MAX: 7.63 MIN: 1.72 / MAX: 5.07 MIN: 2.45 / MAX: 7.16 MIN: 1.22 / MAX: 4.08 MIN: 2.47 / MAX: 7.28 MIN: 1.09 / MAX: 3.58 MIN: 2.6 / MAX: 6.73 MIN: 0.74 / MAX: 2.79 MIN: 1.83 / MAX: 5.18
LuxCoreRender Scene: Orange Juice - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Orange Juice - Acceleration: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.16, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 5.05 8.59 6.56 11.24 8.18 13.40 8.42 12.44 7.01 12.30 6.46 11.19 5.01 8.77 MIN: 4.74 / MAX: 5.15 MIN: 7.51 / MAX: 9.26 MIN: 5.93 / MAX: 6.83 MIN: 9.76 / MAX: 12.48 MIN: 7.2 / MAX: 8.7 MIN: 11.54 / MAX: 15.77 MIN: 7.45 / MAX: 9.01 MIN: 10.8 / MAX: 14.28 MIN: 6.3 / MAX: 7.56 MIN: 10.28 / MAX: 14.34 MIN: 5.76 / MAX: 7.02 MIN: 9.51 / MAX: 13.26 MIN: 4.73 / MAX: 5.13 MIN: 7.63 / MAX: 9.54
LuxCoreRender Scene: LuxCore Benchmark - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: LuxCore Benchmark - Acceleration: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 15 2.72 4.46 3.68 5.56 4.64 6.75 4.74 6.70 3.67 6.57 3.29 6.16 2.59 4.68 MIN: 0.96 / MAX: 3.2 MIN: 1.61 / MAX: 5.3 MIN: 1.36 / MAX: 4.33 MIN: 1.97 / MAX: 6.64 MIN: 1.79 / MAX: 5.4 MIN: 2.41 / MAX: 8.1 MIN: 1.8 / MAX: 5.56 MIN: 2.57 / MAX: 7.82 MIN: 1.31 / MAX: 4.39 MIN: 2.6 / MAX: 7.71 MIN: 1.23 / MAX: 3.85 MIN: 2.54 / MAX: 7.19 MIN: 0.88 / MAX: 3.07 MIN: 1.67 / MAX: 5.69
LuxCoreRender Scene: Rainbow Colors and Prism - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Rainbow Colors and Prism - Acceleration: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.08, N = 4 SE +/- 0.12, N = 4 SE +/- 0.12, N = 5 SE +/- 0.09, N = 4 SE +/- 0.05, N = 5 SE +/- 0.18, N = 6 SE +/- 0.18, N = 4 SE +/- 0.13, N = 5 SE +/- 0.11, N = 9 SE +/- 0.23, N = 15 SE +/- 0.13, N = 5 SE +/- 0.24, N = 15 SE +/- 0.07, N = 4 SE +/- 0.20, N = 15 12.12 13.03 15.11 15.73 17.44 17.44 16.69 18.73 13.20 11.33 13.77 12.60 11.45 12.05 MIN: 11.11 / MAX: 12.32 MIN: 11.85 / MAX: 13.27 MIN: 13.66 / MAX: 15.57 MIN: 14.3 / MAX: 16.13 MIN: 15.75 / MAX: 17.95 MIN: 15.46 / MAX: 18.02 MIN: 15.03 / MAX: 17.36 MIN: 18.24 / MAX: 19.11 MIN: 11.71 / MAX: 14.29 MIN: 9.36 / MAX: 12.19 MIN: 12.72 / MAX: 14.53 MIN: 10.6 / MAX: 13.91 MIN: 10.45 / MAX: 11.99 MIN: 10.43 / MAX: 13.24
Embree Binary: Pathtracer - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer - Model: Crown EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 14 28 42 56 70 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.13, N = 3 SE +/- 0.05, N = 4 SE +/- 0.02, N = 3 SE +/- 0.22, N = 5 SE +/- 0.04, N = 3 SE +/- 0.16, N = 4 SE +/- 0.08, N = 3 SE +/- 0.05, N = 4 SE +/- 0.01, N = 3 SE +/- 0.06, N = 4 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 21.22 37.75 27.42 49.95 34.18 62.36 37.28 52.75 29.84 58.33 25.35 51.39 19.76 38.90 MIN: 20.8 / MAX: 21.59 MIN: 37.14 / MAX: 38.79 MIN: 26.84 / MAX: 28.27 MIN: 48.86 / MAX: 51.27 MIN: 33.8 / MAX: 34.89 MIN: 60.41 / MAX: 65.16 MIN: 36.31 / MAX: 38.34 MIN: 51.1 / MAX: 58.19 MIN: 29.02 / MAX: 31.34 MIN: 56.72 / MAX: 61.53 MIN: 24.68 / MAX: 28.35 MIN: 49.55 / MAX: 55.56 MIN: 19.56 / MAX: 20.64 MIN: 38.2 / MAX: 40.63
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Crown EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 15 30 45 60 75 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.08, N = 4 SE +/- 0.11, N = 3 SE +/- 0.07, N = 5 SE +/- 0.03, N = 3 SE +/- 0.10, N = 4 SE +/- 0.07, N = 3 SE +/- 0.07, N = 5 SE +/- 0.04, N = 3 SE +/- 0.33, N = 5 SE +/- 0.08, N = 3 SE +/- 0.05, N = 4 20.01 35.49 25.83 46.60 33.14 58.90 35.12 51.68 35.84 69.59 29.17 61.18 23.17 46.27 MIN: 19.68 / MAX: 20.39 MIN: 35 / MAX: 36.16 MIN: 25.36 / MAX: 26.62 MIN: 45.29 / MAX: 47.9 MIN: 32.13 / MAX: 34.24 MIN: 57.6 / MAX: 61.52 MIN: 34.38 / MAX: 36.15 MIN: 48.53 / MAX: 56.01 MIN: 34.73 / MAX: 37.86 MIN: 67.34 / MAX: 73.46 MIN: 28.31 / MAX: 34.1 MIN: 57.63 / MAX: 66.74 MIN: 22.47 / MAX: 25.37 MIN: 45.19 / MAX: 48.79
Embree Binary: Pathtracer - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer - Model: Asian Dragon EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 15 30 45 60 75 SE +/- 0.14, N = 3 SE +/- 0.05, N = 3 SE +/- 0.13, N = 3 SE +/- 0.06, N = 4 SE +/- 0.04, N = 4 SE +/- 0.09, N = 4 SE +/- 0.05, N = 4 SE +/- 0.03, N = 5 SE +/- 0.09, N = 3 SE +/- 0.05, N = 5 SE +/- 0.04, N = 3 SE +/- 0.06, N = 5 SE +/- 0.02, N = 3 SE +/- 0.05, N = 4 23.76 38.97 31.90 48.35 40.21 53.81 41.95 62.57 35.91 67.13 31.01 59.68 23.39 43.51 MIN: 23.41 / MAX: 24.11 MIN: 38.53 / MAX: 40.01 MIN: 31.52 / MAX: 32.65 MIN: 47.63 / MAX: 49.46 MIN: 39.78 / MAX: 40.88 MIN: 52.99 / MAX: 56.35 MIN: 41.57 / MAX: 42.56 MIN: 61.2 / MAX: 64.08 MIN: 34.65 / MAX: 37.75 MIN: 65.98 / MAX: 70.89 MIN: 29.86 / MAX: 33.48 MIN: 58.54 / MAX: 62.25 MIN: 23.25 / MAX: 24.1 MIN: 43 / MAX: 44.91
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Asian Dragon EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 4 SE +/- 0.05, N = 3 SE +/- 0.13, N = 4 SE +/- 0.03, N = 4 SE +/- 0.04, N = 5 SE +/- 0.04, N = 4 SE +/- 0.09, N = 6 SE +/- 0.06, N = 4 SE +/- 0.02, N = 5 SE +/- 0.03, N = 3 SE +/- 0.03, N = 4 23.06 38.01 30.45 46.29 38.35 51.94 40.51 60.10 45.79 84.86 40.98 75.25 29.31 55.41 MIN: 22.91 / MAX: 23.57 MIN: 37.62 / MAX: 38.66 MIN: 30.17 / MAX: 30.93 MIN: 45.68 / MAX: 47.36 MIN: 37.95 / MAX: 38.96 MIN: 50.91 / MAX: 54.47 MIN: 40.15 / MAX: 41.05 MIN: 59.02 / MAX: 61.86 MIN: 45.07 / MAX: 48.58 MIN: 82.99 / MAX: 89.58 MIN: 39.96 / MAX: 43 MIN: 73.81 / MAX: 79.52 MIN: 28.56 / MAX: 31.49 MIN: 54.58 / MAX: 57.85
Kvazaar Video Input: Bosphorus 4K - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Medium EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6 12 18 24 30 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.26, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 14.94 22.50 16.10 23.20 20.33 25.02 21.04 19.03 13.69 17.63 13.17 19.27 12.21 18.39 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Kvazaar Video Input: Bosphorus 4K - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Very Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12 24 36 48 60 SE +/- 0.07, N = 3 SE +/- 0.09, N = 4 SE +/- 0.05, N = 3 SE +/- 0.08, N = 4 SE +/- 0.07, N = 4 SE +/- 0.06, N = 5 SE +/- 0.09, N = 4 SE +/- 0.05, N = 4 SE +/- 0.04, N = 3 SE +/- 0.14, N = 4 SE +/- 0.04, N = 3 SE +/- 0.04, N = 4 SE +/- 0.02, N = 3 SE +/- 0.03, N = 4 32.35 45.86 33.41 48.93 42.32 54.13 43.25 41.59 27.47 36.47 27.03 39.25 26.64 36.84 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Kvazaar Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Super Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 14 28 42 56 70 SE +/- 0.03, N = 4 SE +/- 0.18, N = 5 SE +/- 0.04, N = 4 SE +/- 0.24, N = 5 SE +/- 0.17, N = 5 SE +/- 0.55, N = 5 SE +/- 0.09, N = 5 SE +/- 0.39, N = 15 SE +/- 0.09, N = 3 SE +/- 0.40, N = 15 SE +/- 0.03, N = 3 SE +/- 0.39, N = 4 SE +/- 0.04, N = 3 SE +/- 0.05, N = 4 41.24 57.13 43.02 61.75 52.81 63.53 54.27 50.67 33.71 41.44 34.35 47.49 33.93 45.17 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Kvazaar Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Ultra Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 15 30 45 60 75 SE +/- 0.04, N = 5 SE +/- 0.47, N = 11 SE +/- 0.08, N = 5 SE +/- 0.65, N = 5 SE +/- 0.09, N = 5 SE +/- 0.63, N = 6 SE +/- 0.10, N = 5 SE +/- 0.78, N = 15 SE +/- 0.15, N = 4 SE +/- 0.34, N = 15 SE +/- 0.03, N = 4 SE +/- 0.29, N = 4 SE +/- 0.05, N = 4 SE +/- 0.31, N = 4 53.29 63.34 55.36 64.72 62.27 65.39 63.28 57.99 38.52 43.33 42.41 49.75 42.98 50.50 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 4 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.8503 1.7006 2.5509 3.4012 4.2515 SE +/- 0.012, N = 3 SE +/- 0.010, N = 3 SE +/- 0.016, N = 3 SE +/- 0.031, N = 3 SE +/- 0.011, N = 3 SE +/- 0.006, N = 3 SE +/- 0.007, N = 3 SE +/- 0.017, N = 3 SE +/- 0.013, N = 3 SE +/- 0.015, N = 3 SE +/- 0.013, N = 3 SE +/- 0.025, N = 3 SE +/- 0.017, N = 3 SE +/- 0.023, N = 3 3.444 3.779 3.496 3.510 3.669 3.604 3.635 3.421 3.034 3.049 3.209 3.316 3.070 3.438 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 8 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 16 32 48 64 80 SE +/- 0.11, N = 4 SE +/- 0.28, N = 5 SE +/- 0.10, N = 4 SE +/- 0.67, N = 5 SE +/- 0.12, N = 5 SE +/- 0.38, N = 5 SE +/- 0.30, N = 5 SE +/- 0.27, N = 5 SE +/- 0.22, N = 4 SE +/- 0.54, N = 4 SE +/- 0.24, N = 4 SE +/- 0.42, N = 4 SE +/- 0.23, N = 4 SE +/- 0.17, N = 4 48.38 66.08 58.92 65.95 66.63 71.45 67.15 67.31 56.03 63.10 59.41 68.97 47.12 67.61 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 12 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.47, N = 8 SE +/- 0.36, N = 7 SE +/- 0.80, N = 8 SE +/- 0.76, N = 7 SE +/- 0.86, N = 8 SE +/- 1.43, N = 7 SE +/- 0.47, N = 8 SE +/- 1.31, N = 8 SE +/- 0.49, N = 7 SE +/- 0.71, N = 7 SE +/- 0.50, N = 7 SE +/- 1.23, N = 7 SE +/- 0.44, N = 8 SE +/- 0.70, N = 7 179.07 204.55 210.55 217.43 231.54 217.70 237.13 232.00 194.14 201.07 206.81 213.42 173.29 211.63 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 13 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.40, N = 8 SE +/- 0.41, N = 8 SE +/- 0.31, N = 8 SE +/- 0.58, N = 8 SE +/- 0.62, N = 8 SE +/- 1.18, N = 8 SE +/- 0.51, N = 8 SE +/- 0.85, N = 8 SE +/- 0.37, N = 8 SE +/- 1.06, N = 7 SE +/- 0.47, N = 8 SE +/- 1.17, N = 8 SE +/- 0.40, N = 8 SE +/- 1.08, N = 8 172.16 191.02 195.80 193.78 210.24 193.15 214.39 203.19 176.04 180.92 190.74 200.38 166.79 200.42 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-HEVC Tuning: 1 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-HEVC 1.5.0 Tuning: 1 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 3.79 7.28 4.89 9.18 6.22 11.56 6.69 9.79 4.40 8.25 4.09 7.90 3.11 6.12 1. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt
SVT-HEVC Tuning: 7 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-HEVC 1.5.0 Tuning: 7 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.07, N = 5 SE +/- 0.14, N = 7 SE +/- 0.04, N = 6 SE +/- 0.12, N = 7 SE +/- 0.12, N = 7 SE +/- 0.43, N = 7 SE +/- 0.19, N = 7 SE +/- 0.16, N = 7 SE +/- 0.05, N = 6 SE +/- 0.31, N = 7 SE +/- 0.10, N = 6 SE +/- 0.32, N = 7 SE +/- 0.06, N = 5 SE +/- 0.06, N = 7 71.41 116.56 85.67 136.95 111.95 149.01 119.84 138.52 91.70 128.72 85.66 136.71 65.82 117.26 1. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt
SVT-HEVC Tuning: 10 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-HEVC 1.5.0 Tuning: 10 - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.23, N = 8 SE +/- 1.02, N = 8 SE +/- 0.39, N = 8 SE +/- 1.90, N = 15 SE +/- 0.27, N = 8 SE +/- 2.94, N = 15 SE +/- 0.23, N = 9 SE +/- 0.70, N = 9 SE +/- 0.18, N = 8 SE +/- 0.96, N = 8 SE +/- 0.23, N = 8 SE +/- 1.35, N = 15 SE +/- 0.06, N = 7 SE +/- 1.19, N = 15 143.45 191.99 181.39 208.59 207.54 201.76 219.43 224.80 171.63 176.67 173.16 176.18 134.34 176.86 1. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt
SVT-VP9 Tuning: VMAF Optimized - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-VP9 0.3 Tuning: VMAF Optimized - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.79, N = 6 SE +/- 1.45, N = 15 SE +/- 1.16, N = 8 SE +/- 4.20, N = 15 SE +/- 0.92, N = 15 SE +/- 1.60, N = 15 SE +/- 1.40, N = 15 SE +/- 1.46, N = 15 SE +/- 1.38, N = 15 SE +/- 1.44, N = 15 SE +/- 1.09, N = 15 SE +/- 1.39, N = 15 SE +/- 0.57, N = 6 SE +/- 1.32, N = 6 111.82 152.31 140.28 154.60 161.26 163.58 171.65 172.24 143.42 137.47 141.68 139.88 109.47 141.50 1. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm
SVT-VP9 Tuning: PSNR/SSIM Optimized - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-VP9 0.3 Tuning: PSNR/SSIM Optimized - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.17, N = 7 SE +/- 0.22, N = 7 SE +/- 0.24, N = 7 SE +/- 0.94, N = 6 SE +/- 0.48, N = 7 SE +/- 2.12, N = 15 SE +/- 0.17, N = 7 SE +/- 0.20, N = 7 SE +/- 0.14, N = 7 SE +/- 0.19, N = 5 SE +/- 0.26, N = 7 SE +/- 0.52, N = 6 SE +/- 0.11, N = 6 SE +/- 0.27, N = 7 115.80 158.14 143.85 161.19 164.17 165.46 175.18 179.74 148.73 144.22 148.12 148.45 115.37 150.48 1. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm
SVT-VP9 Tuning: Visual Quality Optimized - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-VP9 0.3 Tuning: Visual Quality Optimized - Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.08, N = 6 SE +/- 0.49, N = 6 SE +/- 0.18, N = 6 SE +/- 0.32, N = 6 SE +/- 0.14, N = 7 SE +/- 0.59, N = 6 SE +/- 0.25, N = 7 SE +/- 0.28, N = 6 SE +/- 0.18, N = 6 SE +/- 0.88, N = 5 SE +/- 0.23, N = 6 SE +/- 0.33, N = 6 SE +/- 0.07, N = 6 SE +/- 0.17, N = 6 83.73 130.23 107.77 145.30 129.22 148.84 137.52 146.48 111.92 131.90 109.31 138.19 83.38 130.49 1. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm
uvg266 Video Input: Bosphorus 4K - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 9.26 14.89 10.54 16.00 13.43 17.26 14.00 13.99 9.76 12.56 9.37 14.22 8.18 13.45
uvg266 Video Input: Bosphorus 4K - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 10.42 16.78 11.87 18.06 15.10 19.59 15.77 15.71 10.88 14.12 10.51 16.00 9.16 15.05
uvg266 Video Input: Bosphorus 1080p - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Slow EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 14 28 42 56 70 SE +/- 0.05, N = 4 SE +/- 0.09, N = 4 SE +/- 0.03, N = 4 SE +/- 0.15, N = 5 SE +/- 0.05, N = 4 SE +/- 0.11, N = 5 SE +/- 0.05, N = 4 SE +/- 0.13, N = 5 SE +/- 0.04, N = 3 SE +/- 0.15, N = 4 SE +/- 0.07, N = 3 SE +/- 0.13, N = 4 SE +/- 0.04, N = 3 SE +/- 0.06, N = 4 38.52 43.92 38.45 59.52 40.52 63.00 41.09 56.07 28.13 44.48 33.02 51.74 33.05 38.43
uvg266 Video Input: Bosphorus 1080p - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Medium EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 16 32 48 64 80 SE +/- 0.16, N = 4 SE +/- 0.08, N = 4 SE +/- 0.09, N = 4 SE +/- 0.08, N = 5 SE +/- 0.04, N = 4 SE +/- 0.19, N = 5 SE +/- 0.10, N = 4 SE +/- 0.19, N = 5 SE +/- 0.02, N = 3 SE +/- 0.08, N = 4 SE +/- 0.02, N = 4 SE +/- 0.14, N = 5 SE +/- 0.04, N = 4 SE +/- 0.09, N = 4 43.11 49.15 43.27 66.47 45.60 70.75 46.14 61.66 31.35 49.39 37.08 57.70 37.00 43.04
uvg266 Video Input: Bosphorus 4K - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12 24 36 48 60 SE +/- 0.06, N = 3 SE +/- 0.13, N = 4 SE +/- 0.08, N = 3 SE +/- 0.11, N = 4 SE +/- 0.07, N = 4 SE +/- 0.15, N = 4 SE +/- 0.03, N = 4 SE +/- 0.08, N = 4 SE +/- 0.03, N = 3 SE +/- 0.11, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 4 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 28.94 41.20 31.30 45.98 39.52 51.05 40.67 42.56 26.79 36.01 26.65 39.03 24.70 35.89
uvg266 Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12 24 36 48 60 SE +/- 0.03, N = 3 SE +/- 0.12, N = 4 SE +/- 0.15, N = 3 SE +/- 0.11, N = 4 SE +/- 0.01, N = 4 SE +/- 0.22, N = 4 SE +/- 0.09, N = 4 SE +/- 0.28, N = 4 SE +/- 0.01, N = 3 SE +/- 0.38, N = 4 SE +/- 0.05, N = 3 SE +/- 0.06, N = 4 SE +/- 0.03, N = 3 SE +/- 0.05, N = 4 30.00 42.95 33.10 48.07 41.46 51.46 42.81 45.49 28.50 37.22 28.82 41.73 26.26 38.46
uvg266 Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12 24 36 48 60 SE +/- 0.07, N = 3 SE +/- 0.07, N = 4 SE +/- 0.08, N = 4 SE +/- 0.34, N = 4 SE +/- 0.06, N = 4 SE +/- 0.28, N = 5 SE +/- 0.10, N = 4 SE +/- 0.27, N = 4 SE +/- 0.01, N = 3 SE +/- 0.48, N = 4 SE +/- 0.03, N = 3 SE +/- 0.18, N = 4 SE +/- 0.05, N = 3 SE +/- 0.03, N = 4 35.28 46.65 38.88 49.77 46.07 53.21 47.24 48.31 31.67 38.92 33.30 44.24 31.03 42.08
uvg266 Video Input: Bosphorus 1080p - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Very Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.15, N = 7 SE +/- 0.22, N = 8 SE +/- 0.17, N = 7 SE +/- 0.70, N = 9 SE +/- 0.17, N = 8 SE +/- 0.87, N = 9 SE +/- 0.17, N = 8 SE +/- 0.24, N = 9 SE +/- 0.05, N = 6 SE +/- 0.79, N = 8 SE +/- 0.07, N = 7 SE +/- 0.51, N = 8 SE +/- 0.10, N = 6 SE +/- 0.07, N = 7 110.98 134.43 118.56 164.25 129.79 173.58 130.26 168.38 87.55 131.93 98.13 150.71 93.17 116.97
uvg266 Video Input: Bosphorus 1080p - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Super Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.23, N = 7 SE +/- 0.15, N = 8 SE +/- 0.15, N = 8 SE +/- 0.48, N = 9 SE +/- 0.09, N = 8 SE +/- 0.59, N = 9 SE +/- 0.17, N = 8 SE +/- 1.30, N = 15 SE +/- 0.13, N = 6 SE +/- 0.62, N = 8 SE +/- 0.06, N = 7 SE +/- 0.61, N = 8 SE +/- 0.08, N = 7 SE +/- 0.15, N = 8 116.79 142.78 125.26 163.18 138.95 173.74 139.65 180.55 94.98 133.13 106.29 152.28 100.87 127.62
uvg266 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.10, N = 8 SE +/- 0.28, N = 8 SE +/- 0.17, N = 8 SE +/- 0.88, N = 9 SE +/- 0.24, N = 8 SE +/- 0.58, N = 9 SE +/- 0.15, N = 8 SE +/- 1.44, N = 9 SE +/- 0.15, N = 7 SE +/- 0.92, N = 8 SE +/- 0.25, N = 7 SE +/- 0.69, N = 8 SE +/- 0.07, N = 7 SE +/- 0.20, N = 8 130.30 155.33 138.79 165.33 153.97 175.35 154.38 196.33 105.96 136.60 118.47 155.38 113.18 139.86
VVenC Video Input: Bosphorus 4K - Video Preset: Fast OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1.1023 2.2046 3.3069 4.4092 5.5115 SE +/- 0.006, N = 3 SE +/- 0.005, N = 3 SE +/- 0.011, N = 3 SE +/- 0.018, N = 3 SE +/- 0.008, N = 3 SE +/- 0.021, N = 3 SE +/- 0.007, N = 3 SE +/- 0.010, N = 3 SE +/- 0.005, N = 3 SE +/- 0.003, N = 3 SE +/- 0.004, N = 3 SE +/- 0.014, N = 3 SE +/- 0.005, N = 3 SE +/- 0.008, N = 3 4.310 4.899 4.415 4.658 4.582 4.688 4.724 4.455 3.776 4.045 4.093 4.393 3.862 4.417 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
VVenC Video Input: Bosphorus 4K - Video Preset: Faster OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Faster EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.024, N = 3 SE +/- 0.069, N = 3 SE +/- 0.011, N = 3 SE +/- 0.066, N = 3 SE +/- 0.005, N = 3 SE +/- 0.032, N = 3 SE +/- 0.013, N = 3 SE +/- 0.013, N = 3 SE +/- 0.012, N = 3 SE +/- 0.036, N = 3 SE +/- 0.010, N = 3 SE +/- 0.007, N = 3 SE +/- 0.002, N = 3 SE +/- 0.011, N = 3 9.370 10.051 9.431 9.526 9.736 9.445 9.984 9.110 7.981 8.128 8.830 8.908 8.552 8.929 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
VVenC Video Input: Bosphorus 1080p - Video Preset: Fast OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Fast EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.023, N = 3 SE +/- 0.025, N = 3 SE +/- 0.021, N = 3 SE +/- 0.008, N = 3 SE +/- 0.009, N = 3 SE +/- 0.008, N = 3 SE +/- 0.008, N = 3 SE +/- 0.010, N = 3 SE +/- 0.015, N = 3 SE +/- 0.021, N = 3 SE +/- 0.012, N = 3 SE +/- 0.009, N = 3 SE +/- 0.004, N = 3 SE +/- 0.019, N = 3 10.496 11.054 10.188 10.393 10.350 10.329 10.555 9.553 8.394 8.721 9.153 9.430 9.107 9.609 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
VVenC Video Input: Bosphorus 1080p - Video Preset: Faster OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Faster EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6 12 18 24 30 SE +/- 0.04, N = 3 SE +/- 0.27, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.29, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 25.09 24.19 24.36 23.35 24.71 22.96 24.84 22.51 20.15 20.64 22.27 22.27 22.23 22.16 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
x265 Video Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better x265 3.4 Video Input: Bosphorus 4K EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 7 14 21 28 35 SE +/- 0.02, N = 3 SE +/- 0.17, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.29, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 SE +/- 0.13, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 24.86 23.06 27.01 22.13 28.24 22.65 27.63 27.16 25.70 24.42 27.77 25.54 24.96 25.04 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
Timed Apache Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Apache Compilation 2.4.41 Time To Compile EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 17.70 18.22 18.99 21.00 18.86 19.70 18.83 20.39 22.42 22.11 20.24 20.06 19.68 19.45
Timed Gem5 Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Gem5 Compilation 21.2 Time To Compile EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60 120 180 240 300 SE +/- 0.29, N = 3 SE +/- 0.06, N = 3 SE +/- 1.70, N = 12 SE +/- 1.47, N = 12 SE +/- 1.75, N = 3 SE +/- 3.04, N = 4 SE +/- 0.86, N = 3 SE +/- 0.19, N = 3 SE +/- 1.87, N = 6 SE +/- 0.04, N = 3 SE +/- 1.48, N = 3 267.88 229.60 210.64 198.43 190.76 244.25 199.49 244.57 190.65 289.72 200.96
Timed Godot Game Engine Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Godot Game Engine Compilation 3.2.3 Time To Compile EPYC 7343 EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.25, N = 3 SE +/- 0.05, N = 3 SE +/- 0.15, N = 3 SE +/- 0.11, N = 3 SE +/- 0.14, N = 3 74.95 64.73 57.58 55.11 50.80 69.24 54.70 70.29 51.93 83.06 56.72
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build: defconfig EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 15 30 45 60 75 SE +/- 0.47, N = 3 SE +/- 0.47, N = 3 SE +/- 0.50, N = 3 SE +/- 0.36, N = 5 SE +/- 0.51, N = 3 SE +/- 0.32, N = 5 SE +/- 0.50, N = 3 SE +/- 0.34, N = 6 SE +/- 0.61, N = 3 SE +/- 0.37, N = 5 SE +/- 0.56, N = 3 SE +/- 0.34, N = 5 SE +/- 0.52, N = 3 SE +/- 0.54, N = 3 63.49 38.97 52.72 33.82 44.75 29.78 42.09 33.75 51.84 33.04 55.49 33.79 67.65 40.40
Timed LLVM Compilation Build System: Ninja OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 13.0 Build System: Ninja EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 80 160 240 320 400 SE +/- 0.08, N = 3 SE +/- 0.24, N = 3 SE +/- 0.09, N = 3 SE +/- 0.67, N = 3 SE +/- 0.43, N = 3 SE +/- 0.09, N = 3 SE +/- 0.16, N = 3 SE +/- 0.16, N = 3 SE +/- 0.32, N = 3 SE +/- 0.33, N = 3 SE +/- 0.11, N = 3 SE +/- 0.64, N = 3 SE +/- 0.12, N = 3 SE +/- 0.24, N = 3 347.36 190.97 275.25 161.53 230.69 140.28 212.30 163.54 268.94 160.40 292.73 166.31 373.68 204.23
Timed LLVM Compilation Build System: Unix Makefiles OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 13.0 Build System: Unix Makefiles EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 90 180 270 360 450 SE +/- 1.84, N = 3 SE +/- 3.14, N = 3 SE +/- 3.55, N = 5 SE +/- 0.83, N = 3 SE +/- 1.45, N = 3 SE +/- 1.00, N = 3 SE +/- 2.17, N = 9 SE +/- 0.36, N = 3 SE +/- 1.83, N = 3 SE +/- 0.66, N = 3 SE +/- 2.99, N = 3 SE +/- 1.05, N = 3 SE +/- 3.03, N = 3 SE +/- 2.63, N = 5 392.19 240.49 320.94 216.18 282.42 199.58 260.91 225.70 323.07 227.37 346.26 220.50 421.49 256.36
Timed Node.js Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 18.8 Time To Compile EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 80 160 240 320 400 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.25, N = 3 SE +/- 0.52, N = 3 SE +/- 0.19, N = 3 SE +/- 0.62, N = 3 SE +/- 0.36, N = 3 SE +/- 0.38, N = 3 SE +/- 0.06, N = 3 SE +/- 0.55, N = 3 SE +/- 0.37, N = 3 SE +/- 0.41, N = 3 337.22 191.00 270.84 165.47 226.63 143.60 209.94 166.99 272.73 168.43 295.59 175.01 374.17 209.37
oneDNN Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.6001 1.2002 1.8003 2.4004 3.0005 SE +/- 0.013668, N = 4 SE +/- 0.014584, N = 9 SE +/- 0.084917, N = 15 SE +/- 0.030750, N = 15 SE +/- 0.151936, N = 15 SE +/- 0.019283, N = 15 SE +/- 0.089162, N = 15 SE +/- 0.015644, N = 4 SE +/- 0.084321, N = 15 SE +/- 0.007581, N = 4 SE +/- 0.023972, N = 12 SE +/- 0.006714, N = 4 SE +/- 0.025234, N = 15 1.661420 1.752520 2.197500 1.594450 2.666980 1.494980 2.046400 1.395210 1.664430 1.476490 1.088780 1.694700 1.178640 MIN: 1.24 MIN: 1.5 MIN: 1.4 MIN: 1.3 MIN: 1.38 MIN: 1.25 MIN: 1.33 MIN: 1.18 MIN: 1.04 MIN: 1.22 MIN: 0.84 MIN: 1.42 MIN: 0.89 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.9598 1.9196 2.8794 3.8392 4.799 SE +/- 0.02810, N = 5 SE +/- 0.00276, N = 5 SE +/- 0.02328, N = 5 SE +/- 0.01307, N = 5 SE +/- 0.03491, N = 15 SE +/- 0.00978, N = 5 SE +/- 0.01496, N = 5 SE +/- 0.01676, N = 6 SE +/- 0.02635, N = 15 SE +/- 0.01211, N = 5 SE +/- 0.02380, N = 15 SE +/- 0.01253, N = 5 SE +/- 0.01988, N = 7 3.09624 2.79700 4.00035 3.63115 4.26599 2.02266 3.78466 1.64248 2.40282 1.66931 2.39962 1.84770 2.21782 MIN: 2.38 MIN: 2.65 MIN: 3.18 MIN: 3.48 MIN: 3.76 MIN: 1.82 MIN: 3.41 MIN: 1.54 MIN: 2.02 MIN: 1.57 MIN: 2.1 MIN: 1.71 MIN: 2.07 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1.0084 2.0168 3.0252 4.0336 5.042 SE +/- 0.07340, N = 15 SE +/- 0.05784, N = 15 SE +/- 0.02674, N = 4 SE +/- 0.04593, N = 15 SE +/- 0.01308, N = 4 SE +/- 0.10360, N = 12 3.34833 3.67592 4.48183 3.97631 4.20681 3.01823 MIN: 2.87 MIN: 2.72 MIN: 4.14 MIN: 3.34 MIN: 4.02 MIN: 2.29 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.5467 1.0934 1.6401 2.1868 2.7335 SE +/- 0.01302, N = 5 SE +/- 0.04314, N = 12 SE +/- 0.00547, N = 5 SE +/- 0.02225, N = 15 SE +/- 0.00397, N = 5 SE +/- 0.02196, N = 12 1.81562 1.88632 2.22071 2.42969 1.80606 1.62390 MIN: 1.43 MIN: 1.28 MIN: 1.86 MIN: 1.94 MIN: 1.69 MIN: 1.37 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.7518 1.5036 2.2554 3.0072 3.759 SE +/- 0.003169, N = 7 SE +/- 0.003897, N = 7 SE +/- 0.001690, N = 7 SE +/- 0.002206, N = 7 SE +/- 0.004296, N = 7 SE +/- 0.001763, N = 7 SE +/- 0.000877, N = 7 SE +/- 0.007172, N = 7 SE +/- 0.018972, N = 10 SE +/- 0.009698, N = 7 SE +/- 0.026790, N = 7 SE +/- 0.003371, N = 7 SE +/- 0.028591, N = 15 1.188400 2.137310 0.940455 1.950160 0.786803 1.301380 0.937918 1.711290 2.466270 1.821900 2.993400 1.942000 3.341250 MIN: 0.94 MIN: 1.86 MIN: 0.75 MIN: 1.75 MIN: 0.68 MIN: 1.15 MIN: 0.87 MIN: 1.58 MIN: 2.29 MIN: 1.68 MIN: 2.81 MIN: 1.73 MIN: 3.07 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.06890, N = 5 SE +/- 0.03643, N = 15 SE +/- 0.09795, N = 3 SE +/- 0.01665, N = 3 SE +/- 0.02793, N = 3 SE +/- 0.01466, N = 3 SE +/- 0.03340, N = 3 SE +/- 0.04992, N = 3 SE +/- 0.03026, N = 3 SE +/- 0.00667, N = 3 SE +/- 0.06310, N = 3 SE +/- 0.00784, N = 3 SE +/- 0.00229, N = 3 6.26194 4.70749 7.89700 4.64782 10.00962 4.86899 6.94903 4.48936 6.56164 3.28994 4.76230 3.77644 3.69104 MIN: 4.39 MIN: 3.51 MIN: 6.4 MIN: 3.7 MIN: 7.97 MIN: 3.71 MIN: 4.75 MIN: 3.05 MIN: 5.75 MIN: 2.86 MIN: 3.24 MIN: 3.04 MIN: 3.12 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.7381 1.4762 2.2143 2.9524 3.6905 SE +/- 0.00873, N = 9 SE +/- 0.00656, N = 9 SE +/- 0.00706, N = 9 SE +/- 0.00505, N = 9 SE +/- 0.01467, N = 15 SE +/- 0.00439, N = 9 SE +/- 0.02517, N = 15 SE +/- 0.00280, N = 9 SE +/- 0.00134, N = 9 SE +/- 0.00359, N = 9 SE +/- 0.00211, N = 9 SE +/- 0.01627, N = 9 SE +/- 0.00228, N = 9 2.82788 3.28030 1.88334 3.17840 2.04048 2.98900 3.25137 1.92380 1.14313 1.99051 1.15641 2.62403 1.37242 MIN: 2.42 MIN: 2.8 MIN: 1.51 MIN: 2.9 MIN: 1.66 MIN: 2.73 MIN: 1.97 MIN: 1.66 MIN: 1.04 MIN: 1.71 MIN: 0.96 MIN: 2.27 MIN: 1.2 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1100 2200 3300 4400 5500 SE +/- 10.84, N = 3 SE +/- 10.97, N = 3 SE +/- 26.23, N = 3 SE +/- 21.33, N = 15 SE +/- 16.16, N = 3 SE +/- 4.18, N = 3 SE +/- 24.77, N = 3 SE +/- 2.55, N = 3 SE +/- 7.95, N = 4 SE +/- 8.94, N = 3 SE +/- 2.77, N = 3 SE +/- 4.00, N = 3 SE +/- 5.21, N = 3 2958.98 1797.92 2774.02 1957.83 5074.57 1974.31 2720.07 901.44 681.16 1086.78 703.51 1289.58 702.69 MIN: 2682.11 MIN: 1725.59 MIN: 2185.12 MIN: 1702.97 MIN: 4606.82 MIN: 1898.4 MIN: 2539.45 MIN: 839.85 MIN: 629.82 MIN: 977.32 MIN: 667.26 MIN: 1210.65 MIN: 661.24 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 400 800 1200 1600 2000 SE +/- 16.64, N = 3 SE +/- 6.23, N = 3 SE +/- 15.21, N = 15 SE +/- 9.52, N = 3 SE +/- 20.35, N = 15 SE +/- 6.02, N = 3 SE +/- 6.16, N = 3 SE +/- 1.92, N = 3 SE +/- 5.30, N = 3 SE +/- 4.35, N = 15 SE +/- 4.97, N = 3 SE +/- 3.31, N = 3 SE +/- 3.56, N = 3 1837.89 1070.14 1604.83 1109.99 1606.42 1106.75 1183.30 521.57 472.89 642.83 430.60 722.17 413.29 MIN: 1460.53 MIN: 1010.54 MIN: 1222.24 MIN: 1036.06 MIN: 1227.37 MIN: 1032.76 MIN: 1108.19 MIN: 489.81 MIN: 446.12 MIN: 575.4 MIN: 402.38 MIN: 673.5 MIN: 389.55 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2 4 6 8 10 SE +/- 0.01186, N = 7 SE +/- 0.00326, N = 7 SE +/- 0.02123, N = 7 SE +/- 0.00414, N = 7 SE +/- 0.00522, N = 7 SE +/- 0.00127, N = 7 5.74487 2.92655 6.03750 3.10763 8.24165 4.23272 MIN: 5.58 MIN: 2.88 MIN: 5.8 MIN: 3.01 MIN: 8.12 MIN: 4.15 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.01350, N = 3 SE +/- 0.00935, N = 3 SE +/- 0.04067, N = 3 SE +/- 0.04874, N = 3 SE +/- 0.01258, N = 3 SE +/- 0.00555, N = 3 7.86162 4.33315 8.61404 4.66619 11.41520 5.86134 MIN: 7.58 MIN: 4.14 MIN: 8.14 MIN: 4.34 MIN: 11.11 MIN: 5.72 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.01476, N = 9 SE +/- 0.00722, N = 9 SE +/- 0.00908, N = 9 SE +/- 0.00319, N = 9 SE +/- 0.00399, N = 9 SE +/- 0.00667, N = 9 7.88371 5.02585 8.29712 4.24724 11.43990 5.92201 MIN: 7.66 MIN: 4.84 MIN: 8.01 MIN: 4.13 MIN: 11.21 MIN: 5.79 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.837375, N = 15 SE +/- 0.206028, N = 15 SE +/- 1.007343, N = 15 SE +/- 0.393240, N = 12 SE +/- 1.169116, N = 15 SE +/- 0.559435, N = 15 SE +/- 0.912376, N = 12 SE +/- 0.001079, N = 4 SE +/- 0.001294, N = 4 SE +/- 0.002543, N = 4 SE +/- 0.000460, N = 4 SE +/- 0.004663, N = 4 SE +/- 0.001288, N = 4 8.358690 2.354380 9.130000 2.323020 12.287940 4.318590 6.486810 0.521446 0.255235 0.587102 0.255585 0.806671 0.394611 MIN: 2.64 MIN: 1.2 MIN: 3.45 MIN: 1.19 MIN: 4.19 MIN: 1.39 MIN: 2.12 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1100 2200 3300 4400 5500 SE +/- 18.38, N = 3 SE +/- 2.38, N = 3 SE +/- 39.18, N = 3 SE +/- 9.33, N = 3 SE +/- 37.47, N = 15 SE +/- 14.60, N = 3 SE +/- 26.36, N = 15 SE +/- 2.21, N = 3 SE +/- 7.44, N = 5 SE +/- 8.46, N = 3 SE +/- 5.69, N = 3 SE +/- 3.49, N = 3 SE +/- 2.28, N = 3 2900.06 1795.39 2840.00 1975.47 5033.87 1989.75 2712.50 907.29 690.75 1076.71 703.72 1294.14 701.32 MIN: 2610.36 MIN: 1733.94 MIN: 2260.17 MIN: 1894.9 MIN: 4268.26 MIN: 1902.82 MIN: 2373.24 MIN: 846.78 MIN: 635.03 MIN: 974.49 MIN: 663.96 MIN: 1216.99 MIN: 665.02 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 400 800 1200 1600 2000 SE +/- 7.96, N = 3 SE +/- 4.33, N = 3 SE +/- 19.63, N = 3 SE +/- 7.84, N = 3 SE +/- 14.95, N = 15 SE +/- 8.28, N = 3 SE +/- 13.60, N = 3 SE +/- 0.27, N = 3 SE +/- 3.44, N = 15 SE +/- 3.92, N = 3 SE +/- 6.32, N = 3 SE +/- 2.43, N = 3 SE +/- 1.64, N = 3 1754.12 1073.72 1602.68 1124.53 1615.13 1092.81 1186.00 520.56 457.95 638.13 442.01 717.81 416.42 MIN: 1418.92 MIN: 1016.27 MIN: 1268.13 MIN: 1050.25 MIN: 1226.35 MIN: 1014.43 MIN: 1109.52 MIN: 491.07 MIN: 415.28 MIN: 586.68 MIN: 414.92 MIN: 671.06 MIN: 392.54 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.29445, N = 15 SE +/- 0.76540, N = 12 SE +/- 0.24995, N = 12 SE +/- 0.45466, N = 15 SE +/- 0.12995, N = 12 SE +/- 0.39591, N = 12 3.88765 10.56278 2.80481 6.98945 2.21622 5.50135 MIN: 2 MIN: 4.94 MIN: 1.46 MIN: 3.99 MIN: 1.72 MIN: 3.49 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1500 3000 4500 6000 7500 SE +/- 30.83, N = 3 SE +/- 15.06, N = 3 SE +/- 10.48, N = 3 SE +/- 4.18, N = 3 SE +/- 19.73, N = 3 SE +/- 0.33, N = 3 SE +/- 5.24, N = 3 SE +/- 2.96, N = 3 SE +/- 17.29, N = 3 SE +/- 10.00, N = 3 SE +/- 6.57, N = 3 SE +/- 3.18, N = 3 SE +/- 34.35, N = 3 SE +/- 7.69, N = 3 6805 3628 5121 2722 4014 2150 3767 2424 3314 1641 3769 1956 5199 2534 1. (CXX) g++ options: -O3 -lm -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2K 4K 6K 8K 10K SE +/- 14.64, N = 3 SE +/- 5.04, N = 3 SE +/- 17.21, N = 3 SE +/- 6.98, N = 3 SE +/- 22.62, N = 3 SE +/- 12.06, N = 3 SE +/- 6.51, N = 3 SE +/- 8.33, N = 3 SE +/- 15.01, N = 3 SE +/- 0.88, N = 3 SE +/- 16.80, N = 3 SE +/- 11.06, N = 3 SE +/- 7.21, N = 3 SE +/- 12.78, N = 3 8172 4336 6067 3252 4769 2538 4486 2874 3967 1979 4621 2330 6321 3001 1. (CXX) g++ options: -O3 -lm -ldl
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50K 100K 150K 200K 250K SE +/- 1066.52, N = 3 SE +/- 322.54, N = 3 SE +/- 660.98, N = 3 SE +/- 593.91, N = 3 SE +/- 22.36, N = 3 SE +/- 95.38, N = 3 SE +/- 100.17, N = 3 SE +/- 129.50, N = 3 SE +/- 153.33, N = 3 SE +/- 247.04, N = 3 SE +/- 380.50, N = 3 SE +/- 130.77, N = 3 SE +/- 433.96, N = 3 SE +/- 405.08, N = 3 224298 120264 170190 93834 135636 74566 127078 84001 113149 52646 127865 67775 171646 87290 1. (CXX) g++ options: -O3 -lm -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60K 120K 180K 240K 300K SE +/- 981.14, N = 3 SE +/- 359.93, N = 3 SE +/- 1060.89, N = 3 SE +/- 865.73, N = 3 SE +/- 453.13, N = 3 SE +/- 337.67, N = 3 SE +/- 601.99, N = 3 SE +/- 89.37, N = 3 SE +/- 384.33, N = 3 SE +/- 150.12, N = 3 SE +/- 873.63, N = 3 SE +/- 207.56, N = 3 SE +/- 339.77, N = 3 SE +/- 152.22, N = 3 265238 142611 200057 110558 159097 86704 148990 98653 133650 69538 152061 80780 207128 103047 1. (CXX) g++ options: -O3 -lm -ldl
FFmpeg Encoder: libx264 - Scenario: Live OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Live EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 7 14 21 28 35 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 23.18 23.41 24.88 25.24 24.35 24.46 23.86 24.20 28.24 29.14 26.07 27.09 24.99 26.04 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Live OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Live EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.23, N = 3 SE +/- 0.15, N = 3 SE +/- 0.51, N = 3 SE +/- 0.49, N = 3 SE +/- 0.18, N = 3 SE +/- 0.23, N = 3 SE +/- 0.09, N = 3 SE +/- 0.14, N = 3 SE +/- 0.25, N = 3 SE +/- 0.46, N = 3 SE +/- 0.19, N = 3 SE +/- 0.18, N = 3 SE +/- 0.19, N = 3 SE +/- 0.30, N = 3 217.86 215.69 202.95 200.05 207.35 206.46 211.67 208.64 178.82 173.30 193.69 186.41 202.08 193.90 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Live OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Live EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12 24 36 48 60 SE +/- 0.17, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.24, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.14, N = 3 SE +/- 0.06, N = 3 40.81 48.59 43.08 51.34 42.56 49.98 44.47 47.87 44.77 45.25 41.27 41.71 40.58 41.42 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Live OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Live EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.52, N = 3 SE +/- 0.09, N = 3 SE +/- 0.19, N = 3 SE +/- 0.17, N = 3 SE +/- 0.16, N = 3 SE +/- 0.48, N = 3 SE +/- 0.11, N = 3 SE +/- 0.21, N = 3 SE +/- 0.10, N = 3 SE +/- 0.13, N = 3 SE +/- 0.10, N = 3 SE +/- 0.21, N = 3 SE +/- 0.44, N = 3 SE +/- 0.19, N = 3 123.76 103.93 117.23 98.37 118.65 101.05 113.57 105.50 112.80 111.60 122.36 121.08 124.46 121.92 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Upload OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Upload EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.28, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.21, N = 3 SE +/- 0.12, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.08, N = 3 SE +/- 0.09, N = 3 SE +/- 0.21, N = 3 SE +/- 0.05, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.15, N = 3 199.10 198.24 214.55 215.59 211.01 210.67 210.02 210.12 247.39 250.35 227.36 230.44 216.38 219.39 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Upload OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Upload EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 12.68 12.74 11.77 11.71 11.97 11.99 12.02 12.02 10.21 10.09 11.11 10.96 11.67 11.51 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Upload OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Upload EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.07, N = 3 SE +/- 0.20, N = 3 SE +/- 0.07, N = 3 SE +/- 0.13, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 3 SE +/- 0.30, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.25, N = 3 SE +/- 0.22, N = 3 103.96 107.19 108.80 114.41 108.16 113.72 107.90 118.46 122.64 120.86 113.70 111.87 113.29 110.71 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Upload OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Upload EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6 12 18 24 30 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 24.29 23.56 23.21 22.07 23.35 22.20 23.40 21.32 20.59 20.89 22.21 22.57 22.29 22.81 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Platform OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Platform EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.15, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.14, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.42, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.09, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.14, N = 3 SE +/- 0.08, N = 3 155.46 155.38 166.90 169.02 164.12 164.38 162.71 163.38 192.02 195.55 176.95 181.25 168.80 173.16 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Platform OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Platform EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 11 22 33 44 55 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.12, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 48.73 48.75 45.39 44.82 46.16 46.08 46.55 46.36 39.45 38.74 42.81 41.79 44.87 43.75 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Platform OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Platform EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.09, N = 3 SE +/- 0.17, N = 3 SE +/- 0.12, N = 3 SE +/- 0.14, N = 3 SE +/- 0.05, N = 3 SE +/- 0.19, N = 3 SE +/- 0.06, N = 3 SE +/- 0.19, N = 3 SE +/- 0.09, N = 3 SE +/- 0.23, N = 3 SE +/- 0.27, N = 3 SE +/- 0.11, N = 3 SE +/- 0.16, N = 3 SE +/- 0.36, N = 3 151.85 162.34 159.89 172.96 159.12 171.41 158.24 174.39 180.71 180.82 167.86 167.16 165.89 164.33 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Platform OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Platform EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 11 22 33 44 55 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 49.89 46.66 47.38 43.80 47.61 44.19 47.87 43.44 41.92 41.89 45.13 45.31 45.66 46.10 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Video On Demand OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Video On Demand EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.18, N = 3 SE +/- 0.08, N = 3 SE +/- 0.34, N = 3 SE +/- 0.22, N = 3 SE +/- 0.22, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.17, N = 3 SE +/- 0.18, N = 3 SE +/- 0.02, N = 3 SE +/- 0.13, N = 3 SE +/- 0.23, N = 3 155.37 155.42 167.10 168.57 164.52 164.86 162.21 163.44 192.08 196.03 177.11 181.28 169.00 173.17 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx264 - Scenario: Video On Demand OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Video On Demand EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 11 22 33 44 55 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 48.75 48.74 45.33 44.94 46.04 45.95 46.70 46.35 39.44 38.64 42.77 41.79 44.82 43.74 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Video On Demand OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Video On Demand EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.16, N = 3 SE +/- 0.38, N = 3 SE +/- 0.13, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.58, N = 3 SE +/- 0.13, N = 3 SE +/- 0.04, N = 3 SE +/- 0.24, N = 3 SE +/- 0.22, N = 3 SE +/- 0.33, N = 3 SE +/- 0.17, N = 3 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 152.05 161.72 160.13 172.81 158.71 171.53 158.41 174.28 180.03 181.97 167.31 167.66 166.43 165.06 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
FFmpeg Encoder: libx265 - Scenario: Video On Demand OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Video On Demand EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 11 22 33 44 55 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 49.82 46.84 47.31 43.84 47.73 44.16 47.82 43.46 42.08 41.63 45.28 45.18 45.51 45.89 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl
OpenSSL Algorithm: SHA256 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.0 Algorithm: SHA256 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20000M 40000M 60000M 80000M 100000M SE +/- 29163674.08, N = 3 SE +/- 24582365.01, N = 3 SE +/- 27629858.10, N = 3 SE +/- 54030773.40, N = 3 SE +/- 68531235.70, N = 3 SE +/- 316349484.45, N = 3 SE +/- 186860140.69, N = 3 SE +/- 8398498.36, N = 3 SE +/- 10848440.04, N = 3 SE +/- 10952442.61, N = 3 SE +/- 11924426.00, N = 3 SE +/- 3033485.03, N = 3 SE +/- 9109685.37, N = 3 SE +/- 1989217.69, N = 3 24891101267 49694000047 33095407800 66206231957 42284954430 84365767223 44324823090 69715833097 20888915973 42653381293 20256398000 40355102327 14614638730 29415210430 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenSSL Algorithm: RSA4096 OpenBenchmarking.org sign/s, More Is Better OpenSSL 3.0 Algorithm: RSA4096 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3K 6K 9K 12K 15K SE +/- 3.48, N = 3 SE +/- 5.12, N = 3 SE +/- 0.09, N = 3 SE +/- 9.47, N = 3 SE +/- 5.98, N = 3 SE +/- 12.10, N = 3 SE +/- 7.21, N = 3 SE +/- 10.29, N = 3 SE +/- 0.27, N = 3 SE +/- 0.24, N = 3 SE +/- 13.25, N = 3 SE +/- 5.32, N = 3 SE +/- 0.18, N = 3 SE +/- 0.90, N = 3 4398.6 8794.6 5947.9 11846.8 7637.8 15222.3 7963.1 12568.1 6442.7 12874.9 6109.7 12235.1 4397.2 8906.1 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenSSL Algorithm: RSA4096 OpenBenchmarking.org verify/s, More Is Better OpenSSL 3.0 Algorithm: RSA4096 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200K 400K 600K 800K 1000K SE +/- 27.40, N = 3 SE +/- 36.78, N = 3 SE +/- 51.25, N = 3 SE +/- 52.75, N = 3 SE +/- 556.85, N = 3 SE +/- 55.88, N = 3 SE +/- 34.51, N = 3 SE +/- 53.07, N = 3 SE +/- 41.22, N = 3 SE +/- 40.84, N = 3 SE +/- 54.53, N = 3 SE +/- 292.45, N = 3 SE +/- 83.11, N = 3 SE +/- 232.08, N = 3 287549.0 574456.9 390326.3 778483.0 501938.9 1003089.4 522787.3 823388.7 419447.9 838351.8 398769.3 798077.1 286703.7 580306.3 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
ClickHouse 100M Rows Hits Dataset, First Run / Cold Cache OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 90 180 270 360 450 SE +/- 2.07, N = 3 SE +/- 2.96, N = 3 SE +/- 1.47, N = 3 SE +/- 0.97, N = 3 SE +/- 3.29, N = 3 SE +/- 2.43, N = 3 SE +/- 1.20, N = 3 SE +/- 3.48, N = 3 SE +/- 1.98, N = 3 SE +/- 2.01, N = 3 SE +/- 3.58, N = 3 SE +/- 1.29, N = 3 SE +/- 0.53, N = 3 SE +/- 9.20, N = 12 336.88 423.79 351.34 429.39 362.00 412.09 410.64 365.79 311.11 388.39 312.11 411.38 283.16 360.92 MIN: 13.48 / MAX: 7500 MIN: 23.78 / MAX: 4285.71 MIN: 17.17 / MAX: 6666.67 MIN: 31.35 / MAX: 5000 MIN: 21.03 / MAX: 6000 MIN: 34.8 / MAX: 4000 MIN: 22.56 / MAX: 6666.67 MIN: 31.86 / MAX: 5454.55 MIN: 15.86 / MAX: 5454.55 MIN: 29.17 / MAX: 5454.55 MIN: 14.74 / MAX: 6666.67 MIN: 28.04 / MAX: 5000 MIN: 10.81 / MAX: 6666.67 MIN: 20.41 / MAX: 6000
ClickHouse 100M Rows Hits Dataset, Second Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 100 200 300 400 500 SE +/- 3.50, N = 3 SE +/- 1.63, N = 3 SE +/- 2.06, N = 3 SE +/- 7.88, N = 3 SE +/- 1.23, N = 3 SE +/- 2.78, N = 3 SE +/- 0.54, N = 3 SE +/- 3.18, N = 3 SE +/- 2.19, N = 3 SE +/- 5.74, N = 3 SE +/- 3.16, N = 3 SE +/- 2.05, N = 3 SE +/- 1.01, N = 3 SE +/- 9.42, N = 12 346.00 443.07 363.28 437.50 377.03 436.77 425.45 375.36 325.13 405.08 321.66 433.55 294.82 378.61 MIN: 13.53 / MAX: 7500 MIN: 23.91 / MAX: 5454.55 MIN: 17.19 / MAX: 7500 MIN: 31.66 / MAX: 5000 MIN: 21.37 / MAX: 6666.67 MIN: 35.19 / MAX: 5454.55 MIN: 22.68 / MAX: 6666.67 MIN: 32 / MAX: 6000 MIN: 15.85 / MAX: 5454.55 MIN: 29.11 / MAX: 5000 MIN: 14.82 / MAX: 6666.67 MIN: 28.48 / MAX: 6000 MIN: 10.95 / MAX: 7500 MIN: 20.51 / MAX: 6666.67
ClickHouse 100M Rows Hits Dataset, Third Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 100 200 300 400 500 SE +/- 1.99, N = 3 SE +/- 1.18, N = 3 SE +/- 2.07, N = 3 SE +/- 5.82, N = 3 SE +/- 2.21, N = 3 SE +/- 2.98, N = 3 SE +/- 0.23, N = 3 SE +/- 1.15, N = 3 SE +/- 1.64, N = 3 SE +/- 4.19, N = 3 SE +/- 1.90, N = 3 SE +/- 3.32, N = 3 SE +/- 1.18, N = 3 SE +/- 9.11, N = 12 345.53 443.72 360.64 440.92 379.67 435.85 425.48 380.10 325.93 407.09 325.08 425.45 295.42 379.26 MIN: 13.57 / MAX: 7500 MIN: 24.16 / MAX: 6000 MIN: 17.17 / MAX: 6666.67 MIN: 31.68 / MAX: 4615.38 MIN: 21.33 / MAX: 6666.67 MIN: 35.71 / MAX: 4615.38 MIN: 22.74 / MAX: 6000 MIN: 31.95 / MAX: 6000 MIN: 15.81 / MAX: 6000 MIN: 29.41 / MAX: 5454.55 MIN: 14.7 / MAX: 6666.67 MIN: 28.42 / MAX: 5000 MIN: 10.91 / MAX: 7500 MIN: 20.98 / MAX: 6000
Memcached Set To Get Ratio: 1:5 OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:5 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 900K 1800K 2700K 3600K 4500K SE +/- 3957.77, N = 3 SE +/- 24137.01, N = 3 SE +/- 20367.20, N = 3 SE +/- 51036.74, N = 15 SE +/- 6378.36, N = 3 SE +/- 36603.84, N = 15 SE +/- 6964.53, N = 3 SE +/- 47663.26, N = 3 SE +/- 26712.28, N = 3 SE +/- 21079.66, N = 14 SE +/- 34848.84, N = 8 SE +/- 28979.64, N = 3 SE +/- 27130.94, N = 3 SE +/- 20598.32, N = 3 2199582.80 2421891.74 2917560.70 2164592.24 3632495.02 1867112.74 3574540.35 3378044.12 4271575.65 3270779.44 4068619.97 3701213.86 3346967.77 3597757.55 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Memcached Set To Get Ratio: 1:10 OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:10 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1000K 2000K 3000K 4000K 5000K SE +/- 6608.23, N = 3 SE +/- 10464.07, N = 3 SE +/- 9446.47, N = 3 SE +/- 12992.60, N = 3 SE +/- 10592.08, N = 3 SE +/- 10361.68, N = 3 SE +/- 16723.87, N = 3 SE +/- 53174.54, N = 4 SE +/- 14309.07, N = 3 SE +/- 79008.26, N = 15 SE +/- 13454.68, N = 3 SE +/- 44938.98, N = 15 SE +/- 23174.23, N = 3 SE +/- 36081.97, N = 15 2548333.19 2826219.16 3431617.24 3691244.97 4198464.11 4105338.27 3481927.79 4786407.25 4262554.19 3551712.12 4053902.81 3969670.99 3159962.47 3912323.12 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Memcached Set To Get Ratio: 1:100 OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:100 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 800K 1600K 2400K 3200K 4000K SE +/- 9721.14, N = 3 SE +/- 4664.77, N = 3 SE +/- 18487.99, N = 3 SE +/- 22542.41, N = 15 SE +/- 20057.86, N = 3 SE +/- 1121.75, N = 3 SE +/- 40574.62, N = 3 SE +/- 31526.72, N = 9 SE +/- 34881.31, N = 3 SE +/- 60239.97, N = 15 SE +/- 34942.45, N = 3 SE +/- 43191.93, N = 15 SE +/- 27101.83, N = 15 SE +/- 24448.73, N = 3 1610909.22 2373328.37 2309617.42 2952893.82 2981451.32 3518612.74 2848831.24 3893409.95 2937926.06 2802626.26 2842403.96 2971169.05 2164237.05 2874778.00 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Graph500 Scale: 26 OpenBenchmarking.org bfs median_TEPS, More Is Better Graph500 3.0 Scale: 26 EPYC 7343 EPYC 7343 2P EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6346 Xeon Gold 6346 2P 150M 300M 450M 600M 750M 309817000 422529000 584034000 517810000 665655000 544342000 691348000 510587000 655675000 359689000 562172000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org bfs max_TEPS, More Is Better Graph500 3.0 Scale: 26 EPYC 7343 EPYC 7343 2P EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6346 Xeon Gold 6346 2P 150M 300M 450M 600M 750M 312989000 444474000 601120000 528200000 691983000 554082000 715154000 519294000 667982000 362918000 571793000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org sssp median_TEPS, More Is Better Graph500 3.0 Scale: 26 EPYC 7343 EPYC 7343 2P EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6346 Xeon Gold 6346 2P 50M 100M 150M 200M 250M 114295000 174219000 225284000 176371000 255036000 204519000 227175000 168374000 238460000 117919000 187654000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org sssp max_TEPS, More Is Better Graph500 3.0 Scale: 26 EPYC 7343 EPYC 7343 2P EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6346 Xeon Gold 6346 2P 70M 140M 210M 280M 350M 149710000 218986000 294782000 226239000 322475000 268016000 288959000 213096000 295010000 154209000 245053000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2023 Implementation: MPI CPU - Input: water_GMX50_bare EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2 4 6 8 10 SE +/- 0.009, N = 3 SE +/- 0.003, N = 3 SE +/- 0.015, N = 3 SE +/- 0.006, N = 3 SE +/- 0.019, N = 3 SE +/- 0.013, N = 3 SE +/- 0.008, N = 3 SE +/- 0.025, N = 3 SE +/- 0.011, N = 3 SE +/- 0.004, N = 3 SE +/- 0.019, N = 3 SE +/- 0.001, N = 3 SE +/- 0.018, N = 3 4.083 3.005 4.820 3.547 5.589 4.001 5.098 3.717 7.379 3.376 6.761 2.619 5.391 1. (CXX) g++ options: -O3
PostgreSQL Scaling Factor: 1000 - Clients: 800 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 800 - Mode: Read Only EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200K 400K 600K 800K 1000K SE +/- 7215.33, N = 3 SE +/- 9801.20, N = 3 SE +/- 2318.40, N = 3 SE +/- 19094.08, N = 9 SE +/- 28926.74, N = 11 SE +/- 41984.11, N = 6 SE +/- 4126.34, N = 3 SE +/- 19623.01, N = 12 SE +/- 137.25, N = 3 SE +/- 4309.16, N = 3 SE +/- 1328.10, N = 3 SE +/- 30362.30, N = 12 SE +/- 4113.36, N = 3 SE +/- 10990.82, N = 12 695761 855642 912427 765090 984394 690019 1074765 835087 1123663 750218 983473 850161 746302 1067716 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1000 - Clients: 800 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 800 - Mode: Read Only - Average Latency EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.2651 0.5302 0.7953 1.0604 1.3255 SE +/- 0.012, N = 3 SE +/- 0.011, N = 3 SE +/- 0.002, N = 3 SE +/- 0.025, N = 9 SE +/- 0.032, N = 11 SE +/- 0.060, N = 6 SE +/- 0.003, N = 3 SE +/- 0.020, N = 12 SE +/- 0.000, N = 3 SE +/- 0.006, N = 3 SE +/- 0.001, N = 3 SE +/- 0.031, N = 12 SE +/- 0.006, N = 3 SE +/- 0.008, N = 12 1.150 0.935 0.877 1.051 0.822 1.178 0.745 0.963 0.712 1.066 0.813 0.953 1.072 0.750 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200K 400K 600K 800K 1000K SE +/- 1636.62, N = 3 SE +/- 3271.24, N = 3 SE +/- 7500.42, N = 3 SE +/- 11363.61, N = 12 SE +/- 2084.66, N = 3 SE +/- 10642.91, N = 9 SE +/- 4439.63, N = 3 SE +/- 4640.40, N = 3 SE +/- 4354.62, N = 3 SE +/- 30718.02, N = 12 SE +/- 1181.85, N = 3 SE +/- 10454.75, N = 12 SE +/- 1889.54, N = 3 SE +/- 8418.28, N = 3 685239 849019 884213 728184 976332 638731 1008741 721335 1078586 754104 927858 851464 742550 997957 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only - Average Latency EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.353 0.706 1.059 1.412 1.765 SE +/- 0.003, N = 3 SE +/- 0.005, N = 3 SE +/- 0.010, N = 3 SE +/- 0.021, N = 12 SE +/- 0.002, N = 3 SE +/- 0.027, N = 9 SE +/- 0.004, N = 3 SE +/- 0.009, N = 3 SE +/- 0.004, N = 3 SE +/- 0.050, N = 12 SE +/- 0.001, N = 3 SE +/- 0.014, N = 12 SE +/- 0.003, N = 3 SE +/- 0.008, N = 3 1.459 1.178 1.131 1.377 1.024 1.569 0.991 1.386 0.927 1.348 1.078 1.176 1.347 1.002 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1000 - Clients: 800 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 800 - Mode: Read Write EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6K 12K 18K 24K 30K SE +/- 214.52, N = 3 SE +/- 176.72, N = 12 SE +/- 611.47, N = 12 SE +/- 109.43, N = 3 SE +/- 52.15, N = 3 SE +/- 590.01, N = 9 SE +/- 26.13, N = 3 SE +/- 136.50, N = 3 SE +/- 190.25, N = 3 SE +/- 83.93, N = 3 SE +/- 132.14, N = 3 SE +/- 131.27, N = 3 SE +/- 55.23, N = 3 SE +/- 299.85, N = 3 25679 8492 24251 8736 13777 8552 11845 12245 22228 19540 24360 21929 27853 23290 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1000 - Clients: 800 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 800 - Mode: Read Write - Average Latency EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.26, N = 3 SE +/- 1.69, N = 12 SE +/- 0.81, N = 12 SE +/- 1.13, N = 3 SE +/- 0.22, N = 3 SE +/- 7.23, N = 9 SE +/- 0.15, N = 3 SE +/- 0.72, N = 3 SE +/- 0.31, N = 3 SE +/- 0.18, N = 3 SE +/- 0.18, N = 3 SE +/- 0.22, N = 3 SE +/- 0.06, N = 3 SE +/- 0.44, N = 3 31.16 94.59 33.21 91.60 58.07 97.52 67.54 65.35 36.00 40.94 32.84 36.48 28.72 34.36 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6K 12K 18K 24K 30K SE +/- 210.94, N = 3 SE +/- 43.57, N = 3 SE +/- 239.71, N = 7 SE +/- 68.86, N = 3 SE +/- 246.74, N = 12 SE +/- 88.49, N = 3 SE +/- 167.15, N = 12 SE +/- 567.20, N = 9 SE +/- 84.27, N = 3 SE +/- 265.07, N = 3 SE +/- 144.91, N = 3 SE +/- 180.74, N = 3 SE +/- 212.63, N = 3 SE +/- 300.77, N = 3 24821 8356 25674 9798 13865 10651 12068 15683 22446 19322 25377 22138 27861 23580 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write - Average Latency EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.34, N = 3 SE +/- 0.63, N = 3 SE +/- 0.37, N = 7 SE +/- 0.71, N = 3 SE +/- 1.40, N = 12 SE +/- 0.78, N = 3 SE +/- 1.07, N = 12 SE +/- 2.55, N = 9 SE +/- 0.17, N = 3 SE +/- 0.71, N = 3 SE +/- 0.23, N = 3 SE +/- 0.37, N = 3 SE +/- 0.27, N = 3 SE +/- 0.54, N = 3 40.29 119.68 38.97 102.07 72.40 93.90 83.02 64.50 44.55 51.77 39.41 45.18 35.90 42.42 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
TensorFlow Device: CPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: AlexNet EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 120 240 360 480 600 SE +/- 0.23, N = 3 SE +/- 0.14, N = 3 SE +/- 0.05, N = 3 SE +/- 0.21, N = 3 SE +/- 0.25, N = 3 SE +/- 0.45, N = 3 SE +/- 0.23, N = 3 SE +/- 0.10, N = 3 SE +/- 0.91, N = 3 SE +/- 1.40, N = 3 SE +/- 0.74, N = 3 SE +/- 0.36, N = 3 SE +/- 0.48, N = 3 SE +/- 1.21, N = 3 138.96 143.84 144.99 143.50 151.07 141.81 155.25 130.65 475.07 547.55 410.32 486.36 311.20 376.10
TensorFlow Device: CPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: AlexNet EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 120 240 360 480 600 SE +/- 0.30, N = 3 SE +/- 0.34, N = 3 SE +/- 0.69, N = 3 SE +/- 0.23, N = 3 SE +/- 0.17, N = 3 SE +/- 0.27, N = 3 SE +/- 0.27, N = 3 SE +/- 0.22, N = 3 SE +/- 0.42, N = 3 SE +/- 0.62, N = 3 SE +/- 0.13, N = 3 SE +/- 0.75, N = 3 SE +/- 0.70, N = 3 SE +/- 2.14, N = 3 142.79 147.17 150.98 146.48 156.46 144.20 160.32 136.28 489.77 575.90 432.47 510.92 332.04 402.63
TensorFlow Device: CPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: GoogLeNet EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60 120 180 240 300 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.15, N = 3 SE +/- 0.14, N = 3 SE +/- 0.14, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.33, N = 3 SE +/- 0.11, N = 3 SE +/- 0.20, N = 3 SE +/- 0.10, N = 3 SE +/- 0.11, N = 3 64.03 70.56 65.49 70.39 69.02 62.34 72.46 58.23 203.92 253.31 189.89 231.32 148.57 182.71
TensorFlow Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: ResNet-50 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 16 32 48 64 80 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.21, N = 3 SE +/- 0.03, N = 3 SE +/- 0.23, N = 3 SE +/- 0.02, N = 3 SE +/- 0.10, N = 3 22.37 24.03 23.43 24.04 23.77 22.75 25.34 20.70 68.08 73.49 61.90 66.43 49.28 54.33
TensorFlow Device: CPU - Batch Size: 512 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: GoogLeNet EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60 120 180 240 300 SE +/- 0.09, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.17, N = 3 SE +/- 0.65, N = 3 SE +/- 0.15, N = 3 SE +/- 0.31, N = 3 SE +/- 0.02, N = 3 SE +/- 0.84, N = 3 63.82 71.90 65.67 71.43 70.20 63.68 73.86 60.82 205.17 257.04 191.35 234.54 151.03 188.90
TensorFlow Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: ResNet-50 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.37, N = 3 SE +/- 0.03, N = 3 SE +/- 0.52, N = 3 SE +/- 0.02, N = 3 SE +/- 0.15, N = 3 22.91 25.43 24.16 25.36 24.66 23.96 26.26 21.85 68.38 74.68 62.18 66.12 50.01 56.73
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 9 18 27 36 45 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 12.65 24.92 16.32 32.25 19.90 39.59 22.07 31.45 18.67 37.70 17.39 34.79 13.21 26.54
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200 400 600 800 1000 SE +/- 0.72, N = 3 SE +/- 0.41, N = 3 SE +/- 0.56, N = 3 SE +/- 0.21, N = 3 SE +/- 0.05, N = 3 SE +/- 0.46, N = 3 SE +/- 0.25, N = 3 SE +/- 0.92, N = 3 SE +/- 0.28, N = 3 SE +/- 0.23, N = 3 SE +/- 0.47, N = 3 SE +/- 0.92, N = 3 SE +/- 0.43, N = 3 SE +/- 0.43, N = 3 629.19 636.28 729.31 738.78 791.97 803.45 716.02 1010.00 856.00 847.38 689.68 685.96 605.67 599.81
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 150 300 450 600 750 SE +/- 0.06, N = 3 SE +/- 0.45, N = 3 SE +/- 0.29, N = 3 SE +/- 0.51, N = 3 SE +/- 0.19, N = 3 SE +/- 0.82, N = 3 SE +/- 0.08, N = 3 SE +/- 0.43, N = 3 SE +/- 1.30, N = 3 SE +/- 1.61, N = 3 SE +/- 0.55, N = 3 SE +/- 4.23, N = 3 SE +/- 0.24, N = 3 SE +/- 1.35, N = 3 163.56 280.43 226.05 384.29 283.71 488.63 294.21 455.12 362.29 704.95 294.76 589.28 242.04 482.92
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 16 32 48 64 80 SE +/- 0.01, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.15, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.29, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 48.86 56.98 53.03 62.36 56.33 65.39 54.32 70.21 44.13 45.36 40.68 40.70 33.03 33.11
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.12, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.85, N = 3 SE +/- 0.28, N = 3 SE +/- 0.05, N = 3 SE +/- 0.15, N = 3 SE +/- 0.99, N = 3 SE +/- 0.41, N = 3 SE +/- 1.12, N = 3 SE +/- 0.53, N = 3 SE +/- 0.30, N = 3 52.26 97.20 67.20 127.54 82.55 156.24 91.57 132.30 92.27 177.59 83.03 157.81 63.35 125.60
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.33, N = 3 SE +/- 0.07, N = 3 SE +/- 0.15, N = 3 SE +/- 0.16, N = 3 SE +/- 0.21, N = 3 SE +/- 1.13, N = 3 SE +/- 0.50, N = 3 SE +/- 0.17, N = 3 SE +/- 0.38, N = 3 SE +/- 0.95, N = 3 SE +/- 0.70, N = 3 SE +/- 0.98, N = 3 SE +/- 0.99, N = 3 SE +/- 0.32, N = 3 152.83 164.14 178.21 187.68 193.47 204.23 174.36 241.33 173.20 179.89 144.31 151.86 126.16 127.16
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P 40 80 120 160 200 SE +/- 0.07, N = 3 SE +/- 0.14, N = 3 SE +/- 0.07, N = 3 SE +/- 0.26, N = 3 91.68 113.85 124.13 177.64
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream EPYC 7413 EPYC 7513 EPYC 7543 EPYC 7713P 40 80 120 160 200 SE +/- 0.07, N = 3 SE +/- 0.18, N = 3 SE +/- 0.07, N = 3 SE +/- 0.26, N = 3 130.72 140.23 128.67 179.68
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 140 280 420 560 700 SE +/- 0.25, N = 3 SE +/- 0.20, N = 3 SE +/- 0.51, N = 3 SE +/- 1.20, N = 3 SE +/- 0.61, N = 3 SE +/- 0.50, N = 3 SE +/- 0.36, N = 3 SE +/- 0.55, N = 3 SE +/- 0.07, N = 3 SE +/- 0.15, N = 3 SE +/- 0.25, N = 3 SE +/- 2.27, N = 3 SE +/- 0.23, N = 3 SE +/- 0.08, N = 3 144.23 287.18 192.68 370.19 240.41 468.93 256.52 369.54 320.01 639.77 286.88 578.25 215.84 439.33
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.16, N = 3 SE +/- 0.21, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.12, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 55.41 55.60 62.20 64.72 66.47 68.12 62.29 86.46 49.96 49.97 41.81 41.46 37.04 36.38
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 80 160 240 320 400 SE +/- 0.16, N = 3 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.27, N = 3 SE +/- 0.28, N = 3 SE +/- 0.20, N = 3 SE +/- 0.11, N = 3 SE +/- 0.86, N = 3 SE +/- 0.37, N = 3 SE +/- 0.54, N = 3 SE +/- 0.61, N = 3 SE +/- 0.35, N = 3 SE +/- 0.23, N = 3 SE +/- 0.29, N = 3 105.96 206.53 139.27 270.27 172.73 335.99 186.09 271.88 173.77 345.18 157.60 313.14 115.60 231.51
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30 60 90 120 150 SE +/- 0.12, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.13, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.36, N = 3 SE +/- 0.20, N = 3 SE +/- 0.15, N = 3 SE +/- 0.29, N = 3 SE +/- 0.09, N = 3 SE +/- 0.14, N = 3 SE +/- 0.09, N = 3 75.41 77.34 86.08 88.63 92.54 95.08 85.87 117.48 92.05 92.64 76.12 76.56 69.19 69.04
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 15 30 45 60 75 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 17.74 33.42 23.29 43.91 29.27 55.47 31.39 46.68 33.90 65.21 31.01 59.97 23.59 45.55
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 150 300 450 600 750 SE +/- 0.07, N = 3 SE +/- 0.14, N = 3 SE +/- 0.16, N = 3 SE +/- 0.27, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.64, N = 3 SE +/- 0.21, N = 3 SE +/- 0.50, N = 3 SE +/- 0.38, N = 3 SE +/- 0.45, N = 3 SE +/- 0.27, N = 3 SE +/- 0.17, N = 3 450.60 475.87 515.06 544.62 546.28 575.37 507.66 684.85 471.63 488.41 386.88 399.33 338.98 350.63
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.21, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.30, N = 3 SE +/- 0.08, N = 3 SE +/- 0.37, N = 3 SE +/- 0.06, N = 3 SE +/- 0.50, N = 3 SE +/- 0.22, N = 3 SE +/- 0.13, N = 3 53.60 104.89 70.41 137.04 86.94 170.26 93.97 138.14 83.62 167.38 75.67 150.09 55.75 113.07
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.09, N = 3 SE +/- 0.17, N = 3 SE +/- 0.15, N = 3 SE +/- 0.11, N = 3 SE +/- 0.41, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.59, N = 3 SE +/- 0.18, N = 3 SE +/- 0.33, N = 3 SE +/- 0.13, N = 3 SE +/- 0.51, N = 3 SE +/- 0.56, N = 3 SE +/- 0.10, N = 3 148.96 152.15 170.16 174.62 183.72 187.52 169.93 230.92 191.31 190.84 158.56 159.75 143.49 141.36
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 9 18 27 36 45 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.10, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 12.62 25.02 16.37 32.25 19.98 39.66 22.12 31.40 18.69 37.63 17.38 34.86 13.21 26.52
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200 400 600 800 1000 SE +/- 0.24, N = 3 SE +/- 0.25, N = 3 SE +/- 0.30, N = 3 SE +/- 0.75, N = 3 SE +/- 0.93, N = 3 SE +/- 0.61, N = 3 SE +/- 0.33, N = 3 SE +/- 0.83, N = 3 SE +/- 0.54, N = 3 SE +/- 0.68, N = 3 SE +/- 0.32, N = 3 SE +/- 0.49, N = 3 SE +/- 0.26, N = 3 SE +/- 0.72, N = 3 627.69 634.73 729.06 739.76 792.46 802.16 716.12 1010.58 855.78 848.91 690.24 686.45 605.57 600.72
GPAW Input: Carbon Nanotube OpenBenchmarking.org Seconds, Fewer Is Better GPAW 22.1 Input: Carbon Nanotube EPYC 7343 2P EPYC 7413 2P EPYC 7513 2P 100 200 300 400 500 SE +/- 0.65, N = 3 SE +/- 0.96, N = 3 SE +/- 1.19, N = 3 444.07 417.51 398.99 1. (CC) gcc options: -shared -lxc -lblas -lmpi -O2 -fexceptions -pipe -m64 -march=x86-64-v2 -mtune=generic -fcf-protection -fPIC -fwrapv -UNDEBUG -std=c99
Blender Blend File: BMW27 - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: BMW27 - Compute: CPU-Only EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 20 40 60 80 100 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.13, N = 3 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.12, N = 3 82.60 41.30 62.03 31.80 49.24 25.46 46.24 30.36 59.55 29.66 64.90 32.25 86.38 42.35
Blender Blend File: Classroom - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Classroom - Compute: CPU-Only EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50 100 150 200 250 SE +/- 0.29, N = 3 SE +/- 0.30, N = 3 SE +/- 0.20, N = 3 SE +/- 0.18, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 SE +/- 0.25, N = 3 SE +/- 0.14, N = 3 SE +/- 0.13, N = 3 SE +/- 0.37, N = 3 SE +/- 0.14, N = 3 219.83 109.64 165.39 82.55 130.35 64.96 122.97 79.30 161.50 80.17 176.55 87.28 233.90 115.77
Blender Blend File: Barbershop - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Barbershop - Compute: CPU-Only EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200 400 600 800 1000 SE +/- 0.57, N = 3 SE +/- 0.53, N = 3 SE +/- 2.04, N = 3 SE +/- 0.36, N = 3 SE +/- 0.04, N = 3 SE +/- 0.82, N = 3 SE +/- 0.45, N = 3 SE +/- 0.59, N = 3 SE +/- 0.64, N = 3 SE +/- 0.29, N = 3 SE +/- 3.07, N = 3 SE +/- 0.18, N = 3 SE +/- 0.21, N = 3 SE +/- 0.38, N = 3 815.39 435.02 616.51 330.02 482.82 262.94 456.27 297.72 604.76 302.14 680.31 342.37 889.71 445.24
CloudSuite Data Analytics Hadoop Slaves: 1 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 1 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 13K 26K 39K 52K 65K 18792 58173 58158 61767 58645 62262 59400 60941 20565 21324 18581 19397 18046 18850
CloudSuite Data Analytics Hadoop Slaves: 4 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 4 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 19011 1314712 874335 928018 1295214 905105 1252851 1318693 20697 21284 18674 19473 18119 18808
CloudSuite Data Analytics Hadoop Slaves: 8 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 8 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 19259 1338669 1265492 1386712 1323129 1397332 1279022 1351560 20809 21431 18852 19477 18342 19183
CloudSuite Data Analytics Hadoop Slaves: 32 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 32 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 18906 1025584 1326319 1337500 1282987 1118115 1356145 952995 20822 21685 18923 19751 18027 19218
CloudSuite Data Analytics Hadoop Slaves: 64 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 64 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 19072 915672 1296065 1462648 1315834 910021 1312741 1353066 20909 21632 18776 19706 18205 19126
CloudSuite Data Analytics Hadoop Slaves: 128 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 128 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 101630 870117 1324795 1393156 1378719 1030733 1337915 1377599 121626 122135 104512 99997 118445 118993
CloudSuite Data Analytics Hadoop Slaves: 256 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 256 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 25186 977380 1263825 1456236 1288469 974407 1332491 1321064 43513 34651 27079 34180 58137 31262
CloudSuite Data Analytics Hadoop Slaves: 512 OpenBenchmarking.org ms, Fewer Is Better CloudSuite Data Analytics 4.0 Hadoop Slaves: 512 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K 89452 1306974 1296994 1447278 1380314 1425667 1307991 1296643 93771 29960 80304 31922 22380 23267
CloudSuite Graph Analytics GraphX Algorithm: Page Rank OpenBenchmarking.org ms, Fewer Is Better CloudSuite Graph Analytics 4.0 GraphX Algorithm: Page Rank EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3K 6K 9K 12K 15K SE +/- 84.93, N = 3 SE +/- 190.69, N = 13 SE +/- 82.57, N = 15 SE +/- 184.92, N = 15 SE +/- 135.36, N = 3 SE +/- 118.51, N = 3 SE +/- 79.02, N = 3 SE +/- 49.21, N = 3 SE +/- 115.60, N = 15 SE +/- 108.31, N = 15 SE +/- 106.07, N = 15 SE +/- 69.03, N = 14 SE +/- 97.49, N = 15 SE +/- 39.28, N = 3 11525 9820 9815 9831 9917 9587 9247 9112 11245 11235 10340 10381 13034 10597
CloudSuite Graph Analytics GraphX Algorithm: Triangle Count OpenBenchmarking.org ms, Fewer Is Better CloudSuite Graph Analytics 4.0 GraphX Algorithm: Triangle Count EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 30K 60K 90K 120K 150K SE +/- 192.25, N = 3 SE +/- 2111.36, N = 15 SE +/- 911.07, N = 15 SE +/- 4547.27, N = 12 SE +/- 844.55, N = 3 SE +/- 3129.18, N = 15 SE +/- 816.75, N = 5 SE +/- 1101.67, N = 15 SE +/- 1190.06, N = 15 SE +/- 1737.14, N = 15 SE +/- 969.69, N = 3 SE +/- 486.76, N = 3 SE +/- 2880.79, N = 12 SE +/- 1088.95, N = 15 108988 77278 84114 74003 77893 70042 74250 70089 93231 78150 87786 73459 127015 84608
CloudSuite Graph Analytics GraphX Algorithm: Connected Components OpenBenchmarking.org ms, Fewer Is Better CloudSuite Graph Analytics 4.0 GraphX Algorithm: Connected Components EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 4K 8K 12K 16K 20K SE +/- 216.00, N = 15 SE +/- 400.63, N = 15 SE +/- 188.00, N = 15 SE +/- 176.86, N = 15 SE +/- 194.18, N = 13 SE +/- 134.07, N = 3 SE +/- 220.91, N = 15 SE +/- 128.32, N = 15 SE +/- 97.53, N = 3 SE +/- 180.53, N = 15 SE +/- 140.39, N = 15 SE +/- 57.52, N = 3 SE +/- 155.90, N = 15 SE +/- 268.97, N = 12 15718 14547 14011 14426 13102 13891 13358 13169 14285 14751 13542 13551 17820 14408
CloudSuite In-Memory Analytics Training Set Size: Large OpenBenchmarking.org ms, Fewer Is Better CloudSuite In-Memory Analytics 4.0 Training Set Size: Large EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60K 120K 180K 240K 300K SE +/- 535.64, N = 3 SE +/- 1774.21, N = 4 SE +/- 235.29, N = 3 SE +/- 530.20, N = 3 SE +/- 796.65, N = 3 SE +/- 859.70, N = 3 SE +/- 210.33, N = 3 SE +/- 955.82, N = 3 SE +/- 2349.58, N = 3 SE +/- 775.32, N = 3 SE +/- 623.63, N = 3 SE +/- 546.89, N = 3 SE +/- 800.80, N = 3 SE +/- 725.41, N = 3 122575 147944 124002 225855 134575 301630 130123 250115 163851 287528 140252 196790 148896 157229
CloudSuite In-Memory Analytics Training Set Size: Small OpenBenchmarking.org ms, Fewer Is Better CloudSuite In-Memory Analytics 4.0 Training Set Size: Small EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40K 80K 120K 160K 200K SE +/- 13.02, N = 3 SE +/- 136.22, N = 3 SE +/- 159.06, N = 3 SE +/- 1128.62, N = 3 SE +/- 101.02, N = 3 SE +/- 409.71, N = 3 SE +/- 151.00, N = 3 SE +/- 820.85, N = 3 SE +/- 84.36, N = 3 SE +/- 90.73, N = 3 SE +/- 80.23, N = 3 SE +/- 445.33, N = 3 SE +/- 48.64, N = 3 SE +/- 203.67, N = 3 13995 46059 23575 111224 36808 181349 37315 136721 36646 147653 21960 82287 13855 41096
CloudSuite Web Serving Load Scale: 100 OpenBenchmarking.org ops/sec, More Is Better CloudSuite Web Serving Load Scale: 100 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2 4 6 8 10 7.333 5.550 7.583 5.300 7.417 5.417 6.583 7.100 7.517 7.350 7.517 7.183 7.383 7.533
CloudSuite Web Serving Load Scale: 400 OpenBenchmarking.org ops/sec, More Is Better CloudSuite Web Serving Load Scale: 400 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 4 8 12 16 20 11.83 11.43 14.73 11.97 14.88 11.20 13.80 13.27 12.38 11.93 14.70 11.70 13.55 11.73
CloudSuite Web Serving Load Scale: 500 OpenBenchmarking.org ops/sec, More Is Better CloudSuite Web Serving Load Scale: 500 EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 4 8 12 16 20 11.600 11.217 14.583 12.083 15.267 11.817 13.050 15.283 13.317 9.600 15.433 12.717 12.950 12.300
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 4.27 7.76 5.44 10.06 6.67 12.55 7.32 10.33 8.96 18.48 8.43 17.34 6.43 13.20 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 700 1400 2100 2800 3500 SE +/- 3.34, N = 3 SE +/- 0.58, N = 3 SE +/- 2.73, N = 3 SE +/- 1.48, N = 3 SE +/- 2.40, N = 3 SE +/- 1.75, N = 3 SE +/- 9.46, N = 3 SE +/- 4.99, N = 3 SE +/- 6.05, N = 3 SE +/- 1.93, N = 3 SE +/- 7.34, N = 3 SE +/- 0.46, N = 3 SE +/- 3.43, N = 3 SE +/- 1.08, N = 3 1850.23 1028.98 2183.99 1190.68 2369.52 1272.58 2162.68 3072.39 1771.70 862.09 1413.05 689.05 1232.64 604.17 MIN: 1073.49 / MAX: 1950.78 MIN: 1009.62 / MAX: 1100.65 MIN: 1919.34 / MAX: 2280.72 MIN: 1162.02 / MAX: 1273 MIN: 1311.77 / MAX: 2481.25 MIN: 1233.3 / MAX: 1361.68 MIN: 1785 / MAX: 2247.11 MIN: 2717.45 / MAX: 3200.51 MIN: 1362.81 / MAX: 1851.05 MIN: 623.51 / MAX: 953.92 MIN: 686.62 / MAX: 1507.17 MIN: 523.39 / MAX: 772.01 MIN: 935.61 / MAX: 1312.43 MIN: 472.25 / MAX: 677.41 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 2.84 5.53 3.61 7.01 4.44 8.82 4.95 6.92 5.36 10.84 5.03 9.94 3.87 7.62 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1000 2000 3000 4000 5000 SE +/- 10.65, N = 3 SE +/- 0.75, N = 3 SE +/- 4.10, N = 3 SE +/- 0.56, N = 3 SE +/- 9.18, N = 3 SE +/- 2.22, N = 3 SE +/- 7.16, N = 3 SE +/- 5.09, N = 3 SE +/- 0.75, N = 3 SE +/- 0.75, N = 3 SE +/- 0.81, N = 3 SE +/- 1.46, N = 3 SE +/- 0.68, N = 3 SE +/- 0.85, N = 3 2790.52 1445.13 3275.51 1688.62 3561.39 1803.09 3186.87 4538.43 2962.18 1467.67 2358.37 1198.22 2047.93 1043.48 MIN: 2485.81 / MAX: 2884.12 MIN: 1428.3 / MAX: 1517.31 MIN: 2779.4 / MAX: 3463.81 MIN: 1420.61 / MAX: 1780.64 MIN: 3211.28 / MAX: 3765.97 MIN: 1636.35 / MAX: 1876.9 MIN: 2866.19 / MAX: 3374.03 MIN: 3564.16 / MAX: 4986.6 MIN: 2252.85 / MAX: 3160.04 MIN: 1203.01 / MAX: 1562.63 MIN: 1772.66 / MAX: 2525.32 MIN: 911.32 / MAX: 1454.11 MIN: 1604.74 / MAX: 2166.44 MIN: 886.86 / MAX: 1166.18 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 2.82 5.52 3.59 7.01 4.45 8.81 4.94 6.92 5.26 10.63 4.95 9.78 3.80 7.42 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1000 2000 3000 4000 5000 SE +/- 1.49, N = 3 SE +/- 1.35, N = 3 SE +/- 7.34, N = 3 SE +/- 0.39, N = 3 SE +/- 3.85, N = 3 SE +/- 2.09, N = 3 SE +/- 4.08, N = 3 SE +/- 2.29, N = 3 SE +/- 2.23, N = 3 SE +/- 0.13, N = 3 SE +/- 0.31, N = 3 SE +/- 1.27, N = 3 SE +/- 1.13, N = 3 SE +/- 3.51, N = 3 2813.45 1447.06 3280.27 1689.48 3537.87 1804.95 3217.57 4533.12 3023.56 1495.92 2400.77 1217.97 2081.75 1072.35 MIN: 2640.81 / MAX: 2908.21 MIN: 1431.68 / MAX: 1476.13 MIN: 1686.07 / MAX: 3445.04 MIN: 1404.52 / MAX: 1764.68 MIN: 1864.67 / MAX: 3792.11 MIN: 1665.93 / MAX: 1885.89 MIN: 2966.37 / MAX: 3376.92 MIN: 3616.62 / MAX: 4976.85 MIN: 2431.21 / MAX: 3241.15 MIN: 1185.61 / MAX: 1589.83 MIN: 1826.07 / MAX: 2573.73 MIN: 940.6 / MAX: 1321.99 MIN: 951.54 / MAX: 2214.54 MIN: 885.75 / MAX: 1124.15 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300 600 900 1200 1500 SE +/- 0.47, N = 3 SE +/- 1.53, N = 3 SE +/- 0.91, N = 3 SE +/- 1.28, N = 3 SE +/- 2.26, N = 3 SE +/- 0.46, N = 3 SE +/- 0.75, N = 3 SE +/- 0.33, N = 3 SE +/- 0.77, N = 3 SE +/- 0.97, N = 3 SE +/- 0.55, N = 3 SE +/- 0.67, N = 3 SE +/- 0.43, N = 3 SE +/- 1.91, N = 3 389.71 734.99 479.00 852.08 603.36 1173.42 675.88 940.29 481.60 939.07 449.39 844.38 368.02 695.06 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 8 16 24 32 40 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.10, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 20.51 10.88 25.03 14.07 26.50 13.62 23.66 34.00 33.19 17.01 26.68 14.19 21.72 11.49 MIN: 10.96 / MAX: 31.38 MIN: 9.85 / MAX: 18.79 MIN: 17.49 / MAX: 46.59 MIN: 11.6 / MAX: 34.29 MIN: 15.94 / MAX: 62.11 MIN: 11.93 / MAX: 37.05 MIN: 13.21 / MAX: 47.37 MIN: 20.86 / MAX: 90.26 MIN: 14.88 / MAX: 64.4 MIN: 12.34 / MAX: 32.47 MIN: 13.7 / MAX: 43.32 MIN: 10.82 / MAX: 27.29 MIN: 10.48 / MAX: 36.43 MIN: 9.55 / MAX: 23.06 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 16 32 48 64 80 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 9.36 18.85 12.17 24.72 15.29 31.43 16.56 24.81 35.43 73.58 33.22 67.44 25.52 51.51 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300 600 900 1200 1500 SE +/- 0.21, N = 3 SE +/- 0.12, N = 3 SE +/- 0.56, N = 3 SE +/- 0.04, N = 3 SE +/- 0.48, N = 3 SE +/- 0.49, N = 3 SE +/- 1.20, N = 3 SE +/- 0.66, N = 3 SE +/- 0.13, N = 3 SE +/- 0.07, N = 3 SE +/- 0.25, N = 3 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 854.22 423.55 979.21 483.37 1038.36 507.62 961.41 1279.15 450.58 217.18 360.49 177.69 313.14 155.15 MIN: 777.98 / MAX: 878.94 MIN: 415.99 / MAX: 455.1 MIN: 861.53 / MAX: 1015.88 MIN: 438.12 / MAX: 515.6 MIN: 906.21 / MAX: 1056.67 MIN: 474.68 / MAX: 549.27 MIN: 831.19 / MAX: 978.3 MIN: 1018.37 / MAX: 1317.05 MIN: 338.75 / MAX: 484.67 MIN: 164.55 / MAX: 257.56 MIN: 257.91 / MAX: 392.73 MIN: 141.05 / MAX: 204.41 MIN: 185.19 / MAX: 336.95 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 700 1400 2100 2800 3500 SE +/- 0.19, N = 3 SE +/- 0.73, N = 3 SE +/- 1.37, N = 3 SE +/- 7.85, N = 3 SE +/- 0.12, N = 3 SE +/- 0.29, N = 3 SE +/- 0.71, N = 3 SE +/- 1.60, N = 3 SE +/- 1.15, N = 3 SE +/- 1.96, N = 3 SE +/- 1.94, N = 3 SE +/- 5.21, N = 3 SE +/- 0.17, N = 3 SE +/- 1.91, N = 3 654.14 1243.24 833.99 1570.38 1076.30 2097.59 1166.69 1735.57 1661.48 3402.82 1544.95 3005.72 1175.72 2339.16 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 12.22 6.42 14.38 7.63 14.86 7.62 13.70 18.42 9.61 4.69 7.75 3.98 6.79 3.41 MIN: 8.5 / MAX: 28.01 MIN: 6.15 / MAX: 15.78 MIN: 8.17 / MAX: 28.75 MIN: 6.86 / MAX: 22.57 MIN: 8.08 / MAX: 33.72 MIN: 7.15 / MAX: 31.91 MIN: 7.41 / MAX: 31.1 MIN: 9.93 / MAX: 52.04 MIN: 5.23 / MAX: 31.29 MIN: 4.17 / MAX: 21.97 MIN: 4.25 / MAX: 40.39 MIN: 3.28 / MAX: 15.38 MIN: 3.7 / MAX: 21.83 MIN: 2.97 / MAX: 14.93 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 400 800 1200 1600 2000 SE +/- 0.27, N = 3 SE +/- 0.57, N = 3 SE +/- 0.42, N = 3 SE +/- 0.89, N = 3 SE +/- 0.67, N = 3 SE +/- 1.42, N = 3 SE +/- 0.47, N = 3 SE +/- 0.61, N = 3 SE +/- 1.35, N = 3 SE +/- 2.62, N = 3 SE +/- 0.30, N = 3 SE +/- 1.17, N = 3 SE +/- 1.16, N = 3 SE +/- 1.02, N = 3 404.56 788.14 517.32 1024.68 651.20 1196.03 716.95 1033.39 904.01 1813.34 853.15 1664.20 640.88 1296.57 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 8 16 24 32 40 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 19.76 10.13 23.18 11.70 24.55 13.32 22.30 30.95 35.34 35.12 28.09 28.73 24.93 24.61 MIN: 10.1 / MAX: 35.55 MIN: 9.28 / MAX: 20.91 MIN: 12.53 / MAX: 39.62 MIN: 10.76 / MAX: 20.03 MIN: 13.09 / MAX: 41.71 MIN: 10.8 / MAX: 27.29 MIN: 11.46 / MAX: 38.87 MIN: 16.7 / MAX: 61.98 MIN: 17.29 / MAX: 68.72 MIN: 31.16 / MAX: 58.07 MIN: 13.13 / MAX: 55.07 MIN: 25.35 / MAX: 48.34 MIN: 12.1 / MAX: 57.1 MIN: 21.31 / MAX: 35.8 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40 80 120 160 200 SE +/- 0.13, N = 3 SE +/- 0.19, N = 3 SE +/- 0.29, N = 3 SE +/- 0.17, N = 3 SE +/- 0.31, N = 3 SE +/- 0.21, N = 3 SE +/- 0.65, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 3 SE +/- 0.33, N = 3 SE +/- 0.24, N = 3 SE +/- 0.38, N = 3 SE +/- 0.06, N = 3 SE +/- 0.18, N = 3 49.20 94.18 60.67 119.68 75.28 152.10 83.73 116.30 112.12 204.17 102.67 181.98 77.99 144.01 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60 120 180 240 300 SE +/- 0.41, N = 3 SE +/- 0.16, N = 3 SE +/- 0.94, N = 3 SE +/- 0.14, N = 3 SE +/- 0.84, N = 3 SE +/- 0.13, N = 3 SE +/- 1.43, N = 3 SE +/- 0.24, N = 3 SE +/- 0.16, N = 3 SE +/- 0.13, N = 3 SE +/- 0.26, N = 3 SE +/- 0.14, N = 3 SE +/- 0.09, N = 3 SE +/- 0.07, N = 3 162.40 84.87 197.58 100.17 212.22 105.07 190.87 274.66 142.53 78.16 116.82 65.81 102.51 55.49 MIN: 81.47 / MAX: 190.75 MIN: 79.52 / MAX: 104.17 MIN: 108.45 / MAX: 224.88 MIN: 87.19 / MAX: 120.18 MIN: 102.13 / MAX: 251.51 MIN: 87.23 / MAX: 132.74 MIN: 91.92 / MAX: 221.58 MIN: 113.93 / MAX: 346.09 MIN: 52.25 / MAX: 172.52 MIN: 70.17 / MAX: 99.06 MIN: 63.95 / MAX: 139.61 MIN: 58.3 / MAX: 79.61 MIN: 56.14 / MAX: 121.15 MIN: 48.46 / MAX: 70.39 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 1500 3000 4500 6000 7500 SE +/- 0.17, N = 3 SE +/- 0.17, N = 3 SE +/- 0.09, N = 3 SE +/- 0.28, N = 3 SE +/- 0.26, N = 3 SE +/- 1.61, N = 3 SE +/- 0.33, N = 3 SE +/- 1.30, N = 3 SE +/- 1.10, N = 3 SE +/- 0.75, N = 3 SE +/- 0.53, N = 3 SE +/- 3.20, N = 3 SE +/- 0.48, N = 3 SE +/- 2.46, N = 3 913.75 1934.07 1211.31 2570.67 1520.46 3255.75 1628.99 2475.95 3345.71 7209.16 3090.28 6564.47 2347.83 4979.27 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 6 12 18 24 30 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 17.50 16.53 19.80 18.66 21.03 19.64 19.63 25.83 9.55 8.86 7.75 7.30 6.80 6.41 MIN: 9.9 / MAX: 31.67 MIN: 15.85 / MAX: 27.79 MIN: 9.47 / MAX: 32.84 MIN: 17.49 / MAX: 31.43 MIN: 10.07 / MAX: 37.02 MIN: 17.9 / MAX: 30.08 MIN: 10.05 / MAX: 32.68 MIN: 12.36 / MAX: 42.4 MIN: 5.64 / MAX: 161.27 MIN: 7.46 / MAX: 22.29 MIN: 4.53 / MAX: 25.85 MIN: 6.03 / MAX: 21.33 MIN: 4.77 / MAX: 21.69 MIN: 5.31 / MAX: 19.26 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 400 800 1200 1600 2000 SE +/- 2.63, N = 3 SE +/- 1.01, N = 3 SE +/- 0.50, N = 3 SE +/- 0.70, N = 3 SE +/- 0.76, N = 3 SE +/- 3.83, N = 3 SE +/- 3.78, N = 3 SE +/- 1.02, N = 3 SE +/- 0.64, N = 3 SE +/- 2.61, N = 3 SE +/- 1.01, N = 3 SE +/- 1.68, N = 3 SE +/- 0.53, N = 3 SE +/- 1.01, N = 3 646.15 1132.27 769.91 1313.76 987.77 1713.90 1112.62 1542.73 899.05 1619.83 810.68 1382.22 617.71 1076.16 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 5 10 15 20 25 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 12.37 7.05 15.57 9.12 16.18 9.32 14.37 20.72 17.77 9.85 14.78 8.65 12.93 7.41 MIN: 7.65 / MAX: 28.74 MIN: 6.43 / MAX: 17.91 MIN: 8.87 / MAX: 31.65 MIN: 7.26 / MAX: 24.13 MIN: 8.55 / MAX: 33.46 MIN: 7.86 / MAX: 22.87 MIN: 8.67 / MAX: 30.82 MIN: 16.73 / MAX: 74.02 MIN: 9.82 / MAX: 36.18 MIN: 8.63 / MAX: 22.81 MIN: 8.27 / MAX: 28.31 MIN: 7.32 / MAX: 20.32 MIN: 7.44 / MAX: 25.18 MIN: 6.33 / MAX: 18.13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 10K 20K 30K 40K 50K SE +/- 16.19, N = 3 SE +/- 47.98, N = 3 SE +/- 2.86, N = 3 SE +/- 25.78, N = 3 SE +/- 9.24, N = 3 SE +/- 39.42, N = 3 SE +/- 8.38, N = 3 SE +/- 113.09, N = 3 SE +/- 9.27, N = 3 SE +/- 9.04, N = 3 SE +/- 22.59, N = 3 SE +/- 46.35, N = 3 SE +/- 6.67, N = 3 SE +/- 51.77, N = 3 13149.71 25795.58 17211.28 34019.21 21308.51 42487.49 23118.27 33271.17 22808.14 47801.07 20000.76 41669.50 15262.36 32137.13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.4275 0.855 1.2825 1.71 2.1375 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.21 1.23 1.39 1.40 1.49 1.50 1.37 1.90 1.38 1.32 1.19 1.14 1.04 0.99 MIN: 0.71 / MAX: 41.75 MIN: 1.03 / MAX: 14.15 MIN: 0.77 / MAX: 14.54 MIN: 1.13 / MAX: 14.36 MIN: 0.7 / MAX: 73.62 MIN: 1.19 / MAX: 14.26 MIN: 0.75 / MAX: 14.85 MIN: 0.99 / MAX: 27.38 MIN: 0.61 / MAX: 20.84 MIN: 1.02 / MAX: 14.4 MIN: 0.57 / MAX: 16.29 MIN: 0.85 / MAX: 14.64 MIN: 0.63 / MAX: 14.02 MIN: 0.73 / MAX: 12.92 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 12K 24K 36K 48K 60K SE +/- 3.86, N = 3 SE +/- 47.15, N = 3 SE +/- 25.63, N = 3 SE +/- 96.63, N = 3 SE +/- 36.34, N = 3 SE +/- 31.93, N = 3 SE +/- 28.61, N = 3 SE +/- 463.83, N = 3 SE +/- 22.82, N = 3 SE +/- 28.36, N = 3 SE +/- 19.47, N = 3 SE +/- 11.43, N = 3 SE +/- 12.78, N = 3 SE +/- 51.11, N = 3 14256.40 27742.34 18711.92 36411.01 23116.82 45746.27 25079.41 34339.21 25216.38 54275.42 22510.58 47664.17 17148.89 36784.83 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 0.3915 0.783 1.1745 1.566 1.9575 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.11 1.14 1.27 1.30 1.37 1.39 1.27 1.74 1.23 1.16 1.05 0.99 0.92 0.86 MIN: 0.62 / MAX: 14.15 MIN: 0.96 / MAX: 12.95 MIN: 0.72 / MAX: 14.84 MIN: 1.07 / MAX: 14.22 MIN: 0.85 / MAX: 19.76 MIN: 1.14 / MAX: 14.4 MIN: 0.71 / MAX: 14.55 MIN: 0.91 / MAX: 22.45 MIN: 0.58 / MAX: 21.43 MIN: 0.91 / MAX: 14.56 MIN: 0.49 / MAX: 15.59 MIN: 0.73 / MAX: 14.31 MIN: 0.52 / MAX: 14.11 MIN: 0.67 / MAX: 13.21 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
Apache Cassandra Test: Writes OpenBenchmarking.org Op/s, More Is Better Apache Cassandra 4.0 Test: Writes EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60K 120K 180K 240K 300K SE +/- 902.56, N = 3 SE +/- 2617.59, N = 3 SE +/- 369.63, N = 3 SE +/- 1215.21, N = 3 SE +/- 591.09, N = 3 SE +/- 432.91, N = 3 SE +/- 1364.13, N = 3 SE +/- 1599.50, N = 3 SE +/- 104.54, N = 3 SE +/- 515.32, N = 3 SE +/- 408.15, N = 3 SE +/- 950.77, N = 3 SE +/- 609.52, N = 3 SE +/- 894.00, N = 3 172713 236544 224875 225784 263627 245226 246339 253058 176284 156487 200958 190873 177347 171138
RocksDB Test: Random Fill OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Fill EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K SE +/- 582.91, N = 3 SE +/- 6147.44, N = 3 SE +/- 1471.77, N = 3 SE +/- 1896.83, N = 3 SE +/- 4422.55, N = 15 SE +/- 1034.90, N = 3 SE +/- 2590.86, N = 3 SE +/- 2134.61, N = 3 SE +/- 1945.00, N = 3 SE +/- 2897.98, N = 3 SE +/- 5000.73, N = 3 SE +/- 3806.40, N = 3 SE +/- 6232.77, N = 15 316199 740490 306931 809625 328435 743355 455327 1088420 481703 1272718 590231 1300143 908869 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Read EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 60M 120M 180M 240M 300M SE +/- 286135.95, N = 3 SE +/- 547389.34, N = 3 SE +/- 885950.65, N = 3 SE +/- 207267.91, N = 3 SE +/- 716630.49, N = 3 SE +/- 275956.06, N = 3 SE +/- 795243.99, N = 3 SE +/- 260236.87, N = 3 SE +/- 2092706.33, N = 3 SE +/- 594128.06, N = 3 SE +/- 1248520.83, N = 3 SE +/- 427323.28, N = 3 SE +/- 779454.00, N = 3 181223940 120400741 238439429 150974278 299129297 161712224 246464521 113495056 226944746 104010467 210724462 77391048 154099244 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
RocksDB Test: Update Random OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Update Random EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200K 400K 600K 800K 1000K SE +/- 17553.74, N = 12 SE +/- 708.38, N = 3 SE +/- 3018.40, N = 3 SE +/- 1717.10, N = 3 SE +/- 3148.37, N = 3 SE +/- 2864.72, N = 3 SE +/- 339.25, N = 3 SE +/- 1039.48, N = 3 SE +/- 379.98, N = 3 SE +/- 1500.76, N = 3 SE +/- 9205.01, N = 15 SE +/- 648.59, N = 3 SE +/- 1819.77, N = 3 481479 638378 336131 707656 351517 688172 436633 793742 466697 743700 640738 700379 803231 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
RocksDB Test: Sequential Fill OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Sequential Fill EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 300K 600K 900K 1200K 1500K SE +/- 532.43, N = 3 SE +/- 3079.56, N = 3 SE +/- 319.69, N = 3 SE +/- 2451.41, N = 3 SE +/- 597.87, N = 3 SE +/- 1902.35, N = 3 SE +/- 106.07, N = 3 SE +/- 4969.08, N = 3 SE +/- 3588.97, N = 3 SE +/- 1492.53, N = 3 SE +/- 4947.74, N = 3 SE +/- 2179.57, N = 3 SE +/- 6746.06, N = 3 323598 821279 286858 864802 299732 774765 452291 1269946 488659 1443216 597465 1508607 966189 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
RocksDB Test: Random Fill Sync OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Fill Sync EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 80K 160K 240K 320K 400K SE +/- 335.00, N = 3 SE +/- 831.59, N = 3 SE +/- 1013.52, N = 3 SE +/- 911.55, N = 3 SE +/- 1581.82, N = 3 SE +/- 1077.11, N = 3 SE +/- 1530.69, N = 3 SE +/- 79.36, N = 3 SE +/- 931.26, N = 3 SE +/- 194.11, N = 3 SE +/- 6251.07, N = 15 SE +/- 98.97, N = 3 SE +/- 2669.53, N = 3 170828 199221 165480 238127 197227 233743 267282 297029 307133 277553 367162 208713 289896 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
RocksDB Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Read While Writing EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 2M 4M 6M 8M 10M SE +/- 76523.17, N = 13 SE +/- 43415.41, N = 4 SE +/- 142144.80, N = 15 SE +/- 32029.62, N = 3 SE +/- 135593.38, N = 15 SE +/- 15721.89, N = 3 SE +/- 68024.06, N = 3 SE +/- 22775.73, N = 3 SE +/- 153728.35, N = 12 SE +/- 40873.57, N = 5 SE +/- 44785.37, N = 3 SE +/- 23057.76, N = 3 SE +/- 42331.24, N = 15 4864299 4117643 6957204 5130684 8063050 5147499 7932933 4793137 7436444 3825346 6230967 3142066 4943670 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
RocksDB Test: Read Random Write Random OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Read Random Write Random EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 600K 1200K 1800K 2400K 3000K SE +/- 3492.11, N = 3 SE +/- 2301.51, N = 3 SE +/- 6678.29, N = 3 SE +/- 1879.76, N = 3 SE +/- 5136.66, N = 3 SE +/- 17808.71, N = 3 SE +/- 27203.96, N = 6 SE +/- 2675.18, N = 3 SE +/- 17390.98, N = 15 SE +/- 4554.38, N = 3 SE +/- 14296.96, N = 3 SE +/- 2003.10, N = 3 SE +/- 37734.79, N = 3 2195191 2369439 2190994 2750066 2204871 2690298 2761836 2770547 2579926 2420422 2779890 2311235 2762454 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
nginx Connections: 100 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 100 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7543 Xeon Gold 6338 Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 50K 100K 150K 200K 250K SE +/- 889.98, N = 3 SE +/- 7.14, N = 3 SE +/- 1585.18, N = 5 SE +/- 66.37, N = 3 SE +/- 118.51, N = 3 SE +/- 57.06, N = 3 SE +/- 68.69, N = 3 SE +/- 497.21, N = 3 SE +/- 93.41, N = 3 SE +/- 249.31, N = 3 146481.53 127405.11 144891.45 152248.92 147786.59 151274.54 140495.61 225527.80 118699.47 199748.09 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl
nginx Connections: 200 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 200 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40K 80K 120K 160K 200K SE +/- 248.07, N = 3 SE +/- 83.69, N = 3 SE +/- 288.51, N = 3 SE +/- 142.56, N = 3 SE +/- 704.77, N = 3 SE +/- 73.04, N = 3 SE +/- 498.75, N = 3 SE +/- 41.84, N = 3 SE +/- 271.76, N = 3 SE +/- 76.21, N = 3 SE +/- 512.32, N = 3 SE +/- 24.68, N = 3 SE +/- 149.37, N = 3 155325.61 129033.29 135890.54 160998.23 151573.48 161270.01 167224.22 160541.79 205570.62 141544.55 205476.78 118110.63 207770.19 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl
nginx Connections: 500 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 500 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40K 80K 120K 160K 200K SE +/- 185.36, N = 3 SE +/- 37.87, N = 3 SE +/- 279.41, N = 3 SE +/- 89.54, N = 3 SE +/- 800.94, N = 3 SE +/- 72.87, N = 3 SE +/- 309.16, N = 3 SE +/- 37.98, N = 3 SE +/- 313.96, N = 3 SE +/- 169.87, N = 3 SE +/- 580.70, N = 3 SE +/- 92.60, N = 3 SE +/- 232.73, N = 3 157128.24 131406.38 133788.29 159784.56 140932.43 165787.42 156012.00 160307.52 180812.11 141031.60 204325.45 113630.04 207339.64 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl
nginx Connections: 1000 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 1000 EPYC 7343 2P EPYC 7413 EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 40K 80K 120K 160K 200K SE +/- 189.01, N = 3 SE +/- 1390.17, N = 3 SE +/- 94.36, N = 3 SE +/- 336.74, N = 3 SE +/- 148.74, N = 3 SE +/- 323.88, N = 3 SE +/- 234.38, N = 3 SE +/- 416.78, N = 3 SE +/- 108.10, N = 3 SE +/- 520.06, N = 3 SE +/- 58.40, N = 3 SE +/- 140.88, N = 3 151418.97 129682.72 156398.74 135921.70 165810.67 151997.72 164486.94 178255.95 153700.70 200467.73 109860.58 199978.55 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 -std=c99 -O2 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl
PHPBench PHP Benchmark Suite OpenBenchmarking.org Score, More Is Better PHPBench 0.8.1 PHP Benchmark Suite EPYC 7343 EPYC 7343 2P EPYC 7413 EPYC 7413 2P EPYC 7513 EPYC 7513 2P EPYC 7543 EPYC 7713P Xeon Gold 6338 Xeon Gold 6338 2P Xeon Gold 6342 Xeon Gold 6342 2P Xeon Gold 6346 Xeon Gold 6346 2P 200K 400K 600K 800K 1000K SE +/- 1077.87, N = 3 SE +/- 2797.29, N = 3 SE +/- 1332.81, N = 3 SE +/- 4937.26, N = 3 SE +/- 4086.10, N = 3 SE +/- 1938.22, N = 3 SE +/- 1437.74, N = 3 SE +/- 3010.31, N = 3 SE +/- 1918.32, N = 3 SE +/- 340.03, N = 3 SE +/- 581.13, N = 3 SE +/- 580.18, N = 3 SE +/- 678.65, N = 3 SE +/- 1806.45, N = 3 732752 735624 670928 680136 678084 686597 687000 678966 719675 722240 788731 789297 812732 809727
Phoronix Test Suite v10.8.5