STW AMD EPYC Milan vs. Intel Xeon Ice Lake Server Benchmarks

Benchmarks by Michael Larabel, preparations for a future article on Phoronix.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2305089-PTS-STWSERVE31
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

Timed Code Compilation 3 Tests
C/C++ Compiler Tests 8 Tests
CPU Massive 14 Tests
Creator Workloads 12 Tests
Database Test Suite 5 Tests
Encoding 6 Tests
Fortran Tests 2 Tests
HPC - High Performance Computing 13 Tests
Common Kernel Benchmarks 3 Tests
Machine Learning 4 Tests
Molecular Dynamics 5 Tests
MPI Benchmarks 4 Tests
Multi-Core 21 Tests
NVIDIA GPU Compute 3 Tests
Intel oneAPI 4 Tests
OpenMPI Tests 7 Tests
Programmer / Developer System Benchmarks 3 Tests
Python Tests 6 Tests
Renderers 3 Tests
Scientific Computing 5 Tests
Server 8 Tests
Server CPU Tests 10 Tests
Single-Threaded 2 Tests
Video Encoding 6 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
EPYC 7343
April 26 2023
  16 Hours, 30 Minutes
EPYC 7343 2P
April 25 2023
  16 Hours, 48 Minutes
EPYC 7413
March 13 2023
  16 Hours, 11 Minutes
EPYC 7413 2P
March 24 2023
  17 Hours, 39 Minutes
EPYC 7513
March 09 2023
  17 Hours, 17 Minutes
EPYC 7513 2P
March 29 2023
  17 Hours, 11 Minutes
EPYC 7543
March 08 2023
  16 Hours, 14 Minutes
EPYC 7713P
March 06 2023
  17 Hours, 24 Minutes
Xeon Gold 6338
April 03 2023
  14 Hours, 15 Minutes
Xeon Gold 6338 2P
March 22 2023
  15 Hours, 18 Minutes
Xeon Gold 6342
April 05 2023
  12 Hours, 26 Minutes
Xeon Gold 6342 2P
March 20 2023
  15 Hours, 1 Minute
Xeon Gold 6346
April 20 2023
  16 Hours, 25 Minutes
Xeon Gold 6346 2P
March 18 2023
  17 Hours, 22 Minutes
Invert Hiding All Results Option
  16 Hours, 9 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


STW AMD EPYC Milan vs. Intel Xeon Ice Lake Server BenchmarksProcessorMotherboardMemoryDiskGraphicsMonitorOSKernelCompilerFile-SystemScreen ResolutionEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2PAMD EPYC 7343 16-Core @ 3.20GHz (16 Cores / 32 Threads)Supermicro H12SSL-i v1.02 (2.4 BIOS)8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07astdrmfbDELL E207WFPAlmaLinux 9.15.14.0-162.12.1.el9_1.x86_64 (x86_64)GCC 11.3.1 20220421ext41680x10502 x AMD EPYC 7343 16-Core @ 3.20GHz (32 Cores / 64 Threads)Supermicro H12DSi-N6 v1.02 (2.3 BIOS)16 x 32 GB DDR4-3200MT/s Samsung M393A4K40EB3-CWE5.14.0-162.18.1.el9_1.x86_64 (x86_64)1280x1024AMD EPYC 7413 24-Core @ 2.65GHz (24 Cores / 48 Threads)Supermicro H12SSL-i v1.02 (2.4 BIOS)8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE5.14.0-162.12.1.el9_1.x86_64 (x86_64)1024x7682 x AMD EPYC 7413 24-Core @ 2.65GHz (48 Cores / 96 Threads)Supermicro H12DSi-N6 v1.02 (2.3 BIOS)512GB5.14.0-162.18.1.el9_1.x86_64 (x86_64)AMD EPYC 7513 32-Core @ 2.60GHz (32 Cores / 64 Threads)Supermicro H12SSL-i v1.02 (2.4 BIOS)8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE5.14.0-162.12.1.el9_1.x86_64 (x86_64)2 x AMD EPYC 7513 32-Core @ 2.60GHz (64 Cores / 128 Threads)Supermicro H12DSi-N6 v1.02 (2.3 BIOS)512GB5.14.0-162.18.1.el9_1.x86_64 (x86_64)AMD EPYC 7543 32-Core @ 2.80GHz (32 Cores / 64 Threads)Supermicro H12SSL-i v1.02 (2.4 BIOS)8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWEDELL E207WFP5.14.0-162.12.1.el9_1.x86_64 (x86_64)1680x1050AMD EPYC 7713P 64-Core @ 2.00GHz (64 Cores / 128 Threads)1024x768Intel Xeon Gold 6338 @ 3.20GHz (32 Cores / 64 Threads)Supermicro X12SPO-NTF v2.00 (1.2 BIOS)DELL E207WFP1280x10242 x Intel Xeon Gold 6338 @ 3.20GHz (64 Cores / 128 Threads)Supermicro X12DPi-N6 v1.01 (1.4 BIOS)16 x 32 GB DDR4-3200MT/s Samsung M393A4K40EB3-CWEIntel Xeon Gold 6342 @ 3.50GHz (24 Cores / 48 Threads)Supermicro X12SPO-NTF v2.00 (1.2 BIOS)8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE2 x Intel Xeon Gold 6342 @ 3.50GHz (48 Cores / 96 Threads)Supermicro X12DPi-N6 v1.01 (1.4 BIOS)16 x 32 GB DDR4-3200MT/s Samsung M393A4K40EB3-CWEIntel Xeon Gold 6346 @ 3.60GHz (16 Cores / 32 Threads)Supermicro X12SPO-NTF v2.00 (1.2 BIOS)8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE2 x Intel Xeon Gold 6346 @ 3.60GHz (32 Cores / 64 Threads)Supermicro X12DPi-N6 v1.01 (1.4 BIOS)16 x 32 GB DDR4-3200MT/s Samsung M393A4K40EB3-CWE1024x768OpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Details- EPYC 7343: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173- EPYC 7343 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173- EPYC 7413: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173- EPYC 7413 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173- EPYC 7513: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173- EPYC 7513 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173- EPYC 7543: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173- EPYC 7713P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173- Xeon Gold 6338: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375- Xeon Gold 6338 2P: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375- Xeon Gold 6342: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375- Xeon Gold 6342 2P: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375- Xeon Gold 6346: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375- Xeon Gold 6346 2P: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xd000375Java Details- OpenJDK Runtime Environment (Red_Hat-11.0.18.0.10-2.el9_1) (build 11.0.18+10-LTS)Python Details- Python 3.9.14Security Details- EPYC 7343: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 7343 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 7413: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 7413 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 7513: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 7513 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 7543: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 7713P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Xeon Gold 6338: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Gold 6338 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Gold 6342: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Gold 6342 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Gold 6346: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Gold 6346 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

EPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2PResult OverviewPhoronix Test Suite100%200%300%400%500%OSPRay StudioCloudSuite In-Memory AnalyticsPennantOpenSSLLULESHTensorFlowBlenderNAMDEmbreeOpenVINOXcompact3d Incompact3dTimed Node.js CompilationHigh Performance Conjugate GradientTimed LLVM CompilationSVT-HEVCLuxCoreRenderTimed Linux Kernel CompilationPostgreSQLKvazaarMemcacheduvg266Neural Magic DeepSparseApache CassandraCloudSuite Graph AnalyticsSVT-VP9ClickHouseCloudSuite Web ServingSVT-AV1PHPBenchFFmpeg

EPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2PPer Watt Result OverviewPhoronix Test Suite100%166%232%298%364%TensorFlowOpenSSLApache CassandraLuxCoreRenderCloudSuite Web ServingEmbreePHPBenchSVT-HEVCSVT-VP9uvg266SVT-AV1MemcachedKvazaarFFmpegLULESHClickHouseHigh Performance Conjugate GradientP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.M

STW AMD EPYC Milan vs. Intel Xeon Ice Lake Server Benchmarkshpcg: minibude: OpenMP - BM1minibude: OpenMP - BM1namd: ATPase Simulation - 327,506 Atomsnekrs: TurboPipe Periodicpennant: sedovbigpennant: leblancbigincompact3d: X3D-benchmarking input.i3dincompact3d: input.i3d 193 Cells Per Directionlulesh: luxcorerender: Danish Mood - CPUluxcorerender: Orange Juice - CPUluxcorerender: LuxCore Benchmark - CPUluxcorerender: Rainbow Colors and Prism - CPUembree: Pathtracer - Crownembree: Pathtracer ISPC - Crownembree: Pathtracer - Asian Dragonembree: Pathtracer ISPC - Asian Dragonkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 4K - Very Fastkvazaar: Bosphorus 4K - Super Fastsvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-hevc: 1 - Bosphorus 4Ksvt-hevc: 7 - Bosphorus 4Ksvt-hevc: 10 - Bosphorus 4Ksvt-vp9: VMAF Optimized - Bosphorus 4Ksvt-vp9: PSNR/SSIM Optimized - Bosphorus 4Ksvt-vp9: Visual Quality Optimized - Bosphorus 4Kuvg266: Bosphorus 4K - Slowuvg266: Bosphorus 4K - Mediumuvg266: Bosphorus 1080p - Slowuvg266: Bosphorus 1080p - Mediumuvg266: Bosphorus 4K - Very Fastuvg266: Bosphorus 4K - Super Fastuvg266: Bosphorus 4K - Ultra Fastuvg266: Bosphorus 1080p - Very Fastuvg266: Bosphorus 1080p - Super Fastuvg266: Bosphorus 1080p - Ultra Fastbuild-linux-kernel: defconfigbuild-llvm: Ninjabuild-llvm: Unix Makefilesbuild-nodejs: Time To Compileonednn: Convolution Batch Shapes Auto - f32 - CPUospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 3 - 4K - 32 - Path Tracerffmpeg: libx264 - Liveffmpeg: libx265 - Liveffmpeg: libx265 - Liveffmpeg: libx265 - Uploadffmpeg: libx265 - Uploadffmpeg: libx265 - Platformffmpeg: libx265 - Platformffmpeg: libx265 - Video On Demandffmpeg: libx265 - Video On Demandopenssl: SHA256openssl: RSA4096openssl: RSA4096clickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Runmemcached: 1:5memcached: 1:10memcached: 1:100graph500: 26graph500: 26graph500: 26graph500: 26gromacs: MPI CPU - water_GMX50_barepgbench: 1000 - 800 - Read Onlypgbench: 1000 - 800 - Read Only - Average Latencypgbench: 1000 - 1000 - Read Onlypgbench: 1000 - 1000 - Read Only - Average Latencypgbench: 1000 - 800 - Read Writepgbench: 1000 - 800 - Read Write - Average Latencypgbench: 1000 - 1000 - Read Writepgbench: 1000 - 1000 - Read Write - Average Latencytensorflow: CPU - 256 - ResNet-50tensorflow: CPU - 512 - ResNet-50deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Barbershop - CPU-Onlycloudsuite-ga: Page Rankcloudsuite-ga: Triangle Countcloudsuite-ga: Connected Componentscloudsuite-ma: Largecloudsuite-ma: Smallcloudsuite-ws: 100cloudsuite-ws: 400cloudsuite-ws: 500openvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUcassandra: Writesrocksdb: Rand Readrocksdb: Update Randrocksdb: Seq Fillrocksdb: Rand Fill Syncrocksdb: Read While Writingrocksdb: Read Rand Write Randnginx: 200nginx: 500nginx: 1000phpbench: PHP Benchmark SuiteEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P18.13671.1434026.9280716.69242880.63926235.555610610323.1762.485.052.7212.1221.217020.006723.764723.061314.9432.3541.24179.068172.1613.7971.41143.45111.82115.8083.739.2610.4238.5243.1128.9430.0035.28110.98116.79130.3063.491347.363392.194337.2206805817222429826523823.1840.81123.76103.9624.29151.8549.89152.0549.82248911012674398.6287549.0336.88346.00345.532199582.802548333.191610909.223098170003129890001142950001497100006957611.1506852391.4592567931.1582482140.29422.3722.9112.6466629.1859163.555448.860552.2641152.8306144.228255.4127105.957675.414417.7432450.603353.5991148.958412.6201627.685382.60219.83815.391152510898815718122575139957.33311.83311.64.271850.232.842790.522.822813.45389.7120.519.36854.22654.1412.22404.5619.7649.20162.40913.7517.50646.1512.3713149.711.2114256.401.1117271373275235.31961398.41155.9360.5926016690100000013.474347.618046484.98540218.024458627713.9434.108.594.4613.0337.750335.489838.966738.010922.5045.8657.13204.549191.0177.28116.56191.99152.31158.14130.2314.8916.7843.9249.1541.2042.9546.65134.43142.78155.3338.974190.969240.493190.9971.188403628433612026414261123.4148.59103.93107.1923.56162.33916891246.66161.7246.84496940000478794.6574456.9423.79443.07443.722421891.742826219.162373328.374225290004444740001742190002189860004.0838556420.9358490191.178849294.5908356119.68224.0325.4324.9183636.2769280.431756.976797.1983164.1407287.181355.5978206.532377.342733.4196475.8713104.8912152.148625.0243634.729641.30109.64435.0298207727814547147944460595.5511.43311.2177.761028.985.531445.135.521447.06734.9910.8818.85423.551243.246.42788.1410.1394.1884.871934.0716.531132.277.0525795.581.2327742.341.1423654418122394048147932359817082848642992195191155325.61157128.24151418.9773562417.8487901.85036.0740.8867711235033333321.4193612.95789766.72054032.39508579682.79933.336.563.6815.1127.424025.830131.896530.453516.1033.4143.02210.554195.7984.8985.67181.39140.28143.85107.7710.5411.8738.4543.2731.3033.1038.88118.56125.26138.7952.718275.254320.942270.8402.137315121606717019020005724.8843.08117.23108.8023.21159.8947.38160.1347.31330954078005947.9390326.3351.34363.28360.642917560.703431617.242309617.423.0059124270.8778842131.1312425133.2132567438.97023.4324.1616.3219729.3104226.049453.031667.2045178.2114192.680562.1975139.271986.079023.2903515.056670.4128170.163616.3700729.060262.03165.39616.5198158411414011124002235757.58314.73314.5835.442183.993.613275.513.593280.27479.0025.0312.17979.21833.9914.38517.3223.1860.67197.581211.3119.80769.9115.5717211.281.3918711.921.2722487512040074163837882127919922141176432369439129033.29131406.38129682.7267092827.63261718.93668.7570.4705319422166666710.798515.976653700.10178615.689407725716.7685.1411.245.5615.7349.949646.597448.349146.293023.2048.9361.75217.432193.7789.18136.95208.59154.60161.19145.3016.0018.0659.5266.4745.9848.0749.77164.25163.18165.3333.819161.530216.184165.4710.940455272232529383411055825.2451.3498.37114.4122.07172.9643.80172.8143.846620623195711846.8778483.0429.39437.50440.922164592.243691244.972952893.825840340006011200002252840002947820004.8207650901.0517281841.377873691.6029798102.07324.0425.3632.2500738.7817384.289662.3607127.5406187.6814370.193764.7191270.274088.630843.9125544.6158137.0417174.617032.2535739.762431.8082.55330.02983174003144262258551112245.311.96712.08310.061190.687.011688.627.011689.48852.0814.0724.72483.371570.387.631024.6811.70119.68100.172570.6718.661313.769.1234019.211.436411.011.3022578423843942933613128685816548069572042190994135890.54133788.2968013617.68031177.57147.1030.7158512890433333317.8868910.83575784.79716030.735649118098.8044.358.184.6417.4434.184533.143040.210738.350520.3342.3252.81231.540210.2356.22111.95207.54161.26164.17129.2213.4315.1040.5245.6039.5241.4646.07129.79138.95153.9744.751230.689282.423226.6311.950164014476913563615909724.3542.56118.65108.1623.35159.1247.61158.7147.73422849544307637.8501938.9362.00377.03379.673632495.024198464.112981451.325178100005282000001763710002262390003.5479843940.8229763321.0241377758.0701386572.39923.7724.6619.8959791.9745283.711856.326082.5527193.4699240.409566.4697172.730592.543329.2692546.280786.9371183.717019.9788792.457149.24130.35482.8299177789313102134575368087.41714.88315.2676.672369.524.443561.394.453537.87603.3626.5015.291038.361076.3014.86651.2024.5575.28212.221520.4621.03987.7716.1821308.511.4923116.821.3726362715097427870765686480223812751306842750066160998.23159784.56156398.7467808434.53442333.75593.3500.367162186030000008.7614624.827648432.07365915.813343037170.8556.4313.406.7517.4462.356058.900453.811651.936425.0254.1363.53217.701193.15111.56149.01201.76163.58165.46148.8417.2619.5963.0070.7551.0551.4653.21173.58173.74175.3529.784140.277199.575143.5970.78680321502538745668670424.4649.98101.05113.7222.20171.4144.19171.5344.168436576722315222.31003089.4412.09436.77435.851867112.744105338.273518612.746656550006919830002550360003224750005.5896900191.1786387311.569855297.5171065193.90322.7523.9639.5929803.4468488.625465.3924156.2377204.2260468.926368.1249335.989095.084855.4706575.3658170.2562187.517139.6557802.156925.4664.96262.94958770042138913016301813495.41711.211.81712.551272.588.821803.098.811804.951173.4213.6231.43507.622097.597.621196.0313.32152.10105.073255.7519.641713.909.3242487.491.5045746.271.3924522629912929735151729973219722780630502204871151573.48140932.43135921.7068659719.33851261.44150.4580.6555414911533333315.397178.575596716.61800124.108243321129.4124.368.424.7416.6937.280435.116241.951940.509621.0443.2554.27237.131214.3876.69119.84219.43171.65175.18137.5214.0015.7741.0946.1440.6742.8147.24130.26139.65154.3842.087212.302260.908209.9431.301383767448612707814899023.8644.47113.57107.9023.40158.2447.87158.4147.82443248230907963.1522787.3410.64425.45425.483574540.353481927.792848831.245443420005540820002045190002680160004.00110747650.74510087410.9911184567.5381206883.02425.3426.2622.0707716.0241294.207954.316291.5684174.3602256.523562.2907186.088785.868831.3942507.663193.9657169.934922.1183716.119546.24122.97456.2792477425013358130123373156.58313.813.057.322162.684.953186.874.943217.57675.8823.6616.56961.411166.6913.70716.9522.3083.73190.871628.9919.631112.6214.3723118.271.3725079.411.2724633916171222468817277476523374351474992690298161270.01165787.42165810.6768700019.05581912.74476.5100.4559117022933333311.319446.246704663.82519523.094244022242.5306.1012.446.7018.7352.747751.679562.565660.097819.0341.5950.67231.997203.1949.79138.52224.80172.24179.74146.4813.9915.7156.0761.6642.5645.4948.31168.38180.55196.3333.746163.543225.698166.9880.93791824242874840019865324.2047.87105.50118.4621.32174.3943.44174.2843.466971583309712568.1823388.7365.79375.36380.103378044.124786407.253893409.956913480007151540002271750002889590005.0988350870.9637213351.3861224565.3481568364.50020.7021.8531.44551010.0008455.118470.2051132.2972241.3333369.542086.4635271.8806117.483846.6790684.8470138.1362230.917831.40001010.583330.3679.30297.72911270089131692501151367217.113.26715.28310.333072.396.924538.436.924533.12940.2934.0024.811279.151735.5718.421033.3930.95116.30274.662475.9525.831542.7320.7233271.171.934339.211.7425305824646452143663345229126728279329332761836167224.22156012.00151997.7267896619.89311010.27740.4110.7021512780933333330.8694714.44702626.97611533.003833718868.7233.477.013.6713.2029.839735.836235.907845.794713.6927.4733.71194.141176.0364.491.70171.63143.42148.73111.929.7610.8828.1331.3526.7928.5031.6787.5594.98105.9651.838268.944323.073272.7301.711293314396711314913365028.2444.77112.80122.6420.59180.7141.92180.0342.08208889159736442.7419447.9311.11325.13325.934271575.654262554.192937926.065105870005192940001683740002130960003.71711236630.71210785860.9272222835.9952244644.55268.0868.3818.6692855.9968362.293544.126192.2695173.2014320.005849.9551173.771292.053733.8978471.629783.6220191.308818.6943855.778159.55161.50604.76112459323114285163851366467.51712.38313.3178.961771.705.362962.185.263023.56481.6033.1935.43450.581661.489.61904.0135.34112.12142.533345.719.55899.0517.7722808.141.3825216.381.23176284113495056793742126994629702947931372770547160541.79160307.52164486.9471967539.13632009.71680.3890.3550224229566666719.646207.347379357.23529014.686358139798.6916.0912.306.5711.3358.326969.588967.126684.863517.6336.4741.44201.074180.9198.25128.72176.67137.47144.22131.9012.5614.1244.4849.3936.0137.2238.92131.93133.13136.6033.036160.399227.371168.4252.4662716411979526466953829.1445.25111.60120.8620.89180.8241.89181.9741.634265338129312874.9838351.8388.39405.08407.093270779.443551712.122802626.266556750006679820002384600002950100007.3797502181.0667541041.3481954040.9421932251.77473.4974.6837.6996847.3755704.949945.3578177.5939179.8852639.768749.9661345.181692.639665.2131488.4066167.3832190.836737.6297848.910429.6680.17302.141123578150147512875281476537.3511.9339.618.48862.0910.841467.6710.631495.92939.0717.0173.58217.183402.824.691813.3435.12204.1778.167209.168.861619.839.8547801.071.3254275.421.1615648722694474646669748865930713374364442579926205570.62180812.11178255.9572224018.8044889.01435.5610.7517311779100000031.8319315.69182659.14532533.30064399964.41053.046.463.2913.7725.345429.174831.011340.976113.1727.0334.35206.814190.7364.0985.66173.16141.68148.12109.319.3710.5133.0237.0826.6528.8233.3098.13106.29118.4755.485292.729346.264295.5871.821903769462112786515206126.0741.27122.36113.7022.21167.8645.13167.3145.28202563980006109.7398769.3312.11321.66325.084068619.974053902.812842403.963.3769834730.8139278581.0782436032.8422537739.40961.9062.1817.3928689.6754294.760340.683083.0341144.3061286.878441.8063157.596976.120631.0113386.881175.6723158.555717.3843690.235464.90176.55680.31103408778613542140252219607.51714.715.4338.431413.055.032358.374.952400.77449.3926.6833.22360.491544.957.75853.1528.09102.67116.823090.287.75810.6814.7820000.761.1922510.581.05200958104010467743700144321627755338253462420422141544.55141031.60153700.7078873137.01551712.71868.5090.3809122763533333318.266467.523824461.11089116.508776726940.9765.8411.196.1612.6051.394561.183359.677575.248519.2739.2547.49213.420200.3817.90136.71176.18139.88148.45138.1914.2216.0051.7457.7039.0341.7344.24150.71152.28155.3833.790166.310220.500175.0062.9934019562330677758078027.0941.71121.08111.8722.57167.1645.31167.65808746345.184035510232712235.1798077.1411.38433.55425.453701213.863969670.992971169.056.7618501610.9538514641.1762192936.4832213845.17766.4366.1234.7862685.9576589.284240.6995157.8120151.8582578.252941.4567313.140576.563759.9668399.3327150.0890159.751934.8550686.447632.2587.28342.37103817345913551196790822877.18311.712.71717.34689.059.941198.229.781217.97844.3814.1967.44177.693005.723.981664.2028.73181.9865.816564.477.301382.228.6541669.501.1447664.170.9919087321072446264073859746536716262309672779890205476.78204325.45200467.7378929716.1504690.47027.6190.987429671253333341.9676219.49328889.88275140.552017210152.7572.345.012.5911.4519.758923.165523.389029.313912.2126.6433.93173.290166.7853.1165.82134.34109.47115.3783.388.189.1633.0537.0024.7026.2631.0393.17100.87113.1867.647373.677421.485374.1711.942005199632117164620712824.9940.58124.46113.2922.29165.8945.66166.4345.51146146387304397.2286703.7283.16294.82295.423346967.773159962.472164237.053596890003629180001179190001542090002.6197463021.0727425501.3472785328.7232786135.89649.2850.0113.2078605.6665242.044433.030463.3500126.1607215.842237.0399115.598369.188123.5945338.983055.7478143.487313.2099605.573086.38233.90889.711303412701517820148896138557.38313.5512.956.431232.643.872047.933.802081.75368.0221.7225.52313.141175.726.79640.8824.9377.99102.512347.836.8617.7112.9315262.361.0417148.890.9217734777391048700379150860720871331420662311235118110.63113630.04109860.5881273226.37861372.93354.9170.4935419036900000022.142679.733065725.34643621.224064922099.3244.468.774.6812.0538.904346.270443.507755.409118.3936.8445.17211.627200.4246.12117.26176.86141.50150.48130.4913.4515.0538.4343.0435.8938.4642.08116.97127.62139.8640.403204.227256.364209.3703.34125253430018729010304726.0441.42121.92110.7122.81164.3346.10165.0645.89294152104308906.1580306.3360.92378.61379.263597757.553912323.122874778.005621720005717930001876540002450530005.39110677160.7509979571.0022329034.3602358042.42354.3356.7326.5391599.8080482.924733.1059125.5955127.1627439.334136.3820231.512669.037145.5497350.6344113.0712141.356326.5164600.724642.35115.77445.24105978460814408157229410967.53311.73312.313.20604.177.621043.487.421072.35695.0611.4951.51155.152339.163.411296.5724.61144.0155.494979.276.411076.167.4132137.130.9936784.830.8617113815409924480323196618928989649436702762454207770.19207339.64199978.55809727OpenBenchmarking.org

High Performance Conjugate Gradient

HPCG is the High Performance Conjugate Gradient and is a new scientific benchmark from Sandia National Lans focused for super-computer testing with modern real-world workloads compared to HPCC. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1EPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P918273645SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.21, N = 5SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 318.1435.3217.8527.6317.6834.5319.3419.0619.8939.1418.8037.0216.1526.381. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P5001000150020002500SE +/- 11.90, N = 4SE +/- 0.56, N = 3SE +/- 3.16, N = 4SE +/- 0.14, N = 3SE +/- 4.00, N = 5SE +/- 1.10, N = 4SE +/- 3.71, N = 5SE +/- 0.83, N = 3SE +/- 4.35, N = 5SE +/- 1.48, N = 3SE +/- 7.83, N = 4SE +/- 1.38, N = 3SE +/- 0.78, N = 41398.41901.851718.941177.572333.761261.441912.741010.282009.72889.011712.72690.471372.931. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Implementation: OpenMP - Input Deck: BM1

EPYC 7343: The test quit with a non-zero exit status.

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P20406080100SE +/- 0.48, N = 4SE +/- 0.02, N = 3SE +/- 0.13, N = 4SE +/- 0.01, N = 3SE +/- 0.16, N = 5SE +/- 0.04, N = 4SE +/- 0.15, N = 5SE +/- 0.03, N = 3SE +/- 0.17, N = 5SE +/- 0.06, N = 3SE +/- 0.31, N = 4SE +/- 0.05, N = 3SE +/- 0.03, N = 455.9436.0768.7647.1093.3550.4676.5140.4180.3935.5668.5127.6254.921. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Implementation: OpenMP - Input Deck: BM1

EPYC 7343: The test quit with a non-zero exit status.

NAMD

NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD 2.14ATPase Simulation - 327,506 AtomsEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P0.25730.51460.77191.02921.2865SE +/- 0.00059, N = 3SE +/- 0.00060, N = 3SE +/- 0.00216, N = 3SE +/- 0.00231, N = 3SE +/- 0.00039, N = 3SE +/- 0.00049, N = 3SE +/- 0.00115, N = 3SE +/- 0.00061, N = 3SE +/- 0.00160, N = 3SE +/- 0.00053, N = 3SE +/- 0.00023, N = 3SE +/- 0.00083, N = 3SE +/- 0.00172, N = 3SE +/- 0.00067, N = 31.143400.592600.886770.470530.715850.367160.655540.455910.702150.355020.751730.380910.987420.49354

nekRS

nekRS is an open-source Navier Stokes solver based on the spectral element method. NekRS supports both CPU and GPU/accelerator support though this test profile is currently configured for CPU execution. NekRS is part of Nek5000 of the Mathematics and Computer Science MCS at Argonne National Laboratory. This nekRS benchmark is primarily relevant to large core count HPC servers and otherwise may be very time consuming. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFLOP/s, More Is BetternekRS 22.0Input: TurboPipe PeriodicEPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P50000M100000M150000M200000M250000MSE +/- 194054116.16, N = 3SE +/- 1160248871.77, N = 3SE +/- 716743639.28, N = 3SE +/- 130435595.01, N = 3SE +/- 716358150.65, N = 3SE +/- 37382408.22, N = 3SE +/- 603340791.85, N = 3SE +/- 165905930.51, N = 3SE +/- 1194804633.03, N = 3SE +/- 206475987.30, N = 3SE +/- 233956073.75, N = 3SE +/- 285712164.79, N = 3SE +/- 124957326.05, N = 3166901000000112350333333194221666667128904333333218603000000149115333333170229333333127809333333242295666667117791000000227635333333967125333331903690000001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi

Input: TurboPipe Periodic

EPYC 7343: The test quit with a non-zero exit status. E: mpirun noticed that process rank 0 with PID 0 on node amd-test-02 exited on signal 4 (Illegal instruction).

Pennant

Pennant is an application focused on hydrodynamics on general unstructured meshes in 2D. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: sedovbigEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1020304050SE +/- 0.053422, N = 3SE +/- 0.078086, N = 4SE +/- 0.083410, N = 3SE +/- 0.029276, N = 4SE +/- 0.031210, N = 3SE +/- 0.049248, N = 5SE +/- 0.049389, N = 3SE +/- 0.083702, N = 4SE +/- 0.015982, N = 3SE +/- 0.024622, N = 3SE +/- 0.024301, N = 3SE +/- 0.015004, N = 3SE +/- 0.018190, N = 3SE +/- 0.016802, N = 326.92807013.47434021.41936010.79851017.8868908.76146215.39717011.31944030.86947019.64620031.83193018.26646041.96762022.1426701. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: leblancbigEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P510152025SE +/- 0.027516, N = 3SE +/- 0.016342, N = 5SE +/- 0.066993, N = 4SE +/- 0.020399, N = 6SE +/- 0.065044, N = 4SE +/- 0.022993, N = 6SE +/- 0.028009, N = 5SE +/- 0.054440, N = 6SE +/- 0.017732, N = 4SE +/- 0.011875, N = 5SE +/- 0.025498, N = 3SE +/- 0.022667, N = 5SE +/- 0.006168, N = 3SE +/- 0.008469, N = 516.6924207.61804612.9578905.97665310.8357504.8276488.5755966.24670414.4470207.34737915.6918207.52382419.4932809.7330651. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi

Xcompact3d Incompact3d

Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P2004006008001000SE +/- 0.88, N = 3SE +/- 0.39, N = 3SE +/- 5.59, N = 3SE +/- 9.39, N = 3SE +/- 0.87, N = 3SE +/- 0.45, N = 3SE +/- 1.05, N = 3SE +/- 0.20, N = 3SE +/- 0.51, N = 3SE +/- 0.43, N = 3SE +/- 9.17, N = 3SE +/- 3.99, N = 9SE +/- 0.67, N = 3SE +/- 0.98, N = 3880.64484.99766.72700.10784.80432.07716.62663.83626.98357.24659.15461.11889.88725.351. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per DirectionEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P918273645SE +/- 0.14, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.28, N = 15SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.42, N = 3SE +/- 0.19, N = 4SE +/- 0.08, N = 3SE +/- 0.44, N = 1535.5618.0232.4015.6930.7415.8124.1123.0933.0014.6933.3016.5140.5521.221. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi

LULESH

LULESH is the Livermore Unstructured Lagrangian Explicit Shock Hydrodynamics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgz/s, More Is BetterLULESH 2.0.3EPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P9K18K27K36K45KSE +/- 24.59, N = 6SE +/- 149.46, N = 6SE +/- 25.11, N = 6SE +/- 276.03, N = 15SE +/- 101.13, N = 5SE +/- 90.00, N = 4SE +/- 138.07, N = 5SE +/- 29.51, N = 3SE +/- 85.02, N = 5SE +/- 13.51, N = 4SE +/- 26.68, N = 6SE +/- 38.77, N = 6SE +/- 11.87, N = 6SE +/- 40.17, N = 510323.1827713.949682.8025716.7718098.8037170.8621129.4122242.5318868.7239798.699964.4126940.9810152.7622099.321. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi

LuxCoreRender

LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Danish Mood - Acceleration: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P246810SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 5SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 32.484.103.335.144.356.434.366.103.476.093.045.842.344.46MIN: 0.84 / MAX: 2.91MIN: 1.58 / MAX: 4.79MIN: 1.21 / MAX: 3.89MIN: 1.96 / MAX: 6.18MIN: 1.68 / MAX: 5.04MIN: 2.55 / MAX: 7.63MIN: 1.72 / MAX: 5.07MIN: 2.45 / MAX: 7.16MIN: 1.22 / MAX: 4.08MIN: 2.47 / MAX: 7.28MIN: 1.09 / MAX: 3.58MIN: 2.6 / MAX: 6.73MIN: 0.74 / MAX: 2.79MIN: 1.83 / MAX: 5.18

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Orange Juice - Acceleration: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P3691215SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 35.058.596.5611.248.1813.408.4212.447.0112.306.4611.195.018.77MIN: 4.74 / MAX: 5.15MIN: 7.51 / MAX: 9.26MIN: 5.93 / MAX: 6.83MIN: 9.76 / MAX: 12.48MIN: 7.2 / MAX: 8.7MIN: 11.54 / MAX: 15.77MIN: 7.45 / MAX: 9.01MIN: 10.8 / MAX: 14.28MIN: 6.3 / MAX: 7.56MIN: 10.28 / MAX: 14.34MIN: 5.76 / MAX: 7.02MIN: 9.51 / MAX: 13.26MIN: 4.73 / MAX: 5.13MIN: 7.63 / MAX: 9.54

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: LuxCore Benchmark - Acceleration: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P246810SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 152.724.463.685.564.646.754.746.703.676.573.296.162.594.68MIN: 0.96 / MAX: 3.2MIN: 1.61 / MAX: 5.3MIN: 1.36 / MAX: 4.33MIN: 1.97 / MAX: 6.64MIN: 1.79 / MAX: 5.4MIN: 2.41 / MAX: 8.1MIN: 1.8 / MAX: 5.56MIN: 2.57 / MAX: 7.82MIN: 1.31 / MAX: 4.39MIN: 2.6 / MAX: 7.71MIN: 1.23 / MAX: 3.85MIN: 2.54 / MAX: 7.19MIN: 0.88 / MAX: 3.07MIN: 1.67 / MAX: 5.69

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Rainbow Colors and Prism - Acceleration: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P510152025SE +/- 0.08, N = 4SE +/- 0.12, N = 4SE +/- 0.12, N = 5SE +/- 0.09, N = 4SE +/- 0.05, N = 5SE +/- 0.18, N = 6SE +/- 0.18, N = 4SE +/- 0.13, N = 5SE +/- 0.11, N = 9SE +/- 0.23, N = 15SE +/- 0.13, N = 5SE +/- 0.24, N = 15SE +/- 0.07, N = 4SE +/- 0.20, N = 1512.1213.0315.1115.7317.4417.4416.6918.7313.2011.3313.7712.6011.4512.05MIN: 11.11 / MAX: 12.32MIN: 11.85 / MAX: 13.27MIN: 13.66 / MAX: 15.57MIN: 14.3 / MAX: 16.13MIN: 15.75 / MAX: 17.95MIN: 15.46 / MAX: 18.02MIN: 15.03 / MAX: 17.36MIN: 18.24 / MAX: 19.11MIN: 11.71 / MAX: 14.29MIN: 9.36 / MAX: 12.19MIN: 12.72 / MAX: 14.53MIN: 10.6 / MAX: 13.91MIN: 10.45 / MAX: 11.99MIN: 10.43 / MAX: 13.24

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.0Binary: Pathtracer - Model: CrownEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1428425670SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 4SE +/- 0.02, N = 3SE +/- 0.22, N = 5SE +/- 0.04, N = 3SE +/- 0.16, N = 4SE +/- 0.08, N = 3SE +/- 0.05, N = 4SE +/- 0.01, N = 3SE +/- 0.06, N = 4SE +/- 0.03, N = 3SE +/- 0.18, N = 321.2237.7527.4249.9534.1862.3637.2852.7529.8458.3325.3551.3919.7638.90MIN: 20.8 / MAX: 21.59MIN: 37.14 / MAX: 38.79MIN: 26.84 / MAX: 28.27MIN: 48.86 / MAX: 51.27MIN: 33.8 / MAX: 34.89MIN: 60.41 / MAX: 65.16MIN: 36.31 / MAX: 38.34MIN: 51.1 / MAX: 58.19MIN: 29.02 / MAX: 31.34MIN: 56.72 / MAX: 61.53MIN: 24.68 / MAX: 28.35MIN: 49.55 / MAX: 55.56MIN: 19.56 / MAX: 20.64MIN: 38.2 / MAX: 40.63

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.0Binary: Pathtracer ISPC - Model: CrownEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1530456075SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 4SE +/- 0.11, N = 3SE +/- 0.07, N = 5SE +/- 0.03, N = 3SE +/- 0.10, N = 4SE +/- 0.07, N = 3SE +/- 0.07, N = 5SE +/- 0.04, N = 3SE +/- 0.33, N = 5SE +/- 0.08, N = 3SE +/- 0.05, N = 420.0135.4925.8346.6033.1458.9035.1251.6835.8469.5929.1761.1823.1746.27MIN: 19.68 / MAX: 20.39MIN: 35 / MAX: 36.16MIN: 25.36 / MAX: 26.62MIN: 45.29 / MAX: 47.9MIN: 32.13 / MAX: 34.24MIN: 57.6 / MAX: 61.52MIN: 34.38 / MAX: 36.15MIN: 48.53 / MAX: 56.01MIN: 34.73 / MAX: 37.86MIN: 67.34 / MAX: 73.46MIN: 28.31 / MAX: 34.1MIN: 57.63 / MAX: 66.74MIN: 22.47 / MAX: 25.37MIN: 45.19 / MAX: 48.79

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.0Binary: Pathtracer - Model: Asian DragonEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1530456075SE +/- 0.14, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 4SE +/- 0.04, N = 4SE +/- 0.09, N = 4SE +/- 0.05, N = 4SE +/- 0.03, N = 5SE +/- 0.09, N = 3SE +/- 0.05, N = 5SE +/- 0.04, N = 3SE +/- 0.06, N = 5SE +/- 0.02, N = 3SE +/- 0.05, N = 423.7638.9731.9048.3540.2153.8141.9562.5735.9167.1331.0159.6823.3943.51MIN: 23.41 / MAX: 24.11MIN: 38.53 / MAX: 40.01MIN: 31.52 / MAX: 32.65MIN: 47.63 / MAX: 49.46MIN: 39.78 / MAX: 40.88MIN: 52.99 / MAX: 56.35MIN: 41.57 / MAX: 42.56MIN: 61.2 / MAX: 64.08MIN: 34.65 / MAX: 37.75MIN: 65.98 / MAX: 70.89MIN: 29.86 / MAX: 33.48MIN: 58.54 / MAX: 62.25MIN: 23.25 / MAX: 24.1MIN: 43 / MAX: 44.91

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.0Binary: Pathtracer ISPC - Model: Asian DragonEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P20406080100SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 4SE +/- 0.05, N = 3SE +/- 0.13, N = 4SE +/- 0.03, N = 4SE +/- 0.04, N = 5SE +/- 0.04, N = 4SE +/- 0.09, N = 6SE +/- 0.06, N = 4SE +/- 0.02, N = 5SE +/- 0.03, N = 3SE +/- 0.03, N = 423.0638.0130.4546.2938.3551.9440.5160.1045.7984.8640.9875.2529.3155.41MIN: 22.91 / MAX: 23.57MIN: 37.62 / MAX: 38.66MIN: 30.17 / MAX: 30.93MIN: 45.68 / MAX: 47.36MIN: 37.95 / MAX: 38.96MIN: 50.91 / MAX: 54.47MIN: 40.15 / MAX: 41.05MIN: 59.02 / MAX: 61.86MIN: 45.07 / MAX: 48.58MIN: 82.99 / MAX: 89.58MIN: 39.96 / MAX: 43MIN: 73.81 / MAX: 79.52MIN: 28.56 / MAX: 31.49MIN: 54.58 / MAX: 57.85

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P612182430SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.26, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 314.9422.5016.1023.2020.3325.0221.0419.0313.6917.6313.1719.2712.2118.391. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1224364860SE +/- 0.07, N = 3SE +/- 0.09, N = 4SE +/- 0.05, N = 3SE +/- 0.08, N = 4SE +/- 0.07, N = 4SE +/- 0.06, N = 5SE +/- 0.09, N = 4SE +/- 0.05, N = 4SE +/- 0.04, N = 3SE +/- 0.14, N = 4SE +/- 0.04, N = 3SE +/- 0.04, N = 4SE +/- 0.02, N = 3SE +/- 0.03, N = 432.3545.8633.4148.9342.3254.1343.2541.5927.4736.4727.0339.2526.6436.841. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super FastEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1428425670SE +/- 0.03, N = 4SE +/- 0.18, N = 5SE +/- 0.04, N = 4SE +/- 0.24, N = 5SE +/- 0.17, N = 5SE +/- 0.55, N = 5SE +/- 0.09, N = 5SE +/- 0.39, N = 15SE +/- 0.09, N = 3SE +/- 0.40, N = 15SE +/- 0.03, N = 3SE +/- 0.39, N = 4SE +/- 0.04, N = 3SE +/- 0.05, N = 441.2457.1343.0261.7552.8163.5354.2750.6733.7141.4434.3547.4933.9345.171. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4KEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P50100150200250SE +/- 0.47, N = 8SE +/- 0.36, N = 7SE +/- 0.80, N = 8SE +/- 0.76, N = 7SE +/- 0.86, N = 8SE +/- 1.43, N = 7SE +/- 0.47, N = 8SE +/- 1.31, N = 8SE +/- 0.49, N = 7SE +/- 0.71, N = 7SE +/- 0.50, N = 7SE +/- 1.23, N = 7SE +/- 0.44, N = 8SE +/- 0.70, N = 7179.07204.55210.55217.43231.54217.70237.13232.00194.14201.07206.81213.42173.29211.631. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4KEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P50100150200250SE +/- 0.40, N = 8SE +/- 0.41, N = 8SE +/- 0.31, N = 8SE +/- 0.58, N = 8SE +/- 0.62, N = 8SE +/- 1.18, N = 8SE +/- 0.51, N = 8SE +/- 0.85, N = 8SE +/- 0.37, N = 8SE +/- 1.06, N = 7SE +/- 0.47, N = 8SE +/- 1.17, N = 8SE +/- 0.40, N = 8SE +/- 1.08, N = 8172.16191.02195.80193.78210.24193.15214.39203.19176.04180.92190.74200.38166.79200.421. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-HEVC

This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-HEVC CPU-based multi-threaded video encoder for the HEVC / H.265 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 1 - Input: Bosphorus 4KEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P3691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.797.284.899.186.2211.566.699.794.408.254.097.903.116.121. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 7 - Input: Bosphorus 4KEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P306090120150SE +/- 0.07, N = 5SE +/- 0.14, N = 7SE +/- 0.04, N = 6SE +/- 0.12, N = 7SE +/- 0.12, N = 7SE +/- 0.43, N = 7SE +/- 0.19, N = 7SE +/- 0.16, N = 7SE +/- 0.05, N = 6SE +/- 0.31, N = 7SE +/- 0.10, N = 6SE +/- 0.32, N = 7SE +/- 0.06, N = 5SE +/- 0.06, N = 771.41116.5685.67136.95111.95149.01119.84138.5291.70128.7285.66136.7165.82117.261. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 10 - Input: Bosphorus 4KEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P50100150200250SE +/- 0.23, N = 8SE +/- 1.02, N = 8SE +/- 0.39, N = 8SE +/- 1.90, N = 15SE +/- 0.27, N = 8SE +/- 2.94, N = 15SE +/- 0.23, N = 9SE +/- 0.70, N = 9SE +/- 0.18, N = 8SE +/- 0.96, N = 8SE +/- 0.23, N = 8SE +/- 1.35, N = 15SE +/- 0.06, N = 7SE +/- 1.19, N = 15143.45191.99181.39208.59207.54201.76219.43224.80171.63176.67173.16176.18134.34176.861. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt

SVT-VP9

This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-VP9 CPU-based multi-threaded video encoder for the VP9 video format with a sample YUV input video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: VMAF Optimized - Input: Bosphorus 4KEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P4080120160200SE +/- 0.79, N = 6SE +/- 1.45, N = 15SE +/- 1.16, N = 8SE +/- 4.20, N = 15SE +/- 0.92, N = 15SE +/- 1.60, N = 15SE +/- 1.40, N = 15SE +/- 1.46, N = 15SE +/- 1.38, N = 15SE +/- 1.44, N = 15SE +/- 1.09, N = 15SE +/- 1.39, N = 15SE +/- 0.57, N = 6SE +/- 1.32, N = 6111.82152.31140.28154.60161.26163.58171.65172.24143.42137.47141.68139.88109.47141.501. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: PSNR/SSIM Optimized - Input: Bosphorus 4KEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P4080120160200SE +/- 0.17, N = 7SE +/- 0.22, N = 7SE +/- 0.24, N = 7SE +/- 0.94, N = 6SE +/- 0.48, N = 7SE +/- 2.12, N = 15SE +/- 0.17, N = 7SE +/- 0.20, N = 7SE +/- 0.14, N = 7SE +/- 0.19, N = 5SE +/- 0.26, N = 7SE +/- 0.52, N = 6SE +/- 0.11, N = 6SE +/- 0.27, N = 7115.80158.14143.85161.19164.17165.46175.18179.74148.73144.22148.12148.45115.37150.481. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: Visual Quality Optimized - Input: Bosphorus 4KEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P306090120150SE +/- 0.08, N = 6SE +/- 0.49, N = 6SE +/- 0.18, N = 6SE +/- 0.32, N = 6SE +/- 0.14, N = 7SE +/- 0.59, N = 6SE +/- 0.25, N = 7SE +/- 0.28, N = 6SE +/- 0.18, N = 6SE +/- 0.88, N = 5SE +/- 0.23, N = 6SE +/- 0.33, N = 6SE +/- 0.07, N = 6SE +/- 0.17, N = 683.73130.23107.77145.30129.22148.84137.52146.48111.92131.90109.31138.1983.38130.491. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P48121620SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 39.2614.8910.5416.0013.4317.2614.0013.999.7612.569.3714.228.1813.45

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P510152025SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 310.4216.7811.8718.0615.1019.5915.7715.7110.8814.1210.5116.009.1615.05

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: SlowEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1428425670SE +/- 0.05, N = 4SE +/- 0.09, N = 4SE +/- 0.03, N = 4SE +/- 0.15, N = 5SE +/- 0.05, N = 4SE +/- 0.11, N = 5SE +/- 0.05, N = 4SE +/- 0.13, N = 5SE +/- 0.04, N = 3SE +/- 0.15, N = 4SE +/- 0.07, N = 3SE +/- 0.13, N = 4SE +/- 0.04, N = 3SE +/- 0.06, N = 438.5243.9238.4559.5240.5263.0041.0956.0728.1344.4833.0251.7433.0538.43

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: MediumEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1632486480SE +/- 0.16, N = 4SE +/- 0.08, N = 4SE +/- 0.09, N = 4SE +/- 0.08, N = 5SE +/- 0.04, N = 4SE +/- 0.19, N = 5SE +/- 0.10, N = 4SE +/- 0.19, N = 5SE +/- 0.02, N = 3SE +/- 0.08, N = 4SE +/- 0.02, N = 4SE +/- 0.14, N = 5SE +/- 0.04, N = 4SE +/- 0.09, N = 443.1149.1543.2766.4745.6070.7546.1461.6631.3549.3937.0857.7037.0043.04

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1224364860SE +/- 0.06, N = 3SE +/- 0.13, N = 4SE +/- 0.08, N = 3SE +/- 0.11, N = 4SE +/- 0.07, N = 4SE +/- 0.15, N = 4SE +/- 0.03, N = 4SE +/- 0.08, N = 4SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 4SE +/- 0.00, N = 3SE +/- 0.02, N = 328.9441.2031.3045.9839.5251.0540.6742.5626.7936.0126.6539.0324.7035.89

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super FastEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1224364860SE +/- 0.03, N = 3SE +/- 0.12, N = 4SE +/- 0.15, N = 3SE +/- 0.11, N = 4SE +/- 0.01, N = 4SE +/- 0.22, N = 4SE +/- 0.09, N = 4SE +/- 0.28, N = 4SE +/- 0.01, N = 3SE +/- 0.38, N = 4SE +/- 0.05, N = 3SE +/- 0.06, N = 4SE +/- 0.03, N = 3SE +/- 0.05, N = 430.0042.9533.1048.0741.4651.4642.8145.4928.5037.2228.8241.7326.2638.46

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra FastEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1224364860SE +/- 0.07, N = 3SE +/- 0.07, N = 4SE +/- 0.08, N = 4SE +/- 0.34, N = 4SE +/- 0.06, N = 4SE +/- 0.28, N = 5SE +/- 0.10, N = 4SE +/- 0.27, N = 4SE +/- 0.01, N = 3SE +/- 0.48, N = 4SE +/- 0.03, N = 3SE +/- 0.18, N = 4SE +/- 0.05, N = 3SE +/- 0.03, N = 435.2846.6538.8849.7746.0753.2147.2448.3131.6738.9233.3044.2431.0342.08

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Very FastEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P4080120160200SE +/- 0.15, N = 7SE +/- 0.22, N = 8SE +/- 0.17, N = 7SE +/- 0.70, N = 9SE +/- 0.17, N = 8SE +/- 0.87, N = 9SE +/- 0.17, N = 8SE +/- 0.24, N = 9SE +/- 0.05, N = 6SE +/- 0.79, N = 8SE +/- 0.07, N = 7SE +/- 0.51, N = 8SE +/- 0.10, N = 6SE +/- 0.07, N = 7110.98134.43118.56164.25129.79173.58130.26168.3887.55131.9398.13150.7193.17116.97

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Super FastEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P4080120160200SE +/- 0.23, N = 7SE +/- 0.15, N = 8SE +/- 0.15, N = 8SE +/- 0.48, N = 9SE +/- 0.09, N = 8SE +/- 0.59, N = 9SE +/- 0.17, N = 8SE +/- 1.30, N = 15SE +/- 0.13, N = 6SE +/- 0.62, N = 8SE +/- 0.06, N = 7SE +/- 0.61, N = 8SE +/- 0.08, N = 7SE +/- 0.15, N = 8116.79142.78125.26163.18138.95173.74139.65180.5594.98133.13106.29152.28100.87127.62

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Ultra FastEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P4080120160200SE +/- 0.10, N = 8SE +/- 0.28, N = 8SE +/- 0.17, N = 8SE +/- 0.88, N = 9SE +/- 0.24, N = 8SE +/- 0.58, N = 9SE +/- 0.15, N = 8SE +/- 1.44, N = 9SE +/- 0.15, N = 7SE +/- 0.92, N = 8SE +/- 0.25, N = 7SE +/- 0.69, N = 8SE +/- 0.07, N = 7SE +/- 0.20, N = 8130.30155.33138.79165.33153.97175.35154.38196.33105.96136.60118.47155.38113.18139.86

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1530456075SE +/- 0.47, N = 3SE +/- 0.47, N = 3SE +/- 0.50, N = 3SE +/- 0.36, N = 5SE +/- 0.51, N = 3SE +/- 0.32, N = 5SE +/- 0.50, N = 3SE +/- 0.34, N = 6SE +/- 0.61, N = 3SE +/- 0.37, N = 5SE +/- 0.56, N = 3SE +/- 0.34, N = 5SE +/- 0.52, N = 3SE +/- 0.54, N = 363.4938.9752.7233.8244.7529.7842.0933.7551.8433.0455.4933.7967.6540.40

Timed LLVM Compilation

This test times how long it takes to build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 13.0Build System: NinjaEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P80160240320400SE +/- 0.08, N = 3SE +/- 0.24, N = 3SE +/- 0.09, N = 3SE +/- 0.67, N = 3SE +/- 0.43, N = 3SE +/- 0.09, N = 3SE +/- 0.16, N = 3SE +/- 0.16, N = 3SE +/- 0.32, N = 3SE +/- 0.33, N = 3SE +/- 0.11, N = 3SE +/- 0.64, N = 3SE +/- 0.12, N = 3SE +/- 0.24, N = 3347.36190.97275.25161.53230.69140.28212.30163.54268.94160.40292.73166.31373.68204.23

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 13.0Build System: Unix MakefilesEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P90180270360450SE +/- 1.84, N = 3SE +/- 3.14, N = 3SE +/- 3.55, N = 5SE +/- 0.83, N = 3SE +/- 1.45, N = 3SE +/- 1.00, N = 3SE +/- 2.17, N = 9SE +/- 0.36, N = 3SE +/- 1.83, N = 3SE +/- 0.66, N = 3SE +/- 2.99, N = 3SE +/- 1.05, N = 3SE +/- 3.03, N = 3SE +/- 2.63, N = 5392.19240.49320.94216.18282.42199.58260.91225.70323.07227.37346.26220.50421.49256.36

Timed Node.js Compilation

This test profile times how long it takes to build/compile Node.js itself from source. Node.js is a JavaScript run-time built from the Chrome V8 JavaScript engine while itself is written in C/C++. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 18.8Time To CompileEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P80160240320400SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.25, N = 3SE +/- 0.52, N = 3SE +/- 0.19, N = 3SE +/- 0.62, N = 3SE +/- 0.36, N = 3SE +/- 0.38, N = 3SE +/- 0.06, N = 3SE +/- 0.55, N = 3SE +/- 0.37, N = 3SE +/- 0.41, N = 3337.22191.00270.84165.47226.63143.60209.94166.99272.73168.43295.59175.01374.17209.37

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUEPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P0.75181.50362.25543.00723.759SE +/- 0.003169, N = 7SE +/- 0.003897, N = 7SE +/- 0.001690, N = 7SE +/- 0.002206, N = 7SE +/- 0.004296, N = 7SE +/- 0.001763, N = 7SE +/- 0.000877, N = 7SE +/- 0.007172, N = 7SE +/- 0.018972, N = 10SE +/- 0.009698, N = 7SE +/- 0.026790, N = 7SE +/- 0.003371, N = 7SE +/- 0.028591, N = 151.1884002.1373100.9404551.9501600.7868031.3013800.9379181.7112902.4662701.8219002.9934001.9420003.341250MIN: 0.94MIN: 1.86MIN: 0.75MIN: 1.75MIN: 0.68MIN: 1.15MIN: 0.87MIN: 1.58MIN: 2.29MIN: 1.68MIN: 2.81MIN: 1.73MIN: 3.071. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

EPYC 7343: The test quit with a non-zero exit status.

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P15003000450060007500SE +/- 30.83, N = 3SE +/- 15.06, N = 3SE +/- 10.48, N = 3SE +/- 4.18, N = 3SE +/- 19.73, N = 3SE +/- 0.33, N = 3SE +/- 5.24, N = 3SE +/- 2.96, N = 3SE +/- 17.29, N = 3SE +/- 10.00, N = 3SE +/- 6.57, N = 3SE +/- 3.18, N = 3SE +/- 34.35, N = 3SE +/- 7.69, N = 3680536285121272240142150376724243314164137691956519925341. (CXX) g++ options: -O3 -lm -ldl

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P2K4K6K8K10KSE +/- 14.64, N = 3SE +/- 5.04, N = 3SE +/- 17.21, N = 3SE +/- 6.98, N = 3SE +/- 22.62, N = 3SE +/- 12.06, N = 3SE +/- 6.51, N = 3SE +/- 8.33, N = 3SE +/- 15.01, N = 3SE +/- 0.88, N = 3SE +/- 16.80, N = 3SE +/- 11.06, N = 3SE +/- 7.21, N = 3SE +/- 12.78, N = 3817243366067325247692538448628743967197946212330632130011. (CXX) g++ options: -O3 -lm -ldl

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P50K100K150K200K250KSE +/- 1066.52, N = 3SE +/- 322.54, N = 3SE +/- 660.98, N = 3SE +/- 593.91, N = 3SE +/- 22.36, N = 3SE +/- 95.38, N = 3SE +/- 100.17, N = 3SE +/- 129.50, N = 3SE +/- 153.33, N = 3SE +/- 247.04, N = 3SE +/- 380.50, N = 3SE +/- 130.77, N = 3SE +/- 433.96, N = 3SE +/- 405.08, N = 32242981202641701909383413563674566127078840011131495264612786567775171646872901. (CXX) g++ options: -O3 -lm -ldl

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P60K120K180K240K300KSE +/- 981.14, N = 3SE +/- 359.93, N = 3SE +/- 1060.89, N = 3SE +/- 865.73, N = 3SE +/- 453.13, N = 3SE +/- 337.67, N = 3SE +/- 601.99, N = 3SE +/- 89.37, N = 3SE +/- 384.33, N = 3SE +/- 150.12, N = 3SE +/- 873.63, N = 3SE +/- 207.56, N = 3SE +/- 339.77, N = 3SE +/- 152.22, N = 3265238142611200057110558159097867041489909865313365069538152061807802071281030471. (CXX) g++ options: -O3 -lm -ldl

FFmpeg

This is a benchmark of the FFmpeg multimedia framework. The FFmpeg test profile is making use of a modified version of vbench from Columbia University's Architecture and Design Lab (ARCADE) [http://arcade.cs.columbia.edu/vbench/] that is a benchmark for video-as-a-service workloads. The test profile offers the options of a range of vbench scenarios based on freely distributable video content and offers the options of using the x264 or x265 video encoders for transcoding. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 6.0Encoder: libx264 - Scenario: LiveEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P714212835SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 323.1823.4124.8825.2424.3524.4623.8624.2028.2429.1426.0727.0924.9926.041. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 6.0Encoder: libx265 - Scenario: LiveEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1224364860SE +/- 0.17, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.24, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 340.8148.5943.0851.3442.5649.9844.4747.8744.7745.2541.2741.7140.5841.421. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.0Encoder: libx265 - Scenario: LiveEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P306090120150SE +/- 0.52, N = 3SE +/- 0.09, N = 3SE +/- 0.19, N = 3SE +/- 0.17, N = 3SE +/- 0.16, N = 3SE +/- 0.48, N = 3SE +/- 0.11, N = 3SE +/- 0.21, N = 3SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 0.44, N = 3SE +/- 0.19, N = 3123.76103.93117.2398.37118.65101.05113.57105.50112.80111.60122.36121.08124.46121.921. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 6.0Encoder: libx265 - Scenario: UploadEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P306090120150SE +/- 0.07, N = 3SE +/- 0.20, N = 3SE +/- 0.07, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.17, N = 3SE +/- 0.07, N = 3SE +/- 0.30, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.25, N = 3SE +/- 0.22, N = 3103.96107.19108.80114.41108.16113.72107.90118.46122.64120.86113.70111.87113.29110.711. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.0Encoder: libx265 - Scenario: UploadEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P612182430SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 324.2923.5623.2122.0723.3522.2023.4021.3220.5920.8922.2122.5722.2922.811. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 6.0Encoder: libx265 - Scenario: PlatformEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P4080120160200SE +/- 0.09, N = 3SE +/- 0.17, N = 3SE +/- 0.12, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.09, N = 3SE +/- 0.23, N = 3SE +/- 0.27, N = 3SE +/- 0.11, N = 3SE +/- 0.16, N = 3SE +/- 0.36, N = 3151.85162.34159.89172.96159.12171.41158.24174.39180.71180.82167.86167.16165.89164.331. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.0Encoder: libx265 - Scenario: PlatformEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1122334455SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 349.8946.6647.3843.8047.6144.1947.8743.4441.9241.8945.1345.3145.6646.101. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 6.0Encoder: libx265 - Scenario: Video On DemandEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P4080120160200SE +/- 0.16, N = 3SE +/- 0.38, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.58, N = 3SE +/- 0.13, N = 3SE +/- 0.04, N = 3SE +/- 0.24, N = 3SE +/- 0.22, N = 3SE +/- 0.33, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3152.05161.72160.13172.81158.71171.53158.41174.28180.03181.97167.31167.66166.43165.061. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.0Encoder: libx265 - Scenario: Video On DemandEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1122334455SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 349.8246.8447.3143.8447.7344.1647.8243.4642.0841.6345.2845.1845.5145.891. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl

OpenSSL

OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test profile makes use of the built-in "openssl speed" benchmarking capabilities. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.0Algorithm: SHA256EPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P20000M40000M60000M80000M100000MSE +/- 29163674.08, N = 3SE +/- 24582365.01, N = 3SE +/- 27629858.10, N = 3SE +/- 54030773.40, N = 3SE +/- 68531235.70, N = 3SE +/- 316349484.45, N = 3SE +/- 186860140.69, N = 3SE +/- 8398498.36, N = 3SE +/- 10848440.04, N = 3SE +/- 10952442.61, N = 3SE +/- 11924426.00, N = 3SE +/- 3033485.03, N = 3SE +/- 9109685.37, N = 3SE +/- 1989217.69, N = 324891101267496940000473309540780066206231957422849544308436576722344324823090697158330972088891597342653381293202563980004035510232714614638730294152104301. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.0Algorithm: RSA4096EPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P3K6K9K12K15KSE +/- 3.48, N = 3SE +/- 5.12, N = 3SE +/- 0.09, N = 3SE +/- 9.47, N = 3SE +/- 5.98, N = 3SE +/- 12.10, N = 3SE +/- 7.21, N = 3SE +/- 10.29, N = 3SE +/- 0.27, N = 3SE +/- 0.24, N = 3SE +/- 13.25, N = 3SE +/- 5.32, N = 3SE +/- 0.18, N = 3SE +/- 0.90, N = 34398.68794.65947.911846.87637.815222.37963.112568.16442.712874.96109.712235.14397.28906.11. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.0Algorithm: RSA4096EPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P200K400K600K800K1000KSE +/- 27.40, N = 3SE +/- 36.78, N = 3SE +/- 51.25, N = 3SE +/- 52.75, N = 3SE +/- 556.85, N = 3SE +/- 55.88, N = 3SE +/- 34.51, N = 3SE +/- 53.07, N = 3SE +/- 41.22, N = 3SE +/- 40.84, N = 3SE +/- 54.53, N = 3SE +/- 292.45, N = 3SE +/- 83.11, N = 3SE +/- 232.08, N = 3287549.0574456.9390326.3778483.0501938.91003089.4522787.3823388.7419447.9838351.8398769.3798077.1286703.7580306.31. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P90180270360450SE +/- 2.07, N = 3SE +/- 2.96, N = 3SE +/- 1.47, N = 3SE +/- 0.97, N = 3SE +/- 3.29, N = 3SE +/- 2.43, N = 3SE +/- 1.20, N = 3SE +/- 3.48, N = 3SE +/- 1.98, N = 3SE +/- 2.01, N = 3SE +/- 3.58, N = 3SE +/- 1.29, N = 3SE +/- 0.53, N = 3SE +/- 9.20, N = 12336.88423.79351.34429.39362.00412.09410.64365.79311.11388.39312.11411.38283.16360.92MIN: 13.48 / MAX: 7500MIN: 23.78 / MAX: 4285.71MIN: 17.17 / MAX: 6666.67MIN: 31.35 / MAX: 5000MIN: 21.03 / MAX: 6000MIN: 34.8 / MAX: 4000MIN: 22.56 / MAX: 6666.67MIN: 31.86 / MAX: 5454.55MIN: 15.86 / MAX: 5454.55MIN: 29.17 / MAX: 5454.55MIN: 14.74 / MAX: 6666.67MIN: 28.04 / MAX: 5000MIN: 10.81 / MAX: 6666.67MIN: 20.41 / MAX: 6000

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P100200300400500SE +/- 3.50, N = 3SE +/- 1.63, N = 3SE +/- 2.06, N = 3SE +/- 7.88, N = 3SE +/- 1.23, N = 3SE +/- 2.78, N = 3SE +/- 0.54, N = 3SE +/- 3.18, N = 3SE +/- 2.19, N = 3SE +/- 5.74, N = 3SE +/- 3.16, N = 3SE +/- 2.05, N = 3SE +/- 1.01, N = 3SE +/- 9.42, N = 12346.00443.07363.28437.50377.03436.77425.45375.36325.13405.08321.66433.55294.82378.61MIN: 13.53 / MAX: 7500MIN: 23.91 / MAX: 5454.55MIN: 17.19 / MAX: 7500MIN: 31.66 / MAX: 5000MIN: 21.37 / MAX: 6666.67MIN: 35.19 / MAX: 5454.55MIN: 22.68 / MAX: 6666.67MIN: 32 / MAX: 6000MIN: 15.85 / MAX: 5454.55MIN: 29.11 / MAX: 5000MIN: 14.82 / MAX: 6666.67MIN: 28.48 / MAX: 6000MIN: 10.95 / MAX: 7500MIN: 20.51 / MAX: 6666.67

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P100200300400500SE +/- 1.99, N = 3SE +/- 1.18, N = 3SE +/- 2.07, N = 3SE +/- 5.82, N = 3SE +/- 2.21, N = 3SE +/- 2.98, N = 3SE +/- 0.23, N = 3SE +/- 1.15, N = 3SE +/- 1.64, N = 3SE +/- 4.19, N = 3SE +/- 1.90, N = 3SE +/- 3.32, N = 3SE +/- 1.18, N = 3SE +/- 9.11, N = 12345.53443.72360.64440.92379.67435.85425.48380.10325.93407.09325.08425.45295.42379.26MIN: 13.57 / MAX: 7500MIN: 24.16 / MAX: 6000MIN: 17.17 / MAX: 6666.67MIN: 31.68 / MAX: 4615.38MIN: 21.33 / MAX: 6666.67MIN: 35.71 / MAX: 4615.38MIN: 22.74 / MAX: 6000MIN: 31.95 / MAX: 6000MIN: 15.81 / MAX: 6000MIN: 29.41 / MAX: 5454.55MIN: 14.7 / MAX: 6666.67MIN: 28.42 / MAX: 5000MIN: 10.91 / MAX: 7500MIN: 20.98 / MAX: 6000

Memcached

Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.18Set To Get Ratio: 1:5EPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P900K1800K2700K3600K4500KSE +/- 3957.77, N = 3SE +/- 24137.01, N = 3SE +/- 20367.20, N = 3SE +/- 51036.74, N = 15SE +/- 6378.36, N = 3SE +/- 36603.84, N = 15SE +/- 6964.53, N = 3SE +/- 47663.26, N = 3SE +/- 26712.28, N = 3SE +/- 21079.66, N = 14SE +/- 34848.84, N = 8SE +/- 28979.64, N = 3SE +/- 27130.94, N = 3SE +/- 20598.32, N = 32199582.802421891.742917560.702164592.243632495.021867112.743574540.353378044.124271575.653270779.444068619.973701213.863346967.773597757.551. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.18Set To Get Ratio: 1:10EPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1000K2000K3000K4000K5000KSE +/- 6608.23, N = 3SE +/- 10464.07, N = 3SE +/- 9446.47, N = 3SE +/- 12992.60, N = 3SE +/- 10592.08, N = 3SE +/- 10361.68, N = 3SE +/- 16723.87, N = 3SE +/- 53174.54, N = 4SE +/- 14309.07, N = 3SE +/- 79008.26, N = 15SE +/- 13454.68, N = 3SE +/- 44938.98, N = 15SE +/- 23174.23, N = 3SE +/- 36081.97, N = 152548333.192826219.163431617.243691244.974198464.114105338.273481927.794786407.254262554.193551712.124053902.813969670.993159962.473912323.121. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.18Set To Get Ratio: 1:100EPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P800K1600K2400K3200K4000KSE +/- 9721.14, N = 3SE +/- 4664.77, N = 3SE +/- 18487.99, N = 3SE +/- 22542.41, N = 15SE +/- 20057.86, N = 3SE +/- 1121.75, N = 3SE +/- 40574.62, N = 3SE +/- 31526.72, N = 9SE +/- 34881.31, N = 3SE +/- 60239.97, N = 15SE +/- 34942.45, N = 3SE +/- 43191.93, N = 15SE +/- 27101.83, N = 15SE +/- 24448.73, N = 31610909.222373328.372309617.422952893.822981451.323518612.742848831.243893409.952937926.062802626.262842403.962971169.052164237.052874778.001. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Graph500

This is a benchmark of the reference implementation of Graph500, an HPC benchmark focused on data intensive loads and commonly tested on supercomputers for complex data problems. Graph500 primarily stresses the communication subsystem of the hardware under test. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgbfs median_TEPS, More Is BetterGraph500 3.0Scale: 26EPYC 7343EPYC 7343 2PEPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6346Xeon Gold 6346 2P150M300M450M600M750M3098170004225290005840340005178100006656550005443420006913480005105870006556750003596890005621720001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

Scale: 26

EPYC 7413: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override

Xeon Gold 6342: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override

Xeon Gold 6342 2P: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override

OpenBenchmarking.orgbfs max_TEPS, More Is BetterGraph500 3.0Scale: 26EPYC 7343EPYC 7343 2PEPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6346Xeon Gold 6346 2P150M300M450M600M750M3129890004444740006011200005282000006919830005540820007151540005192940006679820003629180005717930001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

Scale: 26

EPYC 7413: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override

Xeon Gold 6342: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override

Xeon Gold 6342 2P: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override

OpenBenchmarking.orgsssp median_TEPS, More Is BetterGraph500 3.0Scale: 26EPYC 7343EPYC 7343 2PEPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6346Xeon Gold 6346 2P50M100M150M200M250M1142950001742190002252840001763710002550360002045190002271750001683740002384600001179190001876540001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

Scale: 26

EPYC 7413: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override

Xeon Gold 6342: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override

Xeon Gold 6342 2P: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override

OpenBenchmarking.orgsssp max_TEPS, More Is BetterGraph500 3.0Scale: 26EPYC 7343EPYC 7343 2PEPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6346Xeon Gold 6346 2P70M140M210M280M350M1497100002189860002947820002262390003224750002680160002889590002130960002950100001542090002450530001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

Scale: 26

EPYC 7413: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override

Xeon Gold 6342: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override

Xeon Gold 6342 2P: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override

GROMACS

The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2023Implementation: MPI CPU - Input: water_GMX50_bareEPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P246810SE +/- 0.009, N = 3SE +/- 0.003, N = 3SE +/- 0.015, N = 3SE +/- 0.006, N = 3SE +/- 0.019, N = 3SE +/- 0.013, N = 3SE +/- 0.008, N = 3SE +/- 0.025, N = 3SE +/- 0.011, N = 3SE +/- 0.004, N = 3SE +/- 0.019, N = 3SE +/- 0.001, N = 3SE +/- 0.018, N = 34.0833.0054.8203.5475.5894.0015.0983.7177.3793.3766.7612.6195.3911. (CXX) g++ options: -O3

Implementation: MPI CPU - Input: water_GMX50_bare

EPYC 7343: The test quit with a non-zero exit status. E: mpirun noticed that process rank 9 with PID 0 on node amd-test-02 exited on signal 4 (Illegal instruction).

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 1000 - Clients: 800 - Mode: Read OnlyEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P200K400K600K800K1000KSE +/- 7215.33, N = 3SE +/- 9801.20, N = 3SE +/- 2318.40, N = 3SE +/- 19094.08, N = 9SE +/- 28926.74, N = 11SE +/- 41984.11, N = 6SE +/- 4126.34, N = 3SE +/- 19623.01, N = 12SE +/- 137.25, N = 3SE +/- 4309.16, N = 3SE +/- 1328.10, N = 3SE +/- 30362.30, N = 12SE +/- 4113.36, N = 3SE +/- 10990.82, N = 126957618556429124277650909843946900191074765835087112366375021898347385016174630210677161. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 1000 - Clients: 800 - Mode: Read Only - Average LatencyEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P0.26510.53020.79531.06041.3255SE +/- 0.012, N = 3SE +/- 0.011, N = 3SE +/- 0.002, N = 3SE +/- 0.025, N = 9SE +/- 0.032, N = 11SE +/- 0.060, N = 6SE +/- 0.003, N = 3SE +/- 0.020, N = 12SE +/- 0.000, N = 3SE +/- 0.006, N = 3SE +/- 0.001, N = 3SE +/- 0.031, N = 12SE +/- 0.006, N = 3SE +/- 0.008, N = 121.1500.9350.8771.0510.8221.1780.7450.9630.7121.0660.8130.9531.0720.7501. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 1000 - Clients: 1000 - Mode: Read OnlyEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P200K400K600K800K1000KSE +/- 1636.62, N = 3SE +/- 3271.24, N = 3SE +/- 7500.42, N = 3SE +/- 11363.61, N = 12SE +/- 2084.66, N = 3SE +/- 10642.91, N = 9SE +/- 4439.63, N = 3SE +/- 4640.40, N = 3SE +/- 4354.62, N = 3SE +/- 30718.02, N = 12SE +/- 1181.85, N = 3SE +/- 10454.75, N = 12SE +/- 1889.54, N = 3SE +/- 8418.28, N = 3685239849019884213728184976332638731100874172133510785867541049278588514647425509979571. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only - Average LatencyEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P0.3530.7061.0591.4121.765SE +/- 0.003, N = 3SE +/- 0.005, N = 3SE +/- 0.010, N = 3SE +/- 0.021, N = 12SE +/- 0.002, N = 3SE +/- 0.027, N = 9SE +/- 0.004, N = 3SE +/- 0.009, N = 3SE +/- 0.004, N = 3SE +/- 0.050, N = 12SE +/- 0.001, N = 3SE +/- 0.014, N = 12SE +/- 0.003, N = 3SE +/- 0.008, N = 31.4591.1781.1311.3771.0241.5690.9911.3860.9271.3481.0781.1761.3471.0021. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 1000 - Clients: 800 - Mode: Read WriteEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P6K12K18K24K30KSE +/- 214.52, N = 3SE +/- 176.72, N = 12SE +/- 611.47, N = 12SE +/- 109.43, N = 3SE +/- 52.15, N = 3SE +/- 590.01, N = 9SE +/- 26.13, N = 3SE +/- 136.50, N = 3SE +/- 190.25, N = 3SE +/- 83.93, N = 3SE +/- 132.14, N = 3SE +/- 131.27, N = 3SE +/- 55.23, N = 3SE +/- 299.85, N = 325679849224251873613777855211845122452222819540243602192927853232901. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 1000 - Clients: 800 - Mode: Read Write - Average LatencyEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P20406080100SE +/- 0.26, N = 3SE +/- 1.69, N = 12SE +/- 0.81, N = 12SE +/- 1.13, N = 3SE +/- 0.22, N = 3SE +/- 7.23, N = 9SE +/- 0.15, N = 3SE +/- 0.72, N = 3SE +/- 0.31, N = 3SE +/- 0.18, N = 3SE +/- 0.18, N = 3SE +/- 0.22, N = 3SE +/- 0.06, N = 3SE +/- 0.44, N = 331.1694.5933.2191.6058.0797.5267.5465.3536.0040.9432.8436.4828.7234.361. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 1000 - Clients: 1000 - Mode: Read WriteEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P6K12K18K24K30KSE +/- 210.94, N = 3SE +/- 43.57, N = 3SE +/- 239.71, N = 7SE +/- 68.86, N = 3SE +/- 246.74, N = 12SE +/- 88.49, N = 3SE +/- 167.15, N = 12SE +/- 567.20, N = 9SE +/- 84.27, N = 3SE +/- 265.07, N = 3SE +/- 144.91, N = 3SE +/- 180.74, N = 3SE +/- 212.63, N = 3SE +/- 300.77, N = 3248218356256749798138651065112068156832244619322253772213827861235801. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write - Average LatencyEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P306090120150SE +/- 0.34, N = 3SE +/- 0.63, N = 3SE +/- 0.37, N = 7SE +/- 0.71, N = 3SE +/- 1.40, N = 12SE +/- 0.78, N = 3SE +/- 1.07, N = 12SE +/- 2.55, N = 9SE +/- 0.17, N = 3SE +/- 0.71, N = 3SE +/- 0.23, N = 3SE +/- 0.37, N = 3SE +/- 0.27, N = 3SE +/- 0.54, N = 340.29119.6838.97102.0772.4093.9083.0264.5044.5551.7739.4145.1835.9042.421. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries too. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: ResNet-50EPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1632486480SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.21, N = 3SE +/- 0.03, N = 3SE +/- 0.23, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 322.3724.0323.4324.0423.7722.7525.3420.7068.0873.4961.9066.4349.2854.33

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 512 - Model: ResNet-50EPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P20406080100SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.37, N = 3SE +/- 0.03, N = 3SE +/- 0.52, N = 3SE +/- 0.02, N = 3SE +/- 0.15, N = 322.9125.4324.1625.3624.6623.9626.2621.8568.3874.6862.1866.1250.0156.73

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P918273645SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 312.6524.9216.3232.2519.9039.5922.0731.4518.6737.7017.3934.7913.2126.54

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P2004006008001000SE +/- 0.72, N = 3SE +/- 0.41, N = 3SE +/- 0.56, N = 3SE +/- 0.21, N = 3SE +/- 0.05, N = 3SE +/- 0.46, N = 3SE +/- 0.25, N = 3SE +/- 0.92, N = 3SE +/- 0.28, N = 3SE +/- 0.23, N = 3SE +/- 0.47, N = 3SE +/- 0.92, N = 3SE +/- 0.43, N = 3SE +/- 0.43, N = 3629.19636.28729.31738.78791.97803.45716.021010.00856.00847.38689.68685.96605.67599.81

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-StreamEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P150300450600750SE +/- 0.06, N = 3SE +/- 0.45, N = 3SE +/- 0.29, N = 3SE +/- 0.51, N = 3SE +/- 0.19, N = 3SE +/- 0.82, N = 3SE +/- 0.08, N = 3SE +/- 0.43, N = 3SE +/- 1.30, N = 3SE +/- 1.61, N = 3SE +/- 0.55, N = 3SE +/- 4.23, N = 3SE +/- 0.24, N = 3SE +/- 1.35, N = 3163.56280.43226.05384.29283.71488.63294.21455.12362.29704.95294.76589.28242.04482.92

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-StreamEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1632486480SE +/- 0.01, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.15, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.29, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 348.8656.9853.0362.3656.3365.3954.3270.2144.1345.3640.6840.7033.0333.11

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P4080120160200SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.12, N = 3SE +/- 0.11, N = 3SE +/- 0.85, N = 3SE +/- 0.28, N = 3SE +/- 0.05, N = 3SE +/- 0.15, N = 3SE +/- 0.99, N = 3SE +/- 0.41, N = 3SE +/- 1.12, N = 3SE +/- 0.53, N = 3SE +/- 0.30, N = 352.2697.2067.20127.5482.55156.2491.57132.3092.27177.5983.03157.8163.35125.60

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P50100150200250SE +/- 0.33, N = 3SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.16, N = 3SE +/- 0.21, N = 3SE +/- 1.13, N = 3SE +/- 0.50, N = 3SE +/- 0.17, N = 3SE +/- 0.38, N = 3SE +/- 0.95, N = 3SE +/- 0.70, N = 3SE +/- 0.98, N = 3SE +/- 0.99, N = 3SE +/- 0.32, N = 3152.83164.14178.21187.68193.47204.23174.36241.33173.20179.89144.31151.86126.16127.16

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P140280420560700SE +/- 0.25, N = 3SE +/- 0.20, N = 3SE +/- 0.51, N = 3SE +/- 1.20, N = 3SE +/- 0.61, N = 3SE +/- 0.50, N = 3SE +/- 0.36, N = 3SE +/- 0.55, N = 3SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.25, N = 3SE +/- 2.27, N = 3SE +/- 0.23, N = 3SE +/- 0.08, N = 3144.23287.18192.68370.19240.41468.93256.52369.54320.01639.77286.88578.25215.84439.33

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P20406080100SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 3SE +/- 0.21, N = 3SE +/- 0.17, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.16, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 355.4155.6062.2064.7266.4768.1262.2986.4649.9649.9741.8141.4637.0436.38

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P80160240320400SE +/- 0.16, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 3SE +/- 0.28, N = 3SE +/- 0.20, N = 3SE +/- 0.11, N = 3SE +/- 0.86, N = 3SE +/- 0.37, N = 3SE +/- 0.54, N = 3SE +/- 0.61, N = 3SE +/- 0.35, N = 3SE +/- 0.23, N = 3SE +/- 0.29, N = 3105.96206.53139.27270.27172.73335.99186.09271.88173.77345.18157.60313.14115.60231.51

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P306090120150SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.36, N = 3SE +/- 0.20, N = 3SE +/- 0.15, N = 3SE +/- 0.29, N = 3SE +/- 0.09, N = 3SE +/- 0.14, N = 3SE +/- 0.09, N = 375.4177.3486.0888.6392.5495.0885.87117.4892.0592.6476.1276.5669.1969.04

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1530456075SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 317.7433.4223.2943.9129.2755.4731.3946.6833.9065.2131.0159.9723.5945.55

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P150300450600750SE +/- 0.07, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3SE +/- 0.27, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.64, N = 3SE +/- 0.21, N = 3SE +/- 0.50, N = 3SE +/- 0.38, N = 3SE +/- 0.45, N = 3SE +/- 0.27, N = 3SE +/- 0.17, N = 3450.60475.87515.06544.62546.28575.37507.66684.85471.63488.41386.88399.33338.98350.63

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P4080120160200SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.30, N = 3SE +/- 0.08, N = 3SE +/- 0.37, N = 3SE +/- 0.06, N = 3SE +/- 0.50, N = 3SE +/- 0.22, N = 3SE +/- 0.13, N = 353.60104.8970.41137.0486.94170.2693.97138.1483.62167.3875.67150.0955.75113.07

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P50100150200250SE +/- 0.09, N = 3SE +/- 0.17, N = 3SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 0.41, N = 3SE +/- 0.11, N = 3SE +/- 0.12, N = 3SE +/- 0.59, N = 3SE +/- 0.18, N = 3SE +/- 0.33, N = 3SE +/- 0.13, N = 3SE +/- 0.51, N = 3SE +/- 0.56, N = 3SE +/- 0.10, N = 3148.96152.15170.16174.62183.72187.52169.93230.92191.31190.84158.56159.75143.49141.36

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P918273645SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.10, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 312.6225.0216.3732.2519.9839.6622.1231.4018.6937.6317.3834.8613.2126.52

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P2004006008001000SE +/- 0.24, N = 3SE +/- 0.25, N = 3SE +/- 0.30, N = 3SE +/- 0.75, N = 3SE +/- 0.93, N = 3SE +/- 0.61, N = 3SE +/- 0.33, N = 3SE +/- 0.83, N = 3SE +/- 0.54, N = 3SE +/- 0.68, N = 3SE +/- 0.32, N = 3SE +/- 0.49, N = 3SE +/- 0.26, N = 3SE +/- 0.72, N = 3627.69634.73729.06739.76792.46802.16716.121010.58855.78848.91690.24686.45605.57600.72

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: BMW27 - Compute: CPU-OnlyEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P20406080100SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.12, N = 382.6041.3062.0331.8049.2425.4646.2430.3659.5529.6664.9032.2586.3842.35

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Classroom - Compute: CPU-OnlyEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P50100150200250SE +/- 0.29, N = 3SE +/- 0.30, N = 3SE +/- 0.20, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.25, N = 3SE +/- 0.14, N = 3SE +/- 0.13, N = 3SE +/- 0.37, N = 3SE +/- 0.14, N = 3219.83109.64165.3982.55130.3564.96122.9779.30161.5080.17176.5587.28233.90115.77

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Barbershop - Compute: CPU-OnlyEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P2004006008001000SE +/- 0.57, N = 3SE +/- 0.53, N = 3SE +/- 2.04, N = 3SE +/- 0.36, N = 3SE +/- 0.04, N = 3SE +/- 0.82, N = 3SE +/- 0.45, N = 3SE +/- 0.59, N = 3SE +/- 0.64, N = 3SE +/- 0.29, N = 3SE +/- 3.07, N = 3SE +/- 0.18, N = 3SE +/- 0.21, N = 3SE +/- 0.38, N = 3815.39435.02616.51330.02482.82262.94456.27297.72604.76302.14680.31342.37889.71445.24

CloudSuite Graph Analytics

CloudSuite Graph Analytics uses Apache GraphX + Spark to perform graph analytics (PageRank) on sample Twitter data. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterCloudSuite Graph Analytics 4.0GraphX Algorithm: Page RankEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P3K6K9K12K15KSE +/- 84.93, N = 3SE +/- 190.69, N = 13SE +/- 82.57, N = 15SE +/- 184.92, N = 15SE +/- 135.36, N = 3SE +/- 118.51, N = 3SE +/- 79.02, N = 3SE +/- 49.21, N = 3SE +/- 115.60, N = 15SE +/- 108.31, N = 15SE +/- 106.07, N = 15SE +/- 69.03, N = 14SE +/- 97.49, N = 15SE +/- 39.28, N = 3115259820981598319917958792479112112451123510340103811303410597

OpenBenchmarking.orgms, Fewer Is BetterCloudSuite Graph Analytics 4.0GraphX Algorithm: Triangle CountEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P30K60K90K120K150KSE +/- 192.25, N = 3SE +/- 2111.36, N = 15SE +/- 911.07, N = 15SE +/- 4547.27, N = 12SE +/- 844.55, N = 3SE +/- 3129.18, N = 15SE +/- 816.75, N = 5SE +/- 1101.67, N = 15SE +/- 1190.06, N = 15SE +/- 1737.14, N = 15SE +/- 969.69, N = 3SE +/- 486.76, N = 3SE +/- 2880.79, N = 12SE +/- 1088.95, N = 15108988772788411474003778937004274250700899323178150877867345912701584608

OpenBenchmarking.orgms, Fewer Is BetterCloudSuite Graph Analytics 4.0GraphX Algorithm: Connected ComponentsEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P4K8K12K16K20KSE +/- 216.00, N = 15SE +/- 400.63, N = 15SE +/- 188.00, N = 15SE +/- 176.86, N = 15SE +/- 194.18, N = 13SE +/- 134.07, N = 3SE +/- 220.91, N = 15SE +/- 128.32, N = 15SE +/- 97.53, N = 3SE +/- 180.53, N = 15SE +/- 140.39, N = 15SE +/- 57.52, N = 3SE +/- 155.90, N = 15SE +/- 268.97, N = 121571814547140111442613102138911335813169142851475113542135511782014408

CloudSuite In-Memory Analytics

CloudSuite In-Memory Analytics uses Apache Spark and runs a collaborative filtering algorithm in-memory on a dataset of user-movie ratings from Movielens. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterCloudSuite In-Memory Analytics 4.0Training Set Size: LargeEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P60K120K180K240K300KSE +/- 535.64, N = 3SE +/- 1774.21, N = 4SE +/- 235.29, N = 3SE +/- 530.20, N = 3SE +/- 796.65, N = 3SE +/- 859.70, N = 3SE +/- 210.33, N = 3SE +/- 955.82, N = 3SE +/- 2349.58, N = 3SE +/- 775.32, N = 3SE +/- 623.63, N = 3SE +/- 546.89, N = 3SE +/- 800.80, N = 3SE +/- 725.41, N = 3122575147944124002225855134575301630130123250115163851287528140252196790148896157229

OpenBenchmarking.orgms, Fewer Is BetterCloudSuite In-Memory Analytics 4.0Training Set Size: SmallEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P40K80K120K160K200KSE +/- 13.02, N = 3SE +/- 136.22, N = 3SE +/- 159.06, N = 3SE +/- 1128.62, N = 3SE +/- 101.02, N = 3SE +/- 409.71, N = 3SE +/- 151.00, N = 3SE +/- 820.85, N = 3SE +/- 84.36, N = 3SE +/- 90.73, N = 3SE +/- 80.23, N = 3SE +/- 445.33, N = 3SE +/- 48.64, N = 3SE +/- 203.67, N = 313995460592357511122436808181349373151367213664614765321960822871385541096

CloudSuite Web Serving

CloudSuite Web Serving is a Docker-based web server benchmark making use of a web server with Memcached and a MySQL database server. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgops/sec, More Is BetterCloudSuite Web ServingLoad Scale: 100EPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P2468107.3335.5507.5835.3007.4175.4176.5837.1007.5177.3507.5177.1837.3837.533

OpenBenchmarking.orgops/sec, More Is BetterCloudSuite Web ServingLoad Scale: 400EPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P4812162011.8311.4314.7311.9714.8811.2013.8013.2712.3811.9314.7011.7013.5511.73

OpenBenchmarking.orgops/sec, More Is BetterCloudSuite Web ServingLoad Scale: 500EPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P4812162011.60011.21714.58312.08315.26711.81713.05015.28313.3179.60015.43312.71712.95012.300

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P510152025SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 34.277.765.4410.066.6712.557.3210.338.9618.488.4317.346.4313.201. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P7001400210028003500SE +/- 3.34, N = 3SE +/- 0.58, N = 3SE +/- 2.73, N = 3SE +/- 1.48, N = 3SE +/- 2.40, N = 3SE +/- 1.75, N = 3SE +/- 9.46, N = 3SE +/- 4.99, N = 3SE +/- 6.05, N = 3SE +/- 1.93, N = 3SE +/- 7.34, N = 3SE +/- 0.46, N = 3SE +/- 3.43, N = 3SE +/- 1.08, N = 31850.231028.982183.991190.682369.521272.582162.683072.391771.70862.091413.05689.051232.64604.17MIN: 1073.49 / MAX: 1950.78MIN: 1009.62 / MAX: 1100.65MIN: 1919.34 / MAX: 2280.72MIN: 1162.02 / MAX: 1273MIN: 1311.77 / MAX: 2481.25MIN: 1233.3 / MAX: 1361.68MIN: 1785 / MAX: 2247.11MIN: 2717.45 / MAX: 3200.51MIN: 1362.81 / MAX: 1851.05MIN: 623.51 / MAX: 953.92MIN: 686.62 / MAX: 1507.17MIN: 523.39 / MAX: 772.01MIN: 935.61 / MAX: 1312.43MIN: 472.25 / MAX: 677.411. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P3691215SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 32.845.533.617.014.448.824.956.925.3610.845.039.943.877.621. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P10002000300040005000SE +/- 10.65, N = 3SE +/- 0.75, N = 3SE +/- 4.10, N = 3SE +/- 0.56, N = 3SE +/- 9.18, N = 3SE +/- 2.22, N = 3SE +/- 7.16, N = 3SE +/- 5.09, N = 3SE +/- 0.75, N = 3SE +/- 0.75, N = 3SE +/- 0.81, N = 3SE +/- 1.46, N = 3SE +/- 0.68, N = 3SE +/- 0.85, N = 32790.521445.133275.511688.623561.391803.093186.874538.432962.181467.672358.371198.222047.931043.48MIN: 2485.81 / MAX: 2884.12MIN: 1428.3 / MAX: 1517.31MIN: 2779.4 / MAX: 3463.81MIN: 1420.61 / MAX: 1780.64MIN: 3211.28 / MAX: 3765.97MIN: 1636.35 / MAX: 1876.9MIN: 2866.19 / MAX: 3374.03MIN: 3564.16 / MAX: 4986.6MIN: 2252.85 / MAX: 3160.04MIN: 1203.01 / MAX: 1562.63MIN: 1772.66 / MAX: 2525.32MIN: 911.32 / MAX: 1454.11MIN: 1604.74 / MAX: 2166.44MIN: 886.86 / MAX: 1166.181. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P3691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 32.825.523.597.014.458.814.946.925.2610.634.959.783.807.421. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P10002000300040005000SE +/- 1.49, N = 3SE +/- 1.35, N = 3SE +/- 7.34, N = 3SE +/- 0.39, N = 3SE +/- 3.85, N = 3SE +/- 2.09, N = 3SE +/- 4.08, N = 3SE +/- 2.29, N = 3SE +/- 2.23, N = 3SE +/- 0.13, N = 3SE +/- 0.31, N = 3SE +/- 1.27, N = 3SE +/- 1.13, N = 3SE +/- 3.51, N = 32813.451447.063280.271689.483537.871804.953217.574533.123023.561495.922400.771217.972081.751072.35MIN: 2640.81 / MAX: 2908.21MIN: 1431.68 / MAX: 1476.13MIN: 1686.07 / MAX: 3445.04MIN: 1404.52 / MAX: 1764.68MIN: 1864.67 / MAX: 3792.11MIN: 1665.93 / MAX: 1885.89MIN: 2966.37 / MAX: 3376.92MIN: 3616.62 / MAX: 4976.85MIN: 2431.21 / MAX: 3241.15MIN: 1185.61 / MAX: 1589.83MIN: 1826.07 / MAX: 2573.73MIN: 940.6 / MAX: 1321.99MIN: 951.54 / MAX: 2214.54MIN: 885.75 / MAX: 1124.151. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P30060090012001500SE +/- 0.47, N = 3SE +/- 1.53, N = 3SE +/- 0.91, N = 3SE +/- 1.28, N = 3SE +/- 2.26, N = 3SE +/- 0.46, N = 3SE +/- 0.75, N = 3SE +/- 0.33, N = 3SE +/- 0.77, N = 3SE +/- 0.97, N = 3SE +/- 0.55, N = 3SE +/- 0.67, N = 3SE +/- 0.43, N = 3SE +/- 1.91, N = 3389.71734.99479.00852.08603.361173.42675.88940.29481.60939.07449.39844.38368.02695.061. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P816243240SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 320.5110.8825.0314.0726.5013.6223.6634.0033.1917.0126.6814.1921.7211.49MIN: 10.96 / MAX: 31.38MIN: 9.85 / MAX: 18.79MIN: 17.49 / MAX: 46.59MIN: 11.6 / MAX: 34.29MIN: 15.94 / MAX: 62.11MIN: 11.93 / MAX: 37.05MIN: 13.21 / MAX: 47.37MIN: 20.86 / MAX: 90.26MIN: 14.88 / MAX: 64.4MIN: 12.34 / MAX: 32.47MIN: 13.7 / MAX: 43.32MIN: 10.82 / MAX: 27.29MIN: 10.48 / MAX: 36.43MIN: 9.55 / MAX: 23.061. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P1632486480SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 39.3618.8512.1724.7215.2931.4316.5624.8135.4373.5833.2267.4425.5251.511. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P30060090012001500SE +/- 0.21, N = 3SE +/- 0.12, N = 3SE +/- 0.56, N = 3SE +/- 0.04, N = 3SE +/- 0.48, N = 3SE +/- 0.49, N = 3SE +/- 1.20, N = 3SE +/- 0.66, N = 3SE +/- 0.13, N = 3SE +/- 0.07, N = 3SE +/- 0.25, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3854.22423.55979.21483.371038.36507.62961.411279.15450.58217.18360.49177.69313.14155.15MIN: 777.98 / MAX: 878.94MIN: 415.99 / MAX: 455.1MIN: 861.53 / MAX: 1015.88MIN: 438.12 / MAX: 515.6MIN: 906.21 / MAX: 1056.67MIN: 474.68 / MAX: 549.27MIN: 831.19 / MAX: 978.3MIN: 1018.37 / MAX: 1317.05MIN: 338.75 / MAX: 484.67MIN: 164.55 / MAX: 257.56MIN: 257.91 / MAX: 392.73MIN: 141.05 / MAX: 204.41MIN: 185.19 / MAX: 336.951. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P7001400210028003500SE +/- 0.19, N = 3SE +/- 0.73, N = 3SE +/- 1.37, N = 3SE +/- 7.85, N = 3SE +/- 0.12, N = 3SE +/- 0.29, N = 3SE +/- 0.71, N = 3SE +/- 1.60, N = 3SE +/- 1.15, N = 3SE +/- 1.96, N = 3SE +/- 1.94, N = 3SE +/- 5.21, N = 3SE +/- 0.17, N = 3SE +/- 1.91, N = 3654.141243.24833.991570.381076.302097.591166.691735.571661.483402.821544.953005.721175.722339.161. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P510152025SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 312.226.4214.387.6314.867.6213.7018.429.614.697.753.986.793.41MIN: 8.5 / MAX: 28.01MIN: 6.15 / MAX: 15.78MIN: 8.17 / MAX: 28.75MIN: 6.86 / MAX: 22.57MIN: 8.08 / MAX: 33.72MIN: 7.15 / MAX: 31.91MIN: 7.41 / MAX: 31.1MIN: 9.93 / MAX: 52.04MIN: 5.23 / MAX: 31.29MIN: 4.17 / MAX: 21.97MIN: 4.25 / MAX: 40.39MIN: 3.28 / MAX: 15.38MIN: 3.7 / MAX: 21.83MIN: 2.97 / MAX: 14.931. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P400800120016002000SE +/- 0.27, N = 3SE +/- 0.57, N = 3SE +/- 0.42, N = 3SE +/- 0.89, N = 3SE +/- 0.67, N = 3SE +/- 1.42, N = 3SE +/- 0.47, N = 3SE +/- 0.61, N = 3SE +/- 1.35, N = 3SE +/- 2.62, N = 3SE +/- 0.30, N = 3SE +/- 1.17, N = 3SE +/- 1.16, N = 3SE +/- 1.02, N = 3404.56788.14517.321024.68651.201196.03716.951033.39904.011813.34853.151664.20640.881296.571. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P816243240SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 319.7610.1323.1811.7024.5513.3222.3030.9535.3435.1228.0928.7324.9324.61MIN: 10.1 / MAX: 35.55MIN: 9.28 / MAX: 20.91MIN: 12.53 / MAX: 39.62MIN: 10.76 / MAX: 20.03MIN: 13.09 / MAX: 41.71MIN: 10.8 / MAX: 27.29MIN: 11.46 / MAX: 38.87MIN: 16.7 / MAX: 61.98MIN: 17.29 / MAX: 68.72MIN: 31.16 / MAX: 58.07MIN: 13.13 / MAX: 55.07MIN: 25.35 / MAX: 48.34MIN: 12.1 / MAX: 57.1MIN: 21.31 / MAX: 35.81. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P4080120160200SE +/- 0.13, N = 3SE +/- 0.19, N = 3SE +/- 0.29, N = 3SE +/- 0.17, N = 3SE +/- 0.31, N = 3SE +/- 0.21, N = 3SE +/- 0.65, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.33, N = 3SE +/- 0.24, N = 3SE +/- 0.38, N = 3SE +/- 0.06, N = 3SE +/- 0.18, N = 349.2094.1860.67119.6875.28152.1083.73116.30112.12204.17102.67181.9877.99144.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P60120180240300SE +/- 0.41, N = 3SE +/- 0.16, N = 3SE +/- 0.94, N = 3SE +/- 0.14, N = 3SE +/- 0.84, N = 3SE +/- 0.13, N = 3SE +/- 1.43, N = 3SE +/- 0.24, N = 3SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.26, N = 3SE +/- 0.14, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3162.4084.87197.58100.17212.22105.07190.87274.66142.5378.16116.8265.81102.5155.49MIN: 81.47 / MAX: 190.75MIN: 79.52 / MAX: 104.17MIN: 108.45 / MAX: 224.88MIN: 87.19 / MAX: 120.18MIN: 102.13 / MAX: 251.51MIN: 87.23 / MAX: 132.74MIN: 91.92 / MAX: 221.58MIN: 113.93 / MAX: 346.09MIN: 52.25 / MAX: 172.52MIN: 70.17 / MAX: 99.06MIN: 63.95 / MAX: 139.61MIN: 58.3 / MAX: 79.61MIN: 56.14 / MAX: 121.15MIN: 48.46 / MAX: 70.391. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P15003000450060007500SE +/- 0.17, N = 3SE +/- 0.17, N = 3SE +/- 0.09, N = 3SE +/- 0.28, N = 3SE +/- 0.26, N = 3SE +/- 1.61, N = 3SE +/- 0.33, N = 3SE +/- 1.30, N = 3SE +/- 1.10, N = 3SE +/- 0.75, N = 3SE +/- 0.53, N = 3SE +/- 3.20, N = 3SE +/- 0.48, N = 3SE +/- 2.46, N = 3913.751934.071211.312570.671520.463255.751628.992475.953345.717209.163090.286564.472347.834979.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P612182430SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 317.5016.5319.8018.6621.0319.6419.6325.839.558.867.757.306.806.41MIN: 9.9 / MAX: 31.67MIN: 15.85 / MAX: 27.79MIN: 9.47 / MAX: 32.84MIN: 17.49 / MAX: 31.43MIN: 10.07 / MAX: 37.02MIN: 17.9 / MAX: 30.08MIN: 10.05 / MAX: 32.68MIN: 12.36 / MAX: 42.4MIN: 5.64 / MAX: 161.27MIN: 7.46 / MAX: 22.29MIN: 4.53 / MAX: 25.85MIN: 6.03 / MAX: 21.33MIN: 4.77 / MAX: 21.69MIN: 5.31 / MAX: 19.261. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P400800120016002000SE +/- 2.63, N = 3SE +/- 1.01, N = 3SE +/- 0.50, N = 3SE +/- 0.70, N = 3SE +/- 0.76, N = 3SE +/- 3.83, N = 3SE +/- 3.78, N = 3SE +/- 1.02, N = 3SE +/- 0.64, N = 3SE +/- 2.61, N = 3SE +/- 1.01, N = 3SE +/- 1.68, N = 3SE +/- 0.53, N = 3SE +/- 1.01, N = 3646.151132.27769.911313.76987.771713.901112.621542.73899.051619.83810.681382.22617.711076.161. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P510152025SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 312.377.0515.579.1216.189.3214.3720.7217.779.8514.788.6512.937.41MIN: 7.65 / MAX: 28.74MIN: 6.43 / MAX: 17.91MIN: 8.87 / MAX: 31.65MIN: 7.26 / MAX: 24.13MIN: 8.55 / MAX: 33.46MIN: 7.86 / MAX: 22.87MIN: 8.67 / MAX: 30.82MIN: 16.73 / MAX: 74.02MIN: 9.82 / MAX: 36.18MIN: 8.63 / MAX: 22.81MIN: 8.27 / MAX: 28.31MIN: 7.32 / MAX: 20.32MIN: 7.44 / MAX: 25.18MIN: 6.33 / MAX: 18.131. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P10K20K30K40K50KSE +/- 16.19, N = 3SE +/- 47.98, N = 3SE +/- 2.86, N = 3SE +/- 25.78, N = 3SE +/- 9.24, N = 3SE +/- 39.42, N = 3SE +/- 8.38, N = 3SE +/- 113.09, N = 3SE +/- 9.27, N = 3SE +/- 9.04, N = 3SE +/- 22.59, N = 3SE +/- 46.35, N = 3SE +/- 6.67, N = 3SE +/- 51.77, N = 313149.7125795.5817211.2834019.2121308.5142487.4923118.2733271.1722808.1447801.0720000.7641669.5015262.3632137.131. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P0.42750.8551.28251.712.1375SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.211.231.391.401.491.501.371.901.381.321.191.141.040.99MIN: 0.71 / MAX: 41.75MIN: 1.03 / MAX: 14.15MIN: 0.77 / MAX: 14.54MIN: 1.13 / MAX: 14.36MIN: 0.7 / MAX: 73.62MIN: 1.19 / MAX: 14.26MIN: 0.75 / MAX: 14.85MIN: 0.99 / MAX: 27.38MIN: 0.61 / MAX: 20.84MIN: 1.02 / MAX: 14.4MIN: 0.57 / MAX: 16.29MIN: 0.85 / MAX: 14.64MIN: 0.63 / MAX: 14.02MIN: 0.73 / MAX: 12.921. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P12K24K36K48K60KSE +/- 3.86, N = 3SE +/- 47.15, N = 3SE +/- 25.63, N = 3SE +/- 96.63, N = 3SE +/- 36.34, N = 3SE +/- 31.93, N = 3SE +/- 28.61, N = 3SE +/- 463.83, N = 3SE +/- 22.82, N = 3SE +/- 28.36, N = 3SE +/- 19.47, N = 3SE +/- 11.43, N = 3SE +/- 12.78, N = 3SE +/- 51.11, N = 314256.4027742.3418711.9236411.0123116.8245746.2725079.4134339.2125216.3854275.4222510.5847664.1717148.8936784.831. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P0.39150.7831.17451.5661.9575SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.111.141.271.301.371.391.271.741.231.161.050.990.920.86MIN: 0.62 / MAX: 14.15MIN: 0.96 / MAX: 12.95MIN: 0.72 / MAX: 14.84MIN: 1.07 / MAX: 14.22MIN: 0.85 / MAX: 19.76MIN: 1.14 / MAX: 14.4MIN: 0.71 / MAX: 14.55MIN: 0.91 / MAX: 22.45MIN: 0.58 / MAX: 21.43MIN: 0.91 / MAX: 14.56MIN: 0.49 / MAX: 15.59MIN: 0.73 / MAX: 14.31MIN: 0.52 / MAX: 14.11MIN: 0.67 / MAX: 13.211. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Apache Cassandra

This is a benchmark of the Apache Cassandra NoSQL database management system making use of cassandra-stress. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: WritesEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P60K120K180K240K300KSE +/- 902.56, N = 3SE +/- 2617.59, N = 3SE +/- 369.63, N = 3SE +/- 1215.21, N = 3SE +/- 591.09, N = 3SE +/- 432.91, N = 3SE +/- 1364.13, N = 3SE +/- 1599.50, N = 3SE +/- 104.54, N = 3SE +/- 515.32, N = 3SE +/- 408.15, N = 3SE +/- 950.77, N = 3SE +/- 609.52, N = 3SE +/- 894.00, N = 3172713236544224875225784263627245226246339253058176284156487200958190873177347171138

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random ReadEPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P60M120M180M240M300MSE +/- 286135.95, N = 3SE +/- 547389.34, N = 3SE +/- 885950.65, N = 3SE +/- 207267.91, N = 3SE +/- 716630.49, N = 3SE +/- 275956.06, N = 3SE +/- 795243.99, N = 3SE +/- 260236.87, N = 3SE +/- 2092706.33, N = 3SE +/- 594128.06, N = 3SE +/- 1248520.83, N = 3SE +/- 427323.28, N = 3SE +/- 779454.00, N = 3181223940120400741238439429150974278299129297161712224246464521113495056226944746104010467210724462773910481540992441. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Test: Random Read

EPYC 7343: The test quit with a non-zero exit status.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Update RandomEPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P200K400K600K800K1000KSE +/- 17553.74, N = 12SE +/- 708.38, N = 3SE +/- 3018.40, N = 3SE +/- 1717.10, N = 3SE +/- 3148.37, N = 3SE +/- 2864.72, N = 3SE +/- 339.25, N = 3SE +/- 1039.48, N = 3SE +/- 379.98, N = 3SE +/- 1500.76, N = 3SE +/- 9205.01, N = 15SE +/- 648.59, N = 3SE +/- 1819.77, N = 34814796383783361317076563515176881724366337937424666977437006407387003798032311. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Test: Update Random

EPYC 7343: The test quit with a non-zero exit status.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Sequential FillEPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P300K600K900K1200K1500KSE +/- 532.43, N = 3SE +/- 3079.56, N = 3SE +/- 319.69, N = 3SE +/- 2451.41, N = 3SE +/- 597.87, N = 3SE +/- 1902.35, N = 3SE +/- 106.07, N = 3SE +/- 4969.08, N = 3SE +/- 3588.97, N = 3SE +/- 1492.53, N = 3SE +/- 4947.74, N = 3SE +/- 2179.57, N = 3SE +/- 6746.06, N = 33235988212792868588648022997327747654522911269946488659144321659746515086079661891. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Test: Sequential Fill

EPYC 7343: The test quit with a non-zero exit status.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random Fill SyncEPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P80K160K240K320K400KSE +/- 335.00, N = 3SE +/- 831.59, N = 3SE +/- 1013.52, N = 3SE +/- 911.55, N = 3SE +/- 1581.82, N = 3SE +/- 1077.11, N = 3SE +/- 1530.69, N = 3SE +/- 79.36, N = 3SE +/- 931.26, N = 3SE +/- 194.11, N = 3SE +/- 6251.07, N = 15SE +/- 98.97, N = 3SE +/- 2669.53, N = 31708281992211654802381271972272337432672822970293071332775533671622087132898961. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Test: Random Fill Sync

EPYC 7343: The test quit with a non-zero exit status.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read While WritingEPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P2M4M6M8M10MSE +/- 76523.17, N = 13SE +/- 43415.41, N = 4SE +/- 142144.80, N = 15SE +/- 32029.62, N = 3SE +/- 135593.38, N = 15SE +/- 15721.89, N = 3SE +/- 68024.06, N = 3SE +/- 22775.73, N = 3SE +/- 153728.35, N = 12SE +/- 40873.57, N = 5SE +/- 44785.37, N = 3SE +/- 23057.76, N = 3SE +/- 42331.24, N = 1548642994117643695720451306848063050514749979329334793137743644438253466230967314206649436701. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Test: Read While Writing

EPYC 7343: The test quit with a non-zero exit status.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read Random Write RandomEPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P600K1200K1800K2400K3000KSE +/- 3492.11, N = 3SE +/- 2301.51, N = 3SE +/- 6678.29, N = 3SE +/- 1879.76, N = 3SE +/- 5136.66, N = 3SE +/- 17808.71, N = 3SE +/- 27203.96, N = 6SE +/- 2675.18, N = 3SE +/- 17390.98, N = 15SE +/- 4554.38, N = 3SE +/- 14296.96, N = 3SE +/- 2003.10, N = 3SE +/- 37734.79, N = 321951912369439219099427500662204871269029827618362770547257992624204222779890231123527624541. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Test: Read Random Write Random

EPYC 7343: The test quit with a non-zero exit status.

nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 200EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P40K80K120K160K200KSE +/- 248.07, N = 3SE +/- 83.69, N = 3SE +/- 288.51, N = 3SE +/- 142.56, N = 3SE +/- 704.77, N = 3SE +/- 73.04, N = 3SE +/- 498.75, N = 3SE +/- 41.84, N = 3SE +/- 271.76, N = 3SE +/- 76.21, N = 3SE +/- 512.32, N = 3SE +/- 24.68, N = 3SE +/- 149.37, N = 3155325.61129033.29135890.54160998.23151573.48161270.01167224.22160541.79205570.62141544.55205476.78118110.63207770.19-std=c99 -O2-std=c99 -O2-std=c99 -O2-std=c99 -O2-std=c99 -O2-std=c99 -O2-std=c99 -O21. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl

Connections: 200

EPYC 7343: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P40K80K120K160K200KSE +/- 185.36, N = 3SE +/- 37.87, N = 3SE +/- 279.41, N = 3SE +/- 89.54, N = 3SE +/- 800.94, N = 3SE +/- 72.87, N = 3SE +/- 309.16, N = 3SE +/- 37.98, N = 3SE +/- 313.96, N = 3SE +/- 169.87, N = 3SE +/- 580.70, N = 3SE +/- 92.60, N = 3SE +/- 232.73, N = 3157128.24131406.38133788.29159784.56140932.43165787.42156012.00160307.52180812.11141031.60204325.45113630.04207339.64-std=c99 -O2-std=c99 -O2-std=c99 -O2-std=c99 -O2-std=c99 -O2-std=c99 -O2-std=c99 -O21. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl

Connections: 500

EPYC 7343: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 1000EPYC 7343 2PEPYC 7413EPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P40K80K120K160K200KSE +/- 189.01, N = 3SE +/- 1390.17, N = 3SE +/- 94.36, N = 3SE +/- 336.74, N = 3SE +/- 148.74, N = 3SE +/- 323.88, N = 3SE +/- 234.38, N = 3SE +/- 416.78, N = 3SE +/- 108.10, N = 3SE +/- 520.06, N = 3SE +/- 58.40, N = 3SE +/- 140.88, N = 3151418.97129682.72156398.74135921.70165810.67151997.72164486.94178255.95153700.70200467.73109860.58199978.55-std=c99 -O2-std=c99 -O2-std=c99 -O2-std=c99 -O2-std=c99 -O2-std=c99 -O21. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl

Connections: 1000

EPYC 7343: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

EPYC 7413 2P: The test quit with a non-zero exit status.

PHPBench

PHPBench is a benchmark suite for PHP. It performs a large number of simple tests in order to bench various aspects of the PHP interpreter. PHPBench can be used to compare hardware, operating systems, PHP versions, PHP accelerators and caches, compiler options, etc. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark SuiteEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P200K400K600K800K1000KSE +/- 1077.87, N = 3SE +/- 2797.29, N = 3SE +/- 1332.81, N = 3SE +/- 4937.26, N = 3SE +/- 4086.10, N = 3SE +/- 1938.22, N = 3SE +/- 1437.74, N = 3SE +/- 3010.31, N = 3SE +/- 1918.32, N = 3SE +/- 340.03, N = 3SE +/- 581.13, N = 3SE +/- 580.18, N = 3SE +/- 678.65, N = 3SE +/- 1806.45, N = 3732752735624670928680136678084686597687000678966719675722240788731789297812732809727

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P8001600240032004000Min: 2145 / Avg: 3603.76 / Max: 3954Min: 2157 / Avg: 3667.94 / Max: 4327Min: 2161 / Avg: 3329.22 / Max: 3766Min: 2276 / Avg: 3393.65 / Max: 3908Min: 2158 / Avg: 3299.38 / Max: 3938Min: 2133 / Avg: 3391.15 / Max: 3882Min: 2196 / Avg: 3362.09 / Max: 3799Min: 1880 / Avg: 3063.29 / Max: 3719Min: 1768 / Avg: 2871.72 / Max: 3251Min: 2063 / Avg: 2933.33 / Max: 3303Min: 2406 / Avg: 3359.04 / Max: 3553Min: 2702 / Avg: 3399.67 / Max: 4321Min: 2730 / Avg: 3569.74 / Max: 3842Min: 3077 / Avg: 3589.28 / Max: 4011

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P150300450600750Min: 23.99 / Avg: 140.71 / Max: 328.9Min: 58.82 / Avg: 232.68 / Max: 664.7Min: 29.1 / Avg: 127 / Max: 324.96Min: 68.53 / Avg: 227.74 / Max: 566.42Min: 26.89 / Avg: 134.88 / Max: 396.04Min: 65.82 / Avg: 239.48 / Max: 696.69Min: 36.25 / Avg: 150.53 / Max: 430.76Min: 43.09 / Avg: 150.11 / Max: 386.67Min: 53.56 / Avg: 168.73 / Max: 425.54Min: 113.87 / Avg: 305.61 / Max: 595.53Min: 45.82 / Avg: 188.97 / Max: 461.29Min: 98.17 / Avg: 321.64 / Max: 832.85Min: 47.76 / Avg: 187.84 / Max: 408.81Min: 102.44 / Avg: 316.34 / Max: 856.39

System Power Consumption Monitor

OpenBenchmarking.orgWattsSystem Power Consumption MonitorPhoronix Test Suite System MonitoringEPYC 7343EPYC 7343 2PEPYC 7413EPYC 7413 2PEPYC 7513EPYC 7513 2PEPYC 7543EPYC 7713PXeon Gold 6338Xeon Gold 6338 2PXeon Gold 6342Xeon Gold 6342 2PXeon Gold 6346Xeon Gold 6346 2P2004006008001000Min: 45 / Avg: 221.93 / Max: 327Min: 8 / Avg: 335.19 / Max: 1229Min: 8 / Avg: 209.56 / Max: 1269Min: 5 / Avg: 341.73 / Max: 815Min: 7 / Avg: 222.77 / Max: 1265Min: 4 / Avg: 354.08 / Max: 1296Min: 45 / Avg: 243.81 / Max: 793Min: 12 / Avg: 247.7 / Max: 769Min: 120 / Avg: 280.3 / Max: 395Min: 236 / Avg: 471.28 / Max: 775Min: 119 / Avg: 299.04 / Max: 441Min: 213 / Avg: 501.51 / Max: 1250Min: 117 / Avg: 279.8 / Max: 378Min: 215 / Avg: 470.82 / Max: 772

146 Results Shown

High Performance Conjugate Gradient
miniBUDE:
  OpenMP - BM1:
    GFInst/s
    Billion Interactions/s
NAMD
nekRS
Pennant:
  sedovbig
  leblancbig
Xcompact3d Incompact3d:
  X3D-benchmarking input.i3d
  input.i3d 193 Cells Per Direction
LULESH
LuxCoreRender:
  Danish Mood - CPU
  Orange Juice - CPU
  LuxCore Benchmark - CPU
  Rainbow Colors and Prism - CPU
Embree:
  Pathtracer - Crown
  Pathtracer ISPC - Crown
  Pathtracer - Asian Dragon
  Pathtracer ISPC - Asian Dragon
Kvazaar:
  Bosphorus 4K - Medium
  Bosphorus 4K - Very Fast
  Bosphorus 4K - Super Fast
SVT-AV1:
  Preset 12 - Bosphorus 4K
  Preset 13 - Bosphorus 4K
SVT-HEVC:
  1 - Bosphorus 4K
  7 - Bosphorus 4K
  10 - Bosphorus 4K
SVT-VP9:
  VMAF Optimized - Bosphorus 4K
  PSNR/SSIM Optimized - Bosphorus 4K
  Visual Quality Optimized - Bosphorus 4K
uvg266:
  Bosphorus 4K - Slow
  Bosphorus 4K - Medium
  Bosphorus 1080p - Slow
  Bosphorus 1080p - Medium
  Bosphorus 4K - Very Fast
  Bosphorus 4K - Super Fast
  Bosphorus 4K - Ultra Fast
  Bosphorus 1080p - Very Fast
  Bosphorus 1080p - Super Fast
  Bosphorus 1080p - Ultra Fast
Timed Linux Kernel Compilation
Timed LLVM Compilation:
  Ninja
  Unix Makefiles
Timed Node.js Compilation
oneDNN
OSPRay Studio:
  1 - 4K - 1 - Path Tracer
  3 - 4K - 1 - Path Tracer
  1 - 4K - 32 - Path Tracer
  3 - 4K - 32 - Path Tracer
FFmpeg:
  libx264 - Live
  libx265 - Live
  libx265 - Live
  libx265 - Upload
  libx265 - Upload
  libx265 - Platform
  libx265 - Platform
  libx265 - Video On Demand
  libx265 - Video On Demand
OpenSSL:
  SHA256
  RSA4096
  RSA4096
ClickHouse:
  100M Rows Hits Dataset, First Run / Cold Cache
  100M Rows Hits Dataset, Second Run
  100M Rows Hits Dataset, Third Run
Memcached:
  1:5
  1:10
  1:100
Graph500:
  26:
    bfs median_TEPS
    bfs max_TEPS
    sssp median_TEPS
    sssp max_TEPS
GROMACS
PostgreSQL:
  1000 - 800 - Read Only
  1000 - 800 - Read Only - Average Latency
  1000 - 1000 - Read Only
  1000 - 1000 - Read Only - Average Latency
  1000 - 800 - Read Write
  1000 - 800 - Read Write - Average Latency
  1000 - 1000 - Read Write
  1000 - 1000 - Read Write - Average Latency
TensorFlow:
  CPU - 256 - ResNet-50
  CPU - 512 - ResNet-50
Neural Magic DeepSparse:
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
Blender:
  BMW27 - CPU-Only
  Classroom - CPU-Only
  Barbershop - CPU-Only
CloudSuite Graph Analytics:
  Page Rank
  Triangle Count
  Connected Components
CloudSuite In-Memory Analytics:
  Large
  Small
CloudSuite Web Serving:
  100
  400
  500
OpenVINO:
  Face Detection FP16 - CPU:
    FPS
    ms
  Person Detection FP16 - CPU:
    FPS
    ms
  Person Detection FP32 - CPU:
    FPS
    ms
  Vehicle Detection FP16 - CPU:
    FPS
    ms
  Face Detection FP16-INT8 - CPU:
    FPS
    ms
  Vehicle Detection FP16-INT8 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16 - CPU:
    FPS
    ms
  Machine Translation EN To DE FP16 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16-INT8 - CPU:
    FPS
    ms
  Person Vehicle Bike Detection FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    FPS
    ms
Apache Cassandra
RocksDB:
  Rand Read
  Update Rand
  Seq Fill
  Rand Fill Sync
  Read While Writing
  Read Rand Write Rand
nginx:
  200
  500
  1000
PHPBench
CPU Peak Freq (Highest CPU Core Frequency) Monitor:
  Phoronix Test Suite System Monitoring:
    Megahertz
    Watts
    Watts