AMD EPYC Zen 4C Power Efficiency

AMD EPYC Zen 4C power efficiency benchmarks by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2401147-NE-AMDEPYCZE24
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

AV1 2 Tests
BLAS (Basic Linear Algebra Sub-Routine) Tests 2 Tests
C++ Boost Tests 3 Tests
Timed Code Compilation 5 Tests
C/C++ Compiler Tests 8 Tests
CPU Massive 13 Tests
Creator Workloads 14 Tests
Cryptography 2 Tests
Database Test Suite 4 Tests
Encoding 6 Tests
Fortran Tests 3 Tests
Game Development 2 Tests
HPC - High Performance Computing 15 Tests
Java Tests 2 Tests
Common Kernel Benchmarks 2 Tests
Machine Learning 5 Tests
Molecular Dynamics 5 Tests
MPI Benchmarks 3 Tests
Multi-Core 24 Tests
NVIDIA GPU Compute 3 Tests
Intel oneAPI 5 Tests
OpenMPI Tests 7 Tests
Programmer / Developer System Benchmarks 6 Tests
Python Tests 9 Tests
Raytracing 2 Tests
Renderers 5 Tests
Scientific Computing 8 Tests
Server 8 Tests
Server CPU Tests 8 Tests
Video Encoding 6 Tests
Common Workstation Benchmarks 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable
Show Perf Per RAM Channel Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
EPYC 7601 - Zen 1
January 13
  1 Day, 1 Hour, 20 Minutes
EPYC 8324P - Zen 4C
January 12
  13 Hours, 1 Minute
EPYC 8324P - Zen 4C, 155W
January 12
  13 Hours, 3 Minutes
EPYC 8324PN - Zen 4C
January 10
  12 Hours, 44 Minutes
EPYC 8534PN - Zen 4C
January 09
  11 Hours, 36 Minutes
Invert Hiding All Results Option
  15 Hours, 9 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


AMD EPYC Zen 4C Power EfficiencyProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4CAMD EPYC 7601 32-Core @ 2.20GHz (32 Cores / 64 Threads)TYAN B8026T70AE24HR (V1.02.B10 BIOS)AMD 17h8 x 16 GB 2667MT/s Samsung M393A2K40BB2-CTD1000GB INTEL SSDPE2KX010T8 + 280GB INTEL SSDPE21D280GAASPEEDVE2282 x Broadcom NetXtreme BCM5720 PCIeUbuntu 23.106.6.9-060609-generic (x86_64)GNOME Shell 45.0X Server 1.21.1.74.5 Mesa 23.2.1-1ubuntu3.1 (LLVM 15.0.7 256 bits)GCC 13.2.0ext41920x1080AMD EPYC 8324P 32-Core @ 2.65GHz (32 Cores / 64 Threads)AMD Cinnabar (RCB1009C BIOS)AMD Device 14a46 x 32 GB DRAM-4800MT/s Samsung M321R4GA0BB0-CQKMG1000GB INTEL SSDPE2KX010T8llvmpipe1920x1200ASPEEDAMD EPYC 8534PN 32-Core @ 2.05GHz (32 Cores / 64 Threads)llvmpipe4.5 Mesa 23.2.1-1ubuntu3.1 (LLVM 15.0.7 256 bits)AMD EPYC 8534PN 64-Core @ 2.00GHz (64 Cores / 128 Threads)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- EPYC 7601 - Zen 1: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0x800126e- EPYC 8324P - Zen 4C: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00212- EPYC 8324P - Zen 4C, 155W: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00212- EPYC 8324PN - Zen 4C: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00212- EPYC 8534PN - Zen 4C: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00212Java Details- OpenJDK Runtime Environment (build 11.0.21+9-post-Ubuntu-0ubuntu123.10)Python Details- Python 3.11.6Security Details- EPYC 7601 - Zen 1: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT vulnerable + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 8324P - Zen 4C: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 8324P - Zen 4C, 155W: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 8324PN - Zen 4C: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 8534PN - Zen 4C: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4CLogarithmic Result OverviewPhoronix Test SuiteminiBUDETensorFlowACES DGEMMOSPRay StudioOpenSSLOpenVINOXmrigIntel Open Image DenoiseeasyWaveOSPRayEmbreeY-CruncherNeural Magic DeepSparseChaos Group V-RAY7-Zip CompressionBlenderIndigoBenchnginxSVT-AV1QuantLibRocksDBRedis 7.0.12 + memtier_benchmarkNAMDTimed Node.js CompilationGPAWFFmpegTimed LLVM CompilationTimed FFmpeg CompilationPyTorchuvg266SpeedbTimed Linux Kernel Compilationx265CloverLeafXcompact3d Incompact3dLAMMPS Molecular Dynamics SimulatorVVenCTimed Gem5 Compilationrav1eOpenRadiossOpenFOAMApache CassandraKripkeApache IoTDBQuicksilverDuckDB

EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4CLogarithmic Per Watt Result OverviewPhoronix Test SuiteACES DGEMMTensorFlowEmbreeIntel Open Image DenoiseXmrigRedis 7.0.12 + memtier_benchmarkOpenSSLOSPRayPyTorchSVT-AV1IndigoBench7-Zip Compressionuvg266Chaos Group V-RAYRocksDBx265QuantLibnginxVVenCFFmpegSpeedbApache Cassandrarav1eKripkeQuicksilverLAMMPS Molecular Dynamics SimulatorminiBUDEP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.M

AMD EPYC Zen 4C Power Efficiencynginx: 500nginx: 1000openssl: RSA4096openssl: RSA4096openssl: SHA256openssl: SHA512openssl: AES-128-GCMopenssl: AES-256-GCMopenssl: ChaCha20openssl: ChaCha20-Poly1305apache-iotdb: 500 - 100 - 500 - 100apache-iotdb: 500 - 100 - 500 - 100duckdb: IMDBduckdb: TPC-H Parquetcassandra: Writesspeedb: Rand Readspeedb: Read While Writingspeedb: Read Rand Write Randspeedb: Update Randrocksdb: Rand Readrocksdb: Read While Writingmemtier-benchmark: Redis - 100 - 1:10memtier-benchmark: Redis - 100 - 1:5compress-7zip: Compression Ratingcompress-7zip: Decompression Ratingbuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-llvm: Ninjabuild-llvm: Unix Makefilesbuild-nodejs: Time To Compilebuild-gem5: Time To Compilebuild-ffmpeg: Time To Compilequantlib: Multi-Threadedopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenradioss: Chrysler Neon 1Mminibude: OpenMP - BM1minibude: OpenMP - BM1minibude: OpenMP - BM2minibude: OpenMP - BM2easywave: e2Asean Grid + BengkuluSept2007 Source - 1200easywave: e2Asean Grid + BengkuluSept2007 Source - 2400gpaw: Carbon Nanotubelammps: 20k Atomscloverleaf: clover_bm64_shortcloverleaf: clover_bm16kripke: incompact3d: input.i3d 193 Cells Per Directionincompact3d: X3D-benchmarking input.i3dnamd: ATPase Simulation - 327,506 Atomsquicksilver: CORAL2 P1quicksilver: CTS2y-cruncher: 500My-cruncher: 1Bmt-dgemm: Sustained Floating-Point Rateblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyblender: Barbershop - CPU-Onlyembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Crownoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyospray-studio: 1 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 1 - Path Tracer - CPUospray-studio: 3 - 4K - 16 - Path Tracer - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray: particle_volume/ao/real_timeospray: particle_volume/scivis/real_timeospray: particle_volume/pathtracer/real_timev-ray: CPUindigobench: CPU - Supercarindigobench: CPU - Bedroomffmpeg: libx265 - Liveffmpeg: libx265 - Uploadffmpeg: libx265 - Platformffmpeg: libx265 - Video On Demandsvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 4Krav1e: 10rav1e: 6x265: Bosphorus 4Kuvg266: Bosphorus 4K - Very Fastuvg266: Bosphorus 4K - Super Fastuvg266: Bosphorus 4K - Ultra Fastvvenc: Bosphorus 4K - Fasterllama-cpp: llama-2-7b.Q4_0.ggufllama-cpp: llama-2-13b.Q4_0.ggufllama-cpp: llama-2-70b-chat.Q5_0.ggufopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamtensorflow: CPU - 16 - ResNet-50pytorch: CPU - 1 - ResNet-50pytorch: CPU - 256 - ResNet-50xmrig: Monero - 1Mxmrig: Wownero - 1Mxmrig: CryptoNight-Femto UPX2 - 1Mxmrig: CryptoNight-Heavy - 1Mxmrig: KawPow - 1Mxmrig: GhostRider - 1MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C94936.9990952.154497.1292445.3270153932678355425337977070348208997661081747935580060303410466375195073586.19198.940249.18915027785990445595425114478192038238461640834636951277853.471159654.3312374613349076.196752.603435.252529.398389.700394.61939.89164469.4122.25778229.494061164.3926498.23358.25414.330355.99014.240152.337357.692144.01213.781106.27954.7318179596737.98899711092.512530.97282130300001144333315.51533.9083.88677672.43191.71101.10246.71765.2021.842118.43870.488452145560281137100541708713319452.599612.452764.146555.285765.2292798.8969199148.5863.98558.0910.4021.0221.0070.77326.7533.0656.9952.96314.2922.2623.5827.296.3584.202.490.463.812096.0113039.702.4442.43188.25376.9784.77296.4226.96464.4817.2038.63206.72878.719.09188.86169.21149.0153.64246.644064.798184.4287189.3186138.0333115.777510.45271501.605168.1629234.021268.9537231.403510.33641515.67928.50971840.9494138.5291115.3465152.9618104.443612.22441289.8227128.6692124.09288.7724.8920.484973.39331.65061.35087.44687.91042.7164234.98166799.1415040.7457516.343033082363138033407473082073084372653031134571594476755171131058928778032135957.21121.485182.7752232931637717627290610223374431725016167887643943102842511.462795965.0524008321118752.144449.986258.219334.293222.067263.53324.49298717.273.513388153.15408763.50167381.881528.84861.1541532.27461.29142.089115.28880.91618.40756.91489.4726877326723.9050407608.2297160.6772818880000143133335.74711.92711.64561647.50119.5859.64148.76426.6245.508536.89171.113493626331185144152731271397379.142578.8362210.49398.797738.77043147.2533351013.5736.177109.8422.2445.0145.07182.26058.0005.91111.7904.70625.5539.2542.9446.5410.74129.7217.933.4331.25510.7152709.190.47150.74106.003102.1310.201860.658.521701.189.34194.7182.005418.925.77688.6046.39633.2125.21818.314519.5341181.232088.1549266.956759.869821.0230751.6244122.3679130.4161122.9256129.843221.0044752.512138.8202410.4658266.985659.87232193.09067.281625.8368611.1481383.700441.639751.7052.7240.5918908.925644.318922.718883.218875.24043.2149458.34151923.6213565.8457514.140200353400129939407372811918785672428305268731594310086201123440838437029490162.60122.143181.3942240341479915557162203213331131763414772176943013432789711.342720321.3022895720003454.798487.576274.946349.611234.231266.95125.67990654.175.250702163.04119779.50949382.571427.41257.0961425.32457.01341.996115.25384.37917.42357.04489.0425871616723.7732938612.2047930.7355818950000143766676.19212.88711.43484952.02130.6765.03161.95463.2743.127034.24021.033787671531281544493786101504108.788988.456349.873738.757848.75896147.2813153612.5725.720109.7122.2545.1245.06175.74655.7175.81611.8184.73125.4537.3340.5044.8110.63529.3817.092.9328.58558.2949194.550.51144.27110.772851.0111.121710.429.291563.3610.18180.3288.554977.136.3621.8251.41579.3427.56752.587421.2407169.562894.2013254.302862.815519.6390803.8219114.6161139.1784115.4212138.226319.7530801.190135.7929443.4299254.130762.88132099.32467.606424.4736647.8855357.295344.715951.0352.9140.5418129.024096.218090.918155.018088.74031.7136660.96139259.2611909.2430171.635795826073116448675902514155583702164356602071476020776501010650231237728515258.92123.667182.9342122071322481926934544198225730572913120683041073132562876.162500035.0921245817907258.519539.240300.444371.536253.142295.06027.57480175.382.15286172.68566793.87207391.361278.03051.1211276.47251.05942.257116.03190.06515.69057.52492.5024750013324.3467388628.8442990.8279018273333140300006.65313.97111.51727258.20146.9072.96182.47518.2139.600631.08140.934222740231421605004866781672097.979107.665328.893618.132318.14358147.2202817711.2495.127109.7722.2445.0344.99167.16351.5375.55111.8244.72724.0333.8236.7541.0210.29128.5617.063.1125.41627.4643375.550.57131.24121.742520.7712.581527.3210.391424.5311.15163.0997.914405.627.13555.7157.50520.2430.69674.929423.6852152.2068104.8987229.535069.603717.7641892.1039103.4399154.2821104.1306153.396817.6664894.195632.1289493.9887229.912369.50781906.38708.374521.9096722.1041320.863749.797347.7752.9040.3616892.321769.216799.216932.816877.93938.5229161.91232146.4121064.1828697.469910430987226972662074934344962504244000382072846962933731960125738538273149554.71127.201178.69824417724884261612585315227202634974524896938766880892568868.492513019.3233292234394644.423341.477190.992277.910174.002230.99019.376154830.958.610212184.16204687.42305300.622491.16599.6472489.19799.56839.330109.82765.47225.71557.42496.5528839430020.9756184563.3467810.4320021233333163000005.20710.44221.13881930.5776.3238.6695.44267.5874.926859.05131.71214640603747522544474728786015.059614.613116.895414.908614.8549164.2055420421.7679.973115.1123.3147.0347.08190.88764.3366.55612.1864.86827.5147.6549.2251.3311.27249.43644.8071960.410.61202.29157.934878.0012.972816.0911.242547.7312.47295.61108.068310.717.521086.6858.78934.5934.141287.877824.8184281.4898113.4506429.327074.427032.1554982.6109191.0676166.9491192.0616166.026732.1461982.329856.8419556.1457429.360374.41023450.43349.252040.6410776.5434613.226952.123548.5645.2336.2320484.335370.020477.120489.820487.24374.0OpenBenchmarking.org

nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50K100K150K200K250KSE +/- 911.83, N = 3SE +/- 549.43, N = 3SE +/- 1108.21, N = 3SE +/- 213.01, N = 3SE +/- 217.83, N = 394936.99164234.98149458.34136660.96229161.911. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C40K80K120K160K200KMin: 93141.17 / Avg: 94936.99 / Max: 96109.8Min: 163580.51 / Avg: 164234.98 / Max: 165326.66Min: 148081.34 / Avg: 149458.34 / Max: 151650.94Min: 136432.12 / Avg: 136660.96 / Max: 137086.58Min: 228734.88 / Avg: 229161.91 / Max: 229450.141. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 1000EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50K100K150K200K250KSE +/- 357.56, N = 3SE +/- 343.16, N = 3SE +/- 49.01, N = 3SE +/- 199.18, N = 3SE +/- 302.03, N = 390952.15166799.14151923.62139259.26232146.411. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 1000EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C40K80K120K160K200KMin: 90519.17 / Avg: 90952.15 / Max: 91661.54Min: 166255.25 / Avg: 166799.14 / Max: 167433.59Min: 151842.2 / Avg: 151923.62 / Max: 152011.6Min: 138873.24 / Avg: 139259.26 / Max: 139537.48Min: 231689.89 / Avg: 232146.41 / Max: 232717.261. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

OpenSSL

OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test profile makes use of the built-in "openssl speed" benchmarking capabilities. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.1Algorithm: RSA4096EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C5K10K15K20K25KSE +/- 12.09, N = 3SE +/- 2.49, N = 3SE +/- 3.08, N = 3SE +/- 3.00, N = 3SE +/- 4.13, N = 34497.115040.713565.811909.221064.11. (CC) gcc options: -pthread -m64 -O3 -ldl
OpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.1Algorithm: RSA4096EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4K8K12K16K20KMin: 4474.5 / Avg: 4497.13 / Max: 4515.8Min: 15035.8 / Avg: 15040.73 / Max: 15043.8Min: 13561.7 / Avg: 13565.77 / Max: 13571.8Min: 11905 / Avg: 11909.17 / Max: 11915Min: 21056.2 / Avg: 21064.13 / Max: 21070.11. (CC) gcc options: -pthread -m64 -O3 -ldl

OpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.1Algorithm: RSA4096EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C200K400K600K800K1000KSE +/- 714.27, N = 3SE +/- 61.89, N = 3SE +/- 30.98, N = 3SE +/- 22.57, N = 3SE +/- 136.41, N = 3292445.3457516.3457514.1430171.6828697.41. (CC) gcc options: -pthread -m64 -O3 -ldl
OpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.1Algorithm: RSA4096EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C140K280K420K560K700KMin: 291016.8 / Avg: 292445.33 / Max: 293162.8Min: 457415.2 / Avg: 457516.3 / Max: 457628.7Min: 457452.3 / Avg: 457514.13 / Max: 457548.6Min: 430144.9 / Avg: 430171.63 / Max: 430216.5Min: 828521.3 / Avg: 828697.4 / Max: 828965.91. (CC) gcc options: -pthread -m64 -O3 -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: SHA256EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C15000M30000M45000M60000M75000MSE +/- 58715423.07, N = 3SE +/- 11419799.65, N = 3SE +/- 12904999.14, N = 3SE +/- 16148314.98, N = 3SE +/- 41929433.75, N = 327015393267430330823634020035340035795826073699104309871. (CC) gcc options: -pthread -m64 -O3 -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: SHA256EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C12000M24000M36000M48000M60000MMin: 26942010490 / Avg: 27015393266.67 / Max: 27131480680Min: 43011212480 / Avg: 43033082363.33 / Max: 43049719640Min: 40177044330 / Avg: 40200353400 / Max: 40221606500Min: 35769472760 / Avg: 35795826073.33 / Max: 35825171570Min: 69826786200 / Avg: 69910430986.67 / Max: 699574393701. (CC) gcc options: -pthread -m64 -O3 -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: SHA512EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C5000M10000M15000M20000M25000MSE +/- 7664614.59, N = 3SE +/- 1511880.16, N = 3SE +/- 794607.82, N = 3SE +/- 3220312.96, N = 3SE +/- 1693446.92, N = 38355425337138033407471299394073711644867590226972662071. (CC) gcc options: -pthread -m64 -O3 -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: SHA512EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4000M8000M12000M16000M20000MMin: 8341580940 / Avg: 8355425336.67 / Max: 8368047400Min: 13801146740 / Avg: 13803340746.67 / Max: 13806239720Min: 12992943030 / Avg: 12993940736.67 / Max: 12995510870Min: 11638518240 / Avg: 11644867590 / Max: 11648977980Min: 22694215600 / Avg: 22697266206.67 / Max: 227000657301. (CC) gcc options: -pthread -m64 -O3 -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: AES-128-GCMEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C110000M220000M330000M440000M550000MSE +/- 228892930.90, N = 3SE +/- 338919345.53, N = 3SE +/- 1389668244.12, N = 3SE +/- 43613214.37, N = 3SE +/- 350336826.28, N = 3977070348203082073084372811918785672514155583704934344962501. (CC) gcc options: -pthread -m64 -O3 -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: AES-128-GCMEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C90000M180000M270000M360000M450000MMin: 97370110630 / Avg: 97707034820 / Max: 98143894920Min: 307652755180 / Avg: 308207308436.67 / Max: 308822152810Min: 278416801520 / Avg: 281191878566.67 / Max: 282712623790Min: 251351739320 / Avg: 251415558370 / Max: 251498962400Min: 492765336100 / Avg: 493434496250 / Max: 4939490101901. (CC) gcc options: -pthread -m64 -O3 -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: AES-256-GCMEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C90000M180000M270000M360000M450000MSE +/- 220160896.72, N = 3SE +/- 72395520.64, N = 3SE +/- 104993783.37, N = 3SE +/- 288672373.67, N = 3SE +/- 171818503.35, N = 3899766108172653031134572428305268732164356602074244000382071. (CC) gcc options: -pthread -m64 -O3 -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: AES-256-GCMEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C70000M140000M210000M280000M350000MMin: 89639242410 / Avg: 89976610816.67 / Max: 90390344770Min: 265227952670 / Avg: 265303113456.67 / Max: 265447868830Min: 242671806330 / Avg: 242830526873.33 / Max: 243028954040Min: 215933606020 / Avg: 216435660206.67 / Max: 216933570700Min: 424065454350 / Avg: 424400038206.67 / Max: 4246351904801. (CC) gcc options: -pthread -m64 -O3 -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: ChaCha20EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C60000M120000M180000M240000M300000MSE +/- 18792715.18, N = 3SE +/- 3614035.56, N = 3SE +/- 2748202.21, N = 3SE +/- 4106091.67, N = 3SE +/- 8141159.25, N = 3479355800601594476755171594310086201476020776502846962933731. (CC) gcc options: -pthread -m64 -O3 -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: ChaCha20EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50000M100000M150000M200000M250000MMin: 47910868310 / Avg: 47935580060 / Max: 47972461340Min: 159442442920 / Avg: 159447675516.67 / Max: 159454610230Min: 159425925940 / Avg: 159431008620 / Max: 159435361760Min: 147593885830 / Avg: 147602077650 / Max: 147606674090Min: 284682129950 / Avg: 284696293373.33 / Max: 2847103309101. (CC) gcc options: -pthread -m64 -O3 -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: ChaCha20-Poly1305EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C40000M80000M120000M160000M200000MSE +/- 21793844.67, N = 3SE +/- 5327895.48, N = 3SE +/- 3407926.56, N = 3SE +/- 36167959.31, N = 3SE +/- 52537274.39, N = 3303410466371131058928771123440838431010650231231960125738531. (CC) gcc options: -pthread -m64 -O3 -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: ChaCha20-Poly1305EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C30000M60000M90000M120000M150000MMin: 30311736120 / Avg: 30341046636.67 / Max: 30383640850Min: 113097520470 / Avg: 113105892876.67 / Max: 113115787540Min: 112339295710 / Avg: 112344083843.33 / Max: 112350678770Min: 100993304710 / Avg: 101065023123.33 / Max: 101109050300Min: 195908043840 / Avg: 196012573853.33 / Max: 1960740910401. (CC) gcc options: -pthread -m64 -O3 -ldl

Apache IoTDB

Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20M40M60M80M100MSE +/- 395656.07, N = 3SE +/- 458351.52, N = 3SE +/- 1107129.95, N = 12SE +/- 90002.32, N = 3SE +/- 820005.27, N = 35195073580321359702949017728515282731495
OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C14M28M42M56M70MMin: 51173499.27 / Avg: 51950734.58 / Max: 52468038.44Min: 79409637.67 / Avg: 80321359.41 / Max: 80859869.76Min: 64872247.92 / Avg: 70294901.06 / Max: 76966536.29Min: 77142157.02 / Avg: 77285151.69 / Max: 77451336.12Min: 81253977.14 / Avg: 82731495.34 / Max: 84086639.79

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100SE +/- 0.92, N = 3SE +/- 0.50, N = 3SE +/- 0.98, N = 12SE +/- 0.18, N = 3SE +/- 0.27, N = 386.1957.2162.6058.9254.71MAX: 12666.75MAX: 10096.05MAX: 11339.9MAX: 10097.01MAX: 10074.09
OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1632486480Min: 84.63 / Avg: 86.19 / Max: 87.8Min: 56.6 / Avg: 57.21 / Max: 58.2Min: 57.78 / Avg: 62.6 / Max: 67.24Min: 58.56 / Avg: 58.92 / Max: 59.14Min: 54.29 / Avg: 54.71 / Max: 55.2

DuckDB

DuckDB is an in-progress SQL OLAP database management system optimized for analytics and features a vectorized and parallel engine. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterDuckDB 0.9.1Benchmark: IMDBEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200SE +/- 0.90, N = 3SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3198.94121.49122.14123.67127.201. (CXX) g++ options: -O3 -rdynamic -lssl -lcrypto -ldl
OpenBenchmarking.orgSeconds, Fewer Is BetterDuckDB 0.9.1Benchmark: IMDBEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200Min: 197.17 / Avg: 198.94 / Max: 200.07Min: 121.34 / Avg: 121.48 / Max: 121.72Min: 122 / Avg: 122.14 / Max: 122.33Min: 123.47 / Avg: 123.67 / Max: 123.82Min: 127.06 / Avg: 127.2 / Max: 127.321. (CXX) g++ options: -O3 -rdynamic -lssl -lcrypto -ldl

OpenBenchmarking.orgSeconds, Fewer Is BetterDuckDB 0.9.1Benchmark: TPC-H ParquetEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50100150200250SE +/- 1.55, N = 3SE +/- 0.21, N = 3SE +/- 0.48, N = 3SE +/- 0.25, N = 3SE +/- 0.63, N = 3249.19182.78181.39182.93178.701. (CXX) g++ options: -O3 -rdynamic -lssl -lcrypto -ldl
OpenBenchmarking.orgSeconds, Fewer Is BetterDuckDB 0.9.1Benchmark: TPC-H ParquetEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50100150200250Min: 246.3 / Avg: 249.19 / Max: 251.6Min: 182.45 / Avg: 182.77 / Max: 183.16Min: 180.67 / Avg: 181.39 / Max: 182.31Min: 182.44 / Avg: 182.93 / Max: 183.2Min: 177.68 / Avg: 178.7 / Max: 179.861. (CXX) g++ options: -O3 -rdynamic -lssl -lcrypto -ldl

Apache Cassandra

This is a benchmark of the Apache Cassandra NoSQL database management system making use of cassandra-stress. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.1.3Test: WritesEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50K100K150K200K250KSE +/- 1316.75, N = 8SE +/- 371.97, N = 3SE +/- 522.48, N = 3SE +/- 423.47, N = 3SE +/- 1997.81, N = 3150277223293224034212207244177
OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.1.3Test: WritesEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C40K80K120K160K200KMin: 144978 / Avg: 150277 / Max: 155193Min: 222612 / Avg: 223292.67 / Max: 223893Min: 223170 / Avg: 224034 / Max: 224975Min: 211600 / Avg: 212207 / Max: 213022Min: 240268 / Avg: 244176.67 / Max: 246849

Speedb

Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50M100M150M200M250MSE +/- 986396.38, N = 3SE +/- 141623.12, N = 3SE +/- 1751764.05, N = 3SE +/- 227689.47, N = 3SE +/- 139678.30, N = 3859904451637717621479915551322481922488426161. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C40M80M120M160M200MMin: 84869173 / Avg: 85990445 / Max: 87956782Min: 163562678 / Avg: 163771762.33 / Max: 164041786Min: 144488359 / Avg: 147991554.67 / Max: 149784949Min: 131951605 / Avg: 132248191.67 / Max: 132695742Min: 248573691 / Avg: 248842615.67 / Max: 2490425741. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read While WritingEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C3M6M9M12M15MSE +/- 81525.26, N = 3SE +/- 52967.61, N = 15SE +/- 7924.49, N = 3SE +/- 50044.04, N = 3SE +/- 117697.08, N = 155954251729061071622036934544125853151. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read While WritingEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C2M4M6M8M10MMin: 5853089 / Avg: 5954251 / Max: 6115574Min: 6981133 / Avg: 7290609.53 / Max: 7783254Min: 7146405 / Avg: 7162203.33 / Max: 7171199Min: 6847068 / Avg: 6934544 / Max: 7020403Min: 11539758 / Avg: 12585315.07 / Max: 132179341. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read Random Write RandomEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C500K1000K1500K2000K2500KSE +/- 4528.27, N = 3SE +/- 3849.48, N = 3SE +/- 1300.80, N = 3SE +/- 1833.01, N = 3SE +/- 2240.30, N = 3144781922337442133311198225722720261. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read Random Write RandomEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C400K800K1200K1600K2000KMin: 1441989 / Avg: 1447819 / Max: 1456736Min: 2226681 / Avg: 2233744 / Max: 2239929Min: 2131302 / Avg: 2133311 / Max: 2135747Min: 1978791 / Avg: 1982257.33 / Max: 1985024Min: 2268918 / Avg: 2272026 / Max: 22763751. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Update RandomEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C70K140K210K280K350KSE +/- 190.36, N = 3SE +/- 579.72, N = 3SE +/- 167.58, N = 3SE +/- 863.96, N = 3SE +/- 2986.90, N = 152038233172503176343057293497451. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Update RandomEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C60K120K180K240K300KMin: 203514 / Avg: 203822.67 / Max: 204170Min: 316226 / Avg: 317249.67 / Max: 318233Min: 317393 / Avg: 317633.67 / Max: 317956Min: 304019 / Avg: 305729 / Max: 306799Min: 336922 / Avg: 349744.8 / Max: 3650051. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Random ReadEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50M100M150M200M250MSE +/- 709803.02, N = 3SE +/- 126210.06, N = 3SE +/- 294601.47, N = 3SE +/- 242981.96, N = 3SE +/- 187915.38, N = 3846164081616788761477217691312068302489693871. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Random ReadEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C40M80M120M160M200MMin: 83208797 / Avg: 84616407.67 / Max: 85479697Min: 161480476 / Avg: 161678875.67 / Max: 161913224Min: 147169239 / Avg: 147721769 / Max: 148175243Min: 130883601 / Avg: 131206829.67 / Max: 131682710Min: 248771937 / Avg: 248969387.33 / Max: 2493450541. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Read While WritingEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1.4M2.8M4.2M5.6M7MSE +/- 36400.82, N = 3SE +/- 38567.21, N = 15SE +/- 47925.84, N = 5SE +/- 3126.89, N = 3SE +/- 64443.01, N = 15346369543943104301343410731366880891. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Read While WritingEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1.2M2.4M3.6M4.8M6MMin: 3408105 / Avg: 3463695.33 / Max: 3532201Min: 4168410 / Avg: 4394310.27 / Max: 4662322Min: 4129273 / Avg: 4301343.4 / Max: 4390412Min: 4101335 / Avg: 4107312.67 / Max: 4111893Min: 6409554 / Avg: 6688088.6 / Max: 72820421. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Redis 7.0.12 + memtier_benchmark

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C600K1200K1800K2400K3000KSE +/- 10214.62, N = 3SE +/- 3585.70, N = 3SE +/- 16343.62, N = 3SE +/- 11338.77, N = 3SE +/- 20726.56, N = 31277853.472842511.462789711.342562876.162568868.491. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C500K1000K1500K2000K2500KMin: 1257506.05 / Avg: 1277853.47 / Max: 1289609.01Min: 2835589.04 / Avg: 2842511.46 / Max: 2847594.99Min: 2757024.37 / Avg: 2789711.34 / Max: 2806171.83Min: 2540251.25 / Avg: 2562876.16 / Max: 2575525.9Min: 2542825.47 / Avg: 2568868.49 / Max: 2609820.131. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:5EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C600K1200K1800K2400K3000KSE +/- 11184.62, N = 3SE +/- 10431.24, N = 3SE +/- 15002.29, N = 3SE +/- 18767.16, N = 3SE +/- 10691.43, N = 31159654.332795965.052720321.302500035.092513019.321. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:5EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C500K1000K1500K2000K2500KMin: 1141796.81 / Avg: 1159654.33 / Max: 1180250.1Min: 2778309.26 / Avg: 2795965.05 / Max: 2814417.76Min: 2691163.64 / Avg: 2720321.3 / Max: 2741030.33Min: 2480142.32 / Avg: 2500035.09 / Max: 2537546.44Min: 2498105.06 / Avg: 2513019.32 / Max: 2533746.491. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

7-Zip Compression

This is a test of 7-Zip compression/decompression with its integrated benchmark feature. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C70K140K210K280K350KSE +/- 1639.95, N = 3SE +/- 329.87, N = 3SE +/- 172.23, N = 3SE +/- 39.63, N = 3SE +/- 303.12, N = 31237462400832289572124583329221. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C60K120K180K240K300KMin: 121837 / Avg: 123745.67 / Max: 127010Min: 239557 / Avg: 240083.33 / Max: 240691Min: 228706 / Avg: 228957.33 / Max: 229287Min: 212401 / Avg: 212457.67 / Max: 212534Min: 332578 / Avg: 332921.67 / Max: 3335261. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C70K140K210K280K350KSE +/- 602.42, N = 3SE +/- 111.02, N = 3SE +/- 181.34, N = 3SE +/- 170.94, N = 3SE +/- 107.49, N = 31334902111872000341790723439461. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C60K120K180K240K300KMin: 132682 / Avg: 133490 / Max: 134668Min: 211051 / Avg: 211187 / Max: 211407Min: 199678 / Avg: 200034 / Max: 200272Min: 178730 / Avg: 179071.67 / Max: 179253Min: 343741 / Avg: 343945.67 / Max: 3441051. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100SE +/- 0.84, N = 3SE +/- 0.71, N = 3SE +/- 0.67, N = 3SE +/- 0.71, N = 3SE +/- 0.52, N = 476.2052.1454.8058.5244.42
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1530456075Min: 74.99 / Avg: 76.2 / Max: 77.81Min: 51.35 / Avg: 52.14 / Max: 53.57Min: 54.03 / Avg: 54.8 / Max: 56.13Min: 57.78 / Avg: 58.52 / Max: 59.94Min: 43.86 / Avg: 44.42 / Max: 45.99

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C160320480640800SE +/- 0.46, N = 3SE +/- 0.84, N = 3SE +/- 0.47, N = 3SE +/- 0.77, N = 3SE +/- 0.92, N = 3752.60449.99487.58539.24341.48
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C130260390520650Min: 751.69 / Avg: 752.6 / Max: 753.07Min: 448.97 / Avg: 449.99 / Max: 451.66Min: 487.02 / Avg: 487.58 / Max: 488.52Min: 538.25 / Avg: 539.24 / Max: 540.76Min: 340.22 / Avg: 341.48 / Max: 343.26

Timed LLVM Compilation

This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C90180270360450SE +/- 0.41, N = 3SE +/- 1.36, N = 3SE +/- 1.25, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3435.25258.22274.95300.44190.99
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C80160240320400Min: 434.84 / Avg: 435.25 / Max: 436.08Min: 256.78 / Avg: 258.22 / Max: 260.94Min: 272.74 / Avg: 274.95 / Max: 277.06Min: 300.19 / Avg: 300.44 / Max: 300.74Min: 190.71 / Avg: 190.99 / Max: 191.16

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Unix MakefilesEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C110220330440550SE +/- 1.30, N = 3SE +/- 0.60, N = 3SE +/- 1.23, N = 3SE +/- 0.95, N = 3SE +/- 0.46, N = 3529.40334.29349.61371.54277.91
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Unix MakefilesEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C90180270360450Min: 527.08 / Avg: 529.4 / Max: 531.56Min: 333.09 / Avg: 334.29 / Max: 334.91Min: 347.15 / Avg: 349.61 / Max: 350.98Min: 369.73 / Avg: 371.54 / Max: 372.97Min: 277.03 / Avg: 277.91 / Max: 278.57

Timed Node.js Compilation

This test profile times how long it takes to build/compile Node.js itself from source. Node.js is a JavaScript run-time built from the Chrome V8 JavaScript engine while itself is written in C/C++. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1Time To CompileEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C80160240320400SE +/- 0.67, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.22, N = 3SE +/- 0.04, N = 3389.70222.07234.23253.14174.00
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1Time To CompileEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C70140210280350Min: 388.47 / Avg: 389.7 / Max: 390.78Min: 221.86 / Avg: 222.07 / Max: 222.29Min: 234.04 / Avg: 234.23 / Max: 234.52Min: 252.7 / Avg: 253.14 / Max: 253.44Min: 173.96 / Avg: 174 / Max: 174.08

Timed Gem5 Compilation

This test times how long it takes to compile Gem5. Gem5 is a simulator for computer system architecture research. Gem5 is widely used for computer architecture research within the industry, academia, and more. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To CompileEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C90180270360450SE +/- 4.56, N = 3SE +/- 2.62, N = 9SE +/- 1.97, N = 3SE +/- 3.60, N = 3SE +/- 2.69, N = 4394.62263.53266.95295.06230.99
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To CompileEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C70140210280350Min: 385.76 / Avg: 394.62 / Max: 400.89Min: 253.37 / Avg: 263.53 / Max: 274.36Min: 263.29 / Avg: 266.95 / Max: 270.02Min: 288.38 / Avg: 295.06 / Max: 300.71Min: 223 / Avg: 230.99 / Max: 234.59

Timed FFmpeg Compilation

This test times how long it takes to build the FFmpeg multimedia library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1Time To CompileEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C918273645SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 339.8924.4925.6827.5719.38
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1Time To CompileEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C816243240Min: 39.75 / Avg: 39.89 / Max: 40.04Min: 24.42 / Avg: 24.49 / Max: 24.54Min: 25.56 / Avg: 25.68 / Max: 25.78Min: 27.52 / Avg: 27.57 / Max: 27.66Min: 19.18 / Avg: 19.38 / Max: 19.53

QuantLib

QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C30K60K90K120K150KSE +/- 165.76, N = 3SE +/- 60.04, N = 3SE +/- 100.68, N = 3SE +/- 122.23, N = 3SE +/- 29.72, N = 364469.498717.290654.180175.3154830.91. (CXX) g++ options: -O3 -march=native -fPIE -pie
OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C30K60K90K120K150KMin: 64253.1 / Avg: 64469.37 / Max: 64795.1Min: 98600.4 / Avg: 98717.23 / Max: 98799.7Min: 90452.9 / Avg: 90654.13 / Max: 90761Min: 79969.3 / Avg: 80175.33 / Max: 80392.3Min: 154771.9 / Avg: 154830.9 / Max: 154866.61. (CXX) g++ options: -O3 -march=native -fPIE -pie

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C306090120150122.2673.5175.2582.1558.611. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50100150200250229.49153.15163.04172.69184.161. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C300600900120015001164.39763.50779.51793.87687.421. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C110220330440550SE +/- 0.95, N = 3SE +/- 0.38, N = 3SE +/- 0.48, N = 3SE +/- 0.66, N = 3SE +/- 0.58, N = 3498.23381.88382.57391.36300.62
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C90180270360450Min: 497.04 / Avg: 498.23 / Max: 500.1Min: 381.13 / Avg: 381.88 / Max: 382.4Min: 381.62 / Avg: 382.57 / Max: 383.16Min: 390.21 / Avg: 391.36 / Max: 392.5Min: 299.5 / Avg: 300.62 / Max: 301.42

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C5001000150020002500SE +/- 0.43, N = 3SE +/- 0.21, N = 4SE +/- 0.86, N = 4SE +/- 1.51, N = 4SE +/- 0.47, N = 6358.251528.851427.411278.032491.171. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C400800120016002000Min: 357.52 / Avg: 358.25 / Max: 359Min: 1528.23 / Avg: 1528.85 / Max: 1529.17Min: 1425.01 / Avg: 1427.41 / Max: 1428.91Min: 1275.16 / Avg: 1278.03 / Max: 1281.03Min: 2489.3 / Avg: 2491.16 / Max: 2492.841. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100SE +/- 0.02, N = 3SE +/- 0.01, N = 4SE +/- 0.03, N = 4SE +/- 0.06, N = 4SE +/- 0.02, N = 614.3361.1557.1051.1299.651. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100Min: 14.3 / Avg: 14.33 / Max: 14.36Min: 61.13 / Avg: 61.15 / Max: 61.17Min: 57 / Avg: 57.1 / Max: 57.16Min: 51.01 / Avg: 51.12 / Max: 51.24Min: 99.57 / Avg: 99.65 / Max: 99.711. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C5001000150020002500SE +/- 0.44, N = 3SE +/- 0.47, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.34, N = 3355.991532.271425.321276.472489.201. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C400800120016002000Min: 355.15 / Avg: 355.99 / Max: 356.62Min: 1531.8 / Avg: 1532.27 / Max: 1533.22Min: 1424.98 / Avg: 1425.32 / Max: 1425.5Min: 1276.29 / Avg: 1276.47 / Max: 1276.65Min: 2488.52 / Avg: 2489.2 / Max: 2489.561. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 314.2461.2957.0151.0699.571. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100Min: 14.21 / Avg: 14.24 / Max: 14.27Min: 61.27 / Avg: 61.29 / Max: 61.33Min: 57 / Avg: 57.01 / Max: 57.02Min: 51.05 / Avg: 51.06 / Max: 51.07Min: 99.54 / Avg: 99.57 / Max: 99.581. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

easyWave

The easyWave software allows simulating tsunami generation and propagation in the context of early warning systems. EasyWave supports making use of OpenMP for CPU multi-threading and there are also GPU ports available but not currently incorporated as part of this test profile. The easyWave tsunami generation software is run with one of the example/reference input files for measuring the CPU execution time. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C306090120150SE +/- 1.85, N = 3SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.50, N = 3152.3442.0942.0042.2639.331. (CXX) g++ options: -O3 -fopenmp
OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C306090120150Min: 148.83 / Avg: 152.34 / Max: 155.1Min: 41.84 / Avg: 42.09 / Max: 42.41Min: 41.66 / Avg: 42 / Max: 42.25Min: 42.08 / Avg: 42.26 / Max: 42.42Min: 38.78 / Avg: 39.33 / Max: 40.331. (CXX) g++ options: -O3 -fopenmp

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C80160240320400SE +/- 4.58, N = 9SE +/- 0.36, N = 3SE +/- 0.25, N = 3SE +/- 0.25, N = 3SE +/- 0.94, N = 3357.69115.29115.25116.03109.831. (CXX) g++ options: -O3 -fopenmp
OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C60120180240300Min: 343.14 / Avg: 357.69 / Max: 385.39Min: 114.65 / Avg: 115.29 / Max: 115.88Min: 114.76 / Avg: 115.25 / Max: 115.56Min: 115.55 / Avg: 116.03 / Max: 116.39Min: 108.71 / Avg: 109.83 / Max: 111.691. (CXX) g++ options: -O3 -fopenmp

GPAW

GPAW is a density-functional theory (DFT) Python code based on the projector-augmented wave (PAW) method and the atomic simulation environment (ASE). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 23.6Input: Carbon NanotubeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C306090120150SE +/- 1.20, N = 3SE +/- 0.45, N = 3SE +/- 0.21, N = 3SE +/- 0.19, N = 3SE +/- 0.11, N = 3144.0180.9284.3890.0765.471. (CC) gcc options: -shared -fwrapv -O2 -lxc -lblas -lmpi
OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 23.6Input: Carbon NanotubeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C306090120150Min: 141.78 / Avg: 144.01 / Max: 145.89Min: 80.25 / Avg: 80.92 / Max: 81.76Min: 84.08 / Avg: 84.38 / Max: 84.79Min: 89.79 / Avg: 90.06 / Max: 90.42Min: 65.31 / Avg: 65.47 / Max: 65.691. (CC) gcc options: -shared -fwrapv -O2 -lxc -lblas -lmpi

LAMMPS Molecular Dynamics Simulator

LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C612182430SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.28, N = 313.7818.4117.4215.6925.721. (CXX) g++ options: -O3 -lm -ldl
OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C612182430Min: 13.72 / Avg: 13.78 / Max: 13.88Min: 18.3 / Avg: 18.41 / Max: 18.47Min: 17.36 / Avg: 17.42 / Max: 17.45Min: 15.67 / Avg: 15.69 / Max: 15.73Min: 25.16 / Avg: 25.71 / Max: 26.11. (CXX) g++ options: -O3 -lm -ldl

CloverLeaf

CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm64_shortEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3106.2756.9157.0457.5257.421. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm64_shortEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100Min: 106.01 / Avg: 106.27 / Max: 106.61Min: 56.86 / Avg: 56.91 / Max: 56.96Min: 56.97 / Avg: 57.04 / Max: 57.1Min: 57.46 / Avg: 57.52 / Max: 57.58Min: 57.34 / Avg: 57.42 / Max: 57.491. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm16EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C2004006008001000SE +/- 3.58, N = 3SE +/- 0.11, N = 3SE +/- 0.34, N = 3SE +/- 0.30, N = 3SE +/- 0.16, N = 3954.73489.47489.04492.50496.551. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm16EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C2004006008001000Min: 947.7 / Avg: 954.73 / Max: 959.38Min: 489.28 / Avg: 489.47 / Max: 489.66Min: 488.37 / Avg: 489.04 / Max: 489.47Min: 491.97 / Avg: 492.5 / Max: 493.02Min: 496.22 / Avg: 496.55 / Max: 496.741. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

Kripke

Kripke is a simple, scalable, 3D Sn deterministic particle transport code. Its primary purpose is to research how data layout, programming paradigms and architectures effect the implementation and performance of Sn transport. Kripke is developed by LLNL. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgThroughput FoM, More Is BetterKripke 1.2.6EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C60M120M180M240M300MSE +/- 1494376.42, N = 3SE +/- 634968.78, N = 3SE +/- 2369703.74, N = 3SE +/- 363531.75, N = 3SE +/- 1948629.96, N = 31817959672687732672587161672475001332883943001. (CXX) g++ options: -O3 -fopenmp -ldl
OpenBenchmarking.orgThroughput FoM, More Is BetterKripke 1.2.6EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50M100M150M200M250MMin: 178946700 / Avg: 181795966.67 / Max: 184002100Min: 267780700 / Avg: 268773266.67 / Max: 269955600Min: 255289300 / Avg: 258716166.67 / Max: 263264900Min: 246969500 / Avg: 247500133.33 / Max: 248195900Min: 286181200 / Avg: 288394300 / Max: 2922790001. (CXX) g++ options: -O3 -fopenmp -ldl

Xcompact3d Incompact3d

Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per DirectionEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C918273645SE +/- 0.06, N = 3SE +/- 0.16, N = 3SE +/- 0.22, N = 3SE +/- 0.02, N = 3SE +/- 0.18, N = 337.9923.9123.7724.3520.981. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per DirectionEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C816243240Min: 37.92 / Avg: 37.99 / Max: 38.1Min: 23.67 / Avg: 23.91 / Max: 24.21Min: 23.53 / Avg: 23.77 / Max: 24.21Min: 24.31 / Avg: 24.35 / Max: 24.38Min: 20.76 / Avg: 20.98 / Max: 21.341. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C2004006008001000SE +/- 15.13, N = 9SE +/- 0.69, N = 3SE +/- 0.57, N = 3SE +/- 0.29, N = 3SE +/- 0.84, N = 31092.51608.23612.20628.84563.351. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C2004006008001000Min: 1063.13 / Avg: 1092.51 / Max: 1206.89Min: 607.24 / Avg: 608.23 / Max: 609.56Min: 611.25 / Avg: 612.2 / Max: 613.21Min: 628.45 / Avg: 628.84 / Max: 629.4Min: 562.14 / Avg: 563.35 / Max: 564.971. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

NAMD

NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD 2.14ATPase Simulation - 327,506 AtomsEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C0.21890.43780.65670.87561.0945SE +/- 0.00038, N = 3SE +/- 0.00067, N = 3SE +/- 0.00161, N = 3SE +/- 0.00094, N = 3SE +/- 0.00128, N = 30.972820.677280.735580.827900.43200
OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD 2.14ATPase Simulation - 327,506 AtomsEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C246810Min: 0.97 / Avg: 0.97 / Max: 0.97Min: 0.68 / Avg: 0.68 / Max: 0.68Min: 0.73 / Avg: 0.74 / Max: 0.74Min: 0.83 / Avg: 0.83 / Max: 0.83Min: 0.43 / Avg: 0.43 / Max: 0.43

Quicksilver

Quicksilver is a proxy application that represents some elements of the Mercury workload by solving a simplified dynamic Monte Carlo particle transport problem. Quicksilver is developed by Lawrence Livermore National Laboratory (LLNL) and this test profile currently makes use of the OpenMP CPU threaded code path. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P1EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C5M10M15M20M25MSE +/- 105830.05, N = 3SE +/- 66583.28, N = 3SE +/- 106926.77, N = 3SE +/- 24037.01, N = 3SE +/- 18559.21, N = 313030000188800001895000018273333212333331. (CXX) g++ options: -fopenmp -O3 -march=native
OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P1EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4M8M12M16M20MMin: 12830000 / Avg: 13030000 / Max: 13190000Min: 18790000 / Avg: 18880000 / Max: 19010000Min: 18770000 / Avg: 18950000 / Max: 19140000Min: 18240000 / Avg: 18273333.33 / Max: 18320000Min: 21210000 / Avg: 21233333.33 / Max: 212700001. (CXX) g++ options: -fopenmp -O3 -march=native

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CTS2EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C3M6M9M12M15MSE +/- 54569.02, N = 3SE +/- 29627.31, N = 3SE +/- 43333.33, N = 3SE +/- 25166.11, N = 3SE +/- 23094.01, N = 311443333143133331437666714030000163000001. (CXX) g++ options: -fopenmp -O3 -march=native
OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CTS2EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C3M6M9M12M15MMin: 11370000 / Avg: 11443333.33 / Max: 11550000Min: 14270000 / Avg: 14313333.33 / Max: 14370000Min: 14300000 / Avg: 14376666.67 / Max: 14450000Min: 14000000 / Avg: 14030000 / Max: 14080000Min: 16260000 / Avg: 16300000 / Max: 163400001. (CXX) g++ options: -fopenmp -O3 -march=native

Y-Cruncher

Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 500MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C48121620SE +/- 0.140, N = 7SE +/- 0.003, N = 5SE +/- 0.010, N = 5SE +/- 0.006, N = 5SE +/- 0.005, N = 515.5155.7476.1926.6535.207
OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 500MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C48121620Min: 14.72 / Avg: 15.52 / Max: 15.78Min: 5.74 / Avg: 5.75 / Max: 5.76Min: 6.16 / Avg: 6.19 / Max: 6.22Min: 6.63 / Avg: 6.65 / Max: 6.66Min: 5.19 / Avg: 5.21 / Max: 5.22

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C816243240SE +/- 0.10, N = 3SE +/- 0.01, N = 4SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 433.9111.9312.8913.9710.44
OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C714212835Min: 33.79 / Avg: 33.91 / Max: 34.11Min: 11.9 / Avg: 11.93 / Max: 11.94Min: 12.85 / Avg: 12.89 / Max: 12.91Min: 13.95 / Avg: 13.97 / Max: 13.99Min: 10.43 / Avg: 10.44 / Max: 10.45

ACES DGEMM

This is a multi-threaded DGEMM benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C510152025SE +/- 0.031226, N = 3SE +/- 0.076181, N = 15SE +/- 0.135732, N = 3SE +/- 0.073791, N = 3SE +/- 0.111892, N = 53.88677611.64561611.43484911.51727221.1388191. (CC) gcc options: -O3 -march=native -fopenmp
OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C510152025Min: 3.84 / Avg: 3.89 / Max: 3.95Min: 11.05 / Avg: 11.65 / Max: 12.18Min: 11.16 / Avg: 11.43 / Max: 11.57Min: 11.44 / Avg: 11.52 / Max: 11.66Min: 20.98 / Avg: 21.14 / Max: 21.551. (CC) gcc options: -O3 -march=native -fopenmp

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: BMW27 - Compute: CPU-OnlyEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1632486480SE +/- 0.20, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 372.4347.5052.0258.2030.57
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: BMW27 - Compute: CPU-OnlyEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1428425670Min: 72.09 / Avg: 72.43 / Max: 72.78Min: 47.32 / Avg: 47.5 / Max: 47.75Min: 51.84 / Avg: 52.02 / Max: 52.32Min: 58.1 / Avg: 58.2 / Max: 58.31Min: 30.49 / Avg: 30.57 / Max: 30.63

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Classroom - Compute: CPU-OnlyEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3191.71119.58130.67146.9076.32
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Classroom - Compute: CPU-OnlyEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200Min: 191.67 / Avg: 191.71 / Max: 191.76Min: 119.44 / Avg: 119.58 / Max: 119.75Min: 130.47 / Avg: 130.67 / Max: 130.87Min: 146.74 / Avg: 146.9 / Max: 147.01Min: 76.23 / Avg: 76.32 / Max: 76.46

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Fishy Cat - Compute: CPU-OnlyEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3101.1059.6465.0372.9638.66
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Fishy Cat - Compute: CPU-OnlyEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100Min: 100.82 / Avg: 101.1 / Max: 101.25Min: 59.57 / Avg: 59.64 / Max: 59.72Min: 64.94 / Avg: 65.03 / Max: 65.15Min: 72.86 / Avg: 72.96 / Max: 73.08Min: 38.62 / Avg: 38.66 / Max: 38.72

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Pabellon Barcelona - Compute: CPU-OnlyEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50100150200250SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3246.71148.76161.95182.4795.44
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Pabellon Barcelona - Compute: CPU-OnlyEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200Min: 246.42 / Avg: 246.71 / Max: 247.05Min: 148.64 / Avg: 148.76 / Max: 148.94Min: 161.82 / Avg: 161.95 / Max: 162.14Min: 182.39 / Avg: 182.47 / Max: 182.56Min: 95.36 / Avg: 95.44 / Max: 95.49

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Barbershop - Compute: CPU-OnlyEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C160320480640800SE +/- 0.25, N = 3SE +/- 0.14, N = 3SE +/- 0.21, N = 3SE +/- 0.45, N = 3SE +/- 0.08, N = 3765.20426.62463.27518.21267.58
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Barbershop - Compute: CPU-OnlyEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C130260390520650Min: 764.69 / Avg: 765.2 / Max: 765.47Min: 426.4 / Avg: 426.62 / Max: 426.89Min: 462.88 / Avg: 463.27 / Max: 463.61Min: 517.42 / Avg: 518.21 / Max: 518.96Min: 267.46 / Avg: 267.58 / Max: 267.73

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 521.8445.5143.1339.6074.93MIN: 21.59 / MAX: 22.16MIN: 45.23 / MAX: 46.5MIN: 42.84 / MAX: 43.66MIN: 39.34 / MAX: 40.89MIN: 73.96 / MAX: 76.92
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1428425670Min: 21.72 / Avg: 21.84 / Max: 21.94Min: 45.49 / Avg: 45.51 / Max: 45.53Min: 43.07 / Avg: 43.13 / Max: 43.18Min: 39.54 / Avg: 39.6 / Max: 39.63Min: 74.6 / Avg: 74.93 / Max: 75.12

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1326395265SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.11, N = 318.4436.8934.2431.0859.05MIN: 18.15 / MAX: 18.78MIN: 36.22 / MAX: 37.68MIN: 33.72 / MAX: 35.12MIN: 30.63 / MAX: 31.81MIN: 57.98 / MAX: 61.17
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1224364860Min: 18.35 / Avg: 18.44 / Max: 18.49Min: 36.66 / Avg: 36.89 / Max: 37.09Min: 34.09 / Avg: 34.24 / Max: 34.34Min: 30.95 / Avg: 31.08 / Max: 31.17Min: 58.85 / Avg: 59.05 / Max: 59.21

Intel Open Image Denoise

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C0.38480.76961.15441.53921.924SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.481.111.030.931.71
OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C246810Min: 0.48 / Avg: 0.48 / Max: 0.48Min: 1.11 / Avg: 1.11 / Max: 1.11Min: 1.03 / Avg: 1.03 / Max: 1.03Min: 0.93 / Avg: 0.93 / Max: 0.93Min: 1.7 / Avg: 1.71 / Max: 1.71

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C2K4K6K8K10KSE +/- 15.18, N = 3SE +/- 2.31, N = 3SE +/- 1.76, N = 3SE +/- 0.88, N = 3SE +/- 1.20, N = 384523493378742222146
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C15003000450060007500Min: 8422 / Avg: 8452 / Max: 8471Min: 3489 / Avg: 3493 / Max: 3497Min: 3784 / Avg: 3787.33 / Max: 3790Min: 4220 / Avg: 4221.67 / Max: 4223Min: 2144 / Avg: 2146.33 / Max: 2148

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C30K60K90K120K150KSE +/- 111.55, N = 3SE +/- 328.77, N = 3SE +/- 266.18, N = 3SE +/- 220.99, N = 3SE +/- 242.81, N = 314556062633671537402340603
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C30K60K90K120K150KMin: 145337 / Avg: 145559.67 / Max: 145683Min: 62222 / Avg: 62633 / Max: 63283Min: 66864 / Avg: 67153.33 / Max: 67685Min: 73686 / Avg: 74022.67 / Max: 74439Min: 40121 / Avg: 40602.67 / Max: 40897

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C60K120K180K240K300KSE +/- 491.07, N = 3SE +/- 153.74, N = 3SE +/- 87.82, N = 3SE +/- 49.00, N = 3SE +/- 78.83, N = 328113711851412815414216074752
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50K100K150K200K250KMin: 280188 / Avg: 281137.33 / Max: 281830Min: 118260 / Avg: 118513.67 / Max: 118791Min: 128057 / Avg: 128153.67 / Max: 128329Min: 142089 / Avg: 142160 / Max: 142254Min: 74598 / Avg: 74751.67 / Max: 74859

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C2K4K6K8K10KSE +/- 27.62, N = 3SE +/- 1.33, N = 3SE +/- 2.31, N = 3SE +/- 2.03, N = 3SE +/- 0.88, N = 3100544152449350042544
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C2K4K6K8K10KMin: 9999 / Avg: 10054 / Max: 10086Min: 4149 / Avg: 4151.67 / Max: 4153Min: 4489 / Avg: 4493 / Max: 4497Min: 5000 / Avg: 5003.67 / Max: 5007Min: 2543 / Avg: 2544.33 / Max: 2546

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C40K80K120K160K200KSE +/- 111.00, N = 3SE +/- 65.51, N = 3SE +/- 239.39, N = 3SE +/- 286.09, N = 3SE +/- 85.58, N = 317087173127786108667847472
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C30K60K90K120K150KMin: 170649 / Avg: 170870.67 / Max: 170992Min: 72996 / Avg: 73127 / Max: 73194Min: 78183 / Avg: 78610.33 / Max: 79011Min: 86159 / Avg: 86678.33 / Max: 87146Min: 47303 / Avg: 47472 / Max: 47580

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C70K140K210K280K350KSE +/- 408.43, N = 3SE +/- 125.49, N = 3SE +/- 149.58, N = 3SE +/- 85.59, N = 3SE +/- 229.98, N = 333194513973715041016720987860
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C60K120K180K240K300KMin: 331350 / Avg: 331944.67 / Max: 332727Min: 139601 / Avg: 139737.33 / Max: 139988Min: 150120 / Avg: 150410.33 / Max: 150618Min: 167045 / Avg: 167209.33 / Max: 167333Min: 87539 / Avg: 87860.33 / Max: 88306

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C48121620SE +/- 0.00308, N = 3SE +/- 0.02105, N = 3SE +/- 0.02664, N = 3SE +/- 0.02953, N = 3SE +/- 0.01491, N = 32.599619.142578.788987.9791015.05960
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C48121620Min: 2.6 / Avg: 2.6 / Max: 2.61Min: 9.12 / Avg: 9.14 / Max: 9.18Min: 8.76 / Avg: 8.79 / Max: 8.84Min: 7.92 / Avg: 7.98 / Max: 8.01Min: 15.03 / Avg: 15.06 / Max: 15.08

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C48121620SE +/- 0.01198, N = 3SE +/- 0.01463, N = 3SE +/- 0.02613, N = 3SE +/- 0.01310, N = 3SE +/- 0.00073, N = 32.452768.836228.456347.6653214.61310
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C48121620Min: 2.44 / Avg: 2.45 / Max: 2.48Min: 8.82 / Avg: 8.84 / Max: 8.87Min: 8.41 / Avg: 8.46 / Max: 8.5Min: 7.64 / Avg: 7.67 / Max: 7.69Min: 14.61 / Avg: 14.61 / Max: 14.61

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C48121620SE +/- 0.00520, N = 3SE +/- 0.00075, N = 3SE +/- 0.00699, N = 3SE +/- 0.00484, N = 3SE +/- 0.00619, N = 34.1465510.493909.873738.8936116.89540
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C48121620Min: 4.14 / Avg: 4.15 / Max: 4.16Min: 10.49 / Avg: 10.49 / Max: 10.49Min: 9.86 / Avg: 9.87 / Max: 9.89Min: 8.88 / Avg: 8.89 / Max: 8.9Min: 16.89 / Avg: 16.9 / Max: 16.91

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C48121620SE +/- 0.00450, N = 3SE +/- 0.00420, N = 3SE +/- 0.02372, N = 3SE +/- 0.01797, N = 3SE +/- 0.02133, N = 35.285768.797738.757848.1323114.90860
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C48121620Min: 5.28 / Avg: 5.29 / Max: 5.29Min: 8.79 / Avg: 8.8 / Max: 8.8Min: 8.71 / Avg: 8.76 / Max: 8.79Min: 8.1 / Avg: 8.13 / Max: 8.15Min: 14.87 / Avg: 14.91 / Max: 14.94

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/scivis/real_timeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C48121620SE +/- 0.00416, N = 3SE +/- 0.00419, N = 3SE +/- 0.01425, N = 3SE +/- 0.00550, N = 3SE +/- 0.01627, N = 35.229278.770438.758968.1435814.85490
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/scivis/real_timeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C48121620Min: 5.22 / Avg: 5.23 / Max: 5.24Min: 8.76 / Avg: 8.77 / Max: 8.78Min: 8.73 / Avg: 8.76 / Max: 8.78Min: 8.13 / Avg: 8.14 / Max: 8.15Min: 14.82 / Avg: 14.85 / Max: 14.87

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_timeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 398.90147.25147.28147.22164.21
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_timeEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C306090120150Min: 98.79 / Avg: 98.9 / Max: 99Min: 147.12 / Avg: 147.25 / Max: 147.35Min: 147.13 / Avg: 147.28 / Max: 147.45Min: 147.19 / Avg: 147.22 / Max: 147.24Min: 164.04 / Avg: 164.2 / Max: 164.32

Chaos Group V-RAY

This is a test of Chaos Group's V-RAY benchmark. V-RAY is a commercial renderer that can integrate with various creator software products like SketchUp and 3ds Max. The V-RAY benchmark is standalone and supports CPU and NVIDIA CUDA/RTX based rendering. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 5.02Mode: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C12K24K36K48K60KSE +/- 105.66, N = 3SE +/- 277.30, N = 3SE +/- 150.82, N = 3SE +/- 326.21, N = 3SE +/- 123.39, N = 31991433510315362817754204
OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 5.02Mode: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C9K18K27K36K45KMin: 19705 / Avg: 19914.33 / Max: 20044Min: 33182 / Avg: 33509.67 / Max: 34061Min: 31269 / Avg: 31536.33 / Max: 31791Min: 27534 / Avg: 28177.33 / Max: 28593Min: 53985 / Avg: 54204 / Max: 54412

IndigoBench

This is a test of Indigo Renderer's IndigoBench benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: SupercarEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C510152025SE +/- 0.024, N = 3SE +/- 0.058, N = 3SE +/- 0.005, N = 3SE +/- 0.010, N = 3SE +/- 0.020, N = 38.58613.57312.57211.24921.767
OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: SupercarEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C510152025Min: 8.55 / Avg: 8.59 / Max: 8.63Min: 13.46 / Avg: 13.57 / Max: 13.64Min: 12.56 / Avg: 12.57 / Max: 12.58Min: 11.23 / Avg: 11.25 / Max: 11.27Min: 21.74 / Avg: 21.77 / Max: 21.81

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: BedroomEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C3691215SE +/- 0.010, N = 3SE +/- 0.021, N = 3SE +/- 0.013, N = 3SE +/- 0.010, N = 3SE +/- 0.011, N = 33.9856.1775.7205.1279.973
OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: BedroomEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C3691215Min: 3.97 / Avg: 3.99 / Max: 4Min: 6.15 / Avg: 6.18 / Max: 6.22Min: 5.69 / Avg: 5.72 / Max: 5.73Min: 5.11 / Avg: 5.13 / Max: 5.14Min: 9.96 / Avg: 9.97 / Max: 10

FFmpeg

This is a benchmark of the FFmpeg multimedia framework. The FFmpeg test profile is making use of a modified version of vbench from Columbia University's Architecture and Design Lab (ARCADE) [http://arcade.cs.columbia.edu/vbench/] that is a benchmark for video-as-a-service workloads. The test profile offers the options of a range of vbench scenarios based on freely distributable video content and offers the options of using the x264 or x265 video encoders for transcoding. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: LiveEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C306090120150SE +/- 0.11, N = 3SE +/- 0.30, N = 3SE +/- 0.31, N = 3SE +/- 0.17, N = 3SE +/- 0.20, N = 358.09109.84109.71109.77115.111. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: LiveEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100Min: 57.88 / Avg: 58.09 / Max: 58.24Min: 109.33 / Avg: 109.84 / Max: 110.36Min: 109.16 / Avg: 109.71 / Max: 110.24Min: 109.58 / Avg: 109.77 / Max: 110.11Min: 114.71 / Avg: 115.11 / Max: 115.321. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: UploadEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C612182430SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 310.4022.2422.2522.2423.311. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: UploadEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C510152025Min: 10.39 / Avg: 10.4 / Max: 10.42Min: 22.2 / Avg: 22.24 / Max: 22.29Min: 22.22 / Avg: 22.25 / Max: 22.28Min: 22.22 / Avg: 22.24 / Max: 22.28Min: 23.25 / Avg: 23.31 / Max: 23.361. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: PlatformEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1122334455SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 321.0245.0145.1245.0347.031. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: PlatformEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1020304050Min: 21 / Avg: 21.02 / Max: 21.04Min: 44.95 / Avg: 45.01 / Max: 45.07Min: 45.05 / Avg: 45.12 / Max: 45.15Min: 45.01 / Avg: 45.03 / Max: 45.05Min: 46.96 / Avg: 47.03 / Max: 47.11. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Video On DemandEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1122334455SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 321.0045.0745.0644.9947.081. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Video On DemandEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1020304050Min: 20.95 / Avg: 21 / Max: 21.03Min: 45.03 / Avg: 45.07 / Max: 45.09Min: 45.02 / Avg: 45.06 / Max: 45.13Min: 44.94 / Avg: 44.99 / Max: 45.09Min: 47.04 / Avg: 47.08 / Max: 47.121. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4KEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200SE +/- 0.47, N = 3SE +/- 1.24, N = 13SE +/- 1.73, N = 6SE +/- 1.17, N = 5SE +/- 2.10, N = 570.77182.26175.75167.16190.891. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4KEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200Min: 69.85 / Avg: 70.77 / Max: 71.37Min: 173.72 / Avg: 182.26 / Max: 186.83Min: 170.2 / Avg: 175.75 / Max: 179.68Min: 163.36 / Avg: 167.16 / Max: 170.17Min: 182.83 / Avg: 190.89 / Max: 194.551. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1428425670SE +/- 0.28, N = 5SE +/- 0.13, N = 4SE +/- 0.14, N = 4SE +/- 0.05, N = 4SE +/- 0.39, N = 426.7558.0055.7251.5464.341. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1326395265Min: 26 / Avg: 26.75 / Max: 27.68Min: 57.76 / Avg: 58 / Max: 58.3Min: 55.48 / Avg: 55.72 / Max: 56.07Min: 51.4 / Avg: 51.54 / Max: 51.65Min: 63.33 / Avg: 64.34 / Max: 65.241. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C246810SE +/- 0.004, N = 3SE +/- 0.020, N = 3SE +/- 0.004, N = 3SE +/- 0.003, N = 3SE +/- 0.026, N = 33.0655.9115.8165.5516.5561. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C3691215Min: 3.06 / Avg: 3.06 / Max: 3.07Min: 5.87 / Avg: 5.91 / Max: 5.93Min: 5.81 / Avg: 5.82 / Max: 5.82Min: 5.55 / Avg: 5.55 / Max: 5.56Min: 6.52 / Avg: 6.56 / Max: 6.61. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

rav1e

Xiph rav1e is a Rust-written AV1 video encoder that claims to be the fastest and safest AV1 encoder. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.7Speed: 10EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C3691215SE +/- 0.075, N = 4SE +/- 0.141, N = 4SE +/- 0.138, N = 4SE +/- 0.146, N = 4SE +/- 0.125, N = 56.99511.79011.81811.82412.186
OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.7Speed: 10EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C48121620Min: 6.8 / Avg: 6.99 / Max: 7.16Min: 11.37 / Avg: 11.79 / Max: 11.96Min: 11.41 / Avg: 11.82 / Max: 12Min: 11.39 / Avg: 11.82 / Max: 12.01Min: 11.69 / Avg: 12.19 / Max: 12.35

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.7Speed: 6EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1.09532.19063.28594.38125.4765SE +/- 0.020, N = 3SE +/- 0.003, N = 3SE +/- 0.014, N = 3SE +/- 0.017, N = 3SE +/- 0.006, N = 32.9634.7064.7314.7274.868
OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.7Speed: 6EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C246810Min: 2.94 / Avg: 2.96 / Max: 3Min: 4.7 / Avg: 4.71 / Max: 4.71Min: 4.71 / Avg: 4.73 / Max: 4.75Min: 4.7 / Avg: 4.73 / Max: 4.76Min: 4.86 / Avg: 4.87 / Max: 4.88

x265

This is a simple test of the x265 encoder run on the CPU with 1080p and 4K options for H.265 video encode performance with x265. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.4Video Input: Bosphorus 4KEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C612182430SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 314.2925.5525.4524.0327.511. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.4Video Input: Bosphorus 4KEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C612182430Min: 14.1 / Avg: 14.29 / Max: 14.46Min: 25.48 / Avg: 25.55 / Max: 25.62Min: 25.39 / Avg: 25.45 / Max: 25.53Min: 23.97 / Avg: 24.03 / Max: 24.13Min: 27.18 / Avg: 27.51 / Max: 27.681. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1122334455SE +/- 0.08, N = 3SE +/- 0.02, N = 4SE +/- 0.02, N = 4SE +/- 0.03, N = 3SE +/- 0.04, N = 422.2639.2537.3333.8247.65
OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1020304050Min: 22.13 / Avg: 22.26 / Max: 22.4Min: 39.22 / Avg: 39.25 / Max: 39.31Min: 37.28 / Avg: 37.33 / Max: 37.36Min: 33.78 / Avg: 33.82 / Max: 33.87Min: 47.56 / Avg: 47.65 / Max: 47.73

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super FastEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1122334455SE +/- 0.02, N = 3SE +/- 0.03, N = 4SE +/- 0.08, N = 4SE +/- 0.03, N = 4SE +/- 0.06, N = 423.5842.9440.5036.7549.22
OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super FastEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1020304050Min: 23.55 / Avg: 23.58 / Max: 23.62Min: 42.88 / Avg: 42.94 / Max: 43Min: 40.36 / Avg: 40.5 / Max: 40.73Min: 36.66 / Avg: 36.75 / Max: 36.81Min: 49.07 / Avg: 49.22 / Max: 49.33

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra FastEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1224364860SE +/- 0.03, N = 3SE +/- 0.05, N = 4SE +/- 0.06, N = 4SE +/- 0.04, N = 4SE +/- 0.14, N = 427.2946.5444.8141.0251.33
OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra FastEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1020304050Min: 27.24 / Avg: 27.29 / Max: 27.34Min: 46.42 / Avg: 46.54 / Max: 46.64Min: 44.64 / Avg: 44.81 / Max: 44.88Min: 40.93 / Avg: 41.02 / Max: 41.09Min: 51.07 / Avg: 51.33 / Max: 51.7

VVenC

VVenC is the Fraunhofer Versatile Video Encoder as a fast/efficient H.266/VVC encoder. The vvenc encoder makes use of SIMD Everywhere (SIMDe). The vvenc software is published under the Clear BSD License. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: FasterEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C3691215SE +/- 0.044, N = 3SE +/- 0.010, N = 3SE +/- 0.030, N = 3SE +/- 0.030, N = 3SE +/- 0.012, N = 36.35810.74110.63510.29111.2721. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: FasterEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C3691215Min: 6.27 / Avg: 6.36 / Max: 6.41Min: 10.72 / Avg: 10.74 / Max: 10.76Min: 10.59 / Avg: 10.63 / Max: 10.69Min: 10.25 / Avg: 10.29 / Max: 10.35Min: 11.25 / Avg: 11.27 / Max: 11.291. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Llama.cpp

Llama.cpp is a port of Facebook's LLaMA model in C/C++ developed by Georgi Gerganov. Llama.cpp allows the inference of LLaMA and other supported models in C/C++. For CPU inference Llama.cpp supports AVX2/AVX-512, ARM NEON, and other modern ISAs along with features like OpenBLAS usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-7b.Q4_0.ggufEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4C714212835SE +/- 0.12, N = 15SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 34.2029.7229.3828.561. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas
OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-7b.Q4_0.ggufEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4C714212835Min: 3.83 / Avg: 4.2 / Max: 5.57Min: 29.62 / Avg: 29.72 / Max: 29.84Min: 29.32 / Avg: 29.38 / Max: 29.46Min: 28.46 / Avg: 28.56 / Max: 28.621. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4C48121620SE +/- 0.03, N = 12SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 32.4917.9317.0917.061. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas
OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4C510152025Min: 2.35 / Avg: 2.49 / Max: 2.64Min: 17.9 / Avg: 17.93 / Max: 17.97Min: 17.04 / Avg: 17.09 / Max: 17.18Min: 16.96 / Avg: 17.06 / Max: 17.111. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4C0.77181.54362.31543.08723.859SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 30.463.432.933.111. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas
OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4C246810Min: 0.46 / Avg: 0.46 / Max: 0.46Min: 3.42 / Avg: 3.43 / Max: 3.43Min: 2.93 / Avg: 2.93 / Max: 2.94Min: 3.1 / Avg: 3.11 / Max: 3.131. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1122334455SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 33.8131.2528.5825.4149.431. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1020304050Min: 3.81 / Avg: 3.81 / Max: 3.81Min: 31.21 / Avg: 31.25 / Max: 31.3Min: 28.49 / Avg: 28.58 / Max: 28.64Min: 25.4 / Avg: 25.41 / Max: 25.43Min: 49.35 / Avg: 49.43 / Max: 49.481. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C400800120016002000SE +/- 0.15, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 32096.01510.71558.29627.46644.80MIN: 2092.33 / MAX: 2113.24MIN: 471.88 / MAX: 558.37MIN: 500.71 / MAX: 574MIN: 560 / MAX: 672.37MIN: 320.58 / MAX: 691.031. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C400800120016002000Min: 2095.86 / Avg: 2096.01 / Max: 2096.3Min: 510.62 / Avg: 510.71 / Max: 510.83Min: 558.17 / Avg: 558.29 / Max: 558.37Min: 627.37 / Avg: 627.46 / Max: 627.62Min: 644.63 / Avg: 644.8 / Max: 645.021. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C15K30K45K60K75KSE +/- 8.89, N = 3SE +/- 23.70, N = 3SE +/- 37.85, N = 3SE +/- 33.66, N = 3SE +/- 93.27, N = 313039.7052709.1949194.5543375.5571960.411. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C12K24K36K48K60KMin: 13026.48 / Avg: 13039.7 / Max: 13056.61Min: 52672.68 / Avg: 52709.19 / Max: 52753.63Min: 49138.01 / Avg: 49194.55 / Max: 49266.42Min: 43330.47 / Avg: 43375.55 / Max: 43441.39Min: 71798.85 / Avg: 71960.41 / Max: 72121.951. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C0.5491.0981.6472.1962.745SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 32.440.470.510.570.61MIN: 2.39 / MAX: 9.34MIN: 0.27 / MAX: 11.17MIN: 0.28 / MAX: 50.42MIN: 0.29 / MAX: 15.45MIN: 0.27 / MAX: 24.311. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C246810Min: 2.43 / Avg: 2.44 / Max: 2.44Min: 0.47 / Avg: 0.47 / Max: 0.47Min: 0.51 / Avg: 0.51 / Max: 0.51Min: 0.57 / Avg: 0.57 / Max: 0.57Min: 0.6 / Avg: 0.61 / Max: 0.611. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200SE +/- 0.18, N = 3SE +/- 0.51, N = 3SE +/- 0.22, N = 3SE +/- 0.65, N = 3SE +/- 0.77, N = 342.43150.74144.27131.24202.291. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200Min: 42.07 / Avg: 42.43 / Max: 42.63Min: 149.72 / Avg: 150.74 / Max: 151.33Min: 143.83 / Avg: 144.27 / Max: 144.54Min: 130.26 / Avg: 131.24 / Max: 132.47Min: 201.43 / Avg: 202.29 / Max: 203.821. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200SE +/- 0.84, N = 3SE +/- 0.35, N = 3SE +/- 0.19, N = 3SE +/- 0.62, N = 3SE +/- 0.61, N = 3188.25106.00110.77121.74157.93MIN: 171.32 / MAX: 233.13MIN: 49.62 / MAX: 149.63MIN: 56.47 / MAX: 138.98MIN: 59.66 / MAX: 172.6MIN: 61.12 / MAX: 229.821. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C306090120150Min: 187.3 / Avg: 188.25 / Max: 189.92Min: 105.56 / Avg: 106 / Max: 106.69Min: 110.53 / Avg: 110.77 / Max: 111.14Min: 120.58 / Avg: 121.74 / Max: 122.69Min: 156.72 / Avg: 157.93 / Max: 158.61. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C10002000300040005000SE +/- 0.03, N = 3SE +/- 0.48, N = 3SE +/- 0.72, N = 3SE +/- 0.51, N = 3SE +/- 1.98, N = 3376.973102.132851.012520.774878.001. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C8001600240032004000Min: 376.91 / Avg: 376.97 / Max: 377.02Min: 3101.55 / Avg: 3102.13 / Max: 3103.09Min: 2850.25 / Avg: 2851.01 / Max: 2852.45Min: 2519.78 / Avg: 2520.77 / Max: 2521.49Min: 4874.18 / Avg: 4878 / Max: 4880.811. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 384.7710.2011.1212.5812.97MIN: 76.49 / MAX: 98.5MIN: 5.92 / MAX: 71.44MIN: 6.69 / MAX: 66.41MIN: 6.18 / MAX: 27.891. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1632486480Min: 84.75 / Avg: 84.77 / Max: 84.78Min: 10.2 / Avg: 10.2 / Max: 10.21Min: 11.11 / Avg: 11.12 / Max: 11.12Min: 12.58 / Avg: 12.58 / Max: 12.58Min: 12.96 / Avg: 12.97 / Max: 12.981. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C6001200180024003000SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 0.65, N = 3SE +/- 1.22, N = 3SE +/- 0.56, N = 3296.421860.651710.421527.322816.091. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C5001000150020002500Min: 296.22 / Avg: 296.42 / Max: 296.53Min: 1860.31 / Avg: 1860.65 / Max: 1861.03Min: 1709.35 / Avg: 1710.42 / Max: 1711.58Min: 1525.11 / Avg: 1527.32 / Max: 1529.34Min: 2814.99 / Avg: 2816.09 / Max: 2816.781. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C612182430SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 326.968.529.2910.3911.24MIN: 26.82 / MAX: 36.46MIN: 4.86 / MAX: 58.62MIN: 5.21 / MAX: 64.17MIN: 6.01 / MAX: 19.76MIN: 6.13 / MAX: 91.041. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C612182430Min: 26.95 / Avg: 26.96 / Max: 26.97Min: 8.52 / Avg: 8.52 / Max: 8.53Min: 9.28 / Avg: 9.29 / Max: 9.29Min: 10.38 / Avg: 10.39 / Max: 10.41Min: 11.24 / Avg: 11.24 / Max: 11.251. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C5001000150020002500SE +/- 1.37, N = 3SE +/- 1.86, N = 3SE +/- 1.13, N = 3SE +/- 1.32, N = 3SE +/- 2.30, N = 3464.481701.181563.361424.532547.731. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C400800120016002000Min: 461.92 / Avg: 464.48 / Max: 466.61Min: 1697.5 / Avg: 1701.18 / Max: 1703.47Min: 1561.7 / Avg: 1563.36 / Max: 1565.52Min: 1422.14 / Avg: 1424.53 / Max: 1426.7Min: 2543.12 / Avg: 2547.73 / Max: 2550.111. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C48121620SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 317.209.3410.1811.1512.47MIN: 16.21 / MAX: 31.68MIN: 5.89 / MAX: 67.06MIN: 6.06 / MAX: 60MIN: 7.24 / MAX: 68.4MIN: 7.72 / MAX: 24.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C48121620Min: 17.12 / Avg: 17.2 / Max: 17.3Min: 9.33 / Avg: 9.34 / Max: 9.36Min: 10.16 / Avg: 10.18 / Max: 10.19Min: 11.13 / Avg: 11.15 / Max: 11.18Min: 12.46 / Avg: 12.47 / Max: 12.51. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C60120180240300SE +/- 0.16, N = 3SE +/- 0.19, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.54, N = 338.63194.71180.32163.09295.611. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50100150200250Min: 38.39 / Avg: 38.63 / Max: 38.93Min: 194.35 / Avg: 194.71 / Max: 194.99Min: 180.25 / Avg: 180.32 / Max: 180.38Min: 162.99 / Avg: 163.09 / Max: 163.16Min: 294.67 / Avg: 295.61 / Max: 296.541. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50100150200250SE +/- 0.83, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.19, N = 3206.7282.0088.5597.91108.06MIN: 173.41 / MAX: 362.84MIN: 44.77 / MAX: 103.78MIN: 48.33 / MAX: 138.85MIN: 52.76 / MAX: 116.94MIN: 53.32 / MAX: 156.541. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200Min: 205.18 / Avg: 206.72 / Max: 208.03Min: 81.89 / Avg: 82 / Max: 82.14Min: 88.53 / Avg: 88.55 / Max: 88.59Min: 97.85 / Avg: 97.91 / Max: 97.98Min: 107.74 / Avg: 108.06 / Max: 108.391. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C2K4K6K8K10KSE +/- 0.47, N = 3SE +/- 1.73, N = 3SE +/- 1.37, N = 3SE +/- 1.85, N = 3SE +/- 9.00, N = 3878.715418.924977.134405.628310.711. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C14002800420056007000Min: 877.9 / Avg: 878.71 / Max: 879.52Min: 5416.21 / Avg: 5418.92 / Max: 5422.13Min: 4974.74 / Avg: 4977.13 / Max: 4979.47Min: 4402.42 / Avg: 4405.62 / Max: 4408.82Min: 8299.24 / Avg: 8310.71 / Max: 8328.471. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C3691215SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 39.095.776.307.137.52MIN: 9.03 / MAX: 17.52MIN: 3.23 / MAX: 59.13MIN: 3.34 / MAX: 35.73MIN: 3.71 / MAX: 59.81MIN: 3.38 / MAX: 63.311. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C3691215Min: 9.08 / Avg: 9.09 / Max: 9.1Min: 5.77 / Avg: 5.77 / Max: 5.77Min: 6.3 / Avg: 6.3 / Max: 6.3Min: 7.12 / Avg: 7.13 / Max: 7.13Min: 7.51 / Avg: 7.52 / Max: 7.521. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C2004006008001000SE +/- 0.74, N = 3SE +/- 0.64, N = 3SE +/- 5.36, N = 8SE +/- 0.39, N = 3SE +/- 0.42, N = 3188.86688.60621.82555.711086.681. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C2004006008001000Min: 187.45 / Avg: 188.86 / Max: 189.98Min: 687.92 / Avg: 688.6 / Max: 689.88Min: 584.47 / Avg: 621.82 / Max: 629.04Min: 555.19 / Avg: 555.71 / Max: 556.48Min: 1086.14 / Avg: 1086.68 / Max: 1087.511. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200SE +/- 0.68, N = 3SE +/- 0.04, N = 3SE +/- 0.47, N = 8SE +/- 0.04, N = 3SE +/- 0.02, N = 3169.2146.3951.4157.5058.78MIN: 140.86 / MAX: 197.95MIN: 30.48 / MAX: 56.26MIN: 31.75 / MAX: 122.86MIN: 36.68 / MAX: 102.88MIN: 36.54 / MAX: 118.541. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C306090120150Min: 168.18 / Avg: 169.21 / Max: 170.48Min: 46.31 / Avg: 46.39 / Max: 46.44Min: 50.79 / Avg: 51.41 / Max: 54.67Min: 57.42 / Avg: 57.5 / Max: 57.54Min: 58.74 / Avg: 58.78 / Max: 58.811. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C2004006008001000SE +/- 0.05, N = 3SE +/- 0.09, N = 3SE +/- 0.14, N = 3SE +/- 0.24, N = 3SE +/- 3.62, N = 3149.01633.21579.34520.24934.591. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C160320480640800Min: 148.92 / Avg: 149.01 / Max: 149.08Min: 633.06 / Avg: 633.21 / Max: 633.38Min: 579.16 / Avg: 579.34 / Max: 579.62Min: 519.85 / Avg: 520.24 / Max: 520.69Min: 928.03 / Avg: 934.59 / Max: 940.531. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1224364860SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.13, N = 353.6425.2127.5630.6934.14MIN: 52.65 / MAX: 65.91MIN: 14.47 / MAX: 81.04MIN: 15.77 / MAX: 72.29MIN: 17.73 / MAX: 77.96MIN: 18.62 / MAX: 101.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1122334455Min: 53.62 / Avg: 53.64 / Max: 53.67Min: 25.2 / Avg: 25.21 / Max: 25.21Min: 27.54 / Avg: 27.56 / Max: 27.57Min: 30.67 / Avg: 30.69 / Max: 30.71Min: 33.93 / Avg: 34.14 / Max: 34.381. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C30060090012001500SE +/- 2.58, N = 3SE +/- 1.14, N = 3SE +/- 0.55, N = 3SE +/- 0.29, N = 3SE +/- 0.39, N = 3246.64818.31752.59674.931287.88
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C2004006008001000Min: 241.52 / Avg: 246.64 / Max: 249.75Min: 816.94 / Avg: 818.31 / Max: 820.57Min: 751.49 / Avg: 752.59 / Max: 753.19Min: 674.36 / Avg: 674.93 / Max: 675.26Min: 1287.36 / Avg: 1287.88 / Max: 1288.64

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1428425670SE +/- 0.70, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 364.8019.5321.2423.6924.82
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1326395265Min: 63.97 / Avg: 64.8 / Max: 66.18Min: 19.48 / Avg: 19.53 / Max: 19.57Min: 21.22 / Avg: 21.24 / Max: 21.27Min: 23.67 / Avg: 23.69 / Max: 23.71Min: 24.81 / Avg: 24.82 / Max: 24.83

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C60120180240300SE +/- 0.71, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 384.43181.23169.56152.21281.49
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50100150200250Min: 83 / Avg: 84.43 / Max: 85.21Min: 181.11 / Avg: 181.23 / Max: 181.44Min: 169.37 / Avg: 169.56 / Max: 169.77Min: 152.06 / Avg: 152.21 / Max: 152.44Min: 281.36 / Avg: 281.49 / Max: 281.63

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200SE +/- 1.56, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3189.3288.1594.20104.90113.45
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C306090120150Min: 187.63 / Avg: 189.32 / Max: 192.44Min: 88.1 / Avg: 88.15 / Max: 88.19Min: 94.13 / Avg: 94.2 / Max: 94.24Min: 104.83 / Avg: 104.9 / Max: 104.96Min: 113.43 / Avg: 113.45 / Max: 113.47

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C90180270360450SE +/- 0.41, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3138.03266.96254.30229.54429.33
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C80160240320400Min: 137.38 / Avg: 138.03 / Max: 138.79Min: 266.76 / Avg: 266.96 / Max: 267.1Min: 254.19 / Avg: 254.3 / Max: 254.45Min: 229.48 / Avg: 229.54 / Max: 229.58Min: 429.25 / Avg: 429.33 / Max: 429.4

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C306090120150SE +/- 0.35, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3115.7859.8762.8269.6074.43
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100Min: 115.14 / Avg: 115.78 / Max: 116.32Min: 59.83 / Avg: 59.87 / Max: 59.91Min: 62.8 / Avg: 62.82 / Max: 62.84Min: 69.58 / Avg: 69.6 / Max: 69.63Min: 74.39 / Avg: 74.43 / Max: 74.46

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C714212835SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 310.4521.0219.6417.7632.16
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C714212835Min: 10.32 / Avg: 10.45 / Max: 10.58Min: 20.91 / Avg: 21.02 / Max: 21.15Min: 19.55 / Avg: 19.64 / Max: 19.72Min: 17.74 / Avg: 17.76 / Max: 17.78Min: 32.09 / Avg: 32.16 / Max: 32.21

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C30060090012001500SE +/- 7.41, N = 3SE +/- 1.08, N = 3SE +/- 1.07, N = 3SE +/- 0.38, N = 3SE +/- 0.18, N = 31501.61751.62803.82892.10982.61
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C30060090012001500Min: 1492.17 / Avg: 1501.61 / Max: 1516.21Min: 749.73 / Avg: 751.62 / Max: 753.47Min: 802.09 / Avg: 803.82 / Max: 805.78Min: 891.49 / Avg: 892.1 / Max: 892.79Min: 982.25 / Avg: 982.61 / Max: 982.8

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200SE +/- 0.28, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.20, N = 368.16122.37114.62103.44191.07
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200Min: 67.78 / Avg: 68.16 / Max: 68.71Min: 122.17 / Avg: 122.37 / Max: 122.55Min: 114.43 / Avg: 114.62 / Max: 114.73Min: 103.38 / Avg: 103.44 / Max: 103.5Min: 190.68 / Avg: 191.07 / Max: 191.3

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50100150200250SE +/- 0.88, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.14, N = 3234.02130.42139.18154.28166.95
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200Min: 232.27 / Avg: 234.02 / Max: 235.04Min: 130.32 / Avg: 130.42 / Max: 130.58Min: 139.07 / Avg: 139.18 / Max: 139.3Min: 154.17 / Avg: 154.28 / Max: 154.42Min: 166.79 / Avg: 166.95 / Max: 167.22

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200SE +/- 0.44, N = 3SE +/- 0.18, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 368.95122.93115.42104.13192.06
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200Min: 68.09 / Avg: 68.95 / Max: 69.48Min: 122.62 / Avg: 122.93 / Max: 123.24Min: 115.32 / Avg: 115.42 / Max: 115.55Min: 104.07 / Avg: 104.13 / Max: 104.18Min: 191.84 / Avg: 192.06 / Max: 192.2

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C50100150200250SE +/- 1.50, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3231.40129.84138.23153.40166.03
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200Min: 229.4 / Avg: 231.4 / Max: 234.34Min: 129.56 / Avg: 129.84 / Max: 130.04Min: 138.15 / Avg: 138.23 / Max: 138.29Min: 153.25 / Avg: 153.4 / Max: 153.56Min: 165.9 / Avg: 166.03 / Max: 166.16

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C714212835SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 310.3421.0019.7517.6732.15
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C714212835Min: 10.3 / Avg: 10.34 / Max: 10.36Min: 20.92 / Avg: 21 / Max: 21.06Min: 19.72 / Avg: 19.75 / Max: 19.79Min: 17.62 / Avg: 17.67 / Max: 17.71Min: 32.12 / Avg: 32.15 / Max: 32.2

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C30060090012001500SE +/- 0.89, N = 3SE +/- 1.23, N = 3SE +/- 0.47, N = 3SE +/- 0.79, N = 3SE +/- 0.09, N = 31515.68752.51801.19894.20982.33
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C30060090012001500Min: 1514.17 / Avg: 1515.68 / Max: 1517.26Min: 751.17 / Avg: 752.51 / Max: 754.98Min: 800.3 / Avg: 801.19 / Max: 801.9Min: 892.76 / Avg: 894.2 / Max: 895.47Min: 982.2 / Avg: 982.33 / Max: 982.5

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1326395265SE +/- 0.0850, N = 3SE +/- 0.0215, N = 3SE +/- 0.0667, N = 3SE +/- 0.0604, N = 3SE +/- 0.1049, N = 38.509738.820235.792932.128956.8419
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1122334455Min: 8.34 / Avg: 8.51 / Max: 8.61Min: 38.78 / Avg: 38.82 / Max: 38.85Min: 35.7 / Avg: 35.79 / Max: 35.92Min: 32.03 / Avg: 32.13 / Max: 32.23Min: 56.65 / Avg: 56.84 / Max: 57.01

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C400800120016002000SE +/- 6.61, N = 3SE +/- 0.25, N = 3SE +/- 0.46, N = 3SE +/- 0.37, N = 3SE +/- 0.40, N = 31840.95410.47443.43493.99556.15
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C30060090012001500Min: 1831.67 / Avg: 1840.95 / Max: 1853.74Min: 410.21 / Avg: 410.47 / Max: 410.96Min: 442.75 / Avg: 443.43 / Max: 444.31Min: 493.28 / Avg: 493.99 / Max: 494.52Min: 555.67 / Avg: 556.15 / Max: 556.93

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C90180270360450SE +/- 0.48, N = 3SE +/- 0.34, N = 3SE +/- 0.06, N = 3SE +/- 0.16, N = 3SE +/- 0.37, N = 3138.53266.99254.13229.91429.36
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C80160240320400Min: 137.64 / Avg: 138.53 / Max: 139.3Min: 266.63 / Avg: 266.99 / Max: 267.66Min: 254 / Avg: 254.13 / Max: 254.2Min: 229.67 / Avg: 229.91 / Max: 230.22Min: 428.76 / Avg: 429.36 / Max: 430.04

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C306090120150SE +/- 0.43, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3115.3559.8762.8869.5174.41
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100Min: 114.68 / Avg: 115.35 / Max: 116.14Min: 59.72 / Avg: 59.87 / Max: 59.96Min: 62.86 / Avg: 62.88 / Max: 62.92Min: 69.41 / Avg: 69.51 / Max: 69.59Min: 74.33 / Avg: 74.41 / Max: 74.49

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C7001400210028003500SE +/- 0.21, N = 3SE +/- 7.34, N = 3SE +/- 2.41, N = 3SE +/- 2.26, N = 3SE +/- 2.41, N = 3152.962193.092099.321906.393450.43
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C6001200180024003000Min: 152.56 / Avg: 152.96 / Max: 153.22Min: 2178.99 / Avg: 2193.09 / Max: 2203.7Min: 2094.81 / Avg: 2099.32 / Max: 2103.05Min: 1903.28 / Avg: 1906.39 / Max: 1910.78Min: 3446.5 / Avg: 3450.43 / Max: 3454.83

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100SE +/- 0.1244, N = 3SE +/- 0.0229, N = 3SE +/- 0.0078, N = 3SE +/- 0.0084, N = 3SE +/- 0.0062, N = 3104.44367.28167.60648.37459.2520
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100Min: 104.26 / Avg: 104.44 / Max: 104.68Min: 7.25 / Avg: 7.28 / Max: 7.33Min: 7.6 / Avg: 7.61 / Max: 7.62Min: 8.36 / Avg: 8.37 / Max: 8.39Min: 9.24 / Avg: 9.25 / Max: 9.26

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C918273645SE +/- 0.13, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 312.2225.8424.4721.9140.64
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C816243240Min: 11.97 / Avg: 12.22 / Max: 12.42Min: 25.77 / Avg: 25.84 / Max: 25.91Min: 24.45 / Avg: 24.47 / Max: 24.52Min: 21.89 / Avg: 21.91 / Max: 21.94Min: 40.56 / Avg: 40.64 / Max: 40.71

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C30060090012001500SE +/- 8.56, N = 3SE +/- 0.30, N = 3SE +/- 0.27, N = 3SE +/- 0.30, N = 3SE +/- 0.25, N = 31289.82611.15647.89722.10776.54
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C2004006008001000Min: 1281.23 / Avg: 1289.82 / Max: 1306.95Min: 610.66 / Avg: 611.15 / Max: 611.68Min: 647.34 / Avg: 647.89 / Max: 648.2Min: 721.5 / Avg: 722.1 / Max: 722.48Min: 776.04 / Avg: 776.54 / Max: 776.81

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C130260390520650SE +/- 1.39, N = 3SE +/- 1.61, N = 3SE +/- 1.23, N = 3SE +/- 0.28, N = 3SE +/- 0.38, N = 3128.67383.70357.30320.86613.23
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C110220330440550Min: 125.9 / Avg: 128.67 / Max: 130.25Min: 380.51 / Avg: 383.7 / Max: 385.74Min: 355.21 / Avg: 357.3 / Max: 359.47Min: 320.47 / Avg: 320.86 / Max: 321.4Min: 612.55 / Avg: 613.23 / Max: 613.87

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C306090120150SE +/- 1.37, N = 3SE +/- 0.18, N = 3SE +/- 0.15, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3124.0941.6444.7249.8052.12
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C20406080100Min: 122.48 / Avg: 124.09 / Max: 126.81Min: 41.41 / Avg: 41.64 / Max: 42Min: 44.46 / Avg: 44.72 / Max: 44.96Min: 49.73 / Avg: 49.8 / Max: 49.86Min: 52.08 / Avg: 52.12 / Max: 52.17

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1224364860SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 38.7751.7051.0347.7748.56
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1020304050Min: 8.65 / Avg: 8.77 / Max: 8.88Min: 51.56 / Avg: 51.7 / Max: 51.82Min: 50.96 / Avg: 51.03 / Max: 51.11Min: 47.6 / Avg: 47.77 / Max: 47.86Min: 48.5 / Avg: 48.56 / Max: 48.59

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1224364860SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 324.8952.7252.9152.9045.23MIN: 12.04 / MAX: 25.89MIN: 50.17 / MAX: 53.72MIN: 50.65 / MAX: 53.55MIN: 50.6 / MAX: 53.56MIN: 16.58 / MAX: 46.26
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C1122334455Min: 24.73 / Avg: 24.89 / Max: 25.03Min: 52.47 / Avg: 52.72 / Max: 53.12Min: 52.8 / Avg: 52.91 / Max: 53.05Min: 52.77 / Avg: 52.9 / Max: 53Min: 45.03 / Avg: 45.23 / Max: 45.34

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 256 - Model: ResNet-50EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C918273645SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 320.4840.5940.5440.3636.23MIN: 11.38 / MAX: 21.17MIN: 14.97 / MAX: 41.27MIN: 14.7 / MAX: 41.23MIN: 18.81 / MAX: 40.93MIN: 14.59 / MAX: 36.98
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 256 - Model: ResNet-50EPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C816243240Min: 20.25 / Avg: 20.48 / Max: 20.62Min: 40.48 / Avg: 40.59 / Max: 40.65Min: 40.41 / Avg: 40.54 / Max: 40.7Min: 40.18 / Avg: 40.36 / Max: 40.51Min: 36.04 / Avg: 36.23 / Max: 36.52

Xmrig

Xmrig is an open-source cross-platform CPU/GPU miner for RandomX, KawPow, CryptoNight and AstroBWT. This test profile is setup to measure the Xmrig CPU mining performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Monero - Hash Count: 1MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4K8K12K16K20KSE +/- 155.10, N = 12SE +/- 56.24, N = 3SE +/- 43.26, N = 3SE +/- 34.05, N = 3SE +/- 5.73, N = 34973.318908.918129.016892.320484.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Monero - Hash Count: 1MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4K8K12K16K20KMin: 3980.7 / Avg: 4973.28 / Max: 5794.6Min: 18810.8 / Avg: 18908.93 / Max: 19005.6Min: 18043.4 / Avg: 18128.97 / Max: 18182.8Min: 16825.4 / Avg: 16892.3 / Max: 16936.8Min: 20477.1 / Avg: 20484.27 / Max: 20495.61. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Wownero - Hash Count: 1MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C8K16K24K32K40KSE +/- 120.26, N = 3SE +/- 52.06, N = 3SE +/- 6.52, N = 3SE +/- 107.46, N = 3SE +/- 47.09, N = 39331.625644.324096.221769.235370.01. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Wownero - Hash Count: 1MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C6K12K18K24K30KMin: 9109.3 / Avg: 9331.57 / Max: 9522.3Min: 25570.2 / Avg: 25644.3 / Max: 25744.7Min: 24084.8 / Avg: 24096.2 / Max: 24107.4Min: 21558.7 / Avg: 21769.2 / Max: 21912Min: 35292 / Avg: 35369.97 / Max: 35454.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Femto UPX2 - Hash Count: 1MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4K8K12K16K20KSE +/- 202.60, N = 12SE +/- 50.80, N = 3SE +/- 49.53, N = 3SE +/- 103.09, N = 3SE +/- 12.46, N = 35061.318922.718090.916799.220477.11. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Femto UPX2 - Hash Count: 1MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4K8K12K16K20KMin: 4063.3 / Avg: 5061.33 / Max: 6140.5Min: 18822.8 / Avg: 18922.7 / Max: 18988.7Min: 18008.6 / Avg: 18090.87 / Max: 18179.8Min: 16610.5 / Avg: 16799.23 / Max: 16965.5Min: 20452.4 / Avg: 20477.13 / Max: 20492.21. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Heavy - Hash Count: 1MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4K8K12K16K20KSE +/- 166.19, N = 12SE +/- 41.98, N = 3SE +/- 44.77, N = 3SE +/- 35.06, N = 3SE +/- 6.48, N = 35087.418883.218155.016932.820489.81. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Heavy - Hash Count: 1MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4K8K12K16K20KMin: 4186.9 / Avg: 5087.4 / Max: 5881.9Min: 18833.8 / Avg: 18883.2 / Max: 18966.7Min: 18109.4 / Avg: 18154.97 / Max: 18244.5Min: 16866.8 / Avg: 16932.83 / Max: 16986.3Min: 20482.1 / Avg: 20489.83 / Max: 20502.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: KawPow - Hash Count: 1MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4K8K12K16K20KSE +/- 218.18, N = 11SE +/- 43.40, N = 3SE +/- 61.47, N = 3SE +/- 33.52, N = 3SE +/- 5.33, N = 34687.918875.218088.716877.920487.21. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: KawPow - Hash Count: 1MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4K8K12K16K20KMin: 3486.3 / Avg: 4687.86 / Max: 6194.5Min: 18818.9 / Avg: 18875.23 / Max: 18960.6Min: 17971.1 / Avg: 18088.73 / Max: 18178.5Min: 16828.2 / Avg: 16877.87 / Max: 16941.7Min: 20479.2 / Avg: 20487.2 / Max: 20497.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C9001800270036004500SE +/- 12.26, N = 3SE +/- 7.57, N = 3SE +/- 19.57, N = 3SE +/- 16.58, N = 3SE +/- 6.81, N = 31042.74043.24031.73938.54374.01. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C8001600240032004000Min: 1018.3 / Avg: 1042.67 / Max: 1057.2Min: 4028.1 / Avg: 4043.23 / Max: 4051.4Min: 3994.2 / Avg: 4031.73 / Max: 4060.1Min: 3906.7 / Avg: 3938.53 / Max: 3962.5Min: 4366.3 / Avg: 4374.03 / Max: 4387.61. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringEPYC 7601 - Zen 1EPYC 8324P - Zen 4CEPYC 8324P - Zen 4C, 155WEPYC 8324PN - Zen 4CEPYC 8534PN - Zen 4C4080120160200Min: 32.69 / Avg: 143.24 / Max: 192.83Min: 6.76 / Avg: 88.61 / Max: 141.34Min: 11.47 / Avg: 82.06 / Max: 125.14Min: 6.71 / Avg: 71.8 / Max: 108.62Min: 6.99 / Avg: 97.94 / Max: 154.25

150 Results Shown

nginx:
  500
  1000
OpenSSL:
  RSA4096:
    sign/s
    verify/s
  SHA256:
    byte/s
  SHA512:
    byte/s
  AES-128-GCM:
    byte/s
  AES-256-GCM:
    byte/s
  ChaCha20:
    byte/s
  ChaCha20-Poly1305:
    byte/s
Apache IoTDB:
  500 - 100 - 500 - 100:
    point/sec
    Average Latency
DuckDB:
  IMDB
  TPC-H Parquet
Apache Cassandra
Speedb:
  Rand Read
  Read While Writing
  Read Rand Write Rand
  Update Rand
RocksDB:
  Rand Read
  Read While Writing
Redis 7.0.12 + memtier_benchmark:
  Redis - 100 - 1:10
  Redis - 100 - 1:5
7-Zip Compression:
  Compression Rating
  Decompression Rating
Timed Linux Kernel Compilation:
  defconfig
  allmodconfig
Timed LLVM Compilation:
  Ninja
  Unix Makefiles
Timed Node.js Compilation
Timed Gem5 Compilation
Timed FFmpeg Compilation
QuantLib
OpenFOAM:
  drivaerFastback, Small Mesh Size - Execution Time
  drivaerFastback, Medium Mesh Size - Mesh Time
  drivaerFastback, Medium Mesh Size - Execution Time
OpenRadioss
miniBUDE:
  OpenMP - BM1:
    GFInst/s
    Billion Interactions/s
  OpenMP - BM2:
    GFInst/s
    Billion Interactions/s
easyWave:
  e2Asean Grid + BengkuluSept2007 Source - 1200
  e2Asean Grid + BengkuluSept2007 Source - 2400
GPAW
LAMMPS Molecular Dynamics Simulator
CloverLeaf:
  clover_bm64_short
  clover_bm16
Kripke
Xcompact3d Incompact3d:
  input.i3d 193 Cells Per Direction
  X3D-benchmarking input.i3d
NAMD
Quicksilver:
  CORAL2 P1
  CTS2
Y-Cruncher:
  500M
  1B
ACES DGEMM
Blender:
  BMW27 - CPU-Only
  Classroom - CPU-Only
  Fishy Cat - CPU-Only
  Pabellon Barcelona - CPU-Only
  Barbershop - CPU-Only
Embree:
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Crown
Intel Open Image Denoise
OSPRay Studio:
  1 - 4K - 1 - Path Tracer - CPU
  1 - 4K - 16 - Path Tracer - CPU
  1 - 4K - 32 - Path Tracer - CPU
  3 - 4K - 1 - Path Tracer - CPU
  3 - 4K - 16 - Path Tracer - CPU
  3 - 4K - 32 - Path Tracer - CPU
OSPRay:
  gravity_spheres_volume/dim_512/ao/real_time
  gravity_spheres_volume/dim_512/scivis/real_time
  gravity_spheres_volume/dim_512/pathtracer/real_time
  particle_volume/ao/real_time
  particle_volume/scivis/real_time
  particle_volume/pathtracer/real_time
Chaos Group V-RAY
IndigoBench:
  CPU - Supercar
  CPU - Bedroom
FFmpeg:
  libx265 - Live
  libx265 - Upload
  libx265 - Platform
  libx265 - Video On Demand
SVT-AV1:
  Preset 12 - Bosphorus 4K
  Preset 8 - Bosphorus 4K
  Preset 4 - Bosphorus 4K
rav1e:
  10
  6
x265
uvg266:
  Bosphorus 4K - Very Fast
  Bosphorus 4K - Super Fast
  Bosphorus 4K - Ultra Fast
VVenC
Llama.cpp:
  llama-2-7b.Q4_0.gguf
  llama-2-13b.Q4_0.gguf
  llama-2-70b-chat.Q5_0.gguf
OpenVINO:
  Face Detection FP16-INT8 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    FPS
    ms
  Person Detection FP16 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16-INT8 - CPU:
    FPS
    ms
  Vehicle Detection FP16-INT8 - CPU:
    FPS
    ms
  Person Vehicle Bike Detection FP16 - CPU:
    FPS
    ms
  Machine Translation EN To DE FP16 - CPU:
    FPS
    ms
  Face Detection Retail FP16-INT8 - CPU:
    FPS
    ms
  Handwritten English Recognition FP16-INT8 - CPU:
    FPS
    ms
  Road Segmentation ADAS FP16-INT8 - CPU:
    FPS
    ms
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  ResNet-50, Baseline - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  ResNet-50, Sparse INT8 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  BERT-Large, NLP Question Answering - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
TensorFlow
PyTorch:
  CPU - 1 - ResNet-50
  CPU - 256 - ResNet-50
Xmrig:
  Monero - 1M
  Wownero - 1M
  CryptoNight-Femto UPX2 - 1M
  CryptoNight-Heavy - 1M
  KawPow - 1M
  GhostRider - 1M
CPU Power Consumption Monitor