AMD EPYC 9754 Bergamo SMT On/Off Comparison

Benchmarks by Michael Larabel for a future article (post 19th) looking at SMT on/off comparison toggled via BIOS. SMT comparison testing of AMD EPYC 9754 128-Core CPUs on Titanite with Ubuntu 22.04 LTS.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2307190-NE-BERGAMOSM27
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Comparison
Transpose Comparison

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
EPYC 9754 1P: SMT On
July 14 2023
  16 Hours, 51 Minutes
EPYC 9754 1P: SMT Off
July 13 2023
  15 Hours, 43 Minutes
EPYC 9754 2P: SMT On
July 11 2023
  14 Hours, 12 Minutes
EPYC 9754 2P: SMT Off
July 12 2023
  13 Hours, 40 Minutes
Invert Behavior (Only Show Selected Data)
  15 Hours, 6 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerVulkanCompilerFile-SystemScreen ResolutionEPYC 9754 1PEPYC 9754 2P SMT On SMT Off SMT On SMT OffAMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads)AMD Titanite_4G (RTI1007B BIOS)AMD Device 14a4768GB2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007ASPEEDBroadcom NetXtreme BCM5720 PCIeUbuntu 22.045.19.0-41-generic (x86_64)GNOME Shell 42.5X Server 1.21.1.41.3.224GCC 11.3.0ext41024x768AMD EPYC 9754 128-Core @ 2.25GHz (128 Cores)2 x AMD EPYC 9754 128-Core @ 2.25GHz (256 Cores / 512 Threads)1520GB2 x AMD EPYC 9754 128-Core @ 2.25GHz (256 Cores)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa0010bPython Details- Python 3.10.6Security Details- EPYC 9754 1P: SMT On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9754 1P: SMT Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9754 2P: SMT On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9754 2P: SMT Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

graph500: 26graph500: 26minibude: OpenMP - BM1minibude: OpenMP - BM2openssl: SHA256openssl: SHA512openssl: ChaCha20openssl: AES-128-GCMopenssl: AES-256-GCMopenssl: ChaCha20-Poly1305minife: Smallnekrs: Kershawnekrs: TurboPipe Periodicopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUembree: Pathtracer ISPC - Crownembree: Pathtracer ISPC - Asian Dragonminibude: OpenMP - BM1minibude: OpenMP - BM2heffte: c2c - FFTW - double - 512heffte: r2c - FFTW - double - 512heffte: c2c - FFTW - float - 512heffte: r2c - FFTW - float - 512libxsmm: 128libxsmm: 256xmrig: Monero - 1Mxmrig: Wownero - 1Moidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyoidn: RTLightmap.hdr.4096x4096 - CPU-Onlytensorflow: CPU - 256 - AlexNettensorflow: CPU - 512 - AlexNettensorflow: CPU - 256 - GoogLeNettensorflow: CPU - 256 - ResNet-50tensorflow: CPU - 512 - GoogLeNettensorflow: CPU - 512 - ResNet-50openvkl: vklBenchmark ISPCospray: particle_volume/ao/real_timeospray: particle_volume/scivis/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timedeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamaircrack-ng: luxcorerender: DLSC - CPUluxcorerender: Orange Juice - CPUluxcorerender: LuxCore Benchmark - CPUluxcorerender: Rainbow Colors and Prism - CPUsrsran: PUSCH Processor Benchmark, Throughput Totalcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingastcenc: Fastastcenc: Thoroughastcenc: Exhaustivestockfish: Total Timemysqlslap: 2048mysqlslap: 4096john-the-ripper: bcryptjohn-the-ripper: WPA PSKjohn-the-ripper: Blowfishjohn-the-ripper: MD5liquid-dsp: 256 - 256 - 512liquid-dsp: 512 - 256 - 512openssl: RSA4096graph500: 26graph500: 26npb: BT.Cnpb: CG.Cnpb: EP.Dnpb: FT.Cnpb: IS.Dnpb: LU.Cnpb: MG.Cnpb: SP.Bnpb: SP.Cpgbench: 1000 - 800 - Read Onlyopenssl: RSA4096namd: ATPase Simulation - 327,506 Atomstoybrot: TBBtoybrot: OpenMPospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 2 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 16 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 2 - 4K - 16 - Path Tracerospray-studio: 2 - 4K - 32 - Path Tracerospray-studio: 3 - 4K - 16 - Path Tracerospray-studio: 3 - 4K - 32 - Path Tracerpgbench: 1000 - 800 - Read Only - Average Latencyopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamcloverleaf: Lagrangian-Eulerian Hydrodynamicscp2k: H2O-DFT-LSspecfem3d: Mount St. Helensspecfem3d: Layered Halfspacespecfem3d: Tomographic Modelspecfem3d: Homogeneous Halfspacespecfem3d: Water-layered Halfspacebuild-gem5: Time To Compilebuild-godot: Time To Compilebuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-llvm: Ninjabuild-llvm: Unix Makefilesbuild-nodejs: Time To Compileprimesieve: 1e12primesieve: 1e13helsing: 14 digitblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyappleseed: Emilyappleseed: Disney Materialappleseed: Material TesterEPYC 9754 1PEPYC 9754 2P SMT On SMT Off SMT On SMT Off880249000857890000237.763238.905163633625553530058793306593468579871169673735557101253776621046241583732051784.15808636667253840692360.7726.6126.571464.29117.885311.486067.78582.0811794.326148.89120515.1185400.88125.5813157.65045944.0625972.64334.845166.3418128.124245.5422713.43331.724409.474803.63.623.621.741422.081628.80504.09118.45416.03122.77139630.850730.816531.924532.675073.38071376.2142240.8667417.1186968.6267624.4789126.9310316.046673.2077171120.35416.3424.4712.1820.888389.07262717917871190.754975.08318.1743365034349780655216064810375216115203126671696766667178370000054195.1445912000333445000292243.6145686.8813264.79140791.525300.29279662.55128129.56149355.54131909.918555691890935.30.207023591408186187310321375927538139632788516484329720.9521049.312377.792378.0743.73541.2912.0710.53110.0010.8410.400.831.21859.865346.4318267.7088152.989565.9747102.2265499.5866201.6258859.87712.005012.266.21637984915.9649316887.4806747069.40434850017.194492779161.648105.79726.225227.517125.364211.079113.7041.94421.28650.47312.7731.1216.49116.5439.27122.58770944.30492166.676131928320000893624000234.684236.12811141455728051804333637550700307433115283892806399703462188339278268998751741.05734266667258608333362.1828.7428.832784.67119.016744.665837.62545.1311710.595118.29113162.2971673.8585.2893107.36085867.1085903.20535.404967.9907128.597248.5572696.53813.451218.963182.23.573.571.721375.331526.81525.39121.47429.16123.88110723.733323.721025.512125.717896.96971780.4421246.3732504.35781275.7707812.1023134.5717404.233897.0913149056.95313.2720.988.8814.3720430.95927415104701278.646668.30727.3147272722940783695163220676218163263167516671313933333141470000056647.3493535000363750000298801.4448672.2414274.53147448.725315.15289518.14136942.13161475.24133415.428777221799293.00.20595559062421127114613581800435926182693653921666433710.917513.231105.961102.8211.49268.824.745.4758.7110.916.240.701.30644.976835.5549259.2779125.446749.511177.8148468.7809156.0563645.00199.274957.6865.03003158015.0281219294.9372655066.09275029913.419454501148.484102.58822.984177.758119.576213.907116.1221.79621.13257.95615.1538.4420.47147.2250.01123.29839638.492263167.90059717240300001571100000253.123315.52432792603851310604965520313175499540272339890700107201931707032790981736011062774.2121.0340.6740.905810.41235.6513214.2011299.321159.9922954.449889.61168372.89133931.53210.0714255.98646328.0697888.085109.645207.197221.765433.6014976.76112.686533.7142082.74.764.782.351225.411770.91329.22124.98538.52172.36172049.132849.231152.731853.8295139.65902627.3142556.9411797.62481868.33101190.7168242.9589602.2602139.882118.6134.459.8619.0217891.49258201353957610.1137134.885315.930558238692458054540786015245334098503487933325444000003330166667108490.5960471000672541000491231.8367554.7423705.40211432.899849.01591505.17249109.09236490.76224243.288278783782091.80.10646201433214824955827698156197817157319253184550.974526.981559.951552.1511.03270.934.835.6455.1211.006.460.621.08902.859348.6206229.1624159.886168.3638107.1835521.3108211.4848902.779221.652143.5133.9066750959.9974475703.7827417984.7278301489.778381437152.586100.79020.344145.929107.721199.36593.2711.50811.12027.2807.1216.289.8769.0321.75164.56716420788800001815160000439.067439.59722226942886710223223359011004533945702307524535457199823414886378448957052353798.6121.0841.0540.206242.68235.3713141.5111373.951174.9922955.649878.88142135.58118225.55146.2051178.304610976.68210989.938112.413210.933223.584430.2654505.56373.085946.0100754.34.354.312.091581.661908.76452.99146.74634.13189.40153041.656741.553144.288944.7104182.44532730.4980590.87891058.67762409.80351541.9512290.7562770.1392182.5974128050.21914.4525.116.9713.5136573.8771462913091693.3961127.208814.409944702314359157931704613015003208853022166725426333332610933333113251.41075900000770180000536518.7466822.9725983.74224178.108635.30658754.21268721.05246272.79231041.577859683598946.30.13969297636716316457631004620133102322054512127242381.018526.461545.231579.1410.26271.244.865.6154.4211.106.470.671.13676.812845.8765212.6821118.128551.810381.1994426.7362162.0191676.434215.152363.5792.6301225997.4707729302.7092054283.4518301696.218069257148.376100.24018.474118.09999.215198.75093.9521.16011.15250.0548.4520.2411.7285.5427.47159.90661440.570691265.885808OpenBenchmarking.org

CPU Power Consumption Monitor

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringSMT OnSMT Off140280420560700Min: 21.61 / Avg: 460.57 / Max: 792.38Min: 97.83 / Avg: 446.01 / Max: 702.85Min: 10.52 / Avg: 248.93 / Max: 397.25Min: 10.61 / Avg: 238.75 / Max: 362.1

Graph500

This is a benchmark of the reference implementation of Graph500, an HPC benchmark focused on data intensive loads and commonly tested on supercomputers for complex data problems. Graph500 primarily stresses the communication subsystem of the hardware under test. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgbfs max_TEPS, More Is BetterGraph500 3.0Scale: 26SMT OnSMT Off400M800M1200M1600M2000M880249000928320000172403000020788800001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgbfs median_TEPS, More Is BetterGraph500 3.0Scale: 26SMT OnSMT Off400M800M1200M1600M2000M857890000893624000157110000018151600001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1SMT OffSMT On100200300400500SE +/- 0.10, N = 9SE +/- 0.05, N = 9SE +/- 0.21, N = 9SE +/- 7.21, N = 15234.68237.76253.12439.071. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2SMT OnSMT Off0.21350.4270.64050.8541.06750.8190.9490.8810.883

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2SMT OffSMT On100200300400500SE +/- 0.25, N = 3SE +/- 0.01, N = 3SE +/- 0.43, N = 4SE +/- 6.02, N = 12236.13238.91315.52439.601. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenSSL

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgbyte/s Per Watt, More Is BetterOpenSSL 3.1Algorithm: SHA256SMT OffSMT On110M220M330M440M550M368054429.03485100025.27390668971.64491268818.21

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: SHA256SMT OffSMT On70000M140000M210000M280000M350000MSE +/- 15184699.42, N = 3SE +/- 161352968.33, N = 3SE +/- 224959781.68, N = 3SE +/- 207719324.78, N = 31114145572801636336255532222694288673279260385131. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: SHA512SMT OffSMT On20000M40000M60000M80000M100000MSE +/- 19506083.54, N = 3SE +/- 4276543.39, N = 3SE +/- 660141733.06, N = 3SE +/- 22577791.79, N = 351804333637530058793301022322335901060496552031. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgbyte/s Per Watt, More Is BetterOpenSSL 3.1Algorithm: ChaCha20SMT OffSMT On400M800M1200M1600M2000M1666389521.271804203926.061787936411.251812397903.61

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgbyte/s Per Watt, More Is BetterOpenSSL 3.1Algorithm: AES-128-GCMSMT OffSMT On700M1400M2100M2800M3500M3357766493.213375379415.533373392798.473408107334.73

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgbyte/s Per Watt, More Is BetterOpenSSL 3.1Algorithm: AES-256-GCMSMT OnSMT Off600M1200M1800M2400M3000M2919004979.802960156985.812959773610.692960716545.71

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgbyte/s Per Watt, More Is BetterOpenSSL 3.1Algorithm: ChaCha20-Poly1305SMT OffSMT On300M600M900M1200M1500M1185929906.411256483723.091218755474.841284331827.02

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: ChaCha20SMT OffSMT On300000M600000M900000M1200000M1500000MSE +/- 70893114.79, N = 3SE +/- 23916253.09, N = 3SE +/- 107897909.37, N = 3SE +/- 46014499.85, N = 3550700307433659346857987110045339457013175499540271. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: AES-128-GCMSMT OffSMT On500000M1000000M1500000M2000000M2500000MSE +/- 772883363.35, N = 3SE +/- 404585301.69, N = 3SE +/- 4718005576.14, N = 3SE +/- 4494053056.14, N = 311528389280631169673735557230752453545723398907001071. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: AES-256-GCMSMT OffSMT On400000M800000M1200000M1600000M2000000MSE +/- 917614258.55, N = 3SE +/- 2018584981.53, N = 3SE +/- 2904032106.06, N = 3SE +/- 676471418.80, N = 39970346218831012537766210199823414886320193170703271. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: ChaCha20-Poly1305SMT OffSMT On200000M400000M600000M800000M1000000MSE +/- 86138373.27, N = 3SE +/- 15599558.91, N = 3SE +/- 39882779.79, N = 3SE +/- 267574958.87, N = 33927826899874624158373207844895705239098173601101. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

miniFE

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgCG Mflops Per Watt, More Is BetterminiFE 2.2Problem Size: SmallSMT OffSMT On90180270360450236.18268.29419.54430.07

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgCG Mflops, More Is BetterminiFE 2.2Problem Size: SmallSMT OffSMT On13K26K39K52K65KSE +/- 25.22, N = 5SE +/- 52.11, N = 5SE +/- 478.13, N = 5SE +/- 411.42, N = 551741.051784.153798.662774.21. (CXX) g++ options: -O3 -fopenmp -lmpi_cxx -lmpi

nekRS

nekRS is an open-source Navier Stokes solver based on the spectral element method. NekRS supports both CPU and GPU/accelerator support though this test profile is currently configured for CPU execution. NekRS is part of Nek5000 of the Mathematics and Computer Science MCS at Argonne National Laboratory. This nekRS benchmark is primarily relevant to large core count HPC servers and otherwise may be very time consuming on smaller systems. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: KershawSMT OffSMT On1200M2400M3600M4800M6000MSE +/- 37190783.06, N = 3SE +/- 8226739.60, N = 3573426666758086366671. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

Input: Kershaw

EPYC 9754 2P: SMT On: The test quit with a non-zero exit status. E: mpirun noticed that process rank 0 with PID 0 on node phoronix-QuantaGrid-D54Q-2U exited on signal 11 (Segmentation fault).

EPYC 9754 2P: SMT Off: The test quit with a non-zero exit status. E: mpirun noticed that process rank 0 with PID 0 on node phoronix-QuantaGrid-D54Q-2U exited on signal 11 (Segmentation fault).

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: TurboPipe PeriodicSMT OnSMT Off600M1200M1800M2400M3000MSE +/- 62315945.32, N = 13SE +/- 87729075.59, N = 15253840692325860833331. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

Input: TurboPipe Periodic

EPYC 9754 2P: SMT On: The test quit with a non-zero exit status. E: mpirun noticed that process rank 0 with PID 0 on node phoronix-QuantaGrid-D54Q-2U exited on signal 11 (Segmentation fault).

EPYC 9754 2P: SMT Off: The test quit with a non-zero exit status. E: mpirun noticed that process rank 0 with PID 0 on node phoronix-QuantaGrid-D54Q-2U exited on signal 11 (Segmentation fault).

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUSMT OnSMT Off306090120150SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 360.7762.18121.03121.081. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUSMT OnSMT Off918273645SE +/- 0.20, N = 12SE +/- 0.23, N = 9SE +/- 0.14, N = 3SE +/- 0.29, N = 326.6128.7440.6741.051. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUSMT OnSMT Off918273645SE +/- 0.15, N = 15SE +/- 0.29, N = 5SE +/- 0.14, N = 3SE +/- 0.22, N = 326.5728.8340.2040.901. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUSMT OnSMT Off13002600390052006500SE +/- 21.50, N = 14SE +/- 25.69, N = 13SE +/- 93.68, N = 15SE +/- 87.31, N = 131464.292784.675810.416242.681. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUSMT OnSMT Off50100150200250SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3117.88119.01235.37235.651. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUSMT OnSMT Off3K6K9K12K15KSE +/- 103.73, N = 15SE +/- 3.11, N = 3SE +/- 2.74, N = 3SE +/- 7.09, N = 35311.486744.6613141.5113214.201. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUSMT OffSMT On2K4K6K8K10KSE +/- 11.25, N = 3SE +/- 0.58, N = 3SE +/- 9.34, N = 3SE +/- 2.58, N = 35837.626067.7811299.3211373.951. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUSMT OffSMT On30060090012001500SE +/- 4.46, N = 15SE +/- 6.51, N = 15SE +/- 7.44, N = 3SE +/- 4.51, N = 3545.13582.081159.991174.991. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUSMT OffSMT On5K10K15K20K25KSE +/- 13.11, N = 3SE +/- 2.13, N = 3SE +/- 16.03, N = 3SE +/- 15.58, N = 311710.5911794.3222954.4422955.641. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUSMT OffSMT On2K4K6K8K10KSE +/- 5.00, N = 3SE +/- 48.86, N = 15SE +/- 10.15, N = 3SE +/- 11.31, N = 35118.296148.899878.889889.611. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUSMT OffSMT On40K80K120K160K200KSE +/- 202.90, N = 3SE +/- 390.62, N = 3SE +/- 158.47, N = 3SE +/- 676.62, N = 3113162.29120515.11142135.58168372.891. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUSMT OffSMT On30K60K90K120K150KSE +/- 126.57, N = 3SE +/- 192.97, N = 3SE +/- 420.06, N = 3SE +/- 602.14, N = 371673.8585400.88118225.55133931.531. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: CrownSMT OffSMT On50100150200250SE +/- 0.05, N = 6SE +/- 0.13, N = 7SE +/- 0.13, N = 7SE +/- 0.16, N = 985.29125.58146.21210.07

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian DragonSMT OffSMT On60120180240300SE +/- 0.09, N = 6SE +/- 0.09, N = 8SE +/- 0.26, N = 8SE +/- 0.48, N = 9107.36157.65178.30255.99

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1SMT OffSMT On2K4K6K8K10KSE +/- 2.53, N = 9SE +/- 1.30, N = 9SE +/- 5.35, N = 9SE +/- 180.32, N = 155867.115944.066328.0710976.681. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2SMT OffSMT On2K4K6K8K10KSE +/- 6.13, N = 3SE +/- 0.21, N = 3SE +/- 10.75, N = 4SE +/- 150.60, N = 125903.215972.647888.0910989.941. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

HeFFTe - Highly Efficient FFT for Exascale

HeFFTe is the Highly Efficient FFT for Exascale software developed as part of the Exascale Computing Project. This test profile uses HeFFTe's built-in speed benchmarks under a variety of configuration options and currently catering to CPU/processor testing. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgGFLOP/s, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: c2c - Backend: FFTW - Precision: double - X Y Z: 512SMT OnSMT Off306090120150SE +/- 2.09, N = 15SE +/- 2.10, N = 15SE +/- 0.77, N = 3SE +/- 1.48, N = 334.8535.40109.65112.411. (CXX) g++ options: -O3

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgGFLOP/s Per Watt, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: c2c - Backend: FFTW - Precision: float - X Y Z: 512SMT OnSMT Off0.15570.31140.46710.62280.77850.5480.5690.6820.692

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgGFLOP/s Per Watt, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: r2c - Backend: FFTW - Precision: float - X Y Z: 512SMT OffSMT On0.33910.67821.01731.35641.69551.2631.2891.4451.507

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgGFLOP/s, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: r2c - Backend: FFTW - Precision: double - X Y Z: 512SMT OnSMT Off50100150200250SE +/- 3.14, N = 15SE +/- 3.41, N = 15SE +/- 0.28, N = 5SE +/- 1.62, N = 566.3467.99207.20210.931. (CXX) g++ options: -O3

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgGFLOP/s, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: c2c - Backend: FFTW - Precision: float - X Y Z: 512SMT OnSMT Off50100150200250SE +/- 0.15, N = 4SE +/- 0.01, N = 4SE +/- 1.37, N = 5SE +/- 1.28, N = 5128.12128.60221.77223.581. (CXX) g++ options: -O3

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgGFLOP/s, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: r2c - Backend: FFTW - Precision: float - X Y Z: 512SMT OnSMT Off90180270360450SE +/- 0.52, N = 5SE +/- 0.09, N = 5SE +/- 0.77, N = 6SE +/- 0.86, N = 7245.54248.56430.27433.601. (CXX) g++ options: -O3

libxsmm

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgGFLOPS/s Per Watt, More Is Betterlibxsmm 2-1.17-3645M N K: 128SMT OffSMT On4812162013.2113.2413.8915.41

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgGFLOPS/s Per Watt, More Is Betterlibxsmm 2-1.17-3645M N K: 256SMT OnSMT Off51015202515.7818.1219.0419.92

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgGFLOPS/s, More Is Betterlibxsmm 2-1.17-3645M N K: 128SMT OffSMT On11002200330044005500SE +/- 19.26, N = 3SE +/- 0.99, N = 3SE +/- 114.55, N = 9SE +/- 62.14, N = 42696.52713.44505.54976.71. (CXX) g++ options: -dynamic -Bstatic -static-libgcc -lgomp -lm -lrt -ldl -lquadmath -lstdc++ -pthread -fPIC -std=c++14 -O2 -fopenmp-simd -funroll-loops -ftree-vectorize -fdata-sections -ffunction-sections -fvisibility=hidden -msse4.2

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgGFLOPS/s, More Is Betterlibxsmm 2-1.17-3645M N K: 256SMT OnSMT Off14002800420056007000SE +/- 2.32, N = 3SE +/- 16.75, N = 3SE +/- 1.43, N = 3SE +/- 66.66, N = 93331.73813.46112.66373.01. (CXX) g++ options: -dynamic -Bstatic -static-libgcc -lgomp -lm -lrt -ldl -lquadmath -lstdc++ -pthread -fPIC -std=c++14 -O2 -fopenmp-simd -funroll-loops -ftree-vectorize -fdata-sections -ffunction-sections -fvisibility=hidden -msse4.2

Xmrig

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgH/s Per Watt, More Is BetterXmrig 6.18.1Variant: Monero - Hash Count: 1MSMT OnSMT Off4080120160200109.99191.10177.29185.91

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgH/s Per Watt, More Is BetterXmrig 6.18.1Variant: Wownero - Hash Count: 1MSMT OffSMT On70140210280350225.36323.17235.83279.93

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Monero - Hash Count: 1MSMT OnSMT Off20K40K60K80K100KSE +/- 587.76, N = 15SE +/- 513.99, N = 3SE +/- 83.35, N = 4SE +/- 871.70, N = 424409.451218.985946.086533.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Wownero - Hash Count: 1MSMT OffSMT On30K60K90K120K150KSE +/- 13.77, N = 4SE +/- 513.11, N = 15SE +/- 741.13, N = 4SE +/- 677.82, N = 563182.274803.6100754.3142082.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Intel Open Image Denoise

Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlySMT OffSMT On1.0712.1423.2134.2845.355SE +/- 0.02, N = 7SE +/- 0.00, N = 7SE +/- 0.03, N = 7SE +/- 0.01, N = 73.573.624.354.76

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlySMT OffSMT On1.07552.1513.22654.3025.3775SE +/- 0.02, N = 15SE +/- 0.00, N = 7SE +/- 0.03, N = 15SE +/- 0.01, N = 73.573.624.314.78

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 2.0Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlySMT OnSMT Off0.00180.00360.00540.00720.0090.0060.0060.0080.008

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlySMT OffSMT On0.52881.05761.58642.11522.644SE +/- 0.01, N = 4SE +/- 0.00, N = 4SE +/- 0.02, N = 5SE +/- 0.00, N = 51.721.742.092.35

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 256 - Model: AlexNetSMT OnSMT Off30060090012001500SE +/- 14.23, N = 15SE +/- 11.49, N = 15SE +/- 8.29, N = 3SE +/- 3.81, N = 31225.411581.661375.331422.08

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 512 - Model: AlexNetSMT OffSMT On400800120016002000SE +/- 3.13, N = 3SE +/- 1.79, N = 3SE +/- 15.22, N = 15SE +/- 18.22, N = 31526.811628.801770.911908.76

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 256 - Model: ResNet-50SMT OnSMT Off0.12290.24580.36870.49160.61450.3190.3610.5360.546

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 512 - Model: GoogLeNetSMT OnSMT Off0.42280.84561.26841.69122.1141.2271.3911.7671.879

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 512 - Model: ResNet-50SMT OnSMT Off0.12510.25020.37530.50040.62550.4090.4290.5440.556

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 256 - Model: GoogLeNetSMT OnSMT Off110220330440550SE +/- 1.69, N = 3SE +/- 5.52, N = 4SE +/- 3.39, N = 3SE +/- 0.35, N = 3329.22452.99504.09525.39

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 256 - Model: ResNet-50SMT OnSMT Off306090120150SE +/- 1.07, N = 12SE +/- 1.45, N = 12SE +/- 1.70, N = 3SE +/- 0.68, N = 3118.45121.47124.98146.74

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 512 - Model: GoogLeNetSMT OnSMT Off140280420560700SE +/- 4.74, N = 12SE +/- 5.79, N = 12SE +/- 4.51, N = 15SE +/- 6.73, N = 3416.03429.16538.52634.13

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 512 - Model: ResNet-50SMT OnSMT Off4080120160200SE +/- 0.90, N = 3SE +/- 1.35, N = 3SE +/- 0.59, N = 3SE +/- 0.13, N = 3122.77123.88172.36189.40

OpenVKL

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCSMT OffSMT On1.31692.63383.95075.26766.58453.5123.6764.9555.853

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCSMT OffSMT On400800120016002000SE +/- 0.33, N = 3SE +/- 1.86, N = 3SE +/- 1.33, N = 3SE +/- 6.06, N = 31107139615301720

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timeSMT OffSMT On1122334455SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 323.7330.8541.6649.13

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/scivis/real_timeSMT OffSMT On1122334455SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 323.7230.8241.5549.23

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeSMT OffSMT On1224364860SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 325.5131.9244.2952.73

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeSMT OffSMT On1224364860SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 325.7232.6844.7153.83

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamSMT OnSMT Off4080120160200SE +/- 0.25, N = 3SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.07, N = 373.3896.97139.66182.45

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-StreamSMT OnSMT Off6001200180024003000SE +/- 1.21, N = 3SE +/- 3.84, N = 3SE +/- 6.95, N = 3SE +/- 33.47, N = 151376.211780.442627.312730.50

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamSMT OnSMT Off130260390520650SE +/- 7.96, N = 15SE +/- 8.20, N = 15SE +/- 6.10, N = 15SE +/- 11.89, N = 15240.87246.37556.94590.88

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamSMT OnSMT Off2004006008001000SE +/- 0.46, N = 3SE +/- 5.07, N = 15SE +/- 0.32, N = 3SE +/- 0.90, N = 3417.12504.36797.621058.68

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamSMT OnSMT Off5001000150020002500SE +/- 0.74, N = 3SE +/- 5.02, N = 3SE +/- 1.60, N = 3SE +/- 1.63, N = 3968.631275.771868.332409.80

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamSMT OnSMT Off30060090012001500SE +/- 0.29, N = 3SE +/- 3.93, N = 3SE +/- 1.02, N = 3SE +/- 1.38, N = 3624.48812.101190.721541.95

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamSMT OnSMT Off60120180240300SE +/- 0.15, N = 3SE +/- 2.61, N = 15SE +/- 0.12, N = 3SE +/- 2.51, N = 3126.93134.57242.96290.76

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamSMT OnSMT Off170340510680850SE +/- 1.02, N = 3SE +/- 2.15, N = 3SE +/- 0.72, N = 3SE +/- 0.92, N = 3316.05404.23602.26770.14

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamSMT OnSMT Off4080120160200SE +/- 0.25, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 373.2197.09139.88182.60

Aircrack-ng

Aircrack-ng is a tool for assessing WiFi/WLAN network security. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgk/s, More Is BetterAircrack-ng 1.7SMT OffSMT On40K80K120K160K200KSE +/- 1109.71, N = 3SE +/- 1020.90, N = 3SE +/- 101.44, N = 3128050.22149056.95171120.351. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -pthread

EPYC 9754 2P: SMT On: The test run did not produce a result.

LuxCoreRender

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgM samples/sec Per Watt, More Is BetterLuxCoreRender 2.6Scene: DLSC - Acceleration: CPUSMT OffSMT On0.01220.02440.03660.04880.0610.0310.0360.0470.054

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: DLSC - Acceleration: CPUSMT OffSMT On510152025SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.20, N = 413.2716.3414.4518.61

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Orange Juice - Acceleration: CPUSMT OffSMT On816243240SE +/- 0.03, N = 3SE +/- 0.30, N = 15SE +/- 0.60, N = 15SE +/- 1.35, N = 1520.9824.4725.1134.45

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: LuxCore Benchmark - Acceleration: CPUSMT OffSMT On3691215SE +/- 0.11, N = 12SE +/- 0.11, N = 15SE +/- 0.08, N = 8SE +/- 0.09, N = 156.979.868.8812.18

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Rainbow Colors and Prism - Acceleration: CPUSMT OffSMT On510152025SE +/- 0.35, N = 15SE +/- 0.03, N = 5SE +/- 0.04, N = 4SE +/- 0.03, N = 513.5119.0214.3720.88

srsRAN Project

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgMbps Per Watt, More Is BettersrsRAN Project 23.5Test: PUSCH Processor Benchmark, Throughput TotalSMT OnSMT Off2040608010031.9070.6432.0978.41

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.5Test: PUSCH Processor Benchmark, Throughput TotalSMT OnSMT Off8K16K24K32K40KSE +/- 50.60, N = 3SE +/- 54.33, N = 3SE +/- 831.80, N = 15SE +/- 211.99, N = 38389.020430.917891.436573.81. (CXX) g++ options: -march=native -mfma -O3 -fno-trapping-math -fno-math-errno -lgtest

7-Zip Compression

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgMIPS Per Watt, More Is Better7-Zip Compression 22.01Test: Decompression RatingSMT OffSMT On60012001800240030001933.662700.352063.782973.58

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingSMT OffSMT On200K400K600K800K1000KSE +/- 4792.89, N = 3SE +/- 1345.49, N = 3SE +/- 4721.80, N = 3SE +/- 5539.49, N = 35927417262717714629258201. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingSMT OffSMT On300K600K900K1200K1500KSE +/- 429.17, N = 3SE +/- 1608.29, N = 3SE +/- 1897.81, N = 3SE +/- 5499.45, N = 351047079178791309113539571. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

ASTC Encoder

ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: FastSMT OnSMT Off30060090012001500SE +/- 1.29, N = 5SE +/- 1.25, N = 5SE +/- 1.79, N = 6SE +/- 1.20, N = 7610.11693.401190.751278.651. (CXX) g++ options: -O3 -flto -pthread

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ThoroughSMT OffSMT On306090120150SE +/- 0.01, N = 6SE +/- 0.02, N = 6SE +/- 0.05, N = 6SE +/- 0.22, N = 668.3175.08127.21134.891. (CXX) g++ options: -O3 -flto -pthread

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ExhaustiveSMT OffSMT On48121620SE +/- 0.0028, N = 5SE +/- 0.0006, N = 5SE +/- 0.0257, N = 6SE +/- 0.0081, N = 67.31478.174314.409915.93051. (CXX) g++ options: -O3 -flto -pthread

Stockfish

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterStockfish 15Total TimeSMT OffSMT On200K400K600K800K1000K746293.69896399.09881021.761117842.33

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 15Total TimeSMT OffSMT On120M240M360M480M600MSE +/- 5762415.88, N = 15SE +/- 7021012.10, N = 12SE +/- 6859221.31, N = 12SE +/- 9265130.36, N = 152727229403650343494470231435823869241. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -msse -msse3 -mpopcnt -mavx2 -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto=jobserver

MariaDB

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgQueries Per Second Per Watt, More Is BetterMariaDB 11.0.1Clients: 2048SMT OffSMT On2468102.3222.3656.3636.371

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB 11.0.1Clients: 2048SMT OnSMT Off2004006008001000SE +/- 8.04, N = 3SE +/- 0.73, N = 3SE +/- 1.81, N = 3SE +/- 1.06, N = 35805917807831. (CXX) g++ options: -pie -fPIC -fstack-protector -O3 -lnuma -lpcre2-8 -lcrypt -lz -lm -lssl -lcrypto -lpthread -ldl

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB 11.0.1Clients: 4096SMT OnSMT Off150300450600750SE +/- 5.45, N = 6SE +/- 1.48, N = 3SE +/- 8.08, N = 3SE +/- 3.99, N = 35455796556951. (CXX) g++ options: -pie -fPIC -fstack-protector -O3 -lnuma -lpcre2-8 -lcrypt -lz -lm -lssl -lcrypto -lpthread -ldl

John The Ripper

This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: bcryptSMT OffSMT On90K180K270K360K450KSE +/- 33.22, N = 3SE +/- 92.54, N = 3SE +/- 1964.45, N = 3SE +/- 2298.36, N = 31632202160643170464078601. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: WPA PSKSMT OffSMT On300K600K900K1200K1500KSE +/- 6933.79, N = 3SE +/- 505.98, N = 3SE +/- 15887.63, N = 4SE +/- 18163.51, N = 15676218810375130150015245331. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: BlowfishSMT OffSMT On90K180K270K360K450KSE +/- 12.67, N = 3SE +/- 117.40, N = 3SE +/- 1247.49, N = 3SE +/- 3726.56, N = 31632632161153208854098501. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: MD5SMT OffSMT On7M14M21M28M35MSE +/- 35950.58, N = 3SE +/- 52818.35, N = 3SE +/- 140717.61, N = 3SE +/- 83819.91, N = 3167516672031266730221667348793331. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 512SMT OffSMT On500M1000M1500M2000M2500MSE +/- 592546.29, N = 3SE +/- 470224.53, N = 3SE +/- 1068228.02, N = 3SE +/- 1877054.43, N = 313139333331696766667254263333325444000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 512 - Buffer Length: 256 - Filter Length: 512SMT OffSMT On700M1400M2100M2800M3500MSE +/- 2946183.97, N = 3SE +/- 1814754.35, N = 3SE +/- 3555434.03, N = 3SE +/- 569600.25, N = 314147000001783700000261093333333301666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenSSL

OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test profile makes use of the built-in "openssl speed" benchmarking capabilities. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.1Algorithm: RSA4096SMT OnSMT Off20K40K60K80K100KSE +/- 16.66, N = 3SE +/- 1.80, N = 3SE +/- 3.93, N = 3SE +/- 3.85, N = 354195.156647.3108490.5113251.41. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

Graph500

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgsssp max_TEPS Per Watt, More Is BetterGraph500 3.0Scale: 26SMT OnSMT Off400K800K1200K1600K2000K1513281.141664973.761520544.671719832.82

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgsssp max_TEPS, More Is BetterGraph500 3.0Scale: 26SMT OnSMT Off200M400M600M800M1000M44591200049353500096047100010759000001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgsssp median_TEPS, More Is BetterGraph500 3.0Scale: 26SMT OnSMT Off160M320M480M640M800M3334450003637500006725410007701800001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

NAS Parallel Benchmarks

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgTotal Mop/s Per Watt, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.CSMT OnSMT Off70140210280350246.35257.05304.95340.22

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgTotal Mop/s Per Watt, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.DSMT OnSMT Off153045607555.5962.2559.2969.13

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgTotal Mop/s Per Watt, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: FT.CSMT OnSMT Off2004006008001000823.02896.921044.171105.80

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgTotal Mop/s Per Watt, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: IS.DSMT OffSMT On81624324028.0731.2435.4035.70

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgTotal Mop/s Per Watt, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.CSMT OnSMT Off50010001500200025001448.631504.971821.352122.50

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgTotal Mop/s Per Watt, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.CSMT OnSMT Off300600900120015001433.881554.081449.061502.14

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgTotal Mop/s Per Watt, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.BSMT OnSMT Off300600900120015001034.031082.901171.421347.26

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgTotal Mop/s Per Watt, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.CSMT OnSMT Off140280420560700567.82602.82625.95657.40

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: BT.CSMT OnSMT Off110K220K330K440K550KSE +/- 396.74, N = 5SE +/- 269.21, N = 5SE +/- 4903.75, N = 15SE +/- 3792.90, N = 12292243.61298801.44491231.83536518.741. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.CSMT OnSMT Off14K28K42K56K70KSE +/- 441.00, N = 15SE +/- 285.31, N = 8SE +/- 568.39, N = 8SE +/- 348.18, N = 845686.8848672.2466822.9767554.741. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.DSMT OnSMT Off6K12K18K24K30KSE +/- 214.86, N = 15SE +/- 54.02, N = 5SE +/- 413.32, N = 15SE +/- 940.02, N = 1213264.7914274.5323705.4025983.741. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: FT.CSMT OnSMT Off50K100K150K200K250KSE +/- 1029.98, N = 8SE +/- 93.32, N = 8SE +/- 1757.80, N = 9SE +/- 2978.54, N = 13140791.52147448.72211432.89224178.101. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: IS.DSMT OnSMT Off2K4K6K8K10KSE +/- 27.01, N = 6SE +/- 29.88, N = 6SE +/- 105.10, N = 15SE +/- 104.60, N = 155300.295315.158635.309849.011. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.CSMT OnSMT Off140K280K420K560K700KSE +/- 2132.06, N = 6SE +/- 1485.96, N = 6SE +/- 7199.59, N = 15SE +/- 4916.03, N = 15279662.55289518.14591505.17658754.211. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.CSMT OnSMT Off60K120K180K240K300KSE +/- 296.36, N = 10SE +/- 104.98, N = 10SE +/- 1284.96, N = 11SE +/- 599.41, N = 10128129.56136942.13249109.09268721.051. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.BSMT OnSMT Off50K100K150K200K250KSE +/- 1110.64, N = 9SE +/- 885.17, N = 9SE +/- 732.52, N = 9SE +/- 8884.57, N = 15149355.54161475.24236490.76246272.791. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.CSMT OnSMT Off50K100K150K200K250KSE +/- 290.95, N = 4SE +/- 228.86, N = 4SE +/- 1293.24, N = 6SE +/- 1880.70, N = 6131909.91133415.42224243.28231041.571. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 1000 - Clients: 800 - Mode: Read OnlySMT OffSMT On200K400K600K800K1000KSE +/- 4149.87, N = 3SE +/- 23693.25, N = 12SE +/- 45813.37, N = 9SE +/- 21185.07, N = 127859688278788555698777221. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenSSL

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgverify/s Per Watt, More Is BetterOpenSSL 3.1Algorithm: RSA4096SMT OffSMT On140028004200560070006002.696122.576020.726318.78

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.1Algorithm: RSA4096SMT OffSMT On800K1600K2400K3200K4000KSE +/- 1031.37, N = 3SE +/- 405.88, N = 3SE +/- 1067.40, N = 3SE +/- 163.02, N = 31799293.01890935.33598946.33782091.81. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

NAMD

NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD 2.14ATPase Simulation - 327,506 AtomsSMT OnSMT Off0.04660.09320.13980.18640.233SE +/- 0.00095, N = 4SE +/- 0.00018, N = 4SE +/- 0.00135, N = 5SE +/- 0.00040, N = 30.207020.205950.139690.10646

toyBrot Fractal Generator

ToyBrot is a Mandelbrot fractal generator supporting C++ threads/tasks, OpenMP, Intel Threaded Building Blocks (TBB), and other targets. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BettertoyBrot Fractal Generator 2020-11-18Implementation: TBBSMT OffSMT On12002400360048006000SE +/- 43.30, N = 15SE +/- 21.75, N = 9SE +/- 31.80, N = 15SE +/- 23.04, N = 1555903591297620141. (CXX) g++ options: -O3 -lpthread -lm -lgcc -lgcc_s -lc

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BettertoyBrot Fractal Generator 2020-11-18Implementation: OpenMPSMT OffSMT On13002600390052006500SE +/- 0.20, N = 7SE +/- 17.08, N = 8SE +/- 53.03, N = 15SE +/- 23.29, N = 1262424081367133211. (CXX) g++ options: -O3 -lpthread -lm -lgcc -lgcc_s -lc

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerSMT OffSMT On2004006008001000SE +/- 1.20, N = 3SE +/- 0.88, N = 3SE +/- 0.58, N = 3SE +/- 2.85, N = 311278616314821. (CXX) g++ options: -O3 -lm -ldl

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerSMT OffSMT On2004006008001000SE +/- 1.53, N = 3SE +/- 0.88, N = 3SE +/- 0.33, N = 3SE +/- 1.45, N = 311468736454951. (CXX) g++ options: -O3 -lm -ldl

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerSMT OffSMT On30060090012001500SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.88, N = 3SE +/- 0.33, N = 3135810327635821. (CXX) g++ options: -O3 -lm -ldl

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerSMT OffSMT On4K8K12K16K20KSE +/- 18.26, N = 3SE +/- 5.78, N = 3SE +/- 14.52, N = 3SE +/- 7.80, N = 318004137591004676981. (CXX) g++ options: -O3 -lm -ldl

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerSMT OffSMT On8K16K24K32K40KSE +/- 29.21, N = 3SE +/- 10.48, N = 3SE +/- 38.84, N = 3SE +/- 64.83, N = 3359262753820133156191. (CXX) g++ options: -O3 -lm -ldl

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerSMT OffSMT On4K8K12K16K20KSE +/- 11.93, N = 3SE +/- 6.12, N = 3SE +/- 5.29, N = 3SE +/- 19.63, N = 318269139631023278171. (CXX) g++ options: -O3 -lm -ldl

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerSMT OffSMT On8K16K24K32K40KSE +/- 53.62, N = 3SE +/- 21.53, N = 3SE +/- 96.56, N = 3SE +/- 41.40, N = 3365392788520545157311. (CXX) g++ options: -O3 -lm -ldl

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerSMT OffSMT On5K10K15K20K25KSE +/- 15.65, N = 3SE +/- 11.89, N = 3SE +/- 8.65, N = 3SE +/- 27.17, N = 321666164841212792531. (CXX) g++ options: -O3 -lm -ldl

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerSMT OffSMT On9K18K27K36K45KSE +/- 76.61, N = 3SE +/- 17.58, N = 3SE +/- 17.91, N = 3SE +/- 34.44, N = 3433713297224238184551. (CXX) g++ options: -O3 -lm -ldl

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 1000 - Clients: 800 - Mode: Read Only - Average LatencySMT OffSMT On0.22910.45820.68730.91641.1455SE +/- 0.006, N = 3SE +/- 0.025, N = 12SE +/- 0.040, N = 9SE +/- 0.020, N = 121.0180.9740.9520.9171. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUSMT OnSMT Off2004006008001000SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.28, N = 31049.31513.23526.98526.461. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUSMT OnSMT Off5001000150020002500SE +/- 16.41, N = 12SE +/- 8.36, N = 9SE +/- 4.07, N = 3SE +/- 10.43, N = 32377.791105.961559.951545.231. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUSMT OnSMT Off5001000150020002500SE +/- 12.47, N = 15SE +/- 10.77, N = 5SE +/- 4.61, N = 3SE +/- 8.82, N = 32378.071102.821579.141552.151. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUSMT OnSMT Off1020304050SE +/- 0.55, N = 14SE +/- 0.10, N = 13SE +/- 0.15, N = 15SE +/- 0.12, N = 1343.7311.4911.0310.261. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUSMT OnSMT Off120240360480600SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3541.29268.82271.24270.931. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUSMT OnSMT Off3691215SE +/- 0.20, N = 15SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 312.074.744.864.831. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUSMT OnSMT Off3691215SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 310.535.475.645.611. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUSMT OnSMT Off20406080100SE +/- 1.12, N = 15SE +/- 0.45, N = 15SE +/- 0.35, N = 3SE +/- 0.21, N = 3110.0058.7155.1254.421. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUSMT OffSMT On3691215SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 311.1011.0010.9110.841. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUSMT OnSMT Off3691215SE +/- 0.08, N = 15SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 310.406.246.476.461. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUSMT OnSMT Off0.18680.37360.56040.74720.934SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.830.700.670.621. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUSMT OffSMT On0.29250.5850.87751.171.4625SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.301.211.131.081. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamSMT OnSMT Off2004006008001000SE +/- 0.27, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3902.86676.81859.87644.98

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-StreamSMT OnSMT Off1122334455SE +/- 0.13, N = 3SE +/- 0.57, N = 15SE +/- 0.04, N = 3SE +/- 0.10, N = 348.6245.8846.4335.55

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamSMT OnSMT Off60120180240300SE +/- 6.66, N = 15SE +/- 6.30, N = 15SE +/- 2.29, N = 15SE +/- 3.96, N = 15267.71259.28229.16212.68

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamSMT OnSMT Off4080120160200SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 3SE +/- 1.18, N = 15159.89118.13152.99125.45

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamSMT OnSMT Off1530456075SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.20, N = 368.3651.8165.9749.51

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamSMT OnSMT Off20406080100SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.37, N = 3107.1881.20102.2377.81

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamSMT OnSMT Off110220330440550SE +/- 0.26, N = 3SE +/- 3.79, N = 3SE +/- 0.68, N = 3SE +/- 8.17, N = 15521.31426.74499.59468.78

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamSMT OnSMT Off50100150200250SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 0.54, N = 3SE +/- 0.81, N = 3211.48162.02201.63156.06

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamSMT OnSMT Off2004006008001000SE +/- 0.45, N = 3SE +/- 0.21, N = 3SE +/- 0.49, N = 3SE +/- 0.12, N = 3902.78676.43859.88645.00

CloverLeaf

CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version and benchmarked with the clover_bm.in input file (Problem 5). Learn more via the OpenBenchmarking.org test page.

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeafLagrangian-Eulerian HydrodynamicsSMT OnSMT Off510152025SE +/- 0.27, N = 4SE +/- 0.04, N = 4SE +/- 0.11, N = 4SE +/- 0.09, N = 521.6515.1512.009.271. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

CP2K Molecular Dynamics

CP2K is an open-source molecular dynamics software package focused on quantum chemistry and solid-state physics. More details on the CP2K benchmark test cases and details can be found @ https://www.cp2k.org/performance Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterCP2K Molecular Dynamics 2023.1Input: H2O-DFT-LSSMT OnSMT Off110022003300440055005012.264957.692363.582143.511. (F9X) gfortran options: -fopenmp -mtune=native -O3 -funroll-loops -fbacktrace -ffree-form -fimplicit-none -std=f2008 -lcp2kstart -lcp2kmc -lcp2kswarm -lcp2kmotion -lcp2kthermostat -lcp2kemd -lcp2ktmc -lcp2kmain -lcp2kdbt -lcp2ktas -lcp2kdbm -lcp2kgrid -lcp2kgridcpu -lcp2kgridref -lcp2kgridcommon -ldbcsrarnoldi -ldbcsrx -lcp2kshg_int -lcp2keri_mme -lcp2kminimax -lcp2khfxbase -lcp2ksubsys -lcp2kxc -lcp2kao -lcp2kpw_env -lcp2kinput -lcp2kpw -lcp2kgpu -lcp2kfft -lcp2kfpga -lcp2kfm -lcp2kcommon -lcp2koffload -lcp2kmpiwrap -lcp2kbase -ldbcsr -lsirius -lspla -lspfft -lsymspg -lvdwxc -lhdf5 -lhdf5_hl -lz -lgsl -lelpa_openmp -lcosma -lcosta -lscalapack -lxsmmf -lxsmm -ldl -lpthread -lxcf03 -lxc -lint2 -lfftw3_mpi -lfftw3 -lfftw3_omp -lmpi_cxx -lmpi -lopenblas -lvori -lstdc++ -lmpi_usempif08 -lmpi_mpifh -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm

SPECFEM3D

simulates acoustic (fluid), elastic (solid), coupled acoustic/elastic, poroelastic or seismic wave propagation in any type of conforming mesh of hexahedra. This test profile currently relies on CPU-based execution for SPECFEM3D and using a variety of their built-in examples/models for benchmarking. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Mount St. HelensSMT OnSMT Off246810SE +/- 0.034771470, N = 5SE +/- 0.069356320, N = 12SE +/- 0.014293172, N = 5SE +/- 0.013893024, N = 56.2163798495.0300315803.9066750952.6301225991. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Layered HalfspaceSMT OnSMT Off48121620SE +/- 0.034780206, N = 3SE +/- 0.159428812, N = 3SE +/- 0.066481426, N = 15SE +/- 0.056354216, N = 415.96493168815.0281219299.9974475707.4707729301. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Tomographic ModelSMT OnSMT Off246810SE +/- 0.080164897, N = 5SE +/- 0.048140615, N = 15SE +/- 0.086611165, N = 15SE +/- 0.014728964, N = 67.4806747064.9372655063.7827417982.7092054281. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Homogeneous HalfspaceSMT OnSMT Off3691215SE +/- 0.048294894, N = 4SE +/- 0.044108994, N = 15SE +/- 0.120152278, N = 15SE +/- 0.065109589, N = 129.4043485006.0927502994.7278301483.4518301691. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Water-layered HalfspaceSMT OnSMT Off48121620SE +/- 0.142353904, N = 3SE +/- 0.021567327, N = 3SE +/- 0.063515594, N = 4SE +/- 0.062799204, N = 1517.19449277913.4194545019.7783814376.2180692571. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

Timed Gem5 Compilation

This test times how long it takes to compile Gem5. Gem5 is a simulator for computer system architecture research. Gem5 is widely used for computer architecture research within the industry, academia, and more. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 21.2Time To CompileSMT OnSMT Off4080120160200SE +/- 0.32, N = 3SE +/- 0.50, N = 3SE +/- 1.29, N = 3SE +/- 1.24, N = 3161.65148.48152.59148.38

Timed Godot Game Engine Compilation

This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0Time To CompileSMT OnSMT Off20406080100SE +/- 0.14, N = 3SE +/- 0.17, N = 3SE +/- 1.01, N = 3SE +/- 0.30, N = 3105.80102.59100.79100.24

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigSMT OnSMT Off612182430SE +/- 0.23, N = 7SE +/- 0.21, N = 7SE +/- 0.14, N = 13SE +/- 0.12, N = 1326.2322.9820.3418.47

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigSMT OnSMT Off50100150200250SE +/- 1.35, N = 3SE +/- 0.48, N = 3SE +/- 0.51, N = 3SE +/- 0.55, N = 3227.52177.76145.93118.10

Timed LLVM Compilation

This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaSMT OnSMT Off306090120150SE +/- 0.29, N = 3SE +/- 0.18, N = 3SE +/- 0.91, N = 3SE +/- 0.70, N = 3125.36119.58107.7299.22

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Unix MakefilesSMT OffSMT On50100150200250SE +/- 0.70, N = 3SE +/- 0.15, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3213.91211.08199.37198.75

Timed Node.js Compilation

This test profile times how long it takes to build/compile Node.js itself from source. Node.js is a JavaScript run-time built from the Chrome V8 JavaScript engine while itself is written in C/C++. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1Time To CompileSMT OffSMT On306090120150SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3116.12113.7093.9593.27

Primesieve

Primesieve generates prime numbers using a highly optimized sieve of Eratosthenes implementation. Primesieve primarily benchmarks the CPU's L1/L2 cache performance. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 8.0Length: 1e12SMT OnSMT Off0.43740.87481.31221.74962.187SE +/- 0.006, N = 11SE +/- 0.003, N = 11SE +/- 0.010, N = 14SE +/- 0.003, N = 121.9441.7961.5081.1601. (CXX) g++ options: -O3

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 8.0Length: 1e13SMT OnSMT Off510152025SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 5SE +/- 0.01, N = 521.2921.1311.1511.121. (CXX) g++ options: -O3

Helsing

Helsing is an open-source POSIX vampire number generator. This test profile measures the time it takes to generate vampire numbers between varying numbers of digits. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterHelsing 1.0-betaDigit Range: 14 digitSMT OffSMT On1326395265SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.31, N = 3SE +/- 0.37, N = 357.9650.4750.0527.281. (CC) gcc options: -O2 -pthread

Blender

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: BMW27 - Compute: CPU-OnlySMT OffSMT On48121620SE +/- 0.05, N = 4SE +/- 0.02, N = 4SE +/- 0.05, N = 5SE +/- 0.02, N = 615.1512.778.457.12

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Classroom - Compute: CPU-OnlySMT OffSMT On918273645SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 338.4431.1220.2416.28

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Fishy Cat - Compute: CPU-OnlySMT OffSMT On510152025SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 4SE +/- 0.02, N = 520.4716.4911.729.87

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Barbershop - Compute: CPU-OnlySMT OffSMT On306090120150SE +/- 0.17, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 3SE +/- 0.19, N = 3147.22116.5485.5469.03

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Pabellon Barcelona - Compute: CPU-OnlySMT OffSMT On1122334455SE +/- 0.14, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 350.0139.2727.4721.75

Appleseed

Appleseed is an open-source production renderer focused on physically-based global illumination rendering engine primarily designed for animation and visual effects. Learn more via the OpenBenchmarking.org test page.

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgSeconds, Fewer Is BetterAppleseed 2.0 BetaScene: EmilySMT OnSMT Off4080120160200164.57159.91123.30122.59

EPYC 9754 1PEPYC 9754 2POpenBenchmarking.orgSeconds, Fewer Is BetterAppleseed 2.0 BetaScene: Disney MaterialSMT OnSMT Off102030405044.3038.4940.57

Scene: Disney Material

EPYC 9754 2P: SMT On: The test run did not produce a result.

EPYC 9754 2PEPYC 9754 1POpenBenchmarking.orgSeconds, Fewer Is BetterAppleseed 2.0 BetaScene: Material TesterSMT OffSMT On60120180240300265.89167.90166.68

Scene: Material Tester

EPYC 9754 2P: SMT On: The test run did not produce a result.

187 Results Shown

CPU Power Consumption Monitor
Graph500:
  26:
    bfs max_TEPS
    bfs median_TEPS
miniBUDE
miniBUDE
miniBUDE
OpenSSL
OpenSSL:
  SHA256
  SHA512
OpenSSL:
  ChaCha20
  AES-128-GCM
  AES-256-GCM
  ChaCha20-Poly1305
OpenSSL:
  ChaCha20
  AES-128-GCM
  AES-256-GCM
  ChaCha20-Poly1305
miniFE
miniFE
nekRS:
  Kershaw
  TurboPipe Periodic
OpenVINO:
  Face Detection FP16 - CPU
  Person Detection FP16 - CPU
  Person Detection FP32 - CPU
  Vehicle Detection FP16 - CPU
  Face Detection FP16-INT8 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Weld Porosity Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Age Gender Recognition Retail 0013 FP16 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
Embree:
  Pathtracer ISPC - Crown
  Pathtracer ISPC - Asian Dragon
miniBUDE:
  OpenMP - BM1
  OpenMP - BM2
HeFFTe - Highly Efficient FFT for Exascale
HeFFTe - Highly Efficient FFT for Exascale:
  c2c - FFTW - float - 512
  r2c - FFTW - float - 512
HeFFTe - Highly Efficient FFT for Exascale:
  r2c - FFTW - double - 512
  c2c - FFTW - float - 512
  r2c - FFTW - float - 512
libxsmm:
  128
  256
libxsmm:
  128
  256
Xmrig:
  Monero - 1M
  Wownero - 1M
Xmrig:
  Monero - 1M
  Wownero - 1M
Intel Open Image Denoise:
  RT.hdr_alb_nrm.3840x2160 - CPU-Only
  RT.ldr_alb_nrm.3840x2160 - CPU-Only
Intel Open Image Denoise
Intel Open Image Denoise
TensorFlow:
  CPU - 256 - AlexNet
  CPU - 512 - AlexNet
TensorFlow:
  CPU - 256 - ResNet-50
  CPU - 512 - GoogLeNet
  CPU - 512 - ResNet-50
TensorFlow:
  CPU - 256 - GoogLeNet
  CPU - 256 - ResNet-50
  CPU - 512 - GoogLeNet
  CPU - 512 - ResNet-50
OpenVKL
OpenVKL
OSPRay:
  particle_volume/ao/real_time
  particle_volume/scivis/real_time
  gravity_spheres_volume/dim_512/scivis/real_time
  gravity_spheres_volume/dim_512/ao/real_time
Neural Magic DeepSparse:
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
  NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream
  NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
Aircrack-ng
LuxCoreRender
LuxCoreRender:
  DLSC - CPU
  Orange Juice - CPU
  LuxCore Benchmark - CPU
  Rainbow Colors and Prism - CPU
srsRAN Project
srsRAN Project
7-Zip Compression
7-Zip Compression:
  Compression Rating
  Decompression Rating
ASTC Encoder:
  Fast
  Thorough
  Exhaustive
Stockfish
Stockfish
MariaDB
MariaDB:
  2048
  4096
John The Ripper:
  bcrypt
  WPA PSK
  Blowfish
  MD5
Liquid-DSP:
  256 - 256 - 512
  512 - 256 - 512
OpenSSL
Graph500
Graph500:
    sssp max_TEPS
    sssp median_TEPS
NAS Parallel Benchmarks:
  CG.C
  EP.D
  FT.C
  IS.D
  LU.C
  MG.C
  SP.B
  SP.C
NAS Parallel Benchmarks:
  BT.C
  CG.C
  EP.D
  FT.C
  IS.D
  LU.C
  MG.C
  SP.B
  SP.C
PostgreSQL
OpenSSL
OpenSSL
NAMD
toyBrot Fractal Generator:
  TBB
  OpenMP
OSPRay Studio:
  1 - 4K - 1 - Path Tracer
  2 - 4K - 1 - Path Tracer
  3 - 4K - 1 - Path Tracer
  1 - 4K - 16 - Path Tracer
  1 - 4K - 32 - Path Tracer
  2 - 4K - 16 - Path Tracer
  2 - 4K - 32 - Path Tracer
  3 - 4K - 16 - Path Tracer
  3 - 4K - 32 - Path Tracer
PostgreSQL
OpenVINO:
  Face Detection FP16 - CPU
  Person Detection FP16 - CPU
  Person Detection FP32 - CPU
  Vehicle Detection FP16 - CPU
  Face Detection FP16-INT8 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Weld Porosity Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Age Gender Recognition Retail 0013 FP16 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
Neural Magic DeepSparse:
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
  NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream
  NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
CloverLeaf
CP2K Molecular Dynamics
SPECFEM3D:
  Mount St. Helens
  Layered Halfspace
  Tomographic Model
  Homogeneous Halfspace
  Water-layered Halfspace
Timed Gem5 Compilation
Timed Godot Game Engine Compilation
Timed Linux Kernel Compilation:
  defconfig
  allmodconfig
Timed LLVM Compilation:
  Ninja
  Unix Makefiles
Timed Node.js Compilation
Primesieve:
  1e12
  1e13
Helsing
Blender:
  BMW27 - CPU-Only
  Classroom - CPU-Only
  Fishy Cat - CPU-Only
  Barbershop - CPU-Only
  Pabellon Barcelona - CPU-Only
Appleseed:
  Emily
  Disney Material
  Material Tester