X3D Zen 4

Benchmarks for a future article..

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2303056-NE-X3DUPPER661
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

BLAS (Basic Linear Algebra Sub-Routine) Tests 2 Tests
C++ Boost Tests 2 Tests
C/C++ Compiler Tests 2 Tests
CPU Massive 5 Tests
Creator Workloads 4 Tests
Fortran Tests 2 Tests
HPC - High Performance Computing 16 Tests
Machine Learning 6 Tests
Molecular Dynamics 6 Tests
MPI Benchmarks 5 Tests
Multi-Core 8 Tests
NVIDIA GPU Compute 3 Tests
Intel oneAPI 3 Tests
OpenMPI Tests 8 Tests
Programmer / Developer System Benchmarks 2 Tests
Python Tests 5 Tests
Scientific Computing 8 Tests
Server CPU Tests 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Ryzen 9 7900X3D
March 03 2023
  14 Hours, 36 Minutes
Ryzen 9 7900X
March 04 2023
  15 Hours, 29 Minutes
Ryzen 9 79500X3D
March 04 2023
  15 Hours, 2 Minutes
Ryzen 9 7950X
March 05 2023
  14 Hours, 35 Minutes
Invert Hiding All Results Option
  14 Hours, 56 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


X3D Zen 4OpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 7900X3D 12-Core @ 4.40GHz (12 Cores / 24 Threads)AMD Ryzen 9 7900X 12-Core @ 4.70GHz (12 Cores / 24 Threads)AMD Ryzen 9 7950X3D 16-Core @ 4.20GHz (16 Cores / 32 Threads)AMD Ryzen 9 7950X 16-Core @ 4.50GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR X670E HERO (9922 BIOS)AMD Device 14d832GBWestern Digital WD_BLACK SN850X 1000GB + 2000GBAMD Radeon RX 7900 XTX 24GB (2304/1249MHz)AMD Device ab30ASUS MG28UIntel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411Ubuntu 23.046.2.2-060202-generic (x86_64)GNOME Shell 43.2X Server 1.21.1.6 + Wayland4.6 Mesa 23.1.0-devel (git-efcb639 2023-02-13 lunar-oibaf-ppa) (LLVM 15.0.7 DRM 3.49)GCC 12.2.0ext43840x2160ProcessorsMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionX3D Zen 4 BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-AKimc9/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-AKimc9/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa601203- Python 3.11.1- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950XResult OverviewPhoronix Test Suite100%118%135%153%CloverLeafPennantACES DGEMMEmbreeoneDNNASKAPXmrigKTX-Software toktxOpenVINOGPAWGROMACSTensorFlowOpenFOAMXcompact3d Incompact3dClickHouseONNX RuntimeLULESHsrsRANZstd CompressionNCNNLeelaChessZeroPyHPC Benchmarks

X3D Zen 4onnx: yolov4 - CPU - Standardonnx: yolov4 - CPU - Standardonnx: yolov4 - CPU - Parallelonnx: yolov4 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Parallelonnx: super-resolution-10 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: super-resolution-10 - CPU - Parallelonnx: super-resolution-10 - CPU - Parallelonnx: bertsquad-12 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: bertsquad-12 - CPU - Parallelonnx: bertsquad-12 - CPU - Parallelonnx: GPT-2 - CPU - Standardonnx: GPT-2 - CPU - Standardonnx: GPT-2 - CPU - Parallelonnx: GPT-2 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Parallelonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Parallelonnx: ResNet50 v1-12-int8 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Parallelonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeaskap: tConvolve MPI - Degriddingaskap: tConvolve MPI - Griddingaskap: tConvolve OpenMP - Griddingaskap: tConvolve OpenMP - Degriddingaskap: tConvolve MT - Griddingaskap: tConvolve MT - Degriddingaskap: Hogbom Clean OpenMPcompress-zstd: 3 - Compression Speedcompress-zstd: 3 - Decompression Speedcompress-zstd: 3, Long Mode - Compression Speedcompress-zstd: 3, Long Mode - Decompression Speedcompress-zstd: 8 - Compression Speedcompress-zstd: 8 - Decompression Speedcompress-zstd: 8, Long Mode - Compression Speedcompress-zstd: 8, Long Mode - Decompression Speedcompress-zstd: 12 - Compression Speedcompress-zstd: 12 - Decompression Speedcompress-zstd: 19 - Compression Speedcompress-zstd: 19 - Decompression Speedcompress-zstd: 19, Long Mode - Compression Speedcompress-zstd: 19, Long Mode - Decompression Speedonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUonednn: IP Shapes 1D - bf16bf16bf16 - CPUonednn: IP Shapes 3D - bf16bf16bf16 - CPUonednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUtensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 16 - AlexNettensorflow: CPU - 16 - GoogLeNettensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 32 - AlexNettensorflow: CPU - 32 - GoogLeNettensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 64 - AlexNettensorflow: CPU - 64 - GoogLeNettensorflow: CPU - 256 - ResNet-50tensorflow: CPU - 256 - AlexNettensorflow: CPU - 256 - GoogLeNetpennant: leblancbigpennant: sedovbigincompact3d: input.i3d 129 Cells Per Directionincompact3d: input.i3d 193 Cells Per Directiongromacs: MPI CPU - water_GMX50_baretoktx: Zstd Compression 19toktx: UASTC 3toktx: UASTC 3 + Zstd Compression 19toktx: UASTC 4 + Zstd Compression 19gpaw: Carbon Nanotubeclickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Runlulesh: embree: Pathtracer - Asian Dragonembree: Pathtracer - Asian Dragon Objembree: Pathtracer - Crownembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer ISPC - Crownsrsran: 4G PHY_DL_Test 100 PRB SISO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 256-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 256-QAMsrsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAMsrsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAMsrsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMsrsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMsrsran: OFDM_Testmt-dgemm: Sustained Floating-Point Ratepyhpc: CPU - Numpy - 4194304 - Equation of Statepyhpc: CPU - Numpy - 4194304 - Isoneutral Mixingcloverleaf: Lagrangian-Eulerian Hydrodynamicsncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: CPU - vision_transformerncnn: CPU - FastestDetxmrig: Monero - 1Mxmrig: Wownero - 1Mlczero: BLASlczero: EigenRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X10.07832102.27117.97025125.4672.87377347.9731.50536664.593138.3277.5170299.054810.094718.820553.137212.892977.5671195.7605.10690157.2926.3536239.736825.563828.455535.1427424.1692.36463335.7052.978221155.140.865505802.9791.2448168.920714.509348.264520.717710.15589.3919.64304.8630316.750.3917663.840.675.601065.825.611064.331959.526.121000.475.991257.384.77801.877.481188.175.04107.7655.6526.209067138.73605193.355891948.0569923.9312051.36052.1610078.062100.992906.78545.8613710.72162.41319.62217.41026.52352.9940.92365.3298.32453.825.22082.114.31876.31.381445.181722.029031.075101.161650.3034641560.86803.71438.11158.97124.6539.01223.03126.2739.06278.30123.2638.89328.37118.9619.3104230.9376612.690321061.96296032.27811.5286.37410.037169.165143.150269.00303.48308.818953.046126.552523.832424.225531.434926.960327.0459619.7250.6585.9215.8614.9235.3665.2250.3209.9136.82373333338.2155520.7261.08131.289.333.573.143.733.254.571.499.0325.947.084.6012.4714.7311.5711.0692.654.3613564.714966.11882176710.11033101.17198.60115116.2651.75053571.2861.57963633.095173.7845.85153112.4158.8950519.727150.690313.865672.1374172.8095.79435146.3386.8317742.378823.944831.258231.9936430.9592.33461374.0112.67309998.8601.014088830.0691.2042760.106516.881449.497320.201710.95546.2021.44279.4833984.400.3519661.300.605.971000.885.901012.482176.115.511089.165.501358.904.41666.359.001265.144.74112.0253.5425.016407171.61846199.344982161.555810092.111693.25024.895756.772002.692755.49440.1834014.321841393.72249.4857.42393.0808.52410.4248.82452.023.42101.813.01997.41.812914.710131.798300.9794991.517490.2648261434.06731.37638.9162.66128.7440.00232.30127.6740.20294.49125.6240.36353.60123.8725.1461236.8809814.611501068.21861272.27011.6375.9449.698157.108150.868258.64285.41290.148484.566126.507923.815824.678830.887726.494127.6392622.7251.1669.4264.6627.1240.6677.8254.9211.6145.32370000008.2481200.7141.05749.638.843.503.133.463.174.311.388.8225.747.774.9812.3814.2411.7810.0584.574.2213863.015870.6187917729.99604101.97409.44018105.9293.53941282.6441.91347522.692161.2306.29145124.5308.0296020.190749.535614.808867.5478185.3845.39416164.5326.0743837.394527.308133.592729.7700486.6122.06799384.7162.598831084.9070.938149947.6351.0543670.155314.448649.660520.140013.53589.4526.26304.0240658.960.3923679.430.677.321085.087.271094.432616.086.111330.536.011706.684.681003.487.971658.154.82135.5058.9923.906845125.98542178.107691863.953510858.8124956780.7911369.62293.312995.19548.2503959.62203.61338.32254.01053.72391.61004.22422.1292.42452.825.22030.515.01872.41.086403.958861.507150.7295101.083730.2297731209.12623.39443.19176.22147.0144.27258.77149.3944.20339.80145.2943.88418.97137.7716.8608227.0352412.539253758.77319242.69511.4605.1268.747126.296126.899279.87316.84321.768987.939134.703531.009232.072739.714434.164236.2379616.3252.0660.1258.5638.3243.8686.0256.8211.5144.224596666711.2584060.7311.07429.188.873.763.313.863.404.601.638.5224.346.604.2811.8614.2811.7211.9682.034.6815627.419562.91945178710.08625100.74719.95491100.49482.22836448.7641.96381509.325165.0076.14984139.4257.1718421.275547.001916.234461.6107169.5025.89782146.4976.8226144.794122.568236.625627.3030485.2412.06309411.0072.432391224.000.816994922.3371.0833370.091014.265651.742419.327414.38554.4228.37281.5944741.970.3526015.990.617.651040.727.531057.422892.635.531442.535.541843.34.34784.2510.191670.934.78138.1457.8522.793808161.67492190.936732126.102810788.811211.26099.226156.822173.952833.49448.4594227.62170.11413.92223.8837.42379.1845.72390.4253.62439.923.32104.412.51990.02.108313.607481.408490.6643601.522320.2128011130.44578.91143.08176.72146.9944.39264.33147.0844.58351.07143.8844.87439.54140.7624.3587734.8457714.626836866.21399432.60711.2204.8858.405119.500138.014250.50275.45276.948479.877633.632429.815332.534337.221531.778336.5549609.0247.4665.8261.8617.8236.9667.0250.7209.5142.923660000010.9839970.7271.05747.008.703.623.153.623.234.401.548.5824.617.464.8612.1714.2112.1411.4875.764.4613188.920609.419151773OpenBenchmarking.org

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: yolov4 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X3691215SE +/- 0.45158, N = 15SE +/- 0.40412, N = 15SE +/- 0.38311, N = 15SE +/- 0.36261, N = 1510.0783210.110339.9960410.086251. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: yolov4 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X3691215Min: 7.89 / Avg: 10.08 / Max: 11.74Min: 8.28 / Avg: 10.11 / Max: 11.96Min: 8.75 / Avg: 10 / Max: 12.71Min: 9.19 / Avg: 10.09 / Max: 12.391. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: yolov4 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X3691215SE +/- 0.02410, N = 3SE +/- 0.03144, N = 3SE +/- 0.01779, N = 3SE +/- 0.10261, N = 57.970258.601159.440189.954911. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: yolov4 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X3691215Min: 7.93 / Avg: 7.97 / Max: 8.01Min: 8.55 / Avg: 8.6 / Max: 8.66Min: 9.42 / Avg: 9.44 / Max: 9.47Min: 9.55 / Avg: 9.95 / Max: 10.091. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: fcn-resnet101-11 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X0.79641.59282.38923.18563.982SE +/- 0.00156, N = 3SE +/- 0.00921, N = 3SE +/- 0.04984, N = 3SE +/- 0.00558, N = 32.873771.750533.539412.228361. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: fcn-resnet101-11 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810Min: 2.87 / Avg: 2.87 / Max: 2.88Min: 1.73 / Avg: 1.75 / Max: 1.76Min: 3.44 / Avg: 3.54 / Max: 3.61Min: 2.22 / Avg: 2.23 / Max: 2.241. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X0.44190.88381.32571.76762.2095SE +/- 0.01582, N = 5SE +/- 0.00841, N = 3SE +/- 0.01691, N = 3SE +/- 0.02061, N = 31.505361.579631.913471.963811. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810Min: 1.44 / Avg: 1.51 / Max: 1.53Min: 1.57 / Avg: 1.58 / Max: 1.6Min: 1.89 / Avg: 1.91 / Max: 1.95Min: 1.93 / Avg: 1.96 / Max: 21. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: super-resolution-10 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X4080120160200SE +/- 7.10, N = 15SE +/- 5.34, N = 15SE +/- 5.64, N = 15SE +/- 6.30, N = 13138.33173.78161.23165.011. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: super-resolution-10 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150Min: 101.27 / Avg: 138.33 / Max: 166.47Min: 123.51 / Avg: 173.78 / Max: 191.14Min: 135.19 / Avg: 161.23 / Max: 212.66Min: 139.89 / Avg: 165.01 / Max: 230.591. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: super-resolution-10 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150SE +/- 0.10, N = 3SE +/- 0.24, N = 3SE +/- 0.24, N = 3SE +/- 0.49, N = 399.05112.42124.53139.431. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: super-resolution-10 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150Min: 98.86 / Avg: 99.05 / Max: 99.15Min: 111.96 / Avg: 112.42 / Max: 112.78Min: 124.23 / Avg: 124.53 / Max: 125.01Min: 138.9 / Avg: 139.43 / Max: 140.411. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: bertsquad-12 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X510152025SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.19, N = 3SE +/- 0.07, N = 318.8219.7320.1921.281. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: bertsquad-12 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X510152025Min: 18.69 / Avg: 18.82 / Max: 19.06Min: 19.7 / Avg: 19.73 / Max: 19.78Min: 19.82 / Avg: 20.19 / Max: 20.45Min: 21.15 / Avg: 21.28 / Max: 21.41. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: bertsquad-12 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X48121620SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 4SE +/- 0.18, N = 312.8913.8714.8116.231. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: bertsquad-12 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X48121620Min: 12.75 / Avg: 12.89 / Max: 13.03Min: 13.56 / Avg: 13.87 / Max: 14.04Min: 14.41 / Avg: 14.81 / Max: 15.13Min: 15.99 / Avg: 16.23 / Max: 16.581. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: GPT-2 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X4080120160200SE +/- 1.34, N = 3SE +/- 1.80, N = 15SE +/- 2.46, N = 3SE +/- 0.39, N = 3195.76172.81185.38169.501. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: GPT-2 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X4080120160200Min: 193.12 / Avg: 195.76 / Max: 197.48Min: 153.18 / Avg: 172.81 / Max: 178.21Min: 180.58 / Avg: 185.38 / Max: 188.74Min: 169.11 / Avg: 169.5 / Max: 170.281. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: GPT-2 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X4080120160200SE +/- 0.56, N = 3SE +/- 1.56, N = 3SE +/- 0.66, N = 3SE +/- 0.20, N = 3157.29146.34164.53146.501. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: GPT-2 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150Min: 156.26 / Avg: 157.29 / Max: 158.19Min: 143.22 / Avg: 146.34 / Max: 147.95Min: 163.2 / Avg: 164.53 / Max: 165.24Min: 146.2 / Avg: 146.5 / Max: 146.881. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X1020304050SE +/- 1.38, N = 12SE +/- 1.23, N = 15SE +/- 1.50, N = 15SE +/- 1.19, N = 1539.7442.3837.3944.791. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X918273645Min: 30.09 / Avg: 39.74 / Max: 43Min: 31.23 / Avg: 42.38 / Max: 45.55Min: 32.56 / Avg: 37.39 / Max: 46.04Min: 35.9 / Avg: 44.79 / Max: 48.121. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X816243240SE +/- 0.11, N = 3SE +/- 0.21, N = 3SE +/- 0.21, N = 3SE +/- 0.11, N = 328.4631.2633.5936.631. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X816243240Min: 28.24 / Avg: 28.46 / Max: 28.57Min: 30.91 / Avg: 31.26 / Max: 31.63Min: 33.3 / Avg: 33.59 / Max: 34.01Min: 36.47 / Avg: 36.63 / Max: 36.841. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X110220330440550SE +/- 6.30, N = 15SE +/- 10.29, N = 12SE +/- 9.53, N = 15SE +/- 4.65, N = 15424.17430.96486.61485.241. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X90180270360450Min: 389.22 / Avg: 424.17 / Max: 448.75Min: 384.24 / Avg: 430.96 / Max: 471.23Min: 394.27 / Avg: 486.61 / Max: 503.45Min: 443.79 / Avg: 485.24 / Max: 502.951. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X90180270360450SE +/- 1.54, N = 3SE +/- 1.41, N = 3SE +/- 2.07, N = 3SE +/- 0.99, N = 3335.71374.01384.72411.011. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X70140210280350Min: 332.74 / Avg: 335.71 / Max: 337.93Min: 371.36 / Avg: 374.01 / Max: 376.17Min: 380.64 / Avg: 384.72 / Max: 387.36Min: 409.27 / Avg: 411.01 / Max: 412.691. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X30060090012001500SE +/- 7.21, N = 3SE +/- 31.87, N = 15SE +/- 39.20, N = 15SE +/- 11.41, N = 61155.14998.861084.911224.001. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2004006008001000Min: 1140.81 / Avg: 1155.14 / Max: 1163.71Min: 893.95 / Avg: 998.86 / Max: 1203.66Min: 930.42 / Avg: 1084.91 / Max: 1277.41Min: 1170.64 / Avg: 1224 / Max: 1243.961. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2004006008001000SE +/- 11.49, N = 3SE +/- 9.08, N = 5SE +/- 7.64, N = 3SE +/- 6.96, N = 3802.98830.07947.64922.341. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X170340510680850Min: 783.57 / Avg: 802.98 / Max: 823.33Min: 811.8 / Avg: 830.07 / Max: 863.22Min: 939.92 / Avg: 947.64 / Max: 962.92Min: 911.66 / Avg: 922.34 / Max: 935.421. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X1632486480SE +/- 0.38, N = 3SE +/- 1.94, N = 15SE +/- 2.04, N = 15SE +/- 0.09, N = 368.9260.1170.1670.091. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X1428425670Min: 68.5 / Avg: 68.92 / Max: 69.67Min: 51.96 / Avg: 60.11 / Max: 69.07Min: 55.81 / Avg: 70.16 / Max: 75.58Min: 69.96 / Avg: 70.09 / Max: 70.271. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X1224364860SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.55, N = 3SE +/- 0.42, N = 348.2649.5049.6651.741. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.14Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X1020304050Min: 48.1 / Avg: 48.26 / Max: 48.45Min: 49.39 / Avg: 49.5 / Max: 49.57Min: 48.56 / Avg: 49.66 / Max: 50.33Min: 50.92 / Avg: 51.74 / Max: 52.281. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X48121620SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 310.1510.9513.5314.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X48121620Min: 10.15 / Avg: 10.15 / Max: 10.15Min: 10.92 / Avg: 10.95 / Max: 10.98Min: 13.47 / Avg: 13.53 / Max: 13.58Min: 14.35 / Avg: 14.38 / Max: 14.411. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X130260390520650SE +/- 0.29, N = 3SE +/- 0.69, N = 3SE +/- 0.95, N = 3SE +/- 0.39, N = 3589.39546.20589.45554.42MIN: 309.39 / MAX: 685.91MIN: 275.75 / MAX: 574.42MIN: 407.34 / MAX: 615.98MIN: 280.02 / MAX: 579.261. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X100200300400500Min: 588.92 / Avg: 589.39 / Max: 589.93Min: 545.02 / Avg: 546.2 / Max: 547.4Min: 588.21 / Avg: 589.45 / Max: 591.33Min: 553.64 / Avg: 554.42 / Max: 554.831. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X714212835SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 319.6421.4426.2628.371. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X612182430Min: 19.62 / Avg: 19.64 / Max: 19.65Min: 21.31 / Avg: 21.44 / Max: 21.52Min: 26.1 / Avg: 26.26 / Max: 26.42Min: 28.25 / Avg: 28.37 / Max: 28.551. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X70140210280350SE +/- 0.08, N = 3SE +/- 0.86, N = 3SE +/- 1.12, N = 3SE +/- 0.86, N = 3304.86279.48304.02281.59MIN: 160.61 / MAX: 318.49MIN: 148.87 / MAX: 292.1MIN: 154.56 / MAX: 315.21MIN: 146.44 / MAX: 293.541. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X50100150200250Min: 304.73 / Avg: 304.86 / Max: 304.99Min: 278.41 / Avg: 279.48 / Max: 281.19Min: 302.1 / Avg: 304.02 / Max: 305.99Min: 279.89 / Avg: 281.59 / Max: 282.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X10K20K30K40K50KSE +/- 15.66, N = 3SE +/- 51.92, N = 3SE +/- 72.52, N = 3SE +/- 86.54, N = 330316.7533984.4040658.9644741.971. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X8K16K24K32K40KMin: 30292.48 / Avg: 30316.75 / Max: 30346.04Min: 33886.23 / Avg: 33984.4 / Max: 34062.8Min: 40520.72 / Avg: 40658.96 / Max: 40766.07Min: 44598.43 / Avg: 44741.97 / Max: 44897.51. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X0.08780.17560.26340.35120.439SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.390.350.390.35MIN: 0.24 / MAX: 61.73MIN: 0.21 / MAX: 8.31MIN: 0.22 / MAX: 8.71MIN: 0.21 / MAX: 7.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X12345Min: 0.39 / Avg: 0.39 / Max: 0.39Min: 0.35 / Avg: 0.35 / Max: 0.35Min: 0.39 / Avg: 0.39 / Max: 0.39Min: 0.35 / Avg: 0.35 / Max: 0.351. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X6K12K18K24K30KSE +/- 3.40, N = 3SE +/- 119.95, N = 3SE +/- 77.85, N = 3SE +/- 29.30, N = 317663.8419661.3023679.4326015.991. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X5K10K15K20K25KMin: 17658.15 / Avg: 17663.84 / Max: 17669.91Min: 19429.19 / Avg: 19661.3 / Max: 19829.88Min: 23523.74 / Avg: 23679.43 / Max: 23759.12Min: 25958.93 / Avg: 26015.99 / Max: 26056.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X0.15080.30160.45240.60320.754SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.670.600.670.61MIN: 0.37 / MAX: 45.37MIN: 0.33 / MAX: 7.83MIN: 0.35 / MAX: 9.57MIN: 0.34 / MAX: 7.641. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810Min: 0.67 / Avg: 0.67 / Max: 0.67Min: 0.6 / Avg: 0.6 / Max: 0.61Min: 0.67 / Avg: 0.67 / Max: 0.68Min: 0.61 / Avg: 0.61 / Max: 0.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 35.605.977.327.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X3691215Min: 5.57 / Avg: 5.6 / Max: 5.63Min: 5.88 / Avg: 5.97 / Max: 6.05Min: 7.3 / Avg: 7.32 / Max: 7.34Min: 7.62 / Avg: 7.65 / Max: 7.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2004006008001000SE +/- 3.14, N = 3SE +/- 7.16, N = 3SE +/- 2.36, N = 3SE +/- 1.82, N = 31065.821000.881085.081040.72MIN: 618.47 / MAX: 1180.09MIN: 603.97 / MAX: 1146.51MIN: 997.16 / MAX: 1282.69MIN: 623.58 / MAX: 1238.551. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2004006008001000Min: 1061.41 / Avg: 1065.82 / Max: 1071.9Min: 988.72 / Avg: 1000.88 / Max: 1013.52Min: 1080.67 / Avg: 1085.08 / Max: 1088.75Min: 1037.96 / Avg: 1040.72 / Max: 1044.151. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 35.615.907.277.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X3691215Min: 5.58 / Avg: 5.61 / Max: 5.64Min: 5.86 / Avg: 5.9 / Max: 5.94Min: 7.21 / Avg: 7.27 / Max: 7.34Min: 7.41 / Avg: 7.53 / Max: 7.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2004006008001000SE +/- 2.18, N = 3SE +/- 3.50, N = 3SE +/- 6.09, N = 3SE +/- 8.14, N = 31064.331012.481094.431057.42MIN: 940.91 / MAX: 1184.64MIN: 584.86 / MAX: 1150.29MIN: 672.11 / MAX: 1267.85MIN: 582.42 / MAX: 1238.031. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2004006008001000Min: 1060.36 / Avg: 1064.33 / Max: 1067.89Min: 1005.88 / Avg: 1012.48 / Max: 1017.82Min: 1082.98 / Avg: 1094.43 / Max: 1103.74Min: 1045.76 / Avg: 1057.42 / Max: 1073.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X6001200180024003000SE +/- 0.41, N = 3SE +/- 13.39, N = 3SE +/- 2.92, N = 3SE +/- 2.33, N = 31959.522176.112616.082892.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X5001000150020002500Min: 1959.07 / Avg: 1959.52 / Max: 1960.33Min: 2150.26 / Avg: 2176.11 / Max: 2195.07Min: 2612.12 / Avg: 2616.08 / Max: 2621.79Min: 2888.61 / Avg: 2892.63 / Max: 2896.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 36.125.516.115.53MIN: 3.22 / MAX: 17.67MIN: 2.96 / MAX: 12.69MIN: 3.19 / MAX: 13.31MIN: 2.99 / MAX: 13.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810Min: 6.12 / Avg: 6.12 / Max: 6.12Min: 5.46 / Avg: 5.51 / Max: 5.57Min: 6.1 / Avg: 6.11 / Max: 6.12Min: 5.52 / Avg: 5.53 / Max: 5.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X30060090012001500SE +/- 0.24, N = 3SE +/- 0.21, N = 3SE +/- 0.83, N = 3SE +/- 1.85, N = 31000.471089.161330.531442.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X30060090012001500Min: 1000.01 / Avg: 1000.47 / Max: 1000.81Min: 1088.79 / Avg: 1089.16 / Max: 1089.5Min: 1329.17 / Avg: 1330.53 / Max: 1332.04Min: 1440.41 / Avg: 1442.53 / Max: 1446.221. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 35.995.506.015.54MIN: 3.12 / MAX: 18.55MIN: 2.79 / MAX: 16.27MIN: 3.17 / MAX: 13.52MIN: 2.85 / MAX: 12.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810Min: 5.99 / Avg: 5.99 / Max: 5.99Min: 5.5 / Avg: 5.5 / Max: 5.51Min: 6 / Avg: 6.01 / Max: 6.01Min: 5.53 / Avg: 5.54 / Max: 5.551. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X400800120016002000SE +/- 0.73, N = 3SE +/- 6.32, N = 3SE +/- 3.94, N = 3SE +/- 2.59, N = 31257.381358.901706.681843.301. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X30060090012001500Min: 1256.6 / Avg: 1257.38 / Max: 1258.84Min: 1350.31 / Avg: 1358.9 / Max: 1371.22Min: 1698.88 / Avg: 1706.68 / Max: 1711.57Min: 1838.2 / Avg: 1843.3 / Max: 1846.61. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X1.07332.14663.21994.29325.3665SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 34.774.414.684.34MIN: 2.89 / MAX: 23.9MIN: 2.6 / MAX: 12.74MIN: 2.79 / MAX: 16.02MIN: 2.71 / MAX: 12.091. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810Min: 4.76 / Avg: 4.77 / Max: 4.77Min: 4.37 / Avg: 4.41 / Max: 4.44Min: 4.67 / Avg: 4.68 / Max: 4.7Min: 4.33 / Avg: 4.34 / Max: 4.351. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2004006008001000SE +/- 2.18, N = 3SE +/- 9.18, N = 3SE +/- 3.11, N = 3SE +/- 3.17, N = 3801.87666.351003.48784.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2004006008001000Min: 797.51 / Avg: 801.87 / Max: 804.26Min: 650.69 / Avg: 666.35 / Max: 682.47Min: 999.12 / Avg: 1003.48 / Max: 1009.5Min: 778.55 / Avg: 784.25 / Max: 789.521. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X3691215SE +/- 0.02, N = 3SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 37.489.007.9710.19MIN: 4.3 / MAX: 42.8MIN: 4.65 / MAX: 19.47MIN: 4.7 / MAX: 18.6MIN: 4.41 / MAX: 24.51. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X3691215Min: 7.45 / Avg: 7.48 / Max: 7.52Min: 8.78 / Avg: 9 / Max: 9.21Min: 7.92 / Avg: 7.97 / Max: 8Min: 10.12 / Avg: 10.19 / Max: 10.261. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X400800120016002000SE +/- 6.32, N = 3SE +/- 11.19, N = 3SE +/- 1.97, N = 3SE +/- 9.91, N = 31188.171265.141658.151670.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X30060090012001500Min: 1175.6 / Avg: 1188.17 / Max: 1195.57Min: 1242.83 / Avg: 1265.14 / Max: 1277.8Min: 1654.31 / Avg: 1658.15 / Max: 1660.81Min: 1651.27 / Avg: 1670.93 / Max: 1682.91. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X1.1342.2683.4024.5365.67SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 35.044.744.824.78MIN: 3.53 / MAX: 13.4MIN: 3.18 / MAX: 12.15MIN: 3.33 / MAX: 13.06MIN: 3.45 / MAX: 12.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810Min: 5.01 / Avg: 5.04 / Max: 5.1Min: 4.69 / Avg: 4.74 / Max: 4.82Min: 4.81 / Avg: 4.82 / Max: 4.83Min: 4.75 / Avg: 4.78 / Max: 4.841. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150SE +/- 0.45, N = 3SE +/- 0.21, N = 3SE +/- 0.53, N = 3SE +/- 0.55, N = 3107.76112.02135.50138.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150Min: 106.91 / Avg: 107.76 / Max: 108.44Min: 111.6 / Avg: 112.02 / Max: 112.3Min: 134.44 / Avg: 135.5 / Max: 136.06Min: 137.2 / Avg: 138.14 / Max: 139.11. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X1326395265SE +/- 0.23, N = 3SE +/- 0.10, N = 3SE +/- 0.23, N = 3SE +/- 0.22, N = 355.6553.5458.9957.85MIN: 26.86 / MAX: 87.31MIN: 31.21 / MAX: 70.2MIN: 30.71 / MAX: 70.41MIN: 27.45 / MAX: 68.11. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X1224364860Min: 55.29 / Avg: 55.65 / Max: 56.09Min: 53.41 / Avg: 53.54 / Max: 53.73Min: 58.76 / Avg: 58.99 / Max: 59.44Min: 57.47 / Avg: 57.85 / Max: 58.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X61218243026.2125.0223.9122.791. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X4080120160200138.74171.62125.99161.671. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X4080120160200193.36199.34178.11190.941. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X50010001500200025001948.062161.561863.952126.101. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

ASKAP

ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - DegriddingRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2K4K6K8K10KSE +/- 84.09, N = 3SE +/- 0.00, N = 3SE +/- 74.40, N = 3SE +/- 106.21, N = 69923.9310092.1010858.8010788.801. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - DegriddingRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2K4K6K8K10KMin: 9839.84 / Avg: 9923.93 / Max: 10092.1Min: 10092.1 / Avg: 10092.1 / Max: 10092.1Min: 10710 / Avg: 10858.8 / Max: 10933.2Min: 10290 / Avg: 10788.8 / Max: 10933.21. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - GriddingRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X3K6K9K12K15KSE +/- 124.23, N = 3SE +/- 116.93, N = 3SE +/- 0.00, N = 3SE +/- 111.37, N = 612051.311693.212495.011211.21. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - GriddingRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2K4K6K8K10KMin: 11927.1 / Avg: 12051.33 / Max: 12299.8Min: 11576.3 / Avg: 11693.23 / Max: 11927.1Min: 12495 / Avg: 12495 / Max: 12495Min: 10710 / Avg: 11211.18 / Max: 11408.51. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve OpenMP - GriddingRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X15003000450060007500SE +/- 30.03, N = 7SE +/- 34.63, N = 6SE +/- 61.20, N = 7SE +/- 46.08, N = 66052.165024.896780.796099.221. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve OpenMP - GriddingRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X12002400360048006000Min: 5916.8 / Avg: 6052.16 / Max: 6192Min: 4930.67 / Avg: 5024.89 / Max: 5120.31Min: 6494.05 / Avg: 6780.79 / Max: 7006.74Min: 5916.8 / Avg: 6099.22 / Max: 61921. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve OpenMP - DegriddingRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2K4K6K8K10KSE +/- 76.62, N = 7SE +/- 107.63, N = 6SE +/- 97.44, N = 7SE +/- 35.18, N = 410078.065756.7711369.606156.821. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve OpenMP - DegriddingRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2K4K6K8K10KMin: 9861.33 / Avg: 10078.06 / Max: 10240.6Min: 5433.8 / Avg: 5756.77 / Max: 6051.27Min: 11094 / Avg: 11369.6 / Max: 11576.3Min: 6051.27 / Avg: 6156.82 / Max: 61921. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve MT - GriddingRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X5001000150020002500SE +/- 11.10, N = 3SE +/- 11.79, N = 3SE +/- 8.06, N = 3SE +/- 8.23, N = 32100.992002.692293.312173.951. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve MT - GriddingRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X400800120016002000Min: 2084.88 / Avg: 2100.99 / Max: 2122.27Min: 1979.6 / Avg: 2002.69 / Max: 2018.37Min: 2277.52 / Avg: 2293.31 / Max: 2304Min: 2157.56 / Avg: 2173.95 / Max: 2183.541. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve MT - DegriddingRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X6001200180024003000SE +/- 24.29, N = 3SE +/- 39.07, N = 3SE +/- 7.84, N = 3SE +/- 6.59, N = 32906.782755.492995.192833.491. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve MT - DegriddingRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X5001000150020002500Min: 2868.11 / Avg: 2906.78 / Max: 2951.57Min: 2678.18 / Avg: 2755.49 / Max: 2803.92Min: 2985.35 / Avg: 2995.19 / Max: 3010.67Min: 2821.26 / Avg: 2833.49 / Max: 2843.861. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

OpenBenchmarking.orgIterations Per Second, More Is BetterASKAP 1.0Test: Hogbom Clean OpenMPRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X120240360480600SE +/- 1.12, N = 5SE +/- 2.17, N = 5SE +/- 0.74, N = 5SE +/- 1.79, N = 5545.86440.18548.25448.461. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenBenchmarking.orgIterations Per Second, More Is BetterASKAP 1.0Test: Hogbom Clean OpenMPRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X100200300400500Min: 543.48 / Avg: 545.86 / Max: 549.45Min: 436.68 / Avg: 440.18 / Max: 446.43Min: 546.45 / Avg: 548.25 / Max: 549.45Min: 442.48 / Avg: 448.46 / Max: 452.491. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

Zstd Compression

This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3 - Compression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X9001800270036004500SE +/- 10.85, N = 3SE +/- 10.25, N = 3SE +/- 2.07, N = 3SE +/- 22.63, N = 33710.74014.33959.64227.61. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3 - Compression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X7001400210028003500Min: 3689.5 / Avg: 3710.7 / Max: 3725.3Min: 3996.5 / Avg: 4014.33 / Max: 4032Min: 3956.4 / Avg: 3959.63 / Max: 3963.5Min: 4183.5 / Avg: 4227.63 / Max: 4258.41. (CC) gcc options: -O3 -pthread -lz -llzma -llz4

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3 - Decompression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X5001000150020002500SE +/- 7.53, N = 3SE +/- 5.24, N = 3SE +/- 6.56, N = 3SE +/- 3.32, N = 32162.42184.02203.62170.11. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3 - Decompression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X400800120016002000Min: 2148.5 / Avg: 2162.37 / Max: 2174.4Min: 2176 / Avg: 2184.33 / Max: 2194Min: 2193.9 / Avg: 2203.6 / Max: 2216.1Min: 2165.3 / Avg: 2170.13 / Max: 2176.51. (CC) gcc options: -O3 -pthread -lz -llzma -llz4

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3, Long Mode - Compression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X30060090012001500SE +/- 7.40, N = 3SE +/- 1.62, N = 3SE +/- 1.80, N = 3SE +/- 3.37, N = 31319.61393.71338.31413.91. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3, Long Mode - Compression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2004006008001000Min: 1305.3 / Avg: 1319.57 / Max: 1330.1Min: 1390.9 / Avg: 1393.67 / Max: 1396.5Min: 1334.9 / Avg: 1338.3 / Max: 1341Min: 1407.5 / Avg: 1413.93 / Max: 1418.91. (CC) gcc options: -O3 -pthread -lz -llzma -llz4

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3, Long Mode - Decompression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X5001000150020002500SE +/- 5.96, N = 3SE +/- 3.63, N = 3SE +/- 3.72, N = 3SE +/- 4.39, N = 32217.42249.42254.02223.81. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3, Long Mode - Decompression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X400800120016002000Min: 2208.9 / Avg: 2217.43 / Max: 2228.9Min: 2244.9 / Avg: 2249.43 / Max: 2256.6Min: 2248.3 / Avg: 2254 / Max: 2261Min: 2216.7 / Avg: 2223.77 / Max: 2231.81. (CC) gcc options: -O3 -pthread -lz -llzma -llz4

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8 - Compression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2004006008001000SE +/- 7.21, N = 3SE +/- 1.87, N = 3SE +/- 9.05, N = 15SE +/- 3.61, N = 31026.5857.41053.7837.41. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8 - Compression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2004006008001000Min: 1015.8 / Avg: 1026.47 / Max: 1040.2Min: 855.4 / Avg: 857.37 / Max: 861.1Min: 1002.6 / Avg: 1053.69 / Max: 1120.7Min: 831.1 / Avg: 837.4 / Max: 843.61. (CC) gcc options: -O3 -pthread -lz -llzma -llz4

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8 - Decompression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X5001000150020002500SE +/- 4.93, N = 3SE +/- 6.76, N = 3SE +/- 15.85, N = 15SE +/- 7.71, N = 32352.92393.02391.62379.11. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8 - Decompression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X400800120016002000Min: 2343.1 / Avg: 2352.93 / Max: 2358.5Min: 2385.7 / Avg: 2393 / Max: 2406.5Min: 2176.1 / Avg: 2391.55 / Max: 2430.3Min: 2365.9 / Avg: 2379.1 / Max: 2392.61. (CC) gcc options: -O3 -pthread -lz -llzma -llz4

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8, Long Mode - Compression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2004006008001000SE +/- 4.92, N = 3SE +/- 0.92, N = 3SE +/- 1.52, N = 3SE +/- 0.72, N = 3940.9808.51004.2845.71. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8, Long Mode - Compression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2004006008001000Min: 933.7 / Avg: 940.9 / Max: 950.3Min: 807.2 / Avg: 808.53 / Max: 810.3Min: 1002.4 / Avg: 1004.17 / Max: 1007.2Min: 844.3 / Avg: 845.7 / Max: 846.71. (CC) gcc options: -O3 -pthread -lz -llzma -llz4

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8, Long Mode - Decompression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X5001000150020002500SE +/- 4.07, N = 3SE +/- 0.74, N = 3SE +/- 12.98, N = 3SE +/- 0.47, N = 32365.32410.42422.12390.41. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8, Long Mode - Decompression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X400800120016002000Min: 2358.8 / Avg: 2365.3 / Max: 2372.8Min: 2409 / Avg: 2410.43 / Max: 2411.5Min: 2404.2 / Avg: 2422.07 / Max: 2447.3Min: 2389.9 / Avg: 2390.37 / Max: 2391.31. (CC) gcc options: -O3 -pthread -lz -llzma -llz4

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 12 - Compression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X60120180240300SE +/- 2.69, N = 3SE +/- 0.55, N = 3SE +/- 1.20, N = 3SE +/- 1.42, N = 3298.3248.8292.4253.61. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 12 - Compression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X50100150200250Min: 293.2 / Avg: 298.33 / Max: 302.3Min: 248.2 / Avg: 248.8 / Max: 249.9Min: 290 / Avg: 292.4 / Max: 293.7Min: 251.5 / Avg: 253.6 / Max: 256.31. (CC) gcc options: -O3 -pthread -lz -llzma -llz4

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 12 - Decompression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X5001000150020002500SE +/- 2.91, N = 3SE +/- 16.52, N = 3SE +/- 9.67, N = 3SE +/- 6.83, N = 32453.82452.02452.82439.91. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 12 - Decompression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X400800120016002000Min: 2448.2 / Avg: 2453.83 / Max: 2457.9Min: 2419 / Avg: 2452.03 / Max: 2469.2Min: 2434.9 / Avg: 2452.8 / Max: 2468.1Min: 2426.4 / Avg: 2439.9 / Max: 2448.41. (CC) gcc options: -O3 -pthread -lz -llzma -llz4

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X612182430SE +/- 0.31, N = 15SE +/- 0.03, N = 3SE +/- 0.37, N = 15SE +/- 0.09, N = 325.223.425.223.31. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X612182430Min: 23.6 / Avg: 25.23 / Max: 26.7Min: 23.4 / Avg: 23.43 / Max: 23.5Min: 23.3 / Avg: 25.18 / Max: 27.3Min: 23.1 / Avg: 23.27 / Max: 23.41. (CC) gcc options: -O3 -pthread -lz -llzma -llz4

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X5001000150020002500SE +/- 14.47, N = 15SE +/- 31.89, N = 3SE +/- 25.89, N = 15SE +/- 4.22, N = 32082.12101.82030.52104.41. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X400800120016002000Min: 1918.5 / Avg: 2082.09 / Max: 2140.5Min: 2040.8 / Avg: 2101.77 / Max: 2148.5Min: 1942.1 / Avg: 2030.47 / Max: 2187.4Min: 2097 / Avg: 2104.43 / Max: 2111.61. (CC) gcc options: -O3 -pthread -lz -llzma -llz4

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X48121620SE +/- 0.15, N = 15SE +/- 0.12, N = 15SE +/- 0.03, N = 3SE +/- 0.03, N = 314.313.015.012.51. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X48121620Min: 12.8 / Avg: 14.25 / Max: 14.8Min: 12.5 / Avg: 13.03 / Max: 13.8Min: 14.9 / Avg: 14.97 / Max: 15Min: 12.5 / Avg: 12.53 / Max: 12.61. (CC) gcc options: -O3 -pthread -lz -llzma -llz4

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X400800120016002000SE +/- 29.67, N = 15SE +/- 8.37, N = 15SE +/- 16.22, N = 3SE +/- 6.34, N = 31876.31997.41872.41990.01. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression SpeedRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X30060090012001500Min: 1590.6 / Avg: 1876.26 / Max: 2023.8Min: 1941.4 / Avg: 1997.41 / Max: 2037.5Min: 1840.1 / Avg: 1872.4 / Max: 1891.2Min: 1978.6 / Avg: 1989.97 / Max: 2000.51. (CC) gcc options: -O3 -pthread -lz -llzma -llz4

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X0.47440.94881.42321.89762.372SE +/- 0.00176, N = 7SE +/- 0.00247, N = 7SE +/- 0.00908, N = 7SE +/- 0.37855, N = 151.381441.812911.086402.10831MIN: 1.34MIN: 1.74MIN: 1.01MIN: 1.631. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810Min: 1.37 / Avg: 1.38 / Max: 1.39Min: 1.8 / Avg: 1.81 / Max: 1.83Min: 1.06 / Avg: 1.09 / Max: 1.14Min: 1.67 / Avg: 2.11 / Max: 7.41. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X1.16592.33183.49774.66365.8295SE +/- 0.01434, N = 3SE +/- 0.04268, N = 3SE +/- 0.03845, N = 3SE +/- 0.02903, N = 35.181724.710133.958863.60748MIN: 4.98MIN: 4.54MIN: 3.72MIN: 3.431. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810Min: 5.15 / Avg: 5.18 / Max: 5.2Min: 4.64 / Avg: 4.71 / Max: 4.79Min: 3.88 / Avg: 3.96 / Max: 4Min: 3.56 / Avg: 3.61 / Max: 3.661. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X0.45650.9131.36951.8262.2825SE +/- 0.00266, N = 9SE +/- 0.00295, N = 9SE +/- 0.00172, N = 9SE +/- 0.00250, N = 92.029031.798301.507151.40849MIN: 1.97MIN: 1.7MIN: 1.46MIN: 1.341. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810Min: 2.02 / Avg: 2.03 / Max: 2.04Min: 1.79 / Avg: 1.8 / Max: 1.82Min: 1.5 / Avg: 1.51 / Max: 1.52Min: 1.4 / Avg: 1.41 / Max: 1.421. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X0.24190.48380.72570.96761.2095SE +/- 0.002405, N = 4SE +/- 0.004105, N = 4SE +/- 0.010030, N = 15SE +/- 0.006372, N = 151.0751000.9794990.7295100.664360MIN: 1.03MIN: 0.91MIN: 0.63MIN: 0.591. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810Min: 1.07 / Avg: 1.08 / Max: 1.08Min: 0.97 / Avg: 0.98 / Max: 0.99Min: 0.66 / Avg: 0.73 / Max: 0.8Min: 0.64 / Avg: 0.66 / Max: 0.721. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X0.34250.6851.02751.371.7125SE +/- 0.00690, N = 5SE +/- 0.01359, N = 5SE +/- 0.00875, N = 5SE +/- 0.00933, N = 51.161651.517491.083731.52232MIN: 1.08MIN: 1.4MIN: 0.97MIN: 1.41. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810Min: 1.14 / Avg: 1.16 / Max: 1.18Min: 1.48 / Avg: 1.52 / Max: 1.55Min: 1.05 / Avg: 1.08 / Max: 1.1Min: 1.49 / Avg: 1.52 / Max: 1.541. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X0.06830.13660.20490.27320.3415SE +/- 0.004459, N = 15SE +/- 0.000581, N = 4SE +/- 0.000569, N = 4SE +/- 0.000189, N = 40.3034640.2648260.2297730.212801MIN: 0.29MIN: 0.25MIN: 0.22MIN: 0.21. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X12345Min: 0.29 / Avg: 0.3 / Max: 0.36Min: 0.26 / Avg: 0.26 / Max: 0.27Min: 0.23 / Avg: 0.23 / Max: 0.23Min: 0.21 / Avg: 0.21 / Max: 0.211. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X30060090012001500SE +/- 1.50, N = 3SE +/- 1.79, N = 3SE +/- 2.36, N = 3SE +/- 1.31, N = 31560.861434.061209.121130.44MIN: 1554.07MIN: 1423.92MIN: 1195.27MIN: 1121.321. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X30060090012001500Min: 1558.68 / Avg: 1560.86 / Max: 1563.74Min: 1431.52 / Avg: 1434.06 / Max: 1437.51Min: 1205.24 / Avg: 1209.12 / Max: 1213.39Min: 1127.83 / Avg: 1130.44 / Max: 1131.911. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2004006008001000SE +/- 2.26, N = 3SE +/- 1.56, N = 3SE +/- 1.70, N = 3SE +/- 4.41, N = 3803.71731.38623.39578.91MIN: 796.39MIN: 721.81MIN: 614.18MIN: 566.671. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X140280420560700Min: 799.21 / Avg: 803.71 / Max: 806.22Min: 728.33 / Avg: 731.38 / Max: 733.43Min: 620.01 / Avg: 623.39 / Max: 625.46Min: 570.42 / Avg: 578.91 / Max: 585.211. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries too. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 16 - Model: ResNet-50Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X1020304050SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 338.1138.9043.1943.08
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 16 - Model: ResNet-50Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X918273645Min: 38.03 / Avg: 38.11 / Max: 38.15Min: 38.9 / Avg: 38.9 / Max: 38.9Min: 43.04 / Avg: 43.19 / Max: 43.33Min: 43.05 / Avg: 43.08 / Max: 43.1

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 16 - Model: AlexNetRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X4080120160200SE +/- 0.07, N = 4SE +/- 0.22, N = 4SE +/- 0.18, N = 5SE +/- 0.11, N = 5158.97162.66176.22176.72
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 16 - Model: AlexNetRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150Min: 158.83 / Avg: 158.97 / Max: 159.11Min: 162.26 / Avg: 162.66 / Max: 163.09Min: 175.7 / Avg: 176.22 / Max: 176.79Min: 176.56 / Avg: 176.72 / Max: 177.17

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 16 - Model: GoogLeNetRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150SE +/- 0.02, N = 4SE +/- 0.09, N = 4SE +/- 0.07, N = 4SE +/- 0.14, N = 4124.65128.74147.01146.99
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 16 - Model: GoogLeNetRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150Min: 124.6 / Avg: 124.65 / Max: 124.7Min: 128.56 / Avg: 128.74 / Max: 128.94Min: 146.87 / Avg: 147.01 / Max: 147.19Min: 146.65 / Avg: 146.99 / Max: 147.29

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 32 - Model: ResNet-50Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X1020304050SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 339.0140.0044.2744.39
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 32 - Model: ResNet-50Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X918273645Min: 38.9 / Avg: 39.01 / Max: 39.1Min: 39.99 / Avg: 40 / Max: 40.03Min: 44.16 / Avg: 44.27 / Max: 44.38Min: 44.33 / Avg: 44.39 / Max: 44.42

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 32 - Model: AlexNetRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X60120180240300SE +/- 0.10, N = 3SE +/- 0.05, N = 4SE +/- 0.06, N = 4SE +/- 0.14, N = 4223.03232.30258.77264.33
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 32 - Model: AlexNetRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X50100150200250Min: 222.84 / Avg: 223.03 / Max: 223.14Min: 232.2 / Avg: 232.3 / Max: 232.4Min: 258.65 / Avg: 258.77 / Max: 258.94Min: 263.93 / Avg: 264.33 / Max: 264.52

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 32 - Model: GoogLeNetRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150SE +/- 0.03, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.17, N = 3126.27127.67149.39147.08
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 32 - Model: GoogLeNetRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150Min: 126.23 / Avg: 126.27 / Max: 126.33Min: 127.43 / Avg: 127.67 / Max: 127.86Min: 149.16 / Avg: 149.39 / Max: 149.66Min: 146.84 / Avg: 147.08 / Max: 147.41

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 64 - Model: ResNet-50Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X1020304050SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 339.0640.2044.2044.58
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 64 - Model: ResNet-50Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X918273645Min: 39.02 / Avg: 39.06 / Max: 39.08Min: 40.18 / Avg: 40.2 / Max: 40.21Min: 44.12 / Avg: 44.2 / Max: 44.25Min: 44.55 / Avg: 44.58 / Max: 44.62

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 64 - Model: AlexNetRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X80160240320400SE +/- 0.09, N = 3SE +/- 0.30, N = 3SE +/- 0.40, N = 3SE +/- 0.64, N = 3278.30294.49339.80351.07
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 64 - Model: AlexNetRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X60120180240300Min: 278.15 / Avg: 278.3 / Max: 278.45Min: 294.14 / Avg: 294.49 / Max: 295.1Min: 339.28 / Avg: 339.8 / Max: 340.59Min: 350.23 / Avg: 351.07 / Max: 352.33

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 64 - Model: GoogLeNetRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.14, N = 3SE +/- 0.10, N = 3123.26125.62145.29143.88
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 64 - Model: GoogLeNetRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150Min: 123.22 / Avg: 123.26 / Max: 123.33Min: 125.54 / Avg: 125.62 / Max: 125.75Min: 145.06 / Avg: 145.29 / Max: 145.55Min: 143.69 / Avg: 143.88 / Max: 144.03

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 256 - Model: ResNet-50Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X1020304050SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 338.8940.3643.8844.87
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 256 - Model: ResNet-50Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X918273645Min: 38.87 / Avg: 38.89 / Max: 38.91Min: 40.34 / Avg: 40.36 / Max: 40.38Min: 43.87 / Avg: 43.88 / Max: 43.9Min: 44.87 / Avg: 44.87 / Max: 44.87

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 256 - Model: AlexNetRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X100200300400500SE +/- 0.33, N = 3SE +/- 0.11, N = 3SE +/- 0.24, N = 3SE +/- 0.19, N = 3328.37353.60418.97439.54
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 256 - Model: AlexNetRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X80160240320400Min: 327.71 / Avg: 328.37 / Max: 328.74Min: 353.45 / Avg: 353.6 / Max: 353.81Min: 418.48 / Avg: 418.97 / Max: 419.22Min: 439.17 / Avg: 439.54 / Max: 439.82

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 256 - Model: GoogLeNetRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3118.96123.87137.77140.76
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12-rc0Device: CPU - Batch Size: 256 - Model: GoogLeNetRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150Min: 118.88 / Avg: 118.96 / Max: 119.01Min: 123.84 / Avg: 123.87 / Max: 123.92Min: 137.72 / Avg: 137.77 / Max: 137.8Min: 140.71 / Avg: 140.76 / Max: 140.82

Pennant

Pennant is an application focused on hydrodynamics on general unstructured meshes in 2D. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: leblancbigRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X612182430SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 319.3125.1516.8624.361. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: leblancbigRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X612182430Min: 19.24 / Avg: 19.31 / Max: 19.35Min: 25.14 / Avg: 25.15 / Max: 25.16Min: 16.81 / Avg: 16.86 / Max: 16.9Min: 24.32 / Avg: 24.36 / Max: 24.41. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: sedovbigRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X816243240SE +/- 0.29, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 330.9436.8827.0434.851. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: sedovbigRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X816243240Min: 30.64 / Avg: 30.94 / Max: 31.52Min: 36.69 / Avg: 36.88 / Max: 37.14Min: 26.88 / Avg: 27.04 / Max: 27.25Min: 34.81 / Avg: 34.85 / Max: 34.891. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi

Xcompact3d Incompact3d

Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 129 Cells Per DirectionRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X48121620SE +/- 0.05, N = 4SE +/- 0.05, N = 4SE +/- 0.02, N = 4SE +/- 0.04, N = 412.6914.6112.5414.631. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 129 Cells Per DirectionRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X48121620Min: 12.55 / Avg: 12.69 / Max: 12.78Min: 14.52 / Avg: 14.61 / Max: 14.74Min: 12.51 / Avg: 12.54 / Max: 12.58Min: 14.52 / Avg: 14.63 / Max: 14.71. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per DirectionRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X1530456075SE +/- 0.70, N = 4SE +/- 0.82, N = 3SE +/- 0.66, N = 4SE +/- 0.31, N = 361.9668.2258.7766.211. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per DirectionRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X1326395265Min: 59.88 / Avg: 61.96 / Max: 62.83Min: 67.08 / Avg: 68.22 / Max: 69.82Min: 57.6 / Avg: 58.77 / Max: 60.6Min: 65.83 / Avg: 66.21 / Max: 66.831. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

GROMACS

The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2023Implementation: MPI CPU - Input: water_GMX50_bareRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X0.60641.21281.81922.42563.032SE +/- 0.002, N = 3SE +/- 0.004, N = 3SE +/- 0.002, N = 3SE +/- 0.004, N = 32.2782.2702.6952.6071. (CXX) g++ options: -O3
OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2023Implementation: MPI CPU - Input: water_GMX50_bareRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810Min: 2.27 / Avg: 2.28 / Max: 2.28Min: 2.27 / Avg: 2.27 / Max: 2.28Min: 2.69 / Avg: 2.7 / Max: 2.7Min: 2.6 / Avg: 2.61 / Max: 2.611. (CXX) g++ options: -O3

Open Porous Media Git

This is a test of Open Porous Media, a set of open-source tools concerning simulation of flow and transport of fluids in porous media. This test profile builds OPM and its dependencies from upstream Git. Learn more via the OpenBenchmarking.org test page.

OPM Benchmark: Upscale-Relperm - Threads: 16

Ryzen 9 7900X3D: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 7900X: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 79500X3D: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

Ryzen 9 7950X: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

OPM Benchmark: Flow MPI Norne - Threads: 16

Ryzen 9 7900X3D: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 7900X: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 79500X3D: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

Ryzen 9 7950X: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

OPM Benchmark: Flow MPI Norne-4C MSW - Threads: 16

Ryzen 9 7900X3D: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 7900X: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 79500X3D: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

Ryzen 9 7950X: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

OPM Benchmark: Flow MPI Extra - Threads: 16

Ryzen 9 7900X3D: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 7900X: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 79500X3D: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

Ryzen 9 7950X: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

OPM Benchmark: Drogon - Threads: 16

Ryzen 9 7900X3D: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 7900X: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 79500X3D: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

Ryzen 9 7950X: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

OPM Benchmark: SPE10 Model 1 - Threads: 16

Ryzen 9 7900X3D: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 7900X: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 79500X3D: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

Ryzen 9 7950X: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

OPM Benchmark: SPE10 Model 2 - Threads: 16

Ryzen 9 7900X3D: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 7900X: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 79500X3D: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

Ryzen 9 7950X: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

OPM Benchmark: Smeaheia - Threads: 16

Ryzen 9 7900X3D: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 7900X: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 79500X3D: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

Ryzen 9 7950X: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

OPM Benchmark: PUNQ-S3 - Threads: 16

Ryzen 9 7900X3D: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 7900X: The test run did not produce a result. E: There are not enough slots available in the system to satisfy the 16

Ryzen 9 79500X3D: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

Ryzen 9 7950X: The test run did not produce a result. E: mpirun was unable to launch the specified application as it could not access

KTX-Software toktx

This is a benchmark of The Khronos Group's KTX-Software library and tools. KTX-Software provides "toktx" for converting/creating in the KTX container format for image textures. This benchmark times how long it takes to convert to KTX 2.0 format with various settings using a reference PNG sample input. Learn more via the OpenBenchmarking.org test page.

Settings: Zstd Compression 9

Ryzen 9 7900X3D: The test run did not produce a result.

Ryzen 9 7900X: The test run did not produce a result.

Ryzen 9 79500X3D: The test run did not produce a result.

Ryzen 9 7950X: The test run did not produce a result.

OpenBenchmarking.orgSeconds, Fewer Is BetterKTX-Software toktx 4.0Settings: Zstd Compression 19Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X3691215SE +/- 0.03, N = 4SE +/- 0.07, N = 4SE +/- 0.06, N = 5SE +/- 0.05, N = 511.5311.6411.4611.22
OpenBenchmarking.orgSeconds, Fewer Is BetterKTX-Software toktx 4.0Settings: Zstd Compression 19Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X3691215Min: 11.46 / Avg: 11.53 / Max: 11.6Min: 11.44 / Avg: 11.64 / Max: 11.79Min: 11.31 / Avg: 11.46 / Max: 11.63Min: 11.12 / Avg: 11.22 / Max: 11.41

OpenBenchmarking.orgSeconds, Fewer Is BetterKTX-Software toktx 4.0Settings: UASTC 3Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X246810SE +/- 0.004, N = 6SE +/- 0.006, N = 7SE +/- 0.019, N = 7SE +/- 0.003, N = 76.3745.9445.1264.885
OpenBenchmarking.orgSeconds, Fewer Is BetterKTX-Software toktx 4.0Settings: UASTC 3Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X3691215Min: 6.36 / Avg: 6.37 / Max: 6.39Min: 5.92 / Avg: 5.94 / Max: 5.97Min: 5.1 / Avg: 5.13 / Max: 5.24Min: 4.87 / Avg: 4.89 / Max: 4.89

OpenBenchmarking.orgSeconds, Fewer Is BetterKTX-Software toktx 4.0Settings: UASTC 3 + Zstd Compression 19Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X3691215SE +/- 0.014, N = 5SE +/- 0.013, N = 5SE +/- 0.012, N = 5SE +/- 0.005, N = 510.0379.6988.7478.405
OpenBenchmarking.orgSeconds, Fewer Is BetterKTX-Software toktx 4.0Settings: UASTC 3 + Zstd Compression 19Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X3691215Min: 10 / Avg: 10.04 / Max: 10.07Min: 9.66 / Avg: 9.7 / Max: 9.73Min: 8.72 / Avg: 8.75 / Max: 8.78Min: 8.39 / Avg: 8.41 / Max: 8.42

OpenBenchmarking.orgSeconds, Fewer Is BetterKTX-Software toktx 4.0Settings: UASTC 4 + Zstd Compression 19Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X4080120160200SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.03, N = 3SE +/- 0.21, N = 3169.17157.11126.30119.50
OpenBenchmarking.orgSeconds, Fewer Is BetterKTX-Software toktx 4.0Settings: UASTC 4 + Zstd Compression 19Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150Min: 169.08 / Avg: 169.17 / Max: 169.24Min: 156.87 / Avg: 157.11 / Max: 157.31Min: 126.26 / Avg: 126.3 / Max: 126.35Min: 119.08 / Avg: 119.5 / Max: 119.76

GPAW

GPAW is a density-functional theory (DFT) Python code based on the projector-augmented wave (PAW) method and the atomic simulation environment (ASE). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 22.1Input: Carbon NanotubeRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150SE +/- 0.15, N = 3SE +/- 0.21, N = 3SE +/- 0.16, N = 3SE +/- 0.12, N = 3143.15150.87126.90138.011. (CC) gcc options: -shared -fwrapv -O2 -lxc -lblas -lmpi
OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 22.1Input: Carbon NanotubeRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X306090120150Min: 142.95 / Avg: 143.15 / Max: 143.44Min: 150.47 / Avg: 150.87 / Max: 151.15Min: 126.69 / Avg: 126.9 / Max: 127.22Min: 137.77 / Avg: 138.01 / Max: 138.161. (CC) gcc options: -shared -fwrapv -O2 -lxc -lblas -lmpi

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X60120180240300SE +/- 1.41, N = 3SE +/- 1.44, N = 3SE +/- 1.59, N = 3SE +/- 0.81, N = 3269.00258.64279.87250.50MIN: 14.44 / MAX: 8571.43MIN: 15.82 / MAX: 10000MIN: 13.15 / MAX: 7500MIN: 12.61 / MAX: 10000
OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X50100150200250Min: 266.23 / Avg: 269 / Max: 270.84Min: 255.91 / Avg: 258.64 / Max: 260.79Min: 276.7 / Avg: 279.87 / Max: 281.74Min: 249.39 / Avg: 250.5 / Max: 252.07

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X70140210280350SE +/- 0.93, N = 3SE +/- 0.26, N = 3SE +/- 2.16, N = 3SE +/- 3.10, N = 3303.48285.41316.84275.45MIN: 14.85 / MAX: 10000MIN: 16.08 / MAX: 12000MIN: 16.12 / MAX: 10000MIN: 16.28 / MAX: 12000
OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X60120180240300Min: 301.63 / Avg: 303.48 / Max: 304.52Min: 284.88 / Avg: 285.41 / Max: 285.67Min: 313.04 / Avg: 316.84 / Max: 320.52Min: 272.27 / Avg: 275.45 / Max: 281.64

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X70140210280350SE +/- 1.13, N = 3SE +/- 3.74, N = 3SE +/- 3.76, N = 3SE +/- 0.25, N = 3308.81290.14321.76276.94MIN: 14.79 / MAX: 12000MIN: 16.06 / MAX: 12000MIN: 15.82 / MAX: 10000MIN: 15.4 / MAX: 10000
OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X60120180240300Min: 307.16 / Avg: 308.81 / Max: 310.96Min: 285.88 / Avg: 290.14 / Max: 297.6Min: 316.52 / Avg: 321.76 / Max: 329.04Min: 276.45 / Avg: 276.94 / Max: 277.27

LULESH

LULESH is the Livermore Unstructured Lagrangian Explicit Shock Hydrodynamics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgz/s, More Is BetterLULESH 2.0.3Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X2K4K6K8K10KSE +/- 19.85, N = 7SE +/- 18.50, N = 6SE +/- 15.81, N = 7SE +/- 22.43, N = 68953.058484.578987.948479.881. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi
OpenBenchmarking.orgz/s, More Is BetterLULESH 2.0.3Ryzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X16003200480064008000Min: 8887.85 / Avg: 8953.05 / Max: 9043.95Min: 8435.63 / Avg: 8484.57 / Max: 8553.62Min: 8919.62 / Avg: 8987.94 / Max: 9040.45Min: 8405.64 / Avg: 8479.88 / Max: 8569.171. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.0Binary: Pathtracer - Model: Asian DragonRyzen 9 7900X3DRyzen 9 7900XRyzen 9 79500X3DRyzen 9 7950X816243240SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 326.5526.5134.7033.63MIN: 26.42 / MAX: 26.93MIN: 26.37 / MAX: 26.79MIN: 34.46 / MAX: 35.13MIN: 33.39 / MAX: 34.01
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.0Binary: Pathtracer - Model: Asian Dragon