7713 2P

Tests for a future article. 2 x AMD EPYC 7303 16-Core testing with a AMD DAYTONA_X (RYM1009B BIOS) and ASPEED on Ubuntu 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2310231-NE-77132P99738&rdt&gru.

7713 2PProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerVulkanCompilerFile-SystemScreen ResolutionabcAMD EPYC 7303 16-Coredefg2 x AMD EPYC 7713 64-Core @ 2.00GHz (128 Cores / 256 Threads)AMD DAYTONA_X (RYM1009B BIOS)AMD Starship/Matisse256GB3841GB Micron_9300_MTFDHAL3T8TDPASPEEDVE2282 x Mellanox MT27710Ubuntu 22.045.15.0-47-generic (x86_64)GNOME Shell 42.4X Server 1.21.1.31.2.204GCC 11.2.0ext41920x1080AMD EPYC 7303 16-Core @ 2.40GHz (16 Cores / 32 Threads)2 x AMD EPYC 7203 8-Core @ 2.80GHz (16 Cores / 32 Threads)512GB1024x7682 x AMD EPYC 7303 16-Core @ 2.40GHz (32 Cores / 64 Threads)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173Python Details- Python 3.10.6Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

7713 2Popenvino: Person Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUembree: Pathtracer - Asian Dragonembree: Pathtracer - Asian Dragon Objembree: Pathtracer - Crownembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer ISPC - Crownlibxsmm: 32libxsmm: 64oidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyoidn: RTLightmap.hdr.4096x4096 - CPU-Onlyopenvkl: vklBenchmarkCPU Scalaropenvkl: vklBenchmarkCPU ISPClaghos: Triple Point Problemlaghos: Sedov Blast Wave, ube_922_hex.meshcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingopenvino: Person Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUonednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: IP Shapes 1D - f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: IP Shapes 3D - f32 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUopenradioss: Bumper Beamopenradioss: Chrysler Neon 1Mopenradioss: Cell Phone Drop Testopenradioss: Bird Strike on Windshieldopenradioss: Rubber O-Ring Seal Installationopenradioss: INIVOL and Fluid Structure Interaction Drop Containerremhos: Sample Remap Exampleavifenc: 0avifenc: 2avifenc: 6avifenc: 6, Losslessavifenc: 10, Losslessbuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyeasywave: e2Asean Grid + BengkuluSept2007 Source - 240easywave: e2Asean Grid + BengkuluSept2007 Source - 1200easywave: e2Asean Grid + BengkuluSept2007 Source - 2400abcAMD EPYC 7303 16-Coredefg202.6851.123308.289543.231342.68226.155333.242687.19899.1598494.41540.3980.5164.19282.55507611643823157.75623.99.663.3423.81141.3323.9811.89142.220.85115.89174.4926.54147.64130.4132.3711.28475.60341.4243.2486.7865.47423.875182.49116.0840.2820.44153.7849.66203.1451.173302.839544.951340.29226.275334.872655.09897.77101883.13471923.9162.65282.08505036647995157.4623.649.683.3423.85141.2423.9812.03142.420.85116.73173.5926.35146.17134.61129.6111.0275.77840.8373.3316.8815.48523.974179.98616.0840.2120.73152.9449.32203.9651.23303.599527.761340.12222.735335.152694.27898.69101985.21467.3920.8167.28279.20499347678765156.74623.69.673.3523.86143.5523.9711.86142.290.86116.3174.4526.53146.31131.25132.811.70975.83642.413.3096.9295.53523.939179.53916.1940.0420.45152.548.9642.118.66570.581754.67237.7947.46858.21520.89155.523110.2273.2406.9132.65148.49135892116102189.92921.14144.5533.62168.318.6315.34102.820.68118.33551.2465.55202.93102.8357.2737.307120.8560.195.2829.1865.77967.408815.39589.45226.06109.21871.17280.0337.068.35470.461232.95195.543.18856.63369.7171.6123725.5717.478415.743916.125315.870213.844514.3991356.5442.50.560.560.28144267114.18132.46113384106826107.81478.928.493.2420.4492.5318.6510.893.160.662.677234.273385.541361.941734.631851.928112.345651.65094.513330.7684493019.313037.723028.361451.21445.861466.25134.32489.7563.71235.98129.36429.2239.71125.91864.1465.77110.1336.18668.675830.49294.86237.87116.66974.94296.743.29165.733149.20372.7117.21096.253153.9415.3285.511727.34873.34303.846823.7332.969629.619530.102829.980526.069826.5233484.7727.20.950.950.48273495182.23234.135345612210620214511109.89463.577.292.5319.2593.4518.469.13105.220.671.742444.104125.670181.933523.143711.168561.894051.447493.849161.053243494.513379.253216.131114.671161.81137.11105.44304.0341.05192.24118.07302.0323.46392.44748.7243.9657.8015.85543.41462.13850.21116.6862.52505.43155.522.83155.336140.29773.2317.271095.273148.82415.1285.461708.45865.28303.8345126.4533.039229.520630.337830.131426.273726.6112482.9737.30.950.950.48275497181.55233.54212139216258109.16462.787.292.5319.2593.518.679.21105.230.71.698173.839955.664351.95223.061111.165451.770641.923484.189741.143793341.933281.243462.91139.541153.451128.3105.68306.3741.01192.62120.33305.5523.48891.91348.8443.9767.8245.81743.477462.59950.25117.0562.18504.18157.082.67260.049130.44772.1417.281095.683148.97415.1584.861725.37875.64303.5947926.3432.966229.590830.255230.026126.157426.3986470.9723.40.950.950.48274495180.93233.047063651209887218417110.71462.577.292.5319.2594.1718.489.11105.330.661.846524.057685.633191.950243.141051.170232.12072.284693.947331.086613451.093556.443272.361129.541145.621149.15107.04303.5840.85192.49122.81307.2423.72392.52848.7313.9627.8255.81543.318462.69650.09118.3462.31506.55157.592.76656.337133.177OpenBenchmarking.org

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUabcAMD EPYC 7303 16-Coredefg4080120160200202.68203.14203.9642.1137.0672.7173.2372.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUabcAMD EPYC 7303 16-Coredefg122436486051.1251.1751.208.668.3517.2017.2717.281. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUabcAMD EPYC 7303 16-Coredefg70014002100280035003308.283302.833303.59570.58470.461096.251095.271095.681. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUabcAMD EPYC 7303 16-Coredefg2K4K6K8K10K9543.239544.959527.761754.671232.953153.903148.823148.971. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUabcAMD EPYC 7303 16-Coredefg300600900120015001342.681340.291340.12237.79195.50415.32415.12415.151. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUabcAMD EPYC 7303 16-Coredefg50100150200250226.15226.27222.7347.4643.1885.5185.4684.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUabcAMD EPYC 7303 16-Coredefg110022003300440055005333.245334.875335.15858.21856.631727.341708.451725.371. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUabcAMD EPYC 7303 16-Coredefg60012001800240030002687.192655.092694.27520.89369.70873.34865.28875.641. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUabcAMD EPYC 7303 16-Coredefg2004006008001000899.15897.77898.69155.50171.61303.80303.83303.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUabcAMD EPYC 7303 16-Coredefg20K40K60K80K100K98494.41101883.13101985.2123110.2023725.5746823.7345126.4547926.341. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Embree

Binary: Pathtracer - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragondefg81624324017.4832.9733.0432.97MIN: 17.31 / MAX: 17.65MIN: 32.77 / MAX: 33.49MIN: 32.83 / MAX: 33.53MIN: 32.78 / MAX: 33.29

Embree

Binary: Pathtracer - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragon Objdefg71421283515.7429.6229.5229.59MIN: 15.64 / MAX: 15.92MIN: 29.37 / MAX: 30.21MIN: 29.27 / MAX: 30.16MIN: 29.36 / MAX: 30.31

Embree

Binary: Pathtracer - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Crowndefg71421283516.1330.1030.3430.26MIN: 15.95 / MAX: 16.45MIN: 29.78 / MAX: 30.77MIN: 30.01 / MAX: 30.87MIN: 29.92 / MAX: 30.97

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragondefg71421283515.8729.9830.1330.03MIN: 15.72 / MAX: 16.2MIN: 29.79 / MAX: 30.37MIN: 29.94 / MAX: 30.64MIN: 29.84 / MAX: 30.34

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon Objdefg61218243013.8426.0726.2726.16MIN: 13.7 / MAX: 14.06MIN: 25.87 / MAX: 26.79MIN: 26.05 / MAX: 26.62MIN: 25.98 / MAX: 26.75

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Crowndefg61218243014.4026.5226.6126.40MIN: 14.25 / MAX: 14.69MIN: 26.18 / MAX: 27.13MIN: 26.29 / MAX: 27.11MIN: 26.05 / MAX: 27.08

libxsmm

M N K: 32

OpenBenchmarking.orgGFLOPS/s, More Is Betterlibxsmm 2-1.17-3645M N K: 32abcAMD EPYC 7303 16-Coredefg120240360480600540.3471.0467.3273.2356.5484.7482.9470.91. (CXX) g++ options: -dynamic -Bstatic -static-libgcc -lgomp -lm -lrt -ldl -lquadmath -lstdc++ -pthread -fPIC -std=c++14 -O2 -fopenmp-simd -funroll-loops -ftree-vectorize -fdata-sections -ffunction-sections -fvisibility=hidden -msse4.2

libxsmm

M N K: 64

OpenBenchmarking.orgGFLOPS/s, More Is Betterlibxsmm 2-1.17-3645M N K: 64abcAMD EPYC 7303 16-Coredefg2004006008001000980.5923.9920.8406.9442.5727.2737.3723.41. (CXX) g++ options: -dynamic -Bstatic -static-libgcc -lgomp -lm -lrt -ldl -lquadmath -lstdc++ -pthread -fPIC -std=c++14 -O2 -fopenmp-simd -funroll-loops -ftree-vectorize -fdata-sections -ffunction-sections -fvisibility=hidden -msse4.2

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Onlydefg0.21380.42760.64140.85521.0690.560.950.950.95

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Onlydefg0.21380.42760.64140.85521.0690.560.950.950.95

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RTLightmap.hdr.4096x4096 - Device: CPU-Onlydefg0.1080.2160.3240.4320.540.280.480.480.48

OpenVKL

Benchmark: vklBenchmarkCPU Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU Scalardefg60120180240300144273275274MIN: 11 / MAX: 2667MIN: 21 / MAX: 5037MIN: 21 / MAX: 5065MIN: 21 / MAX: 5053

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCdefg110220330440550267495497495MIN: 23 / MAX: 3404MIN: 44 / MAX: 6142MIN: 43 / MAX: 6162MIN: 43 / MAX: 6166

Laghos

Test: Triple Point Problem

OpenBenchmarking.orgMajor Kernels Total Rate, More Is BetterLaghos 3.1Test: Triple Point ProblemabcAMD EPYC 7303 16-Coredefg4080120160200164.19162.65167.28132.65114.18182.23181.55180.931. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Laghos

Test: Sedov Blast Wave, ube_922_hex.mesh

OpenBenchmarking.orgMajor Kernels Total Rate, More Is BetterLaghos 3.1Test: Sedov Blast Wave, ube_922_hex.meshabcAMD EPYC 7303 16-Coredefg60120180240300282.55282.08279.20148.49132.46234.14233.54233.051. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingabcAMD EPYC 7303 16-Coredefg110K220K330K440K550K5076115050364993471358921133842106202121392098871. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingabcAMD EPYC 7303 16-Coredefg150K300K450K600K750K6438236479956787651161021068262145112162582184171. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUabcAMD EPYC 7303 16-Coredefg4080120160200157.75157.40156.74189.92107.81109.89109.16110.71MIN: 108.19 / MAX: 274.81MIN: 128.42 / MAX: 281.86MIN: 131.77 / MAX: 297.92MIN: 169.75 / MAX: 200.94MIN: 102.18 / MAX: 124.72MIN: 93.05 / MAX: 140.85MIN: 99.46 / MAX: 143.57MIN: 98.56 / MAX: 144.81. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUabcAMD EPYC 7303 16-Coredefg2004006008001000623.90623.64623.60921.14478.92463.57462.78462.57MIN: 594.87 / MAX: 669.12MIN: 593.36 / MAX: 672.04MIN: 599.33 / MAX: 668.6MIN: 883.65 / MAX: 932.87MIN: 474.19 / MAX: 500.74MIN: 456.35 / MAX: 480.41MIN: 456.11 / MAX: 479.6MIN: 455.99 / MAX: 481.911. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUabcAMD EPYC 7303 16-Coredefg481216209.669.689.6714.008.497.297.297.29MIN: 7.98 / MAX: 45.57MIN: 7.94 / MAX: 44.33MIN: 7.95 / MAX: 41.68MIN: 7.54 / MAX: 24.09MIN: 7.96 / MAX: 14.96MIN: 7.14 / MAX: 16.48MIN: 7.14 / MAX: 16.05MIN: 7.15 / MAX: 16.281. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUabcAMD EPYC 7303 16-Coredefg1.02382.04763.07144.09525.1193.343.343.354.553.242.532.532.53MIN: 2.82 / MAX: 23.64MIN: 2.79 / MAX: 25.65MIN: 2.81 / MAX: 23.74MIN: 2.67 / MAX: 16.04MIN: 2.94 / MAX: 8.15MIN: 2.48 / MAX: 9.57MIN: 2.48 / MAX: 10.15MIN: 2.47 / MAX: 10.121. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUabcAMD EPYC 7303 16-Coredefg81624324023.8123.8523.8633.6220.4419.2519.2519.25MIN: 20.24 / MAX: 65.85MIN: 20.69 / MAX: 64.82MIN: 20.96 / MAX: 60.47MIN: 25.37 / MAX: 42.95MIN: 18.84 / MAX: 37.99MIN: 17.55 / MAX: 32.52MIN: 17.46 / MAX: 28.16MIN: 17.49 / MAX: 27.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUabcAMD EPYC 7303 16-Coredefg4080120160200141.33141.24143.55168.3092.5393.4593.5094.17MIN: 113.19 / MAX: 547.49MIN: 114.93 / MAX: 488.84MIN: 114.18 / MAX: 525.63MIN: 141.17 / MAX: 184.72MIN: 87.83 / MAX: 184.88MIN: 77.59 / MAX: 139.64MIN: 82.68 / MAX: 155.42MIN: 85.17 / MAX: 160.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUabcAMD EPYC 7303 16-Coredefg61218243023.9823.9823.9718.6318.6518.4618.6718.48MIN: 21.19 / MAX: 37.06MIN: 21.31 / MAX: 35.8MIN: 21.4 / MAX: 33.21MIN: 8.99 / MAX: 30.48MIN: 17.81 / MAX: 33.21MIN: 17.85 / MAX: 32.35MIN: 17.84 / MAX: 33.76MIN: 17.82 / MAX: 33.341. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUabcAMD EPYC 7303 16-Coredefg4812162011.8912.0311.8615.3410.809.139.219.11MIN: 10.03 / MAX: 55.71MIN: 10.4 / MAX: 55.41MIN: 9.49 / MAX: 57.72MIN: 9.22 / MAX: 27.56MIN: 9.8 / MAX: 19.62MIN: 8.44 / MAX: 24.1MIN: 8.24 / MAX: 23.34MIN: 8.35 / MAX: 22.581. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUabcAMD EPYC 7303 16-Coredefg306090120150142.22142.42142.29102.8293.16105.22105.23105.33MIN: 111.28 / MAX: 182.41MIN: 106.02 / MAX: 184.44MIN: 110.33 / MAX: 173.87MIN: 69.31 / MAX: 117.98MIN: 86.16 / MAX: 102.67MIN: 91.67 / MAX: 111.86MIN: 92.98 / MAX: 112.15MIN: 94.87 / MAX: 111.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUabcAMD EPYC 7303 16-Coredefg0.19350.3870.58050.7740.96750.850.850.860.680.660.670.700.66MIN: 0.72 / MAX: 27.72MIN: 0.72 / MAX: 21.71MIN: 0.71 / MAX: 40.39MIN: 0.4 / MAX: 11.17MIN: 0.61 / MAX: 6.63MIN: 0.61 / MAX: 10.58MIN: 0.61 / MAX: 10.2MIN: 0.61 / MAX: 10.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUdefg0.60241.20481.80722.40963.0122.677231.742441.698171.84652MIN: 2.34MIN: 1.45MIN: 1.41MIN: 1.331. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUdefg0.96151.9232.88453.8464.80754.273384.104123.839954.05768MIN: 3.64MIN: 3.26MIN: 3.1MIN: 2.861. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPUdefg1.27582.55163.82745.10326.3795.541365.670185.664355.63319MIN: 4.33MIN: 4.65MIN: 4.73MIN: 4.71. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUdefg0.43920.87841.31761.75682.1961.941731.933521.952201.95024MIN: 1.77MIN: 1.72MIN: 1.79MIN: 1.781. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUdefg1.04222.08443.12664.16885.2114.631853.143713.061113.14105MIN: 4.26MIN: 2.85MIN: 2.86MIN: 2.861. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUdefg0.43380.86761.30141.73522.1691.928111.168561.165451.17023MIN: 1.74MIN: 1.1MIN: 1.11MIN: 1.11. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 1D - Data Type: f32 - Engine: CPUdefg0.52781.05561.58342.11122.6392.345651.894051.770642.12070MIN: 2.11MIN: 1.51MIN: 1.42MIN: 1.651. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUdefg0.51411.02821.54232.05642.57051.650901.447491.923482.28469MIN: 1.3MIN: 1.01MIN: 1.39MIN: 1.481. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUdefg1.01552.0313.04654.0625.07754.513333.849164.189743.94733MIN: 2.92MIN: 3.54MIN: 3.58MIN: 3.551. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPUdefg0.25740.51480.77221.02961.2870.7684491.0532401.1437901.086610MIN: 0.6MIN: 0.81MIN: 0.83MIN: 0.861. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUdefg70014002100280035003019.313494.513341.933451.09MIN: 2971.6MIN: 3430.83MIN: 3231.53MIN: 3397.71. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUdefg80016002400320040003037.723379.253281.243556.44MIN: 2984.39MIN: 3265.73MIN: 3185.12MIN: 3506.871. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUdefg70014002100280035003028.363216.133462.903272.36MIN: 2984.7MIN: 3111.44MIN: 3392.2MIN: 3161.821. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUdefg300600900120015001451.201114.671139.541129.54MIN: 1412.26MIN: 1074.44MIN: 1087.78MIN: 1079.671. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUdefg300600900120015001445.861161.801153.451145.62MIN: 1399.09MIN: 1098.59MIN: 1089.33MIN: 1102.841. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUdefg300600900120015001466.251137.111128.301149.15MIN: 1422.8MIN: 1093.13MIN: 1073.3MIN: 1097.471. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper BeamabcAMD EPYC 7303 16-Coredefg306090120150115.89116.73116.30118.33134.32105.44105.68107.04

OpenRadioss

Model: Chrysler Neon 1M

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MabcAMD EPYC 7303 16-Coredefg120240360480600174.49173.59174.45551.24489.75304.03306.37303.58

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop TestabcAMD EPYC 7303 16-Coredefg153045607526.5426.3526.5365.5563.7141.0541.0140.85

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on WindshieldabcAMD EPYC 7303 16-Coredefg50100150200250147.64146.17146.31202.93235.98192.24192.62192.49

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal InstallationabcAMD EPYC 7303 16-Coredefg306090120150130.40134.61131.25102.80129.36118.07120.33122.81

OpenRadioss

Model: INIVOL and Fluid Structure Interaction Drop Container

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop ContainerabcAMD EPYC 7303 16-Coredefg90180270360450132.37129.61132.80357.27429.22302.03305.55307.24

Remhos

Test: Sample Remap Example

OpenBenchmarking.orgSeconds, Fewer Is BetterRemhos 1.0Test: Sample Remap ExampleabcAMD EPYC 7303 16-Coredefg91827364511.2811.0211.7137.3139.7123.4623.4923.721. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0abcAMD EPYC 7303 16-Coredefg30609012015075.6075.7875.84120.85125.9292.4591.9192.531. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2abcAMD EPYC 7303 16-Coredefg142842567041.4240.8442.4160.1964.1548.7248.8448.731. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6abcAMD EPYC 7303 16-Coredefg1.29852.5973.89555.1946.49253.2483.3313.3095.2825.7713.9653.9763.9621. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, LosslessabcAMD EPYC 7303 16-Coredefg36912156.7866.8816.9299.18610.1337.8017.8247.8251. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 10, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 10, LosslessabcAMD EPYC 7303 16-Coredefg2468105.4745.4855.5355.7796.1865.8555.8175.8151. (CXX) g++ options: -O3 -fPIC -lm

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigabcAMD EPYC 7303 16-Coredefg153045607523.8823.9723.9467.4168.6843.4143.4843.32

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigabcAMD EPYC 7303 16-Coredefg2004006008001000182.49179.99179.54815.40830.49462.14462.60462.70

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: BMW27 - Compute: CPU-OnlyabcAMD EPYC 7303 16-Coredefg2040608010016.0816.0816.1989.4594.8650.2150.2550.09

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Classroom - Compute: CPU-OnlyabcAMD EPYC 7303 16-Coredefg5010015020025040.2840.2140.04226.06237.87116.68117.05118.34

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Fishy Cat - Compute: CPU-OnlyabcAMD EPYC 7303 16-Coredefg30609012015020.4420.7320.45109.21116.6662.5262.1862.31

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Barbershop - Compute: CPU-OnlyabcAMD EPYC 7303 16-Coredefg2004006008001000153.78152.94152.50871.17974.94505.43504.18506.55

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Pabellon Barcelona - Compute: CPU-OnlyabcAMD EPYC 7303 16-Coredefg6012018024030049.6649.3248.96280.03296.74155.52157.08157.59

easyWave

Input: e2Asean Grid + BengkuluSept2007 Source - Time: 240

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 240defg0.74051.4812.22152.9623.70253.2912.8312.6722.7661. (CXX) g++ options: -O3 -fopenmp

easyWave

Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200defg153045607565.7355.3460.0556.341. (CXX) g++ options: -O3 -fopenmp

easyWave

Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400defg306090120150149.20140.30130.45133.181. (CXX) g++ options: -O3 -fopenmp


Phoronix Test Suite v10.8.5