GCE c3d-standard-60

KVM testing on Ubuntu 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2310148-NE-2310093NE34&rdt&grs.

GCE c3d-standard-60ProcessorMotherboardChipsetMemoryDiskNetworkOSKernelVulkanCompilerFile-SystemSystem Layerc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56AMD EPYC 9B14 (30 Cores / 60 Threads)Google Compute Engine c3d-standard-60Intel 440FX 82441FX PMC240GB215GB nvme_card-pdGoogle Compute Engine VirtualUbuntu 22.046.2.0-1014-gcp (x86_64)1.3.238GCC 11.4.0ext4KVMAMD EPYC 7B13 (60 Cores)Google Compute Engine t2d-standard-60215GB PersistentDiskRed Hat Virtio deviceARMv8 Neoverse-N1 (64 Cores)Amazon EC2 c6g.16xlarge (1.0 BIOS)Amazon Device 0200128GB215GB Amazon Elastic Block StoreAmazon Elastic5.19.0-1025-aws (aarch64)amazonAMD EPYC 9R14 (64 Cores)Amazon EC2 m7a.16xlarge (1.0 BIOS)Intel 440FX 82441FX PMC256GB5.19.0-1025-aws (x86_64)ARMv8 Neoverse-V1 (64 Cores)Amazon EC2 c7g.16xlarge (1.0 BIOS)Amazon Device 0200128GB5.19.0-1025-aws (aarch64)AMD EPYC 7B13 (28 Cores / 56 Threads)Google Compute Engine c2d-standard-56Intel 440FX 82441FX PMC224GB215GB PersistentDiskRed Hat Virtio device6.2.0-1014-gcp (x86_64)KVMOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- c3d-standard-60 AMD Genoa: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - t2d-standard-60 AMD Milan: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - c6g.16xlarge: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - m7a.16xlarge: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - c7g.16xlarge: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - c2d-standard-56: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- c3d-standard-60 AMD Genoa: CPU Microcode: 0xffffffff- t2d-standard-60 AMD Milan: CPU Microcode: 0xffffffff- m7a.16xlarge: CPU Microcode: 0xa10113e- c2d-standard-56: CPU Microcode: 0xffffffffJava Details- OpenJDK Runtime Environment (build 11.0.20.1+1-post-Ubuntu-0ubuntu122.04)Python Details- Python 3.10.12Security Details- c3d-standard-60 AMD Genoa: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - t2d-standard-60 AMD Milan: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - c6g.16xlarge: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected - m7a.16xlarge: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - c7g.16xlarge: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected - c2d-standard-56: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

GCE c3d-standard-60openvino: Face Detection FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUnpb: BT.Copenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUnpb: FT.Ctensorflow: CPU - 64 - ResNet-50npb: MG.Cavifenc: 2nekrs: Kershawopenssl: ChaCha20-Poly1305openssl: RSA4096openssl: ChaCha20openssl: AES-128-GCMnpb: IS.Dopenssl: AES-256-GCMtensorflow: CPU - 32 - ResNet-50avifenc: 0openvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection FP16 - CPUtensorflow: CPU - 16 - ResNet-50build-linux-kernel: defconfignpb: EP.Dnpb: CG.Copenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUpgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 1000 - Read Onlypgbench: 100 - 800 - Read Onlypgbench: 100 - 800 - Read Only - Average Latencygromacs: MPI CPU - water_GMX50_barelibxsmm: 32libxsmm: 64openssl: SHA512nekrs: TurboPipe Periodicincompact3d: input.i3d 193 Cells Per Directionremhos: Sample Remap Examplerodinia: OpenMP Streamclusterrodinia: OpenMP CFD Solverheffte: c2c - FFTW - double - 128lammps: Rhodopsin Proteinincompact3d: input.i3d 129 Cells Per Directionamg: openvino: Face Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenssl: RSA4096openvino: Weld Porosity Detection FP16 - CPUnpb: LU.Cnpb: SP.Clammps: 20k Atomsheffte: c2c - FFTW - float - 128heffte: r2c - FFTW - float - 128brl-cad: VGR Performance Metricopenradioss: Chrysler Neon 1Mbuild-nodejs: Time To Compilecoremark: CoreMark Size 666 - Iterations Per Secondcassandra: Writesblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlylaghos: Sedov Blast Wave, ube_922_hex.meshblender: Barbershop - CPU-Onlybuild-linux-kernel: allmodconfigavifenc: 6stockfish: Total Timenginx: 1000blender: Pabellon Barcelona - CPU-Onlyrodinia: OpenMP LavaMDheffte: r2c - FFTW - double - 128blender: Fishy Cat - CPU-Onlynginx: 500avifenc: 6, Losslessopenssl: SHA256build-gem5: Time To Compilecompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingrodinia: OpenMP Leukocytelaghos: Triple Point Problemapache-iotdb: 500 - 100 - 800 - 400apache-iotdb: 800 - 100 - 800 - 400apache-iotdb: 800 - 100 - 500 - 400apache-iotdb: 800 - 100 - 500 - 400apache-iotdb: 500 - 100 - 500 - 400apache-iotdb: 500 - 100 - 500 - 400pgbench: 100 - 1000 - Read Writeapache-iotdb: 500 - 100 - 800 - 400rodinia: OpenMP HotSpot3Dpgbench: 100 - 800 - Read Writeapache-iotdb: 800 - 100 - 800 - 400pgbench: 100 - 1000 - Read Write - Average Latencypgbench: 100 - 800 - Read Write - Average Latencyopenradioss: Rubber O-Ring Seal Installationopenradioss: Bird Strike on Windshieldopenradioss: Cell Phone Drop Testopenradioss: Bumper Beamc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56340.29645.744.5396257.4854971.26964.4618.56761.1443607.041764.21576.9439647.4769.6842701.8341.5384289858333123909304773493077.61739809498933430952844402422.4029332804849762.7478.0681875.281389.698.204166.3918.3950.993783.6019597.860.4142.75142.902043.056.7920.77185.298.626605.122.874.391255.4489.714702270573472394000028.019687733.3626.44810.02557.311617.4235.87157885962889833648.8131.085.8683.9983.9135.1939.380.5264.703650.5720079.515.9873563.1339919.7119.77688.6301148.575510819337.70198.3941445843.521552228640259.553.250105894457180537.8464.86293.6005187350.446.88946211821313176.76727179522621145.498209.003476256535359884447.6834332237418.5933268158623.8984.166682.1289.65147.3138.8292.87568.77565.343.52122720.6144049.15370.0326.50390.7229668.12633.76225.4854846.1820.9047291.9641.9893681935833119647720337860844.61802491457702346040826101752.6221602596764020.3678.3501014.70368.3911.321285.4710.7318.2933.3994935.6816649.370.6173.7478.961512.5723.6466.4696.5840.674239.5211.650.498200818620037840.3995.289289.2554.222244804183273062000024.572118116.3266.4237.36860.034327.8285.630573279204277671393.5681.009.90208.47193.4526.2876.720.99155.142646.5812973.014.7694247.7743228.1126.734109.676196.948629363327.88191.7061730658.44944018716934.2789.35364.64351.58333.3513.205112958788155609.04112.6450.974106.02945.22162957.757.63950884997103170.93027897324725542.010222.303492589935068557433.9634123810415.08334668045793633.5888.5355682709.46172.717140.91672.06123.6130.1275.6822391.860.152186.8124229.14136.162.536773.312.36178.827.362.6121386.3725661.04167.946175886000046715126487215683.267324778360158788510970915.80129198197600270.0688.396.53181.9420.790.1102.2162213.7613343.357.331.061.060.14135.87382.471.36153.120.4648.081.02697503110432670.7672.766312.7589.514384917863222171000025.874832820.81614.2125.98332.357526.0415.6181168610328936679996.56394.946990.10947.59947.860.04423.955.58735.585.502640.0119.1718807.759716.9925.059129.172202.445286.2011259870.716902217355321.29409.0974.46781807706158700.3662.30179.0156162553.858.87942288513973224.414239735234046179.5247764784210.608168.191261.111222.993.07193219.1292100.801419.1113.071158.4381996.813146.041049.66103413.02100.15121293.8035.8057667846667216773475533996017.53083080450835925453627404085.2052211308052787.1965.4473132.482417.345.167222.1031.7269.5527.7097501.7642007.570.27284.42283.403666.895.0715.22315.146.6010382.222.210.347288094029230090.2747.655643.41201.826481506820477479666711.591308613.8675.9306.48071.109532.7852.896026611843444333503.3822.534.3556.2156.4161.1927.600.3850.726177.9431583.810.19210544.87102392.4031.471121.505190.602788704190.79154.4412158639.27488327858527.7471.51409.73276.23267.9652.649135419169224859.0991.8843.286124.36337.12233014.725.67862253861197153.80033063328259334.661218.864450233344699315355.1342643903340.11408992105300521.9874.7785312598.49188.676150.60159.18115.9626.1466.2712852.080.261255.0238934.15180.792.533871.332.44258.5910.154.5139830.1849799.57102.081325216666774306515763713624.41032346086833323451119831797.76283187826230170.58714.3111.19109.9933.230.1880.3473648.4322031.275.521.811.810.2598.57221.502.3289.360.830.080.770129852713143170.6094.194494.2785.032045616820399173666713.791938814.25811.4574.35352.477937.4623.1587883717673490005639.78395.913957.74554.28553.520.08410.003.86431.909.0910181.169.8928356.7017223.9536.725175.729291.966236.4821608877.078630316573409.66316.0053.178119502473255540.0343.905127.985254864.935.91454438555170179.999310517285523231.8553425348187.188149.597868.35466.414.3694143.8535877.14280.2629.99301.6021951.031022.81322.2747216.0521.8254301.2546.541819529333382221279643468650.61208253059531295487666872190.3911840259574021.4888.810689.56701.0017.692215.747.2520.0041.1682579.9223089.420.682.4782.471089.8313.6643.3993.2319.943195.586.300.669149444515099870.5303.951306.3581.113104599007543108333325.415339124.6436.6589.34361.184618.0286.144091929818772671914.2799.8112.83169.57169.6216.0392.771.25149.971581.237181.420.2878848.0848423.5218.369104.534164.720410738363.60231.3841212209.81928017822749.01125.73239.48468.20452.7483.80284017019161127.09150.0670.15799.648059.22160196.248.08039825794840192.60123043020819246.741199.803546071335377376414.4034625899408.13333959685820629.0090.7365702679.86171.947140.41069.43146.5636.8498.45OpenBenchmarking.org

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-565K10K15K20K25KSE +/- 0.21, N = 3SE +/- 0.35, N = 3SE +/- 15.60, N = 3SE +/- 0.03, N = 3SE +/- 5.72, N = 3SE +/- 0.38, N = 3340.29568.7722391.86261.1112852.08868.35-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 22364.17 / MAX: 22423.42-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 12821.62 / MAX: 12882.021. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5630060090012001500SE +/- 0.79, N = 3SE +/- 0.37, N = 3SE +/- 0.00, N = 3SE +/- 0.51, N = 3SE +/- 0.00, N = 3SE +/- 1.07, N = 3645.74565.340.151222.990.26466.41-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-565001000150020002500SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 27.29, N = 3SE +/- 0.00, N = 3SE +/- 0.23, N = 3SE +/- 0.00, N = 34.533.522186.813.071255.024.36-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 2135.06 / MAX: 2233.34-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 1251.83 / MAX: 1261.91. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

NAS Parallel Benchmarks

Test / Class: BT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: BT.Cc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5640K80K120K160K200KSE +/- 122.23, N = 3SE +/- 42.77, N = 3SE +/- 7.69, N = 3SE +/- 560.75, N = 3SE +/- 19.48, N = 3SE +/- 80.45, N = 396257.48122720.6124229.14193219.1238934.1594143.851. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5620K40K60K80K100KSE +/- 45.46, N = 3SE +/- 332.93, N = 3SE +/- 0.48, N = 3SE +/- 453.62, N = 3SE +/- 0.71, N = 3SE +/- 26.90, N = 354971.2644049.15136.1692100.80180.7935877.14-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5630060090012001500SE +/- 0.60, N = 3SE +/- 0.96, N = 3SE +/- 0.02, N = 3SE +/- 0.70, N = 3SE +/- 0.01, N = 3SE +/- 0.37, N = 3964.46370.032.531419.112.53280.26-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5615003000450060007500SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 76.95, N = 3SE +/- 0.01, N = 3SE +/- 0.51, N = 3SE +/- 0.07, N = 318.5626.506773.3113.073871.3329.99-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 6616.83 / MAX: 6859.99-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 3868.49 / MAX: 3876.891. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-562004006008001000SE +/- 1.75, N = 3SE +/- 1.37, N = 3SE +/- 0.00, N = 3SE +/- 0.18, N = 3SE +/- 0.02, N = 3SE +/- 2.14, N = 3761.14390.722.361158.432.44301.60-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5620K40K60K80K100KSE +/- 18.42, N = 3SE +/- 14.46, N = 3SE +/- 0.39, N = 3SE +/- 31.79, N = 3SE +/- 0.88, N = 3SE +/- 3.74, N = 343607.0429668.12178.8281996.81258.5921951.03-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-567001400210028003500SE +/- 4.38, N = 3SE +/- 3.66, N = 3SE +/- 0.01, N = 3SE +/- 1.10, N = 3SE +/- 0.02, N = 3SE +/- 1.21, N = 31764.21633.767.363146.0410.151022.81-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-562004006008001000SE +/- 1.04, N = 3SE +/- 0.93, N = 3SE +/- 0.00, N = 3SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 2.90, N = 3576.94225.482.611049.664.51322.27-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

NAS Parallel Benchmarks

Test / Class: FT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: FT.Cc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5620K40K60K80K100KSE +/- 600.19, N = 15SE +/- 137.77, N = 3SE +/- 2.85, N = 3SE +/- 446.85, N = 3SE +/- 13.54, N = 3SE +/- 57.93, N = 339647.4754846.1821386.37103413.0239830.1847216.051. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-5620406080100SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 369.6820.90100.1521.82

NAS Parallel Benchmarks

Test / Class: MG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.Cc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5630K60K90K120K150KSE +/- 29.69, N = 3SE +/- 145.06, N = 3SE +/- 10.99, N = 3SE +/- 526.14, N = 3SE +/- 10.47, N = 3SE +/- 99.78, N = 342701.8347291.9625661.04121293.8049799.5754301.251. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-564080120160200SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.22, N = 3SE +/- 0.22, N = 3SE +/- 0.13, N = 3SE +/- 0.04, N = 341.5441.99167.9535.81102.0846.541. (CXX) g++ options: -O3 -fPIC -lm

nekRS

Input: Kershaw

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: Kershawc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-562000M4000M6000M8000M10000MSE +/- 57202190.49, N = 12SE +/- 84802173.02, N = 12SE +/- 2970005.61, N = 3SE +/- 49077561.86, N = 3SE +/- 2525353.66, N = 3SE +/- 88231529.95, N = 34289858333368193583317588600007667846667325216666781952933331. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

OpenSSL

Algorithm: ChaCha20-Poly1305

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: ChaCha20-Poly1305c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5650000M100000M150000M200000M250000MSE +/- 3664727.47, N = 3SE +/- 198663058.81, N = 3SE +/- 2259404.37, N = 3SE +/- 85099636.22, N = 3SE +/- 814473.51, N = 3SE +/- 25534569.58, N = 3123909304773119647720337467151264872167734755337430651576382221279643-m64 -lssl -lcrypto-m64 -lssl -lcrypto-m64 -lssl -lcrypto-lssl -lcrypto-m641. (CC) gcc options: -pthread -O3 -ldl

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.1Algorithm: RSA4096c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56200K400K600K800K1000KSE +/- 50.91, N = 3SE +/- 644.45, N = 3SE +/- 6.55, N = 3SE +/- 367.82, N = 3SE +/- 189.99, N = 3SE +/- 418.00, N = 3493077.6860844.6215683.2996017.5713624.4468650.6-m64 -lssl -lcrypto-m64 -lssl -lcrypto-lssl -lcrypto-m64 -lssl -lcrypto-lssl -lcrypto-m641. (CC) gcc options: -pthread -O3 -ldl

OpenSSL

Algorithm: ChaCha20

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: ChaCha20c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5670000M140000M210000M280000M350000MSE +/- 12326205.97, N = 3SE +/- 47698640.87, N = 3SE +/- 372419.81, N = 3SE +/- 280681661.27, N = 3SE +/- 926708.87, N = 3SE +/- 13175767.44, N = 317398094989318024914577067324778360308308045083103234608683120825305953-m64 -lssl -lcrypto-m64 -lssl -lcrypto-m64 -lssl -lcrypto-lssl -lcrypto-m641. (CC) gcc options: -pthread -O3 -ldl

OpenSSL

Algorithm: AES-128-GCM

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: AES-128-GCMc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56130000M260000M390000M520000M650000MSE +/- 342949201.09, N = 3SE +/- 376720190.05, N = 3SE +/- 5537993.15, N = 3SE +/- 1818538727.73, N = 3SE +/- 38386470.30, N = 3SE +/- 2205754.73, N = 3343095284440234604082610158788510970592545362740332345111983129548766687-m64 -lssl -lcrypto-m64 -lssl -lcrypto-m64 -lssl -lcrypto-lssl -lcrypto1. (CC) gcc options: -pthread -O3 -ldl

NAS Parallel Benchmarks

Test / Class: IS.D

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: IS.Dc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-569001800270036004500SE +/- 36.45, N = 15SE +/- 142.62, N = 12SE +/- 0.58, N = 3SE +/- 3.14, N = 3SE +/- 1.25, N = 3SE +/- 3.14, N = 32422.401752.62915.804085.201797.762190.391. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

OpenSSL

Algorithm: AES-256-GCM

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: AES-256-GCMc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56110000M220000M330000M440000M550000MSE +/- 71241287.97, N = 3SE +/- 178290221.71, N = 3SE +/- 2100313.05, N = 3SE +/- 1691817104.57, N = 3SE +/- 10793448.32, N = 3SE +/- 18032723.86, N = 3293328048497216025967640129198197600522113080527283187826230118402595740-m64 -lssl -lcrypto-m64 -lssl -lcrypto-m64 -lssl -lcrypto-lssl -lcrypto1. (CC) gcc options: -pthread -O3 -ldl

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 32 - Model: ResNet-50c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-5620406080100SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 362.7420.3687.1921.48

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5660120180240300SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.34, N = 3SE +/- 0.10, N = 3SE +/- 0.42, N = 3SE +/- 0.31, N = 378.0778.35270.0765.45170.5988.811. (CXX) g++ options: -O3 -fPIC -lm

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-567001400210028003500SE +/- 0.47, N = 3SE +/- 0.56, N = 3SE +/- 0.01, N = 3SE +/- 0.31, N = 3SE +/- 0.00, N = 3SE +/- 0.77, N = 31875.281014.708.393132.4814.31689.56-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-565001000150020002500SE +/- 6.33, N = 3SE +/- 1.55, N = 3SE +/- 0.01, N = 3SE +/- 1.65, N = 3SE +/- 0.01, N = 3SE +/- 0.69, N = 31389.69368.396.532417.3411.19701.00-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-564080120160200SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.24, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 38.2011.32181.945.16109.9917.69-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 180.71 / MAX: 184.11-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 108.37 / MAX: 112.831. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5615003000450060007500SE +/- 8.74, N = 3SE +/- 15.96, N = 3SE +/- 0.01, N = 3SE +/- 4.07, N = 3SE +/- 0.02, N = 3SE +/- 3.06, N = 34166.391285.4720.797222.1033.232215.74-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56714212835SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 318.3910.730.1031.720.187.25-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-561530456075SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 350.9918.2969.5520.00

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigt2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5620406080100SE +/- 0.37, N = 5SE +/- 0.82, N = 3SE +/- 0.29, N = 5SE +/- 0.65, N = 3SE +/- 0.54, N = 333.40102.2227.7180.3541.17

NAS Parallel Benchmarks

Test / Class: EP.D

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.Dc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5616003200480064008000SE +/- 30.67, N = 3SE +/- 51.21, N = 5SE +/- 7.28, N = 3SE +/- 8.54, N = 3SE +/- 25.41, N = 13SE +/- 36.32, N = 33783.604935.682213.767501.763648.432579.921. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: CG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.Cc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-569K18K27K36K45KSE +/- 77.92, N = 3SE +/- 1215.82, N = 15SE +/- 23.52, N = 3SE +/- 178.46, N = 3SE +/- 25.33, N = 3SE +/- 206.16, N = 719597.8616649.3713343.3542007.5722031.2723089.421. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 30.400.617.330.275.520.60-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 6.54 / MAX: 9.95-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 4.5 / MAX: 9.531. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5660120180240300SE +/- 0.23, N = 3SE +/- 3.12, N = 15SE +/- 0.00, N = 3SE +/- 0.53, N = 3SE +/- 0.00, N = 3SE +/- 0.13, N = 3142.7573.741.06284.421.8182.47-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5660120180240300SE +/- 0.48, N = 3SE +/- 2.74, N = 15SE +/- 0.00, N = 3SE +/- 0.29, N = 3SE +/- 0.00, N = 3SE +/- 0.14, N = 3142.9078.961.06283.401.8182.47-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-568001600240032004000SE +/- 3.16, N = 3SE +/- 1.12, N = 3SE +/- 0.00, N = 15SE +/- 1.69, N = 3SE +/- 0.00, N = 3SE +/- 1.05, N = 32043.051512.570.143666.890.251089.83-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56306090120150SE +/- 0.02, N = 3SE +/- 0.14, N = 3SE +/- 0.21, N = 3SE +/- 0.00, N = 3SE +/- 0.21, N = 3SE +/- 0.02, N = 36.7923.64135.875.0798.5713.66-pie - MIN: 9.57 / MAX: 42.22-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 132.35 / MAX: 148.64-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 94.4 / MAX: 118.881. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5680160240320400SE +/- 0.04, N = 3SE +/- 0.27, N = 3SE +/- 0.20, N = 3SE +/- 0.00, N = 3SE +/- 0.13, N = 3SE +/- 0.39, N = 320.7766.46382.4715.22221.5043.39-pie - MIN: 25.85 / MAX: 122.2-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 381.67 / MAX: 383.43-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 220.78 / MAX: 223.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5670140210280350SE +/- 0.25, N = 3SE +/- 0.37, N = 3SE +/- 0.00, N = 3SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3185.2996.581.36315.142.3293.23-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56306090120150SE +/- 0.04, N = 3SE +/- 0.17, N = 3SE +/- 0.09, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 38.6240.67153.126.6089.3619.94-pie - MIN: 12.07 / MAX: 59.44-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 152.69 / MAX: 153.75-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 88.98 / MAX: 90.65-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem - MIN: 10.34 / MAX: 37.941. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-562K4K6K8K10KSE +/- 6.52, N = 3SE +/- 2.08, N = 3SE +/- 0.01, N = 3SE +/- 3.60, N = 3SE +/- 0.00, N = 3SE +/- 2.82, N = 36605.124239.520.4610382.220.803195.58-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-561122334455SE +/- 0.01, N = 3SE +/- 0.14, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 32.8711.6548.082.2130.086.30-pie - MIN: 3.76 / MAX: 29.1-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 47.55 / MAX: 50.49-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 29.37 / MAX: 32.17-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem - MIN: 3.57 / MAX: 21.51. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latencyt2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-560.23090.46180.69270.92361.1545SE +/- 0.006, N = 3SE +/- 0.013, N = 3SE +/- 0.000, N = 3SE +/- 0.007, N = 3SE +/- 0.004, N = 30.4981.0260.3470.7700.6691. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Onlyt2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56600K1200K1800K2400K3000KSE +/- 22497.42, N = 3SE +/- 12606.16, N = 3SE +/- 2874.04, N = 3SE +/- 11830.85, N = 3SE +/- 9220.12, N = 320081869750312880940129852714944451. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Onlyt2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56600K1200K1800K2400K3000KSE +/- 20558.90, N = 3SE +/- 12058.27, N = 3SE +/- 13309.30, N = 3SE +/- 14241.12, N = 3SE +/- 20718.28, N = 3200378410432672923009131431715099871. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latencyt2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-560.17260.34520.51780.69040.863SE +/- 0.004, N = 3SE +/- 0.009, N = 3SE +/- 0.001, N = 3SE +/- 0.007, N = 3SE +/- 0.007, N = 30.3990.7670.2740.6090.5301. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2023Implementation: MPI CPU - Input: water_GMX50_barec3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56246810SE +/- 0.011, N = 3SE +/- 0.005, N = 3SE +/- 0.001, N = 3SE +/- 0.035, N = 3SE +/- 0.003, N = 3SE +/- 0.005, N = 34.3915.2892.7667.6554.1943.9511. (CXX) g++ options: -O3

libxsmm

M N K: 32

OpenBenchmarking.orgGFLOPS/s, More Is Betterlibxsmm 2-1.17-3645M N K: 32c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56140280420560700SE +/- 0.19, N = 3SE +/- 3.60, N = 4SE +/- 0.47, N = 3SE +/- 0.40, N = 3SE +/- 0.07, N = 3SE +/- 0.38, N = 3255.4289.2312.7643.4494.2306.3-lquadmath -msse4.2-lquadmath -msse4.2-march=armv8.1-a-lquadmath -msse4.2-march=armv8.1-a-lquadmath -msse4.21. (CXX) g++ options: -dynamic -Bstatic -static-libgcc -lgomp -lm -lrt -ldl -lstdc++ -pthread -fPIC -std=c++14 -O2 -fopenmp-simd -funroll-loops -ftree-vectorize -fdata-sections -ffunction-sections -fvisibility=hidden

libxsmm

M N K: 64

OpenBenchmarking.orgGFLOPS/s, More Is Betterlibxsmm 2-1.17-3645M N K: 64c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5630060090012001500SE +/- 0.12, N = 3SE +/- 0.25, N = 3SE +/- 0.96, N = 3SE +/- 0.52, N = 3SE +/- 0.03, N = 3SE +/- 1.99, N = 3489.7554.2589.51201.8785.0581.1-lquadmath -msse4.2-lquadmath -msse4.2-march=armv8.1-a-lquadmath -msse4.2-march=armv8.1-a-lquadmath -msse4.21. (CXX) g++ options: -dynamic -Bstatic -static-libgcc -lgomp -lm -lrt -ldl -lstdc++ -pthread -fPIC -std=c++14 -O2 -fopenmp-simd -funroll-loops -ftree-vectorize -fdata-sections -ffunction-sections -fvisibility=hidden

OpenSSL

Algorithm: SHA512

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: SHA512c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-567000M14000M21000M28000M35000MSE +/- 4399663.13, N = 3SE +/- 108274834.92, N = 3SE +/- 6214593.12, N = 3SE +/- 29763937.73, N = 3SE +/- 9797429.91, N = 3SE +/- 631939.37, N = 3147022705732224480418314384917863264815068203204561682013104599007-m64 -lssl -lcrypto-m64 -lssl -lcrypto-lssl -lcrypto-m64 -lssl -lcrypto-lssl -lcrypto-m641. (CC) gcc options: -pthread -O3 -ldl

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: TurboPipe Periodicc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-561200M2400M3600M4800M6000MSE +/- 201939132.13, N = 12SE +/- 481352.26, N = 3SE +/- 1790009.31, N = 3SE +/- 6657808.28, N = 3SE +/- 1792766.33, N = 3SE +/- 4494968.79, N = 34723940000273062000022217100004774796667399173666754310833331. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

Xcompact3d Incompact3d

Input: input.i3d 193 Cells Per Direction

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per Directionc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56714212835SE +/- 0.25, N = 3SE +/- 0.31, N = 12SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 328.0224.5725.8711.5913.7925.421. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

Remhos

Test: Sample Remap Example

OpenBenchmarking.orgSeconds, Fewer Is BetterRemhos 1.0Test: Sample Remap Examplec3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56816243240SE +/- 0.17, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 333.3616.3320.8213.8714.2624.641. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Rodinia

Test: OpenMP Streamcluster

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP Streamclusterc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5648121620SE +/- 0.104, N = 15SE +/- 0.009, N = 3SE +/- 0.017, N = 3SE +/- 0.049, N = 3SE +/- 0.124, N = 3SE +/- 0.009, N = 36.4486.42314.2125.93011.4576.6581. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP CFD Solver

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP CFD Solverc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-563691215SE +/- 0.013, N = 3SE +/- 0.034, N = 3SE +/- 0.001, N = 3SE +/- 0.007, N = 3SE +/- 0.011, N = 3SE +/- 0.013, N = 310.0257.3685.9836.4804.3539.3431. (CXX) g++ options: -O2 -lOpenCL

HeFFTe - Highly Efficient FFT for Exascale

Test: c2c - Backend: FFTW - Precision: double - X Y Z: 128

OpenBenchmarking.orgGFLOP/s, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: c2c - Backend: FFTW - Precision: double - X Y Z: 128c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-561632486480SE +/- 1.29, N = 15SE +/- 0.66, N = 3SE +/- 0.10, N = 3SE +/- 0.63, N = 15SE +/- 0.00, N = 3SE +/- 0.78, N = 1557.3160.0332.3671.1152.4861.181. (CXX) g++ options: -O3

LAMMPS Molecular Dynamics Simulator

Model: Rhodopsin Protein

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin Proteinc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56918273645SE +/- 0.54, N = 12SE +/- 0.17, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.13, N = 317.4227.8326.0432.7937.4618.03-lm-lm-lm-lm1. (CXX) g++ options: -O3 -ldl

Xcompact3d Incompact3d

Input: input.i3d 129 Cells Per Direction

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 129 Cells Per Directionc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56246810SE +/- 0.04970425, N = 3SE +/- 0.02210564, N = 3SE +/- 0.01888616, N = 3SE +/- 0.03993251, N = 3SE +/- 0.01236463, N = 3SE +/- 0.02575719, N = 35.871578855.630573275.618116862.896026613.158788376.144091921. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

Algebraic Multi-Grid Benchmark

OpenBenchmarking.orgFigure Of Merit, More Is BetterAlgebraic Multi-Grid Benchmark 1.2c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56400M800M1200M1600M2000MSE +/- 2060519.90, N = 3SE +/- 1088162.98, N = 3SE +/- 176147.98, N = 3SE +/- 1428129.35, N = 3SE +/- 536620.29, N = 3SE +/- 999273.29, N = 39628898339204277671032893667184344433317673490009818772671. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-562K4K6K8K10KSE +/- 0.17, N = 3SE +/- 1.32, N = 3SE +/- 1.02, N = 3SE +/- 0.12, N = 3SE +/- 1.45, N = 3SE +/- 3.85, N = 3648.811393.569996.56503.385639.781914.27-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 9993.58 / MAX: 10001.76-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 5635.22 / MAX: 5646.39-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem - MIN: 1788.62 / MAX: 2033.221. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5690180270360450SE +/- 0.02, N = 3SE +/- 0.21, N = 3SE +/- 2.18, N = 3SE +/- 0.01, N = 3SE +/- 1.65, N = 3SE +/- 0.13, N = 331.0881.00394.9422.53395.9199.81-pie - MIN: 64.65 / MAX: 134.64-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 380.82 / MAX: 408.15-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 380.35 / MAX: 415.38-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem - MIN: 55.12 / MAX: 150.041. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5615003000450060007500SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 27.09, N = 15SE +/- 0.00, N = 3SE +/- 1.04, N = 3SE +/- 0.01, N = 35.869.906990.104.353957.7412.83-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 6842.82 / MAX: 7088.53-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 3952.99 / MAX: 3967.181. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-562004006008001000SE +/- 0.13, N = 3SE +/- 9.17, N = 15SE +/- 0.37, N = 3SE +/- 0.10, N = 3SE +/- 0.71, N = 3SE +/- 0.29, N = 383.99208.47947.5956.21554.28169.57-pie - MIN: 119.65 / MAX: 316.01-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 943.57 / MAX: 951.68-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 550.22 / MAX: 563.55-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem - MIN: 94.4 / MAX: 218.71. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-562004006008001000SE +/- 0.29, N = 3SE +/- 7.79, N = 15SE +/- 0.55, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.29, N = 383.91193.45947.8656.41553.52169.62-pie - MIN: 113.44 / MAX: 315.54-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 944.57 / MAX: 958.26-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 549.89 / MAX: 562.06-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem - MIN: 104.86 / MAX: 209.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-561428425670SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 335.1926.280.0461.190.0816.03-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5690180270360450SE +/- 0.09, N = 3SE +/- 0.27, N = 3SE +/- 0.26, N = 3SE +/- 0.01, N = 3SE +/- 3.34, N = 3SE +/- 0.65, N = 339.3876.72423.9527.60410.0092.77-pie - MIN: 58.8 / MAX: 121.69-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 411.17 / MAX: 440.57-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 391.1 / MAX: 424.93-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem - MIN: 51.49 / MAX: 118.721. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-561.25552.5113.76655.0226.2775SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 30.520.995.580.383.861.25-pie - MIN: 0.8 / MAX: 13.76-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 5.45 / MAX: 6.48-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 3.63 / MAX: 5.36-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem - MIN: 0.71 / MAX: 15.891. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56160320480640800SE +/- 0.09, N = 3SE +/- 0.58, N = 3SE +/- 0.26, N = 3SE +/- 0.02, N = 3SE +/- 0.24, N = 3SE +/- 0.04, N = 364.70155.14735.5850.72431.90149.97-pie - MIN: 114.75 / MAX: 224.64-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 734.34 / MAX: 738.23-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 430.12 / MAX: 435.25-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem - MIN: 81.05 / MAX: 193.41. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5613002600390052006500SE +/- 3.28, N = 3SE +/- 3.26, N = 3SE +/- 0.01, N = 3SE +/- 4.43, N = 3SE +/- 0.00, N = 3SE +/- 0.68, N = 33650.572646.585.506177.949.091581.23-pie-pie-pie-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.1Algorithm: RSA4096c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-567K14K21K28K35KSE +/- 14.62, N = 3SE +/- 11.58, N = 3SE +/- 0.09, N = 3SE +/- 24.57, N = 3SE +/- 1.56, N = 3SE +/- 0.44, N = 320079.512973.02640.031583.810181.17181.4-m64 -lssl -lcrypto-m64 -lssl -lcrypto-m64 -lssl -lcrypto-lssl -lcrypto-m641. (CC) gcc options: -pthread -O3 -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56306090120150SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 315.9814.76119.1710.1969.8920.28-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 118.73 / MAX: 120.21-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF - MIN: 69.44 / MAX: 71.41-fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF -isystem - MIN: 14.46 / MAX: 30.61. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

NAS Parallel Benchmarks

Test / Class: LU.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.Cc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5650K100K150K200K250KSE +/- 293.57, N = 3SE +/- 1463.52, N = 15SE +/- 7.52, N = 3SE +/- 661.61, N = 3SE +/- 30.15, N = 3SE +/- 22.13, N = 373563.1394247.7718807.75210544.8728356.7078848.081. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: SP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.Cc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5620K40K60K80K100KSE +/- 45.01, N = 3SE +/- 555.92, N = 3SE +/- 0.76, N = 3SE +/- 91.17, N = 3SE +/- 40.05, N = 3SE +/- 113.84, N = 339919.7143228.119716.99102392.4017223.9548423.521. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

LAMMPS Molecular Dynamics Simulator

Model: 20k Atoms

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k Atomsc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56816243240SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 319.7826.7325.0631.4736.7318.37-lm-lm-lm-lm1. (CXX) g++ options: -O3 -ldl

HeFFTe - Highly Efficient FFT for Exascale

Test: c2c - Backend: FFTW - Precision: float - X Y Z: 128

OpenBenchmarking.orgGFLOP/s, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: c2c - Backend: FFTW - Precision: float - X Y Z: 128c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-564080120160200SE +/- 0.52, N = 3SE +/- 0.78, N = 3SE +/- 0.11, N = 3SE +/- 1.44, N = 15SE +/- 0.44, N = 3SE +/- 1.06, N = 388.63109.68129.17121.51175.73104.531. (CXX) g++ options: -O3

HeFFTe - Highly Efficient FFT for Exascale

Test: r2c - Backend: FFTW - Precision: float - X Y Z: 128

OpenBenchmarking.orgGFLOP/s, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: r2c - Backend: FFTW - Precision: float - X Y Z: 128c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5660120180240300SE +/- 2.19, N = 12SE +/- 0.82, N = 3SE +/- 0.57, N = 3SE +/- 2.16, N = 15SE +/- 0.59, N = 3SE +/- 1.51, N = 6148.58196.95202.45190.60291.97164.721. (CXX) g++ options: -O3

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.36VGR Performance Metricc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-56200K400K600K800K1000K5108196293637887044107381. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

OpenRadioss

Model: Chrysler Neon 1M

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1Mc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-5680160240320400SE +/- 2.03, N = 3SE +/- 1.48, N = 3SE +/- 0.61, N = 3SE +/- 0.14, N = 3337.70327.88190.79363.60

Timed Node.js Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1Time To Compilec3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5660120180240300SE +/- 0.29, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.31, N = 3SE +/- 0.26, N = 3198.39191.71286.20154.44236.48231.38

Coremark

CoreMark Size 666 - Iterations Per Second

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per Secondc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56500K1000K1500K2000K2500KSE +/- 1295.68, N = 3SE +/- 9191.61, N = 3SE +/- 635.29, N = 3SE +/- 1437.63, N = 3SE +/- 11587.63, N = 15SE +/- 833.48, N = 31445843.521730658.451259870.722158639.271608877.081212209.821. (CC) gcc options: -O2 -lrt" -lrt

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.1.3Test: Writesc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5670K140K210K280K350KSE +/- 1129.40, N = 3SE +/- 681.76, N = 3SE +/- 3249.94, N = 12SE +/- 352.65, N = 3SE +/- 2261.70, N = 3SE +/- 1718.54, N = 3228640187169217355278585316573178227

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: BMW27 - Compute: CPU-Onlyt2d-standard-60 AMD Milanm7a.16xlargec2d-standard-561122334455SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 334.2727.7449.01

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Classroom - Compute: CPU-Onlyt2d-standard-60 AMD Milanm7a.16xlargec2d-standard-56306090120150SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 389.3571.51125.73

Laghos

Test: Sedov Blast Wave, ube_922_hex.mesh

OpenBenchmarking.orgMajor Kernels Total Rate, More Is BetterLaghos 3.1Test: Sedov Blast Wave, ube_922_hex.meshc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5690180270360450SE +/- 0.31, N = 3SE +/- 0.62, N = 3SE +/- 0.79, N = 3SE +/- 1.29, N = 3SE +/- 0.57, N = 3SE +/- 0.02, N = 3259.55364.64321.29409.73409.66239.481. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Barbershop - Compute: CPU-Onlyt2d-standard-60 AMD Milanm7a.16xlargec2d-standard-56100200300400500SE +/- 0.60, N = 3SE +/- 0.49, N = 3SE +/- 0.71, N = 3351.58276.23468.20

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigt2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56100200300400500SE +/- 1.20, N = 3SE +/- 2.41, N = 3SE +/- 0.37, N = 3SE +/- 0.81, N = 3SE +/- 1.50, N = 3333.35409.10267.97316.01452.75

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-561.00512.01023.01534.02045.0255SE +/- 0.007, N = 3SE +/- 0.013, N = 3SE +/- 0.014, N = 3SE +/- 0.015, N = 3SE +/- 0.004, N = 3SE +/- 0.010, N = 33.2503.2054.4672.6493.1783.8021. (CXX) g++ options: -O3 -fPIC -lm

Stockfish

Total Time

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 15Total Timec3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5630M60M90M120M150MSE +/- 1450871.09, N = 3SE +/- 1618403.29, N = 14SE +/- 1645401.81, N = 15SE +/- 1001447.21, N = 3SE +/- 1921303.63, N = 15SE +/- 705199.36, N = 151058944571129587888180770613541916911950247384017019-m64 -msse -msse3 -mpopcnt -mavx2 -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2-m64 -msse -msse3 -mpopcnt -mavx2 -msse4.1 -mssse3 -msse2 -mbmi2-m64 -msse -msse3 -mpopcnt -mavx2 -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2-m64 -msse -msse3 -mpopcnt -mavx2 -msse4.1 -mssse3 -msse2 -mbmi21. (CXX) g++ options: -lgcov -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -flto -flto=jobserver

nginx

Connections: 1000

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 1000c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5650K100K150K200K250KSE +/- 688.79, N = 3SE +/- 156.32, N = 3SE +/- 132.24, N = 3SE +/- 260.28, N = 3SE +/- 141.46, N = 3SE +/- 157.70, N = 3180537.84155609.04158700.36224859.09255540.03161127.091. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Pabellon Barcelona - Compute: CPU-Onlyt2d-standard-60 AMD Milanm7a.16xlargec2d-standard-56306090120150SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3112.6491.88150.06

Rodinia

Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP LavaMDc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-561632486480SE +/- 0.18, N = 3SE +/- 0.13, N = 3SE +/- 0.03, N = 3SE +/- 0.24, N = 3SE +/- 0.14, N = 3SE +/- 0.13, N = 364.8650.9762.3043.2943.9170.161. (CXX) g++ options: -O2 -lOpenCL

HeFFTe - Highly Efficient FFT for Exascale

Test: r2c - Backend: FFTW - Precision: double - X Y Z: 128

OpenBenchmarking.orgGFLOP/s, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: r2c - Backend: FFTW - Precision: double - X Y Z: 128c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56306090120150SE +/- 1.78, N = 12SE +/- 0.91, N = 3SE +/- 0.71, N = 3SE +/- 1.18, N = 15SE +/- 0.10, N = 3SE +/- 1.39, N = 393.60106.0379.02124.36127.9999.651. (CXX) g++ options: -O3

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Fishy Cat - Compute: CPU-Onlyt2d-standard-60 AMD Milanm7a.16xlargec2d-standard-561326395265SE +/- 0.13, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 345.2237.1259.22

nginx

Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5650K100K150K200K250KSE +/- 126.15, N = 3SE +/- 394.72, N = 3SE +/- 249.05, N = 3SE +/- 451.60, N = 3SE +/- 757.47, N = 3SE +/- 513.44, N = 3187350.44162957.75162553.85233014.72254864.93160196.241. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, Losslessc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-56246810SE +/- 0.099, N = 3SE +/- 0.031, N = 3SE +/- 0.032, N = 3SE +/- 0.008, N = 3SE +/- 0.009, N = 3SE +/- 0.015, N = 36.8897.6398.8795.6785.9148.0801. (CXX) g++ options: -O3 -fPIC -lm

OpenSSL

Algorithm: SHA256

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: SHA256c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5613000M26000M39000M52000M65000MSE +/- 9562123.40, N = 3SE +/- 20491615.60, N = 3SE +/- 192235444.29, N = 3SE +/- 161718701.08, N = 3SE +/- 1709212.75, N = 3SE +/- 7310870.38, N = 3462118213135088499710342288513973622538611975443855517039825794840-m64 -lssl -lcrypto-m64 -lssl -lcrypto-lssl -lcrypto-m64 -lssl -lcrypto-lssl -lcrypto-m641. (CC) gcc options: -pthread -O3 -ldl

Timed Gem5 Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 21.2Time To Compilec3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5650100150200250SE +/- 0.07, N = 3SE +/- 0.27, N = 3SE +/- 0.03, N = 3SE +/- 0.39, N = 3SE +/- 0.25, N = 3SE +/- 0.06, N = 3176.77170.93224.41153.80180.00192.60

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression Ratingc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5670K140K210K280K350KSE +/- 346.51, N = 3SE +/- 388.74, N = 3SE +/- 359.95, N = 3SE +/- 400.99, N = 3SE +/- 291.75, N = 3SE +/- 214.91, N = 32717952789732397353306333105172304301. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression Ratingc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5660K120K180K240K300KSE +/- 519.21, N = 3SE +/- 347.74, N = 3SE +/- 57.33, N = 3SE +/- 342.37, N = 3SE +/- 141.62, N = 3SE +/- 140.45, N = 32262112472552340462825932855232081921. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Rodinia

Test: OpenMP Leukocyte

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP Leukocytec3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-561122334455SE +/- 0.17, N = 3SE +/- 0.02, N = 3SE +/- 0.32, N = 3SE +/- 0.24, N = 345.5042.0134.6646.741. (CXX) g++ options: -O2 -lOpenCL

Laghos

Test: Triple Point Problem

OpenBenchmarking.orgMajor Kernels Total Rate, More Is BetterLaghos 3.1Test: Triple Point Problemc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5650100150200250SE +/- 0.22, N = 3SE +/- 1.77, N = 3SE +/- 0.50, N = 3SE +/- 1.67, N = 3SE +/- 0.90, N = 3SE +/- 0.61, N = 3209.00222.30179.52218.86231.85199.801. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-5610M20M30M40M50MSE +/- 188621.29, N = 3SE +/- 221111.93, N = 3SE +/- 224779.59, N = 3SE +/- 80227.43, N = 334762565349258994450233335460713

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-5610M20M30M40M50MSE +/- 267152.12, N = 3SE +/- 354923.23, N = 3SE +/- 99649.31, N = 3SE +/- 248722.01, N = 335359884350685574469931535377376

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-56100200300400500SE +/- 27.08, N = 3SE +/- 35.57, N = 3SE +/- 7.15, N = 3SE +/- 4.37, N = 3447.68433.96355.13414.40MAX: 95136.87MAX: 103381.73MAX: 67149.77MAX: 91109.59

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-569M18M27M36M45MSE +/- 66565.66, N = 3SE +/- 130588.20, N = 3SE +/- 111073.27, N = 3SE +/- 177230.11, N = 334332237341238104264390334625899

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-5690180270360450SE +/- 2.14, N = 3SE +/- 4.08, N = 3SE +/- 4.92, N = 3SE +/- 2.53, N = 3418.59415.08340.11408.13MAX: 31920.67MAX: 28810.4MAX: 37899.66MAX: 33039.23

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-569M18M27M36M45MSE +/- 154587.14, N = 3SE +/- 303573.79, N = 3SE +/- 457186.43, N = 3SE +/- 247504.71, N = 333268158334668044089921033395968

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Writet2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5612002400360048006000SE +/- 49.93, N = 8SE +/- 124.50, N = 9SE +/- 16.57, N = 3SE +/- 23.65, N = 3SE +/- 50.46, N = 12579347765300534258201. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-56140280420560700SE +/- 3.18, N = 3SE +/- 12.58, N = 3SE +/- 0.65, N = 3SE +/- 13.51, N = 3623.89633.58521.98629.00MAX: 41831.2MAX: 54749.7MAX: 34235.44MAX: 48846.34

Rodinia

Test: OpenMP HotSpot3D

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP HotSpot3Dc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-5620406080100SE +/- 0.86, N = 15SE +/- 1.83, N = 12SE +/- 0.74, N = 15SE +/- 1.43, N = 1584.1788.5474.7890.741. (CXX) g++ options: -O2 -lOpenCL

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Writet2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5612002400360048006000SE +/- 49.28, N = 12SE +/- 109.40, N = 12SE +/- 13.63, N = 3SE +/- 29.72, N = 3SE +/- 47.23, N = 12568247845312534857021. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400c3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-56150300450600750SE +/- 7.53, N = 3SE +/- 25.87, N = 3SE +/- 4.86, N = 3SE +/- 1.38, N = 3682.12709.46598.49679.86MAX: 98294.84MAX: 113264.06MAX: 62432.53MAX: 79453.07

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latencyt2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-5650100150200250SE +/- 1.44, N = 8SE +/- 6.00, N = 9SE +/- 0.59, N = 3SE +/- 0.83, N = 3SE +/- 1.46, N = 12172.72210.61188.68187.19171.951. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latencyt2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargec7g.16xlargec2d-standard-564080120160200SE +/- 1.23, N = 12SE +/- 3.85, N = 12SE +/- 0.39, N = 3SE +/- 0.83, N = 3SE +/- 1.15, N = 12140.92168.19150.60149.60140.411. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal Installationc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-5620406080100SE +/- 4.01, N = 12SE +/- 0.22, N = 3SE +/- 0.73, N = 3SE +/- 0.24, N = 389.6572.0659.1869.43

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on Windshieldc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-56306090120150SE +/- 3.26, N = 9SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 0.41, N = 3147.31123.61115.96146.56

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop Testc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-56918273645SE +/- 1.27, N = 15SE +/- 0.39, N = 15SE +/- 0.08, N = 3SE +/- 0.12, N = 338.8230.1226.1436.84

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper Beamc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanm7a.16xlargec2d-standard-5620406080100SE +/- 1.56, N = 15SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.85, N = 392.8775.6866.2798.45

Phoronix Test Suite v10.8.5