GCE c3d-standard-60

amazon testing on Ubuntu 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2310065-NE-2310055NE35&sro&gru.

GCE c3d-standard-60ProcessorMotherboardChipsetMemoryDiskNetworkOSKernelVulkanCompilerFile-SystemSystem Layerc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargeAMD EPYC 9B14 (30 Cores / 60 Threads)Google Compute Engine c3d-standard-60Intel 440FX 82441FX PMC240GB215GB nvme_card-pdGoogle Compute Engine VirtualUbuntu 22.046.2.0-1014-gcp (x86_64)1.3.238GCC 11.4.0ext4KVMAMD EPYC 7B13 (60 Cores)Google Compute Engine t2d-standard-60215GB PersistentDiskRed Hat Virtio deviceARMv8 Neoverse-N1 (64 Cores)Amazon EC2 c6g.16xlarge (1.0 BIOS)Amazon Device 0200128GB215GB Amazon Elastic Block StoreAmazon Elastic5.19.0-1025-aws (aarch64)amazonAMD EPYC 9R14 (64 Cores)Amazon EC2 m7a.16xlarge (1.0 BIOS)Intel 440FX 82441FX PMC256GB5.19.0-1025-aws (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- c3d-standard-60 AMD Genoa: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - t2d-standard-60 AMD Milan: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - c6g.16xlarge: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - m7a.16xlarge: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- c3d-standard-60 AMD Genoa: CPU Microcode: 0xffffffff- t2d-standard-60 AMD Milan: CPU Microcode: 0xffffffff- m7a.16xlarge: CPU Microcode: 0xa10113eJava Details- OpenJDK Runtime Environment (build 11.0.20.1+1-post-Ubuntu-0ubuntu122.04)Python Details- Python 3.10.12Security Details- c3d-standard-60 AMD Genoa: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - t2d-standard-60 AMD Milan: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - c6g.16xlarge: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected - m7a.16xlarge: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

GCE c3d-standard-60openssl: SHA256openssl: SHA512openssl: ChaCha20openssl: AES-128-GCMopenssl: AES-256-GCMopenssl: ChaCha20-Poly1305amg: nekrs: Kershawnekrs: TurboPipe Periodicopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUheffte: c2c - FFTW - float - 128heffte: r2c - FFTW - float - 128heffte: c2c - FFTW - double - 128heffte: r2c - FFTW - double - 128libxsmm: 32libxsmm: 64tensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 64 - ResNet-50coremark: CoreMark Size 666 - Iterations Per Secondlaghos: Triple Point Problemlaghos: Sedov Blast Wave, ube_922_hex.meshcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingstockfish: Total Timegromacs: MPI CPU - water_GMX50_barelammps: 20k Atomslammps: Rhodopsin Proteincassandra: Writesapache-iotdb: 500 - 100 - 500 - 400apache-iotdb: 500 - 100 - 800 - 400apache-iotdb: 800 - 100 - 500 - 400apache-iotdb: 800 - 100 - 800 - 400nginx: 500nginx: 1000openssl: RSA4096npb: BT.Cnpb: CG.Cnpb: EP.Dnpb: FT.Cnpb: IS.Dnpb: LU.Cnpb: MG.Cnpb: SP.Cpgbench: 100 - 800 - Read Onlypgbench: 100 - 1000 - Read Onlypgbench: 100 - 800 - Read Writepgbench: 100 - 1000 - Read Writeopenssl: RSA4096brl-cad: VGR Performance Metricapache-iotdb: 500 - 100 - 500 - 400apache-iotdb: 500 - 100 - 800 - 400apache-iotdb: 800 - 100 - 500 - 400apache-iotdb: 800 - 100 - 800 - 400openvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUpgbench: 100 - 800 - Read Only - Average Latencypgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 800 - Read Write - Average Latencypgbench: 100 - 1000 - Read Write - Average Latencyrodinia: OpenMP LavaMDrodinia: OpenMP HotSpot3Drodinia: OpenMP Leukocyterodinia: OpenMP CFD Solverrodinia: OpenMP Streamclusterincompact3d: input.i3d 129 Cells Per Directionincompact3d: input.i3d 193 Cells Per Directionopenradioss: Bumper Beamopenradioss: Chrysler Neon 1Mopenradioss: Cell Phone Drop Testopenradioss: Bird Strike on Windshieldopenradioss: Rubber O-Ring Seal Installationremhos: Sample Remap Exampleavifenc: 0avifenc: 2avifenc: 6avifenc: 6, Losslessbuild-gem5: Time To Compilebuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-nodejs: Time To Compileblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlarge46211821313147022705731739809498933430952844402933280484971239093047739628898334289858333472394000018.39142.75142.901389.6935.194166.39576.942043.051875.286605.12645.74185.293650.571764.21964.4643607.04761.1454971.2688.6301148.57557.311693.6005255.4489.750.9962.7469.681445843.521552209.00259.552717952262111058944574.39119.77617.42322864033268158347625653433223735359884187350.44180537.8420079.596257.4819597.863783.6039647.472422.4073563.1342701.8339919.71493077.6510819418.59623.89447.68682.12648.8183.9983.918.62340.292.8720.775.8615.984.5318.5664.708.206.7931.080.5239.380.464.86284.16645.49810.0256.4485.8715788528.019687792.87337.7038.82147.3189.6533.36278.06841.5383.2506.889176.767198.39450884997103222448041831802491457702346040826102160259676401196477203379204277673681935833273062000010.7373.7478.96368.3926.281285.47225.481512.571014.704239.52565.3496.582646.58633.76370.0329668.12390.7244049.15109.676196.94860.0343106.029289.2554.218.2920.3620.901730658.449440222.30364.642789732472551129587885.28926.73427.82818716933466804349258993412381035068557162957.75155609.0412973.0122720.6116649.374935.6854846.181752.6294247.7747291.9643228.112003784200818656825793860844.6629363415.08633.58433.96709.461393.56208.47193.4540.67568.7711.6566.469.9014.763.5226.50155.1411.3223.6481.000.9976.720.610.3990.498140.916172.71750.97488.53542.0107.3686.4235.6305732724.572118175.68327.8830.12123.6172.0616.32678.35041.9893.2057.639170.93033.399333.351191.70634.2789.3545.22351.58112.64422885139731438491786367324778360158788510970129198197600467151264871032893667175886000022217100000.11.061.066.530.0420.792.610.148.390.460.151.365.507.362.53178.822.36136.16129.172202.44532.357579.0156312.7589.51259870.716902179.52321.29239735234046818077062.76625.05926.041217355162553.85158700.362640.024229.1413343.352213.7621386.37915.8018807.7525661.049716.99104326797503147844776215683.29996.56947.59947.86153.1222391.8648.08382.476990.10119.172186.816773.31735.58181.94135.87394.945.58423.957.330.7671.026168.191210.60862.3015.98314.2125.6181168625.874832820.816270.068167.9464.4678.879224.414102.216409.097286.201622538611972648150682030830804508359254536274052211308052721677347553318434443337667846667477479666731.72284.42283.402417.3461.197222.101049.663666.893132.4810382.221222.99315.146177.943146.041419.1181996.811158.4392100.80121.505190.60271.1095124.363643.41201.869.5587.19100.152158639.274883218.86409.733306332825931354191697.65531.47132.78527858540899210445023334264390344699315233014.72224859.0931583.8193219.1242007.577501.76103413.024085.20210544.87121293.80102392.402923009288094053125300996017.5788704340.11521.98355.13598.49503.3856.2156.416.60261.112.2115.224.3510.193.0713.0750.725.165.0722.530.3827.600.270.2740.347150.601188.67643.28674.77834.6616.4805.9302.8960266111.591308666.27190.7926.14115.9659.1813.86765.44735.8052.6495.678153.80027.709267.965154.44127.7471.5137.12276.2391.88OpenBenchmarking.org

OpenSSL

Algorithm: SHA256

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: SHA256c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan13000M26000M39000M52000M65000MSE +/- 9562123.40, N = 3SE +/- 192235444.29, N = 3SE +/- 161718701.08, N = 3SE +/- 20491615.60, N = 346211821313422885139736225386119750884997103-m64-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

OpenSSL

Algorithm: SHA512

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: SHA512c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan6000M12000M18000M24000M30000MSE +/- 4399663.13, N = 3SE +/- 6214593.12, N = 3SE +/- 29763937.73, N = 3SE +/- 108274834.92, N = 314702270573143849178632648150682022244804183-m64-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

OpenSSL

Algorithm: ChaCha20

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: ChaCha20c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan70000M140000M210000M280000M350000MSE +/- 12326205.97, N = 3SE +/- 372419.81, N = 3SE +/- 280681661.27, N = 3SE +/- 47698640.87, N = 317398094989367324778360308308045083180249145770-m64-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

OpenSSL

Algorithm: AES-128-GCM

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: AES-128-GCMc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan130000M260000M390000M520000M650000MSE +/- 342949201.09, N = 3SE +/- 5537993.15, N = 3SE +/- 1818538727.73, N = 3SE +/- 376720190.05, N = 3343095284440158788510970592545362740234604082610-m64-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

OpenSSL

Algorithm: AES-256-GCM

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: AES-256-GCMc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan110000M220000M330000M440000M550000MSE +/- 71241287.97, N = 3SE +/- 2100313.05, N = 3SE +/- 1691817104.57, N = 3SE +/- 178290221.71, N = 3293328048497129198197600522113080527216025967640-m64-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

OpenSSL

Algorithm: ChaCha20-Poly1305

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: ChaCha20-Poly1305c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan50000M100000M150000M200000M250000MSE +/- 3664727.47, N = 3SE +/- 2259404.37, N = 3SE +/- 85099636.22, N = 3SE +/- 198663058.81, N = 312390930477346715126487216773475533119647720337-m64-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

Algebraic Multi-Grid Benchmark

OpenBenchmarking.orgFigure Of Merit, More Is BetterAlgebraic Multi-Grid Benchmark 1.2c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan400M800M1200M1600M2000MSE +/- 2060519.90, N = 3SE +/- 176147.98, N = 3SE +/- 1428129.35, N = 3SE +/- 1088162.98, N = 3962889833103289366718434443339204277671. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi

nekRS

Input: Kershaw

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: Kershawc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan1600M3200M4800M6400M8000MSE +/- 57202190.49, N = 12SE +/- 2970005.61, N = 3SE +/- 49077561.86, N = 3SE +/- 84802173.02, N = 1242898583331758860000766784666736819358331. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: TurboPipe Periodicc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan1000M2000M3000M4000M5000MSE +/- 201939132.13, N = 12SE +/- 1790009.31, N = 3SE +/- 6657808.28, N = 3SE +/- 481352.26, N = 347239400002221710000477479666727306200001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan714212835SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 318.390.1031.7210.73-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan60120180240300SE +/- 0.23, N = 3SE +/- 0.00, N = 3SE +/- 0.53, N = 3SE +/- 3.12, N = 15142.751.06284.4273.74-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan60120180240300SE +/- 0.48, N = 3SE +/- 0.00, N = 3SE +/- 0.29, N = 3SE +/- 2.74, N = 15142.901.06283.4078.96-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan5001000150020002500SE +/- 6.33, N = 3SE +/- 0.01, N = 3SE +/- 1.65, N = 3SE +/- 1.55, N = 31389.696.532417.34368.39-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan1428425670SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 335.190.0461.1926.28-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan15003000450060007500SE +/- 8.74, N = 3SE +/- 0.01, N = 3SE +/- 4.07, N = 3SE +/- 15.96, N = 34166.3920.797222.101285.47-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan2004006008001000SE +/- 1.04, N = 3SE +/- 0.00, N = 3SE +/- 0.11, N = 3SE +/- 0.93, N = 3576.942.611049.66225.48-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan8001600240032004000SE +/- 3.16, N = 3SE +/- 0.00, N = 15SE +/- 1.69, N = 3SE +/- 1.12, N = 32043.050.143666.891512.57-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan7001400210028003500SE +/- 0.47, N = 3SE +/- 0.01, N = 3SE +/- 0.31, N = 3SE +/- 0.56, N = 31875.288.393132.481014.70-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan2K4K6K8K10KSE +/- 6.52, N = 3SE +/- 0.01, N = 3SE +/- 3.60, N = 3SE +/- 2.08, N = 36605.120.4610382.224239.52-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan30060090012001500SE +/- 0.79, N = 3SE +/- 0.00, N = 3SE +/- 0.51, N = 3SE +/- 0.37, N = 3645.740.151222.99565.34-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan70140210280350SE +/- 0.25, N = 3SE +/- 0.00, N = 3SE +/- 0.11, N = 3SE +/- 0.37, N = 3185.291.36315.1496.58-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan13002600390052006500SE +/- 3.28, N = 3SE +/- 0.01, N = 3SE +/- 4.43, N = 3SE +/- 3.26, N = 33650.575.506177.942646.58-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan7001400210028003500SE +/- 4.38, N = 3SE +/- 0.01, N = 3SE +/- 1.10, N = 3SE +/- 3.66, N = 31764.217.363146.04633.76-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan30060090012001500SE +/- 0.60, N = 3SE +/- 0.02, N = 3SE +/- 0.70, N = 3SE +/- 0.96, N = 3964.462.531419.11370.03-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan20K40K60K80K100KSE +/- 18.42, N = 3SE +/- 0.39, N = 3SE +/- 31.79, N = 3SE +/- 14.46, N = 343607.04178.8281996.8129668.12-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan2004006008001000SE +/- 1.75, N = 3SE +/- 0.00, N = 3SE +/- 0.18, N = 3SE +/- 1.37, N = 3761.142.361158.43390.72-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan20K40K60K80K100KSE +/- 45.46, N = 3SE +/- 0.48, N = 3SE +/- 453.62, N = 3SE +/- 332.93, N = 354971.26136.1692100.8044049.15-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

HeFFTe - Highly Efficient FFT for Exascale

Test: c2c - Backend: FFTW - Precision: float - X Y Z: 128

OpenBenchmarking.orgGFLOP/s, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: c2c - Backend: FFTW - Precision: float - X Y Z: 128c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan306090120150SE +/- 0.52, N = 3SE +/- 0.11, N = 3SE +/- 1.44, N = 15SE +/- 0.78, N = 388.63129.17121.51109.681. (CXX) g++ options: -O3

HeFFTe - Highly Efficient FFT for Exascale

Test: r2c - Backend: FFTW - Precision: float - X Y Z: 128

OpenBenchmarking.orgGFLOP/s, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: r2c - Backend: FFTW - Precision: float - X Y Z: 128c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan4080120160200SE +/- 2.19, N = 12SE +/- 0.57, N = 3SE +/- 2.16, N = 15SE +/- 0.82, N = 3148.58202.45190.60196.951. (CXX) g++ options: -O3

HeFFTe - Highly Efficient FFT for Exascale

Test: c2c - Backend: FFTW - Precision: double - X Y Z: 128

OpenBenchmarking.orgGFLOP/s, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: c2c - Backend: FFTW - Precision: double - X Y Z: 128c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan1632486480SE +/- 1.29, N = 15SE +/- 0.10, N = 3SE +/- 0.63, N = 15SE +/- 0.66, N = 357.3132.3671.1160.031. (CXX) g++ options: -O3

HeFFTe - Highly Efficient FFT for Exascale

Test: r2c - Backend: FFTW - Precision: double - X Y Z: 128

OpenBenchmarking.orgGFLOP/s, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: r2c - Backend: FFTW - Precision: double - X Y Z: 128c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan306090120150SE +/- 1.78, N = 12SE +/- 0.71, N = 3SE +/- 1.18, N = 15SE +/- 0.91, N = 393.6079.02124.36106.031. (CXX) g++ options: -O3

libxsmm

M N K: 32

OpenBenchmarking.orgGFLOPS/s, More Is Betterlibxsmm 2-1.17-3645M N K: 32c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan140280420560700SE +/- 0.19, N = 3SE +/- 0.47, N = 3SE +/- 0.40, N = 3SE +/- 3.60, N = 4255.4312.7643.4289.2-lquadmath -msse4.2-march=armv8.1-a-lquadmath -msse4.2-lquadmath -msse4.21. (CXX) g++ options: -dynamic -Bstatic -static-libgcc -lgomp -lm -lrt -ldl -lstdc++ -pthread -fPIC -std=c++14 -O2 -fopenmp-simd -funroll-loops -ftree-vectorize -fdata-sections -ffunction-sections -fvisibility=hidden

libxsmm

M N K: 64

OpenBenchmarking.orgGFLOPS/s, More Is Betterlibxsmm 2-1.17-3645M N K: 64c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan30060090012001500SE +/- 0.12, N = 3SE +/- 0.96, N = 3SE +/- 0.52, N = 3SE +/- 0.25, N = 3489.7589.51201.8554.2-lquadmath -msse4.2-march=armv8.1-a-lquadmath -msse4.2-lquadmath -msse4.21. (CXX) g++ options: -dynamic -Bstatic -static-libgcc -lgomp -lm -lrt -ldl -lstdc++ -pthread -fPIC -std=c++14 -O2 -fopenmp-simd -funroll-loops -ftree-vectorize -fdata-sections -ffunction-sections -fvisibility=hidden

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50c3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan1530456075SE +/- 0.04, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 350.9969.5518.29

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 32 - Model: ResNet-50c3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan20406080100SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 362.7487.1920.36

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50c3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan20406080100SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 369.68100.1520.90

Coremark

CoreMark Size 666 - Iterations Per Second

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per Secondc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan500K1000K1500K2000K2500KSE +/- 1295.68, N = 3SE +/- 635.29, N = 3SE +/- 1437.63, N = 3SE +/- 9191.61, N = 31445843.521259870.722158639.271730658.451. (CC) gcc options: -O2 -lrt" -lrt

Laghos

Test: Triple Point Problem

OpenBenchmarking.orgMajor Kernels Total Rate, More Is BetterLaghos 3.1Test: Triple Point Problemc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan50100150200250SE +/- 0.22, N = 3SE +/- 0.50, N = 3SE +/- 1.67, N = 3SE +/- 1.77, N = 3209.00179.52218.86222.301. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Laghos

Test: Sedov Blast Wave, ube_922_hex.mesh

OpenBenchmarking.orgMajor Kernels Total Rate, More Is BetterLaghos 3.1Test: Sedov Blast Wave, ube_922_hex.meshc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan90180270360450SE +/- 0.31, N = 3SE +/- 0.79, N = 3SE +/- 1.29, N = 3SE +/- 0.62, N = 3259.55321.29409.73364.641. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression Ratingc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan70K140K210K280K350KSE +/- 346.51, N = 3SE +/- 359.95, N = 3SE +/- 400.99, N = 3SE +/- 388.74, N = 32717952397353306332789731. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression Ratingc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan60K120K180K240K300KSE +/- 519.21, N = 3SE +/- 57.33, N = 3SE +/- 342.37, N = 3SE +/- 347.74, N = 32262112340462825932472551. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Stockfish

Total Time

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 15Total Timec3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan30M60M90M120M150MSE +/- 1450871.09, N = 3SE +/- 1645401.81, N = 15SE +/- 1001447.21, N = 3SE +/- 1618403.29, N = 1410589445781807706135419169112958788-m64 -msse -msse3 -mpopcnt -mavx2 -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2-m64 -msse -msse3 -mpopcnt -mavx2 -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2-m64 -msse -msse3 -mpopcnt -mavx2 -msse4.1 -mssse3 -msse2 -mbmi21. (CXX) g++ options: -lgcov -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -flto -flto=jobserver

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2023Implementation: MPI CPU - Input: water_GMX50_barec3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan246810SE +/- 0.011, N = 3SE +/- 0.001, N = 3SE +/- 0.035, N = 3SE +/- 0.005, N = 34.3912.7667.6555.2891. (CXX) g++ options: -O3

LAMMPS Molecular Dynamics Simulator

Model: 20k Atoms

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k Atomsc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan714212835SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 319.7825.0631.4726.73-lm-lm-lm1. (CXX) g++ options: -O3 -ldl

LAMMPS Molecular Dynamics Simulator

Model: Rhodopsin Protein

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin Proteinc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan816243240SE +/- 0.54, N = 12SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 317.4226.0432.7927.83-lm-lm-lm1. (CXX) g++ options: -O3 -ldl

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.1.3Test: Writesc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan60K120K180K240K300KSE +/- 1129.40, N = 3SE +/- 3249.94, N = 12SE +/- 352.65, N = 3SE +/- 681.76, N = 3228640217355278585187169

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400c3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan9M18M27M36M45MSE +/- 154587.14, N = 3SE +/- 457186.43, N = 3SE +/- 303573.79, N = 3332681584089921033466804

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400c3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan10M20M30M40M50MSE +/- 188621.29, N = 3SE +/- 224779.59, N = 3SE +/- 221111.93, N = 3347625654450233334925899

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400c3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan9M18M27M36M45MSE +/- 66565.66, N = 3SE +/- 111073.27, N = 3SE +/- 130588.20, N = 3343322374264390334123810

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400c3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan10M20M30M40M50MSE +/- 267152.12, N = 3SE +/- 99649.31, N = 3SE +/- 354923.23, N = 3353598844469931535068557

nginx

Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan50K100K150K200K250KSE +/- 126.15, N = 3SE +/- 249.05, N = 3SE +/- 451.60, N = 3SE +/- 394.72, N = 3187350.44162553.85233014.72162957.751. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

nginx

Connections: 1000

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 1000c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan50K100K150K200K250KSE +/- 688.79, N = 3SE +/- 132.24, N = 3SE +/- 260.28, N = 3SE +/- 156.32, N = 3180537.84158700.36224859.09155609.041. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.1Algorithm: RSA4096c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan7K14K21K28K35KSE +/- 14.62, N = 3SE +/- 0.09, N = 3SE +/- 24.57, N = 3SE +/- 11.58, N = 320079.52640.031583.812973.0-m64-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

NAS Parallel Benchmarks

Test / Class: BT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: BT.Cc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan40K80K120K160K200KSE +/- 122.23, N = 3SE +/- 7.69, N = 3SE +/- 560.75, N = 3SE +/- 42.77, N = 396257.4824229.14193219.12122720.611. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: CG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.Cc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan9K18K27K36K45KSE +/- 77.92, N = 3SE +/- 23.52, N = 3SE +/- 178.46, N = 3SE +/- 1215.82, N = 1519597.8613343.3542007.5716649.371. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: EP.D

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.Dc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan16003200480064008000SE +/- 30.67, N = 3SE +/- 7.28, N = 3SE +/- 8.54, N = 3SE +/- 51.21, N = 53783.602213.767501.764935.681. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: FT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: FT.Cc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan20K40K60K80K100KSE +/- 600.19, N = 15SE +/- 2.85, N = 3SE +/- 446.85, N = 3SE +/- 137.77, N = 339647.4721386.37103413.0254846.181. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: IS.D

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: IS.Dc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan9001800270036004500SE +/- 36.45, N = 15SE +/- 0.58, N = 3SE +/- 3.14, N = 3SE +/- 142.62, N = 122422.40915.804085.201752.621. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: LU.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.Cc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan50K100K150K200K250KSE +/- 293.57, N = 3SE +/- 7.52, N = 3SE +/- 661.61, N = 3SE +/- 1463.52, N = 1573563.1318807.75210544.8794247.771. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: MG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.Cc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan30K60K90K120K150KSE +/- 29.69, N = 3SE +/- 10.99, N = 3SE +/- 526.14, N = 3SE +/- 145.06, N = 342701.8325661.04121293.8047291.961. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: SP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.Cc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan20K40K60K80K100KSE +/- 45.01, N = 3SE +/- 0.76, N = 3SE +/- 91.17, N = 3SE +/- 555.92, N = 339919.719716.99102392.4043228.111. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Onlyc6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan600K1200K1800K2400K3000KSE +/- 12058.27, N = 3SE +/- 13309.30, N = 3SE +/- 20558.90, N = 31043267292300920037841. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Onlyc6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan600K1200K1800K2400K3000KSE +/- 12606.16, N = 3SE +/- 2874.04, N = 3SE +/- 22497.42, N = 3975031288094020081861. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Writec6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan12002400360048006000SE +/- 109.40, N = 12SE +/- 13.63, N = 3SE +/- 49.28, N = 124784531256821. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Writec6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan12002400360048006000SE +/- 124.50, N = 9SE +/- 16.57, N = 3SE +/- 49.93, N = 84776530057931. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.1Algorithm: RSA4096c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan200K400K600K800K1000KSE +/- 50.91, N = 3SE +/- 6.55, N = 3SE +/- 367.82, N = 3SE +/- 644.45, N = 3493077.6215683.2996017.5860844.6-m64-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.36VGR Performance Metricc3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan200K400K600K800K1000K5108197887046293631. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400c3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan90180270360450SE +/- 2.14, N = 3SE +/- 4.92, N = 3SE +/- 4.08, N = 3418.59340.11415.08MAX: 31920.67MAX: 37899.66MAX: 28810.4

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400c3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan140280420560700SE +/- 3.18, N = 3SE +/- 0.65, N = 3SE +/- 12.58, N = 3623.89521.98633.58MAX: 41831.2MAX: 34235.44MAX: 54749.7

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400c3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan100200300400500SE +/- 27.08, N = 3SE +/- 7.15, N = 3SE +/- 35.57, N = 3447.68355.13433.96MAX: 95136.87MAX: 67149.77MAX: 103381.73

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400c3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan150300450600750SE +/- 7.53, N = 3SE +/- 4.86, N = 3SE +/- 25.87, N = 3682.12598.49709.46MAX: 98294.84MAX: 62432.53MAX: 113264.06

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan2K4K6K8K10KSE +/- 0.17, N = 3SE +/- 1.02, N = 3SE +/- 0.12, N = 3SE +/- 1.32, N = 3648.819996.56503.381393.56-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 9993.58 / MAX: 10001.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan2004006008001000SE +/- 0.13, N = 3SE +/- 0.37, N = 3SE +/- 0.10, N = 3SE +/- 9.17, N = 1583.99947.5956.21208.47-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 943.57 / MAX: 951.68-pie - MIN: 119.65 / MAX: 316.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan2004006008001000SE +/- 0.29, N = 3SE +/- 0.55, N = 3SE +/- 0.06, N = 3SE +/- 7.79, N = 1583.91947.8656.41193.45-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 944.57 / MAX: 958.26-pie - MIN: 113.44 / MAX: 315.541. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan306090120150SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.00, N = 3SE +/- 0.17, N = 38.62153.126.6040.67-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 152.69 / MAX: 153.75-pie - MIN: 12.07 / MAX: 59.441. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan5K10K15K20K25KSE +/- 0.21, N = 3SE +/- 15.60, N = 3SE +/- 0.03, N = 3SE +/- 0.35, N = 3340.2922391.86261.11568.77-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 22364.17 / MAX: 22423.421. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan1122334455SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.14, N = 32.8748.082.2111.65-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 47.55 / MAX: 50.49-pie - MIN: 3.76 / MAX: 29.11. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan80160240320400SE +/- 0.04, N = 3SE +/- 0.20, N = 3SE +/- 0.00, N = 3SE +/- 0.27, N = 320.77382.4715.2266.46-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 381.67 / MAX: 383.43-pie - MIN: 25.85 / MAX: 122.21. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan15003000450060007500SE +/- 0.01, N = 3SE +/- 27.09, N = 15SE +/- 0.00, N = 3SE +/- 0.01, N = 35.866990.104.359.90-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 6842.82 / MAX: 7088.531. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan306090120150SE +/- 0.00, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 315.98119.1710.1914.76-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 118.73 / MAX: 120.211. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan5001000150020002500SE +/- 0.01, N = 3SE +/- 27.29, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 34.532186.813.073.52-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 2135.06 / MAX: 2233.341. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan15003000450060007500SE +/- 0.02, N = 3SE +/- 76.95, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 318.566773.3113.0726.50-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 6616.83 / MAX: 6859.991. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan160320480640800SE +/- 0.09, N = 3SE +/- 0.26, N = 3SE +/- 0.02, N = 3SE +/- 0.58, N = 364.70735.5850.72155.14-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 734.34 / MAX: 738.23-pie - MIN: 114.75 / MAX: 224.641. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan4080120160200SE +/- 0.01, N = 3SE +/- 0.24, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.20181.945.1611.32-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 180.71 / MAX: 184.111. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan306090120150SE +/- 0.02, N = 3SE +/- 0.21, N = 3SE +/- 0.00, N = 3SE +/- 0.14, N = 36.79135.875.0723.64-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 132.35 / MAX: 148.64-pie - MIN: 9.57 / MAX: 42.221. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan90180270360450SE +/- 0.02, N = 3SE +/- 2.18, N = 3SE +/- 0.01, N = 3SE +/- 0.21, N = 331.08394.9422.5381.00-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 380.82 / MAX: 408.15-pie - MIN: 64.65 / MAX: 134.641. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan1.25552.5113.76655.0226.2775SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.525.580.380.99-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 5.45 / MAX: 6.48-pie - MIN: 0.8 / MAX: 13.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan90180270360450SE +/- 0.09, N = 3SE +/- 0.26, N = 3SE +/- 0.01, N = 3SE +/- 0.27, N = 339.38423.9527.6076.72-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 411.17 / MAX: 440.57-pie - MIN: 58.8 / MAX: 121.691. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan246810SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.407.330.270.61-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 6.54 / MAX: 9.951. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latencyc6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan0.17260.34520.51780.69040.863SE +/- 0.009, N = 3SE +/- 0.001, N = 3SE +/- 0.004, N = 30.7670.2740.3991. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latencyc6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan0.23090.46180.69270.92361.1545SE +/- 0.013, N = 3SE +/- 0.000, N = 3SE +/- 0.006, N = 31.0260.3470.4981. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latencyc6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan4080120160200SE +/- 3.85, N = 12SE +/- 0.39, N = 3SE +/- 1.23, N = 12168.19150.60140.921. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latencyc6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan50100150200250SE +/- 6.00, N = 9SE +/- 0.59, N = 3SE +/- 1.44, N = 8210.61188.68172.721. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Rodinia

Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP LavaMDc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan1428425670SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.24, N = 3SE +/- 0.13, N = 364.8662.3043.2950.971. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP HotSpot3D

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP HotSpot3Dc3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan20406080100SE +/- 0.86, N = 15SE +/- 0.74, N = 15SE +/- 1.83, N = 1284.1774.7888.541. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP Leukocyte

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP Leukocytec3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan1020304050SE +/- 0.17, N = 3SE +/- 0.32, N = 3SE +/- 0.02, N = 345.5034.6642.011. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP CFD Solver

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP CFD Solverc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan3691215SE +/- 0.013, N = 3SE +/- 0.001, N = 3SE +/- 0.007, N = 3SE +/- 0.034, N = 310.0255.9836.4807.3681. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP Streamcluster

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP Streamclusterc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan48121620SE +/- 0.104, N = 15SE +/- 0.017, N = 3SE +/- 0.049, N = 3SE +/- 0.009, N = 36.44814.2125.9306.4231. (CXX) g++ options: -O2 -lOpenCL

Xcompact3d Incompact3d

Input: input.i3d 129 Cells Per Direction

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 129 Cells Per Directionc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan1.32112.64223.96335.28446.6055SE +/- 0.04970425, N = 3SE +/- 0.01888616, N = 3SE +/- 0.03993251, N = 3SE +/- 0.02210564, N = 35.871578855.618116862.896026615.630573271. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

Xcompact3d Incompact3d

Input: input.i3d 193 Cells Per Direction

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per Directionc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan714212835SE +/- 0.25, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.31, N = 1228.0225.8711.5924.571. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper Beamc3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan20406080100SE +/- 1.56, N = 15SE +/- 0.05, N = 3SE +/- 0.10, N = 392.8766.2775.68

OpenRadioss

Model: Chrysler Neon 1M

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1Mc3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan70140210280350SE +/- 2.03, N = 3SE +/- 0.61, N = 3SE +/- 1.48, N = 3337.70190.79327.88

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop Testc3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan918273645SE +/- 1.27, N = 15SE +/- 0.08, N = 3SE +/- 0.39, N = 1538.8226.1430.12

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on Windshieldc3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan306090120150SE +/- 3.26, N = 9SE +/- 0.18, N = 3SE +/- 0.13, N = 3147.31115.96123.61

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal Installationc3d-standard-60 AMD Genoam7a.16xlarget2d-standard-60 AMD Milan20406080100SE +/- 4.01, N = 12SE +/- 0.73, N = 3SE +/- 0.22, N = 389.6559.1872.06

Remhos

Test: Sample Remap Example

OpenBenchmarking.orgSeconds, Fewer Is BetterRemhos 1.0Test: Sample Remap Examplec3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan816243240SE +/- 0.17, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 333.3620.8213.8716.331. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan60120180240300SE +/- 0.07, N = 3SE +/- 0.34, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 378.07270.0765.4578.351. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan4080120160200SE +/- 0.11, N = 3SE +/- 0.22, N = 3SE +/- 0.22, N = 3SE +/- 0.03, N = 341.54167.9535.8141.991. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6c3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan1.00512.01023.01534.02045.0255SE +/- 0.007, N = 3SE +/- 0.014, N = 3SE +/- 0.015, N = 3SE +/- 0.013, N = 33.2504.4672.6493.2051. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, Losslessc3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan246810SE +/- 0.099, N = 3SE +/- 0.032, N = 3SE +/- 0.008, N = 3SE +/- 0.031, N = 36.8898.8795.6787.6391. (CXX) g++ options: -O3 -fPIC -lm

Timed Gem5 Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 21.2Time To Compilec3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan50100150200250SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.39, N = 3SE +/- 0.27, N = 3176.77224.41153.80170.93

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigc6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan20406080100SE +/- 0.82, N = 3SE +/- 0.29, N = 5SE +/- 0.37, N = 5102.2227.7133.40

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigc6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan90180270360450SE +/- 2.41, N = 3SE +/- 0.37, N = 3SE +/- 1.20, N = 3409.10267.97333.35

Timed Node.js Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1Time To Compilec3d-standard-60 AMD Genoac6g.16xlargem7a.16xlarget2d-standard-60 AMD Milan60120180240300SE +/- 0.29, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3198.39286.20154.44191.71

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: BMW27 - Compute: CPU-Onlym7a.16xlarget2d-standard-60 AMD Milan816243240SE +/- 0.04, N = 3SE +/- 0.06, N = 327.7434.27

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Classroom - Compute: CPU-Onlym7a.16xlarget2d-standard-60 AMD Milan20406080100SE +/- 0.01, N = 3SE +/- 0.07, N = 371.5189.35

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Fishy Cat - Compute: CPU-Onlym7a.16xlarget2d-standard-60 AMD Milan1020304050SE +/- 0.10, N = 3SE +/- 0.13, N = 337.1245.22

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Barbershop - Compute: CPU-Onlym7a.16xlarget2d-standard-60 AMD Milan80160240320400SE +/- 0.49, N = 3SE +/- 0.60, N = 3276.23351.58

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Pabellon Barcelona - Compute: CPU-Onlym7a.16xlarget2d-standard-60 AMD Milan306090120150SE +/- 0.08, N = 3SE +/- 0.03, N = 391.88112.64

Phoronix Test Suite v10.8.5