GCE c3d-standard-60

amazon testing on Ubuntu 22.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2310065-NE-2310055NE35
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

Timed Code Compilation 3 Tests
C/C++ Compiler Tests 7 Tests
CPU Massive 12 Tests
Creator Workloads 4 Tests
Database Test Suite 3 Tests
Fortran Tests 4 Tests
HPC - High Performance Computing 10 Tests
Java Tests 2 Tests
Common Kernel Benchmarks 2 Tests
Machine Learning 2 Tests
Molecular Dynamics 3 Tests
MPI Benchmarks 4 Tests
Multi-Core 15 Tests
NVIDIA GPU Compute 3 Tests
OpenMPI Tests 11 Tests
Programmer / Developer System Benchmarks 4 Tests
Python Tests 4 Tests
Scientific Computing 4 Tests
Server 5 Tests
Server CPU Tests 7 Tests
Common Workstation Benchmarks 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
c3d-standard-60 AMD Genoa
October 03 2023
  10 Hours, 30 Minutes
t2d-standard-60 AMD Milan
October 03 2023
  13 Hours, 23 Minutes
c6g.16xlarge
October 05 2023
  9 Hours, 27 Minutes
m7a.16xlarge
October 06 2023
  9 Hours, 1 Minute
Invert Hiding All Results Option
  10 Hours, 35 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


GCE c3d-standard-60 - Phoronix Test Suite

GCE c3d-standard-60

amazon testing on Ubuntu 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2310065-NE-2310055NE35&grt&rdt&rro.

GCE c3d-standard-60ProcessorMotherboardChipsetMemoryDiskNetworkOSKernelVulkanCompilerFile-SystemSystem Layerc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlargeAMD EPYC 9B14 (30 Cores / 60 Threads)Google Compute Engine c3d-standard-60Intel 440FX 82441FX PMC240GB215GB nvme_card-pdGoogle Compute Engine VirtualUbuntu 22.046.2.0-1014-gcp (x86_64)1.3.238GCC 11.4.0ext4KVMAMD EPYC 7B13 (60 Cores)Google Compute Engine t2d-standard-60215GB PersistentDiskRed Hat Virtio deviceARMv8 Neoverse-N1 (64 Cores)Amazon EC2 c6g.16xlarge (1.0 BIOS)Amazon Device 0200128GB215GB Amazon Elastic Block StoreAmazon Elastic5.19.0-1025-aws (aarch64)amazonAMD EPYC 9R14 (64 Cores)Amazon EC2 m7a.16xlarge (1.0 BIOS)Intel 440FX 82441FX PMC256GB5.19.0-1025-aws (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- c3d-standard-60 AMD Genoa: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - t2d-standard-60 AMD Milan: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - c6g.16xlarge: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - m7a.16xlarge: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- c3d-standard-60 AMD Genoa: CPU Microcode: 0xffffffff- t2d-standard-60 AMD Milan: CPU Microcode: 0xffffffff- m7a.16xlarge: CPU Microcode: 0xa10113eJava Details- OpenJDK Runtime Environment (build 11.0.20.1+1-post-Ubuntu-0ubuntu122.04)Python Details- Python 3.10.12Security Details- c3d-standard-60 AMD Genoa: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - t2d-standard-60 AMD Milan: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - c6g.16xlarge: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected - m7a.16xlarge: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

GCE c3d-standard-60compress-7zip: Compression Ratingcompress-7zip: Decompression Ratingamg: cassandra: Writesapache-iotdb: 500 - 100 - 500 - 400apache-iotdb: 500 - 100 - 500 - 400apache-iotdb: 500 - 100 - 800 - 400apache-iotdb: 500 - 100 - 800 - 400apache-iotdb: 800 - 100 - 500 - 400apache-iotdb: 800 - 100 - 500 - 400apache-iotdb: 800 - 100 - 800 - 400apache-iotdb: 800 - 100 - 800 - 400blender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlybrl-cad: VGR Performance Metriccoremark: CoreMark Size 666 - Iterations Per Secondgromacs: MPI CPU - water_GMX50_bareheffte: c2c - FFTW - float - 128heffte: r2c - FFTW - float - 128heffte: c2c - FFTW - double - 128heffte: r2c - FFTW - double - 128laghos: Triple Point Problemlaghos: Sedov Blast Wave, ube_922_hex.meshlammps: 20k Atomslammps: Rhodopsin Proteinavifenc: 0avifenc: 2avifenc: 6avifenc: 6, Losslesslibxsmm: 32libxsmm: 64npb: BT.Cnpb: CG.Cnpb: EP.Dnpb: FT.Cnpb: IS.Dnpb: LU.Cnpb: MG.Cnpb: SP.Cnekrs: Kershawnekrs: TurboPipe Periodicnginx: 500nginx: 1000openradioss: Bumper Beamopenradioss: Chrysler Neon 1Mopenradioss: Cell Phone Drop Testopenradioss: Bird Strike on Windshieldopenradioss: Rubber O-Ring Seal Installationopenssl: SHA256openssl: SHA512openssl: RSA4096openssl: RSA4096openssl: ChaCha20openssl: AES-128-GCMopenssl: AES-256-GCMopenssl: ChaCha20-Poly1305openvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUpgbench: 100 - 800 - Read Onlypgbench: 100 - 1000 - Read Onlypgbench: 100 - 800 - Read Writepgbench: 100 - 1000 - Read Writepgbench: 100 - 800 - Read Only - Average Latencypgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 800 - Read Write - Average Latencypgbench: 100 - 1000 - Read Write - Average Latencyremhos: Sample Remap Examplerodinia: OpenMP LavaMDrodinia: OpenMP HotSpot3Drodinia: OpenMP Leukocyterodinia: OpenMP CFD Solverrodinia: OpenMP Streamclusterstockfish: Total Timetensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 64 - ResNet-50build-gem5: Time To Compilebuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-nodejs: Time To Compileincompact3d: input.i3d 129 Cells Per Directionincompact3d: input.i3d 193 Cells Per Directionc3d-standard-60 AMD Genoat2d-standard-60 AMD Milanc6g.16xlargem7a.16xlarge27179522621196288983322864033268158418.5934762565623.8934332237447.6835359884682.125108191445843.5215524.39188.6301148.57557.311693.6005209.00259.5519.77617.42378.06841.5383.2506.889255.4489.796257.4819597.863783.6039647.472422.4073563.1342701.8339919.7142898583334723940000187350.44180537.8492.87337.7038.82147.3189.65462118213131470227057320079.5493077.617398094989334309528444029332804849712390930477318.39648.81142.7583.99142.9083.911389.698.6235.19340.294166.392.87576.9420.772043.055.861875.2815.986605.124.53645.7418.56185.2964.703650.578.201764.216.79964.4631.0843607.040.52761.1439.3854971.260.433.36264.86284.16645.49810.0256.44810589445750.9962.7469.68176.767198.3945.8715788528.019687727897324725592042776718716933466804415.0834925899633.5834123810433.9635068557709.4634.2789.3545.22351.58112.646293631730658.4494405.289109.676196.94860.0343106.029222.30364.6426.73427.82878.35041.9893.2057.639289.2554.2122720.6116649.374935.6854846.181752.6294247.7747291.9643228.1136819358332730620000162957.75155609.0475.68327.8830.12123.6172.06508849971032224480418312973.0860844.618024914577023460408261021602596764011964772033710.731393.5673.74208.4778.96193.45368.3940.6726.28568.771285.4711.65225.4866.461512.579.901014.7014.764239.523.52565.3426.5096.58155.142646.5811.32633.7623.64370.0381.0029668.120.99390.7276.7244049.150.6120037842008186568257930.3990.498140.916172.71716.32650.97488.53542.0107.3686.42311295878818.2920.3620.90170.93033.399333.351191.7065.6305732724.572118123973523404610328936672173551259870.7169022.766129.172202.44532.357579.0156179.52321.2925.05926.041270.068167.9464.4678.879312.7589.524229.1413343.352213.7621386.37915.8018807.7525661.049716.9917588600002221710000162553.85158700.3642288513973143849178632640.0215683.267324778360158788510970129198197600467151264870.19996.561.06947.591.06947.866.53153.120.0422391.8620.7948.082.61382.470.146990.108.39119.170.462186.810.156773.311.36735.585.50181.947.36135.872.53394.94178.825.582.36423.95136.167.331043267975031478447760.7671.026168.191210.60820.81662.3015.98314.21281807706224.414102.216409.097286.2015.6181168625.8748328330633282593184344433327858540899210340.1144502333521.9842643903355.1344699315598.4927.7471.5137.12276.2391.887887042158639.2748837.655121.505190.60271.1095124.363218.86409.7331.47132.78565.44735.8052.6495.678643.41201.8193219.1242007.577501.76103413.024085.20210544.87121293.80102392.4076678466674774796667233014.72224859.0966.27190.7926.14115.9659.18622538611972648150682031583.8996017.530830804508359254536274052211308052721677347553331.72503.38284.4256.21283.4056.412417.346.6061.19261.117222.102.211049.6615.223666.894.353132.4810.1910382.223.071222.9913.07315.1450.726177.945.163146.045.071419.1122.5381996.810.381158.4327.6092100.800.2729230092880940531253000.2740.347150.601188.67613.86743.28674.77834.6616.4805.93013541916969.5587.19100.15153.80027.709267.965154.4412.8960266111.5913086OpenBenchmarking.org

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression Ratingm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa70K140K210K280K350KSE +/- 400.99, N = 3SE +/- 359.95, N = 3SE +/- 388.74, N = 3SE +/- 346.51, N = 33306332397352789732717951. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression Ratingm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa60K120K180K240K300KSE +/- 342.37, N = 3SE +/- 57.33, N = 3SE +/- 347.74, N = 3SE +/- 519.21, N = 32825932340462472552262111. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Algebraic Multi-Grid Benchmark

OpenBenchmarking.orgFigure Of Merit, More Is BetterAlgebraic Multi-Grid Benchmark 1.2m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa400M800M1200M1600M2000MSE +/- 1428129.35, N = 3SE +/- 176147.98, N = 3SE +/- 1088162.98, N = 3SE +/- 2060519.90, N = 3184344433310328936679204277679628898331. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.1.3Test: Writesm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa60K120K180K240K300KSE +/- 352.65, N = 3SE +/- 3249.94, N = 12SE +/- 681.76, N = 3SE +/- 1129.40, N = 3278585217355187169228640

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400m7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa9M18M27M36M45MSE +/- 457186.43, N = 3SE +/- 303573.79, N = 3SE +/- 154587.14, N = 3408992103346680433268158

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400m7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa90180270360450SE +/- 4.92, N = 3SE +/- 4.08, N = 3SE +/- 2.14, N = 3340.11415.08418.59MAX: 37899.66MAX: 28810.4MAX: 31920.67

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400m7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa10M20M30M40M50MSE +/- 224779.59, N = 3SE +/- 221111.93, N = 3SE +/- 188621.29, N = 3445023333492589934762565

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400m7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa140280420560700SE +/- 0.65, N = 3SE +/- 12.58, N = 3SE +/- 3.18, N = 3521.98633.58623.89MAX: 34235.44MAX: 54749.7MAX: 41831.2

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400m7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa9M18M27M36M45MSE +/- 111073.27, N = 3SE +/- 130588.20, N = 3SE +/- 66565.66, N = 3426439033412381034332237

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400m7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa100200300400500SE +/- 7.15, N = 3SE +/- 35.57, N = 3SE +/- 27.08, N = 3355.13433.96447.68MAX: 67149.77MAX: 103381.73MAX: 95136.87

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400m7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa10M20M30M40M50MSE +/- 99649.31, N = 3SE +/- 354923.23, N = 3SE +/- 267152.12, N = 3446993153506855735359884

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400m7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa150300450600750SE +/- 4.86, N = 3SE +/- 25.87, N = 3SE +/- 7.53, N = 3598.49709.46682.12MAX: 62432.53MAX: 113264.06MAX: 98294.84

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: BMW27 - Compute: CPU-Onlym7a.16xlarget2d-standard-60 AMD Milan816243240SE +/- 0.04, N = 3SE +/- 0.06, N = 327.7434.27

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Classroom - Compute: CPU-Onlym7a.16xlarget2d-standard-60 AMD Milan20406080100SE +/- 0.01, N = 3SE +/- 0.07, N = 371.5189.35

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Fishy Cat - Compute: CPU-Onlym7a.16xlarget2d-standard-60 AMD Milan1020304050SE +/- 0.10, N = 3SE +/- 0.13, N = 337.1245.22

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Barbershop - Compute: CPU-Onlym7a.16xlarget2d-standard-60 AMD Milan80160240320400SE +/- 0.49, N = 3SE +/- 0.60, N = 3276.23351.58

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Pabellon Barcelona - Compute: CPU-Onlym7a.16xlarget2d-standard-60 AMD Milan306090120150SE +/- 0.08, N = 3SE +/- 0.03, N = 391.88112.64

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.36VGR Performance Metricm7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa200K400K600K800K1000K7887046293635108191. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Coremark

CoreMark Size 666 - Iterations Per Second

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per Secondm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa500K1000K1500K2000K2500KSE +/- 1437.63, N = 3SE +/- 635.29, N = 3SE +/- 9191.61, N = 3SE +/- 1295.68, N = 32158639.271259870.721730658.451445843.521. (CC) gcc options: -O2 -lrt" -lrt

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2023Implementation: MPI CPU - Input: water_GMX50_barem7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa246810SE +/- 0.035, N = 3SE +/- 0.001, N = 3SE +/- 0.005, N = 3SE +/- 0.011, N = 37.6552.7665.2894.3911. (CXX) g++ options: -O3

HeFFTe - Highly Efficient FFT for Exascale

Test: c2c - Backend: FFTW - Precision: float - X Y Z: 128

OpenBenchmarking.orgGFLOP/s, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: c2c - Backend: FFTW - Precision: float - X Y Z: 128m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa306090120150SE +/- 1.44, N = 15SE +/- 0.11, N = 3SE +/- 0.78, N = 3SE +/- 0.52, N = 3121.51129.17109.6888.631. (CXX) g++ options: -O3

HeFFTe - Highly Efficient FFT for Exascale

Test: r2c - Backend: FFTW - Precision: float - X Y Z: 128

OpenBenchmarking.orgGFLOP/s, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: r2c - Backend: FFTW - Precision: float - X Y Z: 128m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa4080120160200SE +/- 2.16, N = 15SE +/- 0.57, N = 3SE +/- 0.82, N = 3SE +/- 2.19, N = 12190.60202.45196.95148.581. (CXX) g++ options: -O3

HeFFTe - Highly Efficient FFT for Exascale

Test: c2c - Backend: FFTW - Precision: double - X Y Z: 128

OpenBenchmarking.orgGFLOP/s, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: c2c - Backend: FFTW - Precision: double - X Y Z: 128m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa1632486480SE +/- 0.63, N = 15SE +/- 0.10, N = 3SE +/- 0.66, N = 3SE +/- 1.29, N = 1571.1132.3660.0357.311. (CXX) g++ options: -O3

HeFFTe - Highly Efficient FFT for Exascale

Test: r2c - Backend: FFTW - Precision: double - X Y Z: 128

OpenBenchmarking.orgGFLOP/s, More Is BetterHeFFTe - Highly Efficient FFT for Exascale 2.3Test: r2c - Backend: FFTW - Precision: double - X Y Z: 128m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa306090120150SE +/- 1.18, N = 15SE +/- 0.71, N = 3SE +/- 0.91, N = 3SE +/- 1.78, N = 12124.3679.02106.0393.601. (CXX) g++ options: -O3

Laghos

Test: Triple Point Problem

OpenBenchmarking.orgMajor Kernels Total Rate, More Is BetterLaghos 3.1Test: Triple Point Problemm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa50100150200250SE +/- 1.67, N = 3SE +/- 0.50, N = 3SE +/- 1.77, N = 3SE +/- 0.22, N = 3218.86179.52222.30209.001. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Laghos

Test: Sedov Blast Wave, ube_922_hex.mesh

OpenBenchmarking.orgMajor Kernels Total Rate, More Is BetterLaghos 3.1Test: Sedov Blast Wave, ube_922_hex.meshm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa90180270360450SE +/- 1.29, N = 3SE +/- 0.79, N = 3SE +/- 0.62, N = 3SE +/- 0.31, N = 3409.73321.29364.64259.551. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

LAMMPS Molecular Dynamics Simulator

Model: 20k Atoms

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k Atomsm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa714212835SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 331.4725.0626.7319.78-lm-lm-lm1. (CXX) g++ options: -O3 -ldl

LAMMPS Molecular Dynamics Simulator

Model: Rhodopsin Protein

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin Proteinm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa816243240SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.17, N = 3SE +/- 0.54, N = 1232.7926.0427.8317.42-lm-lm-lm1. (CXX) g++ options: -O3 -ldl

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa60120180240300SE +/- 0.10, N = 3SE +/- 0.34, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 365.45270.0778.3578.071. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa4080120160200SE +/- 0.22, N = 3SE +/- 0.22, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 335.81167.9541.9941.541. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa1.00512.01023.01534.02045.0255SE +/- 0.015, N = 3SE +/- 0.014, N = 3SE +/- 0.013, N = 3SE +/- 0.007, N = 32.6494.4673.2053.2501. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, Losslessm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa246810SE +/- 0.008, N = 3SE +/- 0.032, N = 3SE +/- 0.031, N = 3SE +/- 0.099, N = 35.6788.8797.6396.8891. (CXX) g++ options: -O3 -fPIC -lm

libxsmm

M N K: 32

OpenBenchmarking.orgGFLOPS/s, More Is Betterlibxsmm 2-1.17-3645M N K: 32m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa140280420560700SE +/- 0.40, N = 3SE +/- 0.47, N = 3SE +/- 3.60, N = 4SE +/- 0.19, N = 3643.4312.7289.2255.4-lquadmath -msse4.2-march=armv8.1-a-lquadmath -msse4.2-lquadmath -msse4.21. (CXX) g++ options: -dynamic -Bstatic -static-libgcc -lgomp -lm -lrt -ldl -lstdc++ -pthread -fPIC -std=c++14 -O2 -fopenmp-simd -funroll-loops -ftree-vectorize -fdata-sections -ffunction-sections -fvisibility=hidden

libxsmm

M N K: 64

OpenBenchmarking.orgGFLOPS/s, More Is Betterlibxsmm 2-1.17-3645M N K: 64m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa30060090012001500SE +/- 0.52, N = 3SE +/- 0.96, N = 3SE +/- 0.25, N = 3SE +/- 0.12, N = 31201.8589.5554.2489.7-lquadmath -msse4.2-march=armv8.1-a-lquadmath -msse4.2-lquadmath -msse4.21. (CXX) g++ options: -dynamic -Bstatic -static-libgcc -lgomp -lm -lrt -ldl -lstdc++ -pthread -fPIC -std=c++14 -O2 -fopenmp-simd -funroll-loops -ftree-vectorize -fdata-sections -ffunction-sections -fvisibility=hidden

NAS Parallel Benchmarks

Test / Class: BT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: BT.Cm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa40K80K120K160K200KSE +/- 560.75, N = 3SE +/- 7.69, N = 3SE +/- 42.77, N = 3SE +/- 122.23, N = 3193219.1224229.14122720.6196257.481. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: CG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.Cm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa9K18K27K36K45KSE +/- 178.46, N = 3SE +/- 23.52, N = 3SE +/- 1215.82, N = 15SE +/- 77.92, N = 342007.5713343.3516649.3719597.861. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: EP.D

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.Dm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa16003200480064008000SE +/- 8.54, N = 3SE +/- 7.28, N = 3SE +/- 51.21, N = 5SE +/- 30.67, N = 37501.762213.764935.683783.601. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: FT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: FT.Cm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa20K40K60K80K100KSE +/- 446.85, N = 3SE +/- 2.85, N = 3SE +/- 137.77, N = 3SE +/- 600.19, N = 15103413.0221386.3754846.1839647.471. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: IS.D

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: IS.Dm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa9001800270036004500SE +/- 3.14, N = 3SE +/- 0.58, N = 3SE +/- 142.62, N = 12SE +/- 36.45, N = 154085.20915.801752.622422.401. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: LU.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.Cm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa50K100K150K200K250KSE +/- 661.61, N = 3SE +/- 7.52, N = 3SE +/- 1463.52, N = 15SE +/- 293.57, N = 3210544.8718807.7594247.7773563.131. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: MG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.Cm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa30K60K90K120K150KSE +/- 526.14, N = 3SE +/- 10.99, N = 3SE +/- 145.06, N = 3SE +/- 29.69, N = 3121293.8025661.0447291.9642701.831. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: SP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.Cm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa20K40K60K80K100KSE +/- 91.17, N = 3SE +/- 0.76, N = 3SE +/- 555.92, N = 3SE +/- 45.01, N = 3102392.409716.9943228.1139919.711. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

nekRS

Input: Kershaw

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: Kershawm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa1600M3200M4800M6400M8000MSE +/- 49077561.86, N = 3SE +/- 2970005.61, N = 3SE +/- 84802173.02, N = 12SE +/- 57202190.49, N = 1276678466671758860000368193583342898583331. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: TurboPipe Periodicm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa1000M2000M3000M4000M5000MSE +/- 6657808.28, N = 3SE +/- 1790009.31, N = 3SE +/- 481352.26, N = 3SE +/- 201939132.13, N = 1247747966672221710000273062000047239400001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

nginx

Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa50K100K150K200K250KSE +/- 451.60, N = 3SE +/- 249.05, N = 3SE +/- 394.72, N = 3SE +/- 126.15, N = 3233014.72162553.85162957.75187350.441. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

nginx

Connections: 1000

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 1000m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa50K100K150K200K250KSE +/- 260.28, N = 3SE +/- 132.24, N = 3SE +/- 156.32, N = 3SE +/- 688.79, N = 3224859.09158700.36155609.04180537.841. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper Beamm7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa20406080100SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 1.56, N = 1566.2775.6892.87

OpenRadioss

Model: Chrysler Neon 1M

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1Mm7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa70140210280350SE +/- 0.61, N = 3SE +/- 1.48, N = 3SE +/- 2.03, N = 3190.79327.88337.70

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop Testm7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa918273645SE +/- 0.08, N = 3SE +/- 0.39, N = 15SE +/- 1.27, N = 1526.1430.1238.82

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on Windshieldm7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa306090120150SE +/- 0.18, N = 3SE +/- 0.13, N = 3SE +/- 3.26, N = 9115.96123.61147.31

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal Installationm7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa20406080100SE +/- 0.73, N = 3SE +/- 0.22, N = 3SE +/- 4.01, N = 1259.1872.0689.65

OpenSSL

Algorithm: SHA256

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: SHA256m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa13000M26000M39000M52000M65000MSE +/- 161718701.08, N = 3SE +/- 192235444.29, N = 3SE +/- 20491615.60, N = 3SE +/- 9562123.40, N = 362253861197422885139735088499710346211821313-m64-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

OpenSSL

Algorithm: SHA512

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: SHA512m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa6000M12000M18000M24000M30000MSE +/- 29763937.73, N = 3SE +/- 6214593.12, N = 3SE +/- 108274834.92, N = 3SE +/- 4399663.13, N = 326481506820143849178632224480418314702270573-m64-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.1Algorithm: RSA4096m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa7K14K21K28K35KSE +/- 24.57, N = 3SE +/- 0.09, N = 3SE +/- 11.58, N = 3SE +/- 14.62, N = 331583.82640.012973.020079.5-m64-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.1Algorithm: RSA4096m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa200K400K600K800K1000KSE +/- 367.82, N = 3SE +/- 6.55, N = 3SE +/- 644.45, N = 3SE +/- 50.91, N = 3996017.5215683.2860844.6493077.6-m64-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

OpenSSL

Algorithm: ChaCha20

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: ChaCha20m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa70000M140000M210000M280000M350000MSE +/- 280681661.27, N = 3SE +/- 372419.81, N = 3SE +/- 47698640.87, N = 3SE +/- 12326205.97, N = 330830804508367324778360180249145770173980949893-m64-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

OpenSSL

Algorithm: AES-128-GCM

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: AES-128-GCMm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa130000M260000M390000M520000M650000MSE +/- 1818538727.73, N = 3SE +/- 5537993.15, N = 3SE +/- 376720190.05, N = 3SE +/- 342949201.09, N = 3592545362740158788510970234604082610343095284440-m64-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

OpenSSL

Algorithm: AES-256-GCM

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: AES-256-GCMm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa110000M220000M330000M440000M550000MSE +/- 1691817104.57, N = 3SE +/- 2100313.05, N = 3SE +/- 178290221.71, N = 3SE +/- 71241287.97, N = 3522113080527129198197600216025967640293328048497-m64-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

OpenSSL

Algorithm: ChaCha20-Poly1305

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.1Algorithm: ChaCha20-Poly1305m7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa50000M100000M150000M200000M250000MSE +/- 85099636.22, N = 3SE +/- 2259404.37, N = 3SE +/- 198663058.81, N = 3SE +/- 3664727.47, N = 321677347553346715126487119647720337123909304773-m64-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa714212835SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 331.720.1010.7318.39-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa2K4K6K8K10KSE +/- 0.12, N = 3SE +/- 1.02, N = 3SE +/- 1.32, N = 3SE +/- 0.17, N = 3503.389996.561393.56648.81-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 9993.58 / MAX: 10001.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa60120180240300SE +/- 0.53, N = 3SE +/- 0.00, N = 3SE +/- 3.12, N = 15SE +/- 0.23, N = 3284.421.0673.74142.75-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa2004006008001000SE +/- 0.10, N = 3SE +/- 0.37, N = 3SE +/- 9.17, N = 15SE +/- 0.13, N = 356.21947.59208.4783.99-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 943.57 / MAX: 951.68-pie - MIN: 119.65 / MAX: 316.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa60120180240300SE +/- 0.29, N = 3SE +/- 0.00, N = 3SE +/- 2.74, N = 15SE +/- 0.48, N = 3283.401.0678.96142.90-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa2004006008001000SE +/- 0.06, N = 3SE +/- 0.55, N = 3SE +/- 7.79, N = 15SE +/- 0.29, N = 356.41947.86193.4583.91-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 944.57 / MAX: 958.26-pie - MIN: 113.44 / MAX: 315.541. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa5001000150020002500SE +/- 1.65, N = 3SE +/- 0.01, N = 3SE +/- 1.55, N = 3SE +/- 6.33, N = 32417.346.53368.391389.69-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa306090120150SE +/- 0.00, N = 3SE +/- 0.09, N = 3SE +/- 0.17, N = 3SE +/- 0.04, N = 36.60153.1240.678.62-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 152.69 / MAX: 153.75-pie - MIN: 12.07 / MAX: 59.441. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa1428425670SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 361.190.0426.2835.19-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa5K10K15K20K25KSE +/- 0.03, N = 3SE +/- 15.60, N = 3SE +/- 0.35, N = 3SE +/- 0.21, N = 3261.1122391.86568.77340.29-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 22364.17 / MAX: 22423.421. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa15003000450060007500SE +/- 4.07, N = 3SE +/- 0.01, N = 3SE +/- 15.96, N = 3SE +/- 8.74, N = 37222.1020.791285.474166.39-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa1122334455SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 3SE +/- 0.01, N = 32.2148.0811.652.87-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 47.55 / MAX: 50.49-pie - MIN: 3.76 / MAX: 29.11. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa2004006008001000SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 0.93, N = 3SE +/- 1.04, N = 31049.662.61225.48576.94-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa80160240320400SE +/- 0.00, N = 3SE +/- 0.20, N = 3SE +/- 0.27, N = 3SE +/- 0.04, N = 315.22382.4766.4620.77-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 381.67 / MAX: 383.43-pie - MIN: 25.85 / MAX: 122.21. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa8001600240032004000SE +/- 1.69, N = 3SE +/- 0.00, N = 15SE +/- 1.12, N = 3SE +/- 3.16, N = 33666.890.141512.572043.05-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa15003000450060007500SE +/- 0.00, N = 3SE +/- 27.09, N = 15SE +/- 0.01, N = 3SE +/- 0.01, N = 34.356990.109.905.86-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 6842.82 / MAX: 7088.531. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa7001400210028003500SE +/- 0.31, N = 3SE +/- 0.01, N = 3SE +/- 0.56, N = 3SE +/- 0.47, N = 33132.488.391014.701875.28-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa306090120150SE +/- 0.00, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 310.19119.1714.7615.98-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 118.73 / MAX: 120.211. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa2K4K6K8K10KSE +/- 3.60, N = 3SE +/- 0.01, N = 3SE +/- 2.08, N = 3SE +/- 6.52, N = 310382.220.464239.526605.12-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa5001000150020002500SE +/- 0.00, N = 3SE +/- 27.29, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 33.072186.813.524.53-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 2135.06 / MAX: 2233.341. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa30060090012001500SE +/- 0.51, N = 3SE +/- 0.00, N = 3SE +/- 0.37, N = 3SE +/- 0.79, N = 31222.990.15565.34645.74-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa15003000450060007500SE +/- 0.01, N = 3SE +/- 76.95, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 313.076773.3126.5018.56-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 6616.83 / MAX: 6859.991. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa70140210280350SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 0.37, N = 3SE +/- 0.25, N = 3315.141.3696.58185.29-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa160320480640800SE +/- 0.02, N = 3SE +/- 0.26, N = 3SE +/- 0.58, N = 3SE +/- 0.09, N = 350.72735.58155.1464.70-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 734.34 / MAX: 738.23-pie - MIN: 114.75 / MAX: 224.641. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa13002600390052006500SE +/- 4.43, N = 3SE +/- 0.01, N = 3SE +/- 3.26, N = 3SE +/- 3.28, N = 36177.945.502646.583650.57-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa4080120160200SE +/- 0.01, N = 3SE +/- 0.24, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 35.16181.9411.328.20-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 180.71 / MAX: 184.111. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa7001400210028003500SE +/- 1.10, N = 3SE +/- 0.01, N = 3SE +/- 3.66, N = 3SE +/- 4.38, N = 33146.047.36633.761764.21-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa306090120150SE +/- 0.00, N = 3SE +/- 0.21, N = 3SE +/- 0.14, N = 3SE +/- 0.02, N = 35.07135.8723.646.79-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 132.35 / MAX: 148.64-pie - MIN: 9.57 / MAX: 42.221. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa30060090012001500SE +/- 0.70, N = 3SE +/- 0.02, N = 3SE +/- 0.96, N = 3SE +/- 0.60, N = 31419.112.53370.03964.46-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa90180270360450SE +/- 0.01, N = 3SE +/- 2.18, N = 3SE +/- 0.21, N = 3SE +/- 0.02, N = 322.53394.9481.0031.08-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 380.82 / MAX: 408.15-pie - MIN: 64.65 / MAX: 134.641. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa20K40K60K80K100KSE +/- 31.79, N = 3SE +/- 0.39, N = 3SE +/- 14.46, N = 3SE +/- 18.42, N = 381996.81178.8229668.1243607.04-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa1.25552.5113.76655.0226.2775SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.385.580.990.52-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 5.45 / MAX: 6.48-pie - MIN: 0.8 / MAX: 13.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa2004006008001000SE +/- 0.18, N = 3SE +/- 0.00, N = 3SE +/- 1.37, N = 3SE +/- 1.75, N = 31158.432.36390.72761.14-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa90180270360450SE +/- 0.01, N = 3SE +/- 0.26, N = 3SE +/- 0.27, N = 3SE +/- 0.09, N = 327.60423.9576.7239.38-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 411.17 / MAX: 440.57-pie - MIN: 58.8 / MAX: 121.691. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa20K40K60K80K100KSE +/- 453.62, N = 3SE +/- 0.48, N = 3SE +/- 332.93, N = 3SE +/- 45.46, N = 392100.80136.1644049.1554971.26-pie-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa246810SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.277.330.610.40-isystem -fPIC -fvisibility=hidden -std=c++14 -MD -MT -MF -shared - MIN: 6.54 / MAX: 9.951. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Onlym7a.16xlargec6g.16xlarget2d-standard-60 AMD Milan600K1200K1800K2400K3000KSE +/- 13309.30, N = 3SE +/- 12058.27, N = 3SE +/- 20558.90, N = 32923009104326720037841. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Onlym7a.16xlargec6g.16xlarget2d-standard-60 AMD Milan600K1200K1800K2400K3000KSE +/- 2874.04, N = 3SE +/- 12606.16, N = 3SE +/- 22497.42, N = 3288094097503120081861. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Writem7a.16xlargec6g.16xlarget2d-standard-60 AMD Milan12002400360048006000SE +/- 13.63, N = 3SE +/- 109.40, N = 12SE +/- 49.28, N = 125312478456821. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Writem7a.16xlargec6g.16xlarget2d-standard-60 AMD Milan12002400360048006000SE +/- 16.57, N = 3SE +/- 124.50, N = 9SE +/- 49.93, N = 85300477657931. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latencym7a.16xlargec6g.16xlarget2d-standard-60 AMD Milan0.17260.34520.51780.69040.863SE +/- 0.001, N = 3SE +/- 0.009, N = 3SE +/- 0.004, N = 30.2740.7670.3991. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latencym7a.16xlargec6g.16xlarget2d-standard-60 AMD Milan0.23090.46180.69270.92361.1545SE +/- 0.000, N = 3SE +/- 0.013, N = 3SE +/- 0.006, N = 30.3471.0260.4981. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latencym7a.16xlargec6g.16xlarget2d-standard-60 AMD Milan4080120160200SE +/- 0.39, N = 3SE +/- 3.85, N = 12SE +/- 1.23, N = 12150.60168.19140.921. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latencym7a.16xlargec6g.16xlarget2d-standard-60 AMD Milan50100150200250SE +/- 0.59, N = 3SE +/- 6.00, N = 9SE +/- 1.44, N = 8188.68210.61172.721. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Remhos

Test: Sample Remap Example

OpenBenchmarking.orgSeconds, Fewer Is BetterRemhos 1.0Test: Sample Remap Examplem7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa816243240SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 313.8720.8216.3333.361. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Rodinia

Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP LavaMDm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa1428425670SE +/- 0.24, N = 3SE +/- 0.03, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 343.2962.3050.9764.861. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP HotSpot3D

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP HotSpot3Dm7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa20406080100SE +/- 0.74, N = 15SE +/- 1.83, N = 12SE +/- 0.86, N = 1574.7888.5484.171. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP Leukocyte

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP Leukocytem7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa1020304050SE +/- 0.32, N = 3SE +/- 0.02, N = 3SE +/- 0.17, N = 334.6642.0145.501. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP CFD Solver

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP CFD Solverm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa3691215SE +/- 0.007, N = 3SE +/- 0.001, N = 3SE +/- 0.034, N = 3SE +/- 0.013, N = 36.4805.9837.36810.0251. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP Streamcluster

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP Streamclusterm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa48121620SE +/- 0.049, N = 3SE +/- 0.017, N = 3SE +/- 0.009, N = 3SE +/- 0.104, N = 155.93014.2126.4236.4481. (CXX) g++ options: -O2 -lOpenCL

Stockfish

Total Time

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 15Total Timem7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa30M60M90M120M150MSE +/- 1001447.21, N = 3SE +/- 1645401.81, N = 15SE +/- 1618403.29, N = 14SE +/- 1450871.09, N = 313541916981807706112958788105894457-m64 -msse -msse3 -mpopcnt -mavx2 -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2-m64 -msse -msse3 -mpopcnt -mavx2 -msse4.1 -mssse3 -msse2 -mbmi2-m64 -msse -msse3 -mpopcnt -mavx2 -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi21. (CXX) g++ options: -lgcov -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -flto -flto=jobserver

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50m7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa1530456075SE +/- 0.20, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 369.5518.2950.99

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 32 - Model: ResNet-50m7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa20406080100SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 387.1920.3662.74

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50m7a.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa20406080100SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3100.1520.9069.68

Timed Gem5 Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 21.2Time To Compilem7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa50100150200250SE +/- 0.39, N = 3SE +/- 0.03, N = 3SE +/- 0.27, N = 3SE +/- 0.07, N = 3153.80224.41170.93176.77

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milan20406080100SE +/- 0.29, N = 5SE +/- 0.82, N = 3SE +/- 0.37, N = 527.71102.2233.40

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milan90180270360450SE +/- 0.37, N = 3SE +/- 2.41, N = 3SE +/- 1.20, N = 3267.97409.10333.35

Timed Node.js Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1Time To Compilem7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa60120180240300SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.29, N = 3154.44286.20191.71198.39

Xcompact3d Incompact3d

Input: input.i3d 129 Cells Per Direction

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 129 Cells Per Directionm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa1.32112.64223.96335.28446.6055SE +/- 0.03993251, N = 3SE +/- 0.01888616, N = 3SE +/- 0.02210564, N = 3SE +/- 0.04970425, N = 32.896026615.618116865.630573275.871578851. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

Xcompact3d Incompact3d

Input: input.i3d 193 Cells Per Direction

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per Directionm7a.16xlargec6g.16xlarget2d-standard-60 AMD Milanc3d-standard-60 AMD Genoa714212835SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.31, N = 12SE +/- 0.25, N = 311.5925.8724.5728.021. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz


Phoronix Test Suite v10.8.4