GPTshop.ai NVIDIA GH200 Linux Benchmarks
Benchmarks by Michael Larabel for a future article.


GPTshop.ai GH200: 

	Processor: ARMv8 Neoverse-V2 @ 3.39GHz (72 Cores), Motherboard: Quanta Cloud QuantaGrid S74G-2U 1S7GZ9Z0000 S7G MB (CG1) (3A06 BIOS), Memory: 1 x 480GB DRAM-6400MT/s, Disk: 960GB SAMSUNG MZ1L2960HCJR-00A07 + 1920GB SAMSUNG MZTL21T9, Graphics: ASPEED, Network: 2 x Mellanox MT2910 + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE

	OS: Ubuntu 23.10, Kernel: 6.5.0-15-generic (aarch64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

HP Z6 G5 A - Threadripper PRO 7995WX: 

	Processor: AMD Ryzen Threadripper PRO 7995WX 96-Cores @ 6.44GHz (96 Cores / 192 Threads), Motherboard: HP Z6 G5 A Workstation 8B24 (U65 Ver. 01.01.04 BIOS), Chipset: AMD Device 14a4, Memory: 8 x 16GB DRAM-5200MT/s Hynix HMCG78AGBRA190N, Disk: 2 x 1024GB SAMSUNG MZVL21T0HCLR-00BH1, Graphics: NVIDIA RTX A4000 16GB, Audio: NVIDIA GA104 HD Audio, Monitor: ASUS VP28U, Network: Realtek RTL8111/8168/8411

	OS: Ubuntu 23.10, Kernel: 6.5.0-17-generic (x86_64), Desktop: GNOME Shell 45.2, Display Server: X Server 1.21.1.7, Display Driver: NVIDIA 535.154.05, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.2.148, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160


High Performance Conjugate Gradient 3.1
X Y Z: 144 144 144 - RT: 60
GFLOP/s > Higher Is Better
GPTshop.ai GH200 ..................... 41.69 |=================================


NAS Parallel Benchmarks 3.4
Test / Class: BT.C
Total Mop/s > Higher Is Better
GPTshop.ai GH200 ..................... 49381.68  |=======
HP Z6 G5 A - Threadripper PRO 7995WX . 213489.54 |=============================


NAS Parallel Benchmarks 3.4
Test / Class: CG.C
Total Mop/s > Higher Is Better
GPTshop.ai GH200 ..................... 24046.25 |==============
HP Z6 G5 A - Threadripper PRO 7995WX . 50606.21 |==============================


NAS Parallel Benchmarks 3.4
Test / Class: FT.C
Total Mop/s > Higher Is Better
GPTshop.ai GH200 ..................... 48109.28  |==============
HP Z6 G5 A - Threadripper PRO 7995WX . 100501.03 |=============================


NAS Parallel Benchmarks 3.4
Test / Class: IS.D
Total Mop/s > Higher Is Better
GPTshop.ai GH200 ..................... 1748.55 |============
HP Z6 G5 A - Threadripper PRO 7995WX . 4351.68 |===============================


NAS Parallel Benchmarks 3.4
Test / Class: LU.C
Total Mop/s > Higher Is Better
GPTshop.ai GH200 ..................... 39739.62  |=====
HP Z6 G5 A - Threadripper PRO 7995WX . 251214.23 |=============================


NAS Parallel Benchmarks 3.4
Test / Class: MG.C
Total Mop/s > Higher Is Better
GPTshop.ai GH200 ..................... 58334.53 |==================
HP Z6 G5 A - Threadripper PRO 7995WX . 94796.95 |==============================


NAS Parallel Benchmarks 3.4
Test / Class: SP.C
Total Mop/s > Higher Is Better
GPTshop.ai GH200 ..................... 21268.70 |=======
HP Z6 G5 A - Threadripper PRO 7995WX . 88821.77 |==============================


miniBUDE 20210901
Implementation: OpenMP - Input Deck: BM2
GFInst/s > Higher Is Better
GPTshop.ai GH200 ..................... 1193.12 |========
HP Z6 G5 A - Threadripper PRO 7995WX . 4472.18 |===============================


miniBUDE 20210901
Implementation: OpenMP - Input Deck: BM2
Billion Interactions/s > Higher Is Better
GPTshop.ai GH200 ..................... 47.73  |=========
HP Z6 G5 A - Threadripper PRO 7995WX . 178.89 |================================


Rodinia 3.1
Test: OpenMP LavaMD
Seconds < Lower Is Better
GPTshop.ai GH200 ..................... 30.31 |=================================
HP Z6 G5 A - Threadripper PRO 7995WX . 26.81 |=============================


Algebraic Multi-Grid Benchmark 1.2

Figure Of Merit > Higher Is Better
GPTshop.ai GH200 ..................... 1997929111 |============================
HP Z6 G5 A - Threadripper PRO 7995WX . 1669939667 |=======================


libxsmm 2-1.17-3645
M N K: 128
GFLOPS/s > Higher Is Better
HP Z6 G5 A - Threadripper PRO 7995WX . 2039.8 |================================


libxsmm 2-1.17-3645
M N K: 256
GFLOPS/s > Higher Is Better
HP Z6 G5 A - Threadripper PRO 7995WX . 2582.5 |================================


NWChem 7.0.2
Input: C240 Buckyball
Seconds < Lower Is Better
GPTshop.ai GH200 ..................... 1403.5 |============================
HP Z6 G5 A - Threadripper PRO 7995WX . 1601.1 |================================


Xcompact3d Incompact3d 2021-03-11
Input: X3D-benchmarking input.i3d
Seconds < Lower Is Better
GPTshop.ai GH200 ..................... 254.49 |=====================
HP Z6 G5 A - Threadripper PRO 7995WX . 383.99 |================================


Xcompact3d Incompact3d 2021-03-11
Input: input.i3d 193 Cells Per Direction
Seconds < Lower Is Better
GPTshop.ai GH200 ..................... 9.81172053  |=========================
HP Z6 G5 A - Threadripper PRO 7995WX . 10.76054920 |===========================


LULESH 2.0.3

z/s > Higher Is Better
GPTshop.ai GH200 ..................... 23185.18 |=============================
HP Z6 G5 A - Threadripper PRO 7995WX . 23830.87 |==============================


Xmrig 6.18.1
Variant: Monero - Hash Count: 1M
H/s > Higher Is Better
GPTshop.ai GH200 ..................... 17253.0 |=========
HP Z6 G5 A - Threadripper PRO 7995WX . 56612.2 |===============================


Xmrig 6.18.1
Variant: Wownero - Hash Count: 1M
H/s > Higher Is Better
GPTshop.ai GH200 ..................... 21924.1 |==========
HP Z6 G5 A - Threadripper PRO 7995WX . 71115.4 |===============================


John The Ripper 2023.03.14
Test: bcrypt
Real C/S > Higher Is Better
GPTshop.ai GH200 ..................... 68817  |=============
HP Z6 G5 A - Threadripper PRO 7995WX . 172723 |================================


John The Ripper 2023.03.14
Test: WPA PSK
Real C/S > Higher Is Better
GPTshop.ai GH200 ..................... 70310  |====
HP Z6 G5 A - Threadripper PRO 7995WX . 612830 |================================


John The Ripper 2023.03.14
Test: Blowfish
Real C/S > Higher Is Better
GPTshop.ai GH200 ..................... 69811  |=============
HP Z6 G5 A - Threadripper PRO 7995WX . 172819 |================================


John The Ripper 2023.03.14
Test: MD5
Real C/S > Higher Is Better
GPTshop.ai GH200 ..................... 1900667  |====
HP Z6 G5 A - Threadripper PRO 7995WX . 14692667 |==============================


GraphicsMagick 1.3.38
Operation: Sharpen
Iterations Per Minute > Higher Is Better
GPTshop.ai GH200 ..................... 1363 |==================================
HP Z6 G5 A - Threadripper PRO 7995WX . 824  |=====================


GraphicsMagick 1.3.38
Operation: Enhanced
Iterations Per Minute > Higher Is Better
GPTshop.ai GH200 ..................... 1761 |==================================
HP Z6 G5 A - Threadripper PRO 7995WX . 1380 |===========================


SVT-AV1 1.7
Encoder Mode: Preset 4 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
GPTshop.ai GH200 ..................... 0.826 |====
HP Z6 G5 A - Threadripper PRO 7995WX . 7.016 |=================================


SVT-AV1 1.7
Encoder Mode: Preset 8 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
GPTshop.ai GH200 ..................... 13.91  |====
HP Z6 G5 A - Threadripper PRO 7995WX . 119.98 |================================


SVT-AV1 1.7
Encoder Mode: Preset 12 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
GPTshop.ai GH200 ..................... 31.47  |=====
HP Z6 G5 A - Threadripper PRO 7995WX . 206.13 |================================


SVT-AV1 1.7
Encoder Mode: Preset 13 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
GPTshop.ai GH200 ..................... 31.50  |=====
HP Z6 G5 A - Threadripper PRO 7995WX . 202.28 |================================


ACES DGEMM 1.0
Sustained Floating-Point Rate
GFLOP/s > Higher Is Better
GPTshop.ai GH200 ..................... 17.94 |==============
HP Z6 G5 A - Threadripper PRO 7995WX . 43.46 |=================================


Coremark 1.0
CoreMark Size 666 - Iterations Per Second
Iterations/Sec > Higher Is Better
GPTshop.ai GH200 ..................... 2263279.94 |================
HP Z6 G5 A - Threadripper PRO 7995WX . 3998440.41 |============================


7-Zip Compression 22.01
Test: Compression Rating
MIPS > Higher Is Better
GPTshop.ai GH200 ..................... 345295 |====================
HP Z6 G5 A - Threadripper PRO 7995WX . 547165 |================================


7-Zip Compression 22.01
Test: Decompression Rating
MIPS > Higher Is Better
GPTshop.ai GH200 ..................... 389055 |===================
HP Z6 G5 A - Threadripper PRO 7995WX . 658991 |================================


Stockfish 15
Total Time
Nodes Per Second > Higher Is Better
GPTshop.ai GH200 ..................... 153826682 |================
HP Z6 G5 A - Threadripper PRO 7995WX . 285651359 |=============================


asmFish 2018-07-23
1024 Hash Memory, 26 Depth
Nodes/second > Higher Is Better
GPTshop.ai GH200 ..................... 150936379 |==================
HP Z6 G5 A - Threadripper PRO 7995WX . 248304686 |=============================


Timed Godot Game Engine Compilation 4.0
Time To Compile
Seconds < Lower Is Better
GPTshop.ai GH200 ..................... 139.10 |================================
HP Z6 G5 A - Threadripper PRO 7995WX . 86.96  |====================


Timed Linux Kernel Compilation 6.1
Build: defconfig
Seconds < Lower Is Better
GPTshop.ai GH200 ..................... 66.89 |=================================
HP Z6 G5 A - Threadripper PRO 7995WX . 30.98 |===============


Timed Linux Kernel Compilation 6.1
Build: allmodconfig
Seconds < Lower Is Better
GPTshop.ai GH200 ..................... 282.29 |================================
HP Z6 G5 A - Threadripper PRO 7995WX . 261.44 |==============================


Timed LLVM Compilation 16.0
Build System: Ninja
Seconds < Lower Is Better
GPTshop.ai GH200 ..................... 195.98 |================================
HP Z6 G5 A - Threadripper PRO 7995WX . 122.39 |====================


Timed Node.js Compilation 19.8.1
Time To Compile
Seconds < Lower Is Better
GPTshop.ai GH200 ..................... 173.88 |================================
HP Z6 G5 A - Threadripper PRO 7995WX . 109.23 |====================


Primesieve 8.0
Length: 1e13
Seconds < Lower Is Better
GPTshop.ai GH200 ..................... 35.49 |=================================
HP Z6 G5 A - Threadripper PRO 7995WX . 23.29 |======================


rays1bench 2020-01-09
Large Scene
mrays/s > Higher Is Better
HP Z6 G5 A - Threadripper PRO 7995WX . 582.32 |================================


oneDNN 3.3
Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
HP Z6 G5 A - Threadripper PRO 7995WX . 0.358902 |==============================


oneDNN 3.3
Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
HP Z6 G5 A - Threadripper PRO 7995WX . 1.25835 |===============================


Helsing 1.0-beta
Digit Range: 14 digit
Seconds < Lower Is Better
GPTshop.ai GH200 ..................... 67.61 |=================================
HP Z6 G5 A - Threadripper PRO 7995WX . 55.90 |===========================


Tachyon 0.99.2
Total Time
Seconds < Lower Is Better
HP Z6 G5 A - Threadripper PRO 7995WX . 16.05 |=================================


Cpuminer-Opt 23.5
Algorithm: Deepcoin
kH/s > Higher Is Better
HP Z6 G5 A - Threadripper PRO 7995WX . 33632 |=================================


Cpuminer-Opt 23.5
Algorithm: Blake-2 S
kH/s > Higher Is Better
HP Z6 G5 A - Threadripper PRO 7995WX . 560763 |================================


Cpuminer-Opt 23.5
Algorithm: Myriad-Groestl
kH/s > Higher Is Better
HP Z6 G5 A - Threadripper PRO 7995WX . 44940 |=================================


Cpuminer-Opt 23.5
Algorithm: Triple SHA-256, Onecoin
kH/s > Higher Is Better
HP Z6 G5 A - Threadripper PRO 7995WX . 401393 |================================


Liquid-DSP 1.6
Threads: 128 - Buffer Length: 256 - Filter Length: 512
samples/s > Higher Is Better
GPTshop.ai GH200 ..................... 229866667  |=====
HP Z6 G5 A - Threadripper PRO 7995WX . 1306966667 |============================


Liquid-DSP 1.6
Threads: 240 - Buffer Length: 256 - Filter Length: 512
samples/s > Higher Is Better
GPTshop.ai GH200 ..................... 237746667  |====
HP Z6 G5 A - Threadripper PRO 7995WX . 1530466667 |============================


ASKAP 1.0
Test: tConvolve MPI - Degridding
Mpix/sec > Higher Is Better
GPTshop.ai GH200 ..................... 12407.6 |=========
HP Z6 G5 A - Threadripper PRO 7995WX . 40906.5 |===============================


ASKAP 1.0
Test: tConvolve MPI - Gridding
Mpix/sec > Higher Is Better
GPTshop.ai GH200 ..................... 9652.19  |=======
HP Z6 G5 A - Threadripper PRO 7995WX . 43543.90 |==============================


ASTC Encoder 4.0
Preset: Medium
MT/s > Higher Is Better
HP Z6 G5 A - Threadripper PRO 7995WX . 443.46 |================================


ASTC Encoder 4.0
Preset: Thorough
MT/s > Higher Is Better
HP Z6 G5 A - Threadripper PRO 7995WX . 62.64 |=================================


ASTC Encoder 4.0
Preset: Exhaustive
MT/s > Higher Is Better
HP Z6 G5 A - Threadripper PRO 7995WX . 6.6196 |================================


Graph500 3.0
Scale: 26
bfs median_TEPS > Higher Is Better
GPTshop.ai GH200 ..................... 1249790000 |============================
HP Z6 G5 A - Threadripper PRO 7995WX . 634702000  |==============


Graph500 3.0
Scale: 26
bfs max_TEPS > Higher Is Better
GPTshop.ai GH200 ..................... 1315650000 |============================
HP Z6 G5 A - Threadripper PRO 7995WX . 647711000  |==============


Graph500 3.0
Scale: 26
sssp median_TEPS > Higher Is Better
GPTshop.ai GH200 ..................... 299027000 |===========================
HP Z6 G5 A - Threadripper PRO 7995WX . 317931000 |=============================


Graph500 3.0
Scale: 26
sssp max_TEPS > Higher Is Better
GPTshop.ai GH200 ..................... 467012000 |=============================
HP Z6 G5 A - Threadripper PRO 7995WX . 399994000 |=========================


GROMACS 2023
Implementation: MPI CPU - Input: water_GMX50_bare
Ns Per Day > Higher Is Better
GPTshop.ai GH200 ..................... 5.194  |================
HP Z6 G5 A - Threadripper PRO 7995WX . 10.314 |================================


DuckDB 0.9.1
Benchmark: IMDB
Seconds < Lower Is Better
GPTshop.ai GH200 ..................... 92.08  |============================
HP Z6 G5 A - Threadripper PRO 7995WX . 104.28 |================================


DuckDB 0.9.1
Benchmark: TPC-H Parquet
Seconds < Lower Is Better
GPTshop.ai GH200 ..................... 148.76 |================================
HP Z6 G5 A - Threadripper PRO 7995WX . 120.76 |==========================


PostgreSQL 16
Scaling Factor: 100 - Clients: 1000 - Mode: Read Write
TPS > Higher Is Better
GPTshop.ai GH200 ..................... 54975 |=================================
HP Z6 G5 A - Threadripper PRO 7995WX . 16124 |==========


PostgreSQL 16
Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency
ms < Lower Is Better
GPTshop.ai GH200 ..................... 18.23 |==========
HP Z6 G5 A - Threadripper PRO 7995WX . 62.03 |=================================


RawTherapee
Total Benchmark Time
Seconds < Lower Is Better
GPTshop.ai GH200 ..................... 46.72 |===========================
HP Z6 G5 A - Threadripper PRO 7995WX . 57.89 |=================================


Stress-NG 0.16.04
Test: CPU Stress
Bogo Ops/s > Higher Is Better
GPTshop.ai GH200 ..................... 30484.77  |====
HP Z6 G5 A - Threadripper PRO 7995WX . 212486.91 |=============================


Stress-NG 0.16.04
Test: Matrix Math
Bogo Ops/s > Higher Is Better
GPTshop.ai GH200 ..................... 512759.08 |=============================
HP Z6 G5 A - Threadripper PRO 7995WX . 430429.52 |========================


Stress-NG 0.16.04
Test: Vector Math
Bogo Ops/s > Higher Is Better
GPTshop.ai GH200 ..................... 359058.52 |=================
HP Z6 G5 A - Threadripper PRO 7995WX . 619071.09 |=============================


Stress-NG 0.16.04
Test: AVX-512 VNNI
Bogo Ops/s > Higher Is Better
GPTshop.ai GH200 ..................... 4173580.13 |=============
HP Z6 G5 A - Threadripper PRO 7995WX . 9099613.65 |============================


Stress-NG 0.16.04
Test: Floating Point
Bogo Ops/s > Higher Is Better
GPTshop.ai GH200 ..................... 20137.35 |====================
HP Z6 G5 A - Threadripper PRO 7995WX . 30460.61 |==============================


Stress-NG 0.16.04
Test: Matrix 3D Math
Bogo Ops/s > Higher Is Better
GPTshop.ai GH200 ..................... 17483.02 |==============================
HP Z6 G5 A - Threadripper PRO 7995WX . 9100.74  |================


Stress-NG 0.16.04
Test: Memory Copying
Bogo Ops/s > Higher Is Better
GPTshop.ai GH200 ..................... 27182.72 |=============================
HP Z6 G5 A - Threadripper PRO 7995WX . 27883.51 |==============================


Stress-NG 0.16.04
Test: Wide Vector Math
Bogo Ops/s > Higher Is Better
GPTshop.ai GH200 ..................... 2002466.67 |=====================
HP Z6 G5 A - Threadripper PRO 7995WX . 2721964.70 |============================


Stress-NG 0.16.04
Test: Fused Multiply-Add
Bogo Ops/s > Higher Is Better
GPTshop.ai GH200 ..................... 139525267.41 |==================
HP Z6 G5 A - Threadripper PRO 7995WX . 206576021.93 |==========================


Stress-NG 0.16.04
Test: Vector Floating Point
Bogo Ops/s > Higher Is Better
GPTshop.ai GH200 ..................... 103967.93 |==============
HP Z6 G5 A - Threadripper PRO 7995WX . 219092.94 |=============================


Timed Gem5 Compilation 23.0.1
Time To Compile
Seconds < Lower Is Better
GPTshop.ai GH200 ..................... 180.62 |================================
HP Z6 G5 A - Threadripper PRO 7995WX . 156.37 |============================


OpenVINO 2023.2.dev
Model: Face Detection FP16 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 7.46  |=====
HP Z6 G5 A - Threadripper PRO 7995WX . 48.01 |=================================


OpenVINO 2023.2.dev
Model: Face Detection FP16 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 134.06 |====
HP Z6 G5 A - Threadripper PRO 7995WX . 993.05 |================================


OpenVINO 2023.2.dev
Model: Person Detection FP16 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 19.06  |==
HP Z6 G5 A - Threadripper PRO 7995WX . 340.49 |================================


OpenVINO 2023.2.dev
Model: Person Detection FP16 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 52.51  |============
HP Z6 G5 A - Threadripper PRO 7995WX . 140.80 |================================


OpenVINO 2023.2.dev
Model: Person Detection FP32 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 19.16  |==
HP Z6 G5 A - Threadripper PRO 7995WX . 341.45 |================================


OpenVINO 2023.2.dev
Model: Person Detection FP32 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 52.20  |============
HP Z6 G5 A - Threadripper PRO 7995WX . 140.45 |================================


OpenVINO 2023.2.dev
Model: Vehicle Detection FP16 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 124.47  |=
HP Z6 G5 A - Threadripper PRO 7995WX . 3237.40 |===============================


OpenVINO 2023.2.dev
Model: Vehicle Detection FP16 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 8.02  |==================
HP Z6 G5 A - Threadripper PRO 7995WX . 14.81 |=================================


OpenVINO 2023.2.dev
Model: Face Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 1.01  |
HP Z6 G5 A - Threadripper PRO 7995WX . 94.94 |=================================


OpenVINO 2023.2.dev
Model: Face Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 993.52 |================================
HP Z6 G5 A - Threadripper PRO 7995WX . 503.91 |================


OpenVINO 2023.2.dev
Model: Face Detection Retail FP16 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 184.36   |
HP Z6 G5 A - Threadripper PRO 7995WX . 11647.89 |==============================


OpenVINO 2023.2.dev
Model: Face Detection Retail FP16 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 5.41 |==================================
HP Z6 G5 A - Threadripper PRO 7995WX . 4.11 |==========================


OpenVINO 2023.2.dev
Model: Road Segmentation ADAS FP16 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 44.58   |=
HP Z6 G5 A - Threadripper PRO 7995WX . 1712.72 |===============================


OpenVINO 2023.2.dev
Model: Road Segmentation ADAS FP16 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 22.44 |==========================
HP Z6 G5 A - Threadripper PRO 7995WX . 28.00 |=================================


OpenVINO 2023.2.dev
Model: Vehicle Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 9.94    |
HP Z6 G5 A - Threadripper PRO 7995WX . 5727.47 |===============================


OpenVINO 2023.2.dev
Model: Vehicle Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 100.62 |================================
HP Z6 G5 A - Threadripper PRO 7995WX . 8.37   |===


OpenVINO 2023.2.dev
Model: Weld Porosity Detection FP16 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 285.00  |==
HP Z6 G5 A - Threadripper PRO 7995WX . 4793.80 |===============================


OpenVINO 2023.2.dev
Model: Weld Porosity Detection FP16 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 3.50  |======
HP Z6 G5 A - Threadripper PRO 7995WX . 20.01 |=================================


OpenVINO 2023.2.dev
Model: Face Detection Retail FP16-INT8 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 26.53    |
HP Z6 G5 A - Threadripper PRO 7995WX . 16968.10 |==============================


OpenVINO 2023.2.dev
Model: Face Detection Retail FP16-INT8 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 37.70 |=================================
HP Z6 G5 A - Threadripper PRO 7995WX . 5.64  |=====


OpenVINO 2023.2.dev
Model: Road Segmentation ADAS FP16-INT8 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 3.24    |
HP Z6 G5 A - Threadripper PRO 7995WX . 2039.24 |===============================


OpenVINO 2023.2.dev
Model: Road Segmentation ADAS FP16-INT8 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 308.42 |================================
HP Z6 G5 A - Threadripper PRO 7995WX . 23.52  |==


OpenVINO 2023.2.dev
Model: Machine Translation EN To DE FP16 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 23.78  |=
HP Z6 G5 A - Threadripper PRO 7995WX . 555.21 |================================


OpenVINO 2023.2.dev
Model: Machine Translation EN To DE FP16 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 42.05 |================
HP Z6 G5 A - Threadripper PRO 7995WX . 86.38 |=================================


OpenVINO 2023.2.dev
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 76.44   |
HP Z6 G5 A - Threadripper PRO 7995WX . 9585.34 |===============================


OpenVINO 2023.2.dev
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 13.07 |=================================
HP Z6 G5 A - Threadripper PRO 7995WX . 10.00 |=========================


OpenVINO 2023.2.dev
Model: Person Vehicle Bike Detection FP16 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 26.68   |
HP Z6 G5 A - Threadripper PRO 7995WX . 5467.67 |===============================


OpenVINO 2023.2.dev
Model: Person Vehicle Bike Detection FP16 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 37.48 |=================================
HP Z6 G5 A - Threadripper PRO 7995WX . 8.76  |========


OpenVINO 2023.2.dev
Model: Handwritten English Recognition FP16 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 4.33    |
HP Z6 G5 A - Threadripper PRO 7995WX . 2541.51 |===============================


OpenVINO 2023.2.dev
Model: Handwritten English Recognition FP16 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 231.18 |================================
HP Z6 G5 A - Threadripper PRO 7995WX . 37.75  |=====


OpenVINO 2023.2.dev
Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 781.77   |
HP Z6 G5 A - Threadripper PRO 7995WX . 83726.28 |==============================


OpenVINO 2023.2.dev
Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 1.27 |==================================
HP Z6 G5 A - Threadripper PRO 7995WX . 0.90 |========================


OpenVINO 2023.2.dev
Model: Handwritten English Recognition FP16-INT8 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 4.16    |
HP Z6 G5 A - Threadripper PRO 7995WX . 2141.63 |===============================


OpenVINO 2023.2.dev
Model: Handwritten English Recognition FP16-INT8 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 240.51 |================================
HP Z6 G5 A - Threadripper PRO 7995WX . 44.96  |======


OpenVINO 2023.2.dev
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
FPS > Higher Is Better
GPTshop.ai GH200 ..................... 595.73    |
HP Z6 G5 A - Threadripper PRO 7995WX . 107003.12 |=============================


OpenVINO 2023.2.dev
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
ms < Lower Is Better
GPTshop.ai GH200 ..................... 1.67 |==================================
HP Z6 G5 A - Threadripper PRO 7995WX . 0.65 |=============