nvidia A2
2 x AMD EPYC 9334 32-Core testing with a Giga Computing MZ73-LM1-000 v01000100 (F10 BIOS) and Gigabyte NVIDIA A2 15GB on Ubuntu 22.04 via the Phoronix Test Suite.


Genoa 9334: 

	Processor: 2 x AMD EPYC 9334 32-Core @ 2.70GHz (64 Cores / 127 Threads), Motherboard: Giga Computing MZ73-LM1-000 v01000100 (F10 BIOS), Chipset: AMD Device 14a4, Memory: 8 x 32 GB DDR5-4800MT/s Micron MTC20F1045S1RC48BA2, Disk: 1920GB KINGSTON SEDC600, Graphics: Gigabyte NVIDIA A2 15GB, Network: 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA

	OS: Ubuntu 22.04, Kernel: 6.8.0-45-generic (x86_64), Desktop: GNOME Shell 42.9, Display Server: X Server 1.21.1.4, Display Driver: NVIDIA 535.183.01, OpenCL: OpenCL 3.0 CUDA 12.2.148, Vulkan: 1.3.242, Compiler: GCC 11.4.0 + CUDA 12.2, File-System: ext4, Screen Resolution: 1920x1200

Genoa Eypc 9334: 

	Processor: 2 x AMD EPYC 9334 32-Core @ 2.70GHz (64 Cores / 127 Threads), Motherboard: Giga Computing MZ73-LM1-000 v01000100 (F10 BIOS), Chipset: AMD Device 14a4, Memory: 8 x 32 GB DDR5-4800MT/s Micron MTC20F1045S1RC48BA2, Disk: 1920GB KINGSTON SEDC600, Graphics: Gigabyte NVIDIA A2 15GB, Network: 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA

	OS: Ubuntu 22.04, Kernel: 6.8.0-45-generic (x86_64), Desktop: GNOME Shell 42.9, Display Server: X Server 1.21.1.4, Display Driver: NVIDIA 535.183.01, OpenGL: 4.5 Mesa 23.2.1-1ubuntu3.1~22.04.2 (LLVM 15.0.7 256 bits), OpenCL: OpenCL 3.0 CUDA 12.2.148, Vulkan: 1.3.242, Compiler: GCC 11.4.0 + CUDA 12.2, File-System: ext4, Screen Resolution: 1920x1200


PlaidML
FP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCL
Examples Per Second > Higher Is Better


NCNN 20230517
Target: Vulkan GPU - Model: mobilenet
ms < Lower Is Better
Genoa Eypc 9334 . 83.03 |======================================================


NCNN 20230517
Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2
ms < Lower Is Better
Genoa Eypc 9334 . 63.03 |======================================================


NCNN 20230517
Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3
ms < Lower Is Better
Genoa Eypc 9334 . 64.88 |======================================================


NCNN 20230517
Target: Vulkan GPU - Model: shufflenet-v2
ms < Lower Is Better
Genoa Eypc 9334 . 76.79 |======================================================


NCNN 20230517
Target: Vulkan GPU - Model: mnasnet
ms < Lower Is Better
Genoa Eypc 9334 . 62.95 |======================================================


NCNN 20230517
Target: Vulkan GPU - Model: efficientnet-b0
ms < Lower Is Better
Genoa Eypc 9334 . 93.68 |======================================================


NCNN 20230517
Target: Vulkan GPU - Model: blazeface
ms < Lower Is Better
Genoa Eypc 9334 . 30.46 |======================================================


NCNN 20230517
Target: Vulkan GPU - Model: googlenet
ms < Lower Is Better
Genoa Eypc 9334 . 103.18 |=====================================================


NCNN 20230517
Target: Vulkan GPU - Model: vgg16
ms < Lower Is Better
Genoa Eypc 9334 . 132.81 |=====================================================


NCNN 20230517
Target: Vulkan GPU - Model: resnet18
ms < Lower Is Better
Genoa Eypc 9334 . 46.51 |======================================================


NCNN 20230517
Target: Vulkan GPU - Model: alexnet
ms < Lower Is Better
Genoa Eypc 9334 . 38.00 |======================================================


NCNN 20230517
Target: Vulkan GPU - Model: resnet50
ms < Lower Is Better
Genoa Eypc 9334 . 87.73 |======================================================


NCNN 20230517
Target: Vulkan GPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3
ms < Lower Is Better
Genoa Eypc 9334 . 83.03 |======================================================


NCNN 20230517
Target: Vulkan GPU - Model: yolov4-tiny
ms < Lower Is Better
Genoa Eypc 9334 . 111.97 |=====================================================


NCNN 20230517
Target: Vulkan GPU - Model: squeezenet_ssd
ms < Lower Is Better
Genoa Eypc 9334 . 122.44 |=====================================================


NCNN 20230517
Target: Vulkan GPU - Model: regnety_400m
ms < Lower Is Better
Genoa Eypc 9334 . 251.90 |=====================================================


NCNN 20230517
Target: Vulkan GPU - Model: vision_transformer
ms < Lower Is Better
Genoa Eypc 9334 . 212.72 |=====================================================


NCNN 20230517
Target: Vulkan GPU - Model: FastestDet
ms < Lower Is Better
Genoa Eypc 9334 . 84.94 |======================================================