installres1 AMD Ryzen 5 5600X 6-Core testing with a ASRock X570 Phantom Gaming-ITX/TB3 (P3.00 BIOS) and NVIDIA GeForce RTX 3090 24GB on Ubuntu 18.04 via the Phoronix Test Suite. NVIDIA GeForce RTX 3090: Processor: AMD Ryzen 5 5600X 6-Core @ 3.70GHz (6 Cores / 12 Threads), Motherboard: ASRock X570 Phantom Gaming-ITX/TB3 (P3.00 BIOS), Chipset: AMD Device 1480, Memory: 64GB, Disk: 2000GB Samsung SSD 970 EVO Plus 2TB + 4001GB Samsung SSD 870 + ProductCode, Graphics: NVIDIA GeForce RTX 3090 24GB, Audio: NVIDIA Device 1aef, Monitor: marantz-AVR, Network: Intel I211 + Intel Device 2723 OS: Ubuntu 18.04, Kernel: 5.4.0-70-generic (x86_64), Desktop: GNOME Shell 3.28.4, Display Server: X Server 1.20.8, Display Driver: NVIDIA 460.32.03, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 11.2.109, Vulkan: 1.2.155, Compiler: GCC 7.5.0 + CUDA 11.2, File-System: ext4, Screen Resolution: 1920x1080 PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: CPU FPS > Higher Is Better NVIDIA GeForce RTX 3090 . 10.99 |============================================== PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU FPS > Higher Is Better NVIDIA GeForce RTX 3090 . 9.40 |=============================================== SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Triad GB/s > Higher Is Better NVIDIA GeForce RTX 3090 . 12.84 |============================================== SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Reduction GB/s > Higher Is Better NVIDIA GeForce RTX 3090 . 383.06 |============================================= SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Bus Speed Download GB/s > Higher Is Better NVIDIA GeForce RTX 3090 . 13.07 |============================================== SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Bus Speed Readback GB/s > Higher Is Better NVIDIA GeForce RTX 3090 . 13.18 |============================================== SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Texture Read Bandwidth GB/s > Higher Is Better NVIDIA GeForce RTX 3090 . 2156.05 |============================================ SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: S3D GFLOPS > Higher Is Better NVIDIA GeForce RTX 3090 . 428.14 |============================================= SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: FFT SP GFLOPS > Higher Is Better NVIDIA GeForce RTX 3090 . 2346.70 |============================================ SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: GEMM SGEMM_N GFLOPS > Higher Is Better NVIDIA GeForce RTX 3090 . 8373.79 |============================================ SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Max SP Flops GFLOPS > Higher Is Better NVIDIA GeForce RTX 3090 . 39360.4 |============================================ SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: MD5 Hash GHash/s > Higher Is Better NVIDIA GeForce RTX 3090 . 42.91 |============================================== Numpy Benchmark Score > Higher Is Better NVIDIA GeForce RTX 3090 . 466.33 |============================================= AI Benchmark Alpha 0.1.2 Device Inference Score Score > Higher Is Better NVIDIA GeForce RTX 3090 . 1111 |=============================================== AI Benchmark Alpha 0.1.2 Device Training Score Score > Higher Is Better NVIDIA GeForce RTX 3090 . 1163 |=============================================== AI Benchmark Alpha 0.1.2 Device AI Score Score > Higher Is Better NVIDIA GeForce RTX 3090 . 2274 |=============================================== TensorFlow Lite 2020-08-23 Model: SqueezeNet Microseconds < Lower Is Better NVIDIA GeForce RTX 3090 . 234227 |============================================= TensorFlow Lite 2020-08-23 Model: Inception V4 Microseconds < Lower Is Better NVIDIA GeForce RTX 3090 . 3457463 |============================================ TensorFlow Lite 2020-08-23 Model: NASNet Mobile Microseconds < Lower Is Better NVIDIA GeForce RTX 3090 . 192684 |============================================= TensorFlow Lite 2020-08-23 Model: Mobilenet Float Microseconds < Lower Is Better NVIDIA GeForce RTX 3090 . 159375 |============================================= TensorFlow Lite 2020-08-23 Model: Mobilenet Quant Microseconds < Lower Is Better NVIDIA GeForce RTX 3090 . 174205 |============================================= TensorFlow Lite 2020-08-23 Model: Inception ResNet V2 Microseconds < Lower Is Better NVIDIA GeForce RTX 3090 . 3121703 |============================================ oneDNN 2.1.2 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 4.64288 |============================================ oneDNN 2.1.2 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 7.09188 |============================================ oneDNN 2.1.2 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 1.99499 |============================================ oneDNN 2.1.2 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 1.47217 |============================================ oneDNN 2.1.2 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 13.54 |============================================== oneDNN 2.1.2 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 10.54 |============================================== oneDNN 2.1.2 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 8.33697 |============================================ oneDNN 2.1.2 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 12.81 |============================================== oneDNN 2.1.2 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 2.61408 |============================================ oneDNN 2.1.2 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 4.37194 |============================================ oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 4007.49 |============================================ oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 2107.13 |============================================ oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 3999.33 |============================================ oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 2135.24 |============================================ oneDNN 2.1.2 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 2.25636 |============================================ oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 4001.99 |============================================ oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 2109.64 |============================================ oneDNN 2.1.2 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3090 . 3.53795 |============================================ Mobile Neural Network 1.1.3 Model: SqueezeNetV1.0 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 4.143 |============================================== Mobile Neural Network 1.1.3 Model: resnet-v2-50 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 23.68 |============================================== Mobile Neural Network 1.1.3 Model: MobileNetV2_224 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 2.099 |============================================== Mobile Neural Network 1.1.3 Model: mobilenet-v1-1.0 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 2.734 |============================================== Mobile Neural Network 1.1.3 Model: inception-v3 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 28.19 |============================================== NCNN 20201218 Target: CPU - Model: mobilenet ms < Lower Is Better NVIDIA GeForce RTX 3090 . 14.22 |============================================== NCNN 20201218 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 3.68 |=============================================== NCNN 20201218 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 3.11 |=============================================== NCNN 20201218 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 4.40 |=============================================== NCNN 20201218 Target: CPU - Model: mnasnet ms < Lower Is Better NVIDIA GeForce RTX 3090 . 3.51 |=============================================== NCNN 20201218 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 5.37 |=============================================== NCNN 20201218 Target: CPU - Model: blazeface ms < Lower Is Better NVIDIA GeForce RTX 3090 . 1.40 |=============================================== NCNN 20201218 Target: CPU - Model: googlenet ms < Lower Is Better NVIDIA GeForce RTX 3090 . 13.13 |============================================== NCNN 20201218 Target: CPU - Model: vgg16 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 55.98 |============================================== NCNN 20201218 Target: CPU - Model: resnet18 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 15.15 |============================================== NCNN 20201218 Target: CPU - Model: alexnet ms < Lower Is Better NVIDIA GeForce RTX 3090 . 13.48 |============================================== NCNN 20201218 Target: CPU - Model: resnet50 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 27.47 |============================================== NCNN 20201218 Target: CPU - Model: yolov4-tiny ms < Lower Is Better NVIDIA GeForce RTX 3090 . 22.15 |============================================== NCNN 20201218 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better NVIDIA GeForce RTX 3090 . 16.70 |============================================== NCNN 20201218 Target: CPU - Model: regnety_400m ms < Lower Is Better NVIDIA GeForce RTX 3090 . 9.73 |=============================================== NCNN 20201218 Target: Vulkan GPU - Model: mobilenet ms < Lower Is Better NVIDIA GeForce RTX 3090 . 14.18 |============================================== NCNN 20201218 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 3.68 |=============================================== NCNN 20201218 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 3.18 |=============================================== NCNN 20201218 Target: Vulkan GPU - Model: shufflenet-v2 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 4.31 |=============================================== NCNN 20201218 Target: Vulkan GPU - Model: mnasnet ms < Lower Is Better NVIDIA GeForce RTX 3090 . 3.43 |=============================================== NCNN 20201218 Target: Vulkan GPU - Model: efficientnet-b0 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 5.09 |=============================================== NCNN 20201218 Target: Vulkan GPU - Model: blazeface ms < Lower Is Better NVIDIA GeForce RTX 3090 . 1.40 |=============================================== NCNN 20201218 Target: Vulkan GPU - Model: googlenet ms < Lower Is Better NVIDIA GeForce RTX 3090 . 12.97 |============================================== NCNN 20201218 Target: Vulkan GPU - Model: vgg16 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 55.85 |============================================== NCNN 20201218 Target: Vulkan GPU - Model: resnet18 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 15.11 |============================================== NCNN 20201218 Target: Vulkan GPU - Model: alexnet ms < Lower Is Better NVIDIA GeForce RTX 3090 . 13.42 |============================================== NCNN 20201218 Target: Vulkan GPU - Model: resnet50 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 27.56 |============================================== NCNN 20201218 Target: Vulkan GPU - Model: yolov4-tiny ms < Lower Is Better NVIDIA GeForce RTX 3090 . 22.63 |============================================== NCNN 20201218 Target: Vulkan GPU - Model: squeezenet_ssd ms < Lower Is Better NVIDIA GeForce RTX 3090 . 16.93 |============================================== NCNN 20201218 Target: Vulkan GPU - Model: regnety_400m ms < Lower Is Better NVIDIA GeForce RTX 3090 . 9.62 |=============================================== TNN 0.2.3 Target: CPU - Model: MobileNet v2 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 213.48 |============================================= TNN 0.2.3 Target: CPU - Model: SqueezeNet v1.1 ms < Lower Is Better NVIDIA GeForce RTX 3090 . 214.41 |============================================= DeepSpeech 0.6 Acceleration: CPU Seconds < Lower Is Better NVIDIA GeForce RTX 3090 . 63.93 |============================================== RNNoise 2020-06-28 Seconds < Lower Is Better NVIDIA GeForce RTX 3090 . 15.97 |============================================== ECP-CANDLE 0.3 Benchmark: P1B2 Seconds < Lower Is Better NVIDIA GeForce RTX 3090 . 31.60 |============================================== ECP-CANDLE 0.3 Benchmark: P3B1 Seconds < Lower Is Better NVIDIA GeForce RTX 3090 . 896.15 |============================================= ECP-CANDLE 0.3 Benchmark: P3B2 Seconds < Lower Is Better NVIDIA GeForce RTX 3090 . 453.13 |============================================= Numenta Anomaly Benchmark 1.1 Detector: EXPoSE Seconds < Lower Is Better NVIDIA GeForce RTX 3090 . 319.33 |============================================= Numenta Anomaly Benchmark 1.1 Detector: Relative Entropy Seconds < Lower Is Better NVIDIA GeForce RTX 3090 . 19.08 |============================================== Numenta Anomaly Benchmark 1.1 Detector: Windowed Gaussian Seconds < Lower Is Better NVIDIA GeForce RTX 3090 . 13.08 |============================================== Numenta Anomaly Benchmark 1.1 Detector: Earthgecko Skyline Seconds < Lower Is Better NVIDIA GeForce RTX 3090 . 141.34 |============================================= Numenta Anomaly Benchmark 1.1 Detector: Bayesian Changepoint Seconds < Lower Is Better NVIDIA GeForce RTX 3090 . 43.28 |============================================== Mlpack Benchmark Benchmark: scikit_ica Seconds < Lower Is Better NVIDIA GeForce RTX 3090 . 33.52 |============================================== Mlpack Benchmark Benchmark: scikit_qda Seconds < Lower Is Better NVIDIA GeForce RTX 3090 . 120.45 |============================================= Mlpack Benchmark Benchmark: scikit_svm Seconds < Lower Is Better NVIDIA GeForce RTX 3090 . 17.81 |============================================== Mlpack Benchmark Benchmark: scikit_linearridgeregression Seconds < Lower Is Better NVIDIA GeForce RTX 3090 . 2.43 |=============================================== Scikit-Learn 0.22.1 Seconds < Lower Is Better NVIDIA GeForce RTX 3090 . 8.735 |==============================================