sys76-kudu-ml-nvidia AMD Ryzen 9 5900HX testing with a System76 Kudu (1.07.09RSA1 BIOS) and NVIDIA GeForce RTX 3060 Laptop GPU 6GB on Pop 21.10 via the Phoronix Test Suite. NVIDIA GeForce RTX 3060 Laptop GPU: Processor: AMD Ryzen 9 5900HX @ 3.30GHz (8 Cores / 16 Threads), Motherboard: System76 Kudu (1.07.09RSA1 BIOS), Chipset: AMD Renoir/Cezanne, Memory: 16GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: NVIDIA GeForce RTX 3060 Laptop GPU 6GB, Audio: NVIDIA Device 228e, Network: Realtek RTL8125 2.5GbE + Intel Wi-Fi 6 AX200 OS: Pop 21.10, Kernel: 5.15.15-76051515-generic (x86_64), Desktop: GNOME Shell 40.5, Display Server: X Server 1.20.13, Display Driver: NVIDIA 470.86, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 11.4.158, Vulkan: 1.2.182, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080 Mlpack Benchmark Benchmark: scikit_linearridgeregression Seconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 2.09 |==================================== Mlpack Benchmark Benchmark: scikit_svm Seconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 17.59 |=================================== Mlpack Benchmark Benchmark: scikit_qda Seconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 66.04 |=================================== Mlpack Benchmark Benchmark: scikit_ica Seconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 48.31 |=================================== ECP-CANDLE 0.4 Benchmark: P3B2 Seconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 716.51 |================================== ECP-CANDLE 0.4 Benchmark: P3B1 Seconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 1473.43 |================================= ECP-CANDLE 0.4 Benchmark: P1B2 Seconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 35.18 |=================================== PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU FPS > Higher Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 7.00 |==================================== PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: CPU FPS > Higher Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 13.26 |=================================== TNN 0.3 Target: CPU - Model: SqueezeNet v1.1 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 222.65 |================================== TNN 0.3 Target: CPU - Model: SqueezeNet v2 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 54.86 |=================================== TNN 0.3 Target: CPU - Model: MobileNet v2 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 250.13 |================================== TNN 0.3 Target: CPU - Model: DenseNet ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 2721.41 |================================= NCNN 20210720 Target: Vulkan GPU - Model: regnety_400m ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 5.79 |==================================== NCNN 20210720 Target: Vulkan GPU - Model: yolov4-tiny ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 19.01 |=================================== NCNN 20210720 Target: Vulkan GPU - Model: resnet50 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 13.36 |=================================== NCNN 20210720 Target: Vulkan GPU - Model: alexnet ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 6.73 |==================================== NCNN 20210720 Target: Vulkan GPU - Model: resnet18 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 6.51 |==================================== NCNN 20210720 Target: Vulkan GPU - Model: vgg16 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 44.99 |=================================== NCNN 20210720 Target: Vulkan GPU - Model: googlenet ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 9.01 |==================================== NCNN 20210720 Target: Vulkan GPU - Model: blazeface ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 1.34 |==================================== NCNN 20210720 Target: Vulkan GPU - Model: efficientnet-b0 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 10.03 |=================================== NCNN 20210720 Target: Vulkan GPU - Model: mnasnet ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 3.96 |==================================== NCNN 20210720 Target: Vulkan GPU - Model: shufflenet-v2 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 2.88 |==================================== NCNN 20210720 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 4.66 |==================================== NCNN 20210720 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 4.02 |==================================== NCNN 20210720 Target: Vulkan GPU - Model: mobilenet ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 10.6 |==================================== NCNN 20210720 Target: CPU - Model: regnety_400m ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 6.85 |==================================== NCNN 20210720 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 18.56 |=================================== NCNN 20210720 Target: CPU - Model: yolov4-tiny ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 25.11 |=================================== NCNN 20210720 Target: CPU - Model: resnet50 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 25.27 |=================================== NCNN 20210720 Target: CPU - Model: alexnet ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 14.63 |=================================== NCNN 20210720 Target: CPU - Model: resnet18 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 15.92 |=================================== NCNN 20210720 Target: CPU - Model: vgg16 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 70.90 |=================================== NCNN 20210720 Target: CPU - Model: googlenet ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 13.44 |=================================== NCNN 20210720 Target: CPU - Model: blazeface ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 1.19 |==================================== NCNN 20210720 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 5.26 |==================================== NCNN 20210720 Target: CPU - Model: mnasnet ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 3.24 |==================================== NCNN 20210720 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 2.74 |==================================== NCNN 20210720 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 3.48 |==================================== NCNN 20210720 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 4.00 |==================================== NCNN 20210720 Target: CPU - Model: mobilenet ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 15.69 |=================================== Mobile Neural Network 1.2 Model: inception-v3 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 31.92 |=================================== Mobile Neural Network 1.2 Model: mobilenet-v1-1.0 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 2.411 |=================================== Mobile Neural Network 1.2 Model: MobileNetV2_224 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 2.385 |=================================== Mobile Neural Network 1.2 Model: SqueezeNetV1.0 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 4.490 |=================================== Mobile Neural Network 1.2 Model: resnet-v2-50 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 22.61 |=================================== Mobile Neural Network 1.2 Model: squeezenetv1.1 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 2.773 |=================================== Mobile Neural Network 1.2 Model: mobilenetV3 ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 1.199 |=================================== Caffe 2020-02-13 Model: GoogleNet - Acceleration: CPU - Iterations: 1000 Milli-Seconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 866136 |================================== Caffe 2020-02-13 Model: GoogleNet - Acceleration: CPU - Iterations: 200 Milli-Seconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 174373 |================================== Caffe 2020-02-13 Model: GoogleNet - Acceleration: CPU - Iterations: 100 Milli-Seconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 86800 |=================================== Caffe 2020-02-13 Model: AlexNet - Acceleration: CPU - Iterations: 1000 Milli-Seconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 325342 |================================== Caffe 2020-02-13 Model: AlexNet - Acceleration: CPU - Iterations: 200 Milli-Seconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 65872 |=================================== Caffe 2020-02-13 Model: AlexNet - Acceleration: CPU - Iterations: 100 Milli-Seconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 33278 |=================================== TensorFlow Lite 2020-08-23 Model: Inception ResNet V2 Microseconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 2486377 |================================= TensorFlow Lite 2020-08-23 Model: Mobilenet Quant Microseconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 141345 |================================== TensorFlow Lite 2020-08-23 Model: Mobilenet Float Microseconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 127871 |================================== TensorFlow Lite 2020-08-23 Model: NASNet Mobile Microseconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 151814 |================================== TensorFlow Lite 2020-08-23 Model: Inception V4 Microseconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 2758593 |================================= TensorFlow Lite 2020-08-23 Model: SqueezeNet Microseconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 190603 |================================== RNNoise 2020-06-28 Seconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 16.11 |=================================== R Benchmark Seconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 0.1261 |================================== DeepSpeech 0.6 Acceleration: CPU Seconds < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 68.95 |=================================== Numpy Benchmark Score > Higher Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 432.86 |================================== oneDNN 2.1.2 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 3.00110 |================================= oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 2164.42 |================================= oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 3558.73 |================================= oneDNN 2.1.2 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 4.60966 |================================= oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 2164.93 |================================= oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 3566.36 |================================= oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 2135.56 |================================= oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 3570.14 |================================= oneDNN 2.1.2 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 3.18077 |================================= oneDNN 2.1.2 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 2.12066 |================================= oneDNN 2.1.2 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 23.30 |=================================== oneDNN 2.1.2 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 6.71586 |================================= oneDNN 2.1.2 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 8.34154 |================================= oneDNN 2.1.2 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 22.53 |=================================== oneDNN 2.1.2 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 2.47936 |================================= oneDNN 2.1.2 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 1.63127 |================================= oneDNN 2.1.2 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 11.27 |=================================== oneDNN 2.1.2 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 4.30842 |================================= LeelaChessZero 0.28 Backend: BLAS Nodes Per Second > Higher Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 565 |===================================== SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Texture Read Bandwidth GB/s > Higher Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 1309.85 |================================= SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Bus Speed Readback GB/s > Higher Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 6.7648 |================================== SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Bus Speed Download GB/s > Higher Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 6.6926 |================================== SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Max SP Flops GFLOPS > Higher Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 15066.7 |================================= SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: GEMM SGEMM_N GFLOPS > Higher Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 2765.33 |================================= SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Reduction GB/s > Higher Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 295.57 |================================== SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: MD5 Hash GHash/s > Higher Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 16.27 |=================================== SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: FFT SP GFLOPS > Higher Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 877.31 |================================== SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Triad GB/s > Higher Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 6.5530 |================================== SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: S3D GFLOPS > Higher Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 166.28 |================================== OpenCV 4.5.4 Test: DNN - Deep Neural Network ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 28019 |=================================== AI Benchmark Alpha 0.1.2 Score > Higher Is Better ONNX Runtime 1.10 Model: super-resolution-10 - Device: CPU Inferences Per Minute > Higher Is Better ONNX Runtime 1.10 Model: shufflenet-v2-10 - Device: CPU Inferences Per Minute > Higher Is Better ONNX Runtime 1.10 Model: fcn-resnet101-11 - Device: CPU Inferences Per Minute > Higher Is Better ONNX Runtime 1.10 Model: yolov4 - Device: CPU Inferences Per Minute > Higher Is Better Numenta Anomaly Benchmark 1.1 Detector: Bayesian Changepoint Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: Earthgecko Skyline Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: Windowed Gaussian Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: Relative Entropy Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: EXPoSE Seconds < Lower Is Better OpenVINO 2021.1 Model: Age Gender Recognition Retail 0013 FP32 - Device: Intel GPU FPS > Higher Is Better OpenVINO 2021.1 Model: Age Gender Recognition Retail 0013 FP16 - Device: Intel GPU FPS > Higher Is Better OpenVINO 2021.1 Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU FPS > Higher Is Better OpenVINO 2021.1 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better OpenVINO 2021.1 Model: Person Detection 0106 FP32 - Device: Intel GPU FPS > Higher Is Better OpenVINO 2021.1 Model: Person Detection 0106 FP16 - Device: Intel GPU FPS > Higher Is Better OpenVINO 2021.1 Model: Face Detection 0106 FP32 - Device: Intel GPU FPS > Higher Is Better OpenVINO 2021.1 Model: Face Detection 0106 FP16 - Device: Intel GPU FPS > Higher Is Better OpenVINO 2021.1 Model: Person Detection 0106 FP32 - Device: CPU FPS > Higher Is Better OpenVINO 2021.1 Model: Person Detection 0106 FP16 - Device: CPU FPS > Higher Is Better OpenVINO 2021.1 Model: Face Detection 0106 FP32 - Device: CPU FPS > Higher Is Better OpenVINO 2021.1 Model: Face Detection 0106 FP16 - Device: CPU FPS > Higher Is Better NCNN 20210720 Target: Vulkan GPU - Model: squeezenet_ssd ms < Lower Is Better NVIDIA GeForce RTX 3060 Laptop GPU . 19.63 |=================================== Tensorflow Build: Cifar10 Seconds < Lower Is Better oneDNN 2.1.2 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better