NVIDIA TITAN RTX On Linux AMD Ryzen 9 3950X 16-Core testing with a ASUS ROG CROSSHAIR VIII HERO (WI-FI) (1302 BIOS) and NVIDIA TITAN RTX 24GB on Ubuntu 20.04 via the Phoronix Test Suite. 1: Processor: AMD Ryzen 9 3950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (WI-FI) (1302 BIOS), Chipset: AMD Starship/Matisse, Memory: 16GB, Disk: 2000GB Corsair Force MP600 + 2000GB, Graphics: NVIDIA TITAN RTX 24GB (390/405MHz), Audio: NVIDIA TU102 HD Audio, Monitor: DELL P2415Q, Network: Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 20.04, Kernel: 5.4.0-48-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: NVIDIA 450.66, OpenGL: 4.6.0, OpenCL: OpenCL 2.0 AMD-APP (3182.0) + OpenCL 1.2 CUDA 11.0.228, Vulkan: 1.2.133, Compiler: GCC 9.3.0 + CUDA 11.0, File-System: ext4, Screen Resolution: 3840x2160 2: Processor: AMD Ryzen 9 3950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (WI-FI) (1302 BIOS), Chipset: AMD Starship/Matisse, Memory: 16GB, Disk: 2000GB Corsair Force MP600 + 2000GB, Graphics: NVIDIA TITAN RTX 24GB (1350/7000MHz), Audio: NVIDIA TU102 HD Audio, Monitor: DELL P2415Q, Network: Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 20.04, Kernel: 5.4.0-48-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: NVIDIA 450.66, OpenGL: 4.6.0, OpenCL: OpenCL 2.0 AMD-APP (3182.0) + OpenCL 1.2 CUDA 11.0.228, Vulkan: 1.2.133, Compiler: GCC 9.3.0 + CUDA 11.0, File-System: ext4, Screen Resolution: 3840x2160 3: Processor: AMD Ryzen 9 3950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (WI-FI) (1302 BIOS), Chipset: AMD Starship/Matisse, Memory: 16GB, Disk: 2000GB Corsair Force MP600 + 2000GB, Graphics: NVIDIA TITAN RTX 24GB (390/405MHz), Audio: NVIDIA TU102 HD Audio, Monitor: DELL P2415Q, Network: Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 20.04, Kernel: 5.4.0-48-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: NVIDIA 450.66, OpenGL: 4.6.0, OpenCL: OpenCL 2.0 AMD-APP (3182.0) + OpenCL 1.2 CUDA 11.0.228, Vulkan: 1.2.133, Compiler: GCC 9.3.0 + CUDA 11.0, File-System: ext4, Screen Resolution: 3840x2160 4: Processor: AMD Ryzen 9 3950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (WI-FI) (1302 BIOS), Chipset: AMD Starship/Matisse, Memory: 16GB, Disk: 2000GB Corsair Force MP600 + 2000GB, Graphics: NVIDIA TITAN RTX 24GB (1350/7000MHz), Audio: NVIDIA TU102 HD Audio, Monitor: DELL P2415Q, Network: Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 20.04, Kernel: 5.4.0-48-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: NVIDIA 450.66, OpenGL: 4.6.0, OpenCL: OpenCL 2.0 AMD-APP (3182.0) + OpenCL 1.2 CUDA 11.0.228, Vulkan: 1.2.133, Compiler: GCC 9.3.0 + CUDA 11.0, File-System: ext4, Screen Resolution: 3840x2160 5: Processor: AMD Ryzen 9 3950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (WI-FI) (1302 BIOS), Chipset: AMD Starship/Matisse, Memory: 16GB, Disk: 2000GB Corsair Force MP600 + 2000GB, Graphics: NVIDIA TITAN RTX 24GB (390/405MHz), Audio: NVIDIA TU102 HD Audio, Monitor: DELL P2415Q, Network: Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 20.04, Kernel: 5.4.0-48-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: NVIDIA 450.66, OpenGL: 4.6.0, OpenCL: OpenCL 2.0 AMD-APP (3182.0) + OpenCL 1.2 CUDA 11.0.228, Vulkan: 1.2.133, Compiler: GCC 9.3.0 + CUDA 11.0, File-System: ext4, Screen Resolution: 3840x2160 RealSR-NCNN 20200818 Scale: 4x - TAA: No Seconds < Lower Is Better 1 . 7.831 |=================================================================== 2 . 7.976 |==================================================================== 3 . 7.858 |=================================================================== 4 . 7.849 |=================================================================== 5 . 7.825 |=================================================================== RealSR-NCNN 20200818 Scale: 4x - TAA: Yes Seconds < Lower Is Better 1 . 42.88 |==================================================================== 2 . 43.09 |==================================================================== 3 . 42.66 |=================================================================== 4 . 42.82 |==================================================================== 5 . 42.61 |=================================================================== VkFFT 2020-09-29 Benchmark Score > Higher Is Better 1 . 40138 |==================================================================== 2 . 40047 |==================================================================== 3 . 40019 |==================================================================== 4 . 40048 |==================================================================== 5 . 40061 |==================================================================== Hashcat 6.1.1 Benchmark: MD5 H/s > Higher Is Better 1 . 57420166667 |============================================================== 2 . 57241333333 |============================================================== 3 . 57365533333 |============================================================== 4 . 57329633333 |============================================================== 5 . 57416166667 |============================================================== Hashcat 6.1.1 Benchmark: SHA1 H/s > Higher Is Better 1 . 18307600000 |============================================================== 2 . 18259766667 |============================================================== 3 . 18322300000 |============================================================== 4 . 18285433333 |============================================================== 5 . 18324466667 |============================================================== Hashcat 6.1.1 Benchmark: 7-Zip H/s > Higher Is Better 1 . 916533 |=================================================================== 2 . 917200 |=================================================================== 3 . 917000 |=================================================================== 4 . 915167 |=================================================================== 5 . 919933 |=================================================================== Hashcat 6.1.1 Benchmark: SHA-512 H/s > Higher Is Better 1 . 2541833333 |=============================================================== 2 . 2534366667 |=============================================================== 3 . 2541733333 |=============================================================== 4 . 2540333333 |=============================================================== 5 . 2541766667 |=============================================================== Hashcat 6.1.1 Benchmark: TrueCrypt RIPEMD160 + XTS H/s > Higher Is Better 1 . 672533 |=================================================================== 2 . 670800 |=================================================================== 3 . 672600 |=================================================================== 4 . 671700 |=================================================================== 5 . 672200 |=================================================================== RedShift Demo 3.0 Seconds < Lower Is Better 1 . 235 |====================================================================== 2 . 235 |====================================================================== 3 . 235 |====================================================================== 4 . 235 |====================================================================== 5 . 235 |====================================================================== Caffe 2020-02-13 Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 100 Milli-Seconds < Lower Is Better 1 . 922.12 |================================================================== 2 . 924.70 |=================================================================== 3 . 923.24 |================================================================== 4 . 923.67 |================================================================== 5 . 931.02 |=================================================================== Caffe 2020-02-13 Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 200 Milli-Seconds < Lower Is Better 1 . 1805.53 |================================================================== 2 . 1806.40 |================================================================== 3 . 1810.29 |================================================================== 4 . 1812.07 |================================================================== 5 . 1811.35 |================================================================== Caffe 2020-02-13 Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 1000 Milli-Seconds < Lower Is Better 1 . 8921.31 |================================================================== 2 . 8920.17 |================================================================== 3 . 8900.18 |================================================================= 4 . 8934.21 |================================================================== 5 . 8986.35 |================================================================== Caffe 2020-02-13 Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 100 Milli-Seconds < Lower Is Better 1 . 2855.00 |================================================================= 2 . 2875.90 |================================================================== 3 . 2860.43 |================================================================== 4 . 2861.31 |================================================================== 5 . 2878.31 |================================================================== Caffe 2020-02-13 Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 200 Milli-Seconds < Lower Is Better 1 . 5680.16 |================================================================== 2 . 5678.60 |================================================================== 3 . 5693.34 |================================================================== 4 . 5657.51 |================================================================== 5 . 5693.66 |================================================================== Caffe 2020-02-13 Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 1000 Milli-Seconds < Lower Is Better 1 . 28171.0 |================================================================== 2 . 28230.8 |================================================================== 3 . 28178.6 |================================================================== 4 . 28240.1 |================================================================== 5 . 28365.7 |================================================================== NCNN 20200916 Target: Vulkan GPU - Model: squeezenet ms < Lower Is Better 1 . 3.86 |==================================================================== 2 . 3.86 |==================================================================== 3 . 3.90 |===================================================================== 4 . 3.90 |===================================================================== 5 . 3.88 |===================================================================== NCNN 20200916 Target: Vulkan GPU - Model: mobilenet ms < Lower Is Better 1 . 4.14 |===================================================================== 2 . 4.13 |===================================================================== 3 . 4.14 |===================================================================== 4 . 4.13 |===================================================================== 5 . 4.16 |===================================================================== NCNN 20200916 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better 1 . 1.38 |==================================================================== 2 . 1.39 |===================================================================== 3 . 1.38 |==================================================================== 4 . 1.38 |==================================================================== 5 . 1.40 |===================================================================== NCNN 20200916 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better 1 . 1.64 |===================================================================== 2 . 1.64 |===================================================================== 3 . 1.64 |===================================================================== 4 . 1.64 |===================================================================== 5 . 1.64 |===================================================================== NCNN 20200916 Target: Vulkan GPU - Model: shufflenet-v2 ms < Lower Is Better 1 . 1.28 |==================================================================== 2 . 1.29 |===================================================================== 3 . 1.28 |==================================================================== 4 . 1.28 |==================================================================== 5 . 1.28 |==================================================================== NCNN 20200916 Target: Vulkan GPU - Model: mnasnet ms < Lower Is Better 1 . 1.44 |===================================================================== 2 . 1.45 |===================================================================== 3 . 1.45 |===================================================================== 4 . 1.45 |===================================================================== 5 . 1.45 |===================================================================== NCNN 20200916 Target: Vulkan GPU - Model: efficientnet-b0 ms < Lower Is Better 1 . 2.60 |===================================================================== 2 . 2.59 |==================================================================== 3 . 2.60 |===================================================================== 4 . 2.60 |===================================================================== 5 . 2.61 |===================================================================== NCNN 20200916 Target: Vulkan GPU - Model: blazeface ms < Lower Is Better 1 . 0.58 |==================================================================== 2 . 0.57 |=================================================================== 3 . 0.58 |==================================================================== 4 . 0.59 |===================================================================== 5 . 0.58 |==================================================================== NCNN 20200916 Target: Vulkan GPU - Model: googlenet ms < Lower Is Better 1 . 3.02 |===================================================================== 2 . 2.97 |==================================================================== 3 . 2.98 |==================================================================== 4 . 2.97 |==================================================================== 5 . 2.97 |==================================================================== NCNN 20200916 Target: Vulkan GPU - Model: vgg16 ms < Lower Is Better 1 . 5.08 |===================================================================== 2 . 5.09 |===================================================================== 3 . 5.08 |===================================================================== 4 . 5.09 |===================================================================== 5 . 5.07 |===================================================================== NCNN 20200916 Target: Vulkan GPU - Model: resnet18 ms < Lower Is Better 1 . 1.32 |===================================================================== 2 . 1.32 |===================================================================== 3 . 1.32 |===================================================================== 4 . 1.31 |==================================================================== 5 . 1.31 |==================================================================== NCNN 20200916 Target: Vulkan GPU - Model: alexnet ms < Lower Is Better 1 . 1.63 |===================================================================== 2 . 1.57 |================================================================== 3 . 1.62 |===================================================================== 4 . 1.58 |=================================================================== 5 . 1.60 |==================================================================== NCNN 20200916 Target: Vulkan GPU - Model: resnet50 ms < Lower Is Better 1 . 3.06 |===================================================================== 2 . 3.05 |===================================================================== 3 . 3.05 |===================================================================== 4 . 3.06 |===================================================================== 5 . 3.06 |===================================================================== NCNN 20200916 Target: Vulkan GPU - Model: yolov4-tiny ms < Lower Is Better 1 . 7.34 |===================================================================== 2 . 7.17 |=================================================================== 3 . 7.15 |=================================================================== 4 . 7.17 |=================================================================== 5 . 7.15 |===================================================================