Test 2 x Intel Xeon E5-2682 v4 testing with a Supermicro SYS-7048GR-TR X10DRG-Q v1.10 (3.2 BIOS) and MSI NVIDIA GeForce RTX 3090 24GB on Ubuntu 22.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2404173-NE-TEST4784533&grt .
Test Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Display Server Display Driver Compiler File-System Screen Resolution OpenCL Vulkan test Test MSI NVIDIA GeForce RTX 3090 2 x Intel Xeon E5-2682 v4 @ 3.00GHz (32 Cores / 64 Threads) Supermicro X10DRG-Q v1.10 (3.2 BIOS) Intel Xeon E7 v4/Xeon 32GB 1000GB Samsung SSD 870 + 4001GB Western Digital WD40EFPX-68C MSI NVIDIA GeForce RTX 3090 24GB Realtek ALC888-VD 2 x Intel I350 Ubuntu 22.04 5.15.0-102-generic (x86_64) X Server 1.21.1.3 NVIDIA GCC 11.4.0 + Clang 14.0.0-1ubuntu1.1 + LLVM 14.0.0 + CUDA 12.4 ext4 1024x768 Supermicro SYS-7048GR-TR X10DRG-Q v1.10 (3.2 BIOS) 2 x 16GB DDR4-2400MT/s OpenCL 3.0 CUDA 12.4.89 1.3.277 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Environment Details - NVM_CD_FLAGS=-q Processor Details - test: Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0xb000040 - Test: Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0xb000040 - MSI NVIDIA GeForce RTX 3090: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0xb000040 Python Details - test: Python 3.10.14 - MSI NVIDIA GeForce RTX 3090: Python 3.10.12 Security Details - gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT vulnerable Compiler Details - Test, MSI NVIDIA GeForce RTX 3090: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Graphics Details - MSI NVIDIA GeForce RTX 3090: BAR1 / Visible vRAM Size: 256 MiB - vBIOS Version: 94.02.59.00.8a
Test blender: BMW27 - NVIDIA OptiX blender: Junkshop - NVIDIA OptiX blender: Classroom - NVIDIA OptiX blender: Fishy Cat - NVIDIA OptiX blender: Barbershop - NVIDIA OptiX blender: Pabellon Barcelona - NVIDIA OptiX cl-mem: Copy cl-mem: Read cl-mem: Write clpeak: Integer Compute INT clpeak: Single-Precision Float clpeak: Double-Precision Double clpeak: Global Memory Bandwidth fahbench: financebench: Black-Scholes OpenCL hashcat: MD5 hashcat: SHA1 hashcat: 7-Zip hashcat: SHA-512 hashcat: TrueCrypt RIPEMD160 + XTS luxcorerender: DLSC - GPU luxcorerender: Danish Mood - GPU luxcorerender: Orange Juice - GPU luxcorerender: LuxCore Benchmark - GPU luxcorerender: Rainbow Colors and Prism - GPU mixbench: OpenCL - Integer mixbench: NVIDIA CUDA - Integer mixbench: OpenCL - Double Precision mixbench: OpenCL - Single Precision mixbench: NVIDIA CUDA - Half Precision mixbench: NVIDIA CUDA - Double Precision mixbench: NVIDIA CUDA - Single Precision ncnn: Vulkan GPU - mobilenet ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU - shufflenet-v2 ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - googlenet ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - alexnet ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPUv2-yolov3v2-yolov3 - mobilenetv2-yolov3 ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - squeezenet_ssd ncnn: Vulkan GPU - regnety_400m ncnn: Vulkan GPU - vision_transformer ncnn: Vulkan GPU - FastestDet neatbench: GPU rodinia: OpenCL Particle Filter viennacl: CPU BLAS - sCOPY viennacl: CPU BLAS - sAXPY viennacl: CPU BLAS - sDOT viennacl: CPU BLAS - dCOPY viennacl: CPU BLAS - dAXPY viennacl: CPU BLAS - dDOT viennacl: CPU BLAS - dGEMV-N viennacl: CPU BLAS - dGEMV-T viennacl: CPU BLAS - dGEMM-NN viennacl: CPU BLAS - dGEMM-NT viennacl: CPU BLAS - dGEMM-TN viennacl: CPU BLAS - dGEMM-TT viennacl: OpenCL BLAS - sCOPY viennacl: OpenCL BLAS - sAXPY viennacl: OpenCL BLAS - sDOT viennacl: OpenCL BLAS - dCOPY viennacl: OpenCL BLAS - dAXPY viennacl: OpenCL BLAS - dDOT viennacl: OpenCL BLAS - dGEMV-N viennacl: OpenCL BLAS - dGEMV-T viennacl: OpenCL BLAS - dGEMM-NN viennacl: OpenCL BLAS - dGEMM-NT viennacl: OpenCL BLAS - dGEMM-TN viennacl: OpenCL BLAS - dGEMM-TT test Test MSI NVIDIA GeForce RTX 3090 4.89 14.33 9.71 8.45 37.99 11.11 359.5 827.5 753.6 17619.75 34559.24 636.06 816.71 291.2435 6.060 102516368750 43537200000 2122900 6285933333 1629667 28.18 17.48 21.68 16.71 52.13 19101.89 15908.05 526.43 37433.27 33947.25 497.73 31838.27 52.65 22.24 16.97 18.41 16.64 26.40 11.31 49.15 103.35 33.80 31.16 71.49 52.65 64.14 49.93 90.84 134.18 28.33 3090 4.031 69.3 97.5 110.9 16.8 23.6 25.3 29.6 37.1 57.5 52.8 60.0 58.7 359 490 359 596 713 641 186 371 590 593 591 590 OpenBenchmarking.org
Blender Blend File: BMW27 - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: BMW27 - Compute: NVIDIA OptiX MSI NVIDIA GeForce RTX 3090 1.1003 2.2006 3.3009 4.4012 5.5015 SE +/- 0.17, N = 15 4.89
Blender Blend File: Junkshop - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Junkshop - Compute: NVIDIA OptiX MSI NVIDIA GeForce RTX 3090 4 8 12 16 20 SE +/- 0.16, N = 15 14.33
Blender Blend File: Classroom - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Classroom - Compute: NVIDIA OptiX MSI NVIDIA GeForce RTX 3090 3 6 9 12 15 SE +/- 0.09, N = 3 9.71
Blender Blend File: Fishy Cat - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Fishy Cat - Compute: NVIDIA OptiX MSI NVIDIA GeForce RTX 3090 2 4 6 8 10 SE +/- 0.04, N = 3 8.45
Blender Blend File: Barbershop - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Barbershop - Compute: NVIDIA OptiX MSI NVIDIA GeForce RTX 3090 9 18 27 36 45 SE +/- 0.12, N = 3 37.99
Blender Blend File: Pabellon Barcelona - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Pabellon Barcelona - Compute: NVIDIA OptiX MSI NVIDIA GeForce RTX 3090 3 6 9 12 15 SE +/- 0.03, N = 3 11.11
cl-mem Benchmark: Copy OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Copy MSI NVIDIA GeForce RTX 3090 80 160 240 320 400 SE +/- 0.23, N = 3 359.5 1. (CC) gcc options: -O2 -flto -lOpenCL
cl-mem Benchmark: Read OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Read MSI NVIDIA GeForce RTX 3090 200 400 600 800 1000 SE +/- 0.18, N = 3 827.5 1. (CC) gcc options: -O2 -flto -lOpenCL
cl-mem Benchmark: Write OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Write MSI NVIDIA GeForce RTX 3090 160 320 480 640 800 SE +/- 0.21, N = 3 753.6 1. (CC) gcc options: -O2 -flto -lOpenCL
clpeak OpenCL Test: Integer Compute INT OpenBenchmarking.org GIOPS, More Is Better clpeak 1.1.2 OpenCL Test: Integer Compute INT MSI NVIDIA GeForce RTX 3090 4K 8K 12K 16K 20K SE +/- 10.68, N = 3 17619.75 1. (CXX) g++ options: -O3
clpeak OpenCL Test: Single-Precision Float OpenBenchmarking.org GFLOPS, More Is Better clpeak 1.1.2 OpenCL Test: Single-Precision Float MSI NVIDIA GeForce RTX 3090 7K 14K 21K 28K 35K SE +/- 85.81, N = 3 34559.24 1. (CXX) g++ options: -O3
clpeak OpenCL Test: Double-Precision Double OpenBenchmarking.org GFLOPS, More Is Better clpeak 1.1.2 OpenCL Test: Double-Precision Double MSI NVIDIA GeForce RTX 3090 140 280 420 560 700 SE +/- 1.57, N = 3 636.06 1. (CXX) g++ options: -O3
clpeak OpenCL Test: Global Memory Bandwidth OpenBenchmarking.org GBPS, More Is Better clpeak 1.1.2 OpenCL Test: Global Memory Bandwidth MSI NVIDIA GeForce RTX 3090 200 400 600 800 1000 SE +/- 0.04, N = 3 816.71 1. (CXX) g++ options: -O3
FAHBench OpenBenchmarking.org Ns Per Day, More Is Better FAHBench 2.3.2 MSI NVIDIA GeForce RTX 3090 60 120 180 240 300 SE +/- 2.67, N = 3 291.24
FinanceBench Benchmark: Black-Scholes OpenCL OpenBenchmarking.org ms, Fewer Is Better FinanceBench 2016-07-25 Benchmark: Black-Scholes OpenCL MSI NVIDIA GeForce RTX 3090 2 4 6 8 10 SE +/- 0.010, N = 3 6.060 1. (CXX) g++ options: -O3 -march=native -fopenmp
Hashcat Benchmark: MD5 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: MD5 MSI NVIDIA GeForce RTX 3090 20000M 40000M 60000M 80000M 100000M SE +/- 8904234078.96, N = 16 102516368750
Hashcat Benchmark: SHA1 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA1 MSI NVIDIA GeForce RTX 3090 9000M 18000M 27000M 36000M 45000M SE +/- 42689733.35, N = 3 43537200000
Hashcat Benchmark: 7-Zip OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: 7-Zip MSI NVIDIA GeForce RTX 3090 500K 1000K 1500K 2000K 2500K SE +/- 2059.94, N = 3 2122900
Hashcat Benchmark: SHA-512 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA-512 MSI NVIDIA GeForce RTX 3090 1300M 2600M 3900M 5200M 6500M SE +/- 12339818.11, N = 3 6285933333
Hashcat Benchmark: TrueCrypt RIPEMD160 + XTS OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: TrueCrypt RIPEMD160 + XTS MSI NVIDIA GeForce RTX 3090 300K 600K 900K 1200K 1500K SE +/- 1560.27, N = 3 1629667
LuxCoreRender Scene: DLSC - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: DLSC - Acceleration: GPU MSI NVIDIA GeForce RTX 3090 7 14 21 28 35 SE +/- 0.04, N = 3 28.18 MIN: 24.15 / MAX: 28.79
LuxCoreRender Scene: Danish Mood - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Danish Mood - Acceleration: GPU MSI NVIDIA GeForce RTX 3090 4 8 12 16 20 SE +/- 0.14, N = 3 17.48 MIN: 2.15 / MAX: 22.45
LuxCoreRender Scene: Orange Juice - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Orange Juice - Acceleration: GPU MSI NVIDIA GeForce RTX 3090 5 10 15 20 25 SE +/- 0.13, N = 3 21.68 MIN: 10.33 / MAX: 29.71
LuxCoreRender Scene: LuxCore Benchmark - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: LuxCore Benchmark - Acceleration: GPU MSI NVIDIA GeForce RTX 3090 4 8 12 16 20 SE +/- 1.52, N = 12 16.71 MAX: 25.13
LuxCoreRender Scene: Rainbow Colors and Prism - Acceleration: GPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Rainbow Colors and Prism - Acceleration: GPU MSI NVIDIA GeForce RTX 3090 12 24 36 48 60 SE +/- 0.75, N = 15 52.13 MIN: 45.12 / MAX: 71.41
Mixbench Backend: OpenCL - Benchmark: Integer OpenBenchmarking.org GIOPS, More Is Better Mixbench 2020-06-23 Backend: OpenCL - Benchmark: Integer MSI NVIDIA GeForce RTX 3090 4K 8K 12K 16K 20K SE +/- 306.56, N = 15 19101.89 1. (CXX) g++ options: -lm -lstdc++ -lOpenCL -lrt -O2
Mixbench Backend: NVIDIA CUDA - Benchmark: Integer OpenBenchmarking.org GIOPS, More Is Better Mixbench 2020-06-23 Backend: NVIDIA CUDA - Benchmark: Integer MSI NVIDIA GeForce RTX 3090 3K 6K 9K 12K 15K SE +/- 297.96, N = 15 15908.05 1. (CXX) g++ options: -lm -lstdc++ -lOpenCL -lrt -O2
Mixbench Backend: OpenCL - Benchmark: Double Precision OpenBenchmarking.org GFLOPS, More Is Better Mixbench 2020-06-23 Backend: OpenCL - Benchmark: Double Precision MSI NVIDIA GeForce RTX 3090 110 220 330 440 550 SE +/- 5.98, N = 15 526.43 1. (CXX) g++ options: -lm -lstdc++ -lOpenCL -lrt -O2
Mixbench Backend: OpenCL - Benchmark: Single Precision OpenBenchmarking.org GFLOPS, More Is Better Mixbench 2020-06-23 Backend: OpenCL - Benchmark: Single Precision MSI NVIDIA GeForce RTX 3090 8K 16K 24K 32K 40K SE +/- 393.91, N = 15 37433.27 1. (CXX) g++ options: -lm -lstdc++ -lOpenCL -lrt -O2
Mixbench Backend: NVIDIA CUDA - Benchmark: Half Precision OpenBenchmarking.org GFLOPS, More Is Better Mixbench 2020-06-23 Backend: NVIDIA CUDA - Benchmark: Half Precision MSI NVIDIA GeForce RTX 3090 7K 14K 21K 28K 35K SE +/- 584.04, N = 15 33947.25 1. (CXX) g++ options: -lm -lstdc++ -lOpenCL -lrt -O2
Mixbench Backend: NVIDIA CUDA - Benchmark: Double Precision OpenBenchmarking.org GFLOPS, More Is Better Mixbench 2020-06-23 Backend: NVIDIA CUDA - Benchmark: Double Precision MSI NVIDIA GeForce RTX 3090 110 220 330 440 550 SE +/- 8.29, N = 15 497.73 1. (CXX) g++ options: -lm -lstdc++ -lOpenCL -lrt -O2
Mixbench Backend: NVIDIA CUDA - Benchmark: Single Precision OpenBenchmarking.org GFLOPS, More Is Better Mixbench 2020-06-23 Backend: NVIDIA CUDA - Benchmark: Single Precision MSI NVIDIA GeForce RTX 3090 7K 14K 21K 28K 35K SE +/- 404.30, N = 15 31838.27 1. (CXX) g++ options: -lm -lstdc++ -lOpenCL -lrt -O2
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: mobilenet MSI NVIDIA GeForce RTX 3090 12 24 36 48 60 SE +/- 2.58, N = 7 52.65 MIN: 24.88 / MAX: 721.83 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 MSI NVIDIA GeForce RTX 3090 5 10 15 20 25 SE +/- 2.40, N = 7 22.24 MIN: 8.81 / MAX: 621.74 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 MSI NVIDIA GeForce RTX 3090 4 8 12 16 20 SE +/- 1.38, N = 7 16.97 MIN: 8.58 / MAX: 743.55 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: shufflenet-v2 MSI NVIDIA GeForce RTX 3090 5 10 15 20 25 SE +/- 2.21, N = 7 18.41 MIN: 9.35 / MAX: 812.96 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: mnasnet MSI NVIDIA GeForce RTX 3090 4 8 12 16 20 SE +/- 1.58, N = 7 16.64 MIN: 8.12 / MAX: 610.04 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: efficientnet-b0 MSI NVIDIA GeForce RTX 3090 6 12 18 24 30 SE +/- 2.12, N = 7 26.40 MIN: 14.1 / MAX: 1069.68 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: blazeface MSI NVIDIA GeForce RTX 3090 3 6 9 12 15 SE +/- 1.73, N = 7 11.31 MIN: 4.15 / MAX: 483.31 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: googlenet MSI NVIDIA GeForce RTX 3090 11 22 33 44 55 SE +/- 2.62, N = 7 49.15 MIN: 22.64 / MAX: 1036.32 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: vgg16 MSI NVIDIA GeForce RTX 3090 20 40 60 80 100 SE +/- 2.34, N = 7 103.35 MIN: 63.41 / MAX: 795.48 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: resnet18 MSI NVIDIA GeForce RTX 3090 8 16 24 32 40 SE +/- 2.60, N = 7 33.80 MIN: 16.74 / MAX: 608.16 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: alexnet MSI NVIDIA GeForce RTX 3090 7 14 21 28 35 SE +/- 3.50, N = 7 31.16 MIN: 15.67 / MAX: 275.83 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: resnet50 MSI NVIDIA GeForce RTX 3090 16 32 48 64 80 SE +/- 4.70, N = 7 71.49 MIN: 33.7 / MAX: 1100.3 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3 MSI NVIDIA GeForce RTX 3090 12 24 36 48 60 SE +/- 2.58, N = 7 52.65 MIN: 24.88 / MAX: 721.83 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: yolov4-tiny MSI NVIDIA GeForce RTX 3090 14 28 42 56 70 SE +/- 1.60, N = 7 64.14 MIN: 39.53 / MAX: 565.18 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: squeezenet_ssd MSI NVIDIA GeForce RTX 3090 11 22 33 44 55 SE +/- 4.97, N = 7 49.93 MIN: 25.42 / MAX: 1261.69 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: regnety_400m MSI NVIDIA GeForce RTX 3090 20 40 60 80 100 SE +/- 5.08, N = 7 90.84 MIN: 38.24 / MAX: 4536.9 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: vision_transformer MSI NVIDIA GeForce RTX 3090 30 60 90 120 150 SE +/- 4.49, N = 7 134.18 MIN: 89.58 / MAX: 998.89 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: FastestDet MSI NVIDIA GeForce RTX 3090 7 14 21 28 35 SE +/- 3.48, N = 7 28.33 MIN: 10.72 / MAX: 872.51 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NeatBench Acceleration: GPU OpenBenchmarking.org FPS, More Is Better NeatBench 5 Acceleration: GPU MSI NVIDIA GeForce RTX 3090 700 1400 2100 2800 3500 SE +/- 0.00, N = 3 3090
Rodinia Test: OpenCL Particle Filter OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 3.1 Test: OpenCL Particle Filter MSI NVIDIA GeForce RTX 3090 0.907 1.814 2.721 3.628 4.535 SE +/- 0.004, N = 3 4.031 1. (CXX) g++ options: -m64 -lm -lcuda -lcudart -lcudadevrt -lcudart_static -lrt -lpthread -ldl
ViennaCL Test: CPU BLAS - sCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sCOPY MSI NVIDIA GeForce RTX 3090 15 30 45 60 75 SE +/- 4.86, N = 15 69.3 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - sAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sAXPY MSI NVIDIA GeForce RTX 3090 20 40 60 80 100 SE +/- 8.97, N = 15 97.5 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - sDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sDOT MSI NVIDIA GeForce RTX 3090 20 40 60 80 100 SE +/- 7.39, N = 15 110.9 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dCOPY MSI NVIDIA GeForce RTX 3090 4 8 12 16 20 SE +/- 0.32, N = 15 16.8 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dAXPY MSI NVIDIA GeForce RTX 3090 6 12 18 24 30 SE +/- 0.48, N = 15 23.6 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dDOT MSI NVIDIA GeForce RTX 3090 6 12 18 24 30 SE +/- 1.08, N = 15 25.3 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMV-N OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-N MSI NVIDIA GeForce RTX 3090 7 14 21 28 35 SE +/- 1.03, N = 15 29.6 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMV-T OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-T MSI NVIDIA GeForce RTX 3090 9 18 27 36 45 SE +/- 1.64, N = 15 37.1 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-NN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NN MSI NVIDIA GeForce RTX 3090 13 26 39 52 65 SE +/- 0.25, N = 15 57.5 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-NT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NT MSI NVIDIA GeForce RTX 3090 12 24 36 48 60 SE +/- 0.33, N = 15 52.8 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-TN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TN MSI NVIDIA GeForce RTX 3090 13 26 39 52 65 SE +/- 0.38, N = 15 60.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: CPU BLAS - dGEMM-TT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TT MSI NVIDIA GeForce RTX 3090 13 26 39 52 65 SE +/- 0.39, N = 15 58.7 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sCOPY MSI NVIDIA GeForce RTX 3090 80 160 240 320 400 SE +/- 1.15, N = 3 359 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sAXPY MSI NVIDIA GeForce RTX 3090 110 220 330 440 550 SE +/- 0.33, N = 3 490 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - sDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sDOT MSI NVIDIA GeForce RTX 3090 80 160 240 320 400 SE +/- 0.58, N = 3 359 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dCOPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dCOPY MSI NVIDIA GeForce RTX 3090 130 260 390 520 650 SE +/- 0.33, N = 3 596 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dAXPY OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dAXPY MSI NVIDIA GeForce RTX 3090 150 300 450 600 750 SE +/- 0.33, N = 3 713 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dDOT OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dDOT MSI NVIDIA GeForce RTX 3090 140 280 420 560 700 SE +/- 0.67, N = 3 641 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMV-N OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-N MSI NVIDIA GeForce RTX 3090 40 80 120 160 200 SE +/- 0.00, N = 3 186 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMV-T OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-T MSI NVIDIA GeForce RTX 3090 80 160 240 320 400 SE +/- 0.00, N = 3 371 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-NN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NN MSI NVIDIA GeForce RTX 3090 130 260 390 520 650 SE +/- 1.33, N = 3 590 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-NT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NT MSI NVIDIA GeForce RTX 3090 130 260 390 520 650 SE +/- 1.67, N = 3 593 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-TN OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TN MSI NVIDIA GeForce RTX 3090 130 260 390 520 650 SE +/- 1.33, N = 3 591 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
ViennaCL Test: OpenCL BLAS - dGEMM-TT OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TT MSI NVIDIA GeForce RTX 3090 130 260 390 520 650 SE +/- 1.33, N = 3 590 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
Phoronix Test Suite v10.8.5