Core i9 9900KS December 2020

Intel Core i9-9900KS testing with a ASUS PRIME Z390-A (1502 BIOS) and ASUS Intel UHD 630 3GB on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2012204-HA-COREI999032.

Core i9 9900KS December 2020ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen Resolution123Intel Core i9-9900KS @ 5.00GHz (8 Cores / 16 Threads)ASUS PRIME Z390-A (1502 BIOS)Intel Cannon Lake PCH32GB240GB Corsair Force MP510ASUS Intel UHD 630 3GB (1200MHz)Realtek ALC1220G237HLIntel I219-VUbuntu 20.045.9.0-050900rc8daily20201005-generic (x86_64) 20201004GNOME Shell 3.36.2X Server 1.20.8modesetting 1.20.84.6 Mesa 20.0.4GCC 9.3.0ext41920x1080OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0xcc - Thermald 1.9.1 Python Details- Python 2.7.18rc1 + Python 3.8.2Security Details- itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Mitigation of TSX disabled + tsx_async_abort: Mitigation of TSX disabled

Core i9 9900KS December 2020vkfft: betsy: ETC1 - Highestbetsy: ETC2 RGB - Highestvkresample: 2x - Doublevkresample: 2x - Singleyquake2: OpenGL 1.x - 1920 x 1080yquake2: OpenGL 3.x - 1920 x 1080yquake2: Software CPU - 1920 x 1080clomp: Static OMP Speeduphmmer: Pfam Database Searchmafft: Multiple Sequence Alignment - LSU RNAcompress-lz4: 1 - Compression Speedcompress-lz4: 1 - Decompression Speedcompress-lz4: 3 - Compression Speedcompress-lz4: 3 - Decompression Speedcompress-lz4: 9 - Compression Speedcompress-lz4: 9 - Decompression Speedcrafty: Elapsed Timegraphics-magick: Swirlgraphics-magick: Rotategraphics-magick: Sharpengraphics-magick: Enhancedgraphics-magick: Resizinggraphics-magick: Noise-Gaussiangraphics-magick: HWB Color Spaceonednn: IP Shapes 1D - f32 - CPUonednn: IP Shapes 3D - f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUonednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUrav1e: 1rav1e: 5rav1e: 6rav1e: 10coremark: CoreMark Size 666 - Iterations Per Secondstockfish: Total Timeasmfish: 1024 Hash Memory, 26 Depthbuild-clash: Time To Compilebuild-ffmpeg: Time To Compilebuild2: Time To Compilenumpy: build-eigen: Time To Compileencode-ape: WAV To APEespeak: Text-To-Speech Synthesisnode-web-tooling: gromacs: Water Benchmarkastcenc: Fastastcenc: Mediumastcenc: Thoroughastcenc: Exhaustivebasis: ETC1Sbasis: UASTC Level 0basis: UASTC Level 2basis: UASTC Level 3basis: UASTC Level 2 + RDO Post-Processingsqlite-speedtest: Timed Time - Size 1,000redis: LPOPredis: SADDredis: LPUSHredis: GETredis: SETncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400mopenvino: Face Detection 0106 FP16 - CPUopenvino: Face Detection 0106 FP16 - CPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Person Detection 0106 FP16 - CPUopenvino: Person Detection 0106 FP16 - CPUopenvino: Person Detection 0106 FP32 - CPUopenvino: Person Detection 0106 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - CPUindigobench: CPU - Bedroomindigobench: CPU - Supercarai-benchmark: Device Inference Scoreai-benchmark: Device Training Scoreai-benchmark: Device AI Scorephpbench: PHP Benchmark Suiteencode-wavpack: WAV To WavPackbrl-cad: VGR Performance Metric123151513.6645.446889.160376.214439.9448.1132.25.297.0338.5369275.5211356.156.0510989.254.6810988.997886433769457819693224211523.520448.063281.684431.8095914.74954.834526.5983314.04745.400913.165423408.071852.253421.151850.623.140493418.141852.832.950570.4691.3571.8113.957381793.3687261898066029044179304.78758.681121.659444.3168.2099.85224.71714.070.9555.548.6430.72245.9847.2877.21434.04964.514602.73248.2003382992.682758297.752095672.133220307.752405648.8116.274.733.684.623.676.031.6312.3652.7312.5410.5823.4123.0717.1012.5816.574.753.704.813.736.051.6412.4652.5912.4910.6823.4823.4817.4012.652.541572.472.531574.681.562531.911.562540.296996.220.576861.950.571.7124.00812811277255883904612.9691155311514887.049374.163437.9447.0131.65.097.1578.4579243.7011232.356.1310919.554.7710931.095981043789707819693924411783.511687.460191.682991.8103514.76244.878356.6072014.03995.318683.167833408.511852.783411.101847.333.103473414.181847.712.948550.4731.3631.8093.978385854.6289091880353229303188304.63758.712120.760437.4468.0729.84724.92314.470.9545.558.6430.72245.7747.2937.21034.03464.501602.98048.2242128075.582754993.832066450.423019770.332461547.716.584.723.694.913.756.001.6612.5352.5012.4510.7023.5123.4817.4312.5716.574.723.704.913.806.021.6512.5352.5512.4610.7423.4723.4417.4512.602.541577.712.521583.601.562519.621.572523.037007.960.576897.30.571.7073.97412941285257983943012.9631155901515887.337374.471438.1444.1132.55.097.0158.4999259.2511245.156.0610942.854.6710950.798333323779627819693324211663.573417.401701.686521.8071214.76284.845426.6096214.00415.345713.165023403.871842.583412.781843.233.139703410.111845.482.947950.4721.3561.7783.978383816.2176901874729229182888304.02958.691121.322440.9867.9279.84826.02614.070.9525.568.6530.71245.6647.0297.21434.05864.473603.48248.4562968441.762732946.002105711.543077588.582425933.0816.564.733.694.923.765.981.6512.5052.4412.4610.7223.5023.5017.4212.5316.554.743.704.923.786.001.6612.5552.4612.4610.7623.5023.4817.4412.582.531574.462.531566.931.562528.131.592501.686917.950.576853.980.581.7084.01612971285258283755212.970115917OpenBenchmarking.org

VkFFT

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.1.112330060090012001500SE +/- 1.20, N = 3SE +/- 1.53, N = 31515151415151. (CXX) g++ options: -O3 -pthread

Betsy GPU Compressor

Codec: ETC1 - Quality: Highest

OpenBenchmarking.orgSeconds, Fewer Is BetterBetsy GPU Compressor 1.1 BetaCodec: ETC1 - Quality: Highest14812162013.661. (CXX) g++ options: -O3 -O2 -lpthread -ldl

Betsy GPU Compressor

Codec: ETC2 RGB - Quality: Highest

OpenBenchmarking.orgSeconds, Fewer Is BetterBetsy GPU Compressor 1.1 BetaCodec: ETC2 RGB - Quality: Highest11.22542.45083.67624.90166.1275.4461. (CXX) g++ options: -O3 -O2 -lpthread -ldl

VkResample

Upscale: 2x - Precision: Double

OpenBenchmarking.orgms, Fewer Is BetterVkResample 1.0Upscale: 2x - Precision: Double1232004006008001000SE +/- 0.54, N = 3SE +/- 0.34, N = 3SE +/- 0.58, N = 3889.16887.05887.341. (CXX) g++ options: -O3 -pthread

VkResample

Upscale: 2x - Precision: Single

OpenBenchmarking.orgms, Fewer Is BetterVkResample 1.0Upscale: 2x - Precision: Single12380160240320400SE +/- 0.17, N = 3SE +/- 0.30, N = 3SE +/- 0.20, N = 3376.21374.16374.471. (CXX) g++ options: -O3 -pthread

yquake2

Renderer: OpenGL 1.x - Resolution: 1920 x 1080

OpenBenchmarking.orgFrames Per Second, More Is Betteryquake2 7.45Renderer: OpenGL 1.x - Resolution: 1920 x 1080123100200300400500SE +/- 2.55, N = 3SE +/- 0.53, N = 3SE +/- 0.10, N = 3439.9437.9438.11. (CC) gcc options: -lm -ldl -rdynamic -shared -lSDL2 -O2 -pipe -fomit-frame-pointer -std=gnu99 -fno-strict-aliasing -fwrapv -fvisibility=hidden -MMD -mfpmath=sse -fPIC

yquake2

Renderer: OpenGL 3.x - Resolution: 1920 x 1080

OpenBenchmarking.orgFrames Per Second, More Is Betteryquake2 7.45Renderer: OpenGL 3.x - Resolution: 1920 x 1080123100200300400500SE +/- 1.48, N = 3SE +/- 1.09, N = 3SE +/- 1.48, N = 3448.1447.0444.11. (CC) gcc options: -lm -ldl -rdynamic -shared -lSDL2 -O2 -pipe -fomit-frame-pointer -std=gnu99 -fno-strict-aliasing -fwrapv -fvisibility=hidden -MMD -mfpmath=sse -fPIC

yquake2

Renderer: Software CPU - Resolution: 1920 x 1080

OpenBenchmarking.orgFrames Per Second, More Is Betteryquake2 7.45Renderer: Software CPU - Resolution: 1920 x 1080123306090120150SE +/- 0.39, N = 3SE +/- 0.38, N = 3SE +/- 0.15, N = 3132.2131.6132.51. (CC) gcc options: -lm -ldl -rdynamic -shared -lSDL2 -O2 -pipe -fomit-frame-pointer -std=gnu99 -fno-strict-aliasing -fwrapv -fvisibility=hidden -MMD -mfpmath=sse -fPIC

CLOMP

Static OMP Speedup

OpenBenchmarking.orgSpeedup, More Is BetterCLOMP 1.2Static OMP Speedup1231.172.343.514.685.85SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 45.25.05.01. (CC) gcc options: -fopenmp -O3 -lm

Timed HMMer Search

Pfam Database Search

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 3.3.1Pfam Database Search12320406080100SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.02, N = 397.0397.1697.021. (CC) gcc options: -O3 -pthread -lhmmer -leasel -lm

Timed MAFFT Alignment

Multiple Sequence Alignment - LSU RNA

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 7.471Multiple Sequence Alignment - LSU RNA123246810SE +/- 0.036, N = 3SE +/- 0.026, N = 3SE +/- 0.059, N = 38.5368.4578.4991. (CC) gcc options: -std=c99 -O3 -lm -lpthread

LZ4 Compression

Compression Level: 1 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.3Compression Level: 1 - Compression Speed1232K4K6K8K10KSE +/- 1.27, N = 3SE +/- 2.64, N = 3SE +/- 13.49, N = 39275.529243.709259.251. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 1 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.3Compression Level: 1 - Decompression Speed1232K4K6K8K10KSE +/- 0.76, N = 3SE +/- 5.54, N = 3SE +/- 12.40, N = 311356.111232.311245.11. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 3 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.3Compression Level: 3 - Compression Speed1231326395265SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 356.0556.1356.061. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 3 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.3Compression Level: 3 - Decompression Speed1232K4K6K8K10KSE +/- 4.60, N = 3SE +/- 3.57, N = 3SE +/- 2.03, N = 310989.210919.510942.81. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 9 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.3Compression Level: 9 - Compression Speed1231224364860SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 354.6854.7754.671. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 9 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.3Compression Level: 9 - Decompression Speed1232K4K6K8K10KSE +/- 7.91, N = 3SE +/- 6.24, N = 3SE +/- 5.32, N = 310988.910931.010950.71. (CC) gcc options: -O3

Crafty

Elapsed Time

OpenBenchmarking.orgNodes Per Second, More Is BetterCrafty 25.2Elapsed Time1232M4M6M8M10MSE +/- 3551.20, N = 3SE +/- 23426.50, N = 3SE +/- 65946.18, N = 39788643959810498333321. (CC) gcc options: -pthread -lstdc++ -fprofile-use -lm

GraphicsMagick

Operation: Swirl

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Swirl12380160240320400SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 33763783771. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Rotate

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Rotate1232004006008001000SE +/- 0.33, N = 39459709621. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Sharpen

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Sharpen123204060801007878781. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Enhanced

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Enhanced12340801201602001961961961. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Resizing

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Resizing1232004006008001000SE +/- 2.08, N = 3SE +/- 1.20, N = 3SE +/- 2.08, N = 39329399331. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Noise-Gaussian

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Noise-Gaussian12350100150200250SE +/- 0.88, N = 3SE +/- 2.00, N = 3SE +/- 1.33, N = 32422442421. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: HWB Color Space

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: HWB Color Space12330060090012001500SE +/- 1.67, N = 3SE +/- 1.15, N = 3SE +/- 0.88, N = 31152117811661. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

oneDNN

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU1230.8041.6082.4123.2164.02SE +/- 0.04779, N = 4SE +/- 0.04563, N = 4SE +/- 0.00469, N = 33.520443.511683.57341MIN: 3.2MIN: 3.17MIN: 3.251. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU123246810SE +/- 0.00987, N = 3SE +/- 0.01320, N = 3SE +/- 0.01207, N = 38.063287.460197.40170MIN: 7.94MIN: 7.3MIN: 7.271. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU1230.37950.7591.13851.5181.8975SE +/- 0.00209, N = 3SE +/- 0.00257, N = 3SE +/- 0.00153, N = 31.684431.682991.68652MIN: 1.53MIN: 1.52MIN: 1.531. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU1230.40730.81461.22191.62922.0365SE +/- 0.00527, N = 3SE +/- 0.00533, N = 3SE +/- 0.00318, N = 31.809591.810351.80712MIN: 1.76MIN: 1.76MIN: 1.761. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU12348121620SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 314.7514.7614.76MIN: 14.58MIN: 14.57MIN: 14.591. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU1231.09762.19523.29284.39045.488SE +/- 0.01296, N = 3SE +/- 0.02290, N = 3SE +/- 0.01575, N = 34.834524.878354.84542MIN: 4.52MIN: 4.52MIN: 4.511. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU123246810SE +/- 0.00527, N = 3SE +/- 0.00365, N = 3SE +/- 0.01164, N = 36.598336.607206.60962MIN: 5.96MIN: 5.96MIN: 5.951. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU12348121620SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 314.0514.0414.00MIN: 13.93MIN: 13.81MIN: 13.891. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU1231.21522.43043.64564.86086.076SE +/- 0.05553, N = 3SE +/- 0.01249, N = 3SE +/- 0.00604, N = 35.400915.318685.34571MIN: 4.86MIN: 4.93MIN: 4.941. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU1230.71281.42562.13842.85123.564SE +/- 0.00425, N = 3SE +/- 0.00795, N = 3SE +/- 0.00835, N = 33.165423.167833.16502MIN: 2.9MIN: 2.9MIN: 2.91. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU1237001400210028003500SE +/- 1.81, N = 3SE +/- 1.13, N = 3SE +/- 2.25, N = 33408.073408.513403.87MIN: 3399.42MIN: 3400.89MIN: 3394.991. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU123400800120016002000SE +/- 1.64, N = 3SE +/- 8.27, N = 3SE +/- 1.36, N = 31852.251852.781842.58MIN: 1842.69MIN: 1836.62MIN: 1833.811. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU1237001400210028003500SE +/- 0.75, N = 3SE +/- 1.91, N = 3SE +/- 1.40, N = 33421.153411.103412.78MIN: 3414.07MIN: 3402.78MIN: 3405.741. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU123400800120016002000SE +/- 0.58, N = 3SE +/- 1.48, N = 3SE +/- 1.87, N = 31850.621847.331843.23MIN: 1844.57MIN: 1838.33MIN: 1833.461. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU1230.70661.41322.11982.82643.533SE +/- 0.00803, N = 3SE +/- 0.00404, N = 3SE +/- 0.00464, N = 33.140493.103473.13970MIN: 3.08MIN: 3.04MIN: 3.091. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU1237001400210028003500SE +/- 0.69, N = 3SE +/- 0.83, N = 3SE +/- 2.17, N = 33418.143414.183410.11MIN: 3411.38MIN: 3406.96MIN: 3400.641. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU123400800120016002000SE +/- 1.08, N = 3SE +/- 0.90, N = 3SE +/- 0.95, N = 31852.831847.711845.48MIN: 1845.94MIN: 1840.85MIN: 1837.61. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU1230.66391.32781.99172.65563.3195SE +/- 0.00227, N = 3SE +/- 0.00041, N = 3SE +/- 0.00379, N = 32.950572.948552.94795MIN: 2.75MIN: 2.76MIN: 2.741. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

rav1e

Speed: 1

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.4 AlphaSpeed: 11230.10640.21280.31920.42560.532SE +/- 0.001, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.4690.4730.472

rav1e

Speed: 5

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.4 AlphaSpeed: 51230.30670.61340.92011.22681.5335SE +/- 0.003, N = 3SE +/- 0.003, N = 3SE +/- 0.003, N = 31.3571.3631.356

rav1e

Speed: 6

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.4 AlphaSpeed: 61230.40750.8151.22251.632.0375SE +/- 0.003, N = 3SE +/- 0.008, N = 3SE +/- 0.022, N = 51.8111.8091.778

rav1e

Speed: 10

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.4 AlphaSpeed: 101230.89511.79022.68533.58044.4755SE +/- 0.007, N = 3SE +/- 0.002, N = 3SE +/- 0.000, N = 33.9573.9783.978

Coremark

CoreMark Size 666 - Iterations Per Second

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per Second12380K160K240K320K400KSE +/- 712.72, N = 3SE +/- 2742.69, N = 3SE +/- 293.55, N = 3381793.37385854.63383816.221. (CC) gcc options: -O2 -lrt" -lrt

Stockfish

Total Time

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 12Total Time1234M8M12M16M20MSE +/- 167782.08, N = 11SE +/- 165627.37, N = 3SE +/- 189970.60, N = 31898066018803532187472921. (CXX) g++ options: -m64 -lpthread -fno-exceptions -std=c++17 -pedantic -O3 -msse -msse3 -mpopcnt -msse4.1 -mssse3 -msse2 -flto -flto=jobserver

asmFish

1024 Hash Memory, 26 Depth

OpenBenchmarking.orgNodes/second, More Is BetterasmFish 2018-07-231024 Hash Memory, 26 Depth1236M12M18M24M30MSE +/- 244599.81, N = 3SE +/- 380611.24, N = 3SE +/- 368492.85, N = 5290441792930318829182888

Timed Clash Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Clash CompilationTime To Compile12370140210280350SE +/- 0.15, N = 3SE +/- 1.33, N = 3SE +/- 0.29, N = 3304.79304.64304.03

Timed FFmpeg Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 4.2.2Time To Compile1231326395265SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 358.6858.7158.69

Build2

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterBuild2 0.13Time To Compile123306090120150SE +/- 0.28, N = 3SE +/- 1.48, N = 3SE +/- 1.00, N = 3121.66120.76121.32

Numpy Benchmark

OpenBenchmarking.orgScore, More Is BetterNumpy Benchmark123100200300400500SE +/- 0.27, N = 3SE +/- 1.23, N = 3SE +/- 1.69, N = 3444.31437.44440.98

Timed Eigen Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Eigen Compilation 3.3.9Time To Compile1231530456075SE +/- 0.13, N = 3SE +/- 0.20, N = 3SE +/- 0.06, N = 368.2168.0767.93

Monkey Audio Encoding

WAV To APE

OpenBenchmarking.orgSeconds, Fewer Is BetterMonkey Audio Encoding 3.99.6WAV To APE1233691215SE +/- 0.021, N = 5SE +/- 0.029, N = 5SE +/- 0.027, N = 59.8529.8479.8481. (CXX) g++ options: -O3 -pedantic -rdynamic -lrt

eSpeak-NG Speech Engine

Text-To-Speech Synthesis

OpenBenchmarking.orgSeconds, Fewer Is BettereSpeak-NG Speech Engine 20200907Text-To-Speech Synthesis123612182430SE +/- 0.29, N = 4SE +/- 0.12, N = 4SE +/- 0.28, N = 2024.7224.9226.031. (CC) gcc options: -O2 -std=c99

Node.js V8 Web Tooling Benchmark

OpenBenchmarking.orgruns/s, More Is BetterNode.js V8 Web Tooling Benchmark12348121620SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 314.0714.4714.071. Nodejs v10.19.0

GROMACS

Water Benchmark

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2020.3Water Benchmark1230.21490.42980.64470.85961.0745SE +/- 0.002, N = 3SE +/- 0.002, N = 3SE +/- 0.001, N = 30.9550.9540.9521. (CXX) g++ options: -O3 -pthread -lrt -lpthread -lm

ASTC Encoder

Preset: Fast

OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 2.0Preset: Fast1231.2512.5023.7535.0046.255SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 35.545.555.561. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -mfpmath=sse -mavx2 -mpopcnt -lpthread

ASTC Encoder

Preset: Medium

OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 2.0Preset: Medium123246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.648.648.651. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -mfpmath=sse -mavx2 -mpopcnt -lpthread

ASTC Encoder

Preset: Thorough

OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 2.0Preset: Thorough123714212835SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 330.7230.7230.711. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -mfpmath=sse -mavx2 -mpopcnt -lpthread

ASTC Encoder

Preset: Exhaustive

OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 2.0Preset: Exhaustive12350100150200250SE +/- 0.12, N = 3SE +/- 0.17, N = 3SE +/- 0.07, N = 3245.98245.77245.661. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -mfpmath=sse -mavx2 -mpopcnt -lpthread

Basis Universal

Settings: ETC1S

OpenBenchmarking.orgSeconds, Fewer Is BetterBasis Universal 1.12Settings: ETC1S1231122334455SE +/- 0.29, N = 3SE +/- 0.48, N = 3SE +/- 0.25, N = 347.2947.2947.031. (CXX) g++ options: -std=c++11 -fvisibility=hidden -fPIC -fno-strict-aliasing -O3 -rdynamic -lm -lpthread

Basis Universal

Settings: UASTC Level 0

OpenBenchmarking.orgSeconds, Fewer Is BetterBasis Universal 1.12Settings: UASTC Level 0123246810SE +/- 0.002, N = 3SE +/- 0.001, N = 3SE +/- 0.003, N = 37.2147.2107.2141. (CXX) g++ options: -std=c++11 -fvisibility=hidden -fPIC -fno-strict-aliasing -O3 -rdynamic -lm -lpthread

Basis Universal

Settings: UASTC Level 2

OpenBenchmarking.orgSeconds, Fewer Is BetterBasis Universal 1.12Settings: UASTC Level 2123816243240SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 334.0534.0334.061. (CXX) g++ options: -std=c++11 -fvisibility=hidden -fPIC -fno-strict-aliasing -O3 -rdynamic -lm -lpthread

Basis Universal

Settings: UASTC Level 3

OpenBenchmarking.orgSeconds, Fewer Is BetterBasis Universal 1.12Settings: UASTC Level 31231428425670SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 364.5164.5064.471. (CXX) g++ options: -std=c++11 -fvisibility=hidden -fPIC -fno-strict-aliasing -O3 -rdynamic -lm -lpthread

Basis Universal

Settings: UASTC Level 2 + RDO Post-Processing

OpenBenchmarking.orgSeconds, Fewer Is BetterBasis Universal 1.12Settings: UASTC Level 2 + RDO Post-Processing123130260390520650SE +/- 0.49, N = 3SE +/- 0.17, N = 3SE +/- 0.79, N = 3602.73602.98603.481. (CXX) g++ options: -std=c++11 -fvisibility=hidden -fPIC -fno-strict-aliasing -O3 -rdynamic -lm -lpthread

SQLite Speedtest

Timed Time - Size 1,000

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,0001231122334455SE +/- 0.01, N = 3SE +/- 0.18, N = 3SE +/- 0.13, N = 348.2048.2248.461. (CC) gcc options: -O2 -ldl -lz -lpthread

Redis

Test: LPOP

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 6.0.9Test: LPOP123700K1400K2100K2800K3500KSE +/- 36056.39, N = 7SE +/- 11293.64, N = 3SE +/- 154649.98, N = 123382992.682128075.582968441.761. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Redis

Test: SADD

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 6.0.9Test: SADD123600K1200K1800K2400K3000KSE +/- 6807.92, N = 3SE +/- 8712.72, N = 3SE +/- 11220.91, N = 32758297.752754993.832732946.001. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Redis

Test: LPUSH

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 6.0.9Test: LPUSH123500K1000K1500K2000K2500KSE +/- 7455.16, N = 3SE +/- 31690.26, N = 3SE +/- 6866.08, N = 32095672.132066450.422105711.541. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Redis

Test: GET

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 6.0.9Test: GET123700K1400K2100K2800K3500KSE +/- 35956.34, N = 3SE +/- 43634.82, N = 3SE +/- 10512.89, N = 33220307.753019770.333077588.581. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Redis

Test: SET

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 6.0.9Test: SET123500K1000K1500K2000K2500KSE +/- 29916.08, N = 4SE +/- 10824.77, N = 3SE +/- 17059.06, N = 32405648.812461547.702425933.081. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet12348121620SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 316.2716.5816.56MIN: 16.1 / MAX: 17.46MIN: 16.47 / MAX: 25.76MIN: 16.42 / MAX: 25.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v21231.06432.12863.19294.25725.3215SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 34.734.724.73MIN: 4.54 / MAX: 5.87MIN: 4.55 / MAX: 5.78MIN: 4.54 / MAX: 6.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v31230.83031.66062.49093.32124.1515SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 33.683.693.69MIN: 3.59 / MAX: 4.69MIN: 3.63 / MAX: 4.99MIN: 3.62 / MAX: 4.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v21231.1072.2143.3214.4285.535SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 34.624.914.92MIN: 4.56 / MAX: 12.57MIN: 4.8 / MAX: 5.97MIN: 4.81 / MAX: 6.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet1230.8461.6922.5383.3844.23SE +/- 0.02, N = 2SE +/- 0.03, N = 3SE +/- 0.04, N = 33.673.753.76MIN: 3.6 / MAX: 4.54MIN: 3.65 / MAX: 5.11MIN: 3.65 / MAX: 5.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b0123246810SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 36.036.005.98MIN: 5.87 / MAX: 7.37MIN: 5.91 / MAX: 7.05MIN: 5.89 / MAX: 7.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface1230.37350.7471.12051.4941.8675SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 31.631.661.65MIN: 1.61 / MAX: 1.82MIN: 1.59 / MAX: 1.92MIN: 1.6 / MAX: 1.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet1233691215SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 312.3612.5312.50MIN: 12.14 / MAX: 12.95MIN: 12.33 / MAX: 13.05MIN: 12.28 / MAX: 12.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg161231224364860SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 352.7352.5052.44MIN: 52.5 / MAX: 61.22MIN: 52.33 / MAX: 53.56MIN: 52.23 / MAX: 53.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet181233691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 312.5412.4512.46MIN: 12.32 / MAX: 12.86MIN: 12.26 / MAX: 13.56MIN: 12.27 / MAX: 13.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet1233691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 310.5810.7010.72MIN: 10.47 / MAX: 11.26MIN: 10.44 / MAX: 11.28MIN: 10.47 / MAX: 11.391. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet50123612182430SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 323.4123.5123.50MIN: 23.07 / MAX: 32.67MIN: 23.24 / MAX: 24.24MIN: 23.13 / MAX: 23.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny123612182430SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 323.0723.4823.50MIN: 22.88 / MAX: 24.51MIN: 23.02 / MAX: 25.64MIN: 22.95 / MAX: 23.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd12348121620SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 317.1017.4317.42MIN: 16.9 / MAX: 19.23MIN: 17.29 / MAX: 17.69MIN: 17.3 / MAX: 19.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m1233691215SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.15, N = 312.5812.5712.53MIN: 12.33 / MAX: 13.88MIN: 12.34 / MAX: 14.22MIN: 12.12 / MAX: 141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet12348121620SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 316.5716.5716.55MIN: 16.46 / MAX: 17.83MIN: 16.46 / MAX: 17.32MIN: 16.45 / MAX: 17.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v21231.06882.13763.20644.27525.344SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 34.754.724.74MIN: 4.59 / MAX: 5.84MIN: 4.56 / MAX: 5.98MIN: 4.56 / MAX: 5.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v31230.83251.6652.49753.334.1625SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.703.703.70MIN: 3.62 / MAX: 4.79MIN: 3.64 / MAX: 4.8MIN: 3.64 / MAX: 4.791. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v21231.1072.2143.3214.4285.535SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 34.814.914.92MIN: 4.55 / MAX: 6.07MIN: 4.82 / MAX: 6.01MIN: 4.73 / MAX: 8.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet1230.8551.712.5653.424.275SE +/- 0.04, N = 3SE +/- 0.01, N = 2SE +/- 0.03, N = 33.733.803.78MIN: 3.6 / MAX: 4.45MIN: 3.69 / MAX: 4.82MIN: 3.67 / MAX: 4.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b0123246810SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 36.056.026.00MIN: 5.93 / MAX: 7.23MIN: 5.92 / MAX: 7.07MIN: 5.91 / MAX: 7.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface1230.37350.7471.12051.4941.8675SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 31.641.651.66MIN: 1.6 / MAX: 1.87MIN: 1.6 / MAX: 1.92MIN: 1.59 / MAX: 1.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet1233691215SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 312.4612.5312.55MIN: 12.16 / MAX: 12.68MIN: 12.33 / MAX: 14.23MIN: 12.31 / MAX: 14.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg161231224364860SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 352.5952.5552.46MIN: 52.29 / MAX: 62.32MIN: 52.35 / MAX: 60.91MIN: 52.29 / MAX: 61.031. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet181233691215SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 312.4912.4612.46MIN: 12.31 / MAX: 13.16MIN: 12.25 / MAX: 13.68MIN: 12.25 / MAX: 13.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet1233691215SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 310.6810.7410.76MIN: 10.48 / MAX: 11.16MIN: 10.45 / MAX: 20.15MIN: 10.47 / MAX: 19.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet50123612182430SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 323.4823.4723.50MIN: 23.08 / MAX: 25.59MIN: 23.16 / MAX: 23.78MIN: 23.14 / MAX: 23.811. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny123612182430SE +/- 0.02, N = 3SE +/- 0.02, N = 2SE +/- 0.01, N = 323.4823.4423.48MIN: 22.93 / MAX: 23.73MIN: 23.04 / MAX: 24.08MIN: 22.94 / MAX: 24.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd12348121620SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 317.4017.4517.44MIN: 16.91 / MAX: 19.12MIN: 17.31 / MAX: 18.81MIN: 17.31 / MAX: 18.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m1233691215SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.14, N = 312.6512.6012.58MIN: 12.3 / MAX: 13.98MIN: 12.32 / MAX: 14.06MIN: 12.21 / MAX: 14.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenVINO

Model: Face Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU1230.57151.1431.71452.2862.8575SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 32.542.542.531. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Face Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU12330060090012001500SE +/- 9.94, N = 3SE +/- 16.67, N = 3SE +/- 10.91, N = 31572.471577.711574.461. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Face Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU1230.56931.13861.70792.27722.8465SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 32.532.522.531. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Face Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU12330060090012001500SE +/- 5.47, N = 3SE +/- 9.49, N = 3SE +/- 0.65, N = 31574.681583.601566.931. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Person Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU1230.3510.7021.0531.4041.755SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.561.561.561. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Person Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU1235001000150020002500SE +/- 11.97, N = 3SE +/- 1.28, N = 3SE +/- 12.05, N = 32531.912519.622528.131. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Person Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU1230.35780.71561.07341.43121.789SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 51.561.571.591. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Person Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU1235001000150020002500SE +/- 2.80, N = 3SE +/- 7.94, N = 3SE +/- 25.15, N = 52540.292523.032501.681. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU12315003000450060007500SE +/- 32.00, N = 3SE +/- 64.79, N = 3SE +/- 16.76, N = 36996.227007.966917.951. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU1230.12830.25660.38490.51320.6415SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.570.570.571. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU12315003000450060007500SE +/- 17.68, N = 3SE +/- 18.71, N = 3SE +/- 3.12, N = 36861.956897.306853.981. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU1230.13050.2610.39150.5220.6525SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.570.570.581. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

IndigoBench

Acceleration: CPU - Scene: Bedroom

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: Bedroom1230.38520.77041.15561.54081.926SE +/- 0.001, N = 3SE +/- 0.002, N = 3SE +/- 0.002, N = 31.7121.7071.708

IndigoBench

Acceleration: CPU - Scene: Supercar

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: Supercar1230.90361.80722.71083.61444.518SE +/- 0.003, N = 3SE +/- 0.025, N = 3SE +/- 0.007, N = 34.0083.9744.016

AI Benchmark Alpha

Device Inference Score

OpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device Inference Score12330060090012001500128112941297

AI Benchmark Alpha

Device Training Score

OpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device Training Score12330060090012001500127712851285

AI Benchmark Alpha

Device AI Score

OpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device AI Score1236001200180024003000255825792582

PHPBench

PHP Benchmark Suite

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark Suite123200K400K600K800K1000KSE +/- 2050.66, N = 3SE +/- 2124.85, N = 3SE +/- 1775.99, N = 3839046839430837552

WavPack Audio Encoding

WAV To WavPack

OpenBenchmarking.orgSeconds, Fewer Is BetterWavPack Audio Encoding 5.3WAV To WavPack1233691215SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 512.9712.9612.971. (CXX) g++ options: -rdynamic

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.30.8VGR Performance Metric12320K40K60K80K100K1155311155901159171. (CXX) g++ options: -std=c++11 -pipe -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -pedantic -rdynamic -lSM -lICE -lXi -lGLU -lGL -lGLdispatch -lX11 -lXext -lXrender -lpthread -ldl -luuid -lm

Phoronix Test Suite v10.8.4