TR 3990X Okt

AMD Ryzen Threadripper 3990X 64-Core testing with a System76 Thelio Major (F4c Z5 BIOS) and AMD Radeon RX 5600 OEM/5600 XT / 5700/5700 8GB on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2010117-FI-TR3990XOK30&sro.

TR 3990X OktProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionLinux 5.423AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads)System76 Thelio Major (F4c Z5 BIOS)AMD Starship/Matisse126GBSamsung SSD 970 EVO Plus 500GBAMD Radeon RX 5600 OEM/5600 XT / 5700/5700 8GB (1750/875MHz)AMD Navi 10 HDMI AudioG237HLIntel I211 + Intel Wi-Fi 6 AX200Ubuntu 20.045.4.0-47-generic (x86_64)GNOME Shell 3.36.4X Server 1.20.8amdgpu 19.1.04.6 Mesa 20.0.8 (LLVM 10.0.0)GCC 9.3.0ext41920x1080OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq ondemand - CPU Microcode: 0x8301025Graphics Details- GLAMORPython Details- Python 2.7.18rc1 + Python 3.8.2Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

TR 3990X Oktrealsr-ncnn: 4x - Novkfft: glmark2: 1920 x 1080sockperf: Throughputsockperf: Latency Ping Pongsockperf: Latency Under Loadlczero: BLASlczero: Eigenlczero: Randnamd: ATPase Simulation - 327,506 Atomsdolfyn: Computational Fluid Dynamicsffte: N=256, 3D Complex FFT Routinehmmer: Pfam Database Searchincompact3d: Cylindermafft: Multiple Sequence Alignment - LSU RNAmocassin: Dust 2D tau100.0lammps: 20k Atomslammps: Rhodopsin Proteinwebp: Defaultwebp: Quality 100webp: Quality 100, Losslesswebp: Quality 100, Highest Compressionwebp: Quality 100, Lossless, Highest Compressionbyte: Dhrystone 2libraw: Post-Processing Benchmarkaom-av1: Speed 0 Two-Passaom-av1: Speed 4 Two-Passaom-av1: Speed 6 Realtimeaom-av1: Speed 6 Two-Passaom-av1: Speed 8 Realtimebuild-llvm: Time To Compileespeak: Text-To-Speech Synthesisrnnoise: system-decompress-gzip: mpv: Big Buck Bunny Sunflower 4K - Software Onlympv: Big Buck Bunny Sunflower 1080p - Software Onlycouchdb: 100 - 1000 - 24keydb: gromacs: Water Benchmarkcaffe: AlexNet - CPU - 100caffe: AlexNet - CPU - 200caffe: GoogleNet - CPU - 100caffe: GoogleNet - CPU - 200gpaw: Carbon Nanotubemnn: SqueezeNetV1.0mnn: resnet-v2-50mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3ncnn: CPU - squeezenetncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: Vulkan GPU - squeezenetncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinytnn: CPU - MobileNet v2tnn: CPU - SqueezeNet v1.1openvino: Face Detection 0106 FP16 - CPUopenvino: Face Detection 0106 FP16 - CPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Person Detection 0106 FP16 - CPUopenvino: Person Detection 0106 FP16 - CPUopenvino: Person Detection 0106 FP32 - CPUopenvino: Person Detection 0106 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - CPUhint: FLOATmlpack: scikit_icamlpack: scikit_qdamlpack: scikit_svmmlpack: scikit_linearridgeregressionkripke: influxdb: 4 - 10000 - 2,5000,1 - 10000influxdb: 64 - 10000 - 2,5000,1 - 10000influxdb: 1024 - 10000 - 2,5000,1 - 10000Linux 5.42316.8822049086565639333.75514.711151614721941380.4390816.965129902.32261876165.003183.0007839.00222826.55523.6821.5032.29416.2207.14133.52842607098.541.870.332.5318.093.9034.83203.22028.58118.6392.8641046.242574.81118.091450800.423.76154629111761150216301954110.6888.45132.7985.4655.49631.88425.0727.4013.1212.9613.1112.3716.495.5125.5952.6918.6312.1636.7836.405.699.684.548.723.434.6111.531.098.4583.733.3030.499.9214.46270.100245.8449.653294.439.583293.716.684662.586.504799.7733390.810.9333014.260.94376705975.8409751.5042.0920.901.61449300631148311.01498935.71547196.916.5432053886565634953.79814.608150514461936640.4383717.044127987.82451596166.113183.6944589.05622926.28723.3381.5012.29816.3107.12333.77043503603.141.550.332.5118.123.9034.49203.63828.46318.7722.8491037.842563.28118.569440299.413.75456118112360150709301781110.6508.51932.6295.4425.48031.72325.3527.4813.4714.3414.3414.5818.216.1026.9452.1418.2311.7536.3935.055.709.534.538.713.554.6011.461.068.5084.123.3130.279.8214.37268.809244.1729.643286.549.563316.906.644683.326.524752.2633277.840.9332931.770.94375641035.4524751.9242.4320.911.62448737231146038.51501667.11539068.116.5832053286495724213.80214.593147414831923060.4442516.884128693.18322745165.748184.2983659.13523026.17823.8881.4942.30516.3797.17234.12644247620.141.400.332.5317.863.9134.69203.35128.74718.7372.8561050.732568.83117.927447704.193.75356032112011150522303072110.5758.66432.2915.4225.48031.60725.6328.2113.3913.8514.1212.9317.315.8826.3152.1218.4712.1737.3435.665.749.714.538.713.434.6111.501.088.4683.473.3030.029.5814.39268.086246.7809.653284.119.603307.266.604721.766.514782.6333230.500.9332913.000.94374097932.7822252.3942.7920.911.65444765531144571.81495506.91534264.5OpenBenchmarking.org

RealSR-NCNN

Scale: 4x - TAA: No

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: No23Linux 5.448121620SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.22, N = 316.5416.5816.88

VkFFT

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 2020-09-2923Linux 5.44K8K12K16K20KSE +/- 4.16, N = 3SE +/- 2.85, N = 3SE +/- 39.00, N = 3205382053220490

GLmark2

Resolution: 1920 x 1080

OpenBenchmarking.orgScore, More Is BetterGLmark2 2020.04Resolution: 1920 x 108023Linux 5.42K4K6K8K10K865686498656

Sockperf

Test: Throughput

OpenBenchmarking.orgMessages Per Second, More Is BetterSockperf 3.4Test: Throughput23Linux 5.4120K240K360K480K600KSE +/- 7244.39, N = 5SE +/- 5468.48, N = 5SE +/- 6120.70, N = 55634955724215639331. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

Sockperf

Test: Latency Ping Pong

OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.4Test: Latency Ping Pong23Linux 5.40.85551.7112.56653.4224.2775SE +/- 0.025, N = 5SE +/- 0.018, N = 5SE +/- 0.027, N = 53.7983.8023.7551. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

Sockperf

Test: Latency Under Load

OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.4Test: Latency Under Load23Linux 5.448121620SE +/- 0.10, N = 5SE +/- 0.17, N = 6SE +/- 0.06, N = 514.6114.5914.711. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

LeelaChessZero

Backend: BLAS

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.26Backend: BLAS23Linux 5.430060090012001500SE +/- 12.57, N = 3SE +/- 14.47, N = 3SE +/- 12.81, N = 31505147415161. (CXX) g++ options: -flto -pthread

LeelaChessZero

Backend: Eigen

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.26Backend: Eigen23Linux 5.430060090012001500SE +/- 20.76, N = 3SE +/- 15.07, N = 8SE +/- 17.75, N = 31446148314721. (CXX) g++ options: -flto -pthread

LeelaChessZero

Backend: Random

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.26Backend: Random23Linux 5.440K80K120K160K200KSE +/- 236.07, N = 3SE +/- 147.36, N = 3SE +/- 434.65, N = 31936641923061941381. (CXX) g++ options: -flto -pthread

NAMD

ATPase Simulation - 327,506 Atoms

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD 2.14ATPase Simulation - 327,506 Atoms23Linux 5.40.10.20.30.40.5SE +/- 0.00080, N = 3SE +/- 0.00402, N = 3SE +/- 0.00089, N = 30.438370.444250.43908

Dolfyn

Computational Fluid Dynamics

OpenBenchmarking.orgSeconds, Fewer Is BetterDolfyn 0.527Computational Fluid Dynamics23Linux 5.448121620SE +/- 0.29, N = 3SE +/- 0.19, N = 3SE +/- 0.23, N = 317.0416.8816.97

FFTE

N=256, 3D Complex FFT Routine

OpenBenchmarking.orgMFLOPS, More Is BetterFFTE 7.0N=256, 3D Complex FFT Routine23Linux 5.430K60K90K120K150KSE +/- 813.33, N = 3SE +/- 201.66, N = 3SE +/- 375.92, N = 3127987.82128693.18129902.321. (F9X) gfortran options: -O3 -fomit-frame-pointer -fopenmp

Timed HMMer Search

Pfam Database Search

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 3.3.1Pfam Database Search23Linux 5.44080120160200SE +/- 0.25, N = 3SE +/- 0.30, N = 3SE +/- 0.34, N = 3166.11165.75165.001. (CC) gcc options: -O3 -pthread -lhmmer -leasel -lm

Incompact3D

Input: Cylinder

OpenBenchmarking.orgSeconds, Fewer Is BetterIncompact3D 2020-09-17Input: Cylinder23Linux 5.44080120160200SE +/- 1.34, N = 3SE +/- 1.01, N = 3SE +/- 0.90, N = 3183.69184.30183.001. (F9X) gfortran options: -cpp -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi

Timed MAFFT Alignment

Multiple Sequence Alignment - LSU RNA

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 7.471Multiple Sequence Alignment - LSU RNA23Linux 5.43691215SE +/- 0.042, N = 3SE +/- 0.030, N = 3SE +/- 0.056, N = 39.0569.1359.0021. (CC) gcc options: -std=c99 -O3 -lm -lpthread

Monte Carlo Simulations of Ionised Nebulae

Input: Dust 2D tau100.0

OpenBenchmarking.orgSeconds, Fewer Is BetterMonte Carlo Simulations of Ionised Nebulae 2019-03-24Input: Dust 2D tau100.023Linux 5.450100150200250SE +/- 1.00, N = 3SE +/- 1.00, N = 3SE +/- 1.00, N = 32292302281. (F9X) gfortran options: -cpp -Jsource/ -ffree-line-length-0 -lm -std=legacy -O3 -O2 -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi

LAMMPS Molecular Dynamics Simulator

Model: 20k Atoms

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 24Aug2020Model: 20k Atoms23Linux 5.4612182430SE +/- 0.11, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 326.2926.1826.561. (CXX) g++ options: -O3 -pthread -lm

LAMMPS Molecular Dynamics Simulator

Model: Rhodopsin Protein

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 24Aug2020Model: Rhodopsin Protein23Linux 5.4612182430SE +/- 0.35, N = 3SE +/- 0.34, N = 15SE +/- 0.40, N = 323.3423.8923.681. (CXX) g++ options: -O3 -pthread -lm

WebP Image Encode

Encode Settings: Default

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Default23Linux 5.40.33820.67641.01461.35281.691SE +/- 0.001, N = 3SE +/- 0.001, N = 3SE +/- 0.003, N = 31.5011.4941.5031. (CC) gcc options: -fvisibility=hidden -O2 -pthread -lm -ljpeg -lpng16 -ltiff

WebP Image Encode

Encode Settings: Quality 100

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Quality 10023Linux 5.40.51861.03721.55582.07442.593SE +/- 0.002, N = 3SE +/- 0.002, N = 3SE +/- 0.007, N = 32.2982.3052.2941. (CC) gcc options: -fvisibility=hidden -O2 -pthread -lm -ljpeg -lpng16 -ltiff

WebP Image Encode

Encode Settings: Quality 100, Lossless

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Quality 100, Lossless23Linux 5.448121620SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 316.3116.3816.221. (CC) gcc options: -fvisibility=hidden -O2 -pthread -lm -ljpeg -lpng16 -ltiff

WebP Image Encode

Encode Settings: Quality 100, Highest Compression

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Quality 100, Highest Compression23Linux 5.4246810SE +/- 0.009, N = 3SE +/- 0.010, N = 3SE +/- 0.015, N = 37.1237.1727.1411. (CC) gcc options: -fvisibility=hidden -O2 -pthread -lm -ljpeg -lpng16 -ltiff

WebP Image Encode

Encode Settings: Quality 100, Lossless, Highest Compression

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Quality 100, Lossless, Highest Compression23Linux 5.4816243240SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 333.7734.1333.531. (CC) gcc options: -fvisibility=hidden -O2 -pthread -lm -ljpeg -lpng16 -ltiff

BYTE Unix Benchmark

Computational Test: Dhrystone 2

OpenBenchmarking.orgLPS, More Is BetterBYTE Unix Benchmark 3.6Computational Test: Dhrystone 223Linux 5.49M18M27M36M45MSE +/- 631231.56, N = 3SE +/- 365672.33, N = 3SE +/- 97131.78, N = 343503603.144247620.142607098.5

LibRaw

Post-Processing Benchmark

OpenBenchmarking.orgMpix/sec, More Is BetterLibRaw 0.20Post-Processing Benchmark23Linux 5.41020304050SE +/- 0.28, N = 3SE +/- 0.08, N = 3SE +/- 0.26, N = 341.5541.4041.871. (CXX) g++ options: -O2 -fopenmp -ljpeg -lz -lm

AOM AV1

Encoder Mode: Speed 0 Two-Pass

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 2.0Encoder Mode: Speed 0 Two-Pass23Linux 5.40.07430.14860.22290.29720.3715SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.330.330.331. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

AOM AV1

Encoder Mode: Speed 4 Two-Pass

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 2.0Encoder Mode: Speed 4 Two-Pass23Linux 5.40.56931.13861.70792.27722.8465SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 32.512.532.531. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

AOM AV1

Encoder Mode: Speed 6 Realtime

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 2.0Encoder Mode: Speed 6 Realtime23Linux 5.448121620SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 318.1217.8618.091. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

AOM AV1

Encoder Mode: Speed 6 Two-Pass

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 2.0Encoder Mode: Speed 6 Two-Pass23Linux 5.40.87981.75962.63943.51924.399SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.903.913.901. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

AOM AV1

Encoder Mode: Speed 8 Realtime

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 2.0Encoder Mode: Speed 8 Realtime23Linux 5.4816243240SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 334.4934.6934.831. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

Timed LLVM Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 10.0Time To Compile23Linux 5.44080120160200SE +/- 0.91, N = 3SE +/- 0.41, N = 3SE +/- 1.18, N = 3203.64203.35203.22

eSpeak-NG Speech Engine

Text-To-Speech Synthesis

OpenBenchmarking.orgSeconds, Fewer Is BettereSpeak-NG Speech Engine 20200907Text-To-Speech Synthesis23Linux 5.4714212835SE +/- 0.05, N = 4SE +/- 0.07, N = 4SE +/- 0.17, N = 428.4628.7528.581. (CC) gcc options: -O2 -std=c99

RNNoise

OpenBenchmarking.orgSeconds, Fewer Is BetterRNNoise 2020-06-2823Linux 5.4510152025SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 318.7718.7418.641. (CC) gcc options: -O2 -pedantic -fvisibility=hidden

System GZIP Decompression

OpenBenchmarking.orgSeconds, Fewer Is BetterSystem GZIP Decompression23Linux 5.40.64441.28881.93322.57763.222SE +/- 0.002, N = 3SE +/- 0.001, N = 3SE +/- 0.018, N = 32.8492.8562.864

MPV

Video Input: Big Buck Bunny Sunflower 4K - Decode: Software Only

OpenBenchmarking.orgFPS, More Is BetterMPVVideo Input: Big Buck Bunny Sunflower 4K - Decode: Software Only23Linux 5.42004006008001000SE +/- 1.81, N = 3SE +/- 1.72, N = 3SE +/- 5.25, N = 31037.841050.731046.24MIN: 545.46 / MAX: 2000.02MIN: 545.45 / MAX: 2000.04MIN: 545.46 / MAX: 2000.041. mpv 0.32.0

MPV

Video Input: Big Buck Bunny Sunflower 1080p - Decode: Software Only

OpenBenchmarking.orgFPS, More Is BetterMPVVideo Input: Big Buck Bunny Sunflower 1080p - Decode: Software Only23Linux 5.46001200180024003000SE +/- 18.75, N = 3SE +/- 3.63, N = 3SE +/- 13.10, N = 32563.282568.832574.81MIN: 1200.01 / MAX: 6000.24MIN: 1333.32 / MAX: 6000.24MIN: 1200 / MAX: 6000.241. mpv 0.32.0

Apache CouchDB

Bulk Size: 100 - Inserts: 1000 - Rounds: 24

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.1.1Bulk Size: 100 - Inserts: 1000 - Rounds: 2423Linux 5.4306090120150SE +/- 0.48, N = 3SE +/- 1.12, N = 3SE +/- 1.01, N = 3118.57117.93118.091. (CXX) g++ options: -std=c++14 -lmozjs-68 -lm -lerl_interface -lei -fPIC -MMD

KeyDB

OpenBenchmarking.orgOps/sec, More Is BetterKeyDB 6.0.1623Linux 5.4100K200K300K400K500KSE +/- 3068.12, N = 3SE +/- 5879.33, N = 3SE +/- 7622.83, N = 3440299.41447704.19450800.421. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

GROMACS

Water Benchmark

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2020.3Water Benchmark23Linux 5.40.84621.69242.53863.38484.231SE +/- 0.005, N = 3SE +/- 0.006, N = 3SE +/- 0.005, N = 33.7543.7533.7611. (CXX) g++ options: -O3 -pthread -lrt -lpthread -lm

Caffe

Model: AlexNet - Acceleration: CPU - Iterations: 100

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: AlexNet - Acceleration: CPU - Iterations: 10023Linux 5.412K24K36K48K60KSE +/- 135.75, N = 3SE +/- 239.93, N = 3SE +/- 541.26, N = 35611856032546291. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

Caffe

Model: AlexNet - Acceleration: CPU - Iterations: 200

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: AlexNet - Acceleration: CPU - Iterations: 20023Linux 5.420K40K60K80K100KSE +/- 157.09, N = 3SE +/- 122.83, N = 3SE +/- 186.59, N = 31123601120111117611. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

Caffe

Model: GoogleNet - Acceleration: CPU - Iterations: 100

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: GoogleNet - Acceleration: CPU - Iterations: 10023Linux 5.430K60K90K120K150KSE +/- 53.58, N = 3SE +/- 476.07, N = 3SE +/- 388.21, N = 31507091505221502161. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

Caffe

Model: GoogleNet - Acceleration: CPU - Iterations: 200

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: GoogleNet - Acceleration: CPU - Iterations: 20023Linux 5.460K120K180K240K300KSE +/- 1840.25, N = 3SE +/- 72.13, N = 3SE +/- 143.11, N = 33017813030723019541. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

GPAW

Input: Carbon Nanotube

OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 20.1Input: Carbon Nanotube23Linux 5.420406080100SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.21, N = 3110.65110.58110.691. (CC) gcc options: -pthread -shared -fwrapv -O2 -lxc -lblas -lmpi

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: SqueezeNetV1.023Linux 5.4246810SE +/- 0.181, N = 15SE +/- 0.250, N = 12SE +/- 0.112, N = 138.5198.6648.451MIN: 7.66 / MAX: 11.88MIN: 7.6 / MAX: 12MIN: 7.67 / MAX: 10.491. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: resnet-v2-5023Linux 5.4816243240SE +/- 0.17, N = 15SE +/- 0.17, N = 12SE +/- 0.21, N = 1332.6332.2932.80MIN: 30.5 / MAX: 35.76MIN: 30.04 / MAX: 35.43MIN: 30.14 / MAX: 35.821. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: MobileNetV2_22423Linux 5.41.22962.45923.68884.91846.148SE +/- 0.012, N = 15SE +/- 0.022, N = 12SE +/- 0.029, N = 135.4425.4225.465MIN: 5.16 / MAX: 6.35MIN: 5.18 / MAX: 6.03MIN: 5.19 / MAX: 6.361. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: mobilenet-v1-1.023Linux 5.41.23662.47323.70984.94646.183SE +/- 0.022, N = 14SE +/- 0.021, N = 12SE +/- 0.019, N = 135.4805.4805.496MIN: 5.07 / MAX: 6.39MIN: 5.04 / MAX: 6.09MIN: 5.09 / MAX: 6.11. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: inception-v323Linux 5.4714212835SE +/- 0.20, N = 15SE +/- 0.09, N = 12SE +/- 0.16, N = 1331.7231.6131.88MIN: 30 / MAX: 33.75MIN: 30.43 / MAX: 33.67MIN: 30.07 / MAX: 33.311. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

Target: CPU - Model: squeezenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenet23Linux 5.4612182430SE +/- 0.24, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 325.3525.6325.07MIN: 23.99 / MAX: 29.99MIN: 24.27 / MAX: 29.59MIN: 23.9 / MAX: 29.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenet23Linux 5.4714212835SE +/- 0.37, N = 3SE +/- 0.19, N = 3SE +/- 0.43, N = 327.4828.2127.40MIN: 25.29 / MAX: 35.51MIN: 26.7 / MAX: 32.72MIN: 25.76 / MAX: 32.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v223Linux 5.43691215SE +/- 0.23, N = 3SE +/- 0.20, N = 3SE +/- 0.31, N = 313.4713.3913.12MIN: 12.3 / MAX: 18.22MIN: 12.33 / MAX: 32.12MIN: 12.2 / MAX: 15.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v323Linux 5.448121620SE +/- 0.23, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 314.3413.8512.96MIN: 12.98 / MAX: 26.26MIN: 13.09 / MAX: 19.5MIN: 12.63 / MAX: 14.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v223Linux 5.448121620SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 314.3414.1213.11MIN: 13.13 / MAX: 18.68MIN: 13.32 / MAX: 23.18MIN: 12.73 / MAX: 15.231. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnet23Linux 5.448121620SE +/- 1.28, N = 3SE +/- 0.05, N = 3SE +/- 0.19, N = 314.5812.9312.37MIN: 12.24 / MAX: 23.88MIN: 12.34 / MAX: 19.09MIN: 12.06 / MAX: 14.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b023Linux 5.448121620SE +/- 0.25, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 318.2117.3116.49MIN: 16.67 / MAX: 23.54MIN: 16.65 / MAX: 19.75MIN: 16.29 / MAX: 24.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazeface23Linux 5.4246810SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 36.105.885.51MIN: 5.59 / MAX: 16.3MIN: 5.66 / MAX: 6.32MIN: 5.29 / MAX: 9.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenet23Linux 5.4612182430SE +/- 0.42, N = 3SE +/- 0.20, N = 3SE +/- 0.27, N = 326.9426.3125.59MIN: 25.48 / MAX: 29.13MIN: 25.44 / MAX: 33.58MIN: 24.94 / MAX: 42.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg1623Linux 5.41224364860SE +/- 1.04, N = 3SE +/- 0.64, N = 3SE +/- 0.56, N = 352.1452.1252.69MIN: 48.42 / MAX: 60.84MIN: 49.36 / MAX: 63.52MIN: 50.22 / MAX: 58.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet1823Linux 5.4510152025SE +/- 0.34, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 318.2318.4718.63MIN: 17.31 / MAX: 23.72MIN: 17.93 / MAX: 19.6MIN: 17.97 / MAX: 24.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnet23Linux 5.43691215SE +/- 0.09, N = 3SE +/- 0.19, N = 3SE +/- 0.27, N = 311.7512.1712.16MIN: 11.17 / MAX: 23.47MIN: 11.23 / MAX: 17.3MIN: 11.37 / MAX: 14.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet5023Linux 5.4918273645SE +/- 0.52, N = 3SE +/- 0.64, N = 3SE +/- 0.49, N = 336.3937.3436.78MIN: 34.7 / MAX: 41.24MIN: 35.19 / MAX: 51.27MIN: 34.95 / MAX: 41.541. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tiny23Linux 5.4816243240SE +/- 0.37, N = 3SE +/- 0.35, N = 3SE +/- 0.03, N = 335.0535.6636.40MIN: 34.11 / MAX: 40.67MIN: 34.66 / MAX: 38.72MIN: 35.85 / MAX: 41.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: squeezenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: squeezenet23Linux 5.41.29152.5833.87455.1666.4575SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 35.705.745.69MIN: 5.48 / MAX: 9.78MIN: 5.49 / MAX: 11.91MIN: 5.51 / MAX: 6.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mobilenet23Linux 5.43691215SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.09, N = 39.539.719.68MIN: 8.35 / MAX: 36.02MIN: 8.39 / MAX: 40.44MIN: 8.37 / MAX: 29.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v2-v2 - Model: mobilenet-v223Linux 5.41.02152.0433.06454.0865.1075SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 34.534.534.54MIN: 4.25 / MAX: 5.75MIN: 4.23 / MAX: 5.62MIN: 4.26 / MAX: 7.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v3-v3 - Model: mobilenet-v323Linux 5.4246810SE +/- 0.20, N = 3SE +/- 0.19, N = 3SE +/- 0.01, N = 38.718.718.72MIN: 7.4 / MAX: 31.92MIN: 7.43 / MAX: 30.58MIN: 7.38 / MAX: 31.161. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: shufflenet-v223Linux 5.40.79881.59762.39643.19523.994SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.553.433.43MIN: 3.33 / MAX: 22.77MIN: 3.34 / MAX: 3.77MIN: 3.35 / MAX: 3.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mnasnet23Linux 5.41.03732.07463.11194.14925.1865SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 34.604.614.61MIN: 4.35 / MAX: 4.94MIN: 4.35 / MAX: 5.07MIN: 4.36 / MAX: 4.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: efficientnet-b023Linux 5.43691215SE +/- 0.03, N = 3SE +/- 0.21, N = 3SE +/- 0.22, N = 311.4611.5011.53MIN: 10.41 / MAX: 42.66MIN: 10.38 / MAX: 33.2MIN: 10.48 / MAX: 36.81. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: blazeface23Linux 5.40.24530.49060.73590.98121.2265SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 31.061.081.09MIN: 1.01 / MAX: 1.56MIN: 1.01 / MAX: 1.45MIN: 1.01 / MAX: 1.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: googlenet23Linux 5.4246810SE +/- 0.15, N = 3SE +/- 0.05, N = 3SE +/- 0.21, N = 38.508.468.45MIN: 7.1 / MAX: 29.7MIN: 7.12 / MAX: 27.97MIN: 7.12 / MAX: 32.391. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: vgg1623Linux 5.420406080100SE +/- 0.14, N = 3SE +/- 0.10, N = 3SE +/- 0.45, N = 384.1283.4783.73MIN: 66.71 / MAX: 108.36MIN: 66.56 / MAX: 110.05MIN: 66.8 / MAX: 112.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet1823Linux 5.40.74481.48962.23442.97923.724SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 33.313.303.30MIN: 3.22 / MAX: 5.09MIN: 3.22 / MAX: 4.97MIN: 3.23 / MAX: 6.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: alexnet23Linux 5.4714212835SE +/- 0.72, N = 3SE +/- 0.32, N = 3SE +/- 0.57, N = 330.2730.0230.49MIN: 25.44 / MAX: 55.96MIN: 25.34 / MAX: 56.39MIN: 25.2 / MAX: 56.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet5023Linux 5.43691215SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.34, N = 39.829.589.92MIN: 9 / MAX: 31.97MIN: 8.97 / MAX: 23.04MIN: 9.02 / MAX: 30.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: yolov4-tiny23Linux 5.448121620SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 314.3714.3914.46MIN: 12.27 / MAX: 32.22MIN: 12.33 / MAX: 39.9MIN: 12.36 / MAX: 40.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

TNN

Target: CPU - Model: MobileNet v2

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: MobileNet v223Linux 5.460120180240300SE +/- 0.64, N = 3SE +/- 2.03, N = 3SE +/- 3.67, N = 3268.81268.09270.10MIN: 262.12 / MAX: 297.98MIN: 261.24 / MAX: 297.96MIN: 262.09 / MAX: 307.371. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl

TNN

Target: CPU - Model: SqueezeNet v1.1

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: SqueezeNet v1.123Linux 5.450100150200250SE +/- 0.37, N = 3SE +/- 0.33, N = 3SE +/- 0.60, N = 3244.17246.78245.84MIN: 241.07 / MAX: 245.76MIN: 243.93 / MAX: 255.19MIN: 244.15 / MAX: 249.181. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl

OpenVINO

Model: Face Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU23Linux 5.43691215SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 39.649.659.651. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Face Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU23Linux 5.47001400210028003500SE +/- 21.19, N = 3SE +/- 16.95, N = 3SE +/- 7.33, N = 33286.543284.113294.431. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Face Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU23Linux 5.43691215SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 39.569.609.581. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Face Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU23Linux 5.47001400210028003500SE +/- 23.91, N = 3SE +/- 7.03, N = 3SE +/- 15.60, N = 33316.903307.263293.711. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Person Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU23Linux 5.4246810SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 36.646.606.681. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Person Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU23Linux 5.410002000300040005000SE +/- 16.66, N = 3SE +/- 29.15, N = 3SE +/- 34.97, N = 34683.324721.764662.581. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Person Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU23Linux 5.4246810SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 36.526.516.501. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Person Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU23Linux 5.410002000300040005000SE +/- 26.72, N = 3SE +/- 16.09, N = 3SE +/- 11.05, N = 34752.264782.634799.771. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU23Linux 5.47K14K21K28K35KSE +/- 207.95, N = 3SE +/- 175.53, N = 3SE +/- 76.15, N = 333277.8433230.5033390.811. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU23Linux 5.40.20930.41860.62790.83721.0465SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 30.930.930.931. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU23Linux 5.47K14K21K28K35KSE +/- 275.04, N = 3SE +/- 193.36, N = 3SE +/- 147.89, N = 332931.7732913.0033014.261. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU23Linux 5.40.21150.4230.63450.8461.0575SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 30.940.940.941. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

Hierarchical INTegration

Test: FLOAT

OpenBenchmarking.orgQUIPs, More Is BetterHierarchical INTegration 1.0Test: FLOAT23Linux 5.480M160M240M320M400MSE +/- 1833857.81, N = 3SE +/- 1447224.32, N = 3SE +/- 918474.47, N = 3375641035.45374097932.78376705975.841. (CC) gcc options: -O3 -march=native -lm

Mlpack Benchmark

Benchmark: scikit_ica

OpenBenchmarking.orgSeconds, Fewer Is BetterMlpack BenchmarkBenchmark: scikit_ica23Linux 5.41224364860SE +/- 0.45, N = 3SE +/- 0.21, N = 3SE +/- 0.17, N = 351.9252.3951.50

Mlpack Benchmark

Benchmark: scikit_qda

OpenBenchmarking.orgSeconds, Fewer Is BetterMlpack BenchmarkBenchmark: scikit_qda23Linux 5.41020304050SE +/- 0.36, N = 3SE +/- 0.14, N = 3SE +/- 0.29, N = 342.4342.7942.09

Mlpack Benchmark

Benchmark: scikit_svm

OpenBenchmarking.orgSeconds, Fewer Is BetterMlpack BenchmarkBenchmark: scikit_svm23Linux 5.4510152025SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 320.9120.9120.90

Mlpack Benchmark

Benchmark: scikit_linearridgeregression

OpenBenchmarking.orgSeconds, Fewer Is BetterMlpack BenchmarkBenchmark: scikit_linearridgeregression23Linux 5.40.37130.74261.11391.48521.8565SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 31.621.651.61

Kripke

OpenBenchmarking.orgThroughput FoM, More Is BetterKripke 1.2.423Linux 5.410M20M30M40M50MSE +/- 81815.46, N = 3SE +/- 132345.53, N = 3SE +/- 151580.08, N = 34487372344476553449300631. (CXX) g++ options: -O3 -fopenmp

InfluxDB

Concurrent Streams: 4 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000

OpenBenchmarking.orgval/sec, More Is BetterInfluxDB 1.8.2Concurrent Streams: 4 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 1000023Linux 5.4200K400K600K800K1000KSE +/- 2893.07, N = 3SE +/- 1149.41, N = 3SE +/- 2154.85, N = 31146038.51144571.81148311.0

InfluxDB

Concurrent Streams: 64 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000

OpenBenchmarking.orgval/sec, More Is BetterInfluxDB 1.8.2Concurrent Streams: 64 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 1000023Linux 5.4300K600K900K1200K1500KSE +/- 2189.38, N = 3SE +/- 2142.12, N = 3SE +/- 898.05, N = 31501667.11495506.91498935.7

InfluxDB

Concurrent Streams: 1024 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000

OpenBenchmarking.orgval/sec, More Is BetterInfluxDB 1.8.2Concurrent Streams: 1024 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 1000023Linux 5.4300K600K900K1200K1500KSE +/- 3242.42, N = 3SE +/- 5690.48, N = 3SE +/- 2382.01, N = 31539068.11534264.51547196.9


Phoronix Test Suite v10.8.4