1235 August

Intel Xeon E3-1235L v5 testing with a ASRockRack C236M WS (P2.60 BIOS) and Intel HD 530 SKL GT2 3GB on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2109015-TJ-1235AUGUS52
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

C/C++ Compiler Tests 5 Tests
CPU Massive 7 Tests
Creator Workloads 6 Tests
Database Test Suite 3 Tests
Go Language Tests 2 Tests
HPC - High Performance Computing 6 Tests
Java Tests 2 Tests
Common Kernel Benchmarks 2 Tests
Machine Learning 6 Tests
Multi-Core 7 Tests
NVIDIA GPU Compute 2 Tests
Programmer / Developer System Benchmarks 2 Tests
Python Tests 3 Tests
Raytracing 2 Tests
Renderers 3 Tests
Server 5 Tests
Server CPU Tests 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
1
August 31 2021
  4 Hours, 45 Minutes
2
August 31 2021
  14 Hours, 38 Minutes
3
September 01 2021
  4 Hours, 37 Minutes
Invert Hiding All Results Option
  8 Hours

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


1235 AugustProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLOpenCLCompilerFile-SystemScreen Resolution123Intel Xeon E3-1235L v5 @ 3.00GHz (4 Cores)ASRockRack C236M WS (P2.60 BIOS)Intel Xeon E3-1200 v5/E3-15008GBSamsung SSD 960 EVO 500GBIntel HD 530 SKL GT2 3GB (1000MHz)Realtek ALC1150DELL S2409WIntel I219-LM + Intel I210Ubuntu 20.045.8.0-050800-generic (x86_64)GNOME Shell 3.36.4X Server 1.20.94.6 Mesa 20.0.8OpenCL 2.1GCC 9.3.0ext41920x1080OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0xe2 - Thermald 1.9.1 Java Details- OpenJDK Runtime Environment (build 11.0.11+9-Ubuntu-0ubuntu2.20.04) Python Details- Python 3.8.10Security Details- itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT disabled + mds: Mitigation of Clear buffers; SMT disabled + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Mitigation of Microcode + tsx_async_abort: Mitigation of Clear buffers; SMT disabled

123Result OverviewPhoronix Test Suite100%104%108%113%117%NatronApache CassandraApache HTTP ServerKeyDBLeelaChessZeroFacebook RocksDBnginxONNX RuntimeYafaRayTachyonTimed Linux Kernel CompilationECP-CANDLETNNC-BloscGoogle SynthMarkMobile Neural NetworkNCNNdav1dRenaissanceOpenVKL

1235 Augustblosc: blosclzlczero: BLASlczero: Eigenrenaissance: Scala Dottyrenaissance: Rand Forestrenaissance: ALS Movie Lensrenaissance: Apache Spark ALSrenaissance: Apache Spark Bayesrenaissance: Savina Reactors.IOrenaissance: Apache Spark PageRankrenaissance: Finagle HTTP Requestsrenaissance: In-Memory Database Shootoutrenaissance: Akka Unbalanced Cobwebbed Treerenaissance: Genetic Algorithm Using Jenetics + Futuresdav1d: Chimera 1080pdav1d: Summer Nature 4Kdav1d: Summer Nature 1080pdav1d: Chimera 1080p 10-bitopenvkl: vklBenchmark ISPCopenvkl: vklBenchmark Scalarbuild-linux-kernel: Time To Compileyafaray: Total Time For Sample Scenetachyon: Total Timesynthmark: VoiceMark_100keydb: mnn: mobilenetV3mnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3ncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400mtnn: CPU - DenseNettnn: CPU - MobileNet v2tnn: CPU - SqueezeNet v2tnn: CPU - SqueezeNet v1.1cassandra: Readscassandra: Writesrocksdb: Rand Fillrocksdb: Rand Readrocksdb: Update Randrocksdb: Seq Fillrocksdb: Rand Fill Syncrocksdb: Read While Writingrocksdb: Read Rand Write Randonnx: yolov4 - OpenMP CPUonnx: bertsquad-10 - OpenMP CPUonnx: fcn-resnet101-11 - OpenMP CPUonnx: shufflenet-v2-10 - OpenMP CPUonnx: super-resolution-10 - OpenMP CPUecp-candle: P1B2ecp-candle: P3B1nginx: 1nginx: 20nginx: 100nginx: 200nginx: 500nginx: 1000natron: Spaceshipapache: 1apache: 20apache: 100apache: 200apache: 500apache: 10001236287.96436401352.61056.710201.55870.211511.110189.65505.02377.56033.213509.72172.6202.8255.12186.42155.53198358.278584.82364.804476.065179531.952.2694.22937.4187.3424.435.36846.9329.137.66.76.446.8811.362.2525.78104.6527.732550.3143.1651.2513.1143.7714.4716.0515.6614.9829.863.9340.7235.3935.9456.2586.7282.3650.6120.146183.162496.403107.464454.0721875819663439581139811892019185066815473934765254271873093217923194360.5571657.78722746.82124882.11133909.56132682.49127552.53122989.690.77440.7222612.6924449.3824876.8423942.323814.566273.66226101448.11059.810297.55846.511727.410182.95360.32337.16033.913523.52095.6202.3555.14186.43156.3198355.859581.264367.7519474.401191065.122.2694.25137.4717.3944.4285.37947.26429.077.626.716.446.8811.382.2525.76104.6627.7025.0350.2743.2751.2713.1344.4014.5016.1515.6514.9729.843.9740.68236.1935.9355.9086.7182.4850.5120.126173.766497.956108.251454.2521569119292439091147926441991395034016273964555268951873083117936190960.3691670.69421466.59124343.65133819.74132190.40127281.67123050.660.65750.3322638.2424511.4924960.1622932.2723836.026260.26456201508.01048.810178.95772.811602.610254.95234.72423.66090.313608.82065.4203.3755.25186.49155.93198357.886576.569366.029475.062185304.32.2684.22937.3387.3464.415.37447.24729.077.626.736.436.8711.322.2525.74104.3427.752550.2543.0751.2713.1144.7214.4616.0515.6615.0129.863.6840.72235.9135.9756.6386.7582.4750.5220.156179.896497.843107.455453.9461830719328440074149513452010865025285953748854994651873083218052194859.6151671.69720993.79124553.85133952.1132707.63127285.86123254.580.67886.8622869.9224800.425294.223893.7223950.8OpenBenchmarking.org

C-Blosc

A simple, compressed, fast and persistent data store library for C. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.0Compressor: blosclz12313002600390052006500SE +/- 14.79, N = 36287.96273.66260.21. (CC) gcc options: -std=gnu99 -O3 -pthread -lrt -lm
OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.0Compressor: blosclz12311002200330044005500Min: 6245.2 / Avg: 6273.63 / Max: 6294.91. (CC) gcc options: -std=gnu99 -O3 -pthread -lrt -lm

LeelaChessZero

LeelaChessZero (lc0 / lczero) is a chess engine automated vian neural networks. This test profile can be used for OpenCL, CUDA + cuDNN, and BLAS (CPU-based) benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: BLAS123140280420560700SE +/- 10.27, N = 36436226451. (CXX) g++ options: -flto -pthread
OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: BLAS123110220330440550Min: 602 / Avg: 622.33 / Max: 6351. (CXX) g++ options: -flto -pthread

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: Eigen123140280420560700SE +/- 5.78, N = 36406106201. (CXX) g++ options: -flto -pthread
OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: Eigen123110220330440550Min: 602 / Avg: 609.67 / Max: 6211. (CXX) g++ options: -flto -pthread

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Scala Dotty12330060090012001500SE +/- 21.83, N = 151352.61448.11508.0MIN: 1013.48 / MAX: 2514.71MIN: 1018.15 / MAX: 2489.84MIN: 1010.94 / MAX: 2407.46
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Scala Dotty12330060090012001500Min: 1358.63 / Avg: 1448.14 / Max: 1546.83

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Random Forest1232004006008001000SE +/- 5.51, N = 31056.71059.81048.8MIN: 949.78 / MAX: 1498.84MIN: 933.75 / MAX: 1621.87MIN: 940.38 / MAX: 1449.98
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Random Forest1232004006008001000Min: 1054.04 / Avg: 1059.81 / Max: 1070.83

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: ALS Movie Lens1232K4K6K8K10KSE +/- 5.60, N = 310201.510297.510178.9MIN: 9961.74 / MAX: 12627.28MIN: 9974.35 / MAX: 12628.68MIN: 9897.74 / MAX: 12557.93
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: ALS Movie Lens1232K4K6K8K10KMin: 10287.55 / Avg: 10297.53 / Max: 10306.91

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Apache Spark ALS12313002600390052006500SE +/- 33.42, N = 35870.25846.55772.8MIN: 5042.86 / MAX: 6534.47MIN: 5142.19 / MAX: 6588.88MIN: 5196.81 / MAX: 6307.6
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Apache Spark ALS12310002000300040005000Min: 5784.11 / Avg: 5846.53 / Max: 5898.45

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Apache Spark Bayes1233K6K9K12K15KSE +/- 117.98, N = 311511.111727.411602.6MIN: 9440.7MIN: 9496.75 / MAX: 11951.24MIN: 9499.1
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Apache Spark Bayes1232K4K6K8K10KMin: 11550.89 / Avg: 11727.37 / Max: 11951.24

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Savina Reactors.IO1232K4K6K8K10KSE +/- 90.03, N = 310189.610182.910254.9MIN: 10189.59 / MAX: 13435.56MIN: 10075.11 / MAX: 13912.18MIN: 10254.88 / MAX: 13564.19
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Savina Reactors.IO1232K4K6K8K10KMin: 10075.11 / Avg: 10182.94 / Max: 10361.75

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Apache Spark PageRank12312002400360048006000SE +/- 57.80, N = 125505.05360.35234.7MIN: 5139.48 / MAX: 5640.64MIN: 4753.42 / MAX: 5967.1MIN: 4830.49 / MAX: 5380.85
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Apache Spark PageRank12310002000300040005000Min: 5144.51 / Avg: 5360.35 / Max: 5895.51

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Finagle HTTP Requests1235001000150020002500SE +/- 24.69, N = 32377.52337.12423.6MIN: 2093.81 / MAX: 2551.44MIN: 2001.99 / MAX: 2576.15MIN: 2145.98 / MAX: 2579.04
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Finagle HTTP Requests123400800120016002000Min: 2301.98 / Avg: 2337.11 / Max: 2384.74

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: In-Memory Database Shootout12313002600390052006500SE +/- 76.48, N = 56033.26033.96090.3MIN: 5594.96 / MAX: 7637.26MIN: 5405.69 / MAX: 7266.7MIN: 5633.39 / MAX: 7231.93
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: In-Memory Database Shootout12311002200330044005500Min: 5794.14 / Avg: 6033.9 / Max: 6216.32

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Akka Unbalanced Cobwebbed Tree1233K6K9K12K15KSE +/- 56.74, N = 313509.713523.513608.8MIN: 10404.26MIN: 10356.41 / MAX: 13603.14MIN: 10392.91
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Akka Unbalanced Cobwebbed Tree1232K4K6K8K10KMin: 13413.7 / Avg: 13523.54 / Max: 13603.14

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Genetic Algorithm Using Jenetics + Futures1235001000150020002500SE +/- 22.63, N = 32172.62095.62065.4MIN: 2117.62 / MAX: 2244.47MIN: 2020.2 / MAX: 2215.14MIN: 2012.29 / MAX: 2118.64
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.12Test: Genetic Algorithm Using Jenetics + Futures123400800120016002000Min: 2067.16 / Avg: 2095.62 / Max: 2140.33

dav1d

OpenBenchmarking.orgFPS, More Is Betterdav1d 0.9.1Video Input: Chimera 1080p1234080120160200SE +/- 0.22, N = 3202.82202.35203.37MIN: 146.27 / MAX: 335.36MIN: 144.88 / MAX: 353.81MIN: 146.24 / MAX: 339.61. (CC) gcc options: -pthread
OpenBenchmarking.orgFPS, More Is Betterdav1d 0.9.1Video Input: Chimera 1080p1234080120160200Min: 202.11 / Avg: 202.35 / Max: 202.791. (CC) gcc options: -pthread

OpenBenchmarking.orgFPS, More Is Betterdav1d 0.9.1Video Input: Summer Nature 4K1231224364860SE +/- 0.12, N = 355.1255.1455.25MIN: 51.16 / MAX: 63.4MIN: 50.95 / MAX: 64.26MIN: 51.19 / MAX: 64.211. (CC) gcc options: -pthread
OpenBenchmarking.orgFPS, More Is Betterdav1d 0.9.1Video Input: Summer Nature 4K1231122334455Min: 54.9 / Avg: 55.14 / Max: 55.281. (CC) gcc options: -pthread

OpenBenchmarking.orgFPS, More Is Betterdav1d 0.9.1Video Input: Summer Nature 1080p1234080120160200SE +/- 0.19, N = 3186.42186.43186.49MIN: 172.88 / MAX: 205.17MIN: 172.96 / MAX: 205.95MIN: 173.5 / MAX: 205.261. (CC) gcc options: -pthread
OpenBenchmarking.orgFPS, More Is Betterdav1d 0.9.1Video Input: Summer Nature 1080p123306090120150Min: 186.06 / Avg: 186.43 / Max: 186.721. (CC) gcc options: -pthread

OpenBenchmarking.orgFPS, More Is Betterdav1d 0.9.1Video Input: Chimera 1080p 10-bit123306090120150SE +/- 0.55, N = 3155.53156.30155.93MIN: 117.37 / MAX: 273.08MIN: 117.27 / MAX: 278.75MIN: 117.84 / MAX: 269.091. (CC) gcc options: -pthread
OpenBenchmarking.orgFPS, More Is Betterdav1d 0.9.1Video Input: Chimera 1080p 10-bit123306090120150Min: 155.2 / Avg: 156.3 / Max: 156.91. (CC) gcc options: -pthread

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.0Benchmark: vklBenchmark ISPC123510152025191919MIN: 2 / MAX: 198MIN: 2 / MAX: 198MIN: 2 / MAX: 198

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.0Benchmark: vklBenchmark Scalar123246810888MIN: 1 / MAX: 136MIN: 1 / MAX: 136MIN: 1 / MAX: 136

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 5.14Time To Compile12380160240320400SE +/- 0.88, N = 3358.28355.86357.89
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 5.14Time To Compile12360120180240300Min: 354.88 / Avg: 355.86 / Max: 357.61

YafaRay

YafaRay is an open-source physically based montecarlo ray-tracing engine. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterYafaRay 3.5.1Total Time For Sample Scene123130260390520650SE +/- 0.87, N = 3584.82581.26576.571. (CXX) g++ options: -std=c++11 -pthread -O3 -ffast-math -rdynamic -ldl -lImath -lIlmImf -lIex -lHalf -lz -lIlmThread -lxml2 -lfreetype
OpenBenchmarking.orgSeconds, Fewer Is BetterYafaRay 3.5.1Total Time For Sample Scene123100200300400500Min: 580.21 / Avg: 581.26 / Max: 5831. (CXX) g++ options: -std=c++11 -pthread -O3 -ffast-math -rdynamic -ldl -lImath -lIlmImf -lIex -lHalf -lz -lIlmThread -lxml2 -lfreetype

Tachyon

This is a test of the threaded Tachyon, a parallel ray-tracing system, measuring the time to ray-trace a sample scene. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTachyon 0.99b6Total Time12380160240320400SE +/- 1.52, N = 3364.80367.75366.031. (CC) gcc options: -m64 -O3 -fomit-frame-pointer -ffast-math -ltachyon -lm -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterTachyon 0.99b6Total Time12370140210280350Min: 365.93 / Avg: 367.75 / Max: 370.761. (CC) gcc options: -m64 -O3 -fomit-frame-pointer -ffast-math -ltachyon -lm -lpthread

Google SynthMark

SynthMark is a cross platform tool for benchmarking CPU performance under a variety of real-time audio workloads. It uses a polyphonic synthesizer model to provide standardized tests for latency, jitter and computational throughput. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVoices, More Is BetterGoogle SynthMark 20201109Test: VoiceMark_100123100200300400500SE +/- 0.33, N = 3476.07474.40475.061. (CXX) g++ options: -lm -lpthread -std=c++11 -Ofast
OpenBenchmarking.orgVoices, More Is BetterGoogle SynthMark 20201109Test: VoiceMark_10012380160240320400Min: 474.07 / Avg: 474.4 / Max: 475.071. (CXX) g++ options: -lm -lpthread -std=c++11 -Ofast

KeyDB

A benchmark of KeyDB as a multi-threaded fork of the Redis server. The KeyDB benchmark is conducted using memtier-benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterKeyDB 6.2.012340K80K120K160K200KSE +/- 1716.79, N = 10179531.95191065.12185304.301. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterKeyDB 6.2.012330K60K90K120K150KMin: 177703.14 / Avg: 191065.12 / Max: 199275.331. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Mobile Neural Network

MNN is the Mobile Neural Network as a highly efficient, lightweight deep learning framework developed by Alibaba. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenetV31230.51051.0211.53152.0422.5525SE +/- 0.003, N = 32.2692.2692.268MIN: 2.25 / MAX: 4.31MIN: 2.24 / MAX: 2.56MIN: 2.25 / MAX: 2.431. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenetV3123246810Min: 2.26 / Avg: 2.27 / Max: 2.281. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: squeezenetv1.11230.95651.9132.86953.8264.7825SE +/- 0.003, N = 34.2294.2514.229MIN: 4.18 / MAX: 4.39MIN: 4.19 / MAX: 6.2MIN: 4.17 / MAX: 4.41. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: squeezenetv1.1123246810Min: 4.25 / Avg: 4.25 / Max: 4.261. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: resnet-v2-50123918273645SE +/- 0.01, N = 337.4237.4737.34MIN: 37.31 / MAX: 49.27MIN: 37.36 / MAX: 49.47MIN: 37.24 / MAX: 48.731. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: resnet-v2-50123816243240Min: 37.46 / Avg: 37.47 / Max: 37.481. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: SqueezeNetV1.0123246810SE +/- 0.014, N = 37.3427.3947.346MIN: 7.29 / MAX: 7.6MIN: 7.32 / MAX: 19.66MIN: 7.3 / MAX: 7.521. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: SqueezeNetV1.01233691215Min: 7.37 / Avg: 7.39 / Max: 7.421. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: MobileNetV2_2241230.99681.99362.99043.98724.984SE +/- 0.004, N = 34.4304.4284.410MIN: 4.37 / MAX: 12.02MIN: 4.37 / MAX: 16.44MIN: 4.35 / MAX: 4.551. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: MobileNetV2_224123246810Min: 4.42 / Avg: 4.43 / Max: 4.441. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenet-v1-1.01231.21032.42063.63094.84126.0515SE +/- 0.006, N = 35.3685.3795.374MIN: 5.33 / MAX: 7.32MIN: 5.33 / MAX: 7.35MIN: 5.34 / MAX: 5.511. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenet-v1-1.0123246810Min: 5.37 / Avg: 5.38 / Max: 5.391. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: inception-v31231122334455SE +/- 0.07, N = 346.9347.2647.25MIN: 46.82 / MAX: 58.95MIN: 47.03 / MAX: 59.4MIN: 47.13 / MAX: 59.231. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: inception-v31231020304050Min: 47.16 / Avg: 47.26 / Max: 47.391. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mobilenet123714212835SE +/- 0.03, N = 329.1329.0729.07MIN: 29.02 / MAX: 31.11MIN: 28.89 / MAX: 30.6MIN: 28.98 / MAX: 31.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mobilenet123612182430Min: 29.01 / Avg: 29.07 / Max: 29.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v2-v2 - Model: mobilenet-v2123246810SE +/- 0.00, N = 37.607.627.62MIN: 7.54 / MAX: 8.47MIN: 7.54 / MAX: 9.42MIN: 7.53 / MAX: 91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v2-v2 - Model: mobilenet-v21233691215Min: 7.62 / Avg: 7.62 / Max: 7.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v3-v3 - Model: mobilenet-v3123246810SE +/- 0.00, N = 36.706.716.73MIN: 6.66 / MAX: 6.97MIN: 6.64 / MAX: 8.36MIN: 6.66 / MAX: 8.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v3-v3 - Model: mobilenet-v31233691215Min: 6.71 / Avg: 6.71 / Max: 6.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: shufflenet-v2123246810SE +/- 0.00, N = 36.446.446.43MIN: 6.41 / MAX: 6.62MIN: 6.41 / MAX: 7.33MIN: 6.39 / MAX: 6.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: shufflenet-v21233691215Min: 6.43 / Avg: 6.44 / Max: 6.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mnasnet123246810SE +/- 0.01, N = 36.886.886.87MIN: 6.84 / MAX: 7.04MIN: 6.83 / MAX: 8.86MIN: 6.84 / MAX: 6.951. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mnasnet1233691215Min: 6.87 / Avg: 6.88 / Max: 6.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: efficientnet-b01233691215SE +/- 0.01, N = 311.3611.3811.32MIN: 11.32 / MAX: 11.66MIN: 11.31 / MAX: 23.14MIN: 11.28 / MAX: 11.51. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: efficientnet-b01233691215Min: 11.36 / Avg: 11.38 / Max: 11.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: blazeface1230.50631.01261.51892.02522.5315SE +/- 0.00, N = 32.252.252.25MIN: 2.23 / MAX: 2.31MIN: 2.23 / MAX: 2.4MIN: 2.22 / MAX: 2.51. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: blazeface123246810Min: 2.25 / Avg: 2.25 / Max: 2.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: googlenet123612182430SE +/- 0.01, N = 325.7825.7625.74MIN: 25.66 / MAX: 30.06MIN: 25.67 / MAX: 26.13MIN: 25.64 / MAX: 27.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: googlenet123612182430Min: 25.74 / Avg: 25.76 / Max: 25.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: vgg1612320406080100SE +/- 0.13, N = 3104.65104.66104.34MIN: 104.39 / MAX: 107.63MIN: 104.26 / MAX: 116.49MIN: 104.15 / MAX: 106.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: vgg1612320406080100Min: 104.5 / Avg: 104.66 / Max: 104.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet18123714212835SE +/- 0.01, N = 327.7327.7027.75MIN: 27.65 / MAX: 27.88MIN: 27.6 / MAX: 29.86MIN: 27.6 / MAX: 39.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet18123612182430Min: 27.68 / Avg: 27.7 / Max: 27.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: alexnet123612182430SE +/- 0.02, N = 325.0025.0325.00MIN: 24.9 / MAX: 25.35MIN: 24.87 / MAX: 37.04MIN: 24.94 / MAX: 25.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: alexnet123612182430Min: 25 / Avg: 25.03 / Max: 25.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet501231122334455SE +/- 0.03, N = 350.3150.2750.25MIN: 50.16 / MAX: 62.38MIN: 50.1 / MAX: 62.38MIN: 50.12 / MAX: 53.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet501231020304050Min: 50.21 / Avg: 50.27 / Max: 50.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: yolov4-tiny1231020304050SE +/- 0.03, N = 343.1643.2743.07MIN: 43.02 / MAX: 54.35MIN: 43.07 / MAX: 55.26MIN: 42.99 / MAX: 43.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: yolov4-tiny123918273645Min: 43.22 / Avg: 43.27 / Max: 43.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: squeezenet_ssd1231224364860SE +/- 0.01, N = 351.2551.2751.27MIN: 51.03 / MAX: 51.59MIN: 51 / MAX: 51.62MIN: 51 / MAX: 58.691. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: squeezenet_ssd1231020304050Min: 51.26 / Avg: 51.27 / Max: 51.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: regnety_400m1233691215SE +/- 0.01, N = 313.1113.1313.11MIN: 13.08 / MAX: 13.26MIN: 13.09 / MAX: 13.37MIN: 13.05 / MAX: 13.971. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: regnety_400m12348121620Min: 13.12 / Avg: 13.13 / Max: 13.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: mobilenet1231020304050SE +/- 0.61, N = 343.7744.4044.72MIN: 40.75 / MAX: 47.19MIN: 41.03 / MAX: 54.6MIN: 44.32 / MAX: 45.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: mobilenet123918273645Min: 43.18 / Avg: 44.4 / Max: 45.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU-v2-v2 - Model: mobilenet-v212348121620SE +/- 0.01, N = 314.4714.5014.46MIN: 14.11 / MAX: 14.74MIN: 14.09 / MAX: 16.98MIN: 14.1 / MAX: 14.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU-v2-v2 - Model: mobilenet-v212348121620Min: 14.48 / Avg: 14.5 / Max: 14.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU-v3-v3 - Model: mobilenet-v312348121620SE +/- 0.07, N = 316.0516.1516.05MIN: 15.6 / MAX: 17.18MIN: 15.57 / MAX: 16.98MIN: 15.58 / MAX: 16.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU-v3-v3 - Model: mobilenet-v312348121620Min: 16.02 / Avg: 16.15 / Max: 16.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: shufflenet-v212348121620SE +/- 0.24, N = 315.6615.6515.66MIN: 15.28 / MAX: 17.3MIN: 14.02 / MAX: 17.32MIN: 15.29 / MAX: 15.931. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: shufflenet-v212348121620Min: 15.25 / Avg: 15.65 / Max: 16.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: mnasnet12348121620SE +/- 0.00, N = 314.9814.9715.01MIN: 14.59 / MAX: 16.94MIN: 14.57 / MAX: 17.52MIN: 14.87 / MAX: 16.971. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: mnasnet12348121620Min: 14.96 / Avg: 14.97 / Max: 14.971. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: efficientnet-b0123714212835SE +/- 0.00, N = 329.8629.8429.86MIN: 29.46 / MAX: 29.93MIN: 29.44 / MAX: 30.21MIN: 29.12 / MAX: 30.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: efficientnet-b0123714212835Min: 29.84 / Avg: 29.84 / Max: 29.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: blazeface1230.89331.78662.67993.57324.4665SE +/- 0.10, N = 33.933.973.68MIN: 3.42 / MAX: 4.33MIN: 3.21 / MAX: 5.07MIN: 3.23 / MAX: 4.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: blazeface123246810Min: 3.79 / Avg: 3.97 / Max: 4.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: googlenet123918273645SE +/- 0.00, N = 340.7040.6840.72MIN: 40.29 / MAX: 40.96MIN: 40.26 / MAX: 40.99MIN: 40.28 / MAX: 41.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: googlenet123816243240Min: 40.68 / Avg: 40.68 / Max: 40.691. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: vgg1612350100150200250SE +/- 0.22, N = 3235.39236.19235.91MIN: 233.54 / MAX: 237.5MIN: 233.67 / MAX: 239.37MIN: 234.06 / MAX: 238.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: vgg161234080120160200Min: 235.75 / Avg: 236.19 / Max: 236.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: resnet18123816243240SE +/- 0.00, N = 335.9435.9335.97MIN: 35.53 / MAX: 36.19MIN: 35.44 / MAX: 36.15MIN: 35.57 / MAX: 36.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: resnet18123816243240Min: 35.93 / Avg: 35.93 / Max: 35.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: alexnet1231326395265SE +/- 0.15, N = 356.2555.9056.63MIN: 53.16 / MAX: 59.97MIN: 52.97 / MAX: 59.38MIN: 53.7 / MAX: 60.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: alexnet1231122334455Min: 55.61 / Avg: 55.9 / Max: 56.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: resnet5012320406080100SE +/- 0.01, N = 386.7286.7186.75MIN: 85.97 / MAX: 87.07MIN: 86.2 / MAX: 87.18MIN: 86.22 / MAX: 87.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: resnet501231632486480Min: 86.7 / Avg: 86.71 / Max: 86.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: yolov4-tiny12320406080100SE +/- 0.03, N = 382.3682.4882.47MIN: 81.63 / MAX: 83.59MIN: 76.79 / MAX: 83.77MIN: 81.64 / MAX: 86.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: yolov4-tiny1231632486480Min: 82.42 / Avg: 82.48 / Max: 82.541. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: squeezenet_ssd1231122334455SE +/- 0.01, N = 350.6150.5150.52MIN: 49.75 / MAX: 61.17MIN: 49.81 / MAX: 51.06MIN: 50.18 / MAX: 50.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: squeezenet_ssd1231020304050Min: 50.5 / Avg: 50.51 / Max: 50.521. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: regnety_400m123510152025SE +/- 0.01, N = 320.1420.1220.15MIN: 19.76 / MAX: 20.23MIN: 19.73 / MAX: 20.2MIN: 19.78 / MAX: 20.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: Vulkan GPU - Model: regnety_400m123510152025Min: 20.11 / Avg: 20.12 / Max: 20.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

TNN

TNN is an open-source deep learning reasoning framework developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: DenseNet12313002600390052006500SE +/- 4.71, N = 36183.166173.776179.90MIN: 6079.27 / MAX: 6314.52MIN: 6069.46 / MAX: 6411.04MIN: 6082.11 / MAX: 6304.731. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl
OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: DenseNet12311002200330044005500Min: 6167.57 / Avg: 6173.77 / Max: 61831. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: MobileNet v2123110220330440550SE +/- 0.50, N = 3496.40497.96497.84MIN: 494.5 / MAX: 500.2MIN: 495.17 / MAX: 503.64MIN: 495.99 / MAX: 501.481. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl
OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: MobileNet v212390180270360450Min: 497.06 / Avg: 497.96 / Max: 498.791. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v212320406080100SE +/- 0.66, N = 3107.46108.25107.46MIN: 106.97 / MAX: 108.15MIN: 106.96 / MAX: 113.31MIN: 106.95 / MAX: 108.591. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl
OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v212320406080100Min: 107.47 / Avg: 108.25 / Max: 109.551. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v1.1123100200300400500SE +/- 0.09, N = 3454.07454.25453.95MIN: 452.75 / MAX: 455.57MIN: 452.79 / MAX: 456.74MIN: 453.13 / MAX: 454.831. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl
OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v1.112380160240320400Min: 454.09 / Avg: 454.25 / Max: 454.391. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

Apache Cassandra

This is a benchmark of the Apache Cassandra NoSQL database management system making use of cassandra-stress. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Reads1234K8K12K16K20KSE +/- 468.03, N = 12187581569118307
OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Reads1233K6K9K12K15KMin: 12778 / Avg: 15690.5 / Max: 18113

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Writes1234K8K12K16K20KSE +/- 79.29, N = 3196631929219328
OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Writes1233K6K9K12K15KMin: 19167 / Avg: 19292 / Max: 19439

Facebook RocksDB

This is a benchmark of Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.22.1Test: Random Fill12390K180K270K360K450KSE +/- 337.92, N = 34395814390914400741. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.22.1Test: Random Fill12380K160K240K320K400KMin: 438422 / Avg: 439090.67 / Max: 4395101. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.22.1Test: Random Read1233M6M9M12M15MSE +/- 176642.85, N = 31398118914792644149513451. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.22.1Test: Random Read1233M6M9M12M15MMin: 14439399 / Avg: 14792644.33 / Max: 149738921. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.22.1Test: Update Random12340K80K120K160K200KSE +/- 1236.97, N = 32019181991392010861. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.22.1Test: Update Random12340K80K120K160K200KMin: 196817 / Avg: 199139.33 / Max: 2010391. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.22.1Test: Sequential Fill123110K220K330K440K550KSE +/- 1316.10, N = 35066815034015025281. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.22.1Test: Sequential Fill12390K180K270K360K450KMin: 501512 / Avg: 503401 / Max: 5059331. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.22.1Test: Random Fill Sync123140280420560700SE +/- 9.53, N = 35476275951. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.22.1Test: Random Fill Sync123110220330440550Min: 613 / Avg: 626.67 / Max: 6451. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.22.1Test: Read While Writing12380K160K240K320K400KSE +/- 6796.75, N = 33934763964553748851. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.22.1Test: Read While Writing12370K140K210K280K350KMin: 387380 / Avg: 396454.67 / Max: 4097571. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.22.1Test: Read Random Write Random123110K220K330K440K550KSE +/- 1381.33, N = 35254275268954994651. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.22.1Test: Read Random Write Random12390K180K270K360K450KMin: 525513 / Avg: 526895.33 / Max: 5296581. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.8.2Model: yolov4 - Device: OpenMP CPU12340801201602001871871871. (CXX) g++ options: -fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.8.2Model: bertsquad-10 - Device: OpenMP CPU12370140210280350SE +/- 1.04, N = 33093083081. (CXX) g++ options: -fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt
OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.8.2Model: bertsquad-10 - Device: OpenMP CPU12360120180240300Min: 306.5 / Avg: 308 / Max: 3101. (CXX) g++ options: -fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.8.2Model: fcn-resnet101-11 - Device: OpenMP CPU123714212835SE +/- 0.17, N = 33231321. (CXX) g++ options: -fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt
OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.8.2Model: fcn-resnet101-11 - Device: OpenMP CPU123714212835Min: 31 / Avg: 31.17 / Max: 31.51. (CXX) g++ options: -fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.8.2Model: shufflenet-v2-10 - Device: OpenMP CPU1234K8K12K16K20KSE +/- 20.67, N = 31792317936180521. (CXX) g++ options: -fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt
OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.8.2Model: shufflenet-v2-10 - Device: OpenMP CPU1233K6K9K12K15KMin: 17914.5 / Avg: 17936.17 / Max: 17977.51. (CXX) g++ options: -fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.8.2Model: super-resolution-10 - Device: OpenMP CPU123400800120016002000SE +/- 1.92, N = 31943190919481. (CXX) g++ options: -fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt
OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.8.2Model: super-resolution-10 - Device: OpenMP CPU12330060090012001500Min: 1906 / Avg: 1908.83 / Max: 1912.51. (CXX) g++ options: -fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt

ECP-CANDLE

The CANDLE benchmark codes implement deep learning architectures relevant to problems in cancer. These architectures address problems at different biological scales, specifically problems at the molecular, cellular and population scales. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterECP-CANDLE 0.4Benchmark: P1B2123142842567060.5660.3759.62

OpenBenchmarking.orgSeconds, Fewer Is BetterECP-CANDLE 0.4Benchmark: P3B11234008001200160020001657.791670.691671.70

nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the Golang "Bombardier" program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 11235K10K15K20K25KSE +/- 207.92, N = 322746.8221466.5920993.791. (CC) gcc options: -ldl -lpthread -lcrypt -lz -O3 -march=native
OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 11234K8K12K16K20KMin: 21086.9 / Avg: 21466.59 / Max: 21803.31. (CC) gcc options: -ldl -lpthread -lcrypt -lz -O3 -march=native

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 2012330K60K90K120K150KSE +/- 212.20, N = 3124882.11124343.65124553.851. (CC) gcc options: -ldl -lpthread -lcrypt -lz -O3 -march=native
OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 2012320K40K60K80K100KMin: 123929.52 / Avg: 124343.65 / Max: 124631.061. (CC) gcc options: -ldl -lpthread -lcrypt -lz -O3 -march=native

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 10012330K60K90K120K150KSE +/- 215.33, N = 3133909.56133819.74133952.101. (CC) gcc options: -ldl -lpthread -lcrypt -lz -O3 -march=native
OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 10012320K40K60K80K100KMin: 133508.86 / Avg: 133819.74 / Max: 134233.291. (CC) gcc options: -ldl -lpthread -lcrypt -lz -O3 -march=native

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 20012330K60K90K120K150KSE +/- 30.64, N = 3132682.49132190.40132707.631. (CC) gcc options: -ldl -lpthread -lcrypt -lz -O3 -march=native
OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 20012320K40K60K80K100KMin: 132143.36 / Avg: 132190.4 / Max: 132247.941. (CC) gcc options: -ldl -lpthread -lcrypt -lz -O3 -march=native

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 50012330K60K90K120K150KSE +/- 158.22, N = 3127552.53127281.67127285.861. (CC) gcc options: -ldl -lpthread -lcrypt -lz -O3 -march=native
OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 50012320K40K60K80K100KMin: 126973.8 / Avg: 127281.67 / Max: 127498.981. (CC) gcc options: -ldl -lpthread -lcrypt -lz -O3 -march=native

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 100012330K60K90K120K150KSE +/- 180.69, N = 3122989.69123050.66123254.581. (CC) gcc options: -ldl -lpthread -lcrypt -lz -O3 -march=native
OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 100012320K40K60K80K100KMin: 122732.56 / Avg: 123050.66 / Max: 123358.241. (CC) gcc options: -ldl -lpthread -lcrypt -lz -O3 -march=native

Natron

Natron is an open-source, cross-platform compositing software for visual effects (VFX) and motion graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterNatron 2.4Input: Spaceship1230.15750.3150.47250.630.7875SE +/- 0.00, N = 30.70.60.6
OpenBenchmarking.orgFPS, More Is BetterNatron 2.4Input: Spaceship123246810Min: 0.6 / Avg: 0.6 / Max: 0.6

Apache HTTP Server

This is a test of the Apache HTTPD web server. This Apache HTTPD web server benchmark test profile makes use of the Golang "Bombardier" program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 11232K4K6K8K10KSE +/- 488.81, N = 127440.725750.337886.861. (CC) gcc options: -shared -fPIC -O2 -pthread
OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 112314002800420056007000Min: 3693.19 / Avg: 5750.33 / Max: 8103.471. (CC) gcc options: -shared -fPIC -O2 -pthread

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 201235K10K15K20K25KSE +/- 15.02, N = 322612.6922638.2422869.921. (CC) gcc options: -shared -fPIC -O2 -pthread
OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 201234K8K12K16K20KMin: 22608.27 / Avg: 22638.24 / Max: 22655.071. (CC) gcc options: -shared -fPIC -O2 -pthread

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 1001235K10K15K20K25KSE +/- 38.02, N = 324449.3824511.4924800.401. (CC) gcc options: -shared -fPIC -O2 -pthread
OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 1001234K8K12K16K20KMin: 24438.56 / Avg: 24511.49 / Max: 24566.631. (CC) gcc options: -shared -fPIC -O2 -pthread

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 2001235K10K15K20K25KSE +/- 32.98, N = 324876.8424960.1625294.201. (CC) gcc options: -shared -fPIC -O2 -pthread
OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 2001234K8K12K16K20KMin: 24896.67 / Avg: 24960.16 / Max: 25007.371. (CC) gcc options: -shared -fPIC -O2 -pthread

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 5001235K10K15K20K25KSE +/- 293.51, N = 323942.3022932.2723893.721. (CC) gcc options: -shared -fPIC -O2 -pthread
OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 5001234K8K12K16K20KMin: 22353.01 / Avg: 22932.27 / Max: 23304.281. (CC) gcc options: -shared -fPIC -O2 -pthread

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 10001235K10K15K20K25KSE +/- 72.48, N = 323814.5623836.0223950.801. (CC) gcc options: -shared -fPIC -O2 -pthread
OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 10001234K8K12K16K20KMin: 23698.73 / Avg: 23836.02 / Max: 23944.951. (CC) gcc options: -shared -fPIC -O2 -pthread

95 Results Shown

C-Blosc
LeelaChessZero:
  BLAS
  Eigen
Renaissance:
  Scala Dotty
  Rand Forest
  ALS Movie Lens
  Apache Spark ALS
  Apache Spark Bayes
  Savina Reactors.IO
  Apache Spark PageRank
  Finagle HTTP Requests
  In-Memory Database Shootout
  Akka Unbalanced Cobwebbed Tree
  Genetic Algorithm Using Jenetics + Futures
dav1d:
  Chimera 1080p
  Summer Nature 4K
  Summer Nature 1080p
  Chimera 1080p 10-bit
OpenVKL:
  vklBenchmark ISPC
  vklBenchmark Scalar
Timed Linux Kernel Compilation
YafaRay
Tachyon
Google SynthMark
KeyDB
Mobile Neural Network:
  mobilenetV3
  squeezenetv1.1
  resnet-v2-50
  SqueezeNetV1.0
  MobileNetV2_224
  mobilenet-v1-1.0
  inception-v3
NCNN:
  CPU - mobilenet
  CPU-v2-v2 - mobilenet-v2
  CPU-v3-v3 - mobilenet-v3
  CPU - shufflenet-v2
  CPU - mnasnet
  CPU - efficientnet-b0
  CPU - blazeface
  CPU - googlenet
  CPU - vgg16
  CPU - resnet18
  CPU - alexnet
  CPU - resnet50
  CPU - yolov4-tiny
  CPU - squeezenet_ssd
  CPU - regnety_400m
  Vulkan GPU - mobilenet
  Vulkan GPU-v2-v2 - mobilenet-v2
  Vulkan GPU-v3-v3 - mobilenet-v3
  Vulkan GPU - shufflenet-v2
  Vulkan GPU - mnasnet
  Vulkan GPU - efficientnet-b0
  Vulkan GPU - blazeface
  Vulkan GPU - googlenet
  Vulkan GPU - vgg16
  Vulkan GPU - resnet18
  Vulkan GPU - alexnet
  Vulkan GPU - resnet50
  Vulkan GPU - yolov4-tiny
  Vulkan GPU - squeezenet_ssd
  Vulkan GPU - regnety_400m
TNN:
  CPU - DenseNet
  CPU - MobileNet v2
  CPU - SqueezeNet v2
  CPU - SqueezeNet v1.1
Apache Cassandra:
  Reads
  Writes
Facebook RocksDB:
  Rand Fill
  Rand Read
  Update Rand
  Seq Fill
  Rand Fill Sync
  Read While Writing
  Read Rand Write Rand
ONNX Runtime:
  yolov4 - OpenMP CPU
  bertsquad-10 - OpenMP CPU
  fcn-resnet101-11 - OpenMP CPU
  shufflenet-v2-10 - OpenMP CPU
  super-resolution-10 - OpenMP CPU
ECP-CANDLE:
  P1B2
  P3B1
nginx:
  1
  20
  100
  200
  500
  1000
Natron
Apache HTTP Server:
  1
  20
  100
  200
  500
  1000