NCNN Postgres 13

2 x Intel Xeon Gold 5220R testing with a TYAN S7106 (V2.01.B40 BIOS) and llvmpipe on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2009256-FI-NCNNPOSTG58
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
6220R 2P
September 24 2020
  14 Hours, 55 Minutes
2
September 24 2020
  15 Hours, 8 Minutes
3
September 25 2020
  12 Hours, 30 Minutes
Invert Behavior (Only Show Selected Data)
  14 Hours, 11 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


NCNN Postgres 13ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen Resolution6220R 2P232 x Intel Xeon Gold 5220R @ 3.90GHz (36 Cores / 72 Threads)TYAN S7106 (V2.01.B40 BIOS)Intel Sky Lake-E DMI3 Registers94GB500GB Samsung SSD 860llvmpipeVE2282 x Intel I210 + 2 x QLogic cLOM8214 1/10GbEUbuntu 20.045.9.0-050900rc6-generic (x86_64) 20200920GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.83.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits)GCC 9.3.0ext41920x1080OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x5002f01Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

6220R 2P23Result OverviewPhoronix Test Suite100%118%137%155%PostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchNCNNPostgreSQL pgbenchNCNNNCNNPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchNCNNNCNNPostgreSQL pgbenchNCNNNCNNPostgreSQL pgbenchNCNNNCNNPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchNCNNNCNNNCNNPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchNCNNPostgreSQL pgbenchNCNNPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbench1 - 100 - Read Write - Average Latency1 - 250 - Read Write1 - 100 - Read Write1 - 250 - Read Write - Average Latency1000 - 250 - Read Write - Average Latency1000 - 250 - Read Write100 - 100 - Read Write100 - 100 - Read Write - Average Latency100 - 50 - Read Write - Average Latency100 - 50 - Read Write100 - 250 - Read Write - Average LatencyCPU - mnasnet100 - 250 - Read WriteCPU - resnet18CPU-v2-v2 - mobilenet-v21000 - 50 - Read Write1 - 50 - Read Write1 - 50 - Read Write - Average LatencyCPU - shufflenet-v2CPU - efficientnet-b01000 - 50 - Read Write - Average LatencyCPU-v3-v3 - mobilenet-v3CPU - vgg161000 - 100 - Read WriteCPU - yolov4-tinyCPU - blazeface1000 - 100 - Read Write - Average Latency1 - 100 - Read Only1000 - 250 - Read Only - Average Latency1000 - 250 - Read Only1 - 100 - Read Only - Average LatencyCPU - squeezenetCPU - mobilenetCPU - alexnet1 - 250 - Read Only - Average Latency100 - 50 - Read Only - Average Latency1 - 250 - Read OnlyCPU - resnet50100 - 250 - Read Only - Average LatencyCPU - googlenet100 - 100 - Read Only - Average Latency100 - 250 - Read Only1000 - 100 - Read Only100 - 100 - Read Only100 - 50 - Read Only1000 - 50 - Read Only1 - 50 - Read Only1 - 50 - Read Only - Average Latency1000 - 50 - Read Only - Average Latency1000 - 100 - Read Only - Average Latency

NCNN Postgres 13pgbench: 1 - 50 - Read Onlypgbench: 1 - 50 - Read Only - Average Latencypgbench: 1 - 100 - Read Onlypgbench: 1 - 100 - Read Only - Average Latencypgbench: 1 - 250 - Read Onlypgbench: 1 - 250 - Read Only - Average Latencypgbench: 1 - 50 - Read Writepgbench: 1 - 50 - Read Write - Average Latencypgbench: 1 - 100 - Read Writepgbench: 1 - 100 - Read Write - Average Latencypgbench: 1 - 250 - Read Writepgbench: 1 - 250 - Read Write - Average Latencypgbench: 100 - 50 - Read Onlypgbench: 100 - 50 - Read Only - Average Latencypgbench: 100 - 100 - Read Onlypgbench: 100 - 100 - Read Only - Average Latencypgbench: 100 - 250 - Read Onlypgbench: 100 - 250 - Read Only - Average Latencypgbench: 100 - 50 - Read Writepgbench: 100 - 50 - Read Write - Average Latencypgbench: 1000 - 50 - Read Onlypgbench: 1000 - 50 - Read Only - Average Latencypgbench: 100 - 100 - Read Writepgbench: 100 - 100 - Read Write - Average Latencypgbench: 100 - 250 - Read Writepgbench: 100 - 250 - Read Write - Average Latencypgbench: 1000 - 100 - Read Onlypgbench: 1000 - 100 - Read Only - Average Latencypgbench: 1000 - 250 - Read Onlypgbench: 1000 - 250 - Read Only - Average Latencypgbench: 1000 - 50 - Read Writepgbench: 1000 - 50 - Read Write - Average Latencypgbench: 1000 - 100 - Read Writepgbench: 1000 - 100 - Read Write - Average Latencypgbench: 1000 - 250 - Read Writepgbench: 1000 - 250 - Read Write - Average Latencyncnn: CPU - squeezenetncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinytnn: CPU - MobileNet v2tnn: CPU - SqueezeNet v1.16220R 2P236401470.0788997660.1117779620.32279562.952743134.870333827.8085292130.0956289620.1596193190.404331715.1805050520.099394825.480450955.5746108170.1645794960.432362013.844429023.356534447.10256.6923.179.999.489.219.1912.774.1957.54102.8024.1410.8785.9234.046400950.0789193930.1097744470.32478963.407724138.256426697.1505292610.0946276320.1606191280.405355714.0725054030.099426223.571452055.7236086250.1645690210.440366213.711438222.854491451.33255.7923.279.959.469.439.3012.944.2357.42104.8223.9610.7385.7234.52381.089345.7786405190.0789009970.1117822960.32081361.565527234.021271923.6235297830.0946280170.1606223850.402345314.7545050600.099392725.508434758.0956088030.1645732520.437373313.467440222.825505449.65856.0823.5110.309.729.479.5613.134.2957.81102.1524.8310.7886.5833.66387.466345.947OpenBenchmarking.org

PostgreSQL pgbench

This is a benchmark of PostgreSQL using pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 50 - Mode: Read Only26220R 2P3140K280K420K560K700KSE +/- 489.94, N = 3SE +/- 105.30, N = 3SE +/- 150.85, N = 36400956401476405191. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 50 - Mode: Read Only - Average Latency326220R 2P0.01760.03520.05280.07040.088SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0780.0780.0781. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Only6220R 2P32200K400K600K800K1000KSE +/- 5164.98, N = 3SE +/- 5122.70, N = 3SE +/- 3731.23, N = 38997669009979193931. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency36220R 2P20.0250.050.0750.10.125SE +/- 0.001, N = 3SE +/- 0.001, N = 3SE +/- 0.001, N = 30.1110.1110.1091. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 250 - Mode: Read Only26220R 2P3200K400K600K800K1000KSE +/- 8768.63, N = 3SE +/- 11527.76, N = 3SE +/- 4076.73, N = 37744477779627822961. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 250 - Mode: Read Only - Average Latency26220R 2P30.07290.14580.21870.29160.3645SE +/- 0.004, N = 3SE +/- 0.005, N = 3SE +/- 0.002, N = 30.3240.3220.3201. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 50 - Mode: Read Write26220R 2P32004006008001000SE +/- 7.39, N = 3SE +/- 4.67, N = 3SE +/- 7.54, N = 37897958131. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 50 - Mode: Read Write - Average Latency26220R 2P31428425670SE +/- 0.60, N = 3SE +/- 0.37, N = 3SE +/- 0.57, N = 363.4162.9561.571. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Write326220R 2P160320480640800SE +/- 66.83, N = 12SE +/- 3.80, N = 3SE +/- 2.97, N = 35277247431. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency326220R 2P50100150200250SE +/- 31.73, N = 12SE +/- 0.72, N = 3SE +/- 0.53, N = 3234.02138.26134.871. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 250 - Mode: Read Write36220R 2P290180270360450SE +/- 2.48, N = 10SE +/- 36.35, N = 15SE +/- 56.36, N = 122713334261. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 250 - Mode: Read Write - Average Latency36220R 2P22004006008001000SE +/- 8.78, N = 10SE +/- 48.84, N = 15SE +/- 76.09, N = 12923.62827.81697.151. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 50 - Mode: Read Only6220R 2P23110K220K330K440K550KSE +/- 830.17, N = 3SE +/- 811.33, N = 3SE +/- 122.04, N = 35292135292615297831. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 50 - Mode: Read Only - Average Latency6220R 2P320.02140.04280.06420.08560.107SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0950.0940.0941. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 100 - Mode: Read Only236220R 2P130K260K390K520K650KSE +/- 2142.81, N = 3SE +/- 2969.80, N = 3SE +/- 3379.32, N = 36276326280176289621. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency326220R 2P0.0360.0720.1080.1440.18SE +/- 0.001, N = 3SE +/- 0.000, N = 3SE +/- 0.001, N = 30.1600.1600.1591. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 250 - Mode: Read Only26220R 2P3130K260K390K520K650KSE +/- 3164.52, N = 3SE +/- 2959.46, N = 3SE +/- 3862.57, N = 36191286193196223851. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average Latency26220R 2P30.09110.18220.27330.36440.4555SE +/- 0.002, N = 3SE +/- 0.002, N = 3SE +/- 0.003, N = 30.4050.4040.4021. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 50 - Mode: Read Write6220R 2P328001600240032004000SE +/- 70.43, N = 15SE +/- 124.76, N = 15SE +/- 48.14, N = 33317345335571. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 50 - Mode: Read Write - Average Latency6220R 2P3248121620SE +/- 0.33, N = 15SE +/- 0.54, N = 15SE +/- 0.19, N = 315.1814.7514.071. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 50 - Mode: Read Only6220R 2P32110K220K330K440K550KSE +/- 466.00, N = 3SE +/- 812.23, N = 3SE +/- 1094.28, N = 35050525050605054031. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 50 - Mode: Read Only - Average Latency326220R 2P0.02230.04460.06690.08920.1115SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0990.0990.0991. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 100 - Mode: Read Write36220R 2P29001800270036004500SE +/- 51.38, N = 3SE +/- 69.23, N = 15SE +/- 69.80, N = 123927394842621. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency36220R 2P2612182430SE +/- 0.33, N = 3SE +/- 0.46, N = 15SE +/- 0.38, N = 1225.5125.4823.571. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 250 - Mode: Read Write36220R 2P210002000300040005000SE +/- 97.14, N = 15SE +/- 41.20, N = 3SE +/- 87.11, N = 154347450945201. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average Latency326220R 2P1326395265SE +/- 1.48, N = 15SE +/- 1.09, N = 15SE +/- 0.51, N = 358.1055.7255.571. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 100 - Mode: Read Only236220R 2P130K260K390K520K650KSE +/- 750.97, N = 3SE +/- 1549.52, N = 3SE +/- 1389.33, N = 36086256088036108171. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 100 - Mode: Read Only - Average Latency326220R 2P0.03690.07380.11070.14760.1845SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.1640.1640.1641. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 250 - Mode: Read Only236220R 2P120K240K360K480K600KSE +/- 4757.21, N = 3SE +/- 9194.46, N = 3SE +/- 3053.06, N = 35690215732525794961. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 250 - Mode: Read Only - Average Latency236220R 2P0.0990.1980.2970.3960.495SE +/- 0.004, N = 3SE +/- 0.007, N = 3SE +/- 0.002, N = 30.4400.4370.4321. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 50 - Mode: Read Write6220R 2P238001600240032004000SE +/- 50.03, N = 9SE +/- 75.28, N = 9SE +/- 86.17, N = 93620366237331. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 50 - Mode: Read Write - Average Latency6220R 2P2348121620SE +/- 0.19, N = 9SE +/- 0.30, N = 9SE +/- 0.34, N = 913.8413.7113.471. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 100 - Mode: Read Write6220R 2P239001800270036004500SE +/- 56.62, N = 4SE +/- 14.71, N = 3SE +/- 90.74, N = 94290438244021. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 100 - Mode: Read Write - Average Latency6220R 2P23612182430SE +/- 0.31, N = 4SE +/- 0.08, N = 3SE +/- 0.46, N = 923.3622.8522.831. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 250 - Mode: Read Write236220R 2P11002200330044005500SE +/- 135.22, N = 9SE +/- 70.36, N = 9SE +/- 159.21, N = 64914505453441. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 250 - Mode: Read Write - Average Latency236220R 2P1224364860SE +/- 1.55, N = 9SE +/- 0.67, N = 9SE +/- 1.47, N = 651.3349.6647.101. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenet6220R 2P321326395265SE +/- 0.77, N = 12SE +/- 0.68, N = 6SE +/- 0.95, N = 1256.6956.0855.79MIN: 48.25 / MAX: 879.95MIN: 50.11 / MAX: 859.51MIN: 50.4 / MAX: 557.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenet326220R 2P612182430SE +/- 0.21, N = 6SE +/- 0.14, N = 12SE +/- 0.09, N = 1223.5123.2723.17MIN: 22.93 / MAX: 61.83MIN: 22.51 / MAX: 44.41MIN: 22.61 / MAX: 48.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v236220R 2P23691215SE +/- 0.22, N = 6SE +/- 0.08, N = 12SE +/- 0.10, N = 1210.309.999.95MIN: 9.3 / MAX: 33.6MIN: 9.31 / MAX: 48.12MIN: 9.19 / MAX: 11.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v336220R 2P23691215SE +/- 0.17, N = 6SE +/- 0.07, N = 12SE +/- 0.09, N = 129.729.489.46MIN: 8.92 / MAX: 15.71MIN: 8.9 / MAX: 35.25MIN: 8.8 / MAX: 41.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v2326220R 2P3691215SE +/- 0.22, N = 6SE +/- 0.12, N = 12SE +/- 0.08, N = 129.479.439.21MIN: 8.58 / MAX: 10.95MIN: 8.76 / MAX: 11.38MIN: 8.61 / MAX: 10.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnet326220R 2P3691215SE +/- 0.12, N = 5SE +/- 0.06, N = 12SE +/- 0.07, N = 129.569.309.19MIN: 9.12 / MAX: 11.47MIN: 8.74 / MAX: 28.11MIN: 8.67 / MAX: 27.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b0326220R 2P3691215SE +/- 0.29, N = 6SE +/- 0.06, N = 12SE +/- 0.12, N = 1213.1312.9412.77MIN: 11.83 / MAX: 71.59MIN: 12.12 / MAX: 44.83MIN: 11.83 / MAX: 43.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazeface326220R 2P0.96531.93062.89593.86124.8265SE +/- 0.08, N = 6SE +/- 0.03, N = 12SE +/- 0.04, N = 124.294.234.19MIN: 3.93 / MAX: 8.37MIN: 3.95 / MAX: 6.26MIN: 3.89 / MAX: 42.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenet36220R 2P21326395265SE +/- 0.41, N = 6SE +/- 0.28, N = 12SE +/- 0.26, N = 1257.8157.5457.42MIN: 55.4 / MAX: 94.13MIN: 55.46 / MAX: 458.06MIN: 55.71 / MAX: 81.841. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg1626220R 2P320406080100SE +/- 0.40, N = 12SE +/- 0.78, N = 12SE +/- 0.89, N = 6104.82102.80102.15MIN: 91.31 / MAX: 289.03MIN: 84.67 / MAX: 259.76MIN: 89.11 / MAX: 273.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet1836220R 2P2612182430SE +/- 0.54, N = 6SE +/- 0.21, N = 12SE +/- 0.21, N = 1124.8324.1423.96MIN: 22.66 / MAX: 73.09MIN: 22.38 / MAX: 78.32MIN: 22.8 / MAX: 84.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnet6220R 2P323691215SE +/- 0.08, N = 12SE +/- 0.14, N = 6SE +/- 0.07, N = 1210.8710.7810.73MIN: 10.41 / MAX: 14.9MIN: 10.45 / MAX: 14.82MIN: 10.42 / MAX: 13.031. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet5036220R 2P220406080100SE +/- 0.99, N = 6SE +/- 0.68, N = 12SE +/- 0.46, N = 1286.5885.9285.72MIN: 80.65 / MAX: 1155.83MIN: 81.34 / MAX: 1417.73MIN: 81.78 / MAX: 866.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tiny26220R 2P3816243240SE +/- 0.69, N = 12SE +/- 0.69, N = 12SE +/- 0.78, N = 634.5234.0433.66MIN: 31.88 / MAX: 76.98MIN: 31.26 / MAX: 78.16MIN: 31.11 / MAX: 80.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

TNN

TNN is an open-source deep learning reasoning framework developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: MobileNet v23280160240320400SE +/- 3.37, N = 3SE +/- 1.51, N = 3387.47381.09MIN: 377.31 / MAX: 554.07MIN: 376.85 / MAX: 573.681. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: SqueezeNet v1.13280160240320400SE +/- 0.05, N = 3SE +/- 0.05, N = 3345.95345.78MIN: 345.27 / MAX: 354.41MIN: 345.28 / MAX: 351.251. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl

52 Results Shown

PostgreSQL pgbench:
  1 - 50 - Read Only
  1 - 50 - Read Only - Average Latency
  1 - 100 - Read Only
  1 - 100 - Read Only - Average Latency
  1 - 250 - Read Only
  1 - 250 - Read Only - Average Latency
  1 - 50 - Read Write
  1 - 50 - Read Write - Average Latency
  1 - 100 - Read Write
  1 - 100 - Read Write - Average Latency
  1 - 250 - Read Write
  1 - 250 - Read Write - Average Latency
  100 - 50 - Read Only
  100 - 50 - Read Only - Average Latency
  100 - 100 - Read Only
  100 - 100 - Read Only - Average Latency
  100 - 250 - Read Only
  100 - 250 - Read Only - Average Latency
  100 - 50 - Read Write
  100 - 50 - Read Write - Average Latency
  1000 - 50 - Read Only
  1000 - 50 - Read Only - Average Latency
  100 - 100 - Read Write
  100 - 100 - Read Write - Average Latency
  100 - 250 - Read Write
  100 - 250 - Read Write - Average Latency
  1000 - 100 - Read Only
  1000 - 100 - Read Only - Average Latency
  1000 - 250 - Read Only
  1000 - 250 - Read Only - Average Latency
  1000 - 50 - Read Write
  1000 - 50 - Read Write - Average Latency
  1000 - 100 - Read Write
  1000 - 100 - Read Write - Average Latency
  1000 - 250 - Read Write
  1000 - 250 - Read Write - Average Latency
NCNN:
  CPU - squeezenet
  CPU - mobilenet
  CPU-v2-v2 - mobilenet-v2
  CPU-v3-v3 - mobilenet-v3
  CPU - shufflenet-v2
  CPU - mnasnet
  CPU - efficientnet-b0
  CPU - blazeface
  CPU - googlenet
  CPU - vgg16
  CPU - resnet18
  CPU - alexnet
  CPU - resnet50
  CPU - yolov4-tiny
TNN:
  CPU - MobileNet v2
  CPU - SqueezeNet v1.1