NCNN Postgres 13

2 x Intel Xeon Gold 5220R testing with a TYAN S7106 (V2.01.B40 BIOS) and llvmpipe on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2009256-FI-NCNNPOSTG58
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
6220R 2P
September 24 2020
  14 Hours, 55 Minutes
2
September 24 2020
  15 Hours, 8 Minutes
3
September 25 2020
  12 Hours, 30 Minutes
Invert Behavior (Only Show Selected Data)
  14 Hours, 11 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

6220R 2P

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x5002f01
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

2

3

Processor: 2 x Intel Xeon Gold 5220R @ 3.90GHz (36 Cores / 72 Threads), Motherboard: TYAN S7106 (V2.01.B40 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 94GB, Disk: 500GB Samsung SSD 860, Graphics: llvmpipe, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE

OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc6-generic (x86_64) 20200920, Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

NCNN Postgres 13ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen Resolution6220R 2P232 x Intel Xeon Gold 5220R @ 3.90GHz (36 Cores / 72 Threads)TYAN S7106 (V2.01.B40 BIOS)Intel Sky Lake-E DMI3 Registers94GB500GB Samsung SSD 860llvmpipeVE2282 x Intel I210 + 2 x QLogic cLOM8214 1/10GbEUbuntu 20.045.9.0-050900rc6-generic (x86_64) 20200920GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.83.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits)GCC 9.3.0ext41920x1080OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x5002f01Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

6220R 2P23Result OverviewPhoronix Test Suite100%118%137%155%PostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchNCNNPostgreSQL pgbenchNCNNNCNNPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchNCNNNCNNPostgreSQL pgbenchNCNNNCNNPostgreSQL pgbenchNCNNNCNNPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchNCNNNCNNNCNNPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchNCNNPostgreSQL pgbenchNCNNPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbench1 - 100 - Read Write - Average Latency1 - 250 - Read Write1 - 100 - Read Write1 - 250 - Read Write - Average Latency1000 - 250 - Read Write - Average Latency1000 - 250 - Read Write100 - 100 - Read Write100 - 100 - Read Write - Average Latency100 - 50 - Read Write - Average Latency100 - 50 - Read Write100 - 250 - Read Write - Average LatencyCPU - mnasnet100 - 250 - Read WriteCPU - resnet18CPU-v2-v2 - mobilenet-v21000 - 50 - Read Write1 - 50 - Read Write1 - 50 - Read Write - Average LatencyCPU - shufflenet-v2CPU - efficientnet-b01000 - 50 - Read Write - Average LatencyCPU-v3-v3 - mobilenet-v3CPU - vgg161000 - 100 - Read WriteCPU - yolov4-tinyCPU - blazeface1000 - 100 - Read Write - Average Latency1 - 100 - Read Only1000 - 250 - Read Only - Average Latency1000 - 250 - Read Only1 - 100 - Read Only - Average LatencyCPU - squeezenetCPU - mobilenetCPU - alexnet1 - 250 - Read Only - Average Latency100 - 50 - Read Only - Average Latency1 - 250 - Read OnlyCPU - resnet50100 - 250 - Read Only - Average LatencyCPU - googlenet100 - 100 - Read Only - Average Latency100 - 250 - Read Only1000 - 100 - Read Only100 - 100 - Read Only100 - 50 - Read Only1000 - 50 - Read Only1 - 50 - Read Only1 - 50 - Read Only - Average Latency1000 - 50 - Read Only - Average Latency1000 - 100 - Read Only - Average Latency

NCNN Postgres 13pgbench: 1 - 50 - Read Onlypgbench: 1 - 50 - Read Only - Average Latencypgbench: 1 - 100 - Read Onlypgbench: 1 - 100 - Read Only - Average Latencypgbench: 1 - 250 - Read Onlypgbench: 1 - 250 - Read Only - Average Latencypgbench: 1 - 50 - Read Writepgbench: 1 - 50 - Read Write - Average Latencypgbench: 1 - 100 - Read Writepgbench: 1 - 100 - Read Write - Average Latencypgbench: 1 - 250 - Read Writepgbench: 1 - 250 - Read Write - Average Latencypgbench: 100 - 50 - Read Onlypgbench: 100 - 50 - Read Only - Average Latencypgbench: 100 - 100 - Read Onlypgbench: 100 - 100 - Read Only - Average Latencypgbench: 100 - 250 - Read Onlypgbench: 100 - 250 - Read Only - Average Latencypgbench: 100 - 50 - Read Writepgbench: 100 - 50 - Read Write - Average Latencypgbench: 1000 - 50 - Read Onlypgbench: 1000 - 50 - Read Only - Average Latencypgbench: 100 - 100 - Read Writepgbench: 100 - 100 - Read Write - Average Latencypgbench: 100 - 250 - Read Writepgbench: 100 - 250 - Read Write - Average Latencypgbench: 1000 - 100 - Read Onlypgbench: 1000 - 100 - Read Only - Average Latencypgbench: 1000 - 250 - Read Onlypgbench: 1000 - 250 - Read Only - Average Latencypgbench: 1000 - 50 - Read Writepgbench: 1000 - 50 - Read Write - Average Latencypgbench: 1000 - 100 - Read Writepgbench: 1000 - 100 - Read Write - Average Latencypgbench: 1000 - 250 - Read Writepgbench: 1000 - 250 - Read Write - Average Latencyncnn: CPU - squeezenetncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinytnn: CPU - MobileNet v2tnn: CPU - SqueezeNet v1.16220R 2P236401470.0788997660.1117779620.32279562.952743134.870333827.8085292130.0956289620.1596193190.404331715.1805050520.099394825.480450955.5746108170.1645794960.432362013.844429023.356534447.10256.6923.179.999.489.219.1912.774.1957.54102.8024.1410.8785.9234.046400950.0789193930.1097744470.32478963.407724138.256426697.1505292610.0946276320.1606191280.405355714.0725054030.099426223.571452055.7236086250.1645690210.440366213.711438222.854491451.33255.7923.279.959.469.439.3012.944.2357.42104.8223.9610.7385.7234.52381.089345.7786405190.0789009970.1117822960.32081361.565527234.021271923.6235297830.0946280170.1606223850.402345314.7545050600.099392725.508434758.0956088030.1645732520.437373313.467440222.825505449.65856.0823.5110.309.729.479.5613.134.2957.81102.1524.8310.7886.5833.66387.466345.947OpenBenchmarking.org

PostgreSQL pgbench

This is a benchmark of PostgreSQL using pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 50 - Mode: Read Only326220R 2P140K280K420K560K700KSE +/- 150.85, N = 3SE +/- 489.94, N = 3SE +/- 105.30, N = 36405196400956401471. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 50 - Mode: Read Only - Average Latency326220R 2P0.01760.03520.05280.07040.088SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0780.0780.0781. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Only326220R 2P200K400K600K800K1000KSE +/- 5122.70, N = 3SE +/- 3731.23, N = 3SE +/- 5164.98, N = 39009979193938997661. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency326220R 2P0.0250.050.0750.10.125SE +/- 0.001, N = 3SE +/- 0.001, N = 3SE +/- 0.001, N = 30.1110.1090.1111. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 250 - Mode: Read Only326220R 2P200K400K600K800K1000KSE +/- 4076.73, N = 3SE +/- 8768.63, N = 3SE +/- 11527.76, N = 37822967744477779621. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 250 - Mode: Read Only - Average Latency326220R 2P0.07290.14580.21870.29160.3645SE +/- 0.002, N = 3SE +/- 0.004, N = 3SE +/- 0.005, N = 30.3200.3240.3221. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 50 - Mode: Read Write326220R 2P2004006008001000SE +/- 7.54, N = 3SE +/- 7.39, N = 3SE +/- 4.67, N = 38137897951. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 50 - Mode: Read Write - Average Latency326220R 2P1428425670SE +/- 0.57, N = 3SE +/- 0.60, N = 3SE +/- 0.37, N = 361.5763.4162.951. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Write326220R 2P160320480640800SE +/- 66.83, N = 12SE +/- 3.80, N = 3SE +/- 2.97, N = 35277247431. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency326220R 2P50100150200250SE +/- 31.73, N = 12SE +/- 0.72, N = 3SE +/- 0.53, N = 3234.02138.26134.871. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 250 - Mode: Read Write326220R 2P90180270360450SE +/- 2.48, N = 10SE +/- 56.36, N = 12SE +/- 36.35, N = 152714263331. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 250 - Mode: Read Write - Average Latency326220R 2P2004006008001000SE +/- 8.78, N = 10SE +/- 76.09, N = 12SE +/- 48.84, N = 15923.62697.15827.811. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 50 - Mode: Read Only326220R 2P110K220K330K440K550KSE +/- 122.04, N = 3SE +/- 811.33, N = 3SE +/- 830.17, N = 35297835292615292131. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 50 - Mode: Read Only - Average Latency326220R 2P0.02140.04280.06420.08560.107SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0940.0940.0951. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 100 - Mode: Read Only326220R 2P130K260K390K520K650KSE +/- 2969.80, N = 3SE +/- 2142.81, N = 3SE +/- 3379.32, N = 36280176276326289621. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency326220R 2P0.0360.0720.1080.1440.18SE +/- 0.001, N = 3SE +/- 0.000, N = 3SE +/- 0.001, N = 30.1600.1600.1591. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 250 - Mode: Read Only326220R 2P130K260K390K520K650KSE +/- 3862.57, N = 3SE +/- 3164.52, N = 3SE +/- 2959.46, N = 36223856191286193191. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average Latency326220R 2P0.09110.18220.27330.36440.4555SE +/- 0.003, N = 3SE +/- 0.002, N = 3SE +/- 0.002, N = 30.4020.4050.4041. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 50 - Mode: Read Write326220R 2P8001600240032004000SE +/- 124.76, N = 15SE +/- 48.14, N = 3SE +/- 70.43, N = 153453355733171. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 50 - Mode: Read Write - Average Latency326220R 2P48121620SE +/- 0.54, N = 15SE +/- 0.19, N = 3SE +/- 0.33, N = 1514.7514.0715.181. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 50 - Mode: Read Only326220R 2P110K220K330K440K550KSE +/- 812.23, N = 3SE +/- 1094.28, N = 3SE +/- 466.00, N = 35050605054035050521. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 50 - Mode: Read Only - Average Latency326220R 2P0.02230.04460.06690.08920.1115SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0990.0990.0991. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 100 - Mode: Read Write326220R 2P9001800270036004500SE +/- 51.38, N = 3SE +/- 69.80, N = 12SE +/- 69.23, N = 153927426239481. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency326220R 2P612182430SE +/- 0.33, N = 3SE +/- 0.38, N = 12SE +/- 0.46, N = 1525.5123.5725.481. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 250 - Mode: Read Write326220R 2P10002000300040005000SE +/- 97.14, N = 15SE +/- 87.11, N = 15SE +/- 41.20, N = 34347452045091. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average Latency326220R 2P1326395265SE +/- 1.48, N = 15SE +/- 1.09, N = 15SE +/- 0.51, N = 358.1055.7255.571. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 100 - Mode: Read Only326220R 2P130K260K390K520K650KSE +/- 1549.52, N = 3SE +/- 750.97, N = 3SE +/- 1389.33, N = 36088036086256108171. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 100 - Mode: Read Only - Average Latency326220R 2P0.03690.07380.11070.14760.1845SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.1640.1640.1641. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 250 - Mode: Read Only326220R 2P120K240K360K480K600KSE +/- 9194.46, N = 3SE +/- 4757.21, N = 3SE +/- 3053.06, N = 35732525690215794961. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 250 - Mode: Read Only - Average Latency326220R 2P0.0990.1980.2970.3960.495SE +/- 0.007, N = 3SE +/- 0.004, N = 3SE +/- 0.002, N = 30.4370.4400.4321. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 50 - Mode: Read Write326220R 2P8001600240032004000SE +/- 86.17, N = 9SE +/- 75.28, N = 9SE +/- 50.03, N = 93733366236201. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 50 - Mode: Read Write - Average Latency326220R 2P48121620SE +/- 0.34, N = 9SE +/- 0.30, N = 9SE +/- 0.19, N = 913.4713.7113.841. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 100 - Mode: Read Write326220R 2P9001800270036004500SE +/- 90.74, N = 9SE +/- 14.71, N = 3SE +/- 56.62, N = 44402438242901. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 100 - Mode: Read Write - Average Latency326220R 2P612182430SE +/- 0.46, N = 9SE +/- 0.08, N = 3SE +/- 0.31, N = 422.8322.8523.361. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 250 - Mode: Read Write326220R 2P11002200330044005500SE +/- 70.36, N = 9SE +/- 135.22, N = 9SE +/- 159.21, N = 65054491453441. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 250 - Mode: Read Write - Average Latency326220R 2P1224364860SE +/- 0.67, N = 9SE +/- 1.55, N = 9SE +/- 1.47, N = 649.6651.3347.101. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenet326220R 2P1326395265SE +/- 0.68, N = 6SE +/- 0.95, N = 12SE +/- 0.77, N = 1256.0855.7956.69MIN: 50.11 / MAX: 859.51MIN: 50.4 / MAX: 557.87MIN: 48.25 / MAX: 879.951. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenet326220R 2P612182430SE +/- 0.21, N = 6SE +/- 0.14, N = 12SE +/- 0.09, N = 1223.5123.2723.17MIN: 22.93 / MAX: 61.83MIN: 22.51 / MAX: 44.41MIN: 22.61 / MAX: 48.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v2326220R 2P3691215SE +/- 0.22, N = 6SE +/- 0.10, N = 12SE +/- 0.08, N = 1210.309.959.99MIN: 9.3 / MAX: 33.6MIN: 9.19 / MAX: 11.7MIN: 9.31 / MAX: 48.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v3326220R 2P3691215SE +/- 0.17, N = 6SE +/- 0.09, N = 12SE +/- 0.07, N = 129.729.469.48MIN: 8.92 / MAX: 15.71MIN: 8.8 / MAX: 41.14MIN: 8.9 / MAX: 35.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v2326220R 2P3691215SE +/- 0.22, N = 6SE +/- 0.12, N = 12SE +/- 0.08, N = 129.479.439.21MIN: 8.58 / MAX: 10.95MIN: 8.76 / MAX: 11.38MIN: 8.61 / MAX: 10.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnet326220R 2P3691215SE +/- 0.12, N = 5SE +/- 0.06, N = 12SE +/- 0.07, N = 129.569.309.19MIN: 9.12 / MAX: 11.47MIN: 8.74 / MAX: 28.11MIN: 8.67 / MAX: 27.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b0326220R 2P3691215SE +/- 0.29, N = 6SE +/- 0.06, N = 12SE +/- 0.12, N = 1213.1312.9412.77MIN: 11.83 / MAX: 71.59MIN: 12.12 / MAX: 44.83MIN: 11.83 / MAX: 43.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazeface326220R 2P0.96531.93062.89593.86124.8265SE +/- 0.08, N = 6SE +/- 0.03, N = 12SE +/- 0.04, N = 124.294.234.19MIN: 3.93 / MAX: 8.37MIN: 3.95 / MAX: 6.26MIN: 3.89 / MAX: 42.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenet326220R 2P1326395265SE +/- 0.41, N = 6SE +/- 0.26, N = 12SE +/- 0.28, N = 1257.8157.4257.54MIN: 55.4 / MAX: 94.13MIN: 55.71 / MAX: 81.84MIN: 55.46 / MAX: 458.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg16326220R 2P20406080100SE +/- 0.89, N = 6SE +/- 0.40, N = 12SE +/- 0.78, N = 12102.15104.82102.80MIN: 89.11 / MAX: 273.09MIN: 91.31 / MAX: 289.03MIN: 84.67 / MAX: 259.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet18326220R 2P612182430SE +/- 0.54, N = 6SE +/- 0.21, N = 11SE +/- 0.21, N = 1224.8323.9624.14MIN: 22.66 / MAX: 73.09MIN: 22.8 / MAX: 84.65MIN: 22.38 / MAX: 78.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnet326220R 2P3691215SE +/- 0.14, N = 6SE +/- 0.07, N = 12SE +/- 0.08, N = 1210.7810.7310.87MIN: 10.45 / MAX: 14.82MIN: 10.42 / MAX: 13.03MIN: 10.41 / MAX: 14.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet50326220R 2P20406080100SE +/- 0.99, N = 6SE +/- 0.46, N = 12SE +/- 0.68, N = 1286.5885.7285.92MIN: 80.65 / MAX: 1155.83MIN: 81.78 / MAX: 866.28MIN: 81.34 / MAX: 1417.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tiny326220R 2P816243240SE +/- 0.78, N = 6SE +/- 0.69, N = 12SE +/- 0.69, N = 1233.6634.5234.04MIN: 31.11 / MAX: 80.99MIN: 31.88 / MAX: 76.98MIN: 31.26 / MAX: 78.161. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

TNN

TNN is an open-source deep learning reasoning framework developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: MobileNet v23280160240320400SE +/- 3.37, N = 3SE +/- 1.51, N = 3387.47381.09MIN: 377.31 / MAX: 554.07MIN: 376.85 / MAX: 573.681. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: SqueezeNet v1.13280160240320400SE +/- 0.05, N = 3SE +/- 0.05, N = 3345.95345.78MIN: 345.27 / MAX: 354.41MIN: 345.28 / MAX: 351.251. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl

52 Results Shown

PostgreSQL pgbench:
  1 - 50 - Read Only
  1 - 50 - Read Only - Average Latency
  1 - 100 - Read Only
  1 - 100 - Read Only - Average Latency
  1 - 250 - Read Only
  1 - 250 - Read Only - Average Latency
  1 - 50 - Read Write
  1 - 50 - Read Write - Average Latency
  1 - 100 - Read Write
  1 - 100 - Read Write - Average Latency
  1 - 250 - Read Write
  1 - 250 - Read Write - Average Latency
  100 - 50 - Read Only
  100 - 50 - Read Only - Average Latency
  100 - 100 - Read Only
  100 - 100 - Read Only - Average Latency
  100 - 250 - Read Only
  100 - 250 - Read Only - Average Latency
  100 - 50 - Read Write
  100 - 50 - Read Write - Average Latency
  1000 - 50 - Read Only
  1000 - 50 - Read Only - Average Latency
  100 - 100 - Read Write
  100 - 100 - Read Write - Average Latency
  100 - 250 - Read Write
  100 - 250 - Read Write - Average Latency
  1000 - 100 - Read Only
  1000 - 100 - Read Only - Average Latency
  1000 - 250 - Read Only
  1000 - 250 - Read Only - Average Latency
  1000 - 50 - Read Write
  1000 - 50 - Read Write - Average Latency
  1000 - 100 - Read Write
  1000 - 100 - Read Write - Average Latency
  1000 - 250 - Read Write
  1000 - 250 - Read Write - Average Latency
NCNN:
  CPU - squeezenet
  CPU - mobilenet
  CPU-v2-v2 - mobilenet-v2
  CPU-v3-v3 - mobilenet-v3
  CPU - shufflenet-v2
  CPU - mnasnet
  CPU - efficientnet-b0
  CPU - blazeface
  CPU - googlenet
  CPU - vgg16
  CPU - resnet18
  CPU - alexnet
  CPU - resnet50
  CPU - yolov4-tiny
TNN:
  CPU - MobileNet v2
  CPU - SqueezeNet v1.1

6220R 2P

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x5002f01
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 24 September 2020 14:48 by user phoronix.

2

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x5002f01
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 24 September 2020 19:01 by user phoronix.

3

Processor: 2 x Intel Xeon Gold 5220R @ 3.90GHz (36 Cores / 72 Threads), Motherboard: TYAN S7106 (V2.01.B40 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 94GB, Disk: 500GB Samsung SSD 860, Graphics: llvmpipe, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE

OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc6-generic (x86_64) 20200920, Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x5002f01
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 25 September 2020 05:59 by user phoronix.