NCNN Postgres 13

2 x Intel Xeon Gold 5220R testing with a TYAN S7106 (V2.01.B40 BIOS) and llvmpipe on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2009256-FI-NCNNPOSTG58
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

HPC - High Performance Computing 2 Tests
Machine Learning 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
6220R 2P
September 24 2020
  14 Hours, 55 Minutes
2
September 24 2020
  15 Hours, 8 Minutes
3
September 25 2020
  12 Hours, 30 Minutes
Invert Hiding All Results Option
  14 Hours, 11 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

6220R 2P

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x5002f01
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

2

3

Processor: 2 x Intel Xeon Gold 5220R @ 3.90GHz (36 Cores / 72 Threads), Motherboard: TYAN S7106 (V2.01.B40 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 94GB, Disk: 500GB Samsung SSD 860, Graphics: llvmpipe, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE

OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc6-generic (x86_64) 20200920, Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

NCNN Postgres 13ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen Resolution6220R 2P232 x Intel Xeon Gold 5220R @ 3.90GHz (36 Cores / 72 Threads)TYAN S7106 (V2.01.B40 BIOS)Intel Sky Lake-E DMI3 Registers94GB500GB Samsung SSD 860llvmpipeVE2282 x Intel I210 + 2 x QLogic cLOM8214 1/10GbEUbuntu 20.045.9.0-050900rc6-generic (x86_64) 20200920GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.83.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits)GCC 9.3.0ext41920x1080OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x5002f01Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

6220R 2P23Result OverviewPhoronix Test Suite100%118%137%155%PostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchNCNNPostgreSQL pgbenchNCNNNCNNPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchNCNNNCNNPostgreSQL pgbenchNCNNNCNNPostgreSQL pgbenchNCNNNCNNPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchNCNNNCNNNCNNPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchNCNNPostgreSQL pgbenchNCNNPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbenchPostgreSQL pgbench1 - 100 - Read Write - Average Latency1 - 250 - Read Write1 - 100 - Read Write1 - 250 - Read Write - Average Latency1000 - 250 - Read Write - Average Latency1000 - 250 - Read Write100 - 100 - Read Write100 - 100 - Read Write - Average Latency100 - 50 - Read Write - Average Latency100 - 50 - Read Write100 - 250 - Read Write - Average LatencyCPU - mnasnet100 - 250 - Read WriteCPU - resnet18CPU-v2-v2 - mobilenet-v21000 - 50 - Read Write1 - 50 - Read Write1 - 50 - Read Write - Average LatencyCPU - shufflenet-v2CPU - efficientnet-b01000 - 50 - Read Write - Average LatencyCPU-v3-v3 - mobilenet-v3CPU - vgg161000 - 100 - Read WriteCPU - yolov4-tinyCPU - blazeface1000 - 100 - Read Write - Average Latency1 - 100 - Read Only1000 - 250 - Read Only - Average Latency1000 - 250 - Read Only1 - 100 - Read Only - Average LatencyCPU - squeezenetCPU - mobilenetCPU - alexnet1 - 250 - Read Only - Average Latency100 - 50 - Read Only - Average Latency1 - 250 - Read OnlyCPU - resnet50100 - 250 - Read Only - Average LatencyCPU - googlenet100 - 100 - Read Only - Average Latency100 - 250 - Read Only1000 - 100 - Read Only100 - 100 - Read Only100 - 50 - Read Only1000 - 50 - Read Only1 - 50 - Read Only1 - 50 - Read Only - Average Latency1000 - 50 - Read Only - Average Latency1000 - 100 - Read Only - Average Latency

NCNN Postgres 13ncnn: CPU - squeezenetncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinypgbench: 1 - 50 - Read Onlypgbench: 1 - 50 - Read Only - Average Latencypgbench: 1 - 100 - Read Onlypgbench: 1 - 100 - Read Only - Average Latencypgbench: 1 - 250 - Read Onlypgbench: 1 - 250 - Read Only - Average Latencypgbench: 1 - 50 - Read Writepgbench: 1 - 50 - Read Write - Average Latencypgbench: 1 - 100 - Read Writepgbench: 1 - 100 - Read Write - Average Latencypgbench: 1 - 250 - Read Writepgbench: 1 - 250 - Read Write - Average Latencypgbench: 100 - 50 - Read Onlypgbench: 100 - 50 - Read Only - Average Latencypgbench: 100 - 100 - Read Onlypgbench: 100 - 100 - Read Only - Average Latencypgbench: 100 - 250 - Read Onlypgbench: 100 - 250 - Read Only - Average Latencypgbench: 100 - 50 - Read Writepgbench: 100 - 50 - Read Write - Average Latencypgbench: 1000 - 50 - Read Onlypgbench: 1000 - 50 - Read Only - Average Latencypgbench: 100 - 100 - Read Writepgbench: 100 - 100 - Read Write - Average Latencypgbench: 100 - 250 - Read Writepgbench: 100 - 250 - Read Write - Average Latencypgbench: 1000 - 100 - Read Onlypgbench: 1000 - 100 - Read Only - Average Latencypgbench: 1000 - 250 - Read Onlypgbench: 1000 - 250 - Read Only - Average Latencypgbench: 1000 - 50 - Read Writepgbench: 1000 - 50 - Read Write - Average Latencypgbench: 1000 - 100 - Read Writepgbench: 1000 - 100 - Read Write - Average Latencypgbench: 1000 - 250 - Read Writepgbench: 1000 - 250 - Read Write - Average Latencytnn: CPU - MobileNet v2tnn: CPU - SqueezeNet v1.16220R 2P2356.6923.179.999.489.219.1912.774.1957.54102.8024.1410.8785.9234.046401470.0788997660.1117779620.32279562.952743134.870333827.8085292130.0956289620.1596193190.404331715.1805050520.099394825.480450955.5746108170.1645794960.432362013.844429023.356534447.10255.7923.279.959.469.439.3012.944.2357.42104.8223.9610.7385.7234.526400950.0789193930.1097744470.32478963.407724138.256426697.1505292610.0946276320.1606191280.405355714.0725054030.099426223.571452055.7236086250.1645690210.440366213.711438222.854491451.332381.089345.77856.0823.5110.309.729.479.5613.134.2957.81102.1524.8310.7886.5833.666405190.0789009970.1117822960.32081361.565527234.021271923.6235297830.0946280170.1606223850.402345314.7545050600.099392725.508434758.0956088030.1645732520.437373313.467440222.825505449.658387.466345.947OpenBenchmarking.org

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenet236220R 2P1326395265SE +/- 0.95, N = 12SE +/- 0.68, N = 6SE +/- 0.77, N = 1255.7956.0856.69MIN: 50.4 / MAX: 557.87MIN: 50.11 / MAX: 859.51MIN: 48.25 / MAX: 879.951. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenet6220R 2P23612182430SE +/- 0.09, N = 12SE +/- 0.14, N = 12SE +/- 0.21, N = 623.1723.2723.51MIN: 22.61 / MAX: 48.78MIN: 22.51 / MAX: 44.41MIN: 22.93 / MAX: 61.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v226220R 2P33691215SE +/- 0.10, N = 12SE +/- 0.08, N = 12SE +/- 0.22, N = 69.959.9910.30MIN: 9.19 / MAX: 11.7MIN: 9.31 / MAX: 48.12MIN: 9.3 / MAX: 33.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v326220R 2P33691215SE +/- 0.09, N = 12SE +/- 0.07, N = 12SE +/- 0.17, N = 69.469.489.72MIN: 8.8 / MAX: 41.14MIN: 8.9 / MAX: 35.25MIN: 8.92 / MAX: 15.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v26220R 2P233691215SE +/- 0.08, N = 12SE +/- 0.12, N = 12SE +/- 0.22, N = 69.219.439.47MIN: 8.61 / MAX: 10.89MIN: 8.76 / MAX: 11.38MIN: 8.58 / MAX: 10.951. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnet6220R 2P233691215SE +/- 0.07, N = 12SE +/- 0.06, N = 12SE +/- 0.12, N = 59.199.309.56MIN: 8.67 / MAX: 27.82MIN: 8.74 / MAX: 28.11MIN: 9.12 / MAX: 11.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b06220R 2P233691215SE +/- 0.12, N = 12SE +/- 0.06, N = 12SE +/- 0.29, N = 612.7712.9413.13MIN: 11.83 / MAX: 43.9MIN: 12.12 / MAX: 44.83MIN: 11.83 / MAX: 71.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazeface6220R 2P230.96531.93062.89593.86124.8265SE +/- 0.04, N = 12SE +/- 0.03, N = 12SE +/- 0.08, N = 64.194.234.29MIN: 3.89 / MAX: 42.45MIN: 3.95 / MAX: 6.26MIN: 3.93 / MAX: 8.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenet26220R 2P31326395265SE +/- 0.26, N = 12SE +/- 0.28, N = 12SE +/- 0.41, N = 657.4257.5457.81MIN: 55.71 / MAX: 81.84MIN: 55.46 / MAX: 458.06MIN: 55.4 / MAX: 94.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg1636220R 2P220406080100SE +/- 0.89, N = 6SE +/- 0.78, N = 12SE +/- 0.40, N = 12102.15102.80104.82MIN: 89.11 / MAX: 273.09MIN: 84.67 / MAX: 259.76MIN: 91.31 / MAX: 289.031. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet1826220R 2P3612182430SE +/- 0.21, N = 11SE +/- 0.21, N = 12SE +/- 0.54, N = 623.9624.1424.83MIN: 22.8 / MAX: 84.65MIN: 22.38 / MAX: 78.32MIN: 22.66 / MAX: 73.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnet236220R 2P3691215SE +/- 0.07, N = 12SE +/- 0.14, N = 6SE +/- 0.08, N = 1210.7310.7810.87MIN: 10.42 / MAX: 13.03MIN: 10.45 / MAX: 14.82MIN: 10.41 / MAX: 14.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet5026220R 2P320406080100SE +/- 0.46, N = 12SE +/- 0.68, N = 12SE +/- 0.99, N = 685.7285.9286.58MIN: 81.78 / MAX: 866.28MIN: 81.34 / MAX: 1417.73MIN: 80.65 / MAX: 1155.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tiny36220R 2P2816243240SE +/- 0.78, N = 6SE +/- 0.69, N = 12SE +/- 0.69, N = 1233.6634.0434.52MIN: 31.11 / MAX: 80.99MIN: 31.26 / MAX: 78.16MIN: 31.88 / MAX: 76.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

PostgreSQL pgbench

This is a benchmark of PostgreSQL using pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 50 - Mode: Read Only36220R 2P2140K280K420K560K700KSE +/- 150.85, N = 3SE +/- 105.30, N = 3SE +/- 489.94, N = 36405196401476400951. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 50 - Mode: Read Only - Average Latency6220R 2P230.01760.03520.05280.07040.088SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0780.0780.0781. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Only236220R 2P200K400K600K800K1000KSE +/- 3731.23, N = 3SE +/- 5122.70, N = 3SE +/- 5164.98, N = 39193939009978997661. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency26220R 2P30.0250.050.0750.10.125SE +/- 0.001, N = 3SE +/- 0.001, N = 3SE +/- 0.001, N = 30.1090.1110.1111. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 250 - Mode: Read Only36220R 2P2200K400K600K800K1000KSE +/- 4076.73, N = 3SE +/- 11527.76, N = 3SE +/- 8768.63, N = 37822967779627744471. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 250 - Mode: Read Only - Average Latency36220R 2P20.07290.14580.21870.29160.3645SE +/- 0.002, N = 3SE +/- 0.005, N = 3SE +/- 0.004, N = 30.3200.3220.3241. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 50 - Mode: Read Write36220R 2P22004006008001000SE +/- 7.54, N = 3SE +/- 4.67, N = 3SE +/- 7.39, N = 38137957891. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 50 - Mode: Read Write - Average Latency36220R 2P21428425670SE +/- 0.57, N = 3SE +/- 0.37, N = 3SE +/- 0.60, N = 361.5762.9563.411. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Write6220R 2P23160320480640800SE +/- 2.97, N = 3SE +/- 3.80, N = 3SE +/- 66.83, N = 127437245271. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency6220R 2P2350100150200250SE +/- 0.53, N = 3SE +/- 0.72, N = 3SE +/- 31.73, N = 12134.87138.26234.021. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 250 - Mode: Read Write26220R 2P390180270360450SE +/- 56.36, N = 12SE +/- 36.35, N = 15SE +/- 2.48, N = 104263332711. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 250 - Mode: Read Write - Average Latency26220R 2P32004006008001000SE +/- 76.09, N = 12SE +/- 48.84, N = 15SE +/- 8.78, N = 10697.15827.81923.621. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 50 - Mode: Read Only326220R 2P110K220K330K440K550KSE +/- 122.04, N = 3SE +/- 811.33, N = 3SE +/- 830.17, N = 35297835292615292131. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 50 - Mode: Read Only - Average Latency236220R 2P0.02140.04280.06420.08560.107SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0940.0940.0951. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 100 - Mode: Read Only6220R 2P32130K260K390K520K650KSE +/- 3379.32, N = 3SE +/- 2969.80, N = 3SE +/- 2142.81, N = 36289626280176276321. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency6220R 2P230.0360.0720.1080.1440.18SE +/- 0.001, N = 3SE +/- 0.000, N = 3SE +/- 0.001, N = 30.1590.1600.1601. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 250 - Mode: Read Only36220R 2P2130K260K390K520K650KSE +/- 3862.57, N = 3SE +/- 2959.46, N = 3SE +/- 3164.52, N = 36223856193196191281. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average Latency36220R 2P20.09110.18220.27330.36440.4555SE +/- 0.003, N = 3SE +/- 0.002, N = 3SE +/- 0.002, N = 30.4020.4040.4051. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 50 - Mode: Read Write236220R 2P8001600240032004000SE +/- 48.14, N = 3SE +/- 124.76, N = 15SE +/- 70.43, N = 153557345333171. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 50 - Mode: Read Write - Average Latency236220R 2P48121620SE +/- 0.19, N = 3SE +/- 0.54, N = 15SE +/- 0.33, N = 1514.0714.7515.181. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 50 - Mode: Read Only236220R 2P110K220K330K440K550KSE +/- 1094.28, N = 3SE +/- 812.23, N = 3SE +/- 466.00, N = 35054035050605050521. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 50 - Mode: Read Only - Average Latency6220R 2P230.02230.04460.06690.08920.1115SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0990.0990.0991. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 100 - Mode: Read Write26220R 2P39001800270036004500SE +/- 69.80, N = 12SE +/- 69.23, N = 15SE +/- 51.38, N = 34262394839271. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency26220R 2P3612182430SE +/- 0.38, N = 12SE +/- 0.46, N = 15SE +/- 0.33, N = 323.5725.4825.511. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 250 - Mode: Read Write26220R 2P310002000300040005000SE +/- 87.11, N = 15SE +/- 41.20, N = 3SE +/- 97.14, N = 154520450943471. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average Latency6220R 2P231326395265SE +/- 0.51, N = 3SE +/- 1.09, N = 15SE +/- 1.48, N = 1555.5755.7258.101. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 100 - Mode: Read Only6220R 2P32130K260K390K520K650KSE +/- 1389.33, N = 3SE +/- 1549.52, N = 3SE +/- 750.97, N = 36108176088036086251. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 100 - Mode: Read Only - Average Latency6220R 2P230.03690.07380.11070.14760.1845SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.1640.1640.1641. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 250 - Mode: Read Only6220R 2P32120K240K360K480K600KSE +/- 3053.06, N = 3SE +/- 9194.46, N = 3SE +/- 4757.21, N = 35794965732525690211. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 250 - Mode: Read Only - Average Latency6220R 2P320.0990.1980.2970.3960.495SE +/- 0.002, N = 3SE +/- 0.007, N = 3SE +/- 0.004, N = 30.4320.4370.4401. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 50 - Mode: Read Write326220R 2P8001600240032004000SE +/- 86.17, N = 9SE +/- 75.28, N = 9SE +/- 50.03, N = 93733366236201. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 50 - Mode: Read Write - Average Latency326220R 2P48121620SE +/- 0.34, N = 9SE +/- 0.30, N = 9SE +/- 0.19, N = 913.4713.7113.841. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 100 - Mode: Read Write326220R 2P9001800270036004500SE +/- 90.74, N = 9SE +/- 14.71, N = 3SE +/- 56.62, N = 44402438242901. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 100 - Mode: Read Write - Average Latency326220R 2P612182430SE +/- 0.46, N = 9SE +/- 0.08, N = 3SE +/- 0.31, N = 422.8322.8523.361. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 250 - Mode: Read Write6220R 2P3211002200330044005500SE +/- 159.21, N = 6SE +/- 70.36, N = 9SE +/- 135.22, N = 95344505449141. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 250 - Mode: Read Write - Average Latency6220R 2P321224364860SE +/- 1.47, N = 6SE +/- 0.67, N = 9SE +/- 1.55, N = 947.1049.6651.331. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

TNN

TNN is an open-source deep learning reasoning framework developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: MobileNet v22380160240320400SE +/- 1.51, N = 3SE +/- 3.37, N = 3381.09387.47MIN: 376.85 / MAX: 573.68MIN: 377.31 / MAX: 554.071. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: SqueezeNet v1.12380160240320400SE +/- 0.05, N = 3SE +/- 0.05, N = 3345.78345.95MIN: 345.28 / MAX: 351.25MIN: 345.27 / MAX: 354.411. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl

52 Results Shown

NCNN:
  CPU - squeezenet
  CPU - mobilenet
  CPU-v2-v2 - mobilenet-v2
  CPU-v3-v3 - mobilenet-v3
  CPU - shufflenet-v2
  CPU - mnasnet
  CPU - efficientnet-b0
  CPU - blazeface
  CPU - googlenet
  CPU - vgg16
  CPU - resnet18
  CPU - alexnet
  CPU - resnet50
  CPU - yolov4-tiny
PostgreSQL pgbench:
  1 - 50 - Read Only
  1 - 50 - Read Only - Average Latency
  1 - 100 - Read Only
  1 - 100 - Read Only - Average Latency
  1 - 250 - Read Only
  1 - 250 - Read Only - Average Latency
  1 - 50 - Read Write
  1 - 50 - Read Write - Average Latency
  1 - 100 - Read Write
  1 - 100 - Read Write - Average Latency
  1 - 250 - Read Write
  1 - 250 - Read Write - Average Latency
  100 - 50 - Read Only
  100 - 50 - Read Only - Average Latency
  100 - 100 - Read Only
  100 - 100 - Read Only - Average Latency
  100 - 250 - Read Only
  100 - 250 - Read Only - Average Latency
  100 - 50 - Read Write
  100 - 50 - Read Write - Average Latency
  1000 - 50 - Read Only
  1000 - 50 - Read Only - Average Latency
  100 - 100 - Read Write
  100 - 100 - Read Write - Average Latency
  100 - 250 - Read Write
  100 - 250 - Read Write - Average Latency
  1000 - 100 - Read Only
  1000 - 100 - Read Only - Average Latency
  1000 - 250 - Read Only
  1000 - 250 - Read Only - Average Latency
  1000 - 50 - Read Write
  1000 - 50 - Read Write - Average Latency
  1000 - 100 - Read Write
  1000 - 100 - Read Write - Average Latency
  1000 - 250 - Read Write
  1000 - 250 - Read Write - Average Latency
TNN:
  CPU - MobileNet v2
  CPU - SqueezeNet v1.1

6220R 2P

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x5002f01
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 24 September 2020 14:48 by user phoronix.

2

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x5002f01
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 24 September 2020 19:01 by user phoronix.

3

Processor: 2 x Intel Xeon Gold 5220R @ 3.90GHz (36 Cores / 72 Threads), Motherboard: TYAN S7106 (V2.01.B40 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 94GB, Disk: 500GB Samsung SSD 860, Graphics: llvmpipe, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE

OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc6-generic (x86_64) 20200920, Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x5002f01
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 25 September 2020 05:59 by user phoronix.