NCNN Postgres 13

2 x Intel Xeon Gold 5220R testing with a TYAN S7106 (V2.01.B40 BIOS) and llvmpipe on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2009256-FI-NCNNPOSTG58&gru.

NCNN Postgres 13ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen Resolution6220R 2P232 x Intel Xeon Gold 5220R @ 3.90GHz (36 Cores / 72 Threads)TYAN S7106 (V2.01.B40 BIOS)Intel Sky Lake-E DMI3 Registers94GB500GB Samsung SSD 860llvmpipeVE2282 x Intel I210 + 2 x QLogic cLOM8214 1/10GbEUbuntu 20.045.9.0-050900rc6-generic (x86_64) 20200920GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.83.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits)GCC 9.3.0ext41920x1080OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x5002f01Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

NCNN Postgres 13pgbench: 1 - 50 - Read Onlypgbench: 1 - 100 - Read Onlypgbench: 1 - 250 - Read Onlypgbench: 1 - 50 - Read Writepgbench: 1 - 100 - Read Writepgbench: 1 - 250 - Read Writepgbench: 100 - 50 - Read Onlypgbench: 100 - 100 - Read Onlypgbench: 100 - 250 - Read Onlypgbench: 100 - 50 - Read Writepgbench: 1000 - 50 - Read Onlypgbench: 100 - 100 - Read Writepgbench: 100 - 250 - Read Writepgbench: 1000 - 100 - Read Onlypgbench: 1000 - 250 - Read Onlypgbench: 1000 - 50 - Read Writepgbench: 1000 - 100 - Read Writepgbench: 1000 - 250 - Read Writepgbench: 1 - 50 - Read Only - Average Latencypgbench: 1 - 100 - Read Only - Average Latencypgbench: 1 - 250 - Read Only - Average Latencypgbench: 1 - 50 - Read Write - Average Latencypgbench: 1 - 100 - Read Write - Average Latencypgbench: 1 - 250 - Read Write - Average Latencypgbench: 100 - 50 - Read Only - Average Latencypgbench: 100 - 100 - Read Only - Average Latencypgbench: 100 - 250 - Read Only - Average Latencypgbench: 100 - 50 - Read Write - Average Latencypgbench: 1000 - 50 - Read Only - Average Latencypgbench: 100 - 100 - Read Write - Average Latencypgbench: 100 - 250 - Read Write - Average Latencypgbench: 1000 - 100 - Read Only - Average Latencypgbench: 1000 - 250 - Read Only - Average Latencypgbench: 1000 - 50 - Read Write - Average Latencypgbench: 1000 - 100 - Read Write - Average Latencypgbench: 1000 - 250 - Read Write - Average Latencyncnn: CPU - squeezenetncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinytnn: CPU - MobileNet v2tnn: CPU - SqueezeNet v1.16220R 2P236401478997667779627957433335292136289626193193317505052394845096108175794963620429053440.0780.1110.32262.952134.870827.8080.0950.1590.40415.1800.09925.48055.5740.1640.43213.84423.35647.10256.6923.179.999.489.219.1912.774.1957.54102.8024.1410.8785.9234.046400959193937744477897244265292616276326191283557505403426245206086255690213662438249140.0780.1090.32463.407138.256697.1500.0940.1600.40514.0720.09923.57155.7230.1640.44013.71122.85451.33255.7923.279.959.469.439.3012.944.2357.42104.8223.9610.7385.7234.52381.089345.7786405199009977822968135272715297836280176223853453505060392743476088035732523733440250540.0780.1110.32061.565234.021923.6230.0940.1600.40214.7540.09925.50858.0950.1640.43713.46722.82549.65856.0823.5110.309.729.479.5613.134.2957.81102.1524.8310.7886.5833.66387.466345.947OpenBenchmarking.org

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 50 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 50 - Mode: Read Only6220R 2P23140K280K420K560K700KSE +/- 105.30, N = 3SE +/- 489.94, N = 3SE +/- 150.85, N = 36401476400956405191. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 100 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Only6220R 2P23200K400K600K800K1000KSE +/- 5164.98, N = 3SE +/- 3731.23, N = 3SE +/- 5122.70, N = 38997669193939009971. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 250 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 250 - Mode: Read Only6220R 2P23200K400K600K800K1000KSE +/- 11527.76, N = 3SE +/- 8768.63, N = 3SE +/- 4076.73, N = 37779627744477822961. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 50 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 50 - Mode: Read Write6220R 2P232004006008001000SE +/- 4.67, N = 3SE +/- 7.39, N = 3SE +/- 7.54, N = 37957898131. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 100 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Write6220R 2P23160320480640800SE +/- 2.97, N = 3SE +/- 3.80, N = 3SE +/- 66.83, N = 127437245271. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 250 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 250 - Mode: Read Write6220R 2P2390180270360450SE +/- 36.35, N = 15SE +/- 56.36, N = 12SE +/- 2.48, N = 103334262711. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 50 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 50 - Mode: Read Only6220R 2P23110K220K330K440K550KSE +/- 830.17, N = 3SE +/- 811.33, N = 3SE +/- 122.04, N = 35292135292615297831. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 100 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 100 - Mode: Read Only6220R 2P23130K260K390K520K650KSE +/- 3379.32, N = 3SE +/- 2142.81, N = 3SE +/- 2969.80, N = 36289626276326280171. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 250 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 250 - Mode: Read Only6220R 2P23130K260K390K520K650KSE +/- 2959.46, N = 3SE +/- 3164.52, N = 3SE +/- 3862.57, N = 36193196191286223851. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 50 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 50 - Mode: Read Write6220R 2P238001600240032004000SE +/- 70.43, N = 15SE +/- 48.14, N = 3SE +/- 124.76, N = 153317355734531. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1000 - Clients: 50 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 50 - Mode: Read Only6220R 2P23110K220K330K440K550KSE +/- 466.00, N = 3SE +/- 1094.28, N = 3SE +/- 812.23, N = 35050525054035050601. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 100 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 100 - Mode: Read Write6220R 2P239001800270036004500SE +/- 69.23, N = 15SE +/- 69.80, N = 12SE +/- 51.38, N = 33948426239271. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 250 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 250 - Mode: Read Write6220R 2P2310002000300040005000SE +/- 41.20, N = 3SE +/- 87.11, N = 15SE +/- 97.14, N = 154509452043471. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1000 - Clients: 100 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 100 - Mode: Read Only6220R 2P23130K260K390K520K650KSE +/- 1389.33, N = 3SE +/- 750.97, N = 3SE +/- 1549.52, N = 36108176086256088031. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1000 - Clients: 250 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 250 - Mode: Read Only6220R 2P23120K240K360K480K600KSE +/- 3053.06, N = 3SE +/- 4757.21, N = 3SE +/- 9194.46, N = 35794965690215732521. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1000 - Clients: 50 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 50 - Mode: Read Write6220R 2P238001600240032004000SE +/- 50.03, N = 9SE +/- 75.28, N = 9SE +/- 86.17, N = 93620366237331. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1000 - Clients: 100 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 100 - Mode: Read Write6220R 2P239001800270036004500SE +/- 56.62, N = 4SE +/- 14.71, N = 3SE +/- 90.74, N = 94290438244021. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1000 - Clients: 250 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 250 - Mode: Read Write6220R 2P2311002200330044005500SE +/- 159.21, N = 6SE +/- 135.22, N = 9SE +/- 70.36, N = 95344491450541. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 50 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 50 - Mode: Read Only - Average Latency6220R 2P230.01760.03520.05280.07040.088SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0780.0780.0781. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency6220R 2P230.0250.050.0750.10.125SE +/- 0.001, N = 3SE +/- 0.001, N = 3SE +/- 0.001, N = 30.1110.1090.1111. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 250 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 250 - Mode: Read Only - Average Latency6220R 2P230.07290.14580.21870.29160.3645SE +/- 0.005, N = 3SE +/- 0.004, N = 3SE +/- 0.002, N = 30.3220.3240.3201. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 50 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 50 - Mode: Read Write - Average Latency6220R 2P231428425670SE +/- 0.37, N = 3SE +/- 0.60, N = 3SE +/- 0.57, N = 362.9563.4161.571. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency6220R 2P2350100150200250SE +/- 0.53, N = 3SE +/- 0.72, N = 3SE +/- 31.73, N = 12134.87138.26234.021. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 250 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 250 - Mode: Read Write - Average Latency6220R 2P232004006008001000SE +/- 48.84, N = 15SE +/- 76.09, N = 12SE +/- 8.78, N = 10827.81697.15923.621. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 50 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 50 - Mode: Read Only - Average Latency6220R 2P230.02140.04280.06420.08560.107SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0950.0940.0941. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency6220R 2P230.0360.0720.1080.1440.18SE +/- 0.001, N = 3SE +/- 0.000, N = 3SE +/- 0.001, N = 30.1590.1600.1601. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average Latency6220R 2P230.09110.18220.27330.36440.4555SE +/- 0.002, N = 3SE +/- 0.002, N = 3SE +/- 0.003, N = 30.4040.4050.4021. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 50 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 50 - Mode: Read Write - Average Latency6220R 2P2348121620SE +/- 0.33, N = 15SE +/- 0.19, N = 3SE +/- 0.54, N = 1515.1814.0714.751. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1000 - Clients: 50 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 50 - Mode: Read Only - Average Latency6220R 2P230.02230.04460.06690.08920.1115SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0990.0990.0991. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency6220R 2P23612182430SE +/- 0.46, N = 15SE +/- 0.38, N = 12SE +/- 0.33, N = 325.4823.5725.511. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average Latency6220R 2P231326395265SE +/- 0.51, N = 3SE +/- 1.09, N = 15SE +/- 1.48, N = 1555.5755.7258.101. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1000 - Clients: 100 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 100 - Mode: Read Only - Average Latency6220R 2P230.03690.07380.11070.14760.1845SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.1640.1640.1641. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1000 - Clients: 250 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 250 - Mode: Read Only - Average Latency6220R 2P230.0990.1980.2970.3960.495SE +/- 0.002, N = 3SE +/- 0.004, N = 3SE +/- 0.007, N = 30.4320.4400.4371. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1000 - Clients: 50 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 50 - Mode: Read Write - Average Latency6220R 2P2348121620SE +/- 0.19, N = 9SE +/- 0.30, N = 9SE +/- 0.34, N = 913.8413.7113.471. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1000 - Clients: 100 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 100 - Mode: Read Write - Average Latency6220R 2P23612182430SE +/- 0.31, N = 4SE +/- 0.08, N = 3SE +/- 0.46, N = 923.3622.8522.831. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL pgbench

Scaling Factor: 1000 - Clients: 250 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1000 - Clients: 250 - Mode: Read Write - Average Latency6220R 2P231224364860SE +/- 1.47, N = 6SE +/- 1.55, N = 9SE +/- 0.67, N = 947.1051.3349.661. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

NCNN

Target: CPU - Model: squeezenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenet6220R 2P231326395265SE +/- 0.77, N = 12SE +/- 0.95, N = 12SE +/- 0.68, N = 656.6955.7956.08MIN: 48.25 / MAX: 879.95MIN: 50.4 / MAX: 557.87MIN: 50.11 / MAX: 859.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenet6220R 2P23612182430SE +/- 0.09, N = 12SE +/- 0.14, N = 12SE +/- 0.21, N = 623.1723.2723.51MIN: 22.61 / MAX: 48.78MIN: 22.51 / MAX: 44.41MIN: 22.93 / MAX: 61.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v26220R 2P233691215SE +/- 0.08, N = 12SE +/- 0.10, N = 12SE +/- 0.22, N = 69.999.9510.30MIN: 9.31 / MAX: 48.12MIN: 9.19 / MAX: 11.7MIN: 9.3 / MAX: 33.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v36220R 2P233691215SE +/- 0.07, N = 12SE +/- 0.09, N = 12SE +/- 0.17, N = 69.489.469.72MIN: 8.9 / MAX: 35.25MIN: 8.8 / MAX: 41.14MIN: 8.92 / MAX: 15.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v26220R 2P233691215SE +/- 0.08, N = 12SE +/- 0.12, N = 12SE +/- 0.22, N = 69.219.439.47MIN: 8.61 / MAX: 10.89MIN: 8.76 / MAX: 11.38MIN: 8.58 / MAX: 10.951. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnet6220R 2P233691215SE +/- 0.07, N = 12SE +/- 0.06, N = 12SE +/- 0.12, N = 59.199.309.56MIN: 8.67 / MAX: 27.82MIN: 8.74 / MAX: 28.11MIN: 9.12 / MAX: 11.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b06220R 2P233691215SE +/- 0.12, N = 12SE +/- 0.06, N = 12SE +/- 0.29, N = 612.7712.9413.13MIN: 11.83 / MAX: 43.9MIN: 12.12 / MAX: 44.83MIN: 11.83 / MAX: 71.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazeface6220R 2P230.96531.93062.89593.86124.8265SE +/- 0.04, N = 12SE +/- 0.03, N = 12SE +/- 0.08, N = 64.194.234.29MIN: 3.89 / MAX: 42.45MIN: 3.95 / MAX: 6.26MIN: 3.93 / MAX: 8.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenet6220R 2P231326395265SE +/- 0.28, N = 12SE +/- 0.26, N = 12SE +/- 0.41, N = 657.5457.4257.81MIN: 55.46 / MAX: 458.06MIN: 55.71 / MAX: 81.84MIN: 55.4 / MAX: 94.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg166220R 2P2320406080100SE +/- 0.78, N = 12SE +/- 0.40, N = 12SE +/- 0.89, N = 6102.80104.82102.15MIN: 84.67 / MAX: 259.76MIN: 91.31 / MAX: 289.03MIN: 89.11 / MAX: 273.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet186220R 2P23612182430SE +/- 0.21, N = 12SE +/- 0.21, N = 11SE +/- 0.54, N = 624.1423.9624.83MIN: 22.38 / MAX: 78.32MIN: 22.8 / MAX: 84.65MIN: 22.66 / MAX: 73.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnet6220R 2P233691215SE +/- 0.08, N = 12SE +/- 0.07, N = 12SE +/- 0.14, N = 610.8710.7310.78MIN: 10.41 / MAX: 14.9MIN: 10.42 / MAX: 13.03MIN: 10.45 / MAX: 14.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet506220R 2P2320406080100SE +/- 0.68, N = 12SE +/- 0.46, N = 12SE +/- 0.99, N = 685.9285.7286.58MIN: 81.34 / MAX: 1417.73MIN: 81.78 / MAX: 866.28MIN: 80.65 / MAX: 1155.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tiny6220R 2P23816243240SE +/- 0.69, N = 12SE +/- 0.69, N = 12SE +/- 0.78, N = 634.0434.5233.66MIN: 31.26 / MAX: 78.16MIN: 31.88 / MAX: 76.98MIN: 31.11 / MAX: 80.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

TNN

Target: CPU - Model: MobileNet v2

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: MobileNet v22380160240320400SE +/- 1.51, N = 3SE +/- 3.37, N = 3381.09387.47MIN: 376.85 / MAX: 573.68MIN: 377.31 / MAX: 554.071. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl

TNN

Target: CPU - Model: SqueezeNet v1.1

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: SqueezeNet v1.12380160240320400SE +/- 0.05, N = 3SE +/- 0.05, N = 3345.78345.95MIN: 345.28 / MAX: 351.25MIN: 345.27 / MAX: 354.411. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl

Phoronix Test Suite v10.8.4