NCNN Postgres 13 2 x Intel Xeon Gold 5220R testing with a TYAN S7106 (V2.01.B40 BIOS) and llvmpipe on Ubuntu 20.04 via the Phoronix Test Suite. 6220R 2P: Processor: 2 x Intel Xeon Gold 5220R @ 3.90GHz (36 Cores / 72 Threads), Motherboard: TYAN S7106 (V2.01.B40 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 94GB, Disk: 500GB Samsung SSD 860, Graphics: llvmpipe, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc6-generic (x86_64) 20200920, Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 2: Processor: 2 x Intel Xeon Gold 5220R @ 3.90GHz (36 Cores / 72 Threads), Motherboard: TYAN S7106 (V2.01.B40 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 94GB, Disk: 500GB Samsung SSD 860, Graphics: llvmpipe, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc6-generic (x86_64) 20200920, Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 3: Processor: 2 x Intel Xeon Gold 5220R @ 3.90GHz (36 Cores / 72 Threads), Motherboard: TYAN S7106 (V2.01.B40 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 94GB, Disk: 500GB Samsung SSD 860, Graphics: llvmpipe, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc6-generic (x86_64) 20200920, Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 PostgreSQL pgbench 13.0 Scaling Factor: 1 - Clients: 50 - Mode: Read Only TPS > Higher Is Better 6220R 2P . 640147 |============================================================ 2 ........ 640095 |============================================================ 3 ........ 640519 |============================================================ PostgreSQL pgbench 13.0 Scaling Factor: 1 - Clients: 50 - Mode: Read Only - Average Latency ms < Lower Is Better 6220R 2P . 0.078 |============================================================= 2 ........ 0.078 |============================================================= 3 ........ 0.078 |============================================================= PostgreSQL pgbench 13.0 Scaling Factor: 1 - Clients: 100 - Mode: Read Only TPS > Higher Is Better 6220R 2P . 899766 |=========================================================== 2 ........ 919393 |============================================================ 3 ........ 900997 |=========================================================== PostgreSQL pgbench 13.0 Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency ms < Lower Is Better 6220R 2P . 0.111 |============================================================= 2 ........ 0.109 |============================================================ 3 ........ 0.111 |============================================================= PostgreSQL pgbench 13.0 Scaling Factor: 1 - Clients: 250 - Mode: Read Only TPS > Higher Is Better 6220R 2P . 777962 |============================================================ 2 ........ 774447 |=========================================================== 3 ........ 782296 |============================================================ PostgreSQL pgbench 13.0 Scaling Factor: 1 - Clients: 250 - Mode: Read Only - Average Latency ms < Lower Is Better 6220R 2P . 0.322 |============================================================= 2 ........ 0.324 |============================================================= 3 ........ 0.320 |============================================================ PostgreSQL pgbench 13.0 Scaling Factor: 1 - Clients: 50 - Mode: Read Write TPS > Higher Is Better 6220R 2P . 795 |============================================================== 2 ........ 789 |============================================================= 3 ........ 813 |=============================================================== PostgreSQL pgbench 13.0 Scaling Factor: 1 - Clients: 50 - Mode: Read Write - Average Latency ms < Lower Is Better 6220R 2P . 62.95 |============================================================= 2 ........ 63.41 |============================================================= 3 ........ 61.57 |=========================================================== PostgreSQL pgbench 13.0 Scaling Factor: 1 - Clients: 100 - Mode: Read Write TPS > Higher Is Better 6220R 2P . 743 |=============================================================== 2 ........ 724 |============================================================= 3 ........ 527 |============================================= PostgreSQL pgbench 13.0 Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency ms < Lower Is Better 6220R 2P . 134.87 |=================================== 2 ........ 138.26 |=================================== 3 ........ 234.02 |============================================================ PostgreSQL pgbench 13.0 Scaling Factor: 1 - Clients: 250 - Mode: Read Write TPS > Higher Is Better 6220R 2P . 333 |================================================= 2 ........ 426 |=============================================================== 3 ........ 271 |======================================== PostgreSQL pgbench 13.0 Scaling Factor: 1 - Clients: 250 - Mode: Read Write - Average Latency ms < Lower Is Better 6220R 2P . 827.81 |====================================================== 2 ........ 697.15 |============================================= 3 ........ 923.62 |============================================================ PostgreSQL pgbench 13.0 Scaling Factor: 100 - Clients: 50 - Mode: Read Only TPS > Higher Is Better 6220R 2P . 529213 |============================================================ 2 ........ 529261 |============================================================ 3 ........ 529783 |============================================================ PostgreSQL pgbench 13.0 Scaling Factor: 100 - Clients: 50 - Mode: Read Only - Average Latency ms < Lower Is Better 6220R 2P . 0.095 |============================================================= 2 ........ 0.094 |============================================================ 3 ........ 0.094 |============================================================ PostgreSQL pgbench 13.0 Scaling Factor: 100 - Clients: 100 - Mode: Read Only TPS > Higher Is Better 6220R 2P . 628962 |============================================================ 2 ........ 627632 |============================================================ 3 ........ 628017 |============================================================ PostgreSQL pgbench 13.0 Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency ms < Lower Is Better 6220R 2P . 0.159 |============================================================= 2 ........ 0.160 |============================================================= 3 ........ 0.160 |============================================================= PostgreSQL pgbench 13.0 Scaling Factor: 100 - Clients: 250 - Mode: Read Only TPS > Higher Is Better 6220R 2P . 619319 |============================================================ 2 ........ 619128 |============================================================ 3 ........ 622385 |============================================================ PostgreSQL pgbench 13.0 Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average Latency ms < Lower Is Better 6220R 2P . 0.404 |============================================================= 2 ........ 0.405 |============================================================= 3 ........ 0.402 |============================================================= PostgreSQL pgbench 13.0 Scaling Factor: 100 - Clients: 50 - Mode: Read Write TPS > Higher Is Better 6220R 2P . 3317 |========================================================== 2 ........ 3557 |============================================================== 3 ........ 3453 |============================================================ PostgreSQL pgbench 13.0 Scaling Factor: 100 - Clients: 50 - Mode: Read Write - Average Latency ms < Lower Is Better 6220R 2P . 15.18 |============================================================= 2 ........ 14.07 |========================================================= 3 ........ 14.75 |=========================================================== PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 50 - Mode: Read Only TPS > Higher Is Better 6220R 2P . 505052 |============================================================ 2 ........ 505403 |============================================================ 3 ........ 505060 |============================================================ PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 50 - Mode: Read Only - Average Latency ms < Lower Is Better 6220R 2P . 0.099 |============================================================= 2 ........ 0.099 |============================================================= 3 ........ 0.099 |============================================================= PostgreSQL pgbench 13.0 Scaling Factor: 100 - Clients: 100 - Mode: Read Write TPS > Higher Is Better 6220R 2P . 3948 |========================================================= 2 ........ 4262 |============================================================== 3 ........ 3927 |========================================================= PostgreSQL pgbench 13.0 Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency ms < Lower Is Better 6220R 2P . 25.48 |============================================================= 2 ........ 23.57 |======================================================== 3 ........ 25.51 |============================================================= PostgreSQL pgbench 13.0 Scaling Factor: 100 - Clients: 250 - Mode: Read Write TPS > Higher Is Better 6220R 2P . 4509 |============================================================== 2 ........ 4520 |============================================================== 3 ........ 4347 |============================================================ PostgreSQL pgbench 13.0 Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average Latency ms < Lower Is Better 6220R 2P . 55.57 |========================================================== 2 ........ 55.72 |=========================================================== 3 ........ 58.10 |============================================================= PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 100 - Mode: Read Only TPS > Higher Is Better 6220R 2P . 610817 |============================================================ 2 ........ 608625 |============================================================ 3 ........ 608803 |============================================================ PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 100 - Mode: Read Only - Average Latency ms < Lower Is Better 6220R 2P . 0.164 |============================================================= 2 ........ 0.164 |============================================================= 3 ........ 0.164 |============================================================= PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 250 - Mode: Read Only TPS > Higher Is Better 6220R 2P . 579496 |============================================================ 2 ........ 569021 |=========================================================== 3 ........ 573252 |=========================================================== PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 250 - Mode: Read Only - Average Latency ms < Lower Is Better 6220R 2P . 0.432 |============================================================ 2 ........ 0.440 |============================================================= 3 ........ 0.437 |============================================================= PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 50 - Mode: Read Write TPS > Higher Is Better 6220R 2P . 3620 |============================================================ 2 ........ 3662 |============================================================= 3 ........ 3733 |============================================================== PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 50 - Mode: Read Write - Average Latency ms < Lower Is Better 6220R 2P . 13.84 |============================================================= 2 ........ 13.71 |============================================================ 3 ........ 13.47 |=========================================================== PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 100 - Mode: Read Write TPS > Higher Is Better 6220R 2P . 4290 |============================================================ 2 ........ 4382 |============================================================== 3 ........ 4402 |============================================================== PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 100 - Mode: Read Write - Average Latency ms < Lower Is Better 6220R 2P . 23.36 |============================================================= 2 ........ 22.85 |============================================================ 3 ........ 22.83 |============================================================ PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 250 - Mode: Read Write TPS > Higher Is Better 6220R 2P . 5344 |============================================================== 2 ........ 4914 |========================================================= 3 ........ 5054 |=========================================================== PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 250 - Mode: Read Write - Average Latency ms < Lower Is Better 6220R 2P . 47.10 |======================================================== 2 ........ 51.33 |============================================================= 3 ........ 49.66 |=========================================================== NCNN 20200916 Target: CPU - Model: squeezenet ms < Lower Is Better 6220R 2P . 56.69 |============================================================= 2 ........ 55.79 |============================================================ 3 ........ 56.08 |============================================================ NCNN 20200916 Target: CPU - Model: mobilenet ms < Lower Is Better 6220R 2P . 23.17 |============================================================ 2 ........ 23.27 |============================================================ 3 ........ 23.51 |============================================================= NCNN 20200916 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better 6220R 2P . 9.99 |=========================================================== 2 ........ 9.95 |=========================================================== 3 ........ 10.30 |============================================================= NCNN 20200916 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better 6220R 2P . 9.48 |============================================================ 2 ........ 9.46 |============================================================ 3 ........ 9.72 |============================================================== NCNN 20200916 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better 6220R 2P . 9.21 |============================================================ 2 ........ 9.43 |============================================================== 3 ........ 9.47 |============================================================== NCNN 20200916 Target: CPU - Model: mnasnet ms < Lower Is Better 6220R 2P . 9.19 |============================================================ 2 ........ 9.30 |============================================================ 3 ........ 9.56 |============================================================== NCNN 20200916 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better 6220R 2P . 12.77 |=========================================================== 2 ........ 12.94 |============================================================ 3 ........ 13.13 |============================================================= NCNN 20200916 Target: CPU - Model: blazeface ms < Lower Is Better 6220R 2P . 4.19 |============================================================= 2 ........ 4.23 |============================================================= 3 ........ 4.29 |============================================================== NCNN 20200916 Target: CPU - Model: googlenet ms < Lower Is Better 6220R 2P . 57.54 |============================================================= 2 ........ 57.42 |============================================================= 3 ........ 57.81 |============================================================= NCNN 20200916 Target: CPU - Model: vgg16 ms < Lower Is Better 6220R 2P . 102.80 |=========================================================== 2 ........ 104.82 |============================================================ 3 ........ 102.15 |========================================================== NCNN 20200916 Target: CPU - Model: resnet18 ms < Lower Is Better 6220R 2P . 24.14 |=========================================================== 2 ........ 23.96 |=========================================================== 3 ........ 24.83 |============================================================= NCNN 20200916 Target: CPU - Model: alexnet ms < Lower Is Better 6220R 2P . 10.87 |============================================================= 2 ........ 10.73 |============================================================ 3 ........ 10.78 |============================================================ NCNN 20200916 Target: CPU - Model: resnet50 ms < Lower Is Better 6220R 2P . 85.92 |============================================================= 2 ........ 85.72 |============================================================ 3 ........ 86.58 |============================================================= NCNN 20200916 Target: CPU - Model: yolov4-tiny ms < Lower Is Better 6220R 2P . 34.04 |============================================================ 2 ........ 34.52 |============================================================= 3 ........ 33.66 |=========================================================== TNN 0.2.3 Target: CPU - Model: MobileNet v2 ms < Lower Is Better 2 . 381.09 |================================================================== 3 . 387.47 |=================================================================== TNN 0.2.3 Target: CPU - Model: SqueezeNet v1.1 ms < Lower Is Better 2 . 345.78 |=================================================================== 3 . 345.95 |===================================================================