7543 epyc cassandra ncnn

AMD EPYC 7543 32-Core testing with a TYAN S8036GM2NE-LE (V2.00.B21 BIOS) and ASPEED on Ubuntu 21.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2107283-IB-7543EPYCC59
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
1
July 27 2021
  32 Minutes
2
July 27 2021
  23 Minutes
2a
July 28 2021
  6 Hours, 5 Minutes
3
July 28 2021
  5 Hours, 24 Minutes
Invert Hiding All Results Option
  3 Hours, 6 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


7543 epyc cassandra ncnnProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen Resolution122a3AMD EPYC 7543 32-Core @ 2.80GHz (32 Cores / 64 Threads)TYAN S8036GM2NE-LE (V2.00.B21 BIOS)AMD Starship/Matisse64GB1000GB Corsair Force MP600ASPEEDVE2282 x Broadcom NetXtreme BCM5720 2-port PCIeUbuntu 21.045.11.0-25-generic (x86_64)GNOME Shell 3.38.4X ServerGCC 10.3.0ext41920x1080OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa001119 Java Details- OpenJDK Runtime Environment (build 11.0.11+9-Ubuntu-0ubuntu2)Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

122a3Result OverviewPhoronix Test Suite100%105%111%116%121%NCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNCPU - mobilenetCPU - vgg16CPU - resnet50CPU - yolov4-tinyCPU - resnet18CPU - googlenetCPU - mnasnetCPU - alexnetCPU - squeezenet_ssdCPU - efficientnet-b0CPU-v2-v2 - mobilenet-v2CPU - regnety_400mCPU - blazefaceCPU-v3-v3 - mobilenet-v3CPU - shufflenet-v2

7543 epyc cassandra ncnnncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mcassandra: Readscassandra: Writescassandra: Mixed 1:1cassandra: Mixed 1:3122a317.867.997.387.517.099.453.4316.6657.1612.068.4223.9725.8318.9819.5928538925973224444923503721.647.947.317.57.129.413.4216.7261.1912.18.3726.127.3819.3419.6120.097.867.287.487.319.543.4717.2162.7212.748.1925.9826.4419.1019.5229986625842825399425050719.017.937.297.527.279.383.4217.2861.5312.458.4325.2526.3419.1819.82291323268476250454244290OpenBenchmarking.org

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mobilenet22a31510152025SE +/- 1.14, N = 14SE +/- 0.34, N = 1221.6420.0919.0117.86MIN: 19.68 / MAX: 23.22MIN: 16.51 / MAX: 3485.25MIN: 17.47 / MAX: 745MIN: 17.22 / MAX: 35.791. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mobilenet22a31510152025Min: 16.8 / Avg: 20.09 / Max: 33.93Min: 17.76 / Avg: 19.01 / Max: 22.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v2-v2 - Model: mobilenet-v21232a246810SE +/- 0.05, N = 12SE +/- 0.02, N = 147.997.947.937.86MIN: 7.51 / MAX: 30.68MIN: 7.6 / MAX: 32.54MIN: 7.22 / MAX: 159.63MIN: 7.17 / MAX: 31.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v2-v2 - Model: mobilenet-v21232a3691215Min: 7.71 / Avg: 7.93 / Max: 8.48Min: 7.7 / Avg: 7.86 / Max: 7.951. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v3-v3 - Model: mobilenet-v31232a246810SE +/- 0.02, N = 12SE +/- 0.01, N = 147.387.317.297.28MIN: 7.24 / MAX: 13.98MIN: 7.22 / MAX: 7.54MIN: 7.08 / MAX: 10.04MIN: 7.09 / MAX: 9.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v3-v3 - Model: mobilenet-v31232a3691215Min: 7.19 / Avg: 7.29 / Max: 7.4Min: 7.2 / Avg: 7.28 / Max: 7.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: shufflenet-v23122a246810SE +/- 0.02, N = 12SE +/- 0.02, N = 147.527.517.507.48MIN: 7.3 / MAX: 21.94MIN: 7.37 / MAX: 9.11MIN: 7.33 / MAX: 16.09MIN: 7.26 / MAX: 24.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: shufflenet-v23122a3691215Min: 7.45 / Avg: 7.52 / Max: 7.64Min: 7.39 / Avg: 7.48 / Max: 7.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mnasnet2a321246810SE +/- 0.17, N = 14SE +/- 0.18, N = 127.317.277.127.09MIN: 6.56 / MAX: 606.4MIN: 6.69 / MAX: 552.23MIN: 6.79 / MAX: 35.2MIN: 7.02 / MAX: 8.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mnasnet2a3213691215Min: 7.05 / Avg: 7.31 / Max: 9.48Min: 7.01 / Avg: 7.27 / Max: 9.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: efficientnet-b02a1233691215SE +/- 0.17, N = 14SE +/- 0.02, N = 129.549.459.419.38MIN: 9.11 / MAX: 576.44MIN: 9.35 / MAX: 11.78MIN: 9.31 / MAX: 11MIN: 9.19 / MAX: 18.541. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: efficientnet-b02a1233691215Min: 9.23 / Avg: 9.54 / Max: 11.7Min: 9.31 / Avg: 9.38 / Max: 9.531. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: blazeface2a1320.78081.56162.34243.12323.904SE +/- 0.02, N = 14SE +/- 0.01, N = 123.473.433.423.42MIN: 3.34 / MAX: 6.19MIN: 3.37 / MAX: 5.14MIN: 3.32 / MAX: 6.69MIN: 3.37 / MAX: 4.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: blazeface2a132246810Min: 3.38 / Avg: 3.47 / Max: 3.66Min: 3.39 / Avg: 3.42 / Max: 3.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: googlenet32a2148121620SE +/- 0.25, N = 12SE +/- 0.13, N = 1417.2817.2116.7216.66MIN: 15.76 / MAX: 669.16MIN: 15.81 / MAX: 318.84MIN: 16.01 / MAX: 75.65MIN: 15.88 / MAX: 96.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: googlenet32a2148121620Min: 16.49 / Avg: 17.28 / Max: 19.6Min: 16.62 / Avg: 17.21 / Max: 18.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: vgg162a3211428425670SE +/- 1.41, N = 14SE +/- 1.12, N = 1262.7261.5361.1957.16MIN: 37.88 / MAX: 1279.9MIN: 36.02 / MAX: 1286.89MIN: 58.6 / MAX: 127.38MIN: 54.05 / MAX: 256.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: vgg162a3211224364860Min: 56.06 / Avg: 62.72 / Max: 77Min: 57.86 / Avg: 61.53 / Max: 69.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet182a3213691215SE +/- 0.13, N = 14SE +/- 0.13, N = 1212.7412.4512.1012.06MIN: 11.64 / MAX: 89.85MIN: 11.83 / MAX: 15.32MIN: 11.95 / MAX: 12.46MIN: 11.92 / MAX: 13.791. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet182a32148121620Min: 11.77 / Avg: 12.74 / Max: 13.68Min: 12 / Avg: 12.45 / Max: 13.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: alexnet3122a246810SE +/- 0.03, N = 12SE +/- 0.06, N = 148.438.428.378.19MIN: 8.06 / MAX: 35.28MIN: 8.26 / MAX: 10.18MIN: 8.18 / MAX: 10.51MIN: 7.79 / MAX: 17.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: alexnet3122a3691215Min: 8.25 / Avg: 8.43 / Max: 8.64Min: 7.88 / Avg: 8.19 / Max: 8.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet5022a31612182430SE +/- 0.32, N = 14SE +/- 0.40, N = 1226.1025.9825.2523.97MIN: 23.21 / MAX: 97.63MIN: 22.35 / MAX: 529.76MIN: 21.99 / MAX: 427.52MIN: 22.05 / MAX: 110.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet5022a31612182430Min: 23.84 / Avg: 25.98 / Max: 28.17Min: 23.07 / Avg: 25.25 / Max: 27.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: yolov4-tiny22a31612182430SE +/- 0.29, N = 14SE +/- 0.24, N = 1227.3826.4426.3425.83MIN: 27.1 / MAX: 29.9MIN: 23.26 / MAX: 83.51MIN: 24.38 / MAX: 365.46MIN: 25.5 / MAX: 27.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: yolov4-tiny22a31612182430Min: 23.81 / Avg: 26.44 / Max: 27.76Min: 24.87 / Avg: 26.34 / Max: 27.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: squeezenet_ssd232a1510152025SE +/- 0.11, N = 12SE +/- 0.08, N = 1419.3419.1819.1018.98MIN: 19.01 / MAX: 22.08MIN: 18.03 / MAX: 72.07MIN: 18.15 / MAX: 83.81MIN: 18.1 / MAX: 81.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: squeezenet_ssd232a1510152025Min: 18.67 / Avg: 19.18 / Max: 19.85Min: 18.53 / Avg: 19.1 / Max: 19.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: regnety_400m3212a510152025SE +/- 0.37, N = 12SE +/- 0.04, N = 1319.8219.6119.5919.52MIN: 19.12 / MAX: 1097.73MIN: 19.5 / MAX: 21.34MIN: 19.51 / MAX: 21.15MIN: 19.13 / MAX: 65.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: regnety_400m3212a510152025Min: 19.2 / Avg: 19.82 / Max: 23.89Min: 19.23 / Avg: 19.52 / Max: 19.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Apache Cassandra

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Reads132a60K120K180K240K300KSE +/- 9008.80, N = 12SE +/- 11313.77, N = 10285389291323299866
OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Reads132a50K100K150K200K250KMin: 249632 / Avg: 291323 / Max: 329544Min: 245246 / Avg: 299865.7 / Max: 341387

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Writes2a1360K120K180K240K300KSE +/- 1288.19, N = 3SE +/- 2907.08, N = 3258428259732268476
OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Writes2a1350K100K150K200K250KMin: 255859 / Avg: 258428.33 / Max: 259878Min: 265267 / Avg: 268475.67 / Max: 274279

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Mixed 1:1132a50K100K150K200K250KSE +/- 2028.16, N = 3SE +/- 2223.02, N = 3244449250454253994
OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Mixed 1:1132a40K80K120K160K200KMin: 246623 / Avg: 250454 / Max: 253524Min: 251144 / Avg: 253993.67 / Max: 258374

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Mixed 1:3132a50K100K150K200K250KSE +/- 2682.76, N = 3SE +/- 762.05, N = 3235037244290250507
OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Mixed 1:3132a40K80K120K160K200KMin: 239045 / Avg: 244290.33 / Max: 247891Min: 249230 / Avg: 250507 / Max: 251866