7543 epyc cassandra ncnn

AMD EPYC 7543 32-Core testing with a TYAN S8036GM2NE-LE (V2.00.B21 BIOS) and ASPEED on Ubuntu 21.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2107283-IB-7543EPYCC59
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
1
July 27 2021
  32 Minutes
2
July 27 2021
  23 Minutes
2a
July 28 2021
  6 Hours, 5 Minutes
3
July 28 2021
  5 Hours, 24 Minutes
Invert Hiding All Results Option
  3 Hours, 6 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


7543 epyc cassandra ncnnProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen Resolution122a3AMD EPYC 7543 32-Core @ 2.80GHz (32 Cores / 64 Threads)TYAN S8036GM2NE-LE (V2.00.B21 BIOS)AMD Starship/Matisse64GB1000GB Corsair Force MP600ASPEEDVE2282 x Broadcom NetXtreme BCM5720 2-port PCIeUbuntu 21.045.11.0-25-generic (x86_64)GNOME Shell 3.38.4X ServerGCC 10.3.0ext41920x1080OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa001119 Java Details- OpenJDK Runtime Environment (build 11.0.11+9-Ubuntu-0ubuntu2)Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

122a3Result OverviewPhoronix Test Suite100%105%111%116%121%NCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNCPU - mobilenetCPU - vgg16CPU - resnet50CPU - yolov4-tinyCPU - resnet18CPU - googlenetCPU - mnasnetCPU - alexnetCPU - squeezenet_ssdCPU - efficientnet-b0CPU-v2-v2 - mobilenet-v2CPU - regnety_400mCPU - blazefaceCPU-v3-v3 - mobilenet-v3CPU - shufflenet-v2

7543 epyc cassandra ncnnncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mcassandra: Readscassandra: Writescassandra: Mixed 1:1cassandra: Mixed 1:3122a317.867.997.387.517.099.453.4316.6657.1612.068.4223.9725.8318.9819.5928538925973224444923503721.647.947.317.57.129.413.4216.7261.1912.18.3726.127.3819.3419.6120.097.867.287.487.319.543.4717.2162.7212.748.1925.9826.4419.1019.5229986625842825399425050719.017.937.297.527.279.383.4217.2861.5312.458.4325.2526.3419.1819.82291323268476250454244290OpenBenchmarking.org

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mobilenet132a2510152025SE +/- 0.34, N = 12SE +/- 1.14, N = 1417.8619.0120.0921.64MIN: 17.22 / MAX: 35.79MIN: 17.47 / MAX: 745MIN: 16.51 / MAX: 3485.25MIN: 19.68 / MAX: 23.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mobilenet132a2510152025Min: 17.76 / Avg: 19.01 / Max: 22.08Min: 16.8 / Avg: 20.09 / Max: 33.931. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v2-v2 - Model: mobilenet-v22a321246810SE +/- 0.02, N = 14SE +/- 0.05, N = 127.867.937.947.99MIN: 7.17 / MAX: 31.47MIN: 7.22 / MAX: 159.63MIN: 7.6 / MAX: 32.54MIN: 7.51 / MAX: 30.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v2-v2 - Model: mobilenet-v22a3213691215Min: 7.7 / Avg: 7.86 / Max: 7.95Min: 7.71 / Avg: 7.93 / Max: 8.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v3-v3 - Model: mobilenet-v32a321246810SE +/- 0.01, N = 14SE +/- 0.02, N = 127.287.297.317.38MIN: 7.09 / MAX: 9.78MIN: 7.08 / MAX: 10.04MIN: 7.22 / MAX: 7.54MIN: 7.24 / MAX: 13.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v3-v3 - Model: mobilenet-v32a3213691215Min: 7.2 / Avg: 7.28 / Max: 7.37Min: 7.19 / Avg: 7.29 / Max: 7.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: shufflenet-v22a213246810SE +/- 0.02, N = 14SE +/- 0.02, N = 127.487.507.517.52MIN: 7.26 / MAX: 24.38MIN: 7.33 / MAX: 16.09MIN: 7.37 / MAX: 9.11MIN: 7.3 / MAX: 21.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: shufflenet-v22a2133691215Min: 7.39 / Avg: 7.48 / Max: 7.63Min: 7.45 / Avg: 7.52 / Max: 7.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mnasnet1232a246810SE +/- 0.18, N = 12SE +/- 0.17, N = 147.097.127.277.31MIN: 7.02 / MAX: 8.45MIN: 6.79 / MAX: 35.2MIN: 6.69 / MAX: 552.23MIN: 6.56 / MAX: 606.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mnasnet1232a3691215Min: 7.01 / Avg: 7.27 / Max: 9.25Min: 7.05 / Avg: 7.31 / Max: 9.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: efficientnet-b03212a3691215SE +/- 0.02, N = 12SE +/- 0.17, N = 149.389.419.459.54MIN: 9.19 / MAX: 18.54MIN: 9.31 / MAX: 11MIN: 9.35 / MAX: 11.78MIN: 9.11 / MAX: 576.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: efficientnet-b03212a3691215Min: 9.31 / Avg: 9.38 / Max: 9.53Min: 9.23 / Avg: 9.54 / Max: 11.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: blazeface2312a0.78081.56162.34243.12323.904SE +/- 0.01, N = 12SE +/- 0.02, N = 143.423.423.433.47MIN: 3.37 / MAX: 4.82MIN: 3.32 / MAX: 6.69MIN: 3.37 / MAX: 5.14MIN: 3.34 / MAX: 6.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: blazeface2312a246810Min: 3.39 / Avg: 3.42 / Max: 3.47Min: 3.38 / Avg: 3.47 / Max: 3.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: googlenet122a348121620SE +/- 0.13, N = 14SE +/- 0.25, N = 1216.6616.7217.2117.28MIN: 15.88 / MAX: 96.91MIN: 16.01 / MAX: 75.65MIN: 15.81 / MAX: 318.84MIN: 15.76 / MAX: 669.161. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: googlenet122a348121620Min: 16.62 / Avg: 17.21 / Max: 18.14Min: 16.49 / Avg: 17.28 / Max: 19.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: vgg161232a1428425670SE +/- 1.12, N = 12SE +/- 1.41, N = 1457.1661.1961.5362.72MIN: 54.05 / MAX: 256.27MIN: 58.6 / MAX: 127.38MIN: 36.02 / MAX: 1286.89MIN: 37.88 / MAX: 1279.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: vgg161232a1224364860Min: 57.86 / Avg: 61.53 / Max: 69.64Min: 56.06 / Avg: 62.72 / Max: 771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet181232a3691215SE +/- 0.13, N = 12SE +/- 0.13, N = 1412.0612.1012.4512.74MIN: 11.92 / MAX: 13.79MIN: 11.95 / MAX: 12.46MIN: 11.83 / MAX: 15.32MIN: 11.64 / MAX: 89.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet181232a48121620Min: 12 / Avg: 12.45 / Max: 13.04Min: 11.77 / Avg: 12.74 / Max: 13.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: alexnet2a213246810SE +/- 0.06, N = 14SE +/- 0.03, N = 128.198.378.428.43MIN: 7.79 / MAX: 17.71MIN: 8.18 / MAX: 10.51MIN: 8.26 / MAX: 10.18MIN: 8.06 / MAX: 35.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: alexnet2a2133691215Min: 7.88 / Avg: 8.19 / Max: 8.57Min: 8.25 / Avg: 8.43 / Max: 8.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet50132a2612182430SE +/- 0.40, N = 12SE +/- 0.32, N = 1423.9725.2525.9826.10MIN: 22.05 / MAX: 110.63MIN: 21.99 / MAX: 427.52MIN: 22.35 / MAX: 529.76MIN: 23.21 / MAX: 97.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet50132a2612182430Min: 23.07 / Avg: 25.25 / Max: 27.77Min: 23.84 / Avg: 25.98 / Max: 28.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: yolov4-tiny132a2612182430SE +/- 0.24, N = 12SE +/- 0.29, N = 1425.8326.3426.4427.38MIN: 25.5 / MAX: 27.01MIN: 24.38 / MAX: 365.46MIN: 23.26 / MAX: 83.51MIN: 27.1 / MAX: 29.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: yolov4-tiny132a2612182430Min: 24.87 / Avg: 26.34 / Max: 27.78Min: 23.81 / Avg: 26.44 / Max: 27.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: squeezenet_ssd12a32510152025SE +/- 0.08, N = 14SE +/- 0.11, N = 1218.9819.1019.1819.34MIN: 18.1 / MAX: 81.75MIN: 18.15 / MAX: 83.81MIN: 18.03 / MAX: 72.07MIN: 19.01 / MAX: 22.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: squeezenet_ssd12a32510152025Min: 18.53 / Avg: 19.1 / Max: 19.68Min: 18.67 / Avg: 19.18 / Max: 19.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: regnety_400m2a123510152025SE +/- 0.04, N = 13SE +/- 0.37, N = 1219.5219.5919.6119.82MIN: 19.13 / MAX: 65.09MIN: 19.51 / MAX: 21.15MIN: 19.5 / MAX: 21.34MIN: 19.12 / MAX: 1097.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: regnety_400m2a123510152025Min: 19.23 / Avg: 19.52 / Max: 19.76Min: 19.2 / Avg: 19.82 / Max: 23.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Apache Cassandra

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Reads2a3160K120K180K240K300KSE +/- 11313.77, N = 10SE +/- 9008.80, N = 12299866291323285389
OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Reads2a3150K100K150K200K250KMin: 245246 / Avg: 299865.7 / Max: 341387Min: 249632 / Avg: 291323 / Max: 329544

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Writes312a60K120K180K240K300KSE +/- 2907.08, N = 3SE +/- 1288.19, N = 3268476259732258428
OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Writes312a50K100K150K200K250KMin: 265267 / Avg: 268475.67 / Max: 274279Min: 255859 / Avg: 258428.33 / Max: 259878

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Mixed 1:12a3150K100K150K200K250KSE +/- 2223.02, N = 3SE +/- 2028.16, N = 3253994250454244449
OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Mixed 1:12a3140K80K120K160K200KMin: 251144 / Avg: 253993.67 / Max: 258374Min: 246623 / Avg: 250454 / Max: 253524

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Mixed 1:32a3150K100K150K200K250KSE +/- 762.05, N = 3SE +/- 2682.76, N = 3250507244290235037
OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Mixed 1:32a3140K80K120K160K200KMin: 249230 / Avg: 250507 / Max: 251866Min: 239045 / Avg: 244290.33 / Max: 247891