7543 epyc cassandra ncnn

AMD EPYC 7543 32-Core testing with a TYAN S8036GM2NE-LE (V2.00.B21 BIOS) and ASPEED on Ubuntu 21.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2107283-IB-7543EPYCC59
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
1
July 27 2021
  32 Minutes
2
July 27 2021
  23 Minutes
2a
July 28 2021
  6 Hours, 5 Minutes
3
July 28 2021
  5 Hours, 24 Minutes
Invert Hiding All Results Option
  3 Hours, 6 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


7543 epyc cassandra ncnnProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen Resolution122a3AMD EPYC 7543 32-Core @ 2.80GHz (32 Cores / 64 Threads)TYAN S8036GM2NE-LE (V2.00.B21 BIOS)AMD Starship/Matisse64GB1000GB Corsair Force MP600ASPEEDVE2282 x Broadcom NetXtreme BCM5720 2-port PCIeUbuntu 21.045.11.0-25-generic (x86_64)GNOME Shell 3.38.4X ServerGCC 10.3.0ext41920x1080OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa001119 Java Details- OpenJDK Runtime Environment (build 11.0.11+9-Ubuntu-0ubuntu2)Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

122a3Result OverviewPhoronix Test Suite100%105%111%116%121%NCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNCPU - mobilenetCPU - vgg16CPU - resnet50CPU - yolov4-tinyCPU - resnet18CPU - googlenetCPU - mnasnetCPU - alexnetCPU - squeezenet_ssdCPU - efficientnet-b0CPU-v2-v2 - mobilenet-v2CPU - regnety_400mCPU - blazefaceCPU-v3-v3 - mobilenet-v3CPU - shufflenet-v2

7543 epyc cassandra ncnncassandra: Readscassandra: Writescassandra: Mixed 1:1cassandra: Mixed 1:3ncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400m122a328538925973224444923503717.867.997.387.517.099.453.4316.6657.1612.068.4223.9725.8318.9819.5921.647.947.317.57.129.413.4216.7261.1912.18.3726.127.3819.3419.6129986625842825399425050720.097.867.287.487.319.543.4717.2162.7212.748.1925.9826.4419.1019.5229132326847625045424429019.017.937.297.527.279.383.4217.2861.5312.458.4325.2526.3419.1819.82OpenBenchmarking.org

Apache Cassandra

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Reads12a360K120K180K240K300KSE +/- 11313.77, N = 10SE +/- 9008.80, N = 12285389299866291323
OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Reads12a350K100K150K200K250KMin: 245246 / Avg: 299865.7 / Max: 341387Min: 249632 / Avg: 291323 / Max: 329544

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Writes12a360K120K180K240K300KSE +/- 1288.19, N = 3SE +/- 2907.08, N = 3259732258428268476
OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Writes12a350K100K150K200K250KMin: 255859 / Avg: 258428.33 / Max: 259878Min: 265267 / Avg: 268475.67 / Max: 274279

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Mixed 1:112a350K100K150K200K250KSE +/- 2223.02, N = 3SE +/- 2028.16, N = 3244449253994250454
OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Mixed 1:112a340K80K120K160K200KMin: 251144 / Avg: 253993.67 / Max: 258374Min: 246623 / Avg: 250454 / Max: 253524

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Mixed 1:312a350K100K150K200K250KSE +/- 762.05, N = 3SE +/- 2682.76, N = 3235037250507244290
OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: Mixed 1:312a340K80K120K160K200KMin: 249230 / Avg: 250507 / Max: 251866Min: 239045 / Avg: 244290.33 / Max: 247891

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mobilenet122a3510152025SE +/- 1.14, N = 14SE +/- 0.34, N = 1217.8621.6420.0919.01MIN: 17.22 / MAX: 35.79MIN: 19.68 / MAX: 23.22MIN: 16.51 / MAX: 3485.25MIN: 17.47 / MAX: 7451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mobilenet122a3510152025Min: 16.8 / Avg: 20.09 / Max: 33.93Min: 17.76 / Avg: 19.01 / Max: 22.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v2-v2 - Model: mobilenet-v2122a3246810SE +/- 0.02, N = 14SE +/- 0.05, N = 127.997.947.867.93MIN: 7.51 / MAX: 30.68MIN: 7.6 / MAX: 32.54MIN: 7.17 / MAX: 31.47MIN: 7.22 / MAX: 159.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v2-v2 - Model: mobilenet-v2122a33691215Min: 7.7 / Avg: 7.86 / Max: 7.95Min: 7.71 / Avg: 7.93 / Max: 8.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v3-v3 - Model: mobilenet-v3122a3246810SE +/- 0.01, N = 14SE +/- 0.02, N = 127.387.317.287.29MIN: 7.24 / MAX: 13.98MIN: 7.22 / MAX: 7.54MIN: 7.09 / MAX: 9.78MIN: 7.08 / MAX: 10.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU-v3-v3 - Model: mobilenet-v3122a33691215Min: 7.2 / Avg: 7.28 / Max: 7.37Min: 7.19 / Avg: 7.29 / Max: 7.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: shufflenet-v2122a3246810SE +/- 0.02, N = 14SE +/- 0.02, N = 127.517.507.487.52MIN: 7.37 / MAX: 9.11MIN: 7.33 / MAX: 16.09MIN: 7.26 / MAX: 24.38MIN: 7.3 / MAX: 21.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: shufflenet-v2122a33691215Min: 7.39 / Avg: 7.48 / Max: 7.63Min: 7.45 / Avg: 7.52 / Max: 7.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mnasnet122a3246810SE +/- 0.17, N = 14SE +/- 0.18, N = 127.097.127.317.27MIN: 7.02 / MAX: 8.45MIN: 6.79 / MAX: 35.2MIN: 6.56 / MAX: 606.4MIN: 6.69 / MAX: 552.231. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: mnasnet122a33691215Min: 7.05 / Avg: 7.31 / Max: 9.48Min: 7.01 / Avg: 7.27 / Max: 9.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: efficientnet-b0122a33691215SE +/- 0.17, N = 14SE +/- 0.02, N = 129.459.419.549.38MIN: 9.35 / MAX: 11.78MIN: 9.31 / MAX: 11MIN: 9.11 / MAX: 576.44MIN: 9.19 / MAX: 18.541. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: efficientnet-b0122a33691215Min: 9.23 / Avg: 9.54 / Max: 11.7Min: 9.31 / Avg: 9.38 / Max: 9.531. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: blazeface122a30.78081.56162.34243.12323.904SE +/- 0.02, N = 14SE +/- 0.01, N = 123.433.423.473.42MIN: 3.37 / MAX: 5.14MIN: 3.37 / MAX: 4.82MIN: 3.34 / MAX: 6.19MIN: 3.32 / MAX: 6.691. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: blazeface122a3246810Min: 3.38 / Avg: 3.47 / Max: 3.66Min: 3.39 / Avg: 3.42 / Max: 3.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: googlenet122a348121620SE +/- 0.13, N = 14SE +/- 0.25, N = 1216.6616.7217.2117.28MIN: 15.88 / MAX: 96.91MIN: 16.01 / MAX: 75.65MIN: 15.81 / MAX: 318.84MIN: 15.76 / MAX: 669.161. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: googlenet122a348121620Min: 16.62 / Avg: 17.21 / Max: 18.14Min: 16.49 / Avg: 17.28 / Max: 19.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: vgg16122a31428425670SE +/- 1.41, N = 14SE +/- 1.12, N = 1257.1661.1962.7261.53MIN: 54.05 / MAX: 256.27MIN: 58.6 / MAX: 127.38MIN: 37.88 / MAX: 1279.9MIN: 36.02 / MAX: 1286.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: vgg16122a31224364860Min: 56.06 / Avg: 62.72 / Max: 77Min: 57.86 / Avg: 61.53 / Max: 69.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet18122a33691215SE +/- 0.13, N = 14SE +/- 0.13, N = 1212.0612.1012.7412.45MIN: 11.92 / MAX: 13.79MIN: 11.95 / MAX: 12.46MIN: 11.64 / MAX: 89.85MIN: 11.83 / MAX: 15.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet18122a348121620Min: 11.77 / Avg: 12.74 / Max: 13.68Min: 12 / Avg: 12.45 / Max: 13.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: alexnet122a3246810SE +/- 0.06, N = 14SE +/- 0.03, N = 128.428.378.198.43MIN: 8.26 / MAX: 10.18MIN: 8.18 / MAX: 10.51MIN: 7.79 / MAX: 17.71MIN: 8.06 / MAX: 35.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: alexnet122a33691215Min: 7.88 / Avg: 8.19 / Max: 8.57Min: 8.25 / Avg: 8.43 / Max: 8.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet50122a3612182430SE +/- 0.32, N = 14SE +/- 0.40, N = 1223.9726.1025.9825.25MIN: 22.05 / MAX: 110.63MIN: 23.21 / MAX: 97.63MIN: 22.35 / MAX: 529.76MIN: 21.99 / MAX: 427.521. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: resnet50122a3612182430Min: 23.84 / Avg: 25.98 / Max: 28.17Min: 23.07 / Avg: 25.25 / Max: 27.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: yolov4-tiny122a3612182430SE +/- 0.29, N = 14SE +/- 0.24, N = 1225.8327.3826.4426.34MIN: 25.5 / MAX: 27.01MIN: 27.1 / MAX: 29.9MIN: 23.26 / MAX: 83.51MIN: 24.38 / MAX: 365.461. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: yolov4-tiny122a3612182430Min: 23.81 / Avg: 26.44 / Max: 27.76Min: 24.87 / Avg: 26.34 / Max: 27.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: squeezenet_ssd122a3510152025SE +/- 0.08, N = 14SE +/- 0.11, N = 1218.9819.3419.1019.18MIN: 18.1 / MAX: 81.75MIN: 19.01 / MAX: 22.08MIN: 18.15 / MAX: 83.81MIN: 18.03 / MAX: 72.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: squeezenet_ssd122a3510152025Min: 18.53 / Avg: 19.1 / Max: 19.68Min: 18.67 / Avg: 19.18 / Max: 19.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: regnety_400m122a3510152025SE +/- 0.04, N = 13SE +/- 0.37, N = 1219.5919.6119.5219.82MIN: 19.51 / MAX: 21.15MIN: 19.5 / MAX: 21.34MIN: 19.13 / MAX: 65.09MIN: 19.12 / MAX: 1097.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210720Target: CPU - Model: regnety_400m122a3510152025Min: 19.23 / Avg: 19.52 / Max: 19.76Min: 19.2 / Avg: 19.82 / Max: 23.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread