AMD EPYC vs. Intel Xeon Facebook RocksDB Benchmark

Benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/1910173-HU-FBROCKSDB20&grs&rdt.

AMD EPYC vs. Intel Xeon Facebook RocksDB BenchmarkProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionAMD EPYC 7742 2PIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2P2 x AMD EPYC 7742 64-Core @ 2.25GHz (128 Cores / 256 Threads)AMD DAYTONA_X (RDY1001C BIOS)AMD Starship/Matisse516096MB280GB INTEL SSDPED1D280GAllvmpipe 504GBVE2282 x Mellanox MT27710Ubuntu 19.105.3.0-18-generic (x86_64)GNOME Shell 3.34.1X Server 1.20.5modesetting 1.20.53.3 Mesa 19.2.1 (LLVM 9.0 128 bits)GCC 9.2.1 20191008ext41920x10802 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads)GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS)Intel Sky Lake-E DMI3 Registers386048MBllvmpipe 377GB2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE3.3 Mesa 19.2.1 (LLVM 9.0 256 bits)2 x AMD EPYC 7601 32-Core (64 Cores / 128 Threads)Dell 02MJ3T (1.2.5 BIOS)AMD 17h516096MBllvmpipe 504GB2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA + 2 x Broadcom NetXtreme BCM5720 2-port PCIe3.3 Mesa 19.2.1 (LLVM 9.0 128 bits)1600x12002 x AMD EPYC 7502 32-Core @ 2.50GHz (64 Cores / 128 Threads)AMD DAYTONA_X (RDY1001C BIOS)AMD Starship/Matisse2 x Mellanox MT277101920x10802 x AMD EPYC 7642 48-Core @ 2.30GHz (96 Cores / 192 Threads)OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- AMD EPYC 7742 2P: Scaling Governor: acpi-cpufreq ondemand- Intel Xeon Platinum 8280 2P: Scaling Governor: intel_pstate powersave- AMD EPYC 7502 2P: Scaling Governor: acpi-cpufreq ondemand- AMD EPYC 7642 2P: Scaling Governor: acpi-cpufreq ondemandSecurity Details- AMD EPYC 7742 2P: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling- Intel Xeon Platinum 8280 2P: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling- AMD EPYC 7601 2P: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling- AMD EPYC 7502 2P: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling- AMD EPYC 7642 2P: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling

AMD EPYC vs. Intel Xeon Facebook RocksDB Benchmarkrocksdb: Rand Readrocksdb: Rand Fillrocksdb: Seq Fillrocksdb: Read While Writingrocksdb: Rand Fill SyncAMD EPYC 7742 2PIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2P408115639267685269049119958182302202448670041939121941726331092166399243267520188347199470504438615677226431167625735926864475299581977513629376512618872724859895384194152OpenBenchmarking.org

Facebook RocksDB

Performance / Cost - Test: Sequential Fill

OpenBenchmarking.orgOp/s Per Dollar, More Is BetterFacebook RocksDB 6.3.6Performance / Cost - Test: Sequential FillAMD EPYC 7742 2PIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2P112233445517.889.7031.1747.6825.191. AMD EPYC 7742 2P: $15044 reported cost.2. Intel Xeon Platinum 8280 2P: $20018 reported cost.3. AMD EPYC 7601 2P: $6400 reported cost.4. AMD EPYC 7502 2P: $5634 reported cost.5. AMD EPYC 7642 2P: $10818 reported cost.

Facebook RocksDB

Performance / Cost - Test: Random Fill

OpenBenchmarking.orgOp/s Per Dollar, More Is BetterFacebook RocksDB 6.3.6Performance / Cost - Test: Random FillAMD EPYC 7742 2PIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2P102030405017.799.6929.4345.6824.211. AMD EPYC 7742 2P: $15044 reported cost.2. Intel Xeon Platinum 8280 2P: $20018 reported cost.3. AMD EPYC 7601 2P: $6400 reported cost.4. AMD EPYC 7502 2P: $5634 reported cost.5. AMD EPYC 7642 2P: $10818 reported cost.

Facebook RocksDB

Performance / Cost - Test: Read While Writing

OpenBenchmarking.orgOp/s Per Dollar, More Is BetterFacebook RocksDB 6.3.6Performance / Cost - Test: Read While WritingAMD EPYC 7742 2PIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2P30060090012001500797.38316.27788.191336.52914.711. AMD EPYC 7742 2P: $15044 reported cost.2. Intel Xeon Platinum 8280 2P: $20018 reported cost.3. AMD EPYC 7601 2P: $6400 reported cost.4. AMD EPYC 7502 2P: $5634 reported cost.5. AMD EPYC 7642 2P: $10818 reported cost.

Facebook RocksDB

Performance / Cost - Test: Random Fill Sync

OpenBenchmarking.orgOp/s Per Dollar, More Is BetterFacebook RocksDB 6.3.6Performance / Cost - Test: Random Fill SyncAMD EPYC 7742 2PIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2P81624324015.308.3124.5035.1017.951. AMD EPYC 7742 2P: $15044 reported cost.2. Intel Xeon Platinum 8280 2P: $20018 reported cost.3. AMD EPYC 7601 2P: $6400 reported cost.4. AMD EPYC 7502 2P: $5634 reported cost.5. AMD EPYC 7642 2P: $10818 reported cost.

Facebook RocksDB

Performance / Cost - Test: Random Read

OpenBenchmarking.orgOp/s Per Dollar, More Is BetterFacebook RocksDB 6.3.6Performance / Cost - Test: Random ReadAMD EPYC 7742 2PIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2P10K20K30K40K50K27128.1312232.3438010.5546913.6833549.421. AMD EPYC 7742 2P: $15044 reported cost.2. Intel Xeon Platinum 8280 2P: $20018 reported cost.3. AMD EPYC 7601 2P: $6400 reported cost.4. AMD EPYC 7502 2P: $5634 reported cost.5. AMD EPYC 7642 2P: $10818 reported cost.

Facebook RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random ReadAMD EPYC 7742 2PIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2P90M180M270M360M450MSE +/- 3237170.94, N = 3SE +/- 853761.86, N = 3SE +/- 2959260.76, N = 15SE +/- 377978.81, N = 3SE +/- 2001351.31, N = 34081156392448670042432675202643116763629376511. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random FillAMD EPYC 7742 2PIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2P60K120K180K240K300KSE +/- 2430.78, N = 10SE +/- 644.12, N = 3SE +/- 840.97, N = 3SE +/- 838.05, N = 3SE +/- 2598.47, N = 32676851939121883472573592618871. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Sequential FillAMD EPYC 7742 2PIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2P60K120K180K240K300KSE +/- 1933.31, N = 3SE +/- 125.30, N = 3SE +/- 2880.91, N = 4SE +/- 1285.73, N = 3SE +/- 2178.26, N = 32690491941721994702686442724851. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Read While WritingAMD EPYC 7742 2PIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2P3M6M9M12M15MSE +/- 264808.00, N = 12SE +/- 33828.94, N = 3SE +/- 44037.06, N = 15SE +/- 102102.82, N = 15SE +/- 156017.91, N = 151199581863310925044386752995898953841. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Random Fill Sync

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random Fill SyncAMD EPYC 7742 2PIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2P50K100K150K200K250KSE +/- 3260.74, N = 4SE +/- 494.90, N = 3SE +/- 2487.47, N = 3SE +/- 1346.31, N = 3SE +/- 4734.36, N = 152302201663991567721977511941521. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Phoronix Test Suite v10.8.5