AMD EPYC vs. Intel Xeon RocksDB

Benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/1910176-HU-FBROCKSDB09&sor.

AMD EPYC vs. Intel Xeon RocksDB ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2PAMD EPYC 7742 2P2 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads)GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS)Intel Sky Lake-E DMI3 Registers386048MB280GB INTEL SSDPED1D280GAllvmpipe 377GBVE2282 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbEUbuntu 19.105.3.0-18-generic (x86_64)GNOME Shell 3.34.1X Server 1.20.5modesetting 1.20.53.3 Mesa 19.2.1 (LLVM 9.0 256 bits)GCC 9.2.1 20191008ext41920x10802 x AMD EPYC 7601 32-Core (64 Cores / 128 Threads)Dell 02MJ3T (1.2.5 BIOS)AMD 17h516096MBllvmpipe 504GB2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA + 2 x Broadcom NetXtreme BCM5720 2-port PCIe3.3 Mesa 19.2.1 (LLVM 9.0 128 bits)1600x12002 x AMD EPYC 7502 32-Core @ 2.50GHz (64 Cores / 128 Threads)AMD DAYTONA_X (RDY1001C BIOS)AMD Starship/Matisse280GB INTEL SSDPED1D280GA + 256GB Micron_1100_MTFD2 x Mellanox MT277101920x10802 x AMD EPYC 7642 48-Core @ 2.30GHz (96 Cores / 192 Threads)2 x AMD EPYC 7742 64-Core @ 2.25GHz (128 Cores / 256 Threads)280GB INTEL SSDPED1D280GAVE228OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Intel Xeon Platinum 8280 2P: Scaling Governor: intel_pstate powersave- AMD EPYC 7502 2P: Scaling Governor: acpi-cpufreq ondemand- AMD EPYC 7642 2P: Scaling Governor: acpi-cpufreq ondemand- AMD EPYC 7742 2P: Scaling Governor: acpi-cpufreq ondemandSecurity Details- Intel Xeon Platinum 8280 2P: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling- AMD EPYC 7601 2P: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling- AMD EPYC 7502 2P: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling- AMD EPYC 7642 2P: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling- AMD EPYC 7742 2P: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling

AMD EPYC vs. Intel Xeon RocksDB rocksdb: Rand Fillrocksdb: Rand Readrocksdb: Seq Fillrocksdb: Rand Fill Syncrocksdb: Read While WritingIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2PAMD EPYC 7742 2P193912244867004194172166399633109218834724326752019947015677250443862573592643116762686441977517529958261887362937651272485194152989538426768540811563926904923022011995818OpenBenchmarking.org

Facebook RocksDB

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random FillAMD EPYC 7742 2PAMD EPYC 7642 2PAMD EPYC 7502 2PIntel Xeon Platinum 8280 2PAMD EPYC 7601 2P60K120K180K240K300KSE +/- 2430.78, N = 10SE +/- 2598.47, N = 3SE +/- 838.05, N = 3SE +/- 644.12, N = 3SE +/- 840.97, N = 32676852618872573591939121883471. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random ReadAMD EPYC 7742 2PAMD EPYC 7642 2PAMD EPYC 7502 2PIntel Xeon Platinum 8280 2PAMD EPYC 7601 2P90M180M270M360M450MSE +/- 3237170.94, N = 3SE +/- 2001351.31, N = 3SE +/- 377978.81, N = 3SE +/- 853761.86, N = 3SE +/- 2959260.76, N = 154081156393629376512643116762448670042432675201. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Sequential FillAMD EPYC 7642 2PAMD EPYC 7742 2PAMD EPYC 7502 2PAMD EPYC 7601 2PIntel Xeon Platinum 8280 2P60K120K180K240K300KSE +/- 2178.26, N = 3SE +/- 1933.31, N = 3SE +/- 1285.73, N = 3SE +/- 2880.91, N = 4SE +/- 125.30, N = 32724852690492686441994701941721. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Random Fill Sync

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random Fill SyncAMD EPYC 7742 2PAMD EPYC 7502 2PAMD EPYC 7642 2PIntel Xeon Platinum 8280 2PAMD EPYC 7601 2P50K100K150K200K250KSE +/- 3260.74, N = 4SE +/- 1346.31, N = 3SE +/- 4734.36, N = 15SE +/- 494.90, N = 3SE +/- 2487.47, N = 32302201977511941521663991567721. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Read While WritingAMD EPYC 7742 2PAMD EPYC 7642 2PAMD EPYC 7502 2PIntel Xeon Platinum 8280 2PAMD EPYC 7601 2P3M6M9M12M15MSE +/- 264808.00, N = 12SE +/- 156017.91, N = 15SE +/- 102102.82, N = 15SE +/- 33828.94, N = 3SE +/- 44037.06, N = 151199581898953847529958633109250443861. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Performance / Cost - Test: Random Fill

OpenBenchmarking.orgOp/s Per Dollar, More Is BetterFacebook RocksDB 6.3.6Performance / Cost - Test: Random FillAMD EPYC 7502 2PAMD EPYC 7601 2PAMD EPYC 7642 2PAMD EPYC 7742 2PIntel Xeon Platinum 8280 2P102030405045.6829.4324.2117.799.691. AMD EPYC 7502 2P: $5634 reported cost.2. AMD EPYC 7601 2P: $6400 reported cost.3. AMD EPYC 7642 2P: $10818 reported cost.4. AMD EPYC 7742 2P: $15044 reported cost.5. Intel Xeon Platinum 8280 2P: $20018 reported cost.

Facebook RocksDB

Performance / Cost - Test: Random Read

OpenBenchmarking.orgOp/s Per Dollar, More Is BetterFacebook RocksDB 6.3.6Performance / Cost - Test: Random ReadAMD EPYC 7502 2PAMD EPYC 7601 2PAMD EPYC 7642 2PAMD EPYC 7742 2PIntel Xeon Platinum 8280 2P10K20K30K40K50K46913.6838010.5533549.4227128.1312232.341. AMD EPYC 7502 2P: $5634 reported cost.2. AMD EPYC 7601 2P: $6400 reported cost.3. AMD EPYC 7642 2P: $10818 reported cost.4. AMD EPYC 7742 2P: $15044 reported cost.5. Intel Xeon Platinum 8280 2P: $20018 reported cost.

Facebook RocksDB

Performance / Cost - Test: Sequential Fill

OpenBenchmarking.orgOp/s Per Dollar, More Is BetterFacebook RocksDB 6.3.6Performance / Cost - Test: Sequential FillAMD EPYC 7502 2PAMD EPYC 7601 2PAMD EPYC 7642 2PAMD EPYC 7742 2PIntel Xeon Platinum 8280 2P112233445547.6831.1725.1917.889.701. AMD EPYC 7502 2P: $5634 reported cost.2. AMD EPYC 7601 2P: $6400 reported cost.3. AMD EPYC 7642 2P: $10818 reported cost.4. AMD EPYC 7742 2P: $15044 reported cost.5. Intel Xeon Platinum 8280 2P: $20018 reported cost.

Facebook RocksDB

Performance / Cost - Test: Random Fill Sync

OpenBenchmarking.orgOp/s Per Dollar, More Is BetterFacebook RocksDB 6.3.6Performance / Cost - Test: Random Fill SyncAMD EPYC 7502 2PAMD EPYC 7601 2PAMD EPYC 7642 2PAMD EPYC 7742 2PIntel Xeon Platinum 8280 2P81624324035.1024.5017.9515.308.311. AMD EPYC 7502 2P: $5634 reported cost.2. AMD EPYC 7601 2P: $6400 reported cost.3. AMD EPYC 7642 2P: $10818 reported cost.4. AMD EPYC 7742 2P: $15044 reported cost.5. Intel Xeon Platinum 8280 2P: $20018 reported cost.

Facebook RocksDB

Performance / Cost - Test: Read While Writing

OpenBenchmarking.orgOp/s Per Dollar, More Is BetterFacebook RocksDB 6.3.6Performance / Cost - Test: Read While WritingAMD EPYC 7502 2PAMD EPYC 7642 2PAMD EPYC 7742 2PAMD EPYC 7601 2PIntel Xeon Platinum 8280 2P300600900120015001336.52914.71797.38788.19316.271. AMD EPYC 7502 2P: $5634 reported cost.2. AMD EPYC 7642 2P: $10818 reported cost.3. AMD EPYC 7742 2P: $15044 reported cost.4. AMD EPYC 7601 2P: $6400 reported cost.5. Intel Xeon Platinum 8280 2P: $20018 reported cost.

Phoronix Test Suite v10.8.4