AMD EPYC vs. Intel Xeon RocksDB

Benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/1910176-HU-FBROCKSDB09.

AMD EPYC vs. Intel Xeon RocksDB ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2PAMD EPYC 7742 2P2 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads)GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS)Intel Sky Lake-E DMI3 Registers386048MB280GB INTEL SSDPED1D280GAllvmpipe 377GBVE2282 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbEUbuntu 19.105.3.0-18-generic (x86_64)GNOME Shell 3.34.1X Server 1.20.5modesetting 1.20.53.3 Mesa 19.2.1 (LLVM 9.0 256 bits)GCC 9.2.1 20191008ext41920x10802 x AMD EPYC 7601 32-Core (64 Cores / 128 Threads)Dell 02MJ3T (1.2.5 BIOS)AMD 17h516096MBllvmpipe 504GB2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA + 2 x Broadcom NetXtreme BCM5720 2-port PCIe3.3 Mesa 19.2.1 (LLVM 9.0 128 bits)1600x12002 x AMD EPYC 7502 32-Core @ 2.50GHz (64 Cores / 128 Threads)AMD DAYTONA_X (RDY1001C BIOS)AMD Starship/Matisse280GB INTEL SSDPED1D280GA + 256GB Micron_1100_MTFD2 x Mellanox MT277101920x10802 x AMD EPYC 7642 48-Core @ 2.30GHz (96 Cores / 192 Threads)2 x AMD EPYC 7742 64-Core @ 2.25GHz (128 Cores / 256 Threads)280GB INTEL SSDPED1D280GAVE228OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Intel Xeon Platinum 8280 2P: Scaling Governor: intel_pstate powersave- AMD EPYC 7502 2P: Scaling Governor: acpi-cpufreq ondemand- AMD EPYC 7642 2P: Scaling Governor: acpi-cpufreq ondemand- AMD EPYC 7742 2P: Scaling Governor: acpi-cpufreq ondemandSecurity Details- Intel Xeon Platinum 8280 2P: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling- AMD EPYC 7601 2P: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling- AMD EPYC 7502 2P: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling- AMD EPYC 7642 2P: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling- AMD EPYC 7742 2P: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling

AMD EPYC vs. Intel Xeon RocksDB rocksdb: Rand Fillrocksdb: Rand Readrocksdb: Seq Fillrocksdb: Rand Fill Syncrocksdb: Read While WritingIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2PAMD EPYC 7742 2P193912244867004194172166399633109218834724326752019947015677250443862573592643116762686441977517529958261887362937651272485194152989538426768540811563926904923022011995818OpenBenchmarking.org

Facebook RocksDB

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random FillIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2PAMD EPYC 7742 2P60K120K180K240K300KSE +/- 644.12, N = 3SE +/- 840.97, N = 3SE +/- 838.05, N = 3SE +/- 2598.47, N = 3SE +/- 2430.78, N = 101939121883472573592618872676851. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random ReadIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2PAMD EPYC 7742 2P90M180M270M360M450MSE +/- 853761.86, N = 3SE +/- 2959260.76, N = 15SE +/- 377978.81, N = 3SE +/- 2001351.31, N = 3SE +/- 3237170.94, N = 32448670042432675202643116763629376514081156391. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Sequential FillIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2PAMD EPYC 7742 2P60K120K180K240K300KSE +/- 125.30, N = 3SE +/- 2880.91, N = 4SE +/- 1285.73, N = 3SE +/- 2178.26, N = 3SE +/- 1933.31, N = 31941721994702686442724852690491. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Random Fill Sync

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random Fill SyncIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2PAMD EPYC 7742 2P50K100K150K200K250KSE +/- 494.90, N = 3SE +/- 2487.47, N = 3SE +/- 1346.31, N = 3SE +/- 4734.36, N = 15SE +/- 3260.74, N = 41663991567721977511941522302201. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Read While WritingIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2PAMD EPYC 7742 2P3M6M9M12M15MSE +/- 33828.94, N = 3SE +/- 44037.06, N = 15SE +/- 102102.82, N = 15SE +/- 156017.91, N = 15SE +/- 264808.00, N = 126331092504438675299589895384119958181. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Performance / Cost - Test: Random Fill

OpenBenchmarking.orgOp/s Per Dollar, More Is BetterFacebook RocksDB 6.3.6Performance / Cost - Test: Random FillIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2PAMD EPYC 7742 2P10203040509.6929.4345.6824.2117.791. Intel Xeon Platinum 8280 2P: $20018 reported cost.2. AMD EPYC 7601 2P: $6400 reported cost.3. AMD EPYC 7502 2P: $5634 reported cost.4. AMD EPYC 7642 2P: $10818 reported cost.5. AMD EPYC 7742 2P: $15044 reported cost.

Facebook RocksDB

Performance / Cost - Test: Random Read

OpenBenchmarking.orgOp/s Per Dollar, More Is BetterFacebook RocksDB 6.3.6Performance / Cost - Test: Random ReadIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2PAMD EPYC 7742 2P10K20K30K40K50K12232.3438010.5546913.6833549.4227128.131. Intel Xeon Platinum 8280 2P: $20018 reported cost.2. AMD EPYC 7601 2P: $6400 reported cost.3. AMD EPYC 7502 2P: $5634 reported cost.4. AMD EPYC 7642 2P: $10818 reported cost.5. AMD EPYC 7742 2P: $15044 reported cost.

Facebook RocksDB

Performance / Cost - Test: Sequential Fill

OpenBenchmarking.orgOp/s Per Dollar, More Is BetterFacebook RocksDB 6.3.6Performance / Cost - Test: Sequential FillIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2PAMD EPYC 7742 2P11223344559.7031.1747.6825.1917.881. Intel Xeon Platinum 8280 2P: $20018 reported cost.2. AMD EPYC 7601 2P: $6400 reported cost.3. AMD EPYC 7502 2P: $5634 reported cost.4. AMD EPYC 7642 2P: $10818 reported cost.5. AMD EPYC 7742 2P: $15044 reported cost.

Facebook RocksDB

Performance / Cost - Test: Random Fill Sync

OpenBenchmarking.orgOp/s Per Dollar, More Is BetterFacebook RocksDB 6.3.6Performance / Cost - Test: Random Fill SyncIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2PAMD EPYC 7742 2P8162432408.3124.5035.1017.9515.301. Intel Xeon Platinum 8280 2P: $20018 reported cost.2. AMD EPYC 7601 2P: $6400 reported cost.3. AMD EPYC 7502 2P: $5634 reported cost.4. AMD EPYC 7642 2P: $10818 reported cost.5. AMD EPYC 7742 2P: $15044 reported cost.

Facebook RocksDB

Performance / Cost - Test: Read While Writing

OpenBenchmarking.orgOp/s Per Dollar, More Is BetterFacebook RocksDB 6.3.6Performance / Cost - Test: Read While WritingIntel Xeon Platinum 8280 2PAMD EPYC 7601 2PAMD EPYC 7502 2PAMD EPYC 7642 2PAMD EPYC 7742 2P30060090012001500316.27788.191336.52914.71797.381. Intel Xeon Platinum 8280 2P: $20018 reported cost.2. AMD EPYC 7601 2P: $6400 reported cost.3. AMD EPYC 7502 2P: $5634 reported cost.4. AMD EPYC 7642 2P: $10818 reported cost.5. AMD EPYC 7742 2P: $15044 reported cost.

Phoronix Test Suite v10.8.4