Apache Hadoop Benchmark - OpenBenchmarking.org

This is a benchmark of the Apache Hadoop making use of its built-in name-node throughput benchmark (NNThroughputBenchmark).

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark hadoop.

* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data updated weekly as of 24 November 2023.

Performance Metrics

Apache Hadoop 3.3.6

Operation: Create - Threads: 20 - Files: 100000

OpenBenchmarking.org metrics for this test profile configuration based on 88 public results since 7 September 2023 with the latest data as of 20 November 2023.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Compatible Public Results

Ops per sec (Average)

AMD Ryzen 9 7900X 12-Core

99th

73882 ^{+/- 1150}

AMD Ryzen 9 7900 12-Core

86th

64007 ^{+/- 7202}

Intel Xeon E-2336

80th

56025 ^{+/- 435}

Mid-Tier

75th

< 55036

Intel Xeon Platinum 8490H

74th

53973 ^{+/- 1164}

AMD Ryzen 9 7950X 16-Core

66th

48314 ^{+/- 5}

2 x Intel Xeon Platinum 8490H

62nd

44039 ^{+/- 1611}

AMD EPYC 7763 64-Core

58th

39825

Intel Core i9-13900K

51st

39262 ^{+/- 178}

Median

50th

39165

AMD Ryzen Threadripper PRO 5965WX 24-Cores

44th

30856 ^{+/- 489}

AMD Ryzen 7 PRO 5850U

41st

30488 ^{+/- 85}

AMD Ryzen 7 7840U

36th

27927 ^{+/- 1670}

AMD Ryzen 9 3900XT 12-Core

26th

18966 ^{+/- 187}

Low-Tier

25th

< 18804

Intel Core i7-1165G7

19th

7733 ^{+/- 672}

Intel Core i9-10980XE

19th

7554

AMD Ryzen Threadripper PRO 7995WX 96-Cores

9th

5634 ^{+/- 88}

AMD Ryzen Threadripper 3970X 32-Core

5th

3567

Based on OpenBenchmarking.org data, the selected test / test configuration (Apache Hadoop 3.3.6 - Operation: Create - Threads: 20 - Files: 100000) has an average run-time of 2 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

okt 2 Systems - 358 Benchmark Results	AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship Ubuntu 22.04 - 6.2.0-35-generic - GNOME Shell 42.2
2 X AMD EPYC 7A23 48-CORE 12 Systems - 111 Benchmark Results	2 x AMD EPYC 7A23 48-Core - AMD DAYTONA_X - AMD Starship Ubuntu 20.04 - 5.15.0-86-generic - GNOME Shell 3.36.9
atomicrulez_redhat_8.9_beta_hadoop 1 System - 75 Benchmark Results	Intel Core i9-10850K - ASUS ROG MAXIMUS XII APEX - Intel Comet Lake PCH RedHatEnterprise 8.9 - 4.18.0-513.1.1.el8_9.x86_64 - GNOME Shell 3.32.2
2 x Intel Xeon Gold 5318Y 13 Systems - 63 Benchmark Results	2 x Intel Xeon Gold 5318Y - H3C RS35M2C16SB - Intel Device 0998 Ubuntu 22.04 - 5.15.0-83-generic - GCC 11.4.0
2 x Intel Xeon Gold 5318Y 12 Systems - 62 Benchmark Results	2 x Intel Xeon Gold 5318Y - H3C RS35M2C16SB - Intel Device 0998 Ubuntu 22.04 - 5.15.0-83-generic - GCC 11.4.0
tt 3 Systems - 76 Benchmark Results	AMD Ryzen 7 7840U - PHX Ray_PEU - AMD Device 14e8 Ubuntu 23.10 - 6.5.0-with-patch2 - GNOME Shell
9684x 2p sep 4 Systems - 183 Benchmark Results
3970x sep 2023 1 System - 332 Benchmark Results	AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship Ubuntu 22.04 - 5.19.0-051900rc7-generic - GNOME Shell 42.2
9684x 2p sep 2 Systems - 141 Benchmark Results	2 x AMD EPYC 9684X 96-Core - AMD Titanite_4G - AMD Device 14a4 Ubuntu 23.10 - 6.5.1-060501-generic - GNOME Shell
7763 sep 1 System - 95 Benchmark Results	AMD EPYC 7763 64-Core - AMD DAYTONA_X - AMD Starship Ubuntu 22.04 - 5.15.0-47-generic - GNOME Shell 42.4
Bergamo 1 System - 188 Benchmark Results	AMD EPYC 9754 128-Core - AMD Titanite_4G - AMD Device 14a4 Ubuntu 23.10 - 6.5.1-060501-generic - GNOME Shell
ssf 3 Systems - 73 Benchmark Results	Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP Ubuntu 23.04 - 6.5.0-rc5-phx-tues - GNOME Shell 44.3
sssa 2 Systems - 191 Benchmark Results	AMD Ryzen 7 PRO 5850U - HP 8A78 - AMD Renoir Pop 22.04 - 6.2.6-76060206-generic - GNOME Shell 42.5
db xeon e 2 Systems - 46 Benchmark Results	Intel Xeon E-2336 - ASRockRack E3C252D4U - Intel Tiger Lake-H Ubuntu 22.04 - 6.5.1-060501-generic - GNOME Shell 42.9
ddd 5 Systems - 56 Benchmark Results	Intel Core i9-13900K - ASUS PRIME Z790-P WIFI - Intel Device 7a27 Ubuntu 22.04 - 6.4.6-060406-generic - GNOME Shell 42.9

2 x Intel Xeon Gold 5318Y 13 Systems - 63 Benchmark Results	2 x Intel Xeon Gold 5318Y - H3C RS35M2C16SB - Intel Device 0998 Ubuntu 22.04 - 5.15.0-83-generic - GCC 11.4.0
9684x 2p sep 4 Systems - 183 Benchmark Results
tt 3 Systems - 76 Benchmark Results	AMD Ryzen 7 7840U - PHX Ray_PEU - AMD Device 14e8 Ubuntu 23.10 - 6.5.0-with-patch2 - GNOME Shell
db xeon e 2 Systems - 46 Benchmark Results	Intel Xeon E-2336 - ASRockRack E3C252D4U - Intel Tiger Lake-H Ubuntu 22.04 - 6.5.1-060501-generic - GNOME Shell 42.9
AMD Ryzen 7000 Series ECC DRAM 2 Systems - 244 Benchmark Results	AMD Ryzen 9 7900X 12-Core - ASRockRack B650D4U-2L2T/BCM - AMD Device 14d8 Ubuntu 22.04 - 6.6.0-060600rc1daily20230913-generic - GNOME Shell 42.9
ryzen db 2 Systems - 37 Benchmark Results	AMD Ryzen 9 7950X 16-Core - ASUS ROG STRIX X670E-E GAMING WIFI - AMD Device 14d8 Ubuntu 23.04 - 6.3.13-060313-generic - GNOME Shell 44.3
sssa 2 Systems - 191 Benchmark Results	AMD Ryzen 7 PRO 5850U - HP 8A78 - AMD Renoir Pop 22.04 - 6.2.6-76060206-generic - GNOME Shell 42.5
tidb laptop 2 Systems - 46 Benchmark Results	AMD Ryzen 9 5900HX - ASUS G513QY v1.0 - AMD Renoir Ubuntu 22.10 - 5.19.0-46-generic - GNOME Shell 43.0
9684x 2p sep 2 Systems - 141 Benchmark Results	2 x AMD EPYC 9684X 96-Core - AMD Titanite_4G - AMD Device 14a4 Ubuntu 23.10 - 6.5.1-060501-generic - GNOME Shell
tidb-laptop 5 Systems - 46 Benchmark Results	AMD Ryzen 9 5900HX - ASUS G513QY v1.0 - AMD Renoir Ubuntu 22.10 - 5.19.0-46-generic - GNOME Shell 43.0
db xeon e 2 Systems - 46 Benchmark Results	Intel Xeon E-2336 - ASRockRack E3C252D4U - Intel Tiger Lake-H Ubuntu 22.04 - 6.5.1-060501-generic - GNOME Shell 42.9
2 x Intel Xeon Gold 5318Y 12 Systems - 62 Benchmark Results	2 x Intel Xeon Gold 5318Y - H3C RS35M2C16SB - Intel Device 0998 Ubuntu 22.04 - 5.15.0-83-generic - GCC 11.4.0
ssf 3 Systems - 73 Benchmark Results	Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP Ubuntu 23.04 - 6.5.0-rc5-phx-tues - GNOME Shell 44.3
2 X AMD EPYC 7A23 48-CORE 12 Systems - 111 Benchmark Results	2 x AMD EPYC 7A23 48-Core - AMD DAYTONA_X - AMD Starship Ubuntu 20.04 - 5.15.0-86-generic - GNOME Shell 3.36.9
ryzen db 2 Systems - 37 Benchmark Results	AMD Ryzen 9 7950X 16-Core - ASUS ROG STRIX X670E-E GAMING WIFI - AMD Device 14d8 Ubuntu 23.04 - 6.3.13-060313-generic - GNOME Shell 44.3

Apache Hadoop

Project Site

Source Repository

Test Created

Test Maintainer

Test Type

Average Install Time

Average Run Time

Test Dependencies

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

Apache Hadoop 3.3.6

Operation: Create - Threads: 20 - Files: 100000

Tested CPU Architectures

Recent Test Results

Most Popular Test Results