Java JMH

This very basic test profile runs the stock benchmark of the Java JMH benchmark via Maven.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark java-jmh.

Project Site

openjdk.java.net

Test Created

18 September 2017

Last Updated

31 March 2022

Test Maintainer

Michael Larabel

Test Type

System

Average Install Time

1 Minute, 53 Seconds

Average Run Time

8 Minutes, 28 Seconds

Test Dependencies

Java + Apache Maven

Accolades

50k+ Downloads

Supported Platforms

* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 23 May 2022.

Revision History

pts/java-jmh-1.0.1 [View Source] Thu, 31 Mar 2022 13:27:49 GMT
This test isn't particularly useful but land result definition parser fix. Closes: https://github.com/phoronix-test-suite/phoronix-test-suite/issues/612

pts/java-jmh-1.0.0 [View Source] Mon, 18 Sep 2017 10:59:09 GMT
initial commit of Java JMH benchmark

Suites Using This Test

Java

Performance Metrics

Analyze Test Configuration:

Java JMH

Throughput

OpenBenchmarking.org metrics for this test profile configuration based on 455 public results since 18 September 2017 with the latest data as of 26 May 2022.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Compatible Public Results

Ops/s (Average)

Ampere ARMv8 Neoverse-N1 256-Core

100th

486921614157 ^{+/- 7680334006}

2 x AMD EPYC 7773X 64-Core

100th

156781990883 ^{+/- 5597170998}

2 x AMD EPYC 7763 64-Core

98th

144461701657 ^{+/- 100951287}

2 x Intel Xeon Platinum 8380

97th

117672844601 ^{+/- 616035351}

2 x Intel Xeon Gold 6138

96th

101297920410 ^{+/- 4595842133}

AMD Ryzen Threadripper 3990X 64-Core

95th

98586942585 ^{+/- 281792536}

2 x AMD EPYC 75F3 32-Core

93rd

97909515488 ^{+/- 820593461}

2 x AMD EPYC 7573X 32-Core

91st

93955442332 ^{+/- 88010060}

2 x AMD EPYC 7601 32-Core

89th

85678204725 ^{+/- 69195034}

AMD EPYC 7773X 64-Core

88th

77115876193 ^{+/- 862622236}

AMD EPYC 7763 64-Core

86th

73726407264 ^{+/- 418458666}

AMD Ryzen Threadripper 3970X 32-Core

85th

63736905982 ^{+/- 35810781}

Intel Core i9-7980XE

81st

60279832810 ^{+/- 3818644350}

2 x AMD EPYC 7401 24-Core

81st

60181524085 ^{+/- 434995678}

2 x Intel Xeon Gold 5220R

78th

53405848522 ^{+/- 100321925}

2 x AMD EPYC 7373X 16-Core

78th

53335279581 ^{+/- 303832070}

Intel Core i9-12900K

76th

52299759298 ^{+/- 472285412}

Mid-Tier

75th

< 49546141096

AMD EPYC 75F3 32-Core

75th

49481126221 ^{+/- 75072711}

AMD Ryzen Threadripper 3960X 24-Core

75th

48174146016 ^{+/- 4281630}

AMD EPYC 7573X 32-Core

74th

47359487721 ^{+/- 483346752}

Intel Core i7-7900X

72nd

41594894822 ^{+/- 314046769}

AMD EPYC 7601 32-Core

71st

41014982005 ^{+/- 757689866}

AMD Ryzen Threadripper 2970WX 24-Core

69th

38039822794 ^{+/- 149152380}

Intel Core i9-10980XE

68th

33244175366 ^{+/- 4984100}

AMD Ryzen 9 3950X 16-Core

67th

32633108005 ^{+/- 7957390}

AMD Ryzen 9 5950X 16-Core

65th

29201811757 ^{+/- 212928173}

AMD Ryzen Threadripper 1950X 16-Core

64th

27948935098 ^{+/- 185182864}

AMD EPYC 7373X 16-Core

62nd

26837339924 ^{+/- 124995648}

AMD Ryzen 9 5900X 12-Core

57th

22875460626 ^{+/- 448136839}

Intel Core i5-12400

56th

22285793005 ^{+/- 1139014844}

ARMv8 Neoverse-V1 8-Core

53rd

18928471502 ^{+/- 1382739013}

Intel Core i7-4790K

51st

17728554731 ^{+/- 416415242}

AMD Ryzen 7 3800XT 8-Core

51st

16891495553 ^{+/- 9745773}

Median

50th

16881940131

Intel Xeon Silver 4108

50th

16654472360 ^{+/- 174371818}

AMD Ryzen 7 3700X 8-Core

49th

16042391855 ^{+/- 74936945}

AMD Ryzen 9 5900HX

49th

15986772199 ^{+/- 43070466}

Intel Core i5-6600K

47th

15582043013 ^{+/- 747925}

AMD EPYC 7F32 8-Core

45th

15523431509 ^{+/- 115602}

AMD Ryzen 7 5800X3D 8-Core

43rd

15086968721 ^{+/- 29733920}

AMD Ryzen 7 1800X Eight-Core

41st

14770435718 ^{+/- 29319698}

Intel Xeon E3-1280 v5

39th

14707652996 ^{+/- 94007526}

Intel Core i3-8100

39th

14528030429 ^{+/- 171518708}

AMD Ryzen 7 4800U

34th

12921983081 ^{+/- 482894740}

AMD Ryzen 7 1700 Eight-Core

32nd

12762611258 ^{+/- 22934751}

AMD Ryzen 5 1600X Six-Core

29th

11472849362 ^{+/- 507699790}

AMD Ryzen 7 PRO 5850U

29th

11270939066 ^{+/- 426191922}

AMD Ryzen 5 5500

27th

10757224654 ^{+/- 58237053}

Low-Tier

25th

< 10327335008

Apple M1

25th

10168725043 ^{+/- 76596536}

AMD Ryzen 5 5500U

24th

9933256621 ^{+/- 24138712}

Intel Core i7-1185G7

22nd

8282596846 ^{+/- 288532495}

Intel Core i5-1135G7

21st

8073026687 ^{+/- 327049005}

Intel Core i5-1145G7

20th

7666886608 ^{+/- 12811370}

Intel Core i7-1065G7

17th

6880085399 ^{+/- 92039736}

Intel Core i3-4130

16th

6716525642 ^{+/- 41567095}

Intel Core i7 920

14th

6262890103 ^{+/- 817908077}

AMD Ryzen 3 1200

14th

6179453673 ^{+/- 10340309}

POWER9 altivec supported 64-Core

9th

3487616679 ^{+/- 487792}

AMD Ryzen 3 3200U

6th

2919264016 ^{+/- 65647271}

Based on OpenBenchmarking.org data, the selected test / test configuration (Java JMH - Throughput) has an average run-time of 9 minutes. By default this test profile is set to run at least 1 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture

Kernel Identifier

Verified On

Intel / AMD x86 64-bit

x86_64

(Many Processors)

sun4v

SPARC-T3 sparcv9

IBM POWER (PowerPC) 64-bit

ppc64le

POWER9 altivec supported 64-Core

MIPS

mips

Baikal-T1 1.2 GHz MIPS P5600 V3.0 FPU V2.0

Intel / AMD x86 32-bit

i686

(Many Processors)

ARMv8 64-bit

aarch64

ARMv8 Neoverse-N1, ARMv8 Neoverse-N1 4-Core, ARMv8 Neoverse-N1 8-Core, ARMv8 Neoverse-V1, ARMv8 Neoverse-V1 4-Core, ARMv8 Neoverse-V1 8-Core, ARMv8 rev 1 4-Core, Ampere ARMv8 Neoverse-N1 256-Core, Apple M1, Cavium ThunderX

aaaa 1 System - 1 Benchmark Result	ARMv8 Neoverse-V1 - Amazon EC2 c7g.4xlarge - Amazon Device 0200 Amazon Linux 2 - 5.10.109-104.500.amzn2.aarch64 - xfs
aaaa 1 System - 1 Benchmark Result	ARMv8 Neoverse-N1 - Amazon EC2 c6g.4xlarge - Amazon Device 0200 Amazon Linux 2 - 5.10.109-104.500.amzn2.aarch64 - xfs
aaaa 1 System - 1 Benchmark Result	ARMv8 Neoverse-V1 - Amazon EC2 c7g.4xlarge - Amazon Device 0200 Amazon Linux 2 - 5.10.109-104.500.amzn2.aarch64 - xfs
c5xlarge_run_2 1 System - 26 Benchmark Results	Intel Xeon Platinum 8124M - Amazon EC2 c5.xlarge - Intel 440FX 82441FX PMC Ubuntu 20.04 - 5.13.0-1022-aws - GNOME Shell 3.36.9
c7gxlarge_run_2 1 System - 26 Benchmark Results	ARMv8 Neoverse-V1 - Amazon EC2 c7g.xlarge - Amazon Device 0200 Ubuntu 20.04 - 5.13.0-1022-aws - X Server 1.20.13
c6axlarge_run_2 1 System - 26 Benchmark Results	AMD EPYC 7R13 - Amazon EC2 c6a.xlarge - Intel 440FX 82441FX PMC Ubuntu 20.04 - 5.13.0-1022-aws - GNOME Shell 3.36.9
6gxlarge_run_2 1 System - 26 Benchmark Results	ARMv8 Neoverse-N1 - Amazon EC2 c6g.xlarge - Amazon Device 0200 Ubuntu 20.04 - 5.13.0-1022-aws - X Server 1.20.13
aaaa 1 System - 8 Benchmark Results	ARMv8 Neoverse-V1 - Amazon EC2 c7g.medium - Amazon Device 0200 Amazon Linux 2 - 5.10.109-104.500.amzn2.aarch64 - GCC 7.3.1 20180712
aaaa 1 System - 8 Benchmark Results	ARMv8 Neoverse-V1 - Amazon EC2 c7g.large - Amazon Device 0200 Amazon Linux 2 - 5.10.109-104.500.amzn2.aarch64 - GCC 7.3.1 20180712
aaaa 1 System - 8 Benchmark Results	ARMv8 Neoverse-V1 - Amazon EC2 c7g.xlarge - Amazon Device 0200 Amazon Linux 2 - 5.10.109-104.500.amzn2.aarch64 - GCC 7.3.1 20180712
aaaa 1 System - 8 Benchmark Results	ARMv8 Neoverse-V1 - Amazon EC2 c7g.2xlarge - Amazon Device 0200 Amazon Linux 2 - 5.10.109-104.500.amzn2.aarch64 - GCC 7.3.1 20180712
aaaa 1 System - 8 Benchmark Results	ARMv8 Neoverse-V1 - Amazon EC2 c7g.4xlarge - Amazon Device 0200 Amazon Linux 2 - 5.10.109-104.500.amzn2.aarch64 - GCC 7.3.1 20180712
Linux Servers RHEL 8.6 2 Systems - 203 Benchmark Results	2 x Intel Xeon Platinum 8380 - Intel M50CYP2SB2U - Intel Device 0998 Red Hat Enterprise Linux 8.6 - 4.18.0-372.9.1.el8.x86_64 - X Server 1.20.11
aaaa 1 System - 8 Benchmark Results	ARMv8 Neoverse-N1 - Amazon EC2 t4g.large - Amazon Device 0200 Amazon Linux 2 - 5.10.109-104.500.amzn2.aarch64 - GCC 7.3.1 20180712
aaaa 1 System - 8 Benchmark Results	AMD EPYC 7571 - Amazon EC2 t3a.medium - Intel 440FX 82441FX PMC Amazon Linux 2 - 5.10.109-104.500.amzn2.x86_64 - GCC 7.3.1 20180712

AMD EPYC 7351P Linux Performance Benchmarks 11 Systems - 26 Benchmark Results	Intel Xeon E5-2687W v3 - MSI X99S SLI PLUS - Intel Xeon E7 v3 Ubuntu 17.10 - 4.13.6-041306-generic - GNOME Shell 3.26.1
Linux 4.15 New CPU Comparison 28 Systems - 37 Benchmark Results	AMD Ryzen 3 1200 - MSI B350M GAMING PRO - AMD Device 1450 Ubuntu 17.10 - 4.15.2-041502-generic - GNOME Shell 3.26.2
Ubuntu 18.04 Linux 4.15.2 Core i9 Extreme vs. Threadripper 1950X 2 Systems - 178 Benchmark Results	AMD Ryzen Threadripper 1950X 16-Core - Gigabyte X399 AORUS Gaming 7 - AMD Family 17h Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2
Ubuntu 18.04 Linux 4.15.2 Core i9 Extreme vs. Threadripper 1950X 3 Systems - 182 Benchmark Results	Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2
Ubuntu 18.04 Linux 4.15.2 Core i9 Extreme Edition 1 System - 173 Benchmark Results	Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2
freebsd-120-current-trueos 4 Systems - 119 Benchmark Results	Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers FreeBSD - 12.0-CURRENT - Clang 6.0.0
Linux 4.15 vs. Linux 4.16-rc1 Kernel Benchmarking On Ubuntu 10 Systems - 49 Benchmark Results	Intel Core i5-6600K - MSI Z170A GAMING PRO - Intel Sky Lake Ubuntu 16.04 - 4.16.0-041600rc1-generic - Unity 7.4.0
Intel Core i3 8100 Ubuntu Linux Benchmarks 30 Systems - 17 Benchmark Results	Intel Core i3-8100 - ASUS PRIME Z370-A - Intel Device 3e1f Ubuntu 17.10 - 4.13.0-11-generic - GNOME Shell 3.26.0
Linux 4.15 New CPU Comparison 21 Systems - 38 Benchmark Results	AMD Ryzen 3 1200 - MSI B350M GAMING PRO - AMD Device 1450 Ubuntu 17.10 - 4.15.2-041502-generic - GNOME Shell 3.26.2
Linux 4.12 To 4.14 7980XE Intel 4 Systems - 42 Benchmark Results	Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Device 2020 Ubuntu 17.10 - 4.14.0-999-generic - GNOME Shell 3.26.0
mesa-commit-tests 255 Systems - 434 Benchmark Results	Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core Family Ubuntu 11.04 - 3.0.0-999-generic - Unity 3.8.10
Intel Core i7 8770K Ubuntu Linux Benchmarks 13 Systems - 17 Benchmark Results	AMD Ryzen 7 1800X Eight-Core - MSI X370 XPOWER GAMING TITANIUM - AMD Device 1450 Ubuntu 17.10 - 4.13.0-11-generic - GNOME Shell 3.26.0
bfk3dn_all 1 System - 67 Benchmark Results	Baikal-T1 1.2 GHz MIPS P5600 V3.0 FPU V2.0 - Baikal-T1 BFK3 evaluation board - 2048MB Debian 9.3 - 4.4.100-bfk3 - GCC 6.3.0 20170516 + Clang 3.8.1-24 + LLVM 3.8.1
Talos 2 Raptor POWER9 System Featured Compiler Comparison	POWER9 altivec supported - PowerNV T2P9D01 REV 1.00 - 262144MB Debian testing - 4.16.0-rc4 - amdgpu 1.4.0
CPU CPB AMD Zen Linux Kernel Test Featured Kernel Comparison	AMD Ryzen 7 1800X Eight-Core - MSI X370 XPOWER GAMING TITANIUM - AMD Family 17h Ubuntu 17.04 - 4.13.7-041307-generic - Unity 7.5.0

Java JMH

Project Site

Test Created

Last Updated

Test Maintainer

Test Type

Average Install Time

Average Run Time

Test Dependencies

Accolades

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

Java JMH

Throughput

Does It Scale Well With Increasing Cores?

Tested CPU Architectures

Recent Test Results

Most Popular Test Results