OpenJDK Java, GraalVM, OpenJ9 Benchmarks

Java benchmarks by Michael Larabel with OpenJDK, GraalVM CE, OpenJ9.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2005271-PTS-OPENJDKJ78
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

CPU Massive 5 Tests
Java 4 Tests
Server CPU Tests 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
OpenJDK 14.0.1
May 23 2020
  7 Hours, 56 Minutes
OpenJDK 15 EA24
May 24 2020
  7 Hours, 30 Minutes
OpenJDK 11
May 24 2020
  8 Hours, 26 Minutes
OpenJDK 8
May 25 2020
  7 Hours, 54 Minutes
GraalVM 20.1 Java 8
May 25 2020
  7 Hours, 27 Minutes
GraalVM 20.1 Java 11
May 25 2020
  9 Hours, 3 Minutes
OpenJ9 0.20 Java 8
May 26 2020
  8 Hours, 2 Minutes
OpenJ9 0.20 Java 11
May 26 2020
  8 Hours, 2 Minutes
Invert Hiding All Results Option
  8 Hours, 3 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

OpenJDK 14.0.1

Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c
Java Notes: OpenJDK Runtime Environment (build 14.0.1+7)
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

OpenJDK 15 EA24

Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c
Java Notes: OpenJDK Runtime Environment (build 15-ea+24-1168)
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

OpenJDK 11

Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c
Java Notes: OpenJDK Runtime Environment 18.9 (build 11+28)
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

OpenJDK 8

Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c
Java Notes: OpenJDK Runtime Environment (build 1.8.0_41-b04)
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

GraalVM 20.1 Java 8

Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c
Java Notes: OpenJDK Runtime Environment (build 1.8.0_252-b09)
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

GraalVM 20.1 Java 11

Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c
Java Notes: OpenJDK Runtime Environment GraalVM CE 20.1.0 (build 11.0.7+10-jvmci-20.1-b02)
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

OpenJ9 0.20 Java 8

Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c
Java Notes: OMR d4365f371
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

OpenJ9 0.20 Java 11

Processor: Intel Core i9-10980XE @ 4.80GHz (18 Cores / 36 Threads), Motherboard: ASRock X299 Steel Legend (P1.30 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 32GB, Disk: Samsung SSD 970 PRO 512GB, Graphics: NVIDIA NV132 11GB, Audio: Realtek ALC1220, Monitor: ASUS MG28U, Network: Intel I219-V + Intel I211

OS: Ubuntu 20.04, Kernel: 5.4.0-31-generic (x86_64), Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 4.3 Mesa 20.0.4, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 3840x2160

OpenJDK Java, GraalVM, OpenJ9 BenchmarksOpenBenchmarking.orgPhoronix Test SuiteIntel Core i9-10980XE @ 4.80GHz (18 Cores / 36 Threads)ASRock X299 Steel Legend (P1.30 BIOS)Intel Sky Lake-E DMI3 Registers32GBSamsung SSD 970 PRO 512GBNVIDIA NV132 11GBRealtek ALC1220ASUS MG28UIntel I219-V + Intel I211Ubuntu 20.045.4.0-31-generic (x86_64)GNOME Shell 3.36.1X Server 1.20.8modesetting 1.20.84.3 Mesa 20.0.4GCC 9.3.0ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionOpenJDK Java, GraalVM, OpenJ9 Benchmarks PerformanceSystem Logs- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c- OpenJDK 14.0.1: OpenJDK Runtime Environment (build 14.0.1+7)- OpenJDK 15 EA24: OpenJDK Runtime Environment (build 15-ea+24-1168)- OpenJDK 11: OpenJDK Runtime Environment 18.9 (build 11+28)- OpenJDK 8: OpenJDK Runtime Environment (build 1.8.0_41-b04)- GraalVM 20.1 Java 8: OpenJDK Runtime Environment (build 1.8.0_252-b09)- GraalVM 20.1 Java 11: OpenJDK Runtime Environment GraalVM CE 20.1.0 (build 11.0.7+10-jvmci-20.1-b02) - OpenJ9 0.20 Java 8: OMR d4365f371- OpenJ9 0.20 Java 11: OMR d4365f371- itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 11OpenJDK 8GraalVM 20.1 Java 8GraalVM 20.1 Java 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11Result OverviewPhoronix Test Suite100%114%128%142%SPECjbb 2015Apache HBaseRenaissanceDaCapo BenchmarkJava SciMark

OpenJDK Java, GraalVM, OpenJ9 Benchmarksspec-jbb2015: SPECjbb2015-Composite critical-jOPSspec-jbb2015: SPECjbb2015-Composite max-jOPSrenaissance: Savina Reactors.IOrenaissance: Genetic Algorithm Using Jenetics + Futuresjava-gradle-perf: Reactorrenaissance: Akka Unbalanced Cobwebbed Treerenaissance: Scala Dottyhbase: Async Rand Read - 32hbase: Async Rand Read - 32hbase: Increment - 32hbase: Increment - 32dacapobench: Tradebeanshbase: Async Rand Read - 1hbase: Async Rand Read - 1dacapobench: Tradesoaphbase: Rand Read - 1hbase: Rand Read - 1renaissance: Twitter HTTP Requestshbase: Rand Read - 32hbase: Rand Read - 32java-scimark2: Compositedacapobench: H2dacapobench: Jythonjava-scimark2: Jacobi Successive Over-Relaxationjava-scimark2: Dense LU Matrix Factorizationjava-scimark2: Sparse Matrix Multiplyjava-scimark2: Fast Fourier Transformjava-scimark2: Monte CarloOpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 11OpenJDK 8GraalVM 20.1 Java 8GraalVM 20.1 Java 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11245184093712821.4114751.337262.17310789.3301721.468393807993638738093309810114354112877002580.7191731812322218.31541438681908.954759.421971.641271.681179.86241864143012358.7874804.46210760.5491660.572376844143888180892259410475333115663552522.020387820342328.99550739011896.174847.582325.781397.091178.33178633995123220.8745062.544243.49211574.6861520.527374848123848238681329710152369613175462446.910405783352488.75525939031856.195616.192385.301405.661180.42120873987812403.2903377.39910458.5331050.9521591977963548946184699810089397010792582157.5201701841372355.09583534461856.195250.952272.351215.711180.26126504143014987.3325265.043190.46210343.417976.5511581992613758460992679810110436311288112018.0711771767881846.47660936411478.302694.962508.261834.87715.96188423885319849.4235300.317249.91810625.4321563.8781611946713848231796379810016409911287842343.0361781765371835.14657838121479.142719.452472.181798.47706.47128673659616534.6425773.578258.43012042.0311752.36615919718437285085100990311288032520.9561771772372172.32686766871837.175604.051444.421517.67458.28112383700718338.9715747.812290.16012025.4552132.39716119515938681997126781213573182615.4411781762022171.85698568041838.045605.811443.531513.16458.72OpenBenchmarking.org

SPECjbb 2015

This is a benchmark of SPECjbb 2015. For this test profile to work, you must have a valid license/copy of the SPECjbb 2015 ISO (SPECjbb2015-1.02.iso) in your Phoronix Test Suite download cache. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgjOPS, More Is BetterSPECjbb 2015SPECjbb2015-Composite critical-jOPSGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 85K10K15K20K25K1884212650112381286717863245182418612087

OpenBenchmarking.orgjOPS, More Is BetterSPECjbb 2015SPECjbb2015-Composite max-jOPSGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 89K18K27K36K45K3885341430370073659639951409374143039878

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Savina Reactors.IOGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 85K10K15K20K25KSE +/- 523.39, N = 15SE +/- 266.12, N = 20SE +/- 312.33, N = 20SE +/- 229.60, N = 20SE +/- 379.82, N = 20SE +/- 163.33, N = 20SE +/- 159.80, N = 20SE +/- 143.42, N = 1719849.4214987.3318338.9716534.6423220.8712821.4112358.7912403.29

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Genetic Algorithm Using Jenetics + FuturesGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 812002400360048006000SE +/- 71.17, N = 15SE +/- 47.99, N = 5SE +/- 65.09, N = 7SE +/- 72.42, N = 5SE +/- 52.90, N = 15SE +/- 40.11, N = 20SE +/- 56.31, N = 15SE +/- 62.34, N = 205300.325265.045747.815773.585062.544751.344804.463377.40

Java Gradle Build

This test runs Java software project builds using the Gradle build system. It is intended to give developers an idea as to the build performance for development activities and build servers. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterJava Gradle BuildGradle Build: ReactorGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.160120180240300SE +/- 3.15, N = 9SE +/- 4.97, N = 12SE +/- 3.32, N = 9SE +/- 3.37, N = 9SE +/- 3.68, N = 3SE +/- 3.82, N = 3249.92190.46290.16258.43243.49262.17

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Akka Unbalanced Cobwebbed TreeGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 83K6K9K12K15KSE +/- 95.55, N = 5SE +/- 111.93, N = 5SE +/- 104.95, N = 5SE +/- 79.71, N = 5SE +/- 68.81, N = 5SE +/- 99.11, N = 5SE +/- 65.78, N = 5SE +/- 110.87, N = 510625.4310343.4212025.4612042.0311574.6910789.3310760.5510458.53

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Scala DottyGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 85001000150020002500SE +/- 6.33, N = 5SE +/- 11.70, N = 5SE +/- 11.40, N = 5SE +/- 20.66, N = 5SE +/- 5.70, N = 5SE +/- 4.33, N = 5SE +/- 4.34, N = 5SE +/- 7.13, N = 251563.88976.552132.401752.371520.531721.471660.571050.95

Apache HBase

This is a benchmark of the Apache HBase non-relational distributed database system inspired from Google's Bigtable. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 32GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 890180270360450SE +/- 1.35, N = 15SE +/- 1.63, N = 9SE +/- 0.58, N = 3SE +/- 0.88, N = 3SE +/- 3.69, N = 9SE +/- 5.17, N = 3SE +/- 3.83, N = 9SE +/- 1.86, N = 3161158161159374393376159

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 32GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 840K80K120K160K200KSE +/- 1624.51, N = 15SE +/- 1975.69, N = 9SE +/- 996.13, N = 3SE +/- 1055.62, N = 3SE +/- 805.95, N = 9SE +/- 1139.85, N = 3SE +/- 827.01, N = 9SE +/- 2802.32, N = 3194671199261195159197184848128079984414197796

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Increment - Clients: 32GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 880160240320400SE +/- 1.45, N = 3SE +/- 4.37, N = 3SE +/- 3.48, N = 3SE +/- 2.40, N = 3SE +/- 1.53, N = 3SE +/- 4.32, N = 5SE +/- 4.80, N = 5SE +/- 2.19, N = 3384375386372384363388354

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Increment - Clients: 32GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 820K40K60K80K100KSE +/- 161.39, N = 3SE +/- 1159.19, N = 3SE +/- 548.24, N = 3SE +/- 754.83, N = 3SE +/- 522.72, N = 3SE +/- 1168.34, N = 5SE +/- 1066.90, N = 5SE +/- 432.05, N = 38231784609819978508582386873808180889461

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: TradebeansGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 82K4K6K8K10KSE +/- 52.55, N = 4SE +/- 21.96, N = 4SE +/- 35.38, N = 4SE +/- 137.85, N = 4SE +/- 38.02, N = 4SE +/- 58.56, N = 18963792678132933092258469

Apache HBase

This is a benchmark of the Apache HBase non-relational distributed database system inspired from Google's Bigtable. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 1GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 8306090120150SE +/- 1.14, N = 13SE +/- 1.05, N = 15SE +/- 1.47, N = 5SE +/- 1.18, N = 6SE +/- 1.08, N = 6SE +/- 0.94, N = 15SE +/- 1.03, N = 14SE +/- 1.19, N = 14989812610097989498

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 1GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 82K4K6K8K10KSE +/- 106.92, N = 13SE +/- 98.81, N = 15SE +/- 99.51, N = 5SE +/- 119.37, N = 6SE +/- 112.16, N = 6SE +/- 89.29, N = 15SE +/- 106.61, N = 14SE +/- 114.71, N = 1410016101107812990310152101141047510089

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: TradesoapGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 89001800270036004500SE +/- 35.21, N = 20SE +/- 19.52, N = 4SE +/- 20.79, N = 4SE +/- 30.20, N = 12SE +/- 35.88, N = 4SE +/- 28.42, N = 4409943633696354133313970

Apache HBase

This is a benchmark of the Apache HBase non-relational distributed database system inspired from Google's Bigtable. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Random Read - Clients: 1GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 8306090120150SE +/- 1.06, N = 11SE +/- 1.12, N = 12SE +/- 1.53, N = 3SE +/- 0.98, N = 15SE +/- 1.06, N = 15SE +/- 0.88, N = 3SE +/- 1.33, N = 3SE +/- 0.33, N = 3112112135112131128156107

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Random Read - Clients: 1GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 82K4K6K8K10KSE +/- 78.39, N = 11SE +/- 83.93, N = 12SE +/- 81.03, N = 3SE +/- 69.31, N = 15SE +/- 60.96, N = 15SE +/- 50.09, N = 3SE +/- 54.20, N = 3SE +/- 41.59, N = 387848811731888037546770063559258

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Twitter HTTP RequestsGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 86001200180024003000SE +/- 23.48, N = 8SE +/- 8.34, N = 5SE +/- 13.53, N = 5SE +/- 11.47, N = 5SE +/- 11.61, N = 5SE +/- 18.53, N = 5SE +/- 26.94, N = 7SE +/- 6.36, N = 52343.042018.072615.442520.962446.912580.722522.022157.52

Apache HBase

This is a benchmark of the Apache HBase non-relational distributed database system inspired from Google's Bigtable. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Random Read - Clients: 32GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 890180270360450SE +/- 1.53, N = 3SE +/- 1.53, N = 3SE +/- 1.76, N = 3SE +/- 2.52, N = 3SE +/- 1.86, N = 3SE +/- 5.86, N = 3SE +/- 1.20, N = 3178177178177405173387170

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Random Read - Clients: 32GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 840K80K120K160K200KSE +/- 1394.59, N = 3SE +/- 360.02, N = 3SE +/- 1653.04, N = 3SE +/- 1885.48, N = 3SE +/- 546.95, N = 3SE +/- 1641.62, N = 3SE +/- 1297.36, N = 3SE +/- 1562.89, N = 31765371767881762021772377833518123282034184137

Java SciMark

This test runs the Java version of SciMark 2.0, which is a benchmark for scientific and numerical computing developed by programmers at the National Institute of Standards and Technology. This benchmark is made up of Fast Foruier Transform, Jacobi Successive Over-relaxation, Monte Carlo, Sparse Matrix Multiply, and dense LU matrix factorization benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: CompositeGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 85001000150020002500SE +/- 2.12, N = 4SE +/- 2.31, N = 4SE +/- 4.30, N = 4SE +/- 4.09, N = 4SE +/- 27.95, N = 4SE +/- 6.56, N = 4SE +/- 3.35, N = 4SE +/- 4.75, N = 41835.141846.472171.852172.322488.752218.312328.992355.09

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: H2GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 815003000450060007500SE +/- 62.40, N = 4SE +/- 33.66, N = 4SE +/- 65.71, N = 9SE +/- 170.12, N = 16SE +/- 27.17, N = 4SE +/- 27.57, N = 4SE +/- 51.90, N = 4SE +/- 67.44, N = 665786609698568675259541455075835

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: JythonGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 815003000450060007500SE +/- 11.78, N = 4SE +/- 11.57, N = 4SE +/- 83.10, N = 5SE +/- 85.57, N = 4SE +/- 10.96, N = 4SE +/- 12.43, N = 4SE +/- 13.06, N = 4SE +/- 11.45, N = 438123641680466873903386839013446

Java SciMark

This test runs the Java version of SciMark 2.0, which is a benchmark for scientific and numerical computing developed by programmers at the National Institute of Standards and Technology. This benchmark is made up of Fast Foruier Transform, Jacobi Successive Over-relaxation, Monte Carlo, Sparse Matrix Multiply, and dense LU matrix factorization benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Jacobi Successive Over-RelaxationGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 8400800120016002000SE +/- 0.16, N = 4SE +/- 1.13, N = 4SE +/- 1.45, N = 4SE +/- 2.21, N = 4SE +/- 0.56, N = 4SE +/- 9.08, N = 4SE +/- 9.48, N = 4SE +/- 0.76, N = 41479.141478.301838.041837.171856.191908.951896.171856.19

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Dense LU Matrix FactorizationGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 812002400360048006000SE +/- 1.16, N = 4SE +/- 0.86, N = 4SE +/- 15.84, N = 4SE +/- 17.54, N = 4SE +/- 119.94, N = 4SE +/- 11.89, N = 4SE +/- 10.07, N = 4SE +/- 22.76, N = 42719.452694.965605.815604.055616.194759.424847.585250.95

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Sparse Matrix MultiplyGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 85001000150020002500SE +/- 1.46, N = 4SE +/- 1.02, N = 4SE +/- 1.19, N = 4SE +/- 0.41, N = 4SE +/- 1.17, N = 4SE +/- 13.08, N = 4SE +/- 0.26, N = 4SE +/- 1.29, N = 42472.182508.261443.531444.422385.301971.642325.782272.35

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Fast Fourier TransformGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 8400800120016002000SE +/- 9.84, N = 4SE +/- 9.86, N = 4SE +/- 4.93, N = 4SE +/- 7.69, N = 4SE +/- 31.21, N = 4SE +/- 22.74, N = 4SE +/- 14.42, N = 4SE +/- 0.21, N = 41798.471834.871513.161517.671405.661271.681397.091215.71

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Monte CarloGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8OpenJDK 11OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 830060090012001500SE +/- 1.14, N = 4SE +/- 1.62, N = 4SE +/- 0.22, N = 4SE +/- 0.24, N = 4SE +/- 0.09, N = 4SE +/- 0.43, N = 4SE +/- 2.05, N = 4SE +/- 0.13, N = 4706.47715.96458.72458.281180.421179.861178.331180.26

OpenJDK 14.0.1

Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c
Java Notes: OpenJDK Runtime Environment (build 14.0.1+7)
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 23 May 2020 18:51 by user pts.

OpenJDK 15 EA24

Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c
Java Notes: OpenJDK Runtime Environment (build 15-ea+24-1168)
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 24 May 2020 06:12 by user pts.

OpenJDK 11

Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c
Java Notes: OpenJDK Runtime Environment 18.9 (build 11+28)
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 24 May 2020 16:01 by user pts.

OpenJDK 8

Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c
Java Notes: OpenJDK Runtime Environment (build 1.8.0_41-b04)
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 25 May 2020 06:24 by user pts.

GraalVM 20.1 Java 8

Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c
Java Notes: OpenJDK Runtime Environment (build 1.8.0_252-b09)
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 25 May 2020 12:53 by user pts.

GraalVM 20.1 Java 11

Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c
Java Notes: OpenJDK Runtime Environment GraalVM CE 20.1.0 (build 11.0.7+10-jvmci-20.1-b02)
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 25 May 2020 18:36 by user pts.

OpenJ9 0.20 Java 8

Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c
Java Notes: OMR d4365f371
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 26 May 2020 08:58 by user pts.

OpenJ9 0.20 Java 11

Processor: Intel Core i9-10980XE @ 4.80GHz (18 Cores / 36 Threads), Motherboard: ASRock X299 Steel Legend (P1.30 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 32GB, Disk: Samsung SSD 970 PRO 512GB, Graphics: NVIDIA NV132 11GB, Audio: Realtek ALC1220, Monitor: ASUS MG28U, Network: Intel I219-V + Intel I211

OS: Ubuntu 20.04, Kernel: 5.4.0-31-generic (x86_64), Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 4.3 Mesa 20.0.4, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 3840x2160

Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c
Java Notes: OMR d4365f371
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 26 May 2020 16:04 by user pts.