OpenJDK Java, GraalVM, OpenJ9 Benchmarks

Java benchmarks by Michael Larabel with OpenJDK, GraalVM CE, OpenJ9.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2005271-PTS-OPENJDKJ78
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

CPU Massive 5 Tests
Java 4 Tests
Server CPU Tests 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
OpenJDK 14.0.1
May 23 2020
  7 Hours, 56 Minutes
OpenJDK 15 EA24
May 24 2020
  7 Hours, 30 Minutes
OpenJDK 11
May 24 2020
  8 Hours, 26 Minutes
OpenJDK 8
May 25 2020
  7 Hours, 54 Minutes
GraalVM 20.1 Java 8
May 25 2020
  7 Hours, 27 Minutes
GraalVM 20.1 Java 11
May 25 2020
  9 Hours, 3 Minutes
OpenJ9 0.20 Java 8
May 26 2020
  8 Hours, 2 Minutes
OpenJ9 0.20 Java 11
May 26 2020
  8 Hours, 2 Minutes
Invert Hiding All Results Option
  8 Hours, 3 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


OpenJDK Java, GraalVM, OpenJ9 BenchmarksOpenBenchmarking.orgPhoronix Test SuiteIntel Core i9-10980XE @ 4.80GHz (18 Cores / 36 Threads)ASRock X299 Steel Legend (P1.30 BIOS)Intel Sky Lake-E DMI3 Registers32GBSamsung SSD 970 PRO 512GBNVIDIA NV132 11GBRealtek ALC1220ASUS MG28UIntel I219-V + Intel I211Ubuntu 20.045.4.0-31-generic (x86_64)GNOME Shell 3.36.1X Server 1.20.8modesetting 1.20.84.3 Mesa 20.0.4GCC 9.3.0ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionOpenJDK Java, GraalVM, OpenJ9 Benchmarks PerformanceSystem Logs- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c- OpenJDK 14.0.1: OpenJDK Runtime Environment (build 14.0.1+7)- OpenJDK 15 EA24: OpenJDK Runtime Environment (build 15-ea+24-1168)- OpenJDK 11: OpenJDK Runtime Environment 18.9 (build 11+28)- OpenJDK 8: OpenJDK Runtime Environment (build 1.8.0_41-b04)- GraalVM 20.1 Java 8: OpenJDK Runtime Environment (build 1.8.0_252-b09)- GraalVM 20.1 Java 11: OpenJDK Runtime Environment GraalVM CE 20.1.0 (build 11.0.7+10-jvmci-20.1-b02) - OpenJ9 0.20 Java 8: OMR d4365f371- OpenJ9 0.20 Java 11: OMR d4365f371- itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 11OpenJDK 8GraalVM 20.1 Java 8GraalVM 20.1 Java 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11Result OverviewPhoronix Test Suite100%114%128%142%SPECjbb 2015Apache HBaseRenaissanceDaCapo BenchmarkJava SciMark

OpenJDK Java, GraalVM, OpenJ9 Benchmarksspec-jbb2015: SPECjbb2015-Composite max-jOPSspec-jbb2015: SPECjbb2015-Composite critical-jOPSjava-scimark2: Compositejava-scimark2: Monte Carlojava-scimark2: Fast Fourier Transformjava-scimark2: Sparse Matrix Multiplyjava-scimark2: Dense LU Matrix Factorizationjava-scimark2: Jacobi Successive Over-Relaxationhbase: Increment - 32hbase: Rand Read - 1hbase: Rand Read - 32hbase: Async Rand Read - 1hbase: Async Rand Read - 32hbase: Increment - 32hbase: Rand Read - 1hbase: Rand Read - 32hbase: Async Rand Read - 1hbase: Async Rand Read - 32renaissance: Scala Dottyrenaissance: Savina Reactors.IOrenaissance: Twitter HTTP Requestsrenaissance: Akka Unbalanced Cobwebbed Treerenaissance: Genetic Algorithm Using Jenetics + Futuresdacapobench: H2dacapobench: Jythondacapobench: Tradesoapdacapobench: Tradebeansjava-gradle-perf: ReactorOpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 11OpenJDK 8GraalVM 20.1 Java 8GraalVM 20.1 Java 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 1140937245182218.311179.861271.681971.644759.421908.958738077001812321011480799363128173983931721.46812821.4112580.71910789.3304751.3375414386835419330262.17341430241862328.991178.331397.092325.784847.581896.17818086355820341047584414388156387943761660.57212358.7872522.02010760.5494804.462550739013331922539951178632488.751180.421405.662385.305616.191856.19823867546783351015284812384131405973741520.52723220.8742446.91011574.6865062.5445259390336968132243.49239878120872355.091180.261215.712272.355250.951856.1989461925818413710089197796354107170981591050.95212403.2902157.52010458.5333377.399583534463970846941430126501846.47715.961834.872508.262694.961478.308460988111767881011019926137511217798158976.55114987.3322018.07110343.4175265.0436609364143639267190.46238853188421835.14706.471798.472472.182719.451479.1482317878417653710016194671384112178981611563.87819849.4232343.03610625.4325300.3176578381240999637249.91836596128672172.32458.281517.671444.425604.051837.1785085880317723799031971843721121771001591752.36616534.6422520.95612042.0315773.57868676687258.43037007112382171.85458.721513.161443.535605.811838.0481997731817620278121951593861351781261612132.39718338.9712615.44112025.4555747.81269856804290.160OpenBenchmarking.org

SPECjbb 2015

This is a benchmark of SPECjbb 2015. For this test profile to work, you must have a valid license/copy of the SPECjbb 2015 ISO (SPECjbb2015-1.02.iso) in your Phoronix Test Suite download cache. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgjOPS, More Is BetterSPECjbb 2015SPECjbb2015-Composite max-jOPSOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 119K18K27K36K45K3987841430409373995136596370074143038853

OpenBenchmarking.orgjOPS, More Is BetterSPECjbb 2015SPECjbb2015-Composite critical-jOPSOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 115K10K15K20K25K1208724186245181786312867112381265018842

Java SciMark

This test runs the Java version of SciMark 2.0, which is a benchmark for scientific and numerical computing developed by programmers at the National Institute of Standards and Technology. This benchmark is made up of Fast Foruier Transform, Jacobi Successive Over-relaxation, Monte Carlo, Sparse Matrix Multiply, and dense LU matrix factorization benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: CompositeOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 115001000150020002500SE +/- 4.75, N = 4SE +/- 3.35, N = 4SE +/- 6.56, N = 4SE +/- 27.95, N = 4SE +/- 4.09, N = 4SE +/- 4.30, N = 4SE +/- 2.31, N = 4SE +/- 2.12, N = 42355.092328.992218.312488.752172.322171.851846.471835.14
OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: CompositeOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 11400800120016002000Min: 2345.84 / Avg: 2355.09 / Max: 2364.91Min: 2322.22 / Avg: 2328.99 / Max: 2336.18Min: 2206.38 / Avg: 2218.31 / Max: 2236.97Min: 2436.67 / Avg: 2488.75 / Max: 2556.54Min: 2162 / Avg: 2172.32 / Max: 2182.02Min: 2164.44 / Avg: 2171.85 / Max: 2184.23Min: 1840.71 / Avg: 1846.47 / Max: 1850.49Min: 1828.77 / Avg: 1835.14 / Max: 1837.46

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Monte CarloOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1130060090012001500SE +/- 0.13, N = 4SE +/- 2.05, N = 4SE +/- 0.43, N = 4SE +/- 0.09, N = 4SE +/- 0.24, N = 4SE +/- 0.22, N = 4SE +/- 1.62, N = 4SE +/- 1.14, N = 41180.261178.331179.861180.42458.28458.72715.96706.47
OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Monte CarloOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 112004006008001000Min: 1179.94 / Avg: 1180.26 / Max: 1180.58Min: 1172.21 / Avg: 1178.33 / Max: 1180.91Min: 1178.64 / Avg: 1179.86 / Max: 1180.58Min: 1180.26 / Avg: 1180.42 / Max: 1180.58Min: 457.69 / Avg: 458.28 / Max: 458.67Min: 458.28 / Avg: 458.72 / Max: 459.26Min: 713.21 / Avg: 715.96 / Max: 720.39Min: 703.63 / Avg: 706.47 / Max: 708.74

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Fast Fourier TransformOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 11400800120016002000SE +/- 0.21, N = 4SE +/- 14.42, N = 4SE +/- 22.74, N = 4SE +/- 31.21, N = 4SE +/- 7.69, N = 4SE +/- 4.93, N = 4SE +/- 9.86, N = 4SE +/- 9.84, N = 41215.711397.091271.681405.661517.671513.161834.871798.47
OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Fast Fourier TransformOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1130060090012001500Min: 1215.5 / Avg: 1215.71 / Max: 1216.35Min: 1370.72 / Avg: 1397.09 / Max: 1436.77Min: 1245 / Avg: 1271.68 / Max: 1339.66Min: 1320.39 / Avg: 1405.66 / Max: 1467.6Min: 1503.01 / Avg: 1517.67 / Max: 1538.81Min: 1503.66 / Avg: 1513.16 / Max: 1526.02Min: 1809.38 / Avg: 1834.87 / Max: 1853.6Min: 1769.01 / Avg: 1798.47 / Max: 1809.85

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Sparse Matrix MultiplyOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 115001000150020002500SE +/- 1.29, N = 4SE +/- 0.26, N = 4SE +/- 13.08, N = 4SE +/- 1.17, N = 4SE +/- 0.41, N = 4SE +/- 1.19, N = 4SE +/- 1.02, N = 4SE +/- 1.46, N = 42272.352325.781971.642385.301444.421443.532508.262472.18
OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Sparse Matrix MultiplyOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 11400800120016002000Min: 2268.66 / Avg: 2272.35 / Max: 2274.57Min: 2325 / Avg: 2325.78 / Max: 2326.03Min: 1933.22 / Avg: 1971.64 / Max: 1988.95Min: 2382.04 / Avg: 2385.3 / Max: 2387.47Min: 1443.52 / Avg: 1444.42 / Max: 1445.12Min: 1439.96 / Avg: 1443.53 / Max: 1444.72Min: 2506.16 / Avg: 2508.26 / Max: 2510.96Min: 2468.4 / Avg: 2472.18 / Max: 2475.39

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Dense LU Matrix FactorizationOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1112002400360048006000SE +/- 22.76, N = 4SE +/- 10.07, N = 4SE +/- 11.89, N = 4SE +/- 119.94, N = 4SE +/- 17.54, N = 4SE +/- 15.84, N = 4SE +/- 0.86, N = 4SE +/- 1.16, N = 45250.954847.584759.425616.195604.055605.812694.962719.45
OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Dense LU Matrix FactorizationOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1110002000300040005000Min: 5206.23 / Avg: 5250.95 / Max: 5299.69Min: 4818.12 / Avg: 4847.58 / Max: 4863.16Min: 4728.43 / Avg: 4759.42 / Max: 4778.07Min: 5393.91 / Avg: 5616.19 / Max: 5894.59Min: 5554.37 / Avg: 5604.05 / Max: 5628.79Min: 5578.48 / Avg: 5605.81 / Max: 5650.63Min: 2692.97 / Avg: 2694.96 / Max: 2696.95Min: 2717.08 / Avg: 2719.45 / Max: 2722.5

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Jacobi Successive Over-RelaxationOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 11400800120016002000SE +/- 0.76, N = 4SE +/- 9.48, N = 4SE +/- 9.08, N = 4SE +/- 0.56, N = 4SE +/- 2.21, N = 4SE +/- 1.45, N = 4SE +/- 1.13, N = 4SE +/- 0.16, N = 41856.191896.171908.951856.191837.171838.041478.301479.14
OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Jacobi Successive Over-RelaxationOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1130060090012001500Min: 1854.62 / Avg: 1856.19 / Max: 1858.2Min: 1885.47 / Avg: 1896.17 / Max: 1924.55Min: 1891.03 / Avg: 1908.95 / Max: 1925.99Min: 1854.62 / Avg: 1856.19 / Max: 1857.31Min: 1831.71 / Avg: 1837.17 / Max: 1842.21Min: 1835.2 / Avg: 1838.04 / Max: 1841.33Min: 1474.9 / Avg: 1478.3 / Max: 1479.43Min: 1478.86 / Avg: 1479.14 / Max: 1479.43

Apache HBase

This is a benchmark of the Apache HBase non-relational distributed database system inspired from Google's Bigtable. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Increment - Clients: 32OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1120K40K60K80K100KSE +/- 432.05, N = 3SE +/- 1066.90, N = 5SE +/- 1168.34, N = 5SE +/- 522.72, N = 3SE +/- 754.83, N = 3SE +/- 548.24, N = 3SE +/- 1159.19, N = 3SE +/- 161.39, N = 38946181808873808238685085819978460982317
OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Increment - Clients: 32OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1116K32K48K64K80KMin: 89006 / Avg: 89461.33 / Max: 90325Min: 79200 / Avg: 81808 / Max: 85621Min: 83727 / Avg: 87380 / Max: 90593Min: 81343 / Avg: 82385.67 / Max: 82973Min: 83593 / Avg: 85085.33 / Max: 86029Min: 80962 / Avg: 81997 / Max: 82828Min: 83374 / Avg: 84609.33 / Max: 86926Min: 82040 / Avg: 82317 / Max: 82599

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Random Read - Clients: 1OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 112K4K6K8K10KSE +/- 41.59, N = 3SE +/- 54.20, N = 3SE +/- 50.09, N = 3SE +/- 60.96, N = 15SE +/- 69.31, N = 15SE +/- 81.03, N = 3SE +/- 83.93, N = 12SE +/- 78.39, N = 1192586355770075468803731888118784
OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Random Read - Clients: 1OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1116003200480064008000Min: 9194 / Avg: 9258 / Max: 9336Min: 6297 / Avg: 6354.67 / Max: 6463Min: 7606 / Avg: 7700 / Max: 7777Min: 7127 / Avg: 7546.2 / Max: 7926Min: 7916 / Avg: 8802.73 / Max: 9014Min: 7163 / Avg: 7318.33 / Max: 7436Min: 8098 / Avg: 8811.08 / Max: 9245Min: 8094 / Avg: 8784.09 / Max: 9022

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Random Read - Clients: 32OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1140K80K120K160K200KSE +/- 1562.89, N = 3SE +/- 1297.36, N = 3SE +/- 1641.62, N = 3SE +/- 546.95, N = 3SE +/- 1885.48, N = 3SE +/- 1653.04, N = 3SE +/- 360.02, N = 3SE +/- 1394.59, N = 31841378203418123278335177237176202176788176537
OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Random Read - Clients: 32OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1130K60K90K120K150KMin: 181662 / Avg: 184137.33 / Max: 187028Min: 79599 / Avg: 82033.67 / Max: 84028Min: 178086 / Avg: 181232.33 / Max: 183618Min: 77247 / Avg: 78335.33 / Max: 78975Min: 174490 / Avg: 177237.33 / Max: 180848Min: 174441 / Avg: 176202.33 / Max: 179506Min: 176084 / Avg: 176788.33 / Max: 177270Min: 173888 / Avg: 176536.67 / Max: 178618

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 1OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 112K4K6K8K10KSE +/- 114.71, N = 14SE +/- 106.61, N = 14SE +/- 89.29, N = 15SE +/- 112.16, N = 6SE +/- 119.37, N = 6SE +/- 99.51, N = 5SE +/- 98.81, N = 15SE +/- 106.92, N = 1310089104751011410152990378121011010016
OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 1OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 112K4K6K8K10KMin: 8857 / Avg: 10089.36 / Max: 10557Min: 9310 / Avg: 10475.36 / Max: 10964Min: 9083 / Avg: 10114.47 / Max: 10458Min: 9615 / Avg: 10152.17 / Max: 10361Min: 9442 / Avg: 9902.5 / Max: 10207Min: 7627 / Avg: 7812 / Max: 8180Min: 8889 / Avg: 10109.93 / Max: 10615Min: 8981 / Avg: 10016 / Max: 10562

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 32OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1140K80K120K160K200KSE +/- 2802.32, N = 3SE +/- 827.01, N = 9SE +/- 1139.85, N = 3SE +/- 805.95, N = 9SE +/- 1055.62, N = 3SE +/- 996.13, N = 3SE +/- 1975.69, N = 9SE +/- 1624.51, N = 15197796844148079984812197184195159199261194671
OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 32OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1130K60K90K120K150KMin: 194526 / Avg: 197796 / Max: 203373Min: 79057 / Avg: 84414.44 / Max: 85900Min: 78531 / Avg: 80798.67 / Max: 82135Min: 78891 / Avg: 84811.78 / Max: 86330Min: 195620 / Avg: 197183.67 / Max: 199194Min: 193284 / Avg: 195158.67 / Max: 196680Min: 185577 / Avg: 199261.11 / Max: 203744Min: 180556 / Avg: 194671.4 / Max: 202128

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Increment - Clients: 32OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1180160240320400SE +/- 2.19, N = 3SE +/- 4.80, N = 5SE +/- 4.32, N = 5SE +/- 1.53, N = 3SE +/- 2.40, N = 3SE +/- 3.48, N = 3SE +/- 4.37, N = 3SE +/- 1.45, N = 3354388363384372386375384
OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Increment - Clients: 32OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1170140210280350Min: 350 / Avg: 354.33 / Max: 357Min: 370 / Avg: 387.6 / Max: 398Min: 351 / Avg: 363 / Max: 376Min: 382 / Avg: 384 / Max: 387Min: 369 / Avg: 372.33 / Max: 377Min: 380 / Avg: 386.33 / Max: 392Min: 366 / Avg: 374.67 / Max: 380Min: 382 / Avg: 384.33 / Max: 387

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Random Read - Clients: 1OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 11306090120150SE +/- 0.33, N = 3SE +/- 1.33, N = 3SE +/- 0.88, N = 3SE +/- 1.06, N = 15SE +/- 0.98, N = 15SE +/- 1.53, N = 3SE +/- 1.12, N = 12SE +/- 1.06, N = 11107156128131112135112112
OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Random Read - Clients: 1OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 11306090120150Min: 106 / Avg: 106.67 / Max: 107Min: 153 / Avg: 155.67 / Max: 157Min: 127 / Avg: 128.33 / Max: 130Min: 125 / Avg: 131.13 / Max: 139Min: 109 / Avg: 112.13 / Max: 125Min: 133 / Avg: 135 / Max: 138Min: 107 / Avg: 112.08 / Max: 122Min: 109 / Avg: 112.45 / Max: 122

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Random Read - Clients: 32OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1190180270360450SE +/- 1.20, N = 3SE +/- 5.86, N = 3SE +/- 1.86, N = 3SE +/- 2.52, N = 3SE +/- 1.76, N = 3SE +/- 1.53, N = 3SE +/- 1.53, N = 3170387173405177178177178
OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Random Read - Clients: 32OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1170140210280350Min: 168 / Avg: 170.33 / Max: 172Min: 378 / Avg: 387 / Max: 398Min: 171 / Avg: 173.33 / Max: 177Min: 402 / Avg: 405 / Max: 410Min: 174 / Avg: 177.33 / Max: 180Min: 175 / Avg: 178 / Max: 180Min: 176 / Avg: 178 / Max: 181

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 1OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 11306090120150SE +/- 1.19, N = 14SE +/- 1.03, N = 14SE +/- 0.94, N = 15SE +/- 1.08, N = 6SE +/- 1.18, N = 6SE +/- 1.47, N = 5SE +/- 1.05, N = 15SE +/- 1.14, N = 13989498971001269898
OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 1OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1120406080100Min: 93 / Avg: 97.71 / Max: 111Min: 90 / Avg: 94.29 / Max: 106Min: 94 / Avg: 97.53 / Max: 109Min: 95 / Avg: 96.83 / Max: 102Min: 96 / Avg: 99.5 / Max: 104Min: 121 / Avg: 126.4 / Max: 129Min: 93 / Avg: 97.53 / Max: 111Min: 93 / Avg: 98.46 / Max: 110

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 32OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1190180270360450SE +/- 1.86, N = 3SE +/- 3.83, N = 9SE +/- 5.17, N = 3SE +/- 3.69, N = 9SE +/- 0.88, N = 3SE +/- 0.58, N = 3SE +/- 1.63, N = 9SE +/- 1.35, N = 15159376393374159161158161
OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 32OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1170140210280350Min: 155 / Avg: 158.67 / Max: 161Min: 369 / Avg: 376 / Max: 401Min: 387 / Avg: 392.67 / Max: 403Min: 368 / Avg: 374.44 / Max: 402Min: 157 / Avg: 158.67 / Max: 160Min: 160 / Avg: 161 / Max: 162Min: 154 / Avg: 157.56 / Max: 169Min: 155 / Avg: 161 / Max: 173

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Scala DottyOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 115001000150020002500SE +/- 7.13, N = 25SE +/- 4.34, N = 5SE +/- 4.33, N = 5SE +/- 5.70, N = 5SE +/- 20.66, N = 5SE +/- 11.40, N = 5SE +/- 11.70, N = 5SE +/- 6.33, N = 51050.951660.571721.471520.531752.372132.40976.551563.88
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Scala DottyOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 11400800120016002000Min: 1009.63 / Avg: 1050.95 / Max: 1121.28Min: 1651.37 / Avg: 1660.57 / Max: 1676.62Min: 1706.49 / Avg: 1721.47 / Max: 1729.59Min: 1506.44 / Avg: 1520.53 / Max: 1534.9Min: 1696.19 / Avg: 1752.37 / Max: 1799.51Min: 2100.59 / Avg: 2132.4 / Max: 2171.48Min: 939.59 / Avg: 976.55 / Max: 1004.68Min: 1543.72 / Avg: 1563.88 / Max: 1583.37

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Savina Reactors.IOOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 115K10K15K20K25KSE +/- 143.42, N = 17SE +/- 159.80, N = 20SE +/- 163.33, N = 20SE +/- 379.82, N = 20SE +/- 229.60, N = 20SE +/- 312.33, N = 20SE +/- 266.12, N = 20SE +/- 523.39, N = 1512403.2912358.7912821.4123220.8716534.6418338.9714987.3319849.42
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Savina Reactors.IOOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 114K8K12K16K20KMin: 11760.26 / Avg: 12403.29 / Max: 14110.96Min: 11339.53 / Avg: 12358.79 / Max: 13693.38Min: 11419.82 / Avg: 12821.41 / Max: 14552.26Min: 18004.48 / Avg: 23220.87 / Max: 25480.8Min: 14555.31 / Avg: 16534.64 / Max: 18138.41Min: 15150.73 / Avg: 18338.97 / Max: 20537.32Min: 13282.4 / Avg: 14987.33 / Max: 18895.68Min: 14365.36 / Avg: 19849.42 / Max: 23435.77

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Twitter HTTP RequestsOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 116001200180024003000SE +/- 6.36, N = 5SE +/- 26.94, N = 7SE +/- 18.53, N = 5SE +/- 11.61, N = 5SE +/- 11.47, N = 5SE +/- 13.53, N = 5SE +/- 8.34, N = 5SE +/- 23.48, N = 82157.522522.022580.722446.912520.962615.442018.072343.04
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Twitter HTTP RequestsOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 115001000150020002500Min: 2136.19 / Avg: 2157.52 / Max: 2171.19Min: 2385.94 / Avg: 2522.02 / Max: 2597.5Min: 2527.8 / Avg: 2580.72 / Max: 2636.86Min: 2410.66 / Avg: 2446.91 / Max: 2469.22Min: 2493.13 / Avg: 2520.96 / Max: 2554.19Min: 2570.39 / Avg: 2615.44 / Max: 2648.87Min: 1991.44 / Avg: 2018.07 / Max: 2039.73Min: 2267.08 / Avg: 2343.04 / Max: 2471.96

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Akka Unbalanced Cobwebbed TreeOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 113K6K9K12K15KSE +/- 110.87, N = 5SE +/- 65.78, N = 5SE +/- 99.11, N = 5SE +/- 68.81, N = 5SE +/- 79.71, N = 5SE +/- 104.95, N = 5SE +/- 111.93, N = 5SE +/- 95.55, N = 510458.5310760.5510789.3311574.6912042.0312025.4610343.4210625.43
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Akka Unbalanced Cobwebbed TreeOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 112K4K6K8K10KMin: 10223 / Avg: 10458.53 / Max: 10881.06Min: 10639.09 / Avg: 10760.55 / Max: 10983.86Min: 10526.66 / Avg: 10789.33 / Max: 11025.52Min: 11393.5 / Avg: 11574.69 / Max: 11780.98Min: 11867.47 / Avg: 12042.03 / Max: 12296.76Min: 11691.4 / Avg: 12025.46 / Max: 12260.6Min: 9945.99 / Avg: 10343.42 / Max: 10579.5Min: 10379.56 / Avg: 10625.43 / Max: 10830.13

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Genetic Algorithm Using Jenetics + FuturesOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1112002400360048006000SE +/- 62.34, N = 20SE +/- 56.31, N = 15SE +/- 40.11, N = 20SE +/- 52.90, N = 15SE +/- 72.42, N = 5SE +/- 65.09, N = 7SE +/- 47.99, N = 5SE +/- 71.17, N = 153377.404804.464751.345062.545773.585747.815265.045300.32
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Genetic Algorithm Using Jenetics + FuturesOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1110002000300040005000Min: 3029.95 / Avg: 3377.4 / Max: 4015.48Min: 4467.23 / Avg: 4804.46 / Max: 5087.27Min: 4530.72 / Avg: 4751.34 / Max: 5161.58Min: 4808.94 / Avg: 5062.54 / Max: 5405.34Min: 5520.88 / Avg: 5773.58 / Max: 5932.26Min: 5525.6 / Avg: 5747.81 / Max: 6040.55Min: 5111.79 / Avg: 5265.04 / Max: 5368.99Min: 4905.68 / Avg: 5300.32 / Max: 5741.15

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: H2OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1115003000450060007500SE +/- 67.44, N = 6SE +/- 51.90, N = 4SE +/- 27.57, N = 4SE +/- 27.17, N = 4SE +/- 170.12, N = 16SE +/- 65.71, N = 9SE +/- 33.66, N = 4SE +/- 62.40, N = 458355507541452596867698566096578
OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: H2OpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1112002400360048006000Min: 5515 / Avg: 5835.17 / Max: 5986Min: 5376 / Avg: 5507 / Max: 5599Min: 5366 / Avg: 5414 / Max: 5478Min: 5179 / Avg: 5259 / Max: 5294Min: 5283 / Avg: 6866.56 / Max: 7726Min: 6673 / Avg: 6985.33 / Max: 7295Min: 6533 / Avg: 6609.25 / Max: 6696Min: 6430 / Avg: 6577.5 / Max: 6698

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: JythonOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1115003000450060007500SE +/- 11.45, N = 4SE +/- 13.06, N = 4SE +/- 12.43, N = 4SE +/- 10.96, N = 4SE +/- 85.57, N = 4SE +/- 83.10, N = 5SE +/- 11.57, N = 4SE +/- 11.78, N = 434463901386839036687680436413812
OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: JythonOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1112002400360048006000Min: 3421 / Avg: 3445.5 / Max: 3466Min: 3862 / Avg: 3901 / Max: 3917Min: 3833 / Avg: 3867.5 / Max: 3890Min: 3879 / Avg: 3902.75 / Max: 3930Min: 6472 / Avg: 6687 / Max: 6879Min: 6617 / Avg: 6804.2 / Max: 7110Min: 3607 / Avg: 3640.5 / Max: 3660Min: 3787 / Avg: 3811.5 / Max: 3835

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: TradesoapOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11GraalVM 20.1 Java 8GraalVM 20.1 Java 119001800270036004500SE +/- 28.42, N = 4SE +/- 35.88, N = 4SE +/- 30.20, N = 12SE +/- 20.79, N = 4SE +/- 19.52, N = 4SE +/- 35.21, N = 20397033313541369643634099
OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: TradesoapOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11GraalVM 20.1 Java 8GraalVM 20.1 Java 118001600240032004000Min: 3906 / Avg: 3970.25 / Max: 4040Min: 3250 / Avg: 3331 / Max: 3423Min: 3391 / Avg: 3540.92 / Max: 3789Min: 3670 / Avg: 3696 / Max: 3758Min: 4327 / Avg: 4363 / Max: 4406Min: 3854 / Avg: 4098.5 / Max: 4352

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: TradebeansOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11GraalVM 20.1 Java 8GraalVM 20.1 Java 112K4K6K8K10KSE +/- 58.56, N = 18SE +/- 38.02, N = 4SE +/- 137.85, N = 4SE +/- 35.38, N = 4SE +/- 21.96, N = 4SE +/- 52.55, N = 4846992259330813292679637
OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: TradebeansOpenJDK 8OpenJDK 15 EA24OpenJDK 14.0.1OpenJDK 11GraalVM 20.1 Java 8GraalVM 20.1 Java 112K4K6K8K10KMin: 7783 / Avg: 8468.67 / Max: 8830Min: 9113 / Avg: 9225 / Max: 9282Min: 8947 / Avg: 9329.5 / Max: 9576Min: 8041 / Avg: 8131.5 / Max: 8211Min: 9216 / Avg: 9267 / Max: 9314Min: 9538 / Avg: 9637.25 / Max: 9771

Java Gradle Build

This test runs Java software project builds using the Gradle build system. It is intended to give developers an idea as to the build performance for development activities and build servers. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterJava Gradle BuildGradle Build: ReactorOpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1160120180240300SE +/- 3.82, N = 3SE +/- 3.68, N = 3SE +/- 3.37, N = 9SE +/- 3.32, N = 9SE +/- 4.97, N = 12SE +/- 3.15, N = 9262.17243.49258.43290.16190.46249.92
OpenBenchmarking.orgSeconds, Fewer Is BetterJava Gradle BuildGradle Build: ReactorOpenJDK 14.0.1OpenJDK 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11GraalVM 20.1 Java 8GraalVM 20.1 Java 1150100150200250Min: 257.07 / Avg: 262.17 / Max: 269.65Min: 237.25 / Avg: 243.49 / Max: 249.98Min: 243.11 / Avg: 258.43 / Max: 276.97Min: 279.3 / Avg: 290.16 / Max: 310.16Min: 173.68 / Avg: 190.46 / Max: 227.99Min: 233.13 / Avg: 249.92 / Max: 268.17