OpenJDK Java, GraalVM, OpenJ9 Benchmarks

Java benchmarks by Michael Larabel with OpenJDK, GraalVM CE, OpenJ9.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2005271-PTS-OPENJDKJ78
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

CPU Massive 5 Tests
Java 4 Tests
Server CPU Tests 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
OpenJDK 14.0.1
May 23 2020
  7 Hours, 56 Minutes
OpenJDK 15 EA24
May 24 2020
  7 Hours, 30 Minutes
OpenJDK 11
May 24 2020
  8 Hours, 26 Minutes
OpenJDK 8
May 25 2020
  7 Hours, 54 Minutes
GraalVM 20.1 Java 8
May 25 2020
  7 Hours, 27 Minutes
GraalVM 20.1 Java 11
May 25 2020
  9 Hours, 3 Minutes
OpenJ9 0.20 Java 8
May 26 2020
  8 Hours, 2 Minutes
OpenJ9 0.20 Java 11
May 26 2020
  8 Hours, 2 Minutes
Invert Hiding All Results Option
  8 Hours, 3 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


OpenJDK Java, GraalVM, OpenJ9 BenchmarksOpenBenchmarking.orgPhoronix Test SuiteIntel Core i9-10980XE @ 4.80GHz (18 Cores / 36 Threads)ASRock X299 Steel Legend (P1.30 BIOS)Intel Sky Lake-E DMI3 Registers32GBSamsung SSD 970 PRO 512GBNVIDIA NV132 11GBRealtek ALC1220ASUS MG28UIntel I219-V + Intel I211Ubuntu 20.045.4.0-31-generic (x86_64)GNOME Shell 3.36.1X Server 1.20.8modesetting 1.20.84.3 Mesa 20.0.4GCC 9.3.0ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionOpenJDK Java, GraalVM, OpenJ9 Benchmarks PerformanceSystem Logs- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500012c- OpenJDK 14.0.1: OpenJDK Runtime Environment (build 14.0.1+7)- OpenJDK 15 EA24: OpenJDK Runtime Environment (build 15-ea+24-1168)- OpenJDK 11: OpenJDK Runtime Environment 18.9 (build 11+28)- OpenJDK 8: OpenJDK Runtime Environment (build 1.8.0_41-b04)- GraalVM 20.1 Java 8: OpenJDK Runtime Environment (build 1.8.0_252-b09)- GraalVM 20.1 Java 11: OpenJDK Runtime Environment GraalVM CE 20.1.0 (build 11.0.7+10-jvmci-20.1-b02) - OpenJ9 0.20 Java 8: OMR d4365f371- OpenJ9 0.20 Java 11: OMR d4365f371- itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

OpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 11OpenJDK 8GraalVM 20.1 Java 8GraalVM 20.1 Java 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 11Result OverviewPhoronix Test Suite100%114%128%142%SPECjbb 2015Apache HBaseRenaissanceDaCapo BenchmarkJava SciMark

OpenJDK Java, GraalVM, OpenJ9 Benchmarkshbase: Increment - 32hbase: Increment - 32hbase: Rand Read - 1hbase: Rand Read - 1hbase: Rand Read - 32hbase: Rand Read - 32hbase: Async Rand Read - 1hbase: Async Rand Read - 1hbase: Async Rand Read - 32hbase: Async Rand Read - 32dacapobench: H2dacapobench: Jythondacapobench: Tradesoapdacapobench: Tradebeansjava-gradle-perf: Reactorjava-scimark2: Compositejava-scimark2: Monte Carlojava-scimark2: Fast Fourier Transformjava-scimark2: Sparse Matrix Multiplyjava-scimark2: Dense LU Matrix Factorizationjava-scimark2: Jacobi Successive Over-Relaxationrenaissance: Scala Dottyrenaissance: Savina Reactors.IOrenaissance: Twitter HTTP Requestsrenaissance: Akka Unbalanced Cobwebbed Treerenaissance: Genetic Algorithm Using Jenetics + Futuresspec-jbb2015: SPECjbb2015-Composite max-jOPSspec-jbb2015: SPECjbb2015-Composite critical-jOPSOpenJDK 14.0.1OpenJDK 15 EA24OpenJDK 11OpenJDK 8GraalVM 20.1 Java 8GraalVM 20.1 Java 11OpenJ9 0.20 Java 8OpenJ9 0.20 Java 118738036377001281812321731011498807993935414386835419330262.1732218.311179.861271.681971.644759.421908.951721.46812821.4112580.71910789.3304751.33740937245188180838863551568203438710475948441437655073901333192252328.991178.331397.092325.784847.581896.171660.57212358.7872522.02010760.5494804.4624143024186823863847546131783354051015297848123745259390336968132243.4922488.751180.421405.662385.305616.191856.191520.52723220.8742446.91011574.6865062.5443995117863894613549258107184137170100899819779615958353446397084692355.091180.261215.712272.355250.951856.191050.95212403.2902157.52010458.5333377.399398781208784609375881111217678817710110981992611586609364143639267190.4621846.47715.961834.872508.262694.961478.30976.55114987.3322018.07110343.4175265.043414301265082317384878411217653717810016981946711616578381240999637249.9181835.14706.471798.472472.182719.451479.141563.87819849.4232343.03610625.4325300.3173885318842850853728803112177237177990310019718415968676687258.4302172.32458.281517.671444.425604.051837.171752.36616534.6422520.95612042.0315773.5783659612867819973867318135176202178781212619515916169856804290.1602171.85458.721513.161443.535605.811838.042132.39718338.9712615.44112025.4555747.8123700711238OpenBenchmarking.org

Apache HBase

This is a benchmark of the Apache HBase non-relational distributed database system inspired from Google's Bigtable. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Increment - Clients: 32OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.120K40K60K80K100KSE +/- 548.24, N = 3SE +/- 754.83, N = 3SE +/- 161.39, N = 3SE +/- 1159.19, N = 3SE +/- 432.05, N = 3SE +/- 522.72, N = 3SE +/- 1066.90, N = 5SE +/- 1168.34, N = 58199785085823178460989461823868180887380
OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Increment - Clients: 32OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.116K32K48K64K80KMin: 80962 / Avg: 81997 / Max: 82828Min: 83593 / Avg: 85085.33 / Max: 86029Min: 82040 / Avg: 82317 / Max: 82599Min: 83374 / Avg: 84609.33 / Max: 86926Min: 89006 / Avg: 89461.33 / Max: 90325Min: 81343 / Avg: 82385.67 / Max: 82973Min: 79200 / Avg: 81808 / Max: 85621Min: 83727 / Avg: 87380 / Max: 90593

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Increment - Clients: 32OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.180160240320400SE +/- 3.48, N = 3SE +/- 2.40, N = 3SE +/- 1.45, N = 3SE +/- 4.37, N = 3SE +/- 2.19, N = 3SE +/- 1.53, N = 3SE +/- 4.80, N = 5SE +/- 4.32, N = 5386372384375354384388363
OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Increment - Clients: 32OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.170140210280350Min: 380 / Avg: 386.33 / Max: 392Min: 369 / Avg: 372.33 / Max: 377Min: 382 / Avg: 384.33 / Max: 387Min: 366 / Avg: 374.67 / Max: 380Min: 350 / Avg: 354.33 / Max: 357Min: 382 / Avg: 384 / Max: 387Min: 370 / Avg: 387.6 / Max: 398Min: 351 / Avg: 363 / Max: 376

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Random Read - Clients: 1OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.12K4K6K8K10KSE +/- 81.03, N = 3SE +/- 69.31, N = 15SE +/- 78.39, N = 11SE +/- 83.93, N = 12SE +/- 41.59, N = 3SE +/- 60.96, N = 15SE +/- 54.20, N = 3SE +/- 50.09, N = 373188803878488119258754663557700
OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Random Read - Clients: 1OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.116003200480064008000Min: 7163 / Avg: 7318.33 / Max: 7436Min: 7916 / Avg: 8802.73 / Max: 9014Min: 8094 / Avg: 8784.09 / Max: 9022Min: 8098 / Avg: 8811.08 / Max: 9245Min: 9194 / Avg: 9258 / Max: 9336Min: 7127 / Avg: 7546.2 / Max: 7926Min: 6297 / Avg: 6354.67 / Max: 6463Min: 7606 / Avg: 7700 / Max: 7777

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Random Read - Clients: 1OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.1306090120150SE +/- 1.53, N = 3SE +/- 0.98, N = 15SE +/- 1.06, N = 11SE +/- 1.12, N = 12SE +/- 0.33, N = 3SE +/- 1.06, N = 15SE +/- 1.33, N = 3SE +/- 0.88, N = 3135112112112107131156128
OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Random Read - Clients: 1OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.1306090120150Min: 133 / Avg: 135 / Max: 138Min: 109 / Avg: 112.13 / Max: 125Min: 109 / Avg: 112.45 / Max: 122Min: 107 / Avg: 112.08 / Max: 122Min: 106 / Avg: 106.67 / Max: 107Min: 125 / Avg: 131.13 / Max: 139Min: 153 / Avg: 155.67 / Max: 157Min: 127 / Avg: 128.33 / Max: 130

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Random Read - Clients: 32OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.140K80K120K160K200KSE +/- 1653.04, N = 3SE +/- 1885.48, N = 3SE +/- 1394.59, N = 3SE +/- 360.02, N = 3SE +/- 1562.89, N = 3SE +/- 546.95, N = 3SE +/- 1297.36, N = 3SE +/- 1641.62, N = 31762021772371765371767881841377833582034181232
OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Random Read - Clients: 32OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.130K60K90K120K150KMin: 174441 / Avg: 176202.33 / Max: 179506Min: 174490 / Avg: 177237.33 / Max: 180848Min: 173888 / Avg: 176536.67 / Max: 178618Min: 176084 / Avg: 176788.33 / Max: 177270Min: 181662 / Avg: 184137.33 / Max: 187028Min: 77247 / Avg: 78335.33 / Max: 78975Min: 79599 / Avg: 82033.67 / Max: 84028Min: 178086 / Avg: 181232.33 / Max: 183618

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Random Read - Clients: 32OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.190180270360450SE +/- 1.53, N = 3SE +/- 1.76, N = 3SE +/- 1.53, N = 3SE +/- 1.20, N = 3SE +/- 2.52, N = 3SE +/- 5.86, N = 3SE +/- 1.86, N = 3178177178177170405387173
OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Random Read - Clients: 32OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.170140210280350Min: 175 / Avg: 178 / Max: 180Min: 174 / Avg: 177.33 / Max: 180Min: 176 / Avg: 178 / Max: 181Min: 168 / Avg: 170.33 / Max: 172Min: 402 / Avg: 405 / Max: 410Min: 378 / Avg: 387 / Max: 398Min: 171 / Avg: 173.33 / Max: 177

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 1OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.12K4K6K8K10KSE +/- 99.51, N = 5SE +/- 119.37, N = 6SE +/- 106.92, N = 13SE +/- 98.81, N = 15SE +/- 114.71, N = 14SE +/- 112.16, N = 6SE +/- 106.61, N = 14SE +/- 89.29, N = 1578129903100161011010089101521047510114
OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 1OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.12K4K6K8K10KMin: 7627 / Avg: 7812 / Max: 8180Min: 9442 / Avg: 9902.5 / Max: 10207Min: 8981 / Avg: 10016 / Max: 10562Min: 8889 / Avg: 10109.93 / Max: 10615Min: 8857 / Avg: 10089.36 / Max: 10557Min: 9615 / Avg: 10152.17 / Max: 10361Min: 9310 / Avg: 10475.36 / Max: 10964Min: 9083 / Avg: 10114.47 / Max: 10458

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 1OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.1306090120150SE +/- 1.47, N = 5SE +/- 1.18, N = 6SE +/- 1.14, N = 13SE +/- 1.05, N = 15SE +/- 1.19, N = 14SE +/- 1.08, N = 6SE +/- 1.03, N = 14SE +/- 0.94, N = 15126100989898979498
OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 1OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.120406080100Min: 121 / Avg: 126.4 / Max: 129Min: 96 / Avg: 99.5 / Max: 104Min: 93 / Avg: 98.46 / Max: 110Min: 93 / Avg: 97.53 / Max: 111Min: 93 / Avg: 97.71 / Max: 111Min: 95 / Avg: 96.83 / Max: 102Min: 90 / Avg: 94.29 / Max: 106Min: 94 / Avg: 97.53 / Max: 109

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 32OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.140K80K120K160K200KSE +/- 996.13, N = 3SE +/- 1055.62, N = 3SE +/- 1624.51, N = 15SE +/- 1975.69, N = 9SE +/- 2802.32, N = 3SE +/- 805.95, N = 9SE +/- 827.01, N = 9SE +/- 1139.85, N = 3195159197184194671199261197796848128441480799
OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 32OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.130K60K90K120K150KMin: 193284 / Avg: 195158.67 / Max: 196680Min: 195620 / Avg: 197183.67 / Max: 199194Min: 180556 / Avg: 194671.4 / Max: 202128Min: 185577 / Avg: 199261.11 / Max: 203744Min: 194526 / Avg: 197796 / Max: 203373Min: 78891 / Avg: 84811.78 / Max: 86330Min: 79057 / Avg: 84414.44 / Max: 85900Min: 78531 / Avg: 80798.67 / Max: 82135

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 32OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.190180270360450SE +/- 0.58, N = 3SE +/- 0.88, N = 3SE +/- 1.35, N = 15SE +/- 1.63, N = 9SE +/- 1.86, N = 3SE +/- 3.69, N = 9SE +/- 3.83, N = 9SE +/- 5.17, N = 3161159161158159374376393
OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.2.3Test: Async Random Read - Clients: 32OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.170140210280350Min: 160 / Avg: 161 / Max: 162Min: 157 / Avg: 158.67 / Max: 160Min: 155 / Avg: 161 / Max: 173Min: 154 / Avg: 157.56 / Max: 169Min: 155 / Avg: 158.67 / Max: 161Min: 368 / Avg: 374.44 / Max: 402Min: 369 / Avg: 376 / Max: 401Min: 387 / Avg: 392.67 / Max: 403

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: H2OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.115003000450060007500SE +/- 65.71, N = 9SE +/- 170.12, N = 16SE +/- 62.40, N = 4SE +/- 33.66, N = 4SE +/- 67.44, N = 6SE +/- 27.17, N = 4SE +/- 51.90, N = 4SE +/- 27.57, N = 469856867657866095835525955075414
OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: H2OpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.112002400360048006000Min: 6673 / Avg: 6985.33 / Max: 7295Min: 5283 / Avg: 6866.56 / Max: 7726Min: 6430 / Avg: 6577.5 / Max: 6698Min: 6533 / Avg: 6609.25 / Max: 6696Min: 5515 / Avg: 5835.17 / Max: 5986Min: 5179 / Avg: 5259 / Max: 5294Min: 5376 / Avg: 5507 / Max: 5599Min: 5366 / Avg: 5414 / Max: 5478

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: JythonOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.115003000450060007500SE +/- 83.10, N = 5SE +/- 85.57, N = 4SE +/- 11.78, N = 4SE +/- 11.57, N = 4SE +/- 11.45, N = 4SE +/- 10.96, N = 4SE +/- 13.06, N = 4SE +/- 12.43, N = 468046687381236413446390339013868
OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: JythonOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.112002400360048006000Min: 6617 / Avg: 6804.2 / Max: 7110Min: 6472 / Avg: 6687 / Max: 6879Min: 3787 / Avg: 3811.5 / Max: 3835Min: 3607 / Avg: 3640.5 / Max: 3660Min: 3421 / Avg: 3445.5 / Max: 3466Min: 3879 / Avg: 3902.75 / Max: 3930Min: 3862 / Avg: 3901 / Max: 3917Min: 3833 / Avg: 3867.5 / Max: 3890

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: TradesoapGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.19001800270036004500SE +/- 35.21, N = 20SE +/- 19.52, N = 4SE +/- 28.42, N = 4SE +/- 20.79, N = 4SE +/- 35.88, N = 4SE +/- 30.20, N = 12409943633970369633313541
OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: TradesoapGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.18001600240032004000Min: 3854 / Avg: 4098.5 / Max: 4352Min: 4327 / Avg: 4363 / Max: 4406Min: 3906 / Avg: 3970.25 / Max: 4040Min: 3670 / Avg: 3696 / Max: 3758Min: 3250 / Avg: 3331 / Max: 3423Min: 3391 / Avg: 3540.92 / Max: 3789

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: TradebeansGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.12K4K6K8K10KSE +/- 52.55, N = 4SE +/- 21.96, N = 4SE +/- 58.56, N = 18SE +/- 35.38, N = 4SE +/- 38.02, N = 4SE +/- 137.85, N = 4963792678469813292259330
OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: TradebeansGraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.12K4K6K8K10KMin: 9538 / Avg: 9637.25 / Max: 9771Min: 9216 / Avg: 9267 / Max: 9314Min: 7783 / Avg: 8468.67 / Max: 8830Min: 8041 / Avg: 8131.5 / Max: 8211Min: 9113 / Avg: 9225 / Max: 9282Min: 8947 / Avg: 9329.5 / Max: 9576

Java Gradle Build

This test runs Java software project builds using the Gradle build system. It is intended to give developers an idea as to the build performance for development activities and build servers. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterJava Gradle BuildGradle Build: ReactorOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 11OpenJDK 14.0.160120180240300SE +/- 3.32, N = 9SE +/- 3.37, N = 9SE +/- 3.15, N = 9SE +/- 4.97, N = 12SE +/- 3.68, N = 3SE +/- 3.82, N = 3290.16258.43249.92190.46243.49262.17
OpenBenchmarking.orgSeconds, Fewer Is BetterJava Gradle BuildGradle Build: ReactorOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 11OpenJDK 14.0.150100150200250Min: 279.3 / Avg: 290.16 / Max: 310.16Min: 243.11 / Avg: 258.43 / Max: 276.97Min: 233.13 / Avg: 249.92 / Max: 268.17Min: 173.68 / Avg: 190.46 / Max: 227.99Min: 237.25 / Avg: 243.49 / Max: 249.98Min: 257.07 / Avg: 262.17 / Max: 269.65

Java SciMark

This test runs the Java version of SciMark 2.0, which is a benchmark for scientific and numerical computing developed by programmers at the National Institute of Standards and Technology. This benchmark is made up of Fast Foruier Transform, Jacobi Successive Over-relaxation, Monte Carlo, Sparse Matrix Multiply, and dense LU matrix factorization benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: CompositeOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.15001000150020002500SE +/- 4.30, N = 4SE +/- 4.09, N = 4SE +/- 2.12, N = 4SE +/- 2.31, N = 4SE +/- 4.75, N = 4SE +/- 27.95, N = 4SE +/- 3.35, N = 4SE +/- 6.56, N = 42171.852172.321835.141846.472355.092488.752328.992218.31
OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: CompositeOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.1400800120016002000Min: 2164.44 / Avg: 2171.85 / Max: 2184.23Min: 2162 / Avg: 2172.32 / Max: 2182.02Min: 1828.77 / Avg: 1835.14 / Max: 1837.46Min: 1840.71 / Avg: 1846.47 / Max: 1850.49Min: 2345.84 / Avg: 2355.09 / Max: 2364.91Min: 2436.67 / Avg: 2488.75 / Max: 2556.54Min: 2322.22 / Avg: 2328.99 / Max: 2336.18Min: 2206.38 / Avg: 2218.31 / Max: 2236.97

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Monte CarloOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.130060090012001500SE +/- 0.22, N = 4SE +/- 0.24, N = 4SE +/- 1.14, N = 4SE +/- 1.62, N = 4SE +/- 0.13, N = 4SE +/- 0.09, N = 4SE +/- 2.05, N = 4SE +/- 0.43, N = 4458.72458.28706.47715.961180.261180.421178.331179.86
OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Monte CarloOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.12004006008001000Min: 458.28 / Avg: 458.72 / Max: 459.26Min: 457.69 / Avg: 458.28 / Max: 458.67Min: 703.63 / Avg: 706.47 / Max: 708.74Min: 713.21 / Avg: 715.96 / Max: 720.39Min: 1179.94 / Avg: 1180.26 / Max: 1180.58Min: 1180.26 / Avg: 1180.42 / Max: 1180.58Min: 1172.21 / Avg: 1178.33 / Max: 1180.91Min: 1178.64 / Avg: 1179.86 / Max: 1180.58

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Fast Fourier TransformOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.1400800120016002000SE +/- 4.93, N = 4SE +/- 7.69, N = 4SE +/- 9.84, N = 4SE +/- 9.86, N = 4SE +/- 0.21, N = 4SE +/- 31.21, N = 4SE +/- 14.42, N = 4SE +/- 22.74, N = 41513.161517.671798.471834.871215.711405.661397.091271.68
OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Fast Fourier TransformOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.130060090012001500Min: 1503.66 / Avg: 1513.16 / Max: 1526.02Min: 1503.01 / Avg: 1517.67 / Max: 1538.81Min: 1769.01 / Avg: 1798.47 / Max: 1809.85Min: 1809.38 / Avg: 1834.87 / Max: 1853.6Min: 1215.5 / Avg: 1215.71 / Max: 1216.35Min: 1320.39 / Avg: 1405.66 / Max: 1467.6Min: 1370.72 / Avg: 1397.09 / Max: 1436.77Min: 1245 / Avg: 1271.68 / Max: 1339.66

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Sparse Matrix MultiplyOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.15001000150020002500SE +/- 1.19, N = 4SE +/- 0.41, N = 4SE +/- 1.46, N = 4SE +/- 1.02, N = 4SE +/- 1.29, N = 4SE +/- 1.17, N = 4SE +/- 0.26, N = 4SE +/- 13.08, N = 41443.531444.422472.182508.262272.352385.302325.781971.64
OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Sparse Matrix MultiplyOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.1400800120016002000Min: 1439.96 / Avg: 1443.53 / Max: 1444.72Min: 1443.52 / Avg: 1444.42 / Max: 1445.12Min: 2468.4 / Avg: 2472.18 / Max: 2475.39Min: 2506.16 / Avg: 2508.26 / Max: 2510.96Min: 2268.66 / Avg: 2272.35 / Max: 2274.57Min: 2382.04 / Avg: 2385.3 / Max: 2387.47Min: 2325 / Avg: 2325.78 / Max: 2326.03Min: 1933.22 / Avg: 1971.64 / Max: 1988.95

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Dense LU Matrix FactorizationOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.112002400360048006000SE +/- 15.84, N = 4SE +/- 17.54, N = 4SE +/- 1.16, N = 4SE +/- 0.86, N = 4SE +/- 22.76, N = 4SE +/- 119.94, N = 4SE +/- 10.07, N = 4SE +/- 11.89, N = 45605.815604.052719.452694.965250.955616.194847.584759.42
OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Dense LU Matrix FactorizationOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.110002000300040005000Min: 5578.48 / Avg: 5605.81 / Max: 5650.63Min: 5554.37 / Avg: 5604.05 / Max: 5628.79Min: 2717.08 / Avg: 2719.45 / Max: 2722.5Min: 2692.97 / Avg: 2694.96 / Max: 2696.95Min: 5206.23 / Avg: 5250.95 / Max: 5299.69Min: 5393.91 / Avg: 5616.19 / Max: 5894.59Min: 4818.12 / Avg: 4847.58 / Max: 4863.16Min: 4728.43 / Avg: 4759.42 / Max: 4778.07

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Jacobi Successive Over-RelaxationOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.1400800120016002000SE +/- 1.45, N = 4SE +/- 2.21, N = 4SE +/- 0.16, N = 4SE +/- 1.13, N = 4SE +/- 0.76, N = 4SE +/- 0.56, N = 4SE +/- 9.48, N = 4SE +/- 9.08, N = 41838.041837.171479.141478.301856.191856.191896.171908.95
OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Jacobi Successive Over-RelaxationOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.130060090012001500Min: 1835.2 / Avg: 1838.04 / Max: 1841.33Min: 1831.71 / Avg: 1837.17 / Max: 1842.21Min: 1478.86 / Avg: 1479.14 / Max: 1479.43Min: 1474.9 / Avg: 1478.3 / Max: 1479.43Min: 1854.62 / Avg: 1856.19 / Max: 1858.2Min: 1854.62 / Avg: 1856.19 / Max: 1857.31Min: 1885.47 / Avg: 1896.17 / Max: 1924.55Min: 1891.03 / Avg: 1908.95 / Max: 1925.99

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Scala DottyOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.15001000150020002500SE +/- 11.40, N = 5SE +/- 20.66, N = 5SE +/- 6.33, N = 5SE +/- 11.70, N = 5SE +/- 7.13, N = 25SE +/- 5.70, N = 5SE +/- 4.34, N = 5SE +/- 4.33, N = 52132.401752.371563.88976.551050.951520.531660.571721.47
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Scala DottyOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.1400800120016002000Min: 2100.59 / Avg: 2132.4 / Max: 2171.48Min: 1696.19 / Avg: 1752.37 / Max: 1799.51Min: 1543.72 / Avg: 1563.88 / Max: 1583.37Min: 939.59 / Avg: 976.55 / Max: 1004.68Min: 1009.63 / Avg: 1050.95 / Max: 1121.28Min: 1506.44 / Avg: 1520.53 / Max: 1534.9Min: 1651.37 / Avg: 1660.57 / Max: 1676.62Min: 1706.49 / Avg: 1721.47 / Max: 1729.59

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Savina Reactors.IOOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.15K10K15K20K25KSE +/- 312.33, N = 20SE +/- 229.60, N = 20SE +/- 523.39, N = 15SE +/- 266.12, N = 20SE +/- 143.42, N = 17SE +/- 379.82, N = 20SE +/- 159.80, N = 20SE +/- 163.33, N = 2018338.9716534.6419849.4214987.3312403.2923220.8712358.7912821.41
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Savina Reactors.IOOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.14K8K12K16K20KMin: 15150.73 / Avg: 18338.97 / Max: 20537.32Min: 14555.31 / Avg: 16534.64 / Max: 18138.41Min: 14365.36 / Avg: 19849.42 / Max: 23435.77Min: 13282.4 / Avg: 14987.33 / Max: 18895.68Min: 11760.26 / Avg: 12403.29 / Max: 14110.96Min: 18004.48 / Avg: 23220.87 / Max: 25480.8Min: 11339.53 / Avg: 12358.79 / Max: 13693.38Min: 11419.82 / Avg: 12821.41 / Max: 14552.26

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Twitter HTTP RequestsOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.16001200180024003000SE +/- 13.53, N = 5SE +/- 11.47, N = 5SE +/- 23.48, N = 8SE +/- 8.34, N = 5SE +/- 6.36, N = 5SE +/- 11.61, N = 5SE +/- 26.94, N = 7SE +/- 18.53, N = 52615.442520.962343.042018.072157.522446.912522.022580.72
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Twitter HTTP RequestsOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.15001000150020002500Min: 2570.39 / Avg: 2615.44 / Max: 2648.87Min: 2493.13 / Avg: 2520.96 / Max: 2554.19Min: 2267.08 / Avg: 2343.04 / Max: 2471.96Min: 1991.44 / Avg: 2018.07 / Max: 2039.73Min: 2136.19 / Avg: 2157.52 / Max: 2171.19Min: 2410.66 / Avg: 2446.91 / Max: 2469.22Min: 2385.94 / Avg: 2522.02 / Max: 2597.5Min: 2527.8 / Avg: 2580.72 / Max: 2636.86

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Akka Unbalanced Cobwebbed TreeOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.13K6K9K12K15KSE +/- 104.95, N = 5SE +/- 79.71, N = 5SE +/- 95.55, N = 5SE +/- 111.93, N = 5SE +/- 110.87, N = 5SE +/- 68.81, N = 5SE +/- 65.78, N = 5SE +/- 99.11, N = 512025.4612042.0310625.4310343.4210458.5311574.6910760.5510789.33
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Akka Unbalanced Cobwebbed TreeOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.12K4K6K8K10KMin: 11691.4 / Avg: 12025.46 / Max: 12260.6Min: 11867.47 / Avg: 12042.03 / Max: 12296.76Min: 10379.56 / Avg: 10625.43 / Max: 10830.13Min: 9945.99 / Avg: 10343.42 / Max: 10579.5Min: 10223 / Avg: 10458.53 / Max: 10881.06Min: 11393.5 / Avg: 11574.69 / Max: 11780.98Min: 10639.09 / Avg: 10760.55 / Max: 10983.86Min: 10526.66 / Avg: 10789.33 / Max: 11025.52

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Genetic Algorithm Using Jenetics + FuturesOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.112002400360048006000SE +/- 65.09, N = 7SE +/- 72.42, N = 5SE +/- 71.17, N = 15SE +/- 47.99, N = 5SE +/- 62.34, N = 20SE +/- 52.90, N = 15SE +/- 56.31, N = 15SE +/- 40.11, N = 205747.815773.585300.325265.043377.405062.544804.464751.34
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.10.0Test: Genetic Algorithm Using Jenetics + FuturesOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.110002000300040005000Min: 5525.6 / Avg: 5747.81 / Max: 6040.55Min: 5520.88 / Avg: 5773.58 / Max: 5932.26Min: 4905.68 / Avg: 5300.32 / Max: 5741.15Min: 5111.79 / Avg: 5265.04 / Max: 5368.99Min: 3029.95 / Avg: 3377.4 / Max: 4015.48Min: 4808.94 / Avg: 5062.54 / Max: 5405.34Min: 4467.23 / Avg: 4804.46 / Max: 5087.27Min: 4530.72 / Avg: 4751.34 / Max: 5161.58

SPECjbb 2015

This is a benchmark of SPECjbb 2015. For this test profile to work, you must have a valid license/copy of the SPECjbb 2015 ISO (SPECjbb2015-1.02.iso) in your Phoronix Test Suite download cache. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgjOPS, More Is BetterSPECjbb 2015SPECjbb2015-Composite max-jOPSOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.19K18K27K36K45K3700736596388534143039878399514143040937

OpenBenchmarking.orgjOPS, More Is BetterSPECjbb 2015SPECjbb2015-Composite critical-jOPSOpenJ9 0.20 Java 11OpenJ9 0.20 Java 8GraalVM 20.1 Java 11GraalVM 20.1 Java 8OpenJDK 8OpenJDK 11OpenJDK 15 EA24OpenJDK 14.0.15K10K15K20K25K1123812867188421265012087178632418624518