Benchmarks by Michael Larabel for a future article. 2 x Intel Xeon Max 9480 testing with a Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.
WRF WRF, the Weather Research and Forecasting Model, is a "next-generation mesoscale numerical weather prediction system designed for both atmospheric research and operational forecasting applications. It features two dynamical cores, a data assimilation system, and a software architecture supporting parallel computation and system extensibility." Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better WRF 4.2.2 Input: conus 2.5km Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3K 6K 9K 12K 15K 11980.81 6674.12 10602.41 5601.10 13273.69 7157.96 12410.29 6840.06 1. (F9X) gfortran options: -O2 -ftree-vectorize -funroll-loops -ffree-form -fconvert=big-endian -frecord-marker=4 -fallow-invalid-boz -lesmf_time -lwrfio_nf -lnetcdff -lnetcdf -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
OpenVKL OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 2.0.0 Benchmark: vklBenchmarkCPU ISPC Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 700 1400 2100 2800 3500 SE +/- 1.53, N = 3 SE +/- 6.74, N = 3 SE +/- 2.08, N = 3 SE +/- 13.62, N = 3 SE +/- 6.66, N = 3 SE +/- 8.62, N = 3 SE +/- 13.96, N = 3 SE +/- 4.36, N = 3 1734 2716 2004 3222 1243 1776 1356 1852 MIN: 104 / MAX: 26188 MIN: 188 / MAX: 30888 MIN: 134 / MAX: 29750 MIN: 248 / MAX: 36519 MIN: 95 / MAX: 19286 MIN: 177 / MAX: 27371 MIN: 107 / MAX: 20909 MIN: 191 / MAX: 28947 Result Confidence
OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 2.0.0 Benchmark: vklBenchmarkCPU ISPC Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 600 1200 1800 2400 3000 Min: 1731 / Avg: 1734 / Max: 1736 Min: 2706 / Avg: 2716.33 / Max: 2729 Min: 2001 / Avg: 2004 / Max: 2008 Min: 3200 / Avg: 3222.33 / Max: 3247 Min: 1231 / Avg: 1243 / Max: 1254 Min: 1759 / Avg: 1776 / Max: 1787 Min: 1334 / Avg: 1356.33 / Max: 1382 Min: 1844 / Avg: 1852 / Max: 1859
ASKAP ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.
NWChem NWChem is an open-source high performance computational chemistry package. Per NWChem's documentation, "NWChem aims to provide its users with computational chemistry tools that are scalable both in their ability to treat large scientific computational chemistry problems efficiently, and in their use of available parallel computing resources from high-performance parallel supercomputers to conventional workstation clusters." Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better NWChem 7.0.2 Input: C240 Buckyball Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 500 1000 1500 2000 2500 2070.3 1960.9 1878.3 1809.7 2530.5 1785.0 2245.2 1873.1 1. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz -lcomex -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2
RELION RELION - REgularised LIkelihood OptimisatioN - is a stand-alone computer program for Maximum A Posteriori refinement of (multiple) 3D reconstructions or 2D class averages in cryo-electron microscopy (cryo-EM). It is developed in the research group of Sjors Scheres at the MRC Laboratory of Molecular Biology. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better RELION 4.0.1 Test: Basic - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 90 180 270 360 450 SE +/- 7.14, N = 9 SE +/- 2.65, N = 3 SE +/- 2.68, N = 7 SE +/- 1.41, N = 3 SE +/- 2.98, N = 3 SE +/- 3.24, N = 12 SE +/- 4.65, N = 9 SE +/- 2.66, N = 12 373.18 203.41 290.45 155.74 412.37 214.42 384.38 201.38 1. (CXX) g++ options: -fopenmp -std=c++11 -O3 -rdynamic -ldl -ltiff -lfftw3f -lfftw3 -lpng -ljpeg -lmpi_cxx -lmpi Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better RELION 4.0.1 Test: Basic - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 70 140 210 280 350 Min: 321.77 / Avg: 373.18 / Max: 391.54 Min: 200.25 / Avg: 203.41 / Max: 208.67 Min: 281.55 / Avg: 290.45 / Max: 301.47 Min: 153.09 / Avg: 155.74 / Max: 157.87 Min: 406.42 / Avg: 412.37 / Max: 415.48 Min: 190.69 / Avg: 214.42 / Max: 226.92 Min: 361.02 / Avg: 384.38 / Max: 399.13 Min: 177.35 / Avg: 201.38 / Max: 211.97 1. (CXX) g++ options: -fopenmp -std=c++11 -O3 -rdynamic -ldl -ltiff -lfftw3f -lfftw3 -lpng -ljpeg -lmpi_cxx -lmpi
easyWave The easyWave software allows simulating tsunami generation and propagation in the context of early warning systems. EasyWave supports making use of OpenMP for CPU multi-threading and there are also GPU ports available but not currently incorporated as part of this test profile. The easyWave tsunami generation software is run with one of the example/reference input files for measuring the CPU execution time. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better easyWave r34 Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 SE +/- 0.67, N = 3 SE +/- 0.99, N = 12 SE +/- 0.96, N = 15 SE +/- 9.88, N = 12 SE +/- 12.12, N = 12 SE +/- 15.80, N = 12 SE +/- 5.17, N = 9 SE +/- 18.26, N = 12 119.84 126.39 75.73 102.13 173.01 182.12 145.24 173.55 1. (CXX) g++ options: -O3 -fopenmp Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better easyWave r34 Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 Min: 118.8 / Avg: 119.84 / Max: 121.09 Min: 123.29 / Avg: 126.39 / Max: 135.13 Min: 71.24 / Avg: 75.73 / Max: 84.22 Min: 81.89 / Avg: 102.12 / Max: 207.04 Min: 140.27 / Avg: 173.01 / Max: 276.51 Min: 139.66 / Avg: 182.12 / Max: 299.55 Min: 128.56 / Avg: 145.24 / Max: 173.46 Min: 137.94 / Avg: 173.55 / Max: 356.31 1. (CXX) g++ options: -O3 -fopenmp
ASKAP ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Million Grid Points Per Second, More Is Better ASKAP 1.0 Test: tConvolve MT - Gridding Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2K 4K 6K 8K 10K SE +/- 4.15, N = 3 SE +/- 75.19, N = 5 SE +/- 54.27, N = 5 SE +/- 60.72, N = 3 SE +/- 87.89, N = 12 SE +/- 23.56, N = 3 SE +/- 32.87, N = 12 SE +/- 195.28, N = 8 8088.11 7630.06 5062.07 6038.92 3375.32 3347.93 3406.96 4382.97 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp Result Confidence
OpenBenchmarking.org Million Grid Points Per Second, More Is Better ASKAP 1.0 Test: tConvolve MT - Gridding Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1400 2800 4200 5600 7000 Min: 8080.61 / Avg: 8088.11 / Max: 8094.94 Min: 7461.63 / Avg: 7630.06 / Max: 7858.99 Min: 4957.92 / Avg: 5062.07 / Max: 5265.07 Min: 5928.12 / Avg: 6038.92 / Max: 6137.36 Min: 2777.12 / Avg: 3375.32 / Max: 3849.48 Min: 3301.97 / Avg: 3347.93 / Max: 3379.91 Min: 3251.98 / Avg: 3406.96 / Max: 3632.24 Min: 3160.98 / Avg: 4382.97 / Max: 4764.45 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
CockroachDB CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 512 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30K 60K 90K 120K 150K SE +/- 3058.00, N = 15 SE +/- 1606.68, N = 15 SE +/- 2853.06, N = 12 SE +/- 1875.64, N = 15 SE +/- 2758.29, N = 15 SE +/- 1830.36, N = 15 SE +/- 2047.28, N = 12 SE +/- 1792.91, N = 12 131999.7 82341.2 135861.9 85613.1 128125.9 80804.7 120494.3 76524.7 Result Confidence
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 512 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20K 40K 60K 80K 100K Min: 119664.2 / Avg: 131999.73 / Max: 151789 Min: 73794.6 / Avg: 82341.16 / Max: 92346.6 Min: 125801.2 / Avg: 135861.88 / Max: 157261.2 Min: 76314.5 / Avg: 85613.08 / Max: 96679.7 Min: 116807.1 / Avg: 128125.91 / Max: 148404.3 Min: 71972.9 / Avg: 80804.73 / Max: 91544.1 Min: 112880.8 / Avg: 120494.31 / Max: 140570.1 Min: 71697.2 / Avg: 76524.74 / Max: 90724.6
BRL-CAD OpenBenchmarking.org VGR Performance Metric, More Is Better BRL-CAD 7.38.2 VGR Performance Metric Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1.1M 2.2M 3.3M 4.4M 5.5M 833892 4136969 916904 5186677 713937 3658790 767812 4075342 1. (CXX) g++ options: -std=c++17 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lnetpbm -lregex_brl -lz_brl -lassimp -ldl -lm -ltk8.6
CockroachDB CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 512 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30K 60K 90K 120K 150K SE +/- 1885.96, N = 15 SE +/- 886.06, N = 15 SE +/- 2440.36, N = 12 SE +/- 1250.17, N = 13 SE +/- 1362.07, N = 3 SE +/- 889.12, N = 15 SE +/- 1384.66, N = 15 SE +/- 970.10, N = 15 116603.7 72110.1 121465.2 73640.9 110666.9 71680.5 109388.2 71696.5 Result Confidence
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 512 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20K 40K 60K 80K 100K Min: 107481.5 / Avg: 116603.68 / Max: 126252.7 Min: 68626.5 / Avg: 72110.05 / Max: 78029.7 Min: 112686.9 / Avg: 121465.23 / Max: 136580 Min: 67471.8 / Avg: 73640.93 / Max: 82182.1 Min: 107948.3 / Avg: 110666.9 / Max: 112176.6 Min: 67326 / Avg: 71680.5 / Max: 77692.2 Min: 103990.9 / Avg: 109388.25 / Max: 118863.3 Min: 66471.4 / Avg: 71696.49 / Max: 77624.9
PostgreSQL This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.2909 0.5818 0.8727 1.1636 1.4545 SE +/- 0.007, N = 3 SE +/- 0.030, N = 12 SE +/- 0.005, N = 12 SE +/- 0.040, N = 12 SE +/- 0.008, N = 12 SE +/- 0.017, N = 9 SE +/- 0.007, N = 3 SE +/- 0.038, N = 9 0.572 1.293 0.589 1.149 0.559 1.027 0.622 1.098 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm Result Confidence
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 0.56 / Avg: 0.57 / Max: 0.58 Min: 1.09 / Avg: 1.29 / Max: 1.48 Min: 0.57 / Avg: 0.59 / Max: 0.62 Min: 0.92 / Avg: 1.15 / Max: 1.37 Min: 0.54 / Avg: 0.56 / Max: 0.63 Min: 0.93 / Avg: 1.03 / Max: 1.11 Min: 0.61 / Avg: 0.62 / Max: 0.64 Min: 0.84 / Avg: 1.1 / Max: 1.24 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Result
OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 400K 800K 1200K 1600K 2000K SE +/- 20350.34, N = 3 SE +/- 18635.21, N = 12 SE +/- 13863.97, N = 12 SE +/- 30933.90, N = 12 SE +/- 24978.23, N = 12 SE +/- 16726.04, N = 9 SE +/- 17697.00, N = 3 SE +/- 36627.33, N = 9 1748146 778141 1699046 881881 1792636 976035 1607424 920725 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm Result Confidence
OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 300K 600K 900K 1200K 1500K Min: 1714551.7 / Avg: 1748146.26 / Max: 1784842.35 Min: 675010 / Avg: 778140.99 / Max: 917513.6 Min: 1614190.59 / Avg: 1699045.74 / Max: 1759981.07 Min: 730756.21 / Avg: 881881.35 / Max: 1084339.69 Min: 1592416.34 / Avg: 1792635.72 / Max: 1862528.55 Min: 898628.97 / Avg: 976034.51 / Max: 1074194.42 Min: 1575272.28 / Avg: 1607424.15 / Max: 1636315.87 Min: 805818.73 / Avg: 920724.73 / Max: 1185417.76 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
TensorFlow Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 SE +/- 0.01, N = 3 SE +/- 1.39, N = 3 SE +/- 0.48, N = 3 SE +/- 0.61, N = 3 SE +/- 1.17, N = 3 SE +/- 0.79, N = 3 SE +/- 0.61, N = 3 SE +/- 1.80, N = 3 148.45 174.95 140.53 169.75 117.53 145.29 125.14 138.39 Result Confidence
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 Min: 148.44 / Avg: 148.45 / Max: 148.46 Min: 172.43 / Avg: 174.95 / Max: 177.22 Min: 139.68 / Avg: 140.53 / Max: 141.35 Min: 168.56 / Avg: 169.75 / Max: 170.55 Min: 115.29 / Avg: 117.53 / Max: 119.21 Min: 144.06 / Avg: 145.29 / Max: 146.77 Min: 123.92 / Avg: 125.14 / Max: 125.82 Min: 134.79 / Avg: 138.39 / Max: 140.44
CloverLeaf CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm16 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 90 180 270 360 450 SE +/- 0.13, N = 3 SE +/- 0.74, N = 3 SE +/- 0.54, N = 3 SE +/- 2.02, N = 3 SE +/- 1.43, N = 3 SE +/- 1.56, N = 3 SE +/- 2.03, N = 3 SE +/- 2.11, N = 9 328.47 214.80 410.59 378.05 351.29 263.33 357.57 269.20 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm16 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 70 140 210 280 350 Min: 328.23 / Avg: 328.47 / Max: 328.69 Min: 213.33 / Avg: 214.8 / Max: 215.62 Min: 409.58 / Avg: 410.59 / Max: 411.42 Min: 374.35 / Avg: 378.05 / Max: 381.3 Min: 349.41 / Avg: 351.29 / Max: 354.11 Min: 261.16 / Avg: 263.33 / Max: 266.36 Min: 354.4 / Avg: 357.57 / Max: 361.34 Min: 261.99 / Avg: 269.2 / Max: 280.35 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
NAMD NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ns/day, More Is Better NAMD 3.0b6 Input: STMV with 1,066,628 Atoms Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.5072 1.0144 1.5216 2.0288 2.536 SE +/- 0.01396, N = 15 SE +/- 0.04403, N = 15 SE +/- 0.02648, N = 15 SE +/- 0.08185, N = 13 SE +/- 0.05087, N = 15 SE +/- 0.05644, N = 12 SE +/- 0.05862, N = 15 SE +/- 0.05463, N = 15 1.05274 1.10900 1.43787 2.25422 1.45223 1.88679 1.50214 1.76778 Result Confidence
OpenBenchmarking.org ns/day, More Is Better NAMD 3.0b6 Input: STMV with 1,066,628 Atoms Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 0.97 / Avg: 1.05 / Max: 1.14 Min: 0.9 / Avg: 1.11 / Max: 1.44 Min: 1.23 / Avg: 1.44 / Max: 1.61 Min: 1.76 / Avg: 2.25 / Max: 2.78 Min: 1.15 / Avg: 1.45 / Max: 1.75 Min: 1.63 / Avg: 1.89 / Max: 2.23 Min: 1.09 / Avg: 1.5 / Max: 1.84 Min: 1.49 / Avg: 1.77 / Max: 2.29
High Performance Conjugate Gradient HPCG is the High Performance Conjugate Gradient and is a new scientific benchmark from Sandia National Lans focused for super-computer testing with modern real-world workloads compared to HPCC. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.1 X Y Z: 144 144 144 - RT: 60 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 15 30 45 60 75 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.94, N = 3 SE +/- 0.08, N = 3 SE +/- 0.29, N = 3 SE +/- 0.37, N = 3 SE +/- 0.07, N = 3 31.07 60.85 35.14 69.30 25.24 54.41 30.59 62.64 1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi Result Confidence
OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.1 X Y Z: 144 144 144 - RT: 60 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 13 26 39 52 65 Min: 31.05 / Avg: 31.07 / Max: 31.11 Min: 60.81 / Avg: 60.85 / Max: 60.92 Min: 34.98 / Avg: 35.14 / Max: 35.22 Min: 67.54 / Avg: 69.3 / Max: 70.74 Min: 25.1 / Avg: 25.24 / Max: 25.39 Min: 54.03 / Avg: 54.41 / Max: 54.99 Min: 29.88 / Avg: 30.59 / Max: 31.14 Min: 62.56 / Avg: 62.64 / Max: 62.77 1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi
Apache IoTDB Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Average Latency, Fewer Is Better Apache IoTDB 1.2 Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 70 140 210 280 350 SE +/- 2.20, N = 3 SE +/- 3.79, N = 8 SE +/- 3.41, N = 3 SE +/- 3.40, N = 12 SE +/- 5.15, N = 3 SE +/- 2.59, N = 12 SE +/- 5.07, N = 3 SE +/- 3.74, N = 12 294.33 317.36 280.26 286.78 314.44 328.41 309.03 325.97 MAX: 27740.38 MAX: 32341.07 MAX: 27450.82 MAX: 28496.67 MAX: 27244.84 MAX: 29309.84 MAX: 26720.06 MAX: 30042.47 Result Confidence
OpenBenchmarking.org Average Latency, Fewer Is Better Apache IoTDB 1.2 Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 60 120 180 240 300 Min: 291.11 / Avg: 294.33 / Max: 298.54 Min: 303.36 / Avg: 317.36 / Max: 331.83 Min: 275.8 / Avg: 280.26 / Max: 286.97 Min: 273.05 / Avg: 286.78 / Max: 316.89 Min: 304.72 / Avg: 314.44 / Max: 322.26 Min: 319.07 / Avg: 328.41 / Max: 347.44 Min: 299.22 / Avg: 309.03 / Max: 316.14 Min: 307.82 / Avg: 325.97 / Max: 354.99
Result
OpenBenchmarking.org point/sec, More Is Better Apache IoTDB 1.2 Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20M 40M 60M 80M 100M SE +/- 308756.34, N = 3 SE +/- 692701.79, N = 8 SE +/- 746822.47, N = 3 SE +/- 761276.42, N = 12 SE +/- 662950.65, N = 3 SE +/- 565297.90, N = 12 SE +/- 1037167.36, N = 3 SE +/- 574699.97, N = 12 87797206 80169620 92709751 89231850 82455664 77501248 83475645 78057728 Result Confidence
OpenBenchmarking.org point/sec, More Is Better Apache IoTDB 1.2 Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 16M 32M 48M 64M 80M Min: 87266472.46 / Avg: 87797206.07 / Max: 88335945.89 Min: 76187205.81 / Avg: 80169620.06 / Max: 82023058.74 Min: 91216839.59 / Avg: 92709751.24 / Max: 93496734.87 Min: 81747205.1 / Avg: 89231850.46 / Max: 91854673.51 Min: 81296689.33 / Avg: 82455664.42 / Max: 83592909.29 Min: 73145472.62 / Avg: 77501248.16 / Max: 79015213.11 Min: 81771445.11 / Avg: 83475644.71 / Max: 85351915.5 Min: 73090909.99 / Avg: 78057727.65 / Max: 80034510.45
ClickHouse ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 110 220 330 440 550 SE +/- 3.45, N = 3 SE +/- 2.55, N = 3 SE +/- 3.62, N = 6 SE +/- 5.39, N = 5 SE +/- 6.03, N = 3 SE +/- 3.08, N = 3 SE +/- 3.60, N = 3 SE +/- 3.54, N = 12 481.66 501.63 458.23 438.60 470.02 501.07 476.91 471.79 MIN: 40.16 / MAX: 5454.55 MIN: 64.45 / MAX: 6666.67 MIN: 42.16 / MAX: 6000 MIN: 58.2 / MAX: 6000 MIN: 32.59 / MAX: 5454.55 MIN: 54.25 / MAX: 5000 MIN: 36.01 / MAX: 5000 MIN: 53.43 / MAX: 6000 Result Confidence
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 90 180 270 360 450 Min: 475.41 / Avg: 481.66 / Max: 487.3 Min: 496.6 / Avg: 501.63 / Max: 504.9 Min: 448.17 / Avg: 458.23 / Max: 470.76 Min: 421.32 / Avg: 438.6 / Max: 447.62 Min: 463.25 / Avg: 470.02 / Max: 482.06 Min: 496.61 / Avg: 501.07 / Max: 506.98 Min: 471.3 / Avg: 476.91 / Max: 483.63 Min: 446.09 / Avg: 471.79 / Max: 491.73
Result
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 110 220 330 440 550 SE +/- 2.93, N = 3 SE +/- 3.26, N = 3 SE +/- 2.86, N = 6 SE +/- 3.10, N = 5 SE +/- 1.94, N = 3 SE +/- 0.19, N = 3 SE +/- 4.95, N = 3 SE +/- 3.17, N = 12 486.05 507.56 455.79 443.58 465.06 499.18 474.68 467.96 MIN: 40.43 / MAX: 6666.67 MIN: 66.45 / MAX: 5454.55 MIN: 42.19 / MAX: 6666.67 MIN: 62.43 / MAX: 6666.67 MIN: 32.59 / MAX: 5000 MIN: 54.2 / MAX: 4615.38 MIN: 36.43 / MAX: 6000 MIN: 52.36 / MAX: 6000 Result Confidence
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 90 180 270 360 450 Min: 481.53 / Avg: 486.05 / Max: 491.55 Min: 503.94 / Avg: 507.56 / Max: 514.07 Min: 447.71 / Avg: 455.79 / Max: 463.66 Min: 433.51 / Avg: 443.58 / Max: 451.39 Min: 461.49 / Avg: 465.06 / Max: 468.18 Min: 498.98 / Avg: 499.18 / Max: 499.57 Min: 465.01 / Avg: 474.68 / Max: 481.39 Min: 454.49 / Avg: 467.96 / Max: 490.02
Result
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 110 220 330 440 550 SE +/- 3.41, N = 3 SE +/- 4.37, N = 3 SE +/- 4.18, N = 6 SE +/- 4.12, N = 5 SE +/- 2.85, N = 3 SE +/- 1.35, N = 3 SE +/- 5.88, N = 3 SE +/- 3.85, N = 12 465.50 485.63 437.20 423.30 446.40 491.89 461.62 460.66 MIN: 40.93 / MAX: 5454.55 MIN: 63.63 / MAX: 5000 MIN: 41.7 / MAX: 5454.55 MIN: 61.54 / MAX: 6000 MIN: 32.64 / MAX: 4615.38 MIN: 51.86 / MAX: 5454.55 MIN: 35.59 / MAX: 5454.55 MIN: 53.62 / MAX: 5454.55 Result Confidence
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 90 180 270 360 450 Min: 460.18 / Avg: 465.5 / Max: 471.85 Min: 476.93 / Avg: 485.63 / Max: 490.74 Min: 426.53 / Avg: 437.2 / Max: 455.19 Min: 412.49 / Avg: 423.3 / Max: 437.55 Min: 441.14 / Avg: 446.4 / Max: 450.91 Min: 489.2 / Avg: 491.89 / Max: 493.37 Min: 452.26 / Avg: 461.62 / Max: 472.47 Min: 437.57 / Avg: 460.66 / Max: 481.51
OpenSSL Result
OpenBenchmarking.org verify/s, More Is Better OpenSSL 3.3 Algorithm: RSA4096 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 400K 800K 1200K 1600K 2000K SE +/- 92.46, N = 3 SE +/- 862.96, N = 3 SE +/- 92.62, N = 3 SE +/- 6745.42, N = 3 SE +/- 165.80, N = 3 SE +/- 355.69, N = 3 SE +/- 200.66, N = 3 SE +/- 277.84, N = 3 974189.9 1916162.9 1036735.6 2057021.6 697707.2 1395446.4 813667.6 1627941.4 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl Result Confidence
OpenBenchmarking.org verify/s, More Is Better OpenSSL 3.3 Algorithm: RSA4096 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 400K 800K 1200K 1600K 2000K Min: 974005 / Avg: 974189.87 / Max: 974286.4 Min: 1914634.4 / Avg: 1916162.9 / Max: 1917621.3 Min: 1036563.4 / Avg: 1036735.63 / Max: 1036880.8 Min: 2043628.9 / Avg: 2057021.63 / Max: 2065124.5 Min: 697529.8 / Avg: 697707.17 / Max: 698038.5 Min: 1394736 / Avg: 1395446.43 / Max: 1395833.4 Min: 813395.8 / Avg: 813667.6 / Max: 814059.2 Min: 1627415 / Avg: 1627941.37 / Max: 1628358.8 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
Result
OpenBenchmarking.org sign/s, More Is Better OpenSSL 3.3 Algorithm: RSA4096 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 13K 26K 39K 52K 65K SE +/- 9.84, N = 3 SE +/- 14.34, N = 3 SE +/- 15.15, N = 3 SE +/- 56.68, N = 3 SE +/- 19.45, N = 3 SE +/- 6.92, N = 3 SE +/- 20.13, N = 3 SE +/- 83.09, N = 3 27431.1 54601.1 31594.4 61499.6 22861.0 45531.0 25441.5 48534.8 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl Result Confidence
OpenBenchmarking.org sign/s, More Is Better OpenSSL 3.3 Algorithm: RSA4096 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11K 22K 33K 44K 55K Min: 27412.5 / Avg: 27431.07 / Max: 27446 Min: 54572.8 / Avg: 54601.13 / Max: 54619.2 Min: 31564.8 / Avg: 31594.43 / Max: 31614.7 Min: 61388.1 / Avg: 61499.57 / Max: 61573.2 Min: 22837.3 / Avg: 22861.03 / Max: 22899.6 Min: 45522.9 / Avg: 45531.03 / Max: 45544.8 Min: 25410.6 / Avg: 25441.5 / Max: 25479.3 Min: 48448.6 / Avg: 48534.77 / Max: 48700.9 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
TensorFlow Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 SE +/- 0.03, N = 3 SE +/- 1.57, N = 3 SE +/- 0.58, N = 3 SE +/- 0.21, N = 3 SE +/- 0.14, N = 3 SE +/- 1.40, N = 3 SE +/- 0.63, N = 3 SE +/- 1.04, N = 12 143.67 161.06 129.02 150.33 119.73 141.95 123.69 135.28 Result Confidence
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 Min: 143.62 / Avg: 143.67 / Max: 143.71 Min: 158.11 / Avg: 161.06 / Max: 163.44 Min: 127.87 / Avg: 129.02 / Max: 129.6 Min: 149.91 / Avg: 150.33 / Max: 150.6 Min: 119.49 / Avg: 119.73 / Max: 119.99 Min: 139.16 / Avg: 141.95 / Max: 143.51 Min: 122.52 / Avg: 123.69 / Max: 124.7 Min: 128.65 / Avg: 135.28 / Max: 139.7
Timed Linux Kernel Compilation Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: allmodconfig Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 90 180 270 360 450 SE +/- 0.80, N = 3 SE +/- 0.86, N = 3 SE +/- 0.72, N = 3 SE +/- 0.56, N = 3 SE +/- 0.61, N = 3 SE +/- 0.56, N = 3 SE +/- 0.67, N = 3 SE +/- 0.73, N = 3 362.45 218.57 316.90 189.74 428.39 246.94 384.06 231.03 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: allmodconfig Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 80 160 240 320 400 Min: 361.57 / Avg: 362.45 / Max: 364.05 Min: 217.6 / Avg: 218.57 / Max: 220.29 Min: 316.04 / Avg: 316.9 / Max: 318.34 Min: 189.09 / Avg: 189.74 / Max: 190.86 Min: 427.77 / Avg: 428.39 / Max: 429.6 Min: 246.34 / Avg: 246.94 / Max: 248.06 Min: 383.35 / Avg: 384.06 / Max: 385.39 Min: 230.21 / Avg: 231.03 / Max: 232.48
Xcompact3d Incompact3d Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: X3D-benchmarking input.i3d Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 90 180 270 360 450 SE +/- 3.88, N = 4 SE +/- 0.05, N = 3 SE +/- 2.51, N = 3 SE +/- 0.37, N = 3 SE +/- 1.25, N = 3 SE +/- 0.04, N = 3 SE +/- 0.14, N = 3 SE +/- 0.01, N = 3 357.01 196.81 323.25 171.38 407.59 189.69 351.64 187.22 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: X3D-benchmarking input.i3d Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 70 140 210 280 350 Min: 352.67 / Avg: 357.01 / Max: 368.65 Min: 196.75 / Avg: 196.81 / Max: 196.91 Min: 318.23 / Avg: 323.25 / Max: 325.77 Min: 170.71 / Avg: 171.38 / Max: 171.97 Min: 406.25 / Avg: 407.59 / Max: 410.08 Min: 189.62 / Avg: 189.69 / Max: 189.76 Min: 351.39 / Avg: 351.64 / Max: 351.84 Min: 187.21 / Avg: 187.22 / Max: 187.23 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
Stockfish Result
OpenBenchmarking.org Nodes Per Second, More Is Better Stockfish 16.1 Chess Benchmark Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50M 100M 150M 200M 250M SE +/- 1304590.97, N = 3 SE +/- 2148606.38, N = 4 SE +/- 2966712.90, N = 9 SE +/- 2482737.87, N = 3 SE +/- 1751369.24, N = 12 SE +/- 4344961.90, N = 10 SE +/- 629927.17, N = 3 SE +/- 2925715.37, N = 11 96887479 187761769 109766345 222610378 68019088 137977203 73592230 149409082 1. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver Result Confidence
OpenBenchmarking.org Nodes Per Second, More Is Better Stockfish 16.1 Chess Benchmark Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40M 80M 120M 160M 200M Min: 94884961 / Avg: 96887479.33 / Max: 99337294 Min: 182910465 / Avg: 187761768.75 / Max: 192568158 Min: 95815903 / Avg: 109766344.67 / Max: 124123359 Min: 218003860 / Avg: 222610378 / Max: 226518927 Min: 59888483 / Avg: 68019087.75 / Max: 77730908 Min: 114663193 / Avg: 137977202.6 / Max: 157872926 Min: 72332406 / Avg: 73592230 / Max: 74229713 Min: 129404582 / Avg: 149409082.45 / Max: 160455993 1. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver
SecureMark SecureMark is an objective, standardized benchmarking framework for measuring the efficiency of cryptographic processing solutions developed by EEMBC. SecureMark-TLS is benchmarking Transport Layer Security performance with a focus on IoT/edge computing. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org marks, More Is Better SecureMark 1.0.4 Benchmark: SecureMark-TLS Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 70K 140K 210K 280K 350K SE +/- 625.56, N = 3 SE +/- 330.95, N = 3 SE +/- 209.97, N = 3 SE +/- 411.11, N = 3 SE +/- 256.85, N = 3 SE +/- 384.08, N = 3 SE +/- 670.43, N = 3 SE +/- 196.24, N = 3 277205 275472 309896 308434 277647 277589 277260 277298 1. (CC) gcc options: -pedantic -O3 Result Confidence
OpenBenchmarking.org marks, More Is Better SecureMark 1.0.4 Benchmark: SecureMark-TLS Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50K 100K 150K 200K 250K Min: 276369.16 / Avg: 277204.97 / Max: 278429.13 Min: 274903.75 / Avg: 275472.07 / Max: 276050.06 Min: 309477.53 / Avg: 309896.25 / Max: 310133.28 Min: 308006.75 / Avg: 308434.25 / Max: 309256.25 Min: 277154.09 / Avg: 277646.99 / Max: 278018.78 Min: 277153.66 / Avg: 277589.29 / Max: 278355.03 Min: 276120.94 / Avg: 277260.22 / Max: 278442.19 Min: 276929.5 / Avg: 277298.43 / Max: 277598.84 1. (CC) gcc options: -pedantic -O3
Apache IoTDB Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Average Latency, Fewer Is Better Apache IoTDB 1.2 Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.15, N = 3 SE +/- 1.18, N = 3 SE +/- 0.68, N = 3 SE +/- 0.80, N = 7 SE +/- 0.48, N = 3 SE +/- 1.01, N = 3 SE +/- 0.87, N = 3 SE +/- 1.11, N = 4 85.16 92.23 81.73 82.73 90.02 94.84 89.53 95.39 MAX: 23810.86 MAX: 23842.9 MAX: 24081.78 MAX: 24148.34 MAX: 23857.34 MAX: 23842.98 MAX: 23819.37 MAX: 23846.38 Result Confidence
OpenBenchmarking.org Average Latency, Fewer Is Better Apache IoTDB 1.2 Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 Min: 84.91 / Avg: 85.16 / Max: 85.42 Min: 90.17 / Avg: 92.23 / Max: 94.25 Min: 80.98 / Avg: 81.73 / Max: 83.09 Min: 81.11 / Avg: 82.73 / Max: 87.36 Min: 89.39 / Avg: 90.02 / Max: 90.97 Min: 93.52 / Avg: 94.84 / Max: 96.82 Min: 88.61 / Avg: 89.53 / Max: 91.26 Min: 93.94 / Avg: 95.39 / Max: 98.68
Result
OpenBenchmarking.org point/sec, More Is Better Apache IoTDB 1.2 Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20M 40M 60M 80M 100M SE +/- 276414.35, N = 3 SE +/- 928557.10, N = 3 SE +/- 739343.51, N = 3 SE +/- 862582.24, N = 7 SE +/- 435900.66, N = 3 SE +/- 594234.55, N = 3 SE +/- 782176.98, N = 3 SE +/- 872659.60, N = 4 90871770 83651785 94616807 92771639 85744542 80770465 86354518 80139566 Result Confidence
OpenBenchmarking.org point/sec, More Is Better Apache IoTDB 1.2 Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 16M 32M 48M 64M 80M Min: 90321310.22 / Avg: 90871770.37 / Max: 91191271.14 Min: 82086029.92 / Avg: 83651785.32 / Max: 85299511.22 Min: 93141563.61 / Avg: 94616807.11 / Max: 95441772.58 Min: 87833481.05 / Avg: 92771638.71 / Max: 94723672.41 Min: 84895320.77 / Avg: 85744542.22 / Max: 86339873.09 Min: 79582539.09 / Avg: 80770464.9 / Max: 81395545.65 Min: 84804662.47 / Avg: 86354518.4 / Max: 87313463.81 Min: 77579252.22 / Avg: 80139565.75 / Max: 81426556.35
CockroachDB CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 512 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20K 40K 60K 80K 100K SE +/- 1037.18, N = 15 SE +/- 639.27, N = 15 SE +/- 1659.04, N = 15 SE +/- 325.76, N = 3 SE +/- 297.86, N = 3 SE +/- 833.19, N = 3 SE +/- 1352.20, N = 3 SE +/- 556.62, N = 3 108953.6 68524.7 115715.8 77327.1 103089.8 69221.4 112265.3 66816.9 Result Confidence
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 512 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20K 40K 60K 80K 100K Min: 105338.5 / Avg: 108953.62 / Max: 118959.2 Min: 66107.8 / Avg: 68524.75 / Max: 75601.2 Min: 106431.8 / Avg: 115715.79 / Max: 127674.4 Min: 76815.7 / Avg: 77327.13 / Max: 77932.4 Min: 102743.8 / Avg: 103089.83 / Max: 103682.8 Min: 68312.7 / Avg: 69221.37 / Max: 70885.4 Min: 109568.3 / Avg: 112265.27 / Max: 113787.3 Min: 65707.2 / Avg: 66816.9 / Max: 67448.5
PyTorch Result
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-152 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 6 12 18 24 30 SE +/- 0.18, N = 3 SE +/- 0.17, N = 3 SE +/- 0.34, N = 3 SE +/- 0.15, N = 12 SE +/- 0.19, N = 5 SE +/- 0.21, N = 3 SE +/- 0.17, N = 12 SE +/- 0.05, N = 3 20.13 14.03 23.49 16.25 19.01 15.84 19.24 14.96 MIN: 17.06 / MAX: 21.01 MIN: 8.98 / MAX: 15.41 MIN: 19.73 / MAX: 24.56 MIN: 6.19 / MAX: 17.5 MIN: 11.15 / MAX: 20.08 MIN: 6.82 / MAX: 16.51 MIN: 10.95 / MAX: 20.39 MIN: 10.89 / MAX: 15.42 Result Confidence
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-152 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 Min: 19.76 / Avg: 20.13 / Max: 20.37 Min: 13.7 / Avg: 14.03 / Max: 14.29 Min: 22.82 / Avg: 23.49 / Max: 23.88 Min: 15.08 / Avg: 16.25 / Max: 17.16 Min: 18.55 / Avg: 19.01 / Max: 19.68 Min: 15.57 / Avg: 15.84 / Max: 16.25 Min: 18.21 / Avg: 19.24 / Max: 20.15 Min: 14.87 / Avg: 14.96 / Max: 15.01
LuxCoreRender LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Danish Mood - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.08, N = 3 SE +/- 0.18, N = 12 SE +/- 0.10, N = 12 SE +/- 0.11, N = 15 SE +/- 0.02, N = 3 SE +/- 0.22, N = 15 SE +/- 0.07, N = 15 SE +/- 0.20, N = 15 6.85 7.00 7.63 7.70 6.03 6.23 6.29 5.91 MIN: 3.05 / MAX: 8.02 MIN: 2.74 / MAX: 9.4 MIN: 3.26 / MAX: 9.01 MIN: 3.44 / MAX: 9.79 MIN: 2.52 / MAX: 7 MIN: 2.27 / MAX: 9.18 MIN: 2.44 / MAX: 7.56 MIN: 2.31 / MAX: 9.24 Result Confidence
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Danish Mood - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 6.75 / Avg: 6.85 / Max: 7 Min: 6.21 / Avg: 7 / Max: 8.03 Min: 6.97 / Avg: 7.63 / Max: 8.07 Min: 7.13 / Avg: 7.7 / Max: 8.51 Min: 6 / Avg: 6.03 / Max: 6.06 Min: 5.19 / Avg: 6.23 / Max: 7.76 Min: 5.6 / Avg: 6.29 / Max: 6.58 Min: 5.14 / Avg: 5.91 / Max: 7.69
Timed Gem5 Compilation This test times how long it takes to compile Gem5. Gem5 is a simulator for computer system architecture research. Gem5 is widely used for computer architecture research within the industry, academia, and more. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed Gem5 Compilation 23.0.1 Time To Compile Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50 100 150 200 250 SE +/- 0.92, N = 3 SE +/- 0.58, N = 3 SE +/- 2.17, N = 3 SE +/- 0.89, N = 3 SE +/- 2.59, N = 4 SE +/- 1.72, N = 3 SE +/- 2.11, N = 6 SE +/- 1.01, N = 3 210.93 178.28 187.51 157.36 220.57 184.30 215.50 181.63 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Timed Gem5 Compilation 23.0.1 Time To Compile Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 Min: 209.09 / Avg: 210.93 / Max: 211.86 Min: 177.28 / Avg: 178.28 / Max: 179.29 Min: 183.17 / Avg: 187.51 / Max: 189.86 Min: 155.58 / Avg: 157.36 / Max: 158.28 Min: 215.31 / Avg: 220.57 / Max: 225.44 Min: 180.87 / Avg: 184.3 / Max: 186.22 Min: 207.83 / Avg: 215.5 / Max: 219.52 Min: 180.13 / Avg: 181.63 / Max: 183.54
RocksDB Result
OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Read While Writing Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3M 6M 9M 12M 15M SE +/- 61518.27, N = 10 SE +/- 343737.14, N = 15 SE +/- 28201.44, N = 3 SE +/- 215352.04, N = 15 SE +/- 83772.27, N = 13 SE +/- 218479.19, N = 15 SE +/- 26369.56, N = 3 SE +/- 254193.37, N = 15 7841738 12321300 8926893 12425519 7439663 9624417 7366500 11223329 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread Result Confidence
OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Read While Writing Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2M 4M 6M 8M 10M Min: 7607121 / Avg: 7841737.7 / Max: 8193969 Min: 10700779 / Avg: 12321300.13 / Max: 15657422 Min: 8871422 / Avg: 8926893 / Max: 8963471 Min: 11093004 / Avg: 12425519.07 / Max: 14001329 Min: 7227203 / Avg: 7439663.23 / Max: 8347963 Min: 8744273 / Avg: 9624416.6 / Max: 11852266 Min: 7328644 / Avg: 7366499.67 / Max: 7417228 Min: 9871431 / Avg: 11223328.93 / Max: 13362337 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
LAMMPS Molecular Dynamics Simulator LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ns/day, More Is Better LAMMPS Molecular Dynamics Simulator 23Jun2022 Model: 20k Atoms Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 13 26 39 52 65 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 34.89 50.52 37.46 56.40 28.28 46.71 32.16 51.82 1. (CXX) g++ options: -O3 -lm -ldl Result Confidence
OpenBenchmarking.org ns/day, More Is Better LAMMPS Molecular Dynamics Simulator 23Jun2022 Model: 20k Atoms Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11 22 33 44 55 Min: 34.81 / Avg: 34.89 / Max: 34.94 Min: 50.5 / Avg: 50.52 / Max: 50.54 Min: 37.42 / Avg: 37.46 / Max: 37.49 Min: 56.35 / Avg: 56.4 / Max: 56.48 Min: 28.26 / Avg: 28.28 / Max: 28.29 Min: 46.61 / Avg: 46.71 / Max: 46.84 Min: 32.15 / Avg: 32.16 / Max: 32.17 Min: 51.72 / Avg: 51.82 / Max: 51.89 1. (CXX) g++ options: -O3 -lm -ldl
Blender Result
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Barbershop - Compute: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 70 140 210 280 350 SE +/- 0.18, N = 3 SE +/- 0.42, N = 3 SE +/- 0.69, N = 3 SE +/- 0.21, N = 3 SE +/- 0.12, N = 3 SE +/- 0.23, N = 3 SE +/- 1.09, N = 3 SE +/- 0.06, N = 3 261.97 141.54 236.73 125.87 320.11 169.44 290.56 156.70 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Barbershop - Compute: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 60 120 180 240 300 Min: 261.68 / Avg: 261.97 / Max: 262.29 Min: 140.92 / Avg: 141.54 / Max: 142.33 Min: 235.47 / Avg: 236.73 / Max: 237.85 Min: 125.6 / Avg: 125.87 / Max: 126.29 Min: 319.91 / Avg: 320.11 / Max: 320.34 Min: 168.99 / Avg: 169.44 / Max: 169.77 Min: 288.45 / Avg: 290.56 / Max: 292.08 Min: 156.59 / Avg: 156.7 / Max: 156.77
Llamafile Result
OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.7 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1.3163 2.6326 3.9489 5.2652 6.5815 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.12, N = 6 5.85 3.82 4.08 3.05 1.47 1.77 1.54 1.54 Result Confidence
OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.7 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 5.83 / Avg: 5.85 / Max: 5.86 Min: 3.8 / Avg: 3.82 / Max: 3.84 Min: 4.05 / Avg: 4.08 / Max: 4.1 Min: 3.03 / Avg: 3.05 / Max: 3.06 Min: 1.47 / Avg: 1.47 / Max: 1.48 Min: 1.76 / Avg: 1.77 / Max: 1.78 Min: 1.53 / Avg: 1.54 / Max: 1.54 Min: 1.07 / Avg: 1.54 / Max: 1.78
Timed Node.js Compilation Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 21.7.2 Time To Compile Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 60 120 180 240 300 SE +/- 0.71, N = 3 SE +/- 0.48, N = 3 SE +/- 0.52, N = 3 SE +/- 0.12, N = 3 SE +/- 0.53, N = 3 SE +/- 0.84, N = 3 SE +/- 0.74, N = 3 SE +/- 0.52, N = 3 254.00 172.99 214.43 145.41 270.38 175.63 252.65 171.17 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 21.7.2 Time To Compile Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50 100 150 200 250 Min: 253.22 / Avg: 254 / Max: 255.43 Min: 172.43 / Avg: 172.99 / Max: 173.95 Min: 213.49 / Avg: 214.43 / Max: 215.29 Min: 145.21 / Avg: 145.41 / Max: 145.61 Min: 269.34 / Avg: 270.38 / Max: 271.1 Min: 174.7 / Avg: 175.63 / Max: 177.31 Min: 251.27 / Avg: 252.65 / Max: 253.82 Min: 170.52 / Avg: 171.17 / Max: 172.21
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 SE +/- 0.09, N = 3 SE +/- 0.69, N = 15 SE +/- 0.71, N = 3 SE +/- 0.44, N = 3 SE +/- 3.36, N = 15 SE +/- 5.82, N = 12 SE +/- 6.41, N = 15 SE +/- 2.59, N = 15 116.32 92.35 109.67 100.74 139.10 121.67 155.79 121.78 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 Min: 116.18 / Avg: 116.31 / Max: 116.48 Min: 90.31 / Avg: 92.35 / Max: 100.18 Min: 108.91 / Avg: 109.67 / Max: 111.08 Min: 100.26 / Avg: 100.74 / Max: 101.61 Min: 126.21 / Avg: 139.1 / Max: 173.52 Min: 104.92 / Avg: 121.67 / Max: 167.8 Min: 134.46 / Avg: 155.79 / Max: 211.84 Min: 111.99 / Avg: 121.78 / Max: 145.67 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 SE +/- 0.00664, N = 3 SE +/- 0.07619, N = 15 SE +/- 0.05824, N = 3 SE +/- 0.04271, N = 3 SE +/- 0.15651, N = 15 SE +/- 0.34632, N = 12 SE +/- 0.22869, N = 15 SE +/- 0.16487, N = 15 8.59719 10.83623 9.11885 9.92684 7.24187 8.39962 6.54965 8.26016 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 SE +/- 0.09, N = 3 SE +/- 0.69, N = 15 SE +/- 0.71, N = 3 SE +/- 0.44, N = 3 SE +/- 3.36, N = 15 SE +/- 5.82, N = 12 SE +/- 6.41, N = 15 SE +/- 2.59, N = 15 116.32 92.35 109.67 100.74 139.10 121.67 155.79 121.78 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 8.58 / Avg: 8.6 / Max: 8.61 Min: 9.98 / Avg: 10.84 / Max: 11.07 Min: 9 / Avg: 9.12 / Max: 9.18 Min: 9.84 / Avg: 9.93 / Max: 9.97 Min: 5.76 / Avg: 7.24 / Max: 7.92 Min: 5.96 / Avg: 8.4 / Max: 9.53 Min: 4.72 / Avg: 6.55 / Max: 7.44 Min: 6.86 / Avg: 8.26 / Max: 8.93 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
DuckDB DuckDB is an in-progress SQL OLAP database management system optimized for analytics and features a vectorized and parallel engine. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better DuckDB 0.9.1 Benchmark: TPC-H Parquet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 SE +/- 0.12, N = 3 SE +/- 0.55, N = 3 SE +/- 0.34, N = 3 SE +/- 0.44, N = 3 SE +/- 0.15, N = 3 SE +/- 0.57, N = 3 SE +/- 0.58, N = 3 SE +/- 0.95, N = 3 145.57 155.73 132.87 144.26 146.87 156.14 145.24 158.31 1. (CXX) g++ options: -O3 -rdynamic -lssl -lcrypto -ldl Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better DuckDB 0.9.1 Benchmark: TPC-H Parquet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 Min: 145.35 / Avg: 145.57 / Max: 145.77 Min: 154.65 / Avg: 155.73 / Max: 156.47 Min: 132.45 / Avg: 132.87 / Max: 133.54 Min: 143.73 / Avg: 144.26 / Max: 145.13 Min: 146.59 / Avg: 146.87 / Max: 147.11 Min: 155.23 / Avg: 156.14 / Max: 157.2 Min: 144.25 / Avg: 145.24 / Max: 146.26 Min: 157.33 / Avg: 158.31 / Max: 160.21 1. (CXX) g++ options: -O3 -rdynamic -lssl -lcrypto -ldl
easyWave The easyWave software allows simulating tsunami generation and propagation in the context of early warning systems. EasyWave supports making use of OpenMP for CPU multi-threading and there are also GPU ports available but not currently incorporated as part of this test profile. The easyWave tsunami generation software is run with one of the example/reference input files for measuring the CPU execution time. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better easyWave r34 Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.10, N = 3 SE +/- 0.24, N = 3 SE +/- 0.32, N = 4 SE +/- 0.23, N = 3 SE +/- 3.12, N = 12 SE +/- 4.11, N = 15 SE +/- 3.75, N = 15 SE +/- 3.75, N = 15 46.29 50.83 28.70 37.66 63.43 74.87 64.88 68.86 1. (CXX) g++ options: -O3 -fopenmp Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better easyWave r34 Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 14 28 42 56 70 Min: 46.1 / Avg: 46.29 / Max: 46.42 Min: 50.51 / Avg: 50.83 / Max: 51.29 Min: 27.94 / Avg: 28.7 / Max: 29.34 Min: 37.23 / Avg: 37.66 / Max: 37.99 Min: 53.09 / Avg: 63.43 / Max: 91.63 Min: 54.87 / Avg: 74.87 / Max: 104.87 Min: 51.18 / Avg: 64.88 / Max: 95.16 Min: 56.33 / Avg: 68.86 / Max: 107.29 1. (CXX) g++ options: -O3 -fopenmp
OpenRadioss OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Chrysler Neon 1M Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50 100 150 200 250 SE +/- 0.15, N = 3 SE +/- 0.11, N = 3 SE +/- 0.20, N = 3 SE +/- 0.14, N = 3 SE +/- 0.08, N = 3 SE +/- 0.13, N = 3 SE +/- 0.18, N = 3 SE +/- 0.14, N = 3 207.20 115.89 157.56 86.93 228.74 125.15 212.99 117.91 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Chrysler Neon 1M Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 Min: 207.03 / Avg: 207.2 / Max: 207.49 Min: 115.68 / Avg: 115.89 / Max: 116.03 Min: 157.21 / Avg: 157.56 / Max: 157.92 Min: 86.78 / Avg: 86.93 / Max: 87.22 Min: 228.6 / Avg: 228.74 / Max: 228.86 Min: 124.93 / Avg: 125.15 / Max: 125.39 Min: 212.71 / Avg: 212.99 / Max: 213.33 Min: 117.77 / Avg: 117.91 / Max: 118.18
LuxCoreRender LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: DLSC - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 SE +/- 0.06, N = 15 SE +/- 0.23, N = 15 SE +/- 0.02, N = 3 SE +/- 0.24, N = 15 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 SE +/- 0.10, N = 3 SE +/- 0.20, N = 15 8.72 11.12 9.38 12.74 7.46 10.17 8.00 10.44 MIN: 8.12 / MAX: 10.6 MIN: 9.18 / MAX: 17.51 MIN: 8.94 / MAX: 11.49 MIN: 10.69 / MAX: 19.19 MIN: 7.17 / MAX: 8.21 MIN: 9.34 / MAX: 14.75 MIN: 7.65 / MAX: 9.12 MIN: 8.86 / MAX: 16.08 Result Confidence
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: DLSC - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 Min: 8.48 / Avg: 8.72 / Max: 9.03 Min: 10.06 / Avg: 11.12 / Max: 12.79 Min: 9.35 / Avg: 9.38 / Max: 9.4 Min: 11.63 / Avg: 12.74 / Max: 14.1 Min: 7.31 / Avg: 7.46 / Max: 7.54 Min: 9.93 / Avg: 10.17 / Max: 10.3 Min: 7.87 / Avg: 8 / Max: 8.2 Min: 9.65 / Avg: 10.44 / Max: 12.26
FFmpeg Result
OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Upload Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 6 12 18 24 30 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 24.97 24.56 26.93 26.80 23.33 22.34 23.77 23.30 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma Result Confidence
OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Upload Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 6 12 18 24 30 Min: 24.9 / Avg: 24.97 / Max: 25.05 Min: 24.42 / Avg: 24.56 / Max: 24.75 Min: 26.83 / Avg: 26.93 / Max: 26.98 Min: 26.73 / Avg: 26.8 / Max: 26.85 Min: 23.33 / Avg: 23.33 / Max: 23.33 Min: 22.12 / Avg: 22.34 / Max: 22.55 Min: 23.66 / Avg: 23.77 / Max: 23.89 Min: 23.18 / Avg: 23.3 / Max: 23.4 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 15 30 45 60 75 SE +/- 0.12, N = 3 SE +/- 0.28, N = 3 SE +/- 0.10, N = 3 SE +/- 0.35, N = 3 SE +/- 0.55, N = 15 SE +/- 1.43, N = 15 SE +/- 0.55, N = 15 SE +/- 0.47, N = 14 50.35 64.29 43.54 58.94 54.96 69.45 59.18 69.20 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 13 26 39 52 65 Min: 50.11 / Avg: 50.35 / Max: 50.48 Min: 63.94 / Avg: 64.29 / Max: 64.85 Min: 43.36 / Avg: 43.54 / Max: 43.69 Min: 58.25 / Avg: 58.94 / Max: 59.32 Min: 53.22 / Avg: 54.96 / Max: 61.86 Min: 63.2 / Avg: 69.45 / Max: 76.56 Min: 56.75 / Avg: 59.18 / Max: 63.11 Min: 66.91 / Avg: 69.2 / Max: 72.94 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 6 12 18 24 30 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 SE +/- 0.17, N = 15 SE +/- 0.29, N = 15 SE +/- 0.15, N = 15 SE +/- 0.10, N = 14 19.86 15.56 22.97 16.97 18.22 14.48 16.92 14.46 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 15 30 45 60 75 SE +/- 0.12, N = 3 SE +/- 0.28, N = 3 SE +/- 0.10, N = 3 SE +/- 0.35, N = 3 SE +/- 0.55, N = 15 SE +/- 1.43, N = 15 SE +/- 0.55, N = 15 SE +/- 0.47, N = 14 50.35 64.29 43.54 58.94 54.96 69.45 59.18 69.20 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 Min: 19.81 / Avg: 19.86 / Max: 19.96 Min: 15.42 / Avg: 15.56 / Max: 15.64 Min: 22.89 / Avg: 22.97 / Max: 23.06 Min: 16.86 / Avg: 16.97 / Max: 17.17 Min: 16.16 / Avg: 18.22 / Max: 18.79 Min: 13.06 / Avg: 14.48 / Max: 15.82 Min: 15.84 / Avg: 16.92 / Max: 17.62 Min: 13.71 / Avg: 14.46 / Max: 14.95 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenSSL Result
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: AES-128-GCM Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 400000M 800000M 1200000M 1600000M 2000000M SE +/- 28627701.54, N = 3 SE +/- 159598753.20, N = 3 SE +/- 1253503549.61, N = 3 SE +/- 1622921637.03, N = 3 SE +/- 43545680.66, N = 3 SE +/- 268465891.11, N = 3 SE +/- 56355870.99, N = 3 SE +/- 697208281.49, N = 3 768804693697 1533026300727 889567506540 1769313146013 641200848170 1277583382757 747710702660 1484669627050 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl Result Confidence
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: AES-128-GCM Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 300000M 600000M 900000M 1200000M 1500000M Min: 768752002660 / Avg: 768804693696.67 / Max: 768850439650 Min: 1532769000930 / Avg: 1533026300726.7 / Max: 1533318544320 Min: 888030335850 / Avg: 889567506540 / Max: 892051213790 Min: 1767482912490 / Avg: 1769313146013.3 / Max: 1772549751060 Min: 641113915120 / Avg: 641200848170 / Max: 641248860300 Min: 1277092543690 / Avg: 1277583382756.7 / Max: 1278017295160 Min: 747630093380 / Avg: 747710702660 / Max: 747819231640 Min: 1483608758680 / Avg: 1484669627050 / Max: 1485983781140 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
Result
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: AES-256-GCM Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 300000M 600000M 900000M 1200000M 1500000M SE +/- 2848140790.67, N = 3 SE +/- 1397764228.85, N = 3 SE +/- 3966858436.56, N = 3 SE +/- 1320809584.03, N = 3 SE +/- 119857064.56, N = 3 SE +/- 108288170.03, N = 3 SE +/- 63026881.96, N = 3 SE +/- 112278705.55, N = 3 700239352717 1369534328470 744387683670 1497529939377 507456728087 1011898993323 592014115453 1181148957353 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl Result Confidence
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: AES-256-GCM Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 300000M 600000M 900000M 1200000M 1500000M Min: 694545018060 / Avg: 700239352716.67 / Max: 703215487110 Min: 1367768906960 / Avg: 1369534328470 / Max: 1372294191240 Min: 740373466320 / Avg: 744387683670 / Max: 752321211320 Min: 1494955760300 / Avg: 1497529939376.7 / Max: 1499330658580 Min: 507221000470 / Avg: 507456728086.67 / Max: 507612294890 Min: 1011763512390 / Avg: 1011898993323.3 / Max: 1012113064480 Min: 591917684600 / Avg: 592014115453.33 / Max: 592132637220 Min: 1180954994550 / Avg: 1181148957353.3 / Max: 1181343935420 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
Result
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: ChaCha20-Poly1305 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 100000M 200000M 300000M 400000M 500000M SE +/- 766713911.50, N = 3 SE +/- 132227134.30, N = 3 SE +/- 120899798.30, N = 3 SE +/- 82161991.11, N = 3 SE +/- 6370607.14, N = 3 SE +/- 4148679.28, N = 3 SE +/- 37795783.50, N = 3 SE +/- 36941390.18, N = 3 225038850730 442202532977 223625738013 444099144270 161321058213 320396720447 187796174440 372735215297 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl Result Confidence
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: ChaCha20-Poly1305 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 80000M 160000M 240000M 320000M 400000M Min: 223505534430 / Avg: 225038850730 / Max: 225821524790 Min: 441973884520 / Avg: 442202532976.67 / Max: 442431930910 Min: 223384491620 / Avg: 223625738013.33 / Max: 223760518080 Min: 443969338300 / Avg: 444099144270 / Max: 444251308850 Min: 161308707500 / Avg: 161321058213.33 / Max: 161329944440 Min: 320390195610 / Avg: 320396720446.67 / Max: 320404421840 Min: 187728433970 / Avg: 187796174440 / Max: 187859096100 Min: 372685934870 / Avg: 372735215296.67 / Max: 372807527080 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
Result
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: SHA512 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 10000M 20000M 30000M 40000M 50000M SE +/- 203213936.42, N = 3 SE +/- 481040738.21, N = 3 SE +/- 37654528.63, N = 3 SE +/- 14734422.48, N = 3 SE +/- 500176.69, N = 3 SE +/- 3500318.33, N = 3 SE +/- 1250834.62, N = 3 SE +/- 14339684.98, N = 3 22219927723 42846254477 23886054770 46520760707 16199261277 32304222993 18893980783 37564522053 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl Result Confidence
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: SHA512 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8000M 16000M 24000M 32000M 40000M Min: 21813753380 / Avg: 22219927723.33 / Max: 22435445260 Min: 41884310320 / Avg: 42846254476.67 / Max: 43341303310 Min: 23845431080 / Avg: 23886054770 / Max: 23961283620 Min: 46497952550 / Avg: 46520760706.67 / Max: 46548324940 Min: 16198336550 / Avg: 16199261276.67 / Max: 16200054080 Min: 32297389590 / Avg: 32304222993.33 / Max: 32308956940 Min: 18891629010 / Avg: 18893980783.33 / Max: 18895895340 Min: 37536606990 / Avg: 37564522053.33 / Max: 37584175340 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
Result
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: ChaCha20 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 150000M 300000M 450000M 600000M 750000M SE +/- 232288636.76, N = 3 SE +/- 271318554.29, N = 3 SE +/- 3335467.26, N = 3 SE +/- 303075210.03, N = 3 SE +/- 415487944.57, N = 3 SE +/- 329510485.23, N = 3 SE +/- 312824840.64, N = 3 SE +/- 863978337.15, N = 3 316126421173 624402972947 344150916937 684284382760 226597354153 449908494927 263740690067 522912403347 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl Result Confidence
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: ChaCha20 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 120000M 240000M 360000M 480000M 600000M Min: 315723909260 / Avg: 316126421173.33 / Max: 316528580470 Min: 623925663880 / Avg: 624402972946.67 / Max: 624865174600 Min: 344145814050 / Avg: 344150916936.67 / Max: 344157189460 Min: 683775698530 / Avg: 684284382760 / Max: 684824196440 Min: 225829051050 / Avg: 226597354153.33 / Max: 227255683480 Min: 449342850940 / Avg: 449908494926.67 / Max: 450484176340 Min: 263115681790 / Avg: 263740690066.67 / Max: 264077722420 Min: 521204638730 / Avg: 522912403346.67 / Max: 523994388070 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
Result
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: SHA256 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30000M 60000M 90000M 120000M 150000M SE +/- 159515825.53, N = 3 SE +/- 66583540.43, N = 3 SE +/- 23323764.84, N = 3 SE +/- 29142783.86, N = 3 SE +/- 27466135.54, N = 3 SE +/- 126029257.64, N = 3 SE +/- 33334799.97, N = 3 SE +/- 70647143.49, N = 3 61806994523 119106802107 66573957920 131976050120 44439185187 88635753413 51840436763 103382860113 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl Result Confidence
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: SHA256 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20000M 40000M 60000M 80000M 100000M Min: 61618891490 / Avg: 61806994523.33 / Max: 62124202560 Min: 118985504260 / Avg: 119106802106.67 / Max: 119215045440 Min: 66530973870 / Avg: 66573957920 / Max: 66611143020 Min: 131941867810 / Avg: 131976050120 / Max: 132034026270 Min: 44395980250 / Avg: 44439185186.67 / Max: 44490167340 Min: 88435026300 / Avg: 88635753413.33 / Max: 88868145720 Min: 51778993930 / Avg: 51840436763.33 / Max: 51893568230 Min: 103284149010 / Avg: 103382860113.33 / Max: 103519766480 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
Speedb Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Random Read Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 130M 260M 390M 520M 650M SE +/- 168680.90, N = 3 SE +/- 5393159.45, N = 3 SE +/- 242146.75, N = 3 SE +/- 5399265.88, N = 15 SE +/- 3698537.65, N = 15 SE +/- 8491098.40, N = 15 SE +/- 2763560.64, N = 13 SE +/- 2955608.21, N = 3 276179617 551286958 315178381 586147871 211457048 419943570 244070674 497907490 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread Result Confidence
OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Random Read Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 100M 200M 300M 400M 500M Min: 275854286 / Avg: 276179617 / Max: 276419610 Min: 540533097 / Avg: 551286957.67 / Max: 557388020 Min: 314847036 / Avg: 315178380.67 / Max: 315649934 Min: 537891393 / Avg: 586147871.33 / Max: 608835550 Min: 183773999 / Avg: 211457047.53 / Max: 218801419 Min: 365172792 / Avg: 419943569.73 / Max: 440904796 Min: 211153701 / Avg: 244070673.77 / Max: 247613116 Min: 493247765 / Avg: 497907489.67 / Max: 503387286 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
FFmpeg Result
OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Video On Demand Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12 24 36 48 60 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.14, N = 3 SE +/- 0.10, N = 3 SE +/- 0.43, N = 3 SE +/- 0.07, N = 3 SE +/- 0.13, N = 3 49.84 48.77 53.99 53.29 47.34 45.29 48.14 46.79 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma Result Confidence
OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Video On Demand Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11 22 33 44 55 Min: 49.82 / Avg: 49.84 / Max: 49.88 Min: 48.7 / Avg: 48.77 / Max: 48.81 Min: 53.93 / Avg: 53.99 / Max: 54.05 Min: 53.03 / Avg: 53.29 / Max: 53.49 Min: 47.24 / Avg: 47.34 / Max: 47.53 Min: 44.84 / Avg: 45.29 / Max: 46.15 Min: 48 / Avg: 48.14 / Max: 48.22 Min: 46.53 / Avg: 46.79 / Max: 46.92 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
Result
OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Platform Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12 24 36 48 60 SE +/- 0.16, N = 3 SE +/- 0.12, N = 3 SE +/- 0.14, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.27, N = 3 49.79 48.76 53.92 53.22 47.32 45.95 48.35 46.59 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma Result Confidence
OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Platform Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11 22 33 44 55 Min: 49.5 / Avg: 49.79 / Max: 50.05 Min: 48.53 / Avg: 48.76 / Max: 48.93 Min: 53.65 / Avg: 53.92 / Max: 54.09 Min: 52.97 / Avg: 53.22 / Max: 53.47 Min: 47.27 / Avg: 47.32 / Max: 47.37 Min: 45.76 / Avg: 45.95 / Max: 46.05 Min: 48.2 / Avg: 48.35 / Max: 48.48 Min: 46.08 / Avg: 46.59 / Max: 47.01 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
PyTorch Result
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-152 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 6 12 18 24 30 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.16, N = 3 SE +/- 0.18, N = 3 SE +/- 0.18, N = 7 SE +/- 0.09, N = 3 SE +/- 0.18, N = 7 SE +/- 0.16, N = 3 20.46 14.59 23.41 16.17 19.47 16.68 19.29 14.74 MIN: 17.25 / MAX: 21.16 MIN: 10.11 / MAX: 16.06 MIN: 22.41 / MAX: 24.3 MIN: 11.54 / MAX: 16.69 MIN: 11.79 / MAX: 20.53 MIN: 7.02 / MAX: 17.07 MIN: 10.66 / MAX: 20.07 MIN: 10.63 / MAX: 15.36 Result Confidence
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-152 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 Min: 20.39 / Avg: 20.46 / Max: 20.54 Min: 14.43 / Avg: 14.59 / Max: 14.74 Min: 23.13 / Avg: 23.41 / Max: 23.67 Min: 15.82 / Avg: 16.17 / Max: 16.41 Min: 18.55 / Avg: 19.47 / Max: 20.1 Min: 16.56 / Avg: 16.68 / Max: 16.86 Min: 18.48 / Avg: 19.29 / Max: 19.78 Min: 14.42 / Avg: 14.74 / Max: 14.92
Zstd Compression This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19 - Decompression Speed Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 300 600 900 1200 1500 SE +/- 4.45, N = 3 SE +/- 4.96, N = 3 SE +/- 3.01, N = 4 SE +/- 1.88, N = 3 SE +/- 2.12, N = 3 SE +/- 0.66, N = 15 SE +/- 1.08, N = 15 SE +/- 0.65, N = 15 1032.0 963.6 1221.8 1165.8 1126.4 1040.2 1127.5 1039.2 1. (CC) gcc options: -O3 -pthread -lz -llzma Result Confidence
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19 - Decompression Speed Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 200 400 600 800 1000 Min: 1024.3 / Avg: 1032 / Max: 1039.7 Min: 954.2 / Avg: 963.57 / Max: 971.1 Min: 1217.4 / Avg: 1221.83 / Max: 1230.5 Min: 1162.1 / Avg: 1165.8 / Max: 1168.2 Min: 1122.6 / Avg: 1126.43 / Max: 1129.9 Min: 1036.2 / Avg: 1040.2 / Max: 1044.9 Min: 1119 / Avg: 1127.51 / Max: 1131.8 Min: 1035.2 / Avg: 1039.18 / Max: 1043.3 1. (CC) gcc options: -O3 -pthread -lz -llzma
Result
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19 - Compression Speed Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 SE +/- 0.06, N = 3 SE +/- 0.12, N = 3 SE +/- 0.21, N = 4 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 SE +/- 0.09, N = 15 SE +/- 0.11, N = 15 SE +/- 0.13, N = 15 14.6 15.2 18.0 17.8 14.4 13.8 14.5 13.3 1. (CC) gcc options: -O3 -pthread -lz -llzma Result Confidence
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19 - Compression Speed Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 Min: 14.5 / Avg: 14.6 / Max: 14.7 Min: 15 / Avg: 15.17 / Max: 15.4 Min: 17.7 / Avg: 18 / Max: 18.6 Min: 17.7 / Avg: 17.77 / Max: 17.8 Min: 14.1 / Avg: 14.37 / Max: 14.6 Min: 13.1 / Avg: 13.76 / Max: 14.4 Min: 13.7 / Avg: 14.49 / Max: 15.2 Min: 12.2 / Avg: 13.29 / Max: 13.9 1. (CC) gcc options: -O3 -pthread -lz -llzma
oneDNN Result
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Recurrent Neural Network Inference - Engine: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 300 600 900 1200 1500 SE +/- 0.29, N = 3 SE +/- 2.30, N = 3 SE +/- 2.24, N = 3 SE +/- 3.17, N = 3 SE +/- 21.06, N = 12 SE +/- 113.47, N = 12 SE +/- 20.21, N = 15 SE +/- 7.22, N = 3 409.59 633.29 488.92 538.23 734.80 1498.58 632.15 719.23 MIN: 390.22 MIN: 621.42 MIN: 457.65 MIN: 529.58 MIN: 546.95 MIN: 641.2 MIN: 459.4 MIN: 696.95 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread Result Confidence
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Recurrent Neural Network Inference - Engine: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 300 600 900 1200 1500 Min: 409.02 / Avg: 409.59 / Max: 409.92 Min: 628.68 / Avg: 633.29 / Max: 635.67 Min: 484.6 / Avg: 488.92 / Max: 492.08 Min: 534.09 / Avg: 538.22 / Max: 544.45 Min: 618.9 / Avg: 734.8 / Max: 833.89 Min: 947.22 / Avg: 1498.58 / Max: 2054.61 Min: 538.26 / Avg: 632.15 / Max: 745.87 Min: 704.9 / Avg: 719.23 / Max: 727.93 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
John The Ripper This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: MD5 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4M 8M 12M 16M 20M SE +/- 3511.88, N = 3 SE +/- 22338.31, N = 3 SE +/- 1201.85, N = 3 SE +/- 317498.76, N = 15 SE +/- 54649.77, N = 15 SE +/- 601801.63, N = 12 SE +/- 5000.00, N = 3 SE +/- 695042.48, N = 12 9583000 18166000 10922667 18438600 7626333 12958000 8957000 14609417 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2 Result Confidence
OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: MD5 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3M 6M 9M 12M 15M Min: 9576000 / Avg: 9583000 / Max: 9587000 Min: 18134000 / Avg: 18166000 / Max: 18209000 Min: 10921000 / Avg: 10922666.67 / Max: 10925000 Min: 15993000 / Avg: 18438600 / Max: 20058000 Min: 7070000 / Avg: 7626333.33 / Max: 7783000 Min: 7797000 / Avg: 12958000 / Max: 15040000 Min: 8952000 / Avg: 8957000 / Max: 8967000 Min: 9301000 / Avg: 14609416.67 / Max: 16765000 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
PyTorch Result
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-152 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 6 12 18 24 30 SE +/- 0.08, N = 3 SE +/- 0.13, N = 7 SE +/- 0.29, N = 3 SE +/- 0.16, N = 3 SE +/- 0.15, N = 3 SE +/- 0.09, N = 3 SE +/- 0.15, N = 3 SE +/- 0.18, N = 4 20.25 14.08 23.33 16.00 19.20 16.30 19.58 14.92 MIN: 17.03 / MAX: 21.21 MIN: 6.98 / MAX: 15.46 MIN: 19.78 / MAX: 24.54 MIN: 11.43 / MAX: 16.66 MIN: 10.93 / MAX: 20 MIN: 11.86 / MAX: 16.95 MIN: 13.13 / MAX: 20.27 MIN: 8.28 / MAX: 15.85 Result Confidence
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-152 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 Min: 20.08 / Avg: 20.25 / Max: 20.35 Min: 13.69 / Avg: 14.08 / Max: 14.61 Min: 22.87 / Avg: 23.33 / Max: 23.86 Min: 15.77 / Avg: 16 / Max: 16.32 Min: 18.9 / Avg: 19.2 / Max: 19.38 Min: 16.14 / Avg: 16.3 / Max: 16.46 Min: 19.41 / Avg: 19.58 / Max: 19.87 Min: 14.45 / Avg: 14.92 / Max: 15.35
OSPRay Result
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/scivis/real_time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12 24 36 48 60 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 21.89 38.23 30.68 53.93 16.09 29.35 18.49 33.13 Result Confidence
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/scivis/real_time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11 22 33 44 55 Min: 21.88 / Avg: 21.89 / Max: 21.9 Min: 38.18 / Avg: 38.23 / Max: 38.26 Min: 30.6 / Avg: 30.68 / Max: 30.73 Min: 53.85 / Avg: 53.93 / Max: 54 Min: 16.07 / Avg: 16.09 / Max: 16.1 Min: 29.25 / Avg: 29.35 / Max: 29.45 Min: 18.41 / Avg: 18.49 / Max: 18.52 Min: 33.05 / Avg: 33.13 / Max: 33.19
DuckDB DuckDB is an in-progress SQL OLAP database management system optimized for analytics and features a vectorized and parallel engine. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better DuckDB 0.9.1 Benchmark: IMDB Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 SE +/- 0.10, N = 3 SE +/- 0.67, N = 3 SE +/- 0.59, N = 3 SE +/- 0.30, N = 3 SE +/- 0.23, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.41, N = 3 99.49 125.88 99.18 127.57 100.09 127.70 99.62 131.80 1. (CXX) g++ options: -O3 -rdynamic -lssl -lcrypto -ldl Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better DuckDB 0.9.1 Benchmark: IMDB Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 Min: 99.37 / Avg: 99.49 / Max: 99.7 Min: 124.9 / Avg: 125.88 / Max: 127.17 Min: 98 / Avg: 99.18 / Max: 99.81 Min: 127.13 / Avg: 127.57 / Max: 128.14 Min: 99.64 / Avg: 100.09 / Max: 100.42 Min: 127.57 / Avg: 127.7 / Max: 127.8 Min: 99.49 / Avg: 99.62 / Max: 99.73 Min: 131.21 / Avg: 131.79 / Max: 132.58 1. (CXX) g++ options: -O3 -rdynamic -lssl -lcrypto -ldl
OSPRay Result
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/pathtracer/real_time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 SE +/- 0.17, N = 3 SE +/- 0.49, N = 3 SE +/- 0.25, N = 3 SE +/- 0.89, N = 3 SE +/- 0.09, N = 3 SE +/- 0.42, N = 3 SE +/- 0.29, N = 3 SE +/- 0.81, N = 3 160.24 149.09 193.14 176.40 144.48 137.50 143.48 135.44 Result Confidence
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/pathtracer/real_time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 Min: 160.06 / Avg: 160.24 / Max: 160.59 Min: 148.5 / Avg: 149.09 / Max: 150.07 Min: 192.7 / Avg: 193.14 / Max: 193.55 Min: 174.97 / Avg: 176.39 / Max: 178.04 Min: 144.33 / Avg: 144.48 / Max: 144.63 Min: 136.68 / Avg: 137.5 / Max: 138.07 Min: 142.92 / Avg: 143.48 / Max: 143.9 Min: 133.82 / Avg: 135.44 / Max: 136.27
Result
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 10 20 30 40 50 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.22, N = 15 SE +/- 0.24, N = 12 SE +/- 0.18, N = 15 SE +/- 0.22, N = 15 19.58 35.60 23.18 41.91 15.50 15.34 16.27 15.82 Result Confidence
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 Min: 19.49 / Avg: 19.58 / Max: 19.62 Min: 35.55 / Avg: 35.6 / Max: 35.64 Min: 23.1 / Avg: 23.18 / Max: 23.25 Min: 41.81 / Avg: 41.91 / Max: 42.08 Min: 14.07 / Avg: 15.5 / Max: 16.59 Min: 14.41 / Avg: 15.34 / Max: 16.59 Min: 15.45 / Avg: 16.27 / Max: 17.84 Min: 14.52 / Avg: 15.82 / Max: 17.4
LuxCoreRender LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Orange Juice - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.05, N = 3 SE +/- 0.30, N = 15 SE +/- 0.10, N = 3 SE +/- 0.16, N = 15 SE +/- 0.04, N = 3 SE +/- 0.28, N = 15 13.46 18.70 14.74 19.91 11.86 16.91 12.50 16.64 MIN: 11.09 / MAX: 16.56 MIN: 16.22 / MAX: 25.05 MIN: 12.17 / MAX: 18.21 MIN: 15 / MAX: 30.59 MIN: 9.93 / MAX: 13.28 MIN: 12.9 / MAX: 23.07 MIN: 10.38 / MAX: 14.93 MIN: 12.39 / MAX: 24.93 Result Confidence
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Orange Juice - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 Min: 13.33 / Avg: 13.46 / Max: 13.55 Min: 18.51 / Avg: 18.7 / Max: 18.91 Min: 14.65 / Avg: 14.74 / Max: 14.8 Min: 18.33 / Avg: 19.91 / Max: 22.1 Min: 11.67 / Avg: 11.86 / Max: 11.97 Min: 15.85 / Avg: 16.91 / Max: 17.99 Min: 12.42 / Avg: 12.5 / Max: 12.54 Min: 15.54 / Avg: 16.64 / Max: 18.7
Timed LLVM Compilation This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 16.0 Build System: Ninja Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50 100 150 200 250 SE +/- 0.07, N = 3 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 SE +/- 0.27, N = 3 SE +/- 0.19, N = 3 SE +/- 0.17, N = 3 SE +/- 0.36, N = 3 SE +/- 0.79, N = 3 187.02 122.31 165.05 106.82 212.48 134.42 197.84 128.07 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 16.0 Build System: Ninja Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 Min: 186.89 / Avg: 187.02 / Max: 187.11 Min: 122.06 / Avg: 122.31 / Max: 122.58 Min: 164.82 / Avg: 165.05 / Max: 165.22 Min: 106.41 / Avg: 106.81 / Max: 107.32 Min: 212.28 / Avg: 212.48 / Max: 212.86 Min: 134.13 / Avg: 134.42 / Max: 134.71 Min: 197.13 / Avg: 197.84 / Max: 198.28 Min: 126.57 / Avg: 128.07 / Max: 129.25
NAMD NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ns/day, More Is Better NAMD 3.0b6 Input: ATPase with 327,506 Atoms Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.21567, N = 12 SE +/- 0.17435, N = 15 SE +/- 0.54361, N = 15 SE +/- 0.34017, N = 12 SE +/- 0.16058, N = 15 SE +/- 0.26203, N = 15 SE +/- 0.14537, N = 15 SE +/- 0.44989, N = 15 2.97021 2.21948 4.64814 5.85267 5.97130 7.30065 5.92501 2.56319 Result Confidence
OpenBenchmarking.org ns/day, More Is Better NAMD 3.0b6 Input: ATPase with 327,506 Atoms Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 1.8 / Avg: 2.97 / Max: 4.16 Min: 1.23 / Avg: 2.22 / Max: 3.92 Min: 1.28 / Avg: 4.65 / Max: 7.54 Min: 3.15 / Avg: 5.85 / Max: 7.05 Min: 4.66 / Avg: 5.97 / Max: 6.77 Min: 5.44 / Avg: 7.3 / Max: 8.57 Min: 5.29 / Avg: 5.93 / Max: 6.78 Min: 0.77 / Avg: 2.56 / Max: 5.7
VVenC Result
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Fast Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.022, N = 3 SE +/- 0.047, N = 3 SE +/- 0.023, N = 3 SE +/- 0.038, N = 3 SE +/- 0.010, N = 3 SE +/- 0.081, N = 3 SE +/- 0.033, N = 3 SE +/- 0.043, N = 15 6.719 6.480 7.392 6.960 6.324 6.023 6.501 6.077 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Fast Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 6.68 / Avg: 6.72 / Max: 6.76 Min: 6.42 / Avg: 6.48 / Max: 6.57 Min: 7.35 / Avg: 7.39 / Max: 7.43 Min: 6.89 / Avg: 6.96 / Max: 7.02 Min: 6.31 / Avg: 6.32 / Max: 6.34 Min: 5.88 / Avg: 6.02 / Max: 6.16 Min: 6.44 / Avg: 6.5 / Max: 6.56 Min: 5.78 / Avg: 6.08 / Max: 6.31 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
Numpy Benchmark This is a test to obtain the general Numpy performance. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Score, More Is Better Numpy Benchmark Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 110 220 330 440 550 SE +/- 0.33, N = 3 SE +/- 0.26, N = 3 SE +/- 1.84, N = 3 SE +/- 1.42, N = 3 SE +/- 0.60, N = 3 SE +/- 1.13, N = 3 SE +/- 0.79, N = 3 SE +/- 1.30, N = 3 455.57 456.18 520.22 519.89 461.61 435.21 464.72 439.84 Result Confidence
OpenBenchmarking.org Score, More Is Better Numpy Benchmark Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 90 180 270 360 450 Min: 454.98 / Avg: 455.57 / Max: 456.12 Min: 455.67 / Avg: 456.18 / Max: 456.52 Min: 518.27 / Avg: 520.22 / Max: 523.89 Min: 517.06 / Avg: 519.89 / Max: 521.5 Min: 460.51 / Avg: 461.61 / Max: 462.58 Min: 433.47 / Avg: 435.21 / Max: 437.33 Min: 463.6 / Avg: 464.72 / Max: 466.25 Min: 437.94 / Avg: 439.84 / Max: 442.32
PyTorch Result
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 14 28 42 56 70 SE +/- 0.12, N = 3 SE +/- 0.21, N = 3 SE +/- 0.19, N = 3 SE +/- 0.30, N = 15 SE +/- 0.72, N = 3 SE +/- 0.26, N = 3 SE +/- 0.43, N = 15 SE +/- 0.34, N = 15 56.44 37.55 63.30 40.83 51.05 41.65 51.86 37.84 MIN: 48.09 / MAX: 58.6 MIN: 24.5 / MAX: 40.69 MIN: 48.94 / MAX: 65.25 MIN: 15.4 / MAX: 43.41 MIN: 40.71 / MAX: 53.89 MIN: 31.6 / MAX: 43.65 MIN: 30.55 / MAX: 55.87 MIN: 19.63 / MAX: 40.77 Result Confidence
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12 24 36 48 60 Min: 56.2 / Avg: 56.44 / Max: 56.58 Min: 37.32 / Avg: 37.55 / Max: 37.96 Min: 62.94 / Avg: 63.3 / Max: 63.6 Min: 38.66 / Avg: 40.83 / Max: 41.99 Min: 49.89 / Avg: 51.05 / Max: 52.38 Min: 41.16 / Avg: 41.65 / Max: 42.05 Min: 48.81 / Avg: 51.86 / Max: 54.88 Min: 35.44 / Avg: 37.84 / Max: 39.47
LuxCoreRender LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: LuxCore Benchmark - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.17, N = 12 SE +/- 0.03, N = 3 SE +/- 0.22, N = 12 SE +/- 0.05, N = 3 SE +/- 0.16, N = 15 7.10 8.82 8.06 8.88 6.30 6.81 6.82 7.41 MIN: 3.06 / MAX: 8.2 MIN: 3.72 / MAX: 10.41 MIN: 3.62 / MAX: 9.37 MIN: 3.73 / MAX: 11.48 MIN: 2.53 / MAX: 7.3 MIN: 2.55 / MAX: 9.19 MIN: 2.81 / MAX: 7.94 MIN: 2.67 / MAX: 9.42 Result Confidence
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: LuxCore Benchmark - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 7.04 / Avg: 7.1 / Max: 7.17 Min: 8.61 / Avg: 8.82 / Max: 9.04 Min: 7.95 / Avg: 8.06 / Max: 8.28 Min: 8.28 / Avg: 8.88 / Max: 10.13 Min: 6.25 / Avg: 6.3 / Max: 6.34 Min: 6.05 / Avg: 6.81 / Max: 7.91 Min: 6.74 / Avg: 6.82 / Max: 6.91 Min: 6.33 / Avg: 7.41 / Max: 8.21
OpenFOAM OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Execution Time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 100 200 300 400 500 420.65 196.50 302.06 137.04 440.83 201.11 410.29 186.33 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Mesh Time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 160.73 162.03 148.40 139.62 153.12 134.78 150.67 159.31 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
PostgreSQL This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 14.04 14.86 13.26 30.20 14.29 16.96 13.85 16.66 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm Result Confidence
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 Min: 14.01 / Avg: 14.04 / Max: 14.06 Min: 14.8 / Avg: 14.86 / Max: 14.89 Min: 13.22 / Avg: 13.26 / Max: 13.33 Min: 30.02 / Avg: 30.2 / Max: 30.35 Min: 14.27 / Avg: 14.29 / Max: 14.33 Min: 16.87 / Avg: 16.96 / Max: 17.07 Min: 13.81 / Avg: 13.85 / Max: 13.9 Min: 16.43 / Avg: 16.66 / Max: 16.85 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Result
OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 16K 32K 48K 64K 80K SE +/- 78.02, N = 3 SE +/- 137.82, N = 3 SE +/- 198.41, N = 3 SE +/- 106.16, N = 3 SE +/- 95.84, N = 3 SE +/- 195.77, N = 3 SE +/- 143.25, N = 3 SE +/- 440.63, N = 3 71227 67315 75396 33110 69969 58952 72225 60046 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm Result Confidence
OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 13K 26K 39K 52K 65K Min: 71104.9 / Avg: 71227.06 / Max: 71372.21 Min: 67177.04 / Avg: 67315.11 / Max: 67590.75 Min: 75004.67 / Avg: 75396.07 / Max: 75648.36 Min: 32945.41 / Avg: 33110.04 / Max: 33308.47 Min: 69776.9 / Avg: 69968.58 / Max: 70064.85 Min: 58590 / Avg: 58952.17 / Max: 59262.11 Min: 71942.13 / Avg: 72225.43 / Max: 72404.01 Min: 59344.37 / Avg: 60046.43 / Max: 60858.76 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenRadioss OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Rubber O-Ring Seal Installation Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.12, N = 3 SE +/- 0.06, N = 3 SE +/- 0.34, N = 3 SE +/- 0.72, N = 8 SE +/- 0.60, N = 3 SE +/- 0.02, N = 3 SE +/- 0.32, N = 3 SE +/- 0.51, N = 15 59.91 88.39 54.14 86.85 59.58 70.73 59.32 81.65 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Rubber O-Ring Seal Installation Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 Min: 59.67 / Avg: 59.91 / Max: 60.07 Min: 88.33 / Avg: 88.39 / Max: 88.51 Min: 53.72 / Avg: 54.14 / Max: 54.82 Min: 85.84 / Avg: 86.85 / Max: 91.84 Min: 58.81 / Avg: 59.58 / Max: 60.75 Min: 70.69 / Avg: 70.73 / Max: 70.76 Min: 58.96 / Avg: 59.32 / Max: 59.96 Min: 80.69 / Avg: 81.65 / Max: 87.41
Result
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: INIVOL and Fluid Structure Interaction Drop Container Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 SE +/- 0.19, N = 3 SE +/- 0.17, N = 3 SE +/- 0.12, N = 3 SE +/- 0.30, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.09, N = 3 140.43 107.36 128.74 100.00 160.56 114.29 146.03 110.56 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: INIVOL and Fluid Structure Interaction Drop Container Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 Min: 140.15 / Avg: 140.43 / Max: 140.8 Min: 107.19 / Avg: 107.36 / Max: 107.69 Min: 128.51 / Avg: 128.74 / Max: 128.94 Min: 99.46 / Avg: 100 / Max: 100.48 Min: 160.43 / Avg: 160.56 / Max: 160.7 Min: 114.19 / Avg: 114.29 / Max: 114.42 Min: 145.92 / Avg: 146.03 / Max: 146.11 Min: 110.44 / Avg: 110.56 / Max: 110.74
Zstd Compression This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Decompression Speed Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 300 600 900 1200 1500 SE +/- 0.43, N = 3 SE +/- 3.69, N = 3 SE +/- 0.84, N = 3 SE +/- 1.60, N = 3 SE +/- 0.56, N = 3 SE +/- 1.00, N = 3 SE +/- 1.45, N = 3 SE +/- 1.78, N = 15 1069.1 992.1 1242.6 1189.7 1131.1 1041.8 1133.3 1046.0 1. (CC) gcc options: -O3 -pthread -lz -llzma Result Confidence
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Decompression Speed Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 200 400 600 800 1000 Min: 1068.2 / Avg: 1069.07 / Max: 1069.5 Min: 988 / Avg: 992.13 / Max: 999.5 Min: 1241.7 / Avg: 1242.63 / Max: 1244.3 Min: 1186.5 / Avg: 1189.67 / Max: 1191.6 Min: 1130.3 / Avg: 1131.13 / Max: 1132.2 Min: 1040.5 / Avg: 1041.83 / Max: 1043.8 Min: 1131.3 / Avg: 1133.27 / Max: 1136.1 Min: 1022.2 / Avg: 1046.02 / Max: 1050.8 1. (CC) gcc options: -O3 -pthread -lz -llzma
Result
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Compression Speed Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 15 7.94 8.16 9.80 9.67 7.76 7.62 7.72 7.46 1. (CC) gcc options: -O3 -pthread -lz -llzma Result Confidence
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Compression Speed Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 7.91 / Avg: 7.94 / Max: 7.99 Min: 8.06 / Avg: 8.16 / Max: 8.23 Min: 9.73 / Avg: 9.8 / Max: 9.89 Min: 9.59 / Avg: 9.67 / Max: 9.72 Min: 7.69 / Avg: 7.76 / Max: 7.81 Min: 7.58 / Avg: 7.62 / Max: 7.67 Min: 7.69 / Avg: 7.72 / Max: 7.78 Min: 6.93 / Avg: 7.46 / Max: 7.82 1. (CC) gcc options: -O3 -pthread -lz -llzma
Timed Godot Game Engine Compilation This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed Godot Game Engine Compilation 4.0 Time To Compile Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 SE +/- 0.76, N = 3 SE +/- 0.56, N = 3 SE +/- 0.91, N = 3 SE +/- 0.29, N = 3 SE +/- 0.18, N = 3 SE +/- 0.56, N = 3 SE +/- 0.32, N = 3 SE +/- 1.69, N = 3 140.23 118.57 122.72 103.38 149.38 123.88 143.81 122.70 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Timed Godot Game Engine Compilation 4.0 Time To Compile Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 Min: 138.79 / Avg: 140.23 / Max: 141.34 Min: 117.47 / Avg: 118.57 / Max: 119.27 Min: 121.35 / Avg: 122.72 / Max: 124.45 Min: 102.83 / Avg: 103.38 / Max: 103.79 Min: 149.02 / Avg: 149.38 / Max: 149.59 Min: 123.06 / Avg: 123.88 / Max: 124.94 Min: 143.2 / Avg: 143.81 / Max: 144.31 Min: 120.06 / Avg: 122.7 / Max: 125.86
Xmrig Xmrig is an open-source cross-platform CPU/GPU miner for RandomX, KawPow, CryptoNight and AstroBWT. This test profile is setup to measure the Xmrig CPU mining performance. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: GhostRider - Hash Count: 1M Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3K 6K 9K 12K 15K SE +/- 23.16, N = 3 SE +/- 4.03, N = 3 SE +/- 44.68, N = 3 SE +/- 64.69, N = 3 SE +/- 12.93, N = 3 SE +/- 14.02, N = 3 SE +/- 14.78, N = 3 SE +/- 7.44, N = 3 5808.8 11263.2 8378.3 16324.7 5446.8 10975.8 6122.3 12115.0 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc Result Confidence
OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: GhostRider - Hash Count: 1M Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3K 6K 9K 12K 15K Min: 5783.9 / Avg: 5808.83 / Max: 5855.1 Min: 11256.6 / Avg: 11263.17 / Max: 11270.5 Min: 8302.5 / Avg: 8378.33 / Max: 8457.2 Min: 16244.8 / Avg: 16324.73 / Max: 16452.8 Min: 5428.9 / Avg: 5446.77 / Max: 5471.9 Min: 10950.9 / Avg: 10975.83 / Max: 10999.4 Min: 6093.4 / Avg: 6122.3 / Max: 6142.1 Min: 12100.2 / Avg: 12115 / Max: 12123.7 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
TensorFlow Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: GoogLeNet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 120 240 360 480 600 SE +/- 0.34, N = 3 SE +/- 2.62, N = 3 SE +/- 3.68, N = 3 SE +/- 1.52, N = 3 SE +/- 0.41, N = 3 SE +/- 1.14, N = 3 SE +/- 0.37, N = 3 SE +/- 2.46, N = 3 461.23 576.08 462.78 577.76 383.57 467.91 398.40 477.33 Result Confidence
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: GoogLeNet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 100 200 300 400 500 Min: 460.79 / Avg: 461.23 / Max: 461.9 Min: 572.84 / Avg: 576.08 / Max: 581.26 Min: 455.42 / Avg: 462.78 / Max: 466.49 Min: 575.91 / Avg: 577.76 / Max: 580.78 Min: 382.75 / Avg: 383.57 / Max: 384.07 Min: 465.67 / Avg: 467.91 / Max: 469.37 Min: 397.73 / Avg: 398.4 / Max: 398.99 Min: 473.08 / Avg: 477.33 / Max: 481.61
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.3867 0.7734 1.1601 1.5468 1.9335 SE +/- 0.01594, N = 3 SE +/- 0.01405, N = 15 SE +/- 0.00291, N = 3 SE +/- 0.01541, N = 3 SE +/- 0.02719, N = 15 SE +/- 0.00498, N = 3 SE +/- 0.01456, N = 3 SE +/- 0.01853, N = 5 1.17292 1.43573 1.10042 1.32454 1.37831 1.65270 1.41662 1.71875 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 1.15 / Avg: 1.17 / Max: 1.2 Min: 1.39 / Avg: 1.44 / Max: 1.58 Min: 1.09 / Avg: 1.1 / Max: 1.1 Min: 1.29 / Avg: 1.32 / Max: 1.34 Min: 1.31 / Avg: 1.38 / Max: 1.63 Min: 1.64 / Avg: 1.65 / Max: 1.66 Min: 1.39 / Avg: 1.42 / Max: 1.43 Min: 1.67 / Avg: 1.72 / Max: 1.78 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 200 400 600 800 1000 SE +/- 11.46, N = 3 SE +/- 6.50, N = 15 SE +/- 2.43, N = 3 SE +/- 8.88, N = 3 SE +/- 12.91, N = 15 SE +/- 1.83, N = 3 SE +/- 7.34, N = 3 SE +/- 6.21, N = 5 852.33 696.98 908.19 754.81 728.47 604.76 705.61 581.77 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.3867 0.7734 1.1601 1.5468 1.9335 SE +/- 0.01594, N = 3 SE +/- 0.01405, N = 15 SE +/- 0.00291, N = 3 SE +/- 0.01541, N = 3 SE +/- 0.02719, N = 15 SE +/- 0.00498, N = 3 SE +/- 0.01456, N = 3 SE +/- 0.01853, N = 5 1.17292 1.43573 1.10042 1.32454 1.37831 1.65270 1.41662 1.71875 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 160 320 480 640 800 Min: 830.17 / Avg: 852.33 / Max: 868.51 Min: 631.49 / Avg: 696.98 / Max: 720.32 Min: 904.5 / Avg: 908.19 / Max: 912.79 Min: 744.33 / Avg: 754.81 / Max: 772.47 Min: 611.13 / Avg: 728.47 / Max: 762.65 Min: 602.3 / Avg: 604.76 / Max: 608.34 Min: 696.95 / Avg: 705.61 / Max: 720.19 Min: 561.07 / Avg: 581.77 / Max: 598.93 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.03075, N = 3 SE +/- 0.03218, N = 3 SE +/- 0.01631, N = 3 SE +/- 0.15083, N = 15 SE +/- 0.06596, N = 15 SE +/- 0.02902, N = 3 SE +/- 0.06620, N = 3 SE +/- 0.06105, N = 3 4.49976 5.55101 3.69649 4.29531 5.67700 7.04111 5.91961 7.53259 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 4.45 / Avg: 4.5 / Max: 4.56 Min: 5.49 / Avg: 5.55 / Max: 5.6 Min: 3.68 / Avg: 3.7 / Max: 3.73 Min: 3.71 / Avg: 4.3 / Max: 5.01 Min: 5.34 / Avg: 5.68 / Max: 6.16 Min: 6.98 / Avg: 7.04 / Max: 7.08 Min: 5.84 / Avg: 5.92 / Max: 6.05 Min: 7.41 / Avg: 7.53 / Max: 7.6 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 60 120 180 240 300 SE +/- 1.50, N = 3 SE +/- 1.05, N = 3 SE +/- 1.19, N = 3 SE +/- 8.14, N = 15 SE +/- 2.01, N = 15 SE +/- 0.58, N = 3 SE +/- 1.88, N = 3 SE +/- 1.08, N = 3 222.03 180.03 270.33 236.65 176.33 141.95 168.86 132.71 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.03075, N = 3 SE +/- 0.03218, N = 3 SE +/- 0.01631, N = 3 SE +/- 0.15083, N = 15 SE +/- 0.06596, N = 15 SE +/- 0.02902, N = 3 SE +/- 0.06620, N = 3 SE +/- 0.06105, N = 3 4.49976 5.55101 3.69649 4.29531 5.67700 7.04111 5.91961 7.53259 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50 100 150 200 250 Min: 219.24 / Avg: 222.03 / Max: 224.4 Min: 178.44 / Avg: 180.03 / Max: 182 Min: 267.97 / Avg: 270.33 / Max: 271.72 Min: 199.33 / Avg: 236.65 / Max: 269.01 Min: 162.19 / Avg: 176.33 / Max: 187.26 Min: 141.15 / Avg: 141.95 / Max: 143.09 Min: 165.14 / Avg: 168.86 / Max: 171.13 Min: 131.45 / Avg: 132.71 / Max: 134.87 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.9132 1.8264 2.7396 3.6528 4.566 SE +/- 0.00807, N = 3 SE +/- 0.04801, N = 3 SE +/- 0.01801, N = 3 SE +/- 0.01381, N = 3 SE +/- 0.03338, N = 15 SE +/- 0.04072, N = 3 SE +/- 0.01443, N = 3 SE +/- 0.02633, N = 15 3.06500 4.05881 2.15980 2.81739 2.97094 4.05270 2.88734 3.95819 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 3.05 / Avg: 3.07 / Max: 3.08 Min: 3.96 / Avg: 4.06 / Max: 4.12 Min: 2.14 / Avg: 2.16 / Max: 2.19 Min: 2.79 / Avg: 2.82 / Max: 2.84 Min: 2.87 / Avg: 2.97 / Max: 3.37 Min: 4.01 / Avg: 4.05 / Max: 4.13 Min: 2.86 / Avg: 2.89 / Max: 2.91 Min: 3.8 / Avg: 3.96 / Max: 4.17 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 100 200 300 400 500 SE +/- 0.86, N = 3 SE +/- 2.94, N = 3 SE +/- 3.84, N = 3 SE +/- 1.73, N = 3 SE +/- 3.48, N = 15 SE +/- 2.44, N = 3 SE +/- 1.74, N = 3 SE +/- 1.67, N = 15 326.14 246.34 462.86 354.75 337.00 246.68 346.21 252.67 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.9132 1.8264 2.7396 3.6528 4.566 SE +/- 0.00807, N = 3 SE +/- 0.04801, N = 3 SE +/- 0.01801, N = 3 SE +/- 0.01381, N = 3 SE +/- 0.03338, N = 15 SE +/- 0.04072, N = 3 SE +/- 0.01443, N = 3 SE +/- 0.02633, N = 15 3.06500 4.05881 2.15980 2.81739 2.97094 4.05270 2.88734 3.95819 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 80 160 240 320 400 Min: 324.75 / Avg: 326.14 / Max: 327.7 Min: 242.46 / Avg: 246.33 / Max: 252.1 Min: 455.4 / Avg: 462.85 / Max: 468.18 Min: 351.82 / Avg: 354.75 / Max: 357.8 Min: 296.9 / Avg: 337 / Max: 348.81 Min: 241.81 / Avg: 246.68 / Max: 249.47 Min: 343.93 / Avg: 346.21 / Max: 349.63 Min: 239.84 / Avg: 252.67 / Max: 263.27 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenRadioss OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Bird Strike on Windshield Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 SE +/- 0.24, N = 3 SE +/- 0.29, N = 3 SE +/- 0.14, N = 3 SE +/- 0.83, N = 3 SE +/- 0.45, N = 3 SE +/- 0.69, N = 3 SE +/- 0.03, N = 3 SE +/- 0.38, N = 3 117.41 124.44 110.32 113.15 126.89 116.49 120.76 119.03 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Bird Strike on Windshield Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 Min: 117.04 / Avg: 117.41 / Max: 117.85 Min: 123.87 / Avg: 124.44 / Max: 124.79 Min: 110.04 / Avg: 110.32 / Max: 110.47 Min: 112.09 / Avg: 113.15 / Max: 114.79 Min: 126.21 / Avg: 126.89 / Max: 127.74 Min: 115.65 / Avg: 116.49 / Max: 117.86 Min: 120.72 / Avg: 120.76 / Max: 120.82 Min: 118.46 / Avg: 119.03 / Max: 119.76
QMCPACK QMCPACK is a modern high-performance open-source Quantum Monte Carlo (QMC) simulation code making use of MPI for this benchmark of the H20 example code. QMCPACK is an open-source production level many-body ab initio Quantum Monte Carlo code for computing the electronic structure of atoms, molecules, and solids. QMCPACK is supported by the U.S. Department of Energy. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Total Execution Time - Seconds, Fewer Is Better QMCPACK 3.17.1 Input: Li2_STO_ae Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 SE +/- 0.89, N = 3 SE +/- 1.11, N = 3 SE +/- 1.03, N = 3 SE +/- 0.93, N = 3 SE +/- 1.20, N = 3 SE +/- 0.88, N = 3 SE +/- 1.04, N = 3 SE +/- 1.11, N = 5 109.30 101.63 105.98 97.91 121.19 102.12 117.81 106.27 1. (CXX) g++ options: -fopenmp -foffload=disable -finline-limit=1000 -fstrict-aliasing -funroll-all-loops -ffast-math -march=native -O3 -lm -ldl Result Confidence
OpenBenchmarking.org Total Execution Time - Seconds, Fewer Is Better QMCPACK 3.17.1 Input: Li2_STO_ae Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 Min: 107.57 / Avg: 109.3 / Max: 110.52 Min: 99.85 / Avg: 101.63 / Max: 103.68 Min: 104.67 / Avg: 105.98 / Max: 108.02 Min: 96.04 / Avg: 97.91 / Max: 98.88 Min: 119.44 / Avg: 121.19 / Max: 123.49 Min: 101.06 / Avg: 102.12 / Max: 103.88 Min: 116.12 / Avg: 117.81 / Max: 119.69 Min: 103.79 / Avg: 106.27 / Max: 109.86 1. (CXX) g++ options: -fopenmp -foffload=disable -finline-limit=1000 -fstrict-aliasing -funroll-all-loops -ffast-math -march=native -O3 -lm -ldl
Appleseed Appleseed is an open-source production renderer focused on physically-based global illumination rendering engine primarily designed for animation and visual effects. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Appleseed 2.0 Beta Scene: Material Tester Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50 100 150 200 250 126.15 225.35 118.78 210.82 136.49 243.24 134.39 239.73
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 SE +/- 0.06, N = 3 SE +/- 0.36, N = 3 SE +/- 0.19, N = 3 SE +/- 0.39, N = 13 SE +/- 0.32, N = 15 SE +/- 0.21, N = 3 SE +/- 0.33, N = 3 SE +/- 0.18, N = 3 18.93 27.59 15.04 26.09 21.22 24.65 23.66 29.44 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 Min: 18.82 / Avg: 18.93 / Max: 19.03 Min: 27.04 / Avg: 27.59 / Max: 28.28 Min: 14.84 / Avg: 15.04 / Max: 15.42 Min: 25.2 / Avg: 26.09 / Max: 30.7 Min: 19.95 / Avg: 21.22 / Max: 23.38 Min: 24.3 / Avg: 24.65 / Max: 25.02 Min: 23.2 / Avg: 23.66 / Max: 24.31 Min: 29.12 / Avg: 29.44 / Max: 29.73 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 15 30 45 60 75 SE +/- 0.16, N = 3 SE +/- 0.48, N = 3 SE +/- 0.82, N = 3 SE +/- 0.51, N = 13 SE +/- 0.69, N = 15 SE +/- 0.34, N = 3 SE +/- 0.59, N = 3 SE +/- 0.21, N = 3 52.82 36.25 66.52 38.42 47.27 40.57 42.27 33.96 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 SE +/- 0.06, N = 3 SE +/- 0.36, N = 3 SE +/- 0.19, N = 3 SE +/- 0.39, N = 13 SE +/- 0.32, N = 15 SE +/- 0.21, N = 3 SE +/- 0.33, N = 3 SE +/- 0.18, N = 3 18.93 27.59 15.04 26.09 21.22 24.65 23.66 29.44 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 13 26 39 52 65 Min: 52.55 / Avg: 52.82 / Max: 53.12 Min: 35.36 / Avg: 36.25 / Max: 36.98 Min: 64.87 / Avg: 66.52 / Max: 67.36 Min: 32.57 / Avg: 38.42 / Max: 39.68 Min: 42.77 / Avg: 47.27 / Max: 50.13 Min: 39.96 / Avg: 40.57 / Max: 41.14 Min: 41.14 / Avg: 42.27 / Max: 43.1 Min: 33.63 / Avg: 33.96 / Max: 34.34 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OSPRay Result
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 10 20 30 40 50 SE +/- 0.10, N = 3 SE +/- 0.11, N = 3 SE +/- 0.05, N = 3 SE +/- 0.36, N = 3 SE +/- 0.17, N = 3 SE +/- 0.22, N = 3 SE +/- 0.18, N = 15 SE +/- 0.32, N = 15 19.85 36.15 23.73 42.13 15.40 15.98 16.32 15.37 Result Confidence
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 Min: 19.65 / Avg: 19.85 / Max: 19.96 Min: 35.95 / Avg: 36.15 / Max: 36.34 Min: 23.64 / Avg: 23.73 / Max: 23.83 Min: 41.69 / Avg: 42.13 / Max: 42.84 Min: 15.14 / Avg: 15.4 / Max: 15.73 Min: 15.66 / Avg: 15.98 / Max: 16.41 Min: 14.99 / Avg: 16.32 / Max: 17.9 Min: 14.24 / Avg: 15.37 / Max: 18.6
Result
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/ao/real_time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12 24 36 48 60 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 21.93 38.22 30.84 54.12 16.05 29.50 18.55 33.11 Result Confidence
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/ao/real_time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11 22 33 44 55 Min: 21.91 / Avg: 21.93 / Max: 21.95 Min: 38.18 / Avg: 38.22 / Max: 38.25 Min: 30.82 / Avg: 30.84 / Max: 30.85 Min: 53.98 / Avg: 54.12 / Max: 54.23 Min: 15.99 / Avg: 16.05 / Max: 16.11 Min: 29.46 / Avg: 29.5 / Max: 29.53 Min: 18.53 / Avg: 18.55 / Max: 18.57 Min: 33.11 / Avg: 33.11 / Max: 33.12
oneDNN Result
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Recurrent Neural Network Training - Engine: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 600 1200 1800 2400 3000 SE +/- 0.67, N = 3 SE +/- 2.79, N = 3 SE +/- 5.57, N = 3 SE +/- 4.22, N = 3 SE +/- 12.69, N = 3 SE +/- 119.20, N = 12 SE +/- 8.14, N = 3 SE +/- 31.34, N = 3 623.60 635.15 703.47 626.14 1200.75 1966.88 1180.85 2776.52 MIN: 598.72 MIN: 612.85 MIN: 649.83 MIN: 600.37 MIN: 1127.94 MIN: 1146.52 MIN: 1153.29 MIN: 2715.64 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread Result Confidence
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Recurrent Neural Network Training - Engine: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 500 1000 1500 2000 2500 Min: 622.81 / Avg: 623.6 / Max: 624.93 Min: 629.62 / Avg: 635.15 / Max: 638.51 Min: 692.78 / Avg: 703.47 / Max: 711.52 Min: 617.73 / Avg: 626.14 / Max: 630.93 Min: 1175.76 / Avg: 1200.75 / Max: 1217.11 Min: 1402.73 / Avg: 1966.88 / Max: 2602.69 Min: 1172.61 / Avg: 1180.85 / Max: 1197.12 Min: 2732.93 / Avg: 2776.52 / Max: 2837.32 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Speedb Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Read While Writing Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4M 8M 12M 16M 20M SE +/- 62510.72, N = 3 SE +/- 239363.92, N = 3 SE +/- 143570.67, N = 4 SE +/- 195912.00, N = 15 SE +/- 88257.34, N = 3 SE +/- 171807.74, N = 3 SE +/- 93731.24, N = 7 SE +/- 197596.27, N = 3 10695360 17297027 12168413 17585737 8795408 13859254 9988176 15354400 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread Result Confidence
OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Read While Writing Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3M 6M 9M 12M 15M Min: 10620683 / Avg: 10695359.67 / Max: 10819533 Min: 16836096 / Avg: 17297027.33 / Max: 17639484 Min: 11766394 / Avg: 12168412.75 / Max: 12413695 Min: 16371972 / Avg: 17585736.6 / Max: 19279365 Min: 8642809 / Avg: 8795407.67 / Max: 8948540 Min: 13643803 / Avg: 13859254 / Max: 14198797 Min: 9687263 / Avg: 9988176.43 / Max: 10411581 Min: 15030824 / Avg: 15354399.67 / Max: 15712674 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Memcached Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.19 Set To Get Ratio: 1:100 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1000K 2000K 3000K 4000K 5000K SE +/- 25335.31, N = 3 SE +/- 50660.01, N = 15 SE +/- 35182.67, N = 3 SE +/- 35300.21, N = 3 SE +/- 21428.06, N = 3 SE +/- 26891.33, N = 3 SE +/- 52575.97, N = 3 SE +/- 24083.78, N = 3 4481667.95 3245908.40 4752673.79 3780240.56 4384040.52 3373323.92 4315467.17 3392842.38 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre Result Confidence
OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.19 Set To Get Ratio: 1:100 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 800K 1600K 2400K 3200K 4000K Min: 4432195.38 / Avg: 4481667.95 / Max: 4515890.16 Min: 2978749.57 / Avg: 3245908.4 / Max: 3602162.86 Min: 4682633.04 / Avg: 4752673.79 / Max: 4793540.69 Min: 3727174.59 / Avg: 3780240.56 / Max: 3847101.16 Min: 4341203.5 / Avg: 4384040.52 / Max: 4406567.27 Min: 3327832.66 / Avg: 3373323.92 / Max: 3420915.87 Min: 4241023.34 / Avg: 4315467.17 / Max: 4417003.03 Min: 3344835.19 / Avg: 3392842.38 / Max: 3420247.08 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
DaCapo Benchmark This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Tradesoap Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1600 3200 4800 6400 8000 SE +/- 29.41, N = 3 SE +/- 31.29, N = 3 SE +/- 57.43, N = 15 SE +/- 52.55, N = 15 SE +/- 36.36, N = 15 SE +/- 48.92, N = 14 SE +/- 40.72, N = 15 SE +/- 48.60, N = 15 4115 4215 7321 7492 3887 4199 3884 4069 Result Confidence
OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Tradesoap Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1300 2600 3900 5200 6500 Min: 4057 / Avg: 4115.33 / Max: 4151 Min: 4164 / Avg: 4215.33 / Max: 4272 Min: 7102 / Avg: 7321.07 / Max: 7802 Min: 7157 / Avg: 7492 / Max: 7837 Min: 3624 / Avg: 3886.8 / Max: 4141 Min: 3958 / Avg: 4199.14 / Max: 4643 Min: 3653 / Avg: 3884.33 / Max: 4183 Min: 3856 / Avg: 4068.53 / Max: 4528
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.01810, N = 3 SE +/- 0.03225, N = 3 SE +/- 0.02572, N = 3 SE +/- 0.01358, N = 3 SE +/- 0.02187, N = 3 SE +/- 0.09530, N = 15 SE +/- 0.03815, N = 5 SE +/- 0.06816, N = 3 3.17002 5.62517 3.18392 5.83954 3.02897 5.74491 3.37034 6.17796 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 3.14 / Avg: 3.17 / Max: 3.2 Min: 5.58 / Avg: 5.63 / Max: 5.69 Min: 3.15 / Avg: 3.18 / Max: 3.23 Min: 5.81 / Avg: 5.84 / Max: 5.85 Min: 2.99 / Avg: 3.03 / Max: 3.06 Min: 5.38 / Avg: 5.74 / Max: 6.53 Min: 3.28 / Avg: 3.37 / Max: 3.51 Min: 6.07 / Avg: 6.18 / Max: 6.31 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 70 140 210 280 350 SE +/- 1.80, N = 3 SE +/- 1.01, N = 3 SE +/- 2.52, N = 3 SE +/- 0.40, N = 3 SE +/- 2.40, N = 3 SE +/- 2.72, N = 15 SE +/- 3.31, N = 5 SE +/- 1.78, N = 3 315.41 177.76 314.06 171.23 330.10 174.68 296.80 161.89 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.01810, N = 3 SE +/- 0.03225, N = 3 SE +/- 0.02572, N = 3 SE +/- 0.01358, N = 3 SE +/- 0.02187, N = 3 SE +/- 0.09530, N = 15 SE +/- 0.03815, N = 5 SE +/- 0.06816, N = 3 3.17002 5.62517 3.18392 5.83954 3.02897 5.74491 3.37034 6.17796 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 60 120 180 240 300 Min: 312.56 / Avg: 315.41 / Max: 318.75 Min: 175.79 / Avg: 177.76 / Max: 179.16 Min: 309.09 / Avg: 314.06 / Max: 317.25 Min: 170.81 / Avg: 171.23 / Max: 172.03 Min: 327.17 / Avg: 330.1 / Max: 334.85 Min: 153.07 / Avg: 174.68 / Max: 185.97 Min: 285.12 / Avg: 296.8 / Max: 305.13 Min: 158.56 / Avg: 161.89 / Max: 164.63 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1.1255 2.251 3.3765 4.502 5.6275 SE +/- 0.00313, N = 3 SE +/- 0.10855, N = 15 SE +/- 0.00044, N = 3 SE +/- 0.05342, N = 3 SE +/- 0.00187, N = 3 SE +/- 0.05347, N = 4 SE +/- 0.00532, N = 3 SE +/- 0.02558, N = 3 4.39649 4.72530 3.85774 3.98013 4.58912 4.85818 4.67269 5.00222 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 4.39 / Avg: 4.4 / Max: 4.4 Min: 4.41 / Avg: 4.73 / Max: 6.01 Min: 3.86 / Avg: 3.86 / Max: 3.86 Min: 3.88 / Avg: 3.98 / Max: 4.07 Min: 4.59 / Avg: 4.59 / Max: 4.59 Min: 4.71 / Avg: 4.86 / Max: 4.95 Min: 4.66 / Avg: 4.67 / Max: 4.68 Min: 4.98 / Avg: 5 / Max: 5.05 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 60 120 180 240 300 SE +/- 0.16, N = 3 SE +/- 4.15, N = 15 SE +/- 0.03, N = 3 SE +/- 3.39, N = 3 SE +/- 0.09, N = 3 SE +/- 2.30, N = 4 SE +/- 0.25, N = 3 SE +/- 1.02, N = 3 227.42 212.92 259.19 251.31 217.88 205.89 213.99 199.90 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1.1255 2.251 3.3765 4.502 5.6275 SE +/- 0.00313, N = 3 SE +/- 0.10855, N = 15 SE +/- 0.00044, N = 3 SE +/- 0.05342, N = 3 SE +/- 0.00187, N = 3 SE +/- 0.05347, N = 4 SE +/- 0.00532, N = 3 SE +/- 0.02558, N = 3 4.39649 4.72530 3.85774 3.98013 4.58912 4.85818 4.67269 5.00222 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50 100 150 200 250 Min: 227.12 / Avg: 227.42 / Max: 227.66 Min: 166.26 / Avg: 212.92 / Max: 226.64 Min: 259.13 / Avg: 259.19 / Max: 259.22 Min: 245.94 / Avg: 251.3 / Max: 257.58 Min: 217.72 / Avg: 217.88 / Max: 218.03 Min: 201.86 / Avg: 205.88 / Max: 212.41 Min: 213.65 / Avg: 213.99 / Max: 214.46 Min: 197.86 / Avg: 199.9 / Max: 200.92 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
PyTorch Result
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 6 12 18 24 30 SE +/- 0.09, N = 3 SE +/- 0.16, N = 4 SE +/- 0.08, N = 3 SE +/- 0.19, N = 5 SE +/- 0.26, N = 3 SE +/- 0.18, N = 3 SE +/- 0.16, N = 3 SE +/- 0.13, N = 8 19.41 15.77 27.21 17.57 19.99 17.91 18.07 14.86 MIN: 14.68 / MAX: 22.3 MIN: 8.33 / MAX: 16.91 MIN: 13.91 / MAX: 28.31 MIN: 5.14 / MAX: 18.58 MIN: 0.34 / MAX: 23.05 MIN: 5.47 / MAX: 18.9 MIN: 0.27 / MAX: 21.93 MIN: 0.53 / MAX: 17.18 Result Confidence
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 6 12 18 24 30 Min: 19.22 / Avg: 19.41 / Max: 19.51 Min: 15.42 / Avg: 15.77 / Max: 16.18 Min: 27.06 / Avg: 27.21 / Max: 27.32 Min: 16.94 / Avg: 17.57 / Max: 18.06 Min: 19.48 / Avg: 19.99 / Max: 20.28 Min: 17.56 / Avg: 17.91 / Max: 18.15 Min: 17.8 / Avg: 18.07 / Max: 18.35 Min: 14.16 / Avg: 14.86 / Max: 15.24
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 14 28 42 56 70 SE +/- 0.17, N = 3 SE +/- 0.62, N = 3 SE +/- 0.04, N = 3 SE +/- 0.44, N = 3 SE +/- 0.44, N = 3 SE +/- 0.68, N = 3 SE +/- 0.23, N = 3 SE +/- 1.12, N = 15 49.64 60.36 39.75 44.60 47.24 60.11 49.97 55.90 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12 24 36 48 60 Min: 49.44 / Avg: 49.64 / Max: 49.98 Min: 59.65 / Avg: 60.36 / Max: 61.59 Min: 39.7 / Avg: 39.75 / Max: 39.82 Min: 43.99 / Avg: 44.6 / Max: 45.45 Min: 46.39 / Avg: 47.24 / Max: 47.85 Min: 59.24 / Avg: 60.11 / Max: 61.46 Min: 49.68 / Avg: 49.97 / Max: 50.43 Min: 51.18 / Avg: 55.9 / Max: 62.25 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 6 12 18 24 30 SE +/- 0.07, N = 3 SE +/- 0.17, N = 3 SE +/- 0.02, N = 3 SE +/- 0.22, N = 3 SE +/- 0.20, N = 3 SE +/- 0.19, N = 3 SE +/- 0.09, N = 3 SE +/- 0.35, N = 15 20.15 16.57 25.16 22.43 21.17 16.64 20.01 17.99 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 14 28 42 56 70 SE +/- 0.17, N = 3 SE +/- 0.62, N = 3 SE +/- 0.04, N = 3 SE +/- 0.44, N = 3 SE +/- 0.44, N = 3 SE +/- 0.68, N = 3 SE +/- 0.23, N = 3 SE +/- 1.12, N = 15 49.64 60.36 39.75 44.60 47.24 60.11 49.97 55.90 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 6 12 18 24 30 Min: 20.01 / Avg: 20.15 / Max: 20.23 Min: 16.24 / Avg: 16.57 / Max: 16.76 Min: 25.11 / Avg: 25.16 / Max: 25.19 Min: 22 / Avg: 22.43 / Max: 22.73 Min: 20.9 / Avg: 21.17 / Max: 21.55 Min: 16.27 / Avg: 16.64 / Max: 16.88 Min: 19.83 / Avg: 20.01 / Max: 20.13 Min: 16.06 / Avg: 17.99 / Max: 19.54 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVINO Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.1103 0.2206 0.3309 0.4412 0.5515 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 15 0.43 0.29 0.49 0.46 0.33 0.28 0.37 0.30 MIN: 0.23 / MAX: 17.03 MIN: 0.24 / MAX: 39.69 MIN: 0.18 / MAX: 16.07 MIN: 0.18 / MAX: 22.29 MIN: 0.26 / MAX: 19.2 MIN: 0.25 / MAX: 41.4 MIN: 0.28 / MAX: 40.85 MIN: 0.26 / MAX: 42.1 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 0.43 / Avg: 0.43 / Max: 0.43 Min: 0.29 / Avg: 0.29 / Max: 0.29 Min: 0.49 / Avg: 0.49 / Max: 0.5 Min: 0.45 / Avg: 0.46 / Max: 0.47 Min: 0.33 / Avg: 0.33 / Max: 0.34 Min: 0.28 / Avg: 0.28 / Max: 0.29 Min: 0.36 / Avg: 0.37 / Max: 0.38 Min: 0.3 / Avg: 0.3 / Max: 0.31 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Result
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40K 80K 120K 160K 200K SE +/- 75.30, N = 3 SE +/- 2494.14, N = 3 SE +/- 988.12, N = 3 SE +/- 1158.60, N = 3 SE +/- 383.22, N = 3 SE +/- 18.38, N = 3 SE +/- 1761.33, N = 3 SE +/- 1422.88, N = 15 115106.30 189893.31 81279.79 128566.81 135075.07 174862.56 140144.01 176900.32 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30K 60K 90K 120K 150K Min: 115010.38 / Avg: 115106.3 / Max: 115254.8 Min: 186685.76 / Avg: 189893.31 / Max: 194805.55 Min: 79424.55 / Avg: 81279.79 / Max: 82797.06 Min: 126358.92 / Avg: 128566.81 / Max: 130279.86 Min: 134312.2 / Avg: 135075.07 / Max: 135520.49 Min: 174838.3 / Avg: 174862.56 / Max: 174898.6 Min: 136639.43 / Avg: 140144.01 / Max: 142204.97 Min: 168872.14 / Avg: 176900.32 / Max: 183917.68 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1.213 2.426 3.639 4.852 6.065 SE +/- 0.00659, N = 3 SE +/- 0.00316, N = 3 SE +/- 0.00472, N = 3 SE +/- 0.02371, N = 3 SE +/- 0.08827, N = 15 SE +/- 0.03283, N = 3 SE +/- 0.01103, N = 3 SE +/- 0.02608, N = 3 2.79694 3.46571 2.16966 2.80263 4.57581 5.02267 4.64757 5.39123 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 2.78 / Avg: 2.8 / Max: 2.8 Min: 3.46 / Avg: 3.47 / Max: 3.47 Min: 2.16 / Avg: 2.17 / Max: 2.18 Min: 2.76 / Avg: 2.8 / Max: 2.85 Min: 4.3 / Avg: 4.58 / Max: 5.28 Min: 4.96 / Avg: 5.02 / Max: 5.06 Min: 4.63 / Avg: 4.65 / Max: 4.67 Min: 5.36 / Avg: 5.39 / Max: 5.44 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 100 200 300 400 500 SE +/- 0.84, N = 3 SE +/- 0.26, N = 3 SE +/- 1.00, N = 3 SE +/- 3.01, N = 3 SE +/- 3.95, N = 15 SE +/- 1.31, N = 3 SE +/- 0.51, N = 3 SE +/- 0.89, N = 3 357.36 288.47 460.78 356.76 219.53 199.08 215.13 185.46 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1.213 2.426 3.639 4.852 6.065 SE +/- 0.00659, N = 3 SE +/- 0.00316, N = 3 SE +/- 0.00472, N = 3 SE +/- 0.02371, N = 3 SE +/- 0.08827, N = 15 SE +/- 0.03283, N = 3 SE +/- 0.01103, N = 3 SE +/- 0.02608, N = 3 2.79694 3.46571 2.16966 2.80263 4.57581 5.02267 4.64757 5.39123 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 80 160 240 320 400 Min: 356.49 / Avg: 357.35 / Max: 359.04 Min: 287.98 / Avg: 288.47 / Max: 288.88 Min: 459 / Avg: 460.78 / Max: 462.47 Min: 351.26 / Avg: 356.76 / Max: 361.65 Min: 189.44 / Avg: 219.53 / Max: 232.62 Min: 197.61 / Avg: 199.08 / Max: 201.68 Min: 214.14 / Avg: 215.13 / Max: 215.81 Min: 183.72 / Avg: 185.46 / Max: 186.68 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Timed CPython Compilation This test times how long it takes to build the reference Python implementation, CPython, with optimizations and LTO enabled for a release build. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Timed CPython Compilation 3.10.6 Build Configuration: Released Build, PGO + LTO Optimized Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 60 120 180 240 300 277.39 279.69 244.82 244.95 275.39 276.46 273.52 276.23
Appleseed Appleseed is an open-source production renderer focused on physically-based global illumination rendering engine primarily designed for animation and visual effects. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Appleseed 2.0 Beta Scene: Emily Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 120.75 130.62 119.80 129.96 132.13 137.46 128.60 137.00
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 100 200 300 400 500 SE +/- 0.94, N = 3 SE +/- 0.96, N = 3 SE +/- 0.74, N = 3 SE +/- 4.07, N = 3 SE +/- 1.73, N = 3 SE +/- 5.57, N = 13 SE +/- 2.21, N = 3 SE +/- 6.06, N = 3 329.04 352.74 302.27 327.88 380.90 460.67 382.11 475.25 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 80 160 240 320 400 Min: 327.16 / Avg: 329.04 / Max: 330.05 Min: 351.7 / Avg: 352.74 / Max: 354.65 Min: 301.2 / Avg: 302.27 / Max: 303.68 Min: 319.98 / Avg: 327.88 / Max: 333.56 Min: 378.8 / Avg: 380.9 / Max: 384.34 Min: 415.8 / Avg: 460.67 / Max: 496.58 Min: 377.89 / Avg: 382.11 / Max: 385.33 Min: 468.29 / Avg: 475.25 / Max: 487.33 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.7444 1.4888 2.2332 2.9776 3.722 SE +/- 0.00871, N = 3 SE +/- 0.00768, N = 3 SE +/- 0.00805, N = 3 SE +/- 0.03826, N = 3 SE +/- 0.01189, N = 3 SE +/- 0.02702, N = 13 SE +/- 0.01517, N = 3 SE +/- 0.02652, N = 3 3.03922 2.83498 3.30836 3.05085 2.62544 2.17463 2.61721 2.10480 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 100 200 300 400 500 SE +/- 0.94, N = 3 SE +/- 0.96, N = 3 SE +/- 0.74, N = 3 SE +/- 4.07, N = 3 SE +/- 1.73, N = 3 SE +/- 5.57, N = 13 SE +/- 2.21, N = 3 SE +/- 6.06, N = 3 329.04 352.74 302.27 327.88 380.90 460.67 382.11 475.25 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 3.03 / Avg: 3.04 / Max: 3.06 Min: 2.82 / Avg: 2.83 / Max: 2.84 Min: 3.29 / Avg: 3.31 / Max: 3.32 Min: 3 / Avg: 3.05 / Max: 3.13 Min: 2.6 / Avg: 2.63 / Max: 2.64 Min: 2.01 / Avg: 2.17 / Max: 2.4 Min: 2.6 / Avg: 2.62 / Max: 2.65 Min: 2.05 / Avg: 2.1 / Max: 2.14 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenRadioss OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Bumper Beam Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.04, N = 3 SE +/- 0.27, N = 3 SE +/- 0.09, N = 3 SE +/- 0.22, N = 3 SE +/- 0.03, N = 3 SE +/- 0.23, N = 3 SE +/- 0.09, N = 3 SE +/- 0.22, N = 3 79.54 81.30 78.71 86.11 83.44 78.27 81.72 80.32 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Bumper Beam Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 16 32 48 64 80 Min: 79.46 / Avg: 79.54 / Max: 79.59 Min: 80.76 / Avg: 81.3 / Max: 81.62 Min: 78.53 / Avg: 78.71 / Max: 78.81 Min: 85.78 / Avg: 86.11 / Max: 86.52 Min: 83.41 / Avg: 83.44 / Max: 83.49 Min: 78.03 / Avg: 78.27 / Max: 78.74 Min: 81.56 / Avg: 81.72 / Max: 81.87 Min: 79.96 / Avg: 80.32 / Max: 80.73
Aircrack-ng Aircrack-ng is a tool for assessing WiFi/WLAN network security. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org k/s, More Is Better Aircrack-ng 1.7 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30K 60K 90K 120K 150K SE +/- 1953.08, N = 3 SE +/- 1197.41, N = 15 SE +/- 840.59, N = 3 SE +/- 773.70, N = 3 SE +/- 36.42, N = 3 SE +/- 1027.07, N = 15 SE +/- 122.31, N = 3 SE +/- 1131.21, N = 15 147469.33 53914.93 153584.20 64181.29 117588.99 83665.76 134048.96 65663.82 1. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lsqlite3 -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -pthread Result Confidence
OpenBenchmarking.org k/s, More Is Better Aircrack-ng 1.7 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30K 60K 90K 120K 150K Min: 143615.3 / Avg: 147469.33 / Max: 149947.17 Min: 46494.81 / Avg: 53914.93 / Max: 62158.72 Min: 152198.84 / Avg: 153584.2 / Max: 155101.73 Min: 63027.57 / Avg: 64181.29 / Max: 65651.2 Min: 117530.57 / Avg: 117588.99 / Max: 117655.87 Min: 74275.53 / Avg: 83665.76 / Max: 90875.94 Min: 133845.03 / Avg: 134048.96 / Max: 134267.94 Min: 58215.94 / Avg: 65663.82 / Max: 73521.7 1. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lsqlite3 -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -pthread
Helsing Helsing is an open-source POSIX vampire number generator. This test profile measures the time it takes to generate vampire numbers between varying numbers of digits. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Helsing 1.0-beta Digit Range: 14 digit Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 SE +/- 0.26, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.53, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.42, N = 3 93.35 50.83 89.07 48.09 123.83 65.03 107.24 58.25 1. (CC) gcc options: -O2 -pthread Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Helsing 1.0-beta Digit Range: 14 digit Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 Min: 92.89 / Avg: 93.35 / Max: 93.78 Min: 50.71 / Avg: 50.83 / Max: 50.93 Min: 88.98 / Avg: 89.07 / Max: 89.23 Min: 47.96 / Avg: 48.09 / Max: 48.21 Min: 122.82 / Avg: 123.83 / Max: 124.63 Min: 64.83 / Avg: 65.03 / Max: 65.19 Min: 107.01 / Avg: 107.24 / Max: 107.36 Min: 57.64 / Avg: 58.25 / Max: 59.05 1. (CC) gcc options: -O2 -pthread
DaCapo Benchmark This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Tradebeans Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3K 6K 9K 12K 15K SE +/- 79.99, N = 3 SE +/- 64.94, N = 3 SE +/- 226.65, N = 15 SE +/- 16.01, N = 3 SE +/- 51.68, N = 15 SE +/- 66.27, N = 3 SE +/- 54.76, N = 15 SE +/- 10.41, N = 3 7270 8050 11004 12713 6130 6681 5994 6672 Result Confidence
OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Tradebeans Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2K 4K 6K 8K 10K Min: 7134 / Avg: 7270.33 / Max: 7411 Min: 7926 / Avg: 8050.33 / Max: 8145 Min: 9243 / Avg: 11003.93 / Max: 11844 Min: 12682 / Avg: 12712.67 / Max: 12736 Min: 5790 / Avg: 6130 / Max: 6422 Min: 6608 / Avg: 6680.67 / Max: 6813 Min: 5584 / Avg: 5994.33 / Max: 6555 Min: 6653 / Avg: 6671.67 / Max: 6689
TensorFlow Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 SE +/- 0.05, N = 4 SE +/- 0.06, N = 15 SE +/- 0.05, N = 9 SE +/- 0.03, N = 15 SE +/- 0.09, N = 4 SE +/- 0.07, N = 3 SE +/- 0.10, N = 4 SE +/- 0.04, N = 15 10.53 4.39 6.43 3.85 11.29 5.11 9.99 4.37 Result Confidence
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 10.44 / Avg: 10.53 / Max: 10.67 Min: 3.94 / Avg: 4.39 / Max: 4.78 Min: 6.29 / Avg: 6.43 / Max: 6.82 Min: 3.69 / Avg: 3.85 / Max: 4.15 Min: 11.1 / Avg: 11.29 / Max: 11.51 Min: 5.03 / Avg: 5.11 / Max: 5.25 Min: 9.74 / Avg: 9.99 / Max: 10.17 Min: 4.15 / Avg: 4.37 / Max: 4.65
Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 SE +/- 0.04, N = 3 SE +/- 1.12, N = 3 SE +/- 0.50, N = 3 SE +/- 0.70, N = 3 SE +/- 0.13, N = 3 SE +/- 0.39, N = 3 SE +/- 0.93, N = 3 SE +/- 1.28, N = 3 120.93 115.47 91.51 94.66 104.23 111.71 103.56 107.30 Result Confidence
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 Min: 120.89 / Avg: 120.93 / Max: 121.01 Min: 113.57 / Avg: 115.47 / Max: 117.44 Min: 90.88 / Avg: 91.51 / Max: 92.5 Min: 93.32 / Avg: 94.66 / Max: 95.7 Min: 104.01 / Avg: 104.23 / Max: 104.47 Min: 111.29 / Avg: 111.71 / Max: 112.49 Min: 101.7 / Avg: 103.56 / Max: 104.56 Min: 105.37 / Avg: 107.3 / Max: 109.71
Blender Result
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Pabellon Barcelona - Compute: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.15, N = 3 SE +/- 0.26, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.31, N = 3 SE +/- 0.08, N = 3 SE +/- 0.44, N = 3 SE +/- 0.20, N = 3 87.92 46.38 80.29 41.85 106.96 55.26 97.80 51.29 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Pabellon Barcelona - Compute: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 Min: 87.63 / Avg: 87.92 / Max: 88.15 Min: 45.94 / Avg: 46.38 / Max: 46.84 Min: 80.11 / Avg: 80.29 / Max: 80.39 Min: 41.74 / Avg: 41.85 / Max: 41.95 Min: 106.49 / Avg: 106.96 / Max: 107.55 Min: 55.12 / Avg: 55.26 / Max: 55.41 Min: 97.15 / Avg: 97.8 / Max: 98.64 Min: 51.08 / Avg: 51.29 / Max: 51.69
libavif avifenc Result
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 0 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.32, N = 3 SE +/- 0.05, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 SE +/- 0.29, N = 3 SE +/- 0.22, N = 3 SE +/- 0.32, N = 3 69.93 67.38 64.48 60.53 76.92 69.65 73.06 68.44 1. (CXX) g++ options: -O3 -fPIC -lm Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 0 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 15 30 45 60 75 Min: 69.55 / Avg: 69.93 / Max: 70.56 Min: 67.32 / Avg: 67.37 / Max: 67.47 Min: 64.38 / Avg: 64.48 / Max: 64.63 Min: 60.47 / Avg: 60.53 / Max: 60.57 Min: 76.63 / Avg: 76.92 / Max: 77.15 Min: 69.12 / Avg: 69.65 / Max: 70.13 Min: 72.62 / Avg: 73.06 / Max: 73.3 Min: 68 / Avg: 68.44 / Max: 69.07 1. (CXX) g++ options: -O3 -fPIC -lm
OSPRay Studio Result
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 500 1000 1500 2000 2500 SE +/- 0.88, N = 3 SE +/- 0.88, N = 3 SE +/- 1.45, N = 3 SE +/- 0.00, N = 3 SE +/- 1.20, N = 3 SE +/- 2.65, N = 3 SE +/- 1.20, N = 3 SE +/- 0.33, N = 3 1977 1063 1709 898 2357 1237 2123 1143 Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 400 800 1200 1600 2000 Min: 1976 / Avg: 1977.33 / Max: 1979 Min: 1062 / Avg: 1063.33 / Max: 1065 Min: 1707 / Avg: 1709.33 / Max: 1712 Min: 898 / Avg: 898 / Max: 898 Min: 2355 / Avg: 2357.33 / Max: 2359 Min: 1232 / Avg: 1237 / Max: 1241 Min: 2121 / Avg: 2123.33 / Max: 2125 Min: 1142 / Avg: 1142.67 / Max: 1143
TensorFlow Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: GoogLeNet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 110 220 330 440 550 SE +/- 0.24, N = 3 SE +/- 4.87, N = 3 SE +/- 2.30, N = 3 SE +/- 2.68, N = 3 SE +/- 1.67, N = 3 SE +/- 2.29, N = 3 SE +/- 1.91, N = 3 SE +/- 4.80, N = 3 448.46 528.93 423.59 501.39 375.73 447.50 386.00 449.91 Result Confidence
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: GoogLeNet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 90 180 270 360 450 Min: 448.09 / Avg: 448.46 / Max: 448.91 Min: 519.66 / Avg: 528.93 / Max: 536.16 Min: 419.06 / Avg: 423.59 / Max: 426.5 Min: 496.29 / Avg: 501.39 / Max: 505.37 Min: 372.9 / Avg: 375.73 / Max: 378.68 Min: 443.1 / Avg: 447.5 / Max: 450.82 Min: 382.18 / Avg: 386 / Max: 388.1 Min: 440.94 / Avg: 449.91 / Max: 457.38
GraphicsMagick Result
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Rotate Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 SE +/- 1.93, N = 6 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 196 172 203 182 197 148 194 143 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp Result Confidence
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Rotate Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 Min: 187 / Avg: 196.33 / Max: 199 Min: 171 / Avg: 171.67 / Max: 172 Min: 202 / Avg: 202.67 / Max: 204 Min: 182 / Avg: 182.33 / Max: 183 Min: 197 / Avg: 197.33 / Max: 198 Min: 147 / Avg: 148 / Max: 149 Min: 194 / Avg: 194.33 / Max: 195 Min: 143 / Avg: 143.33 / Max: 144 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
OSPRay Studio Result
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 400 800 1200 1600 2000 SE +/- 0.58, N = 3 SE +/- 0.58, N = 3 SE +/- 0.88, N = 3 SE +/- 0.88, N = 3 SE +/- 0.33, N = 3 SE +/- 1.76, N = 3 SE +/- 0.58, N = 3 SE +/- 0.58, N = 3 1657 894 1441 759 1988 1049 1792 961 Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 300 600 900 1200 1500 Min: 1656 / Avg: 1657 / Max: 1658 Min: 893 / Avg: 894 / Max: 895 Min: 1439 / Avg: 1440.67 / Max: 1442 Min: 757 / Avg: 758.67 / Max: 760 Min: 1988 / Avg: 1988.33 / Max: 1989 Min: 1046 / Avg: 1048.67 / Max: 1052 Min: 1791 / Avg: 1792 / Max: 1793 Min: 960 / Avg: 961 / Max: 962
OpenVINO Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 80 160 240 320 400 SE +/- 0.28, N = 3 SE +/- 0.00, N = 3 SE +/- 0.69, N = 3 SE +/- 0.33, N = 3 SE +/- 0.15, N = 3 SE +/- 0.40, N = 3 SE +/- 0.47, N = 3 SE +/- 0.35, N = 3 356.38 283.11 224.64 234.24 236.52 256.63 257.50 278.52 MIN: 109.11 / MAX: 395.69 MIN: 203.37 / MAX: 332.08 MIN: 153.29 / MAX: 553.64 MIN: 148.68 / MAX: 448.54 MIN: 172.47 / MAX: 265.77 MIN: 191.95 / MAX: 301.21 MIN: 187.62 / MAX: 295.06 MIN: 196.58 / MAX: 401.59 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 60 120 180 240 300 Min: 356.04 / Avg: 356.38 / Max: 356.93 Min: 283.1 / Avg: 283.11 / Max: 283.11 Min: 223.42 / Avg: 224.64 / Max: 225.79 Min: 233.59 / Avg: 234.24 / Max: 234.69 Min: 236.27 / Avg: 236.52 / Max: 236.8 Min: 256.02 / Avg: 256.63 / Max: 257.38 Min: 256.83 / Avg: 257.5 / Max: 258.41 Min: 277.85 / Avg: 278.52 / Max: 279.04 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Result
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 120 240 360 480 600 SE +/- 0.12, N = 3 SE +/- 0.01, N = 3 SE +/- 0.69, N = 3 SE +/- 0.77, N = 3 SE +/- 0.14, N = 3 SE +/- 0.58, N = 3 SE +/- 0.41, N = 3 SE +/- 0.54, N = 3 167.83 423.18 284.64 545.21 202.59 373.50 217.11 401.45 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 100 200 300 400 500 Min: 167.59 / Avg: 167.83 / Max: 168 Min: 423.16 / Avg: 423.18 / Max: 423.19 Min: 283.41 / Avg: 284.64 / Max: 285.79 Min: 544.3 / Avg: 545.21 / Max: 546.74 Min: 202.35 / Avg: 202.59 / Max: 202.83 Min: 372.41 / Avg: 373.5 / Max: 374.39 Min: 216.31 / Avg: 217.11 / Max: 217.68 Min: 400.66 / Avg: 401.45 / Max: 402.49 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OSPRay Studio Result
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20K 40K 60K 80K 100K SE +/- 58.68, N = 3 SE +/- 125.33, N = 3 SE +/- 162.52, N = 3 SE +/- 47.16, N = 3 SE +/- 41.33, N = 3 SE +/- 155.80, N = 3 SE +/- 65.97, N = 3 SE +/- 141.04, N = 3 68006 38813 59522 33391 80742 45211 73366 41971 Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 14K 28K 42K 56K 70K Min: 67889 / Avg: 68005.67 / Max: 68075 Min: 38562 / Avg: 38812.67 / Max: 38938 Min: 59240 / Avg: 59521.67 / Max: 59803 Min: 33306 / Avg: 33390.67 / Max: 33469 Min: 80692 / Avg: 80742 / Max: 80824 Min: 44930 / Avg: 45211.33 / Max: 45468 Min: 73275 / Avg: 73365.67 / Max: 73494 Min: 41773 / Avg: 41971 / Max: 42244
miniBUDE MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 SE +/- 0.31, N = 3 SE +/- 0.99, N = 3 SE +/- 0.03, N = 3 SE +/- 1.93, N = 15 SE +/- 0.31, N = 3 SE +/- 1.48, N = 3 SE +/- 0.96, N = 4 SE +/- 0.93, N = 3 86.97 140.83 108.12 191.82 70.21 127.85 78.11 133.99 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm Result Confidence
OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 Min: 86.39 / Avg: 86.97 / Max: 87.46 Min: 139.5 / Avg: 140.83 / Max: 142.75 Min: 108.09 / Avg: 108.12 / Max: 108.18 Min: 180.36 / Avg: 191.82 / Max: 206.68 Min: 69.59 / Avg: 70.21 / Max: 70.54 Min: 125.14 / Avg: 127.85 / Max: 130.24 Min: 75.51 / Avg: 78.1 / Max: 79.59 Min: 132.16 / Avg: 133.99 / Max: 135.14 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
Result
OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1000 2000 3000 4000 5000 SE +/- 7.77, N = 3 SE +/- 24.63, N = 3 SE +/- 0.70, N = 3 SE +/- 48.20, N = 15 SE +/- 7.81, N = 3 SE +/- 36.96, N = 3 SE +/- 23.93, N = 4 SE +/- 23.14, N = 3 2174.19 3520.71 2703.09 4795.46 1755.33 3196.12 1952.61 3349.76 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm Result Confidence
OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 800 1600 2400 3200 4000 Min: 2159.76 / Avg: 2174.19 / Max: 2186.39 Min: 3487.53 / Avg: 3520.71 / Max: 3568.84 Min: 2702.35 / Avg: 2703.09 / Max: 2704.49 Min: 4508.91 / Avg: 4795.46 / Max: 5166.93 Min: 1739.72 / Avg: 1755.33 / Max: 1763.46 Min: 3128.55 / Avg: 3196.12 / Max: 3255.87 Min: 1887.63 / Avg: 1952.61 / Max: 1989.74 Min: 3304 / Avg: 3349.76 / Max: 3378.59 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OSPRay Result
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11 22 33 44 55 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.16, N = 3 24.64 42.82 27.10 48.76 19.91 35.93 22.36 39.34 Result Confidence
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 10 20 30 40 50 Min: 24.61 / Avg: 24.64 / Max: 24.66 Min: 42.79 / Avg: 42.82 / Max: 42.85 Min: 27.06 / Avg: 27.1 / Max: 27.17 Min: 48.7 / Avg: 48.76 / Max: 48.83 Min: 19.9 / Avg: 19.91 / Max: 19.92 Min: 35.81 / Avg: 35.93 / Max: 36.12 Min: 22.32 / Avg: 22.36 / Max: 22.42 Min: 39.02 / Avg: 39.34 / Max: 39.52
OSPRay Studio Result
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 15K 30K 45K 60K 75K SE +/- 102.40, N = 3 SE +/- 64.24, N = 3 SE +/- 90.37, N = 3 SE +/- 16.05, N = 3 SE +/- 134.33, N = 3 SE +/- 37.55, N = 3 SE +/- 64.91, N = 3 SE +/- 13.86, N = 3 58026 33411 50798 24249 68973 38926 62540 36179 Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12K 24K 36K 48K 60K Min: 57887 / Avg: 58026.33 / Max: 58226 Min: 33291 / Avg: 33410.67 / Max: 33511 Min: 50683 / Avg: 50797.67 / Max: 50976 Min: 24217 / Avg: 24248.67 / Max: 24269 Min: 68712 / Avg: 68973.33 / Max: 69158 Min: 38866 / Avg: 38925.67 / Max: 38995 Min: 62411 / Avg: 62539.67 / Max: 62619 Min: 36158 / Avg: 36178.67 / Max: 36205
Result
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8K 16K 24K 32K 40K SE +/- 62.46, N = 3 SE +/- 34.10, N = 3 SE +/- 37.49, N = 3 SE +/- 7.13, N = 3 SE +/- 28.06, N = 3 SE +/- 72.42, N = 3 SE +/- 83.47, N = 3 SE +/- 51.39, N = 3 31380 14138 23125 12124 37055 16645 33790 15357 Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 6K 12K 18K 24K 30K Min: 31258 / Avg: 31379.67 / Max: 31465 Min: 14077 / Avg: 14137.67 / Max: 14195 Min: 23082 / Avg: 23125.33 / Max: 23200 Min: 12114 / Avg: 12124.33 / Max: 12138 Min: 37000 / Avg: 37054.67 / Max: 37093 Min: 16562 / Avg: 16644.67 / Max: 16789 Min: 33636 / Avg: 33789.67 / Max: 33923 Min: 15268 / Avg: 15357.33 / Max: 15446
OpenVINO Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.8055 1.611 2.4165 3.222 4.0275 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 4 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 3.58 2.50 2.36 2.48 2.50 2.53 2.67 2.79 MIN: 1.4 / MAX: 12.71 MIN: 2.28 / MAX: 40.8 MIN: 2.02 / MAX: 21.33 MIN: 1.98 / MAX: 34.01 MIN: 2.22 / MAX: 27.89 MIN: 2.23 / MAX: 31.44 MIN: 2.39 / MAX: 34.22 MIN: 2.44 / MAX: 34.21 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 3.58 / Avg: 3.58 / Max: 3.59 Min: 2.5 / Avg: 2.5 / Max: 2.51 Min: 2.35 / Avg: 2.36 / Max: 2.36 Min: 2.47 / Avg: 2.48 / Max: 2.48 Min: 2.46 / Avg: 2.5 / Max: 2.59 Min: 2.52 / Avg: 2.53 / Max: 2.54 Min: 2.66 / Avg: 2.67 / Max: 2.67 Min: 2.76 / Avg: 2.79 / Max: 2.81 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Result
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 10K 20K 30K 40K 50K SE +/- 2.71, N = 3 SE +/- 53.98, N = 3 SE +/- 47.41, N = 3 SE +/- 39.08, N = 3 SE +/- 234.43, N = 4 SE +/- 80.58, N = 3 SE +/- 21.27, N = 3 SE +/- 233.95, N = 3 15943.17 47654.95 26943.42 48122.16 19183.83 37710.60 20910.53 40032.81 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8K 16K 24K 32K 40K Min: 15937.95 / Avg: 15943.17 / Max: 15947.04 Min: 47565.14 / Avg: 47654.95 / Max: 47751.73 Min: 26880.83 / Avg: 26943.42 / Max: 27036.41 Min: 48082.4 / Avg: 48122.16 / Max: 48200.32 Min: 18494.39 / Avg: 19183.83 / Max: 19482.1 Min: 37586.55 / Avg: 37710.6 / Max: 37861.73 Min: 20878.26 / Avg: 20910.53 / Max: 20950.67 Min: 39641.67 / Avg: 40032.81 / Max: 40450.75 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 SE +/- 0.00, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.02, N = 3 SE +/- 0.09, N = 3 13.95 15.96 9.40 13.15 11.37 17.15 12.72 18.72 MIN: 8.67 / MAX: 65.92 MIN: 10.38 / MAX: 43.64 MIN: 7.66 / MAX: 25.07 MIN: 7.28 / MAX: 47.97 MIN: 9.17 / MAX: 32.12 MIN: 10.81 / MAX: 59.34 MIN: 9.56 / MAX: 30.66 MIN: 12.15 / MAX: 64.81 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 Min: 13.94 / Avg: 13.95 / Max: 13.95 Min: 15.86 / Avg: 15.96 / Max: 16.02 Min: 9.38 / Avg: 9.4 / Max: 9.43 Min: 13.1 / Avg: 13.15 / Max: 13.23 Min: 11.33 / Avg: 11.37 / Max: 11.45 Min: 16.93 / Avg: 17.15 / Max: 17.33 Min: 12.67 / Avg: 12.72 / Max: 12.74 Min: 18.58 / Avg: 18.72 / Max: 18.9 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Result
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2K 4K 6K 8K 10K SE +/- 1.87, N = 3 SE +/- 13.31, N = 3 SE +/- 10.14, N = 3 SE +/- 24.76, N = 3 SE +/- 15.13, N = 3 SE +/- 37.79, N = 3 SE +/- 7.60, N = 3 SE +/- 28.98, N = 3 4209.10 7356.63 6757.26 9360.89 4208.49 5565.23 4386.48 5933.65 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1600 3200 4800 6400 8000 Min: 4205.72 / Avg: 4209.1 / Max: 4212.18 Min: 7337.71 / Avg: 7356.63 / Max: 7382.31 Min: 6738.08 / Avg: 6757.26 / Max: 6772.53 Min: 9311.42 / Avg: 9360.89 / Max: 9387.66 Min: 4178.31 / Avg: 4208.49 / Max: 4225.58 Min: 5510.56 / Avg: 5565.23 / Max: 5637.75 Min: 4378.2 / Avg: 4386.48 / Max: 4401.66 Min: 5878.07 / Avg: 5933.65 / Max: 5975.66 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OSPRay Studio Result
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9K 18K 27K 36K 45K SE +/- 61.20, N = 3 SE +/- 29.96, N = 3 SE +/- 26.00, N = 3 SE +/- 8.00, N = 3 SE +/- 36.47, N = 3 SE +/- 25.12, N = 3 SE +/- 74.33, N = 3 SE +/- 10.97, N = 3 36649 16837 31993 14358 42837 19701 39238 18111 Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7K 14K 21K 28K 35K Min: 36542 / Avg: 36648.67 / Max: 36754 Min: 16795 / Avg: 16837 / Max: 16895 Min: 31947 / Avg: 31993 / Max: 32037 Min: 14342 / Avg: 14358 / Max: 14366 Min: 42766 / Avg: 42837 / Max: 42887 Min: 19670 / Avg: 19701.33 / Max: 19751 Min: 39114 / Avg: 39238 / Max: 39371 Min: 18092 / Avg: 18110.67 / Max: 18130
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.4698 0.9396 1.4094 1.8792 2.349 SE +/- 0.00936, N = 3 SE +/- 0.01492, N = 3 SE +/- 0.01491, N = 4 SE +/- 0.00701, N = 3 SE +/- 0.00884, N = 3 SE +/- 0.00720, N = 3 SE +/- 0.01053, N = 3 SE +/- 0.00871, N = 3 1.27368 1.76353 1.20298 1.64919 1.45280 2.02659 1.47249 2.08780 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 1.26 / Avg: 1.27 / Max: 1.29 Min: 1.74 / Avg: 1.76 / Max: 1.79 Min: 1.18 / Avg: 1.2 / Max: 1.25 Min: 1.64 / Avg: 1.65 / Max: 1.66 Min: 1.44 / Avg: 1.45 / Max: 1.47 Min: 2.01 / Avg: 2.03 / Max: 2.04 Min: 1.45 / Avg: 1.47 / Max: 1.49 Min: 2.08 / Avg: 2.09 / Max: 2.11 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 200 400 600 800 1000 SE +/- 5.72, N = 3 SE +/- 4.81, N = 3 SE +/- 10.06, N = 4 SE +/- 2.57, N = 3 SE +/- 4.16, N = 3 SE +/- 1.77, N = 3 SE +/- 4.87, N = 3 SE +/- 1.98, N = 3 784.30 566.38 830.73 605.59 687.67 492.89 678.48 478.47 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.4698 0.9396 1.4094 1.8792 2.349 SE +/- 0.00936, N = 3 SE +/- 0.01492, N = 3 SE +/- 0.01491, N = 4 SE +/- 0.00701, N = 3 SE +/- 0.00884, N = 3 SE +/- 0.00720, N = 3 SE +/- 0.01053, N = 3 SE +/- 0.00871, N = 3 1.27368 1.76353 1.20298 1.64919 1.45280 2.02659 1.47249 2.08780 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 150 300 450 600 750 Min: 773 / Avg: 784.3 / Max: 791.5 Min: 559.3 / Avg: 566.38 / Max: 575.57 Min: 800.82 / Avg: 830.72 / Max: 843.8 Min: 600.49 / Avg: 605.59 / Max: 608.66 Min: 680.54 / Avg: 687.67 / Max: 694.95 Min: 490.15 / Avg: 492.89 / Max: 496.19 Min: 672.26 / Avg: 678.48 / Max: 688.08 Min: 474.56 / Avg: 478.47 / Max: 480.94 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVINO Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 16.50 15.04 11.17 11.69 12.54 13.34 13.59 14.42 MIN: 11.95 / MAX: 28.87 MIN: 12.32 / MAX: 32.87 MIN: 10.18 / MAX: 19.36 MIN: 10.28 / MAX: 42.12 MIN: 9.17 / MAX: 21.01 MIN: 9.67 / MAX: 39.84 MIN: 9.53 / MAX: 21.61 MIN: 9.74 / MAX: 43.95 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 Min: 16.47 / Avg: 16.5 / Max: 16.53 Min: 15.02 / Avg: 15.04 / Max: 15.08 Min: 11.15 / Avg: 11.17 / Max: 11.18 Min: 11.69 / Avg: 11.69 / Max: 11.69 Min: 12.51 / Avg: 12.54 / Max: 12.59 Min: 13.34 / Avg: 13.34 / Max: 13.35 Min: 13.55 / Avg: 13.59 / Max: 13.65 Min: 14.41 / Avg: 14.42 / Max: 14.43 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Result
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2K 4K 6K 8K 10K SE +/- 4.52, N = 3 SE +/- 8.98, N = 3 SE +/- 4.97, N = 3 SE +/- 3.37, N = 3 SE +/- 7.17, N = 3 SE +/- 4.05, N = 3 SE +/- 9.37, N = 3 SE +/- 3.66, N = 3 3606.12 7862.58 5725.03 10934.17 3802.61 7127.28 4093.73 7689.32 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2K 4K 6K 8K 10K Min: 3598.48 / Avg: 3606.12 / Max: 3614.13 Min: 7844.62 / Avg: 7862.58 / Max: 7871.66 Min: 5716.19 / Avg: 5725.03 / Max: 5733.37 Min: 10930.3 / Avg: 10934.17 / Max: 10940.89 Min: 3788.72 / Avg: 3802.61 / Max: 3812.62 Min: 7120.17 / Avg: 7127.28 / Max: 7134.19 Min: 4075.39 / Avg: 4093.73 / Max: 4106.2 Min: 7685.53 / Avg: 7689.32 / Max: 7696.65 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 9.79 7.72 6.72 6.95 7.13 7.32 7.76 7.97 MIN: 4.37 / MAX: 18.18 MIN: 7.16 / MAX: 18.31 MIN: 6.22 / MAX: 11.15 MIN: 6.28 / MAX: 20.42 MIN: 6.64 / MAX: 12.22 MIN: 6.78 / MAX: 18.72 MIN: 6.86 / MAX: 12.92 MIN: 7.04 / MAX: 21.51 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 9.78 / Avg: 9.79 / Max: 9.8 Min: 7.71 / Avg: 7.72 / Max: 7.72 Min: 6.71 / Avg: 6.72 / Max: 6.72 Min: 6.95 / Avg: 6.95 / Max: 6.96 Min: 7.13 / Avg: 7.13 / Max: 7.14 Min: 7.31 / Avg: 7.32 / Max: 7.32 Min: 7.76 / Avg: 7.76 / Max: 7.76 Min: 7.96 / Avg: 7.97 / Max: 7.97 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Result
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4K 8K 12K 16K 20K SE +/- 3.97, N = 3 SE +/- 4.14, N = 3 SE +/- 5.57, N = 3 SE +/- 7.74, N = 3 SE +/- 3.72, N = 3 SE +/- 3.67, N = 3 SE +/- 0.46, N = 3 SE +/- 7.22, N = 3 5943.66 15519.92 9515.86 18375.63 6717.65 13102.28 7207.74 14033.94 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3K 6K 9K 12K 15K Min: 5937.09 / Avg: 5943.66 / Max: 5950.81 Min: 15515.26 / Avg: 15519.92 / Max: 15528.17 Min: 9508.89 / Avg: 9515.86 / Max: 9526.87 Min: 18360.15 / Avg: 18375.63 / Max: 18383.72 Min: 6710.36 / Avg: 6717.65 / Max: 6722.63 Min: 13098.5 / Avg: 13102.28 / Max: 13109.61 Min: 7207.09 / Avg: 7207.74 / Max: 7208.64 Min: 14023.17 / Avg: 14033.94 / Max: 14047.65 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 15 30 45 60 75 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.28, N = 3 SE +/- 0.15, N = 3 SE +/- 0.05, N = 3 SE +/- 0.21, N = 3 SE +/- 0.06, N = 3 55.99 65.02 55.07 57.13 55.74 56.71 62.53 62.11 MIN: 27.63 / MAX: 76.45 MIN: 55.15 / MAX: 104.43 MIN: 46.78 / MAX: 80.73 MIN: 39.58 / MAX: 104.91 MIN: 44.83 / MAX: 69.99 MIN: 45.43 / MAX: 89.46 MIN: 48.23 / MAX: 78.43 MIN: 47.82 / MAX: 101.26 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 13 26 39 52 65 Min: 55.71 / Avg: 55.99 / Max: 56.15 Min: 64.98 / Avg: 65.02 / Max: 65.08 Min: 55.03 / Avg: 55.07 / Max: 55.1 Min: 56.8 / Avg: 57.13 / Max: 57.69 Min: 55.44 / Avg: 55.74 / Max: 55.92 Min: 56.63 / Avg: 56.71 / Max: 56.8 Min: 62.27 / Avg: 62.53 / Max: 62.94 Min: 61.99 / Avg: 62.11 / Max: 62.18 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Result
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 500 1000 1500 2000 2500 SE +/- 2.65, N = 3 SE +/- 0.66, N = 3 SE +/- 0.47, N = 3 SE +/- 11.53, N = 3 SE +/- 2.29, N = 3 SE +/- 1.56, N = 3 SE +/- 2.94, N = 3 SE +/- 1.74, N = 3 1068.43 1843.61 1159.66 2237.69 860.64 1691.79 894.87 1801.89 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 400 800 1200 1600 2000 Min: 1065.34 / Avg: 1068.43 / Max: 1073.71 Min: 1842.38 / Avg: 1843.61 / Max: 1844.65 Min: 1159 / Avg: 1159.66 / Max: 1160.57 Min: 2214.76 / Avg: 2237.69 / Max: 2251.29 Min: 857.92 / Avg: 860.64 / Max: 865.19 Min: 1688.93 / Avg: 1691.79 / Max: 1694.3 Min: 889.09 / Avg: 894.87 / Max: 898.73 Min: 1799.84 / Avg: 1801.89 / Max: 1805.36 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
QuantLib QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MFLOPS, More Is Better QuantLib 1.32 Configuration: Multi-Threaded Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 80K 160K 240K 320K 400K SE +/- 105.60, N = 3 SE +/- 362.38, N = 3 SE +/- 63.14, N = 3 SE +/- 248.00, N = 3 SE +/- 155.19, N = 3 SE +/- 286.86, N = 3 SE +/- 40.48, N = 3 SE +/- 160.59, N = 3 179647.5 350187.5 195648.8 380867.5 143755.3 288129.1 162727.4 316359.2 1. (CXX) g++ options: -O3 -march=native -fPIE -pie Result Confidence
OpenBenchmarking.org MFLOPS, More Is Better QuantLib 1.32 Configuration: Multi-Threaded Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 70K 140K 210K 280K 350K Min: 179510.9 / Avg: 179647.5 / Max: 179855.3 Min: 349585.6 / Avg: 350187.53 / Max: 350838.1 Min: 195522.5 / Avg: 195648.77 / Max: 195714 Min: 380550.6 / Avg: 380867.5 / Max: 381356.4 Min: 143465.9 / Avg: 143755.33 / Max: 143997.1 Min: 287724.1 / Avg: 288129.07 / Max: 288683.5 Min: 162652.1 / Avg: 162727.43 / Max: 162790.8 Min: 316084 / Avg: 316359.23 / Max: 316640.2 1. (CXX) g++ options: -O3 -march=native -fPIE -pie
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 SE +/- 0.40, N = 3 SE +/- 0.31, N = 3 SE +/- 0.33, N = 3 29.41 29.75 29.02 28.85 33.33 36.23 33.99 36.00 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 Min: 29.33 / Avg: 29.41 / Max: 29.45 Min: 29.52 / Avg: 29.75 / Max: 29.9 Min: 28.87 / Avg: 29.02 / Max: 29.17 Min: 28.67 / Avg: 28.85 / Max: 28.95 Min: 33.13 / Avg: 33.33 / Max: 33.49 Min: 35.77 / Avg: 36.23 / Max: 37.04 Min: 33.37 / Avg: 33.99 / Max: 34.35 Min: 35.37 / Avg: 36 / Max: 36.49 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 SE +/- 0.05, N = 3 SE +/- 0.13, N = 3 SE +/- 0.10, N = 3 SE +/- 0.11, N = 3 SE +/- 0.09, N = 3 SE +/- 0.31, N = 3 SE +/- 0.27, N = 3 SE +/- 0.26, N = 3 34.00 33.61 34.46 34.66 30.00 27.61 29.43 27.78 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 SE +/- 0.40, N = 3 SE +/- 0.31, N = 3 SE +/- 0.33, N = 3 29.41 29.75 29.02 28.85 33.33 36.23 33.99 36.00 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 Min: 33.95 / Avg: 34 / Max: 34.09 Min: 33.44 / Avg: 33.61 / Max: 33.87 Min: 34.28 / Avg: 34.46 / Max: 34.63 Min: 34.55 / Avg: 34.66 / Max: 34.88 Min: 29.86 / Avg: 30 / Max: 30.18 Min: 27 / Avg: 27.61 / Max: 27.95 Min: 29.11 / Avg: 29.42 / Max: 29.97 Min: 27.4 / Avg: 27.78 / Max: 28.27 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.13, N = 3 SE +/- 0.55, N = 3 SE +/- 0.08, N = 3 SE +/- 0.32, N = 3 30.92 33.29 29.96 31.53 35.07 40.45 35.11 40.52 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 Min: 30.82 / Avg: 30.92 / Max: 31.04 Min: 33.17 / Avg: 33.29 / Max: 33.4 Min: 29.94 / Avg: 29.96 / Max: 29.97 Min: 31.52 / Avg: 31.53 / Max: 31.54 Min: 34.81 / Avg: 35.07 / Max: 35.22 Min: 39.45 / Avg: 40.45 / Max: 41.37 Min: 34.95 / Avg: 35.11 / Max: 35.22 Min: 39.89 / Avg: 40.52 / Max: 40.88 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.10, N = 3 SE +/- 0.34, N = 3 SE +/- 0.07, N = 3 SE +/- 0.19, N = 3 32.34 30.04 33.38 31.71 28.52 24.73 28.48 24.68 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.13, N = 3 SE +/- 0.55, N = 3 SE +/- 0.08, N = 3 SE +/- 0.32, N = 3 30.92 33.29 29.96 31.53 35.07 40.45 35.11 40.52 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 Min: 32.21 / Avg: 32.34 / Max: 32.44 Min: 29.94 / Avg: 30.04 / Max: 30.14 Min: 33.37 / Avg: 33.38 / Max: 33.4 Min: 31.71 / Avg: 31.71 / Max: 31.72 Min: 28.39 / Avg: 28.52 / Max: 28.72 Min: 24.17 / Avg: 24.73 / Max: 25.34 Min: 28.39 / Avg: 28.48 / Max: 28.61 Min: 24.46 / Avg: 24.68 / Max: 25.07 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
JPEG-XL libjxl Result
OpenBenchmarking.org MP/s, More Is Better JPEG-XL libjxl 0.10.1 Input: JPEG - Quality: 90 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11 22 33 44 55 SE +/- 0.35, N = 3 SE +/- 0.06, N = 3 SE +/- 0.53, N = 15 SE +/- 0.67, N = 12 SE +/- 0.34, N = 8 SE +/- 0.01, N = 3 SE +/- 0.21, N = 3 SE +/- 0.36, N = 5 43.20 42.04 48.36 42.97 39.10 39.59 43.63 34.63 1. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm Result Confidence
OpenBenchmarking.org MP/s, More Is Better JPEG-XL libjxl 0.10.1 Input: JPEG - Quality: 90 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 10 20 30 40 50 Min: 42.6 / Avg: 43.2 / Max: 43.83 Min: 41.92 / Avg: 42.04 / Max: 42.12 Min: 44.98 / Avg: 48.36 / Max: 51.28 Min: 39.5 / Avg: 42.97 / Max: 46.31 Min: 37.9 / Avg: 39.1 / Max: 40.45 Min: 39.58 / Avg: 39.59 / Max: 39.62 Min: 43.21 / Avg: 43.63 / Max: 43.88 Min: 33.7 / Avg: 34.63 / Max: 35.85 1. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm
OpenVINO Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 100.39 45.78 39.62 43.41 41.93 42.16 59.69 64.91 MIN: 41.76 / MAX: 139.86 MIN: 33.94 / MAX: 85.21 MIN: 26.71 / MAX: 62.24 MIN: 27.3 / MAX: 82.85 MIN: 27.14 / MAX: 54.05 MIN: 32.47 / MAX: 70.84 MIN: 42.86 / MAX: 84.25 MIN: 49.88 / MAX: 107.03 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 Min: 100.37 / Avg: 100.39 / Max: 100.4 Min: 45.68 / Avg: 45.78 / Max: 45.84 Min: 39.45 / Avg: 39.62 / Max: 39.73 Min: 43.24 / Avg: 43.41 / Max: 43.52 Min: 41.75 / Avg: 41.93 / Max: 42.29 Min: 42.01 / Avg: 42.16 / Max: 42.34 Min: 59.52 / Avg: 59.69 / Max: 59.87 Min: 64.82 / Avg: 64.91 / Max: 65.03 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Result
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 160 320 480 640 800 SE +/- 0.04, N = 3 SE +/- 0.69, N = 3 SE +/- 0.95, N = 3 SE +/- 1.42, N = 3 SE +/- 1.23, N = 3 SE +/- 1.28, N = 3 SE +/- 0.52, N = 3 SE +/- 0.55, N = 3 298.56 654.84 403.20 736.23 285.95 568.81 301.30 569.60 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 130 260 390 520 650 Min: 298.49 / Avg: 298.56 / Max: 298.61 Min: 653.98 / Avg: 654.84 / Max: 656.21 Min: 402.04 / Avg: 403.2 / Max: 405.07 Min: 734.28 / Avg: 736.23 / Max: 739 Min: 283.49 / Avg: 285.95 / Max: 287.22 Min: 566.4 / Avg: 568.81 / Max: 570.75 Min: 300.38 / Avg: 301.3 / Max: 302.17 Min: 568.56 / Avg: 569.6 / Max: 570.41 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.01428, N = 3 SE +/- 0.03717, N = 3 SE +/- 0.00434, N = 3 SE +/- 0.02114, N = 3 SE +/- 0.02823, N = 3 SE +/- 0.08283, N = 3 SE +/- 0.07483, N = 3 SE +/- 0.01417, N = 3 5.21520 6.90619 4.01687 5.10948 5.22781 7.34848 5.29027 7.30822 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 5.19 / Avg: 5.22 / Max: 5.24 Min: 6.83 / Avg: 6.91 / Max: 6.95 Min: 4.01 / Avg: 4.02 / Max: 4.02 Min: 5.08 / Avg: 5.11 / Max: 5.15 Min: 5.17 / Avg: 5.23 / Max: 5.26 Min: 7.21 / Avg: 7.35 / Max: 7.49 Min: 5.21 / Avg: 5.29 / Max: 5.44 Min: 7.29 / Avg: 7.31 / Max: 7.34 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50 100 150 200 250 SE +/- 0.53, N = 3 SE +/- 0.78, N = 3 SE +/- 0.27, N = 3 SE +/- 0.81, N = 3 SE +/- 1.04, N = 3 SE +/- 1.53, N = 3 SE +/- 2.63, N = 3 SE +/- 0.26, N = 3 191.56 144.64 248.68 195.45 191.11 135.98 188.93 136.69 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.01428, N = 3 SE +/- 0.03717, N = 3 SE +/- 0.00434, N = 3 SE +/- 0.02114, N = 3 SE +/- 0.02823, N = 3 SE +/- 0.08283, N = 3 SE +/- 0.07483, N = 3 SE +/- 0.01417, N = 3 5.21520 6.90619 4.01687 5.10948 5.22781 7.34848 5.29027 7.30822 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50 100 150 200 250 Min: 190.81 / Avg: 191.56 / Max: 192.57 Min: 143.64 / Avg: 144.64 / Max: 146.17 Min: 248.38 / Avg: 248.68 / Max: 249.23 Min: 193.96 / Avg: 195.45 / Max: 196.73 Min: 189.86 / Avg: 191.11 / Max: 193.18 Min: 133.3 / Avg: 135.98 / Max: 138.6 Min: 183.67 / Avg: 188.93 / Max: 191.81 Min: 136.16 / Avg: 136.69 / Max: 136.97 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVINO Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 14 28 42 56 70 SE +/- 0.03, N = 3 SE +/- 0.16, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.34, N = 3 SE +/- 0.05, N = 3 62.46 37.58 26.85 28.17 28.73 29.98 38.50 41.57 MIN: 46.12 / MAX: 79.06 MIN: 20.58 / MAX: 347.67 MIN: 20.18 / MAX: 307.38 MIN: 20.12 / MAX: 261.31 MIN: 19.52 / MAX: 209.26 MIN: 20.48 / MAX: 222.7 MIN: 25.18 / MAX: 161.13 MIN: 28.11 / MAX: 155.06 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12 24 36 48 60 Min: 62.41 / Avg: 62.46 / Max: 62.51 Min: 37.25 / Avg: 37.58 / Max: 37.76 Min: 26.82 / Avg: 26.85 / Max: 26.89 Min: 28.15 / Avg: 28.17 / Max: 28.21 Min: 28.54 / Avg: 28.73 / Max: 28.94 Min: 29.85 / Avg: 29.98 / Max: 30.09 Min: 37.89 / Avg: 38.5 / Max: 39.08 Min: 41.5 / Avg: 41.57 / Max: 41.67 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Result
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 200 400 600 800 1000 SE +/- 0.17, N = 3 SE +/- 3.48, N = 3 SE +/- 0.54, N = 3 SE +/- 0.85, N = 3 SE +/- 1.21, N = 3 SE +/- 1.99, N = 3 SE +/- 4.09, N = 3 SE +/- 1.13, N = 3 477.77 793.64 592.20 1128.78 415.96 795.63 467.08 889.18 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 200 400 600 800 1000 Min: 477.45 / Avg: 477.77 / Max: 478.03 Min: 789.51 / Avg: 793.64 / Max: 800.56 Min: 591.13 / Avg: 592.2 / Max: 592.87 Min: 1127.09 / Avg: 1128.78 / Max: 1129.73 Min: 413.7 / Avg: 415.96 / Max: 417.83 Min: 791.97 / Avg: 795.63 / Max: 798.81 Min: 460.09 / Avg: 467.08 / Max: 474.24 Min: 886.92 / Avg: 889.18 / Max: 890.47 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Node.js V8 Web Tooling Benchmark Running the V8 project's Web-Tooling-Benchmark under Node.js. The Web-Tooling-Benchmark stresses JavaScript-related workloads common to web developers like Babel and TypeScript and Babylon. This test profile can test the system's JavaScript performance with Node.js. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org runs/s, More Is Better Node.js V8 Web Tooling Benchmark Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 SE +/- 0.11, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 15.76 15.49 17.42 17.02 15.59 14.99 15.62 14.51 Result Confidence
OpenBenchmarking.org runs/s, More Is Better Node.js V8 Web Tooling Benchmark Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 Min: 15.71 / Avg: 15.76 / Max: 15.81 Min: 15.42 / Avg: 15.49 / Max: 15.62 Min: 17.41 / Avg: 17.42 / Max: 17.44 Min: 16.93 / Avg: 17.02 / Max: 17.08 Min: 15.39 / Avg: 15.59 / Max: 15.77 Min: 14.78 / Avg: 14.99 / Max: 15.14 Min: 15.55 / Avg: 15.62 / Max: 15.73 Min: 14.42 / Avg: 14.51 / Max: 14.65
OpenVINO Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 17.84 21.73 13.73 14.67 16.33 17.19 19.44 20.24 MIN: 9.08 / MAX: 37.11 MIN: 15.08 / MAX: 39.82 MIN: 12.23 / MAX: 23.01 MIN: 12.73 / MAX: 41.28 MIN: 13.49 / MAX: 26.98 MIN: 13.16 / MAX: 42.02 MIN: 15.1 / MAX: 32.19 MIN: 13.69 / MAX: 36.9 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 Min: 17.83 / Avg: 17.84 / Max: 17.86 Min: 21.69 / Avg: 21.73 / Max: 21.81 Min: 13.72 / Avg: 13.73 / Max: 13.73 Min: 14.65 / Avg: 14.67 / Max: 14.68 Min: 16.25 / Avg: 16.33 / Max: 16.41 Min: 17.17 / Avg: 17.19 / Max: 17.21 Min: 19.38 / Avg: 19.44 / Max: 19.51 Min: 20.18 / Avg: 20.24 / Max: 20.28 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Result
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2K 4K 6K 8K 10K SE +/- 0.81, N = 3 SE +/- 11.51, N = 3 SE +/- 0.73, N = 3 SE +/- 6.25, N = 3 SE +/- 8.09, N = 3 SE +/- 4.11, N = 3 SE +/- 5.68, N = 3 SE +/- 8.70, N = 3 3325.90 5483.81 4656.92 8719.37 2935.47 5576.86 2877.32 5525.56 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1500 3000 4500 6000 7500 Min: 3324.4 / Avg: 3325.9 / Max: 3327.18 Min: 5460.82 / Avg: 5483.81 / Max: 5496.2 Min: 4656.19 / Avg: 4656.92 / Max: 4658.37 Min: 8712.89 / Avg: 8719.37 / Max: 8731.87 Min: 2921.65 / Avg: 2935.47 / Max: 2949.68 Min: 5570.53 / Avg: 5576.86 / Max: 5584.57 Min: 2867.21 / Avg: 2877.32 / Max: 2886.87 Min: 5513.58 / Avg: 5525.56 / Max: 5542.48 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.30, N = 3 SE +/- 0.57, N = 3 SE +/- 0.22, N = 3 SE +/- 0.74, N = 3 SE +/- 0.01, N = 3 SE +/- 0.13, N = 3 55.12 78.40 47.90 70.44 61.83 76.42 61.01 79.38 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 15 30 45 60 75 Min: 55.06 / Avg: 55.12 / Max: 55.22 Min: 78.27 / Avg: 78.4 / Max: 78.57 Min: 47.51 / Avg: 47.9 / Max: 48.49 Min: 69.71 / Avg: 70.44 / Max: 71.56 Min: 61.53 / Avg: 61.83 / Max: 62.26 Min: 74.95 / Avg: 76.42 / Max: 77.24 Min: 60.99 / Avg: 61.01 / Max: 61.03 Min: 79.2 / Avg: 79.38 / Max: 79.62 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.13, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 18.14 12.75 20.88 14.20 16.17 13.09 16.39 12.60 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.30, N = 3 SE +/- 0.57, N = 3 SE +/- 0.22, N = 3 SE +/- 0.74, N = 3 SE +/- 0.01, N = 3 SE +/- 0.13, N = 3 55.12 78.40 47.90 70.44 61.83 76.42 61.01 79.38 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 Min: 18.11 / Avg: 18.14 / Max: 18.16 Min: 12.73 / Avg: 12.75 / Max: 12.78 Min: 20.62 / Avg: 20.88 / Max: 21.05 Min: 13.97 / Avg: 14.2 / Max: 14.35 Min: 16.06 / Avg: 16.17 / Max: 16.25 Min: 12.95 / Avg: 13.09 / Max: 13.34 Min: 16.39 / Avg: 16.39 / Max: 16.4 Min: 12.56 / Avg: 12.6 / Max: 12.63 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 16 32 48 64 80 SE +/- 0.18, N = 3 SE +/- 0.11, N = 3 SE +/- 0.57, N = 3 SE +/- 0.12, N = 3 SE +/- 0.23, N = 3 SE +/- 0.50, N = 3 SE +/- 0.31, N = 3 SE +/- 0.23, N = 3 62.13 68.83 50.83 64.79 61.25 72.80 63.54 73.97 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 14 28 42 56 70 Min: 61.93 / Avg: 62.13 / Max: 62.48 Min: 68.6 / Avg: 68.83 / Max: 68.96 Min: 50.26 / Avg: 50.83 / Max: 51.97 Min: 64.66 / Avg: 64.79 / Max: 65.03 Min: 60.83 / Avg: 61.25 / Max: 61.61 Min: 72.2 / Avg: 72.8 / Max: 73.79 Min: 62.99 / Avg: 63.54 / Max: 64.05 Min: 73.59 / Avg: 73.97 / Max: 74.37 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.22, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 16.10 14.53 19.68 15.43 16.33 13.74 15.74 13.52 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 16 32 48 64 80 SE +/- 0.18, N = 3 SE +/- 0.11, N = 3 SE +/- 0.57, N = 3 SE +/- 0.12, N = 3 SE +/- 0.23, N = 3 SE +/- 0.50, N = 3 SE +/- 0.31, N = 3 SE +/- 0.23, N = 3 62.13 68.83 50.83 64.79 61.25 72.80 63.54 73.97 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 Min: 16 / Avg: 16.1 / Max: 16.15 Min: 14.5 / Avg: 14.53 / Max: 14.58 Min: 19.24 / Avg: 19.68 / Max: 19.9 Min: 15.38 / Avg: 15.43 / Max: 15.47 Min: 16.23 / Avg: 16.33 / Max: 16.44 Min: 13.55 / Avg: 13.74 / Max: 13.85 Min: 15.61 / Avg: 15.74 / Max: 15.87 Min: 13.45 / Avg: 13.52 / Max: 13.59 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVINO Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 6.43 5.72 5.19 5.18 5.27 5.55 5.77 6.02 MIN: 3.84 / MAX: 15.83 MIN: 5.1 / MAX: 17.93 MIN: 4.72 / MAX: 11.02 MIN: 4.74 / MAX: 26.35 MIN: 4.98 / MAX: 13.16 MIN: 5.12 / MAX: 24.99 MIN: 5.26 / MAX: 13.86 MIN: 5.37 / MAX: 27.77 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 6.43 / Avg: 6.43 / Max: 6.44 Min: 5.72 / Avg: 5.72 / Max: 5.73 Min: 5.18 / Avg: 5.19 / Max: 5.19 Min: 5.17 / Avg: 5.18 / Max: 5.18 Min: 5.26 / Avg: 5.27 / Max: 5.29 Min: 5.55 / Avg: 5.55 / Max: 5.56 Min: 5.76 / Avg: 5.77 / Max: 5.78 Min: 6.02 / Avg: 6.02 / Max: 6.02 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Result
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5K 10K 15K 20K 25K SE +/- 5.45, N = 3 SE +/- 12.64, N = 3 SE +/- 4.30, N = 3 SE +/- 17.69, N = 3 SE +/- 18.13, N = 3 SE +/- 12.64, N = 3 SE +/- 7.39, N = 3 SE +/- 3.89, N = 3 9004.23 20937.58 12317.94 24676.86 9087.12 17252.27 9686.39 18561.91 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4K 8K 12K 16K 20K Min: 8995.55 / Avg: 9004.23 / Max: 9014.29 Min: 20913.51 / Avg: 20937.58 / Max: 20956.31 Min: 12311.49 / Avg: 12317.94 / Max: 12326.08 Min: 24653.87 / Avg: 24676.86 / Max: 24711.65 Min: 9051.23 / Avg: 9087.12 / Max: 9109.51 Min: 17227.05 / Avg: 17252.27 / Max: 17266.33 Min: 9673.85 / Avg: 9686.39 / Max: 9699.43 Min: 18557.63 / Avg: 18561.91 / Max: 18569.68 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 SE +/- 0.07, N = 3 SE +/- 0.28, N = 3 SE +/- 0.17, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 21.34 34.31 16.55 31.79 24.55 30.47 23.66 34.25 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 Min: 21.3 / Avg: 21.34 / Max: 21.43 Min: 34.17 / Avg: 34.31 / Max: 34.52 Min: 16.41 / Avg: 16.55 / Max: 16.64 Min: 31.51 / Avg: 31.79 / Max: 32.34 Min: 24.28 / Avg: 24.55 / Max: 24.86 Min: 30.32 / Avg: 30.47 / Max: 30.69 Min: 23.46 / Avg: 23.66 / Max: 23.86 Min: 34.08 / Avg: 34.25 / Max: 34.51 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 14 28 42 56 70 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.27, N = 3 SE +/- 0.27, N = 3 SE +/- 0.28, N = 3 SE +/- 0.12, N = 3 SE +/- 0.21, N = 3 SE +/- 0.11, N = 3 46.85 29.15 60.41 31.46 40.73 32.81 42.27 29.20 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 SE +/- 0.07, N = 3 SE +/- 0.28, N = 3 SE +/- 0.17, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 21.34 34.31 16.55 31.79 24.55 30.47 23.66 34.25 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12 24 36 48 60 Min: 46.65 / Avg: 46.85 / Max: 46.95 Min: 28.97 / Avg: 29.15 / Max: 29.27 Min: 60.09 / Avg: 60.41 / Max: 60.95 Min: 30.92 / Avg: 31.46 / Max: 31.73 Min: 40.22 / Avg: 40.73 / Max: 41.18 Min: 32.58 / Avg: 32.81 / Max: 32.98 Min: 41.9 / Avg: 42.27 / Max: 42.63 Min: 28.97 / Avg: 29.2 / Max: 29.34 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVINO Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 36.20 25.12 21.87 22.96 23.12 24.00 24.94 25.72 MIN: 20.73 / MAX: 45.28 MIN: 19.86 / MAX: 59.96 MIN: 20.16 / MAX: 32.36 MIN: 20.8 / MAX: 34.86 MIN: 18.74 / MAX: 31.08 MIN: 19.19 / MAX: 45.88 MIN: 19.75 / MAX: 33.18 MIN: 20.7 / MAX: 44.98 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 Min: 36.13 / Avg: 36.2 / Max: 36.25 Min: 25.11 / Avg: 25.12 / Max: 25.12 Min: 21.86 / Avg: 21.87 / Max: 21.88 Min: 22.93 / Avg: 22.96 / Max: 22.98 Min: 23.07 / Avg: 23.12 / Max: 23.2 Min: 23.99 / Avg: 24 / Max: 24.01 Min: 24.85 / Avg: 24.94 / Max: 25.03 Min: 25.7 / Avg: 25.72 / Max: 25.75 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Result
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1200 2400 3600 4800 6000 SE +/- 1.46, N = 3 SE +/- 2.46, N = 3 SE +/- 0.73, N = 3 SE +/- 3.43, N = 3 SE +/- 3.41, N = 3 SE +/- 1.09, N = 3 SE +/- 4.55, N = 3 SE +/- 2.81, N = 3 1643.43 4744.05 2924.66 5570.63 2074.30 3998.02 2243.84 4351.59 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl Result Confidence
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1000 2000 3000 4000 5000 Min: 1640.97 / Avg: 1643.43 / Max: 1646.02 Min: 4741.37 / Avg: 4744.05 / Max: 4748.96 Min: 2923.2 / Avg: 2924.66 / Max: 2925.43 Min: 5565.94 / Avg: 5570.63 / Max: 5577.32 Min: 2067.66 / Avg: 2074.3 / Max: 2078.94 Min: 3995.99 / Avg: 3998.02 / Max: 3999.72 Min: 2236.43 / Avg: 2243.84 / Max: 2252.13 Min: 4346.02 / Avg: 4351.59 / Max: 4355.05 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
GraphicsMagick Result
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Sharpen Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 60 120 180 240 300 SE +/- 0.33, N = 3 SE +/- 1.67, N = 3 SE +/- 0.00, N = 3 SE +/- 1.67, N = 3 SE +/- 0.00, N = 3 SE +/- 1.20, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 157 265 167 284 114 199 130 227 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp Result Confidence
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Sharpen Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50 100 150 200 250 Min: 156 / Avg: 156.67 / Max: 157 Min: 262 / Avg: 265.33 / Max: 267 Min: 167 / Avg: 167 / Max: 167 Min: 281 / Avg: 284.33 / Max: 286 Min: 114 / Avg: 114 / Max: 114 Min: 197 / Avg: 199.33 / Max: 201 Min: 130 / Avg: 130 / Max: 130 Min: 226 / Avg: 226.67 / Max: 227 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
Result
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Noise-Gaussian Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 SE +/- 0.33, N = 3 SE +/- 1.15, N = 3 SE +/- 0.00, N = 3 SE +/- 0.88, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 158 182 171 194 150 150 158 164 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp Result Confidence
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Noise-Gaussian Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 Min: 158 / Avg: 158.33 / Max: 159 Min: 180 / Avg: 182 / Max: 184 Min: 171 / Avg: 171 / Max: 171 Min: 192 / Avg: 193.67 / Max: 195 Min: 149 / Avg: 149.67 / Max: 150 Min: 149 / Avg: 150 / Max: 151 Min: 157 / Avg: 157.67 / Max: 158 Min: 164 / Avg: 164.33 / Max: 165 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
Result
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Resizing Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50 100 150 200 250 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 229 95 230 96 245 108 213 97 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp Result Confidence
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Resizing Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 Min: 229 / Avg: 229.33 / Max: 230 Min: 94 / Avg: 94.67 / Max: 95 Min: 230 / Avg: 230.33 / Max: 231 Min: 96 / Avg: 96.33 / Max: 97 Min: 244 / Avg: 245 / Max: 246 Min: 107 / Avg: 107.67 / Max: 108 Min: 212 / Avg: 213 / Max: 214 Min: 97 / Avg: 97.33 / Max: 98 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.00544, N = 3 SE +/- 0.02968, N = 3 SE +/- 0.02630, N = 3 SE +/- 0.06875, N = 3 SE +/- 0.01698, N = 3 SE +/- 0.01680, N = 3 SE +/- 0.03023, N = 3 SE +/- 0.03080, N = 3 3.19298 6.39031 3.23780 6.49693 3.13366 6.00525 3.32030 6.51744 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 3.18 / Avg: 3.19 / Max: 3.2 Min: 6.35 / Avg: 6.39 / Max: 6.45 Min: 3.19 / Avg: 3.24 / Max: 3.28 Min: 6.37 / Avg: 6.5 / Max: 6.61 Min: 3.1 / Avg: 3.13 / Max: 3.15 Min: 5.97 / Avg: 6.01 / Max: 6.02 Min: 3.27 / Avg: 3.32 / Max: 3.38 Min: 6.46 / Avg: 6.52 / Max: 6.57 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 70 140 210 280 350 SE +/- 0.53, N = 3 SE +/- 0.73, N = 3 SE +/- 2.50, N = 3 SE +/- 1.63, N = 3 SE +/- 1.74, N = 3 SE +/- 0.47, N = 3 SE +/- 2.72, N = 3 SE +/- 0.73, N = 3 313.10 156.46 308.80 153.92 319.04 166.49 301.14 153.41 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.00544, N = 3 SE +/- 0.02968, N = 3 SE +/- 0.02630, N = 3 SE +/- 0.06875, N = 3 SE +/- 0.01698, N = 3 SE +/- 0.01680, N = 3 SE +/- 0.03023, N = 3 SE +/- 0.03080, N = 3 3.19298 6.39031 3.23780 6.49693 3.13366 6.00525 3.32030 6.51744 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 60 120 180 240 300 Min: 312.35 / Avg: 313.1 / Max: 314.13 Min: 155.06 / Avg: 156.46 / Max: 157.5 Min: 304.4 / Avg: 308.8 / Max: 313.06 Min: 151.21 / Avg: 153.92 / Max: 156.84 Min: 316.97 / Avg: 319.04 / Max: 322.5 Min: 166.02 / Avg: 166.49 / Max: 167.42 Min: 296.09 / Avg: 301.14 / Max: 305.44 Min: 152.27 / Avg: 153.41 / Max: 154.76 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
GraphicsMagick Result
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: HWB Color Space Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 60 120 180 240 300 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.67, N = 3 SE +/- 0.33, N = 3 SE +/- 1.00, N = 3 SE +/- 1.20, N = 3 SE +/- 0.58, N = 3 SE +/- 2.40, N = 3 265 236 285 256 286 193 277 207 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp Result Confidence
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: HWB Color Space Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50 100 150 200 250 Min: 264 / Avg: 264.67 / Max: 265 Min: 236 / Avg: 236 / Max: 236 Min: 284 / Avg: 285.33 / Max: 286 Min: 256 / Avg: 256.33 / Max: 257 Min: 285 / Avg: 286 / Max: 288 Min: 191 / Avg: 193.33 / Max: 195 Min: 276 / Avg: 277 / Max: 278 Min: 202 / Avg: 206.67 / Max: 210 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
Result
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Enhanced Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 80 160 240 320 400 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 1.15, N = 3 SE +/- 0.00, N = 3 SE +/- 2.60, N = 3 SE +/- 0.00, N = 3 SE +/- 1.00, N = 3 216 342 228 374 160 269 181 301 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp Result Confidence
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Enhanced Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 70 140 210 280 350 Min: 216 / Avg: 216 / Max: 216 Min: 342 / Avg: 342.33 / Max: 343 Min: 228 / Avg: 228 / Max: 228 Min: 372 / Avg: 374 / Max: 376 Min: 160 / Avg: 160 / Max: 160 Min: 265 / Avg: 269.33 / Max: 274 Min: 181 / Avg: 181 / Max: 181 Min: 299 / Avg: 301 / Max: 302 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1.3244 2.6488 3.9732 5.2976 6.622 SE +/- 0.05586, N = 3 SE +/- 0.02062, N = 3 SE +/- 0.03569, N = 3 SE +/- 0.02988, N = 3 SE +/- 0.02534, N = 3 SE +/- 0.03854, N = 3 SE +/- 0.01694, N = 3 SE +/- 0.02155, N = 3 4.86604 5.29287 4.26352 4.65431 5.10914 5.74921 5.26075 5.88628 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 4.78 / Avg: 4.87 / Max: 4.97 Min: 5.25 / Avg: 5.29 / Max: 5.32 Min: 4.19 / Avg: 4.26 / Max: 4.3 Min: 4.6 / Avg: 4.65 / Max: 4.7 Min: 5.06 / Avg: 5.11 / Max: 5.14 Min: 5.68 / Avg: 5.75 / Max: 5.81 Min: 5.24 / Avg: 5.26 / Max: 5.29 Min: 5.85 / Avg: 5.89 / Max: 5.93 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50 100 150 200 250 SE +/- 2.34, N = 3 SE +/- 0.74, N = 3 SE +/- 1.98, N = 3 SE +/- 1.38, N = 3 SE +/- 0.98, N = 3 SE +/- 1.17, N = 3 SE +/- 0.61, N = 3 SE +/- 0.62, N = 3 205.53 188.89 234.54 214.81 195.71 173.91 190.06 169.85 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1.3244 2.6488 3.9732 5.2976 6.622 SE +/- 0.05586, N = 3 SE +/- 0.02062, N = 3 SE +/- 0.03569, N = 3 SE +/- 0.02988, N = 3 SE +/- 0.02534, N = 3 SE +/- 0.03854, N = 3 SE +/- 0.01694, N = 3 SE +/- 0.02155, N = 3 4.86604 5.29287 4.26352 4.65431 5.10914 5.74921 5.26075 5.88628 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Result Confidence
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Parallel Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 Min: 201.08 / Avg: 205.52 / Max: 209.04 Min: 187.98 / Avg: 188.89 / Max: 190.35 Min: 232.42 / Avg: 234.54 / Max: 238.5 Min: 212.63 / Avg: 214.81 / Max: 217.37 Min: 194.68 / Avg: 195.71 / Max: 197.66 Min: 172.15 / Avg: 173.91 / Max: 176.13 Min: 188.89 / Avg: 190.06 / Max: 190.94 Min: 168.73 / Avg: 169.85 / Max: 170.87 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
GraphicsMagick Result
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Swirl Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 150 300 450 600 750 SE +/- 1.15, N = 3 SE +/- 1.76, N = 3 SE +/- 0.88, N = 3 SE +/- 0.58, N = 3 SE +/- 0.58, N = 3 SE +/- 1.33, N = 3 SE +/- 0.67, N = 3 SE +/- 0.67, N = 3 502 617 529 689 394 509 432 558 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp Result Confidence
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Swirl Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 120 240 360 480 600 Min: 500 / Avg: 502 / Max: 504 Min: 614 / Avg: 616.67 / Max: 620 Min: 528 / Avg: 529.33 / Max: 531 Min: 688 / Avg: 689 / Max: 690 Min: 393 / Avg: 394 / Max: 395 Min: 508 / Avg: 509.33 / Max: 512 Min: 431 / Avg: 432.33 / Max: 433 Min: 557 / Avg: 557.67 / Max: 559 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
RocksDB Result
OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Random Read Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 120M 240M 360M 480M 600M SE +/- 3338569.32, N = 3 SE +/- 1411218.60, N = 3 SE +/- 1119855.47, N = 3 SE +/- 82996.27, N = 3 SE +/- 81327.78, N = 3 SE +/- 1120857.00, N = 3 SE +/- 86315.43, N = 3 SE +/- 785893.13, N = 3 265366170 525049998 297517946 578392800 205346154 405533173 234469939 473755946 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread Result Confidence
OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Random Read Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 100M 200M 300M 400M 500M Min: 261907154 / Avg: 265366169.67 / Max: 272041842 Min: 523359264 / Avg: 525049998.33 / Max: 527852577 Min: 295339623 / Avg: 297517946 / Max: 299058118 Min: 578230155 / Avg: 578392800 / Max: 578502847 Min: 205193864 / Avg: 205346153.67 / Max: 205471781 Min: 403617121 / Avg: 405533172.67 / Max: 407498929 Min: 234318066 / Avg: 234469938.67 / Max: 234616953 Min: 472700204 / Avg: 473755946.33 / Max: 475292252 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Blender Result
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Classroom - Compute: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 SE +/- 0.22, N = 3 SE +/- 0.20, N = 3 SE +/- 0.38, N = 3 SE +/- 0.40, N = 3 SE +/- 0.25, N = 3 68.61 35.91 63.61 33.61 86.67 44.71 76.87 40.38 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Classroom - Compute: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 16 32 48 64 80 Min: 68.53 / Avg: 68.61 / Max: 68.66 Min: 35.81 / Avg: 35.91 / Max: 35.98 Min: 63.41 / Avg: 63.61 / Max: 63.77 Min: 33.38 / Avg: 33.61 / Max: 34.04 Min: 86.32 / Avg: 86.67 / Max: 87 Min: 44.3 / Avg: 44.71 / Max: 45.47 Min: 76.14 / Avg: 76.87 / Max: 77.5 Min: 39.89 / Avg: 40.38 / Max: 40.74
PyTorch Result
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 14 28 42 56 70 SE +/- 0.52, N = 3 SE +/- 0.49, N = 3 SE +/- 0.64, N = 3 SE +/- 0.29, N = 3 SE +/- 0.76, N = 3 SE +/- 0.52, N = 3 SE +/- 0.62, N = 3 SE +/- 0.45, N = 3 54.84 37.44 63.60 41.45 52.97 41.68 51.56 37.91 MIN: 46.5 / MAX: 58.5 MIN: 26.88 / MAX: 41.26 MIN: 37.79 / MAX: 65.67 MIN: 38.42 / MAX: 42.93 MIN: 33.28 / MAX: 55.78 MIN: 37.38 / MAX: 44.02 MIN: 30.49 / MAX: 54.7 MIN: 16.15 / MAX: 40.53 Result Confidence
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12 24 36 48 60 Min: 53.9 / Avg: 54.84 / Max: 55.68 Min: 36.73 / Avg: 37.44 / Max: 38.39 Min: 62.37 / Avg: 63.6 / Max: 64.51 Min: 40.97 / Avg: 41.45 / Max: 41.96 Min: 51.73 / Avg: 52.97 / Max: 54.35 Min: 40.84 / Avg: 41.68 / Max: 42.62 Min: 50.46 / Avg: 51.56 / Max: 52.61 Min: 37.02 / Avg: 37.91 / Max: 38.38
Result
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 14 28 42 56 70 SE +/- 0.24, N = 3 SE +/- 0.50, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.71, N = 3 SE +/- 0.51, N = 3 SE +/- 0.62, N = 3 SE +/- 0.46, N = 4 56.01 37.08 63.06 40.77 51.55 42.35 51.35 38.30 MIN: 51.84 / MAX: 59.12 MIN: 26.46 / MAX: 40.15 MIN: 33.2 / MAX: 65.54 MIN: 16.88 / MAX: 42.06 MIN: 37.49 / MAX: 54.33 MIN: 36.76 / MAX: 44.4 MIN: 41.6 / MAX: 53.81 MIN: 27.11 / MAX: 40.39 Result Confidence
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12 24 36 48 60 Min: 55.54 / Avg: 56.01 / Max: 56.33 Min: 36.19 / Avg: 37.08 / Max: 37.92 Min: 62.84 / Avg: 63.06 / Max: 63.24 Min: 40.55 / Avg: 40.77 / Max: 40.96 Min: 50.78 / Avg: 51.55 / Max: 52.97 Min: 41.36 / Avg: 42.35 / Max: 43.03 Min: 50.48 / Avg: 51.35 / Max: 52.55 Min: 36.95 / Avg: 38.3 / Max: 38.97
CloverLeaf CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm64_short Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 10 20 30 40 50 SE +/- 0.02, N = 3 SE +/- 0.24, N = 3 SE +/- 0.03, N = 3 SE +/- 0.45, N = 3 SE +/- 0.15, N = 3 SE +/- 0.31, N = 15 SE +/- 0.17, N = 3 SE +/- 0.40, N = 4 39.48 26.58 39.38 31.90 41.43 32.25 42.22 32.44 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm64_short Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 Min: 39.45 / Avg: 39.48 / Max: 39.52 Min: 26.11 / Avg: 26.58 / Max: 26.87 Min: 39.35 / Avg: 39.38 / Max: 39.44 Min: 31.03 / Avg: 31.9 / Max: 32.55 Min: 41.15 / Avg: 41.43 / Max: 41.66 Min: 30.55 / Avg: 32.25 / Max: 34.35 Min: 41.95 / Avg: 42.22 / Max: 42.54 Min: 31.41 / Avg: 32.44 / Max: 33.19 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
Llamafile Result
OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.7 Test: llava-v1.5-7b-q4 - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 SE +/- 0.15, N = 4 SE +/- 0.09, N = 15 SE +/- 0.17, N = 4 SE +/- 1.08, N = 12 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 20.95 10.44 16.61 7.49 7.67 7.77 8.13 7.26 Result Confidence
OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.7 Test: llava-v1.5-7b-q4 - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 Min: 20.63 / Avg: 20.95 / Max: 21.26 Min: 9.84 / Avg: 10.44 / Max: 11.02 Min: 16.11 / Avg: 16.61 / Max: 16.84 Min: 1.11 / Avg: 7.49 / Max: 9.77 Min: 7.55 / Avg: 7.67 / Max: 7.87 Min: 7.68 / Avg: 7.77 / Max: 7.82 Min: 8.1 / Avg: 8.13 / Max: 8.18 Min: 7.21 / Avg: 7.26 / Max: 7.34
srsRAN Project Result
OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Total Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7K 14K 21K 28K 35K SE +/- 236.27, N = 4 SE +/- 312.17, N = 3 SE +/- 298.34, N = 15 SE +/- 356.81, N = 15 SE +/- 938.95, N = 15 SE +/- 175.78, N = 4 SE +/- 281.72, N = 15 SE +/- 490.54, N = 15 24688.5 30108.7 26378.1 30547.6 21286.6 30236.0 15081.0 11866.7 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl Result Confidence
OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Total Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5K 10K 15K 20K 25K Min: 24005.5 / Avg: 24688.5 / Max: 25092.7 Min: 29484.5 / Avg: 30108.7 / Max: 30432.5 Min: 24120 / Avg: 26378.14 / Max: 28050.8 Min: 28535.9 / Avg: 30547.59 / Max: 33263.4 Min: 13002.8 / Avg: 21286.6 / Max: 24103.3 Min: 29772.1 / Avg: 30235.98 / Max: 30546.3 Min: 13387.5 / Avg: 15080.97 / Max: 17986.8 Min: 10692.2 / Avg: 11866.71 / Max: 17213 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl
RawTherapee RawTherapee is a cross-platform, open-source multi-threaded RAW image processing program. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better RawTherapee Total Benchmark Time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 13 26 39 52 65 SE +/- 0.17, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 SE +/- 0.08, N = 3 SE +/- 0.19, N = 3 46.76 53.76 42.78 52.69 46.96 55.44 47.09 56.78 1. RawTherapee, version 5.10, command line. Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better RawTherapee Total Benchmark Time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11 22 33 44 55 Min: 46.41 / Avg: 46.76 / Max: 46.93 Min: 53.6 / Avg: 53.76 / Max: 53.89 Min: 42.72 / Avg: 42.77 / Max: 42.85 Min: 52.61 / Avg: 52.69 / Max: 52.78 Min: 46.84 / Avg: 46.96 / Max: 47.07 Min: 55.34 / Avg: 55.44 / Max: 55.64 Min: 46.97 / Avg: 47.09 / Max: 47.23 Min: 56.47 / Avg: 56.78 / Max: 57.13 1. RawTherapee, version 5.10, command line.
GPAW GPAW is a density-functional theory (DFT) Python code based on the projector-augmented wave (PAW) method and the atomic simulation environment (ASE). Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better GPAW 23.6 Input: Carbon Nanotube Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12 24 36 48 60 SE +/- 0.24, N = 3 SE +/- 0.55, N = 3 SE +/- 0.12, N = 3 SE +/- 0.10, N = 3 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 SE +/- 0.27, N = 3 47.78 41.56 43.05 38.05 54.38 42.87 48.49 43.91 1. (CC) gcc options: -shared -lxc -lblas -lmpi Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better GPAW 23.6 Input: Carbon Nanotube Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11 22 33 44 55 Min: 47.32 / Avg: 47.78 / Max: 48.11 Min: 41.01 / Avg: 41.56 / Max: 42.67 Min: 42.84 / Avg: 43.05 / Max: 43.24 Min: 37.88 / Avg: 38.05 / Max: 38.21 Min: 54.33 / Avg: 54.38 / Max: 54.43 Min: 42.73 / Avg: 42.87 / Max: 43.02 Min: 48.34 / Avg: 48.49 / Max: 48.59 Min: 43.62 / Avg: 43.91 / Max: 44.46 1. (CC) gcc options: -shared -lxc -lblas -lmpi
VVenC Result
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Faster Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.16, N = 3 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 SE +/- 0.13, N = 3 SE +/- 0.13, N = 3 15.06 12.54 15.97 13.26 14.10 11.90 14.36 11.97 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Faster Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 Min: 15.03 / Avg: 15.06 / Max: 15.09 Min: 12.28 / Avg: 12.54 / Max: 12.83 Min: 15.87 / Avg: 15.97 / Max: 16.12 Min: 13.03 / Avg: 13.26 / Max: 13.44 Min: 14.04 / Avg: 14.1 / Max: 14.19 Min: 11.68 / Avg: 11.9 / Max: 12.05 Min: 14.1 / Avg: 14.36 / Max: 14.53 Min: 11.71 / Avg: 11.97 / Max: 12.15 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
Coremark This is a test of EEMBC CoreMark processor benchmark. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Iterations/Sec, More Is Better Coremark 1.0 CoreMark Size 666 - Iterations Per Second Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1.1M 2.2M 3.3M 4.4M 5.5M SE +/- 9256.47, N = 3 SE +/- 12743.41, N = 3 SE +/- 4635.95, N = 3 SE +/- 9700.21, N = 3 SE +/- 1747.99, N = 3 SE +/- 7219.73, N = 3 SE +/- 5202.86, N = 3 SE +/- 20649.43, N = 3 2194630.60 3902076.24 2369998.36 4966250.78 1614763.70 2993136.60 1855135.33 3279262.53 1. (CC) gcc options: -O2 -lrt" -lrt Result Confidence
OpenBenchmarking.org Iterations/Sec, More Is Better Coremark 1.0 CoreMark Size 666 - Iterations Per Second Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 900K 1800K 2700K 3600K 4500K Min: 2176176.81 / Avg: 2194630.6 / Max: 2205138.14 Min: 3878640.96 / Avg: 3902076.24 / Max: 3922469.93 Min: 2363949.77 / Avg: 2369998.36 / Max: 2379108.45 Min: 4952761.75 / Avg: 4966250.78 / Max: 4985070.75 Min: 1611278.95 / Avg: 1614763.7 / Max: 1616748.5 Min: 2983161.45 / Avg: 2993136.6 / Max: 3007165.51 Min: 1844878.84 / Avg: 1855135.33 / Max: 1861784.33 Min: 3249040.2 / Avg: 3279262.53 / Max: 3318748.99 1. (CC) gcc options: -O2 -lrt" -lrt
miniFE MiniFE Finite Element is an application for unstructured implicit finite element codes. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org CG Mflops, More Is Better miniFE 2.2 Problem Size: Small Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 10K 20K 30K 40K 50K SE +/- 11.14, N = 4 SE +/- 467.78, N = 4 SE +/- 135.77, N = 4 SE +/- 1633.92, N = 15 SE +/- 601.03, N = 12 SE +/- 1097.75, N = 15 SE +/- 572.00, N = 12 SE +/- 283.44, N = 3 35230.1 46877.5 31830.2 42114.6 20091.1 19876.5 18621.2 21583.2 1. (CXX) g++ options: -O3 -fopenmp -lmpi_cxx -lmpi Result Confidence
OpenBenchmarking.org CG Mflops, More Is Better miniFE 2.2 Problem Size: Small Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8K 16K 24K 32K 40K Min: 35202.3 / Avg: 35230.08 / Max: 35256.3 Min: 45706.5 / Avg: 46877.53 / Max: 47668.4 Min: 31581.2 / Avg: 31830.2 / Max: 32217.1 Min: 26242 / Avg: 42114.62 / Max: 48682.4 Min: 17078.6 / Avg: 20091.11 / Max: 23135.7 Min: 12173.5 / Avg: 19876.54 / Max: 26049.5 Min: 16170.7 / Avg: 18621.23 / Max: 22590.4 Min: 21273.9 / Avg: 21583.23 / Max: 22149.3 1. (CXX) g++ options: -O3 -fopenmp -lmpi_cxx -lmpi
Timed PHP Compilation Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed PHP Compilation 8.3.4 Time To Compile Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11 22 33 44 55 SE +/- 0.16, N = 3 SE +/- 0.07, N = 3 SE +/- 0.31, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.16, N = 3 SE +/- 0.07, N = 3 48.01 46.64 41.85 40.38 48.71 46.87 47.95 46.57 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Timed PHP Compilation 8.3.4 Time To Compile Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 10 20 30 40 50 Min: 47.75 / Avg: 48.01 / Max: 48.29 Min: 46.53 / Avg: 46.64 / Max: 46.77 Min: 41.32 / Avg: 41.85 / Max: 42.39 Min: 40.26 / Avg: 40.38 / Max: 40.56 Min: 48.64 / Avg: 48.71 / Max: 48.76 Min: 46.76 / Avg: 46.87 / Max: 46.96 Min: 47.68 / Avg: 47.95 / Max: 48.24 Min: 46.46 / Avg: 46.57 / Max: 46.71
John The Ripper This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: WPA PSK Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 200K 400K 600K 800K 1000K SE +/- 1599.31, N = 3 SE +/- 2519.00, N = 3 SE +/- 864.17, N = 3 SE +/- 15579.94, N = 15 SE +/- 987.33, N = 3 SE +/- 5122.51, N = 3 SE +/- 1274.00, N = 3 SE +/- 788.50, N = 3 401278 793253 428116 797093 286552 562875 334076 657889 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2 Result Confidence
OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: WPA PSK Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 140K 280K 420K 560K 700K Min: 398080 / Avg: 401277.67 / Max: 402944 Min: 788217 / Avg: 793253 / Max: 795894 Min: 426388 / Avg: 428116.33 / Max: 428987 Min: 670974 / Avg: 797093.27 / Max: 846770 Min: 284577 / Avg: 286551.67 / Max: 287539 Min: 553185 / Avg: 562874.67 / Max: 570601 Min: 331528 / Avg: 334076 / Max: 335350 Min: 656370 / Avg: 657888.67 / Max: 659016 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
7-Zip Compression This is a test of 7-Zip compression/decompression with its integrated benchmark feature. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 120K 240K 360K 480K 600K SE +/- 61.74, N = 3 SE +/- 185.14, N = 3 SE +/- 119.21, N = 3 SE +/- 28320.74, N = 3 SE +/- 916.22, N = 3 SE +/- 2598.93, N = 3 SE +/- 374.59, N = 3 SE +/- 6276.88, N = 3 287862 557054 338146 573410 207738 401707 243347 469131 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC Result Confidence
OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 100K 200K 300K 400K 500K Min: 287786 / Avg: 287861.67 / Max: 287984 Min: 556694 / Avg: 557054 / Max: 557309 Min: 338011 / Avg: 338146.33 / Max: 338384 Min: 529470 / Avg: 573410 / Max: 626334 Min: 206272 / Avg: 207737.67 / Max: 209423 Min: 396748 / Avg: 401707.33 / Max: 405535 Min: 242598 / Avg: 243347 / Max: 243736 Min: 456604 / Avg: 469131 / Max: 476104 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
Result
OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Compression Rating Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 140K 280K 420K 560K 700K SE +/- 1535.53, N = 3 SE +/- 4200.62, N = 3 SE +/- 1982.97, N = 3 SE +/- 709.87, N = 3 SE +/- 1836.55, N = 3 SE +/- 5127.15, N = 3 SE +/- 2258.81, N = 3 SE +/- 3924.87, N = 3 388190 592729 441636 674239 314716 491729 342363 525514 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC Result Confidence
OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Compression Rating Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 120K 240K 360K 480K 600K Min: 386105 / Avg: 388189.67 / Max: 391185 Min: 588274 / Avg: 592729 / Max: 601125 Min: 439125 / Avg: 441636 / Max: 445550 Min: 673306 / Avg: 674238.67 / Max: 675632 Min: 312328 / Avg: 314716 / Max: 318327 Min: 484529 / Avg: 491728.67 / Max: 501652 Min: 338862 / Avg: 342362.67 / Max: 346586 Min: 521447 / Avg: 525514 / Max: 533362 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
LuxCoreRender LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Rainbow Colors and Prism - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 SE +/- 0.05, N = 4 SE +/- 0.10, N = 15 SE +/- 0.15, N = 4 SE +/- 0.04, N = 3 SE +/- 0.12, N = 7 SE +/- 0.07, N = 15 SE +/- 0.06, N = 4 SE +/- 0.03, N = 3 13.54 5.96 14.28 7.22 12.80 9.64 12.97 6.51 MIN: 13.42 / MAX: 13.68 MIN: 5.5 / MAX: 7.04 MIN: 12.85 / MAX: 14.54 MIN: 7.13 / MAX: 7.4 MIN: 11.39 / MAX: 13.21 MIN: 8.98 / MAX: 10.13 MIN: 12.11 / MAX: 13.11 MIN: 6.27 / MAX: 6.67 Result Confidence
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Rainbow Colors and Prism - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 Min: 13.43 / Avg: 13.54 / Max: 13.67 Min: 5.56 / Avg: 5.96 / Max: 7.02 Min: 13.84 / Avg: 14.28 / Max: 14.53 Min: 7.15 / Avg: 7.22 / Max: 7.3 Min: 12.15 / Avg: 12.8 / Max: 13.09 Min: 9.03 / Avg: 9.64 / Max: 10.09 Min: 12.87 / Avg: 12.97 / Max: 13.07 Min: 6.47 / Avg: 6.51 / Max: 6.56
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4M 8M 12M 16M 20M SE +/- 8685.88, N = 3 SE +/- 38670.98, N = 3 SE +/- 9492.69, N = 3 SE +/- 162096.41, N = 15 SE +/- 5238.74, N = 3 SE +/- 17457.89, N = 3 SE +/- 30179.10, N = 3 SE +/- 7571.88, N = 3 16882333 16843333 18774333 18200533 16906333 16904667 16885333 16884000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid Result Confidence
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3M 6M 9M 12M 15M Min: 16868000 / Avg: 16882333.33 / Max: 16898000 Min: 16766000 / Avg: 16843333.33 / Max: 16883000 Min: 18762000 / Avg: 18774333.33 / Max: 18793000 Min: 17032000 / Avg: 18200533.33 / Max: 19386000 Min: 16896000 / Avg: 16906333.33 / Max: 16913000 Min: 16879000 / Avg: 16904666.67 / Max: 16938000 Min: 16825000 / Avg: 16885333.33 / Max: 16917000 Min: 16870000 / Avg: 16884000 / Max: 16896000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Timed Linux Kernel Compilation Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: defconfig Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 10 20 30 40 50 SE +/- 0.55, N = 3 SE +/- 0.43, N = 3 SE +/- 0.39, N = 4 SE +/- 0.23, N = 7 SE +/- 0.59, N = 3 SE +/- 0.40, N = 4 SE +/- 0.57, N = 3 SE +/- 0.31, N = 5 39.45 29.98 34.59 25.87 43.42 32.14 40.50 30.53 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: defconfig Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 Min: 38.81 / Avg: 39.45 / Max: 40.55 Min: 29.37 / Avg: 29.98 / Max: 30.81 Min: 34.14 / Avg: 34.59 / Max: 35.77 Min: 25.39 / Avg: 25.87 / Max: 27.23 Min: 42.78 / Avg: 43.42 / Max: 44.59 Min: 31.72 / Avg: 32.14 / Max: 33.34 Min: 39.82 / Avg: 40.5 / Max: 41.63 Min: 30.11 / Avg: 30.53 / Max: 31.78
WebP Image Encode This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Lossless, Highest Compression Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.135 0.27 0.405 0.54 0.675 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.52 0.51 0.60 0.59 0.55 0.54 0.55 0.54 1. (CC) gcc options: -fvisibility=hidden -O2 -lm Result Confidence
OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Lossless, Highest Compression Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 0.52 / Avg: 0.52 / Max: 0.52 Min: 0.51 / Avg: 0.51 / Max: 0.52 Min: 0.6 / Avg: 0.6 / Max: 0.6 Min: 0.58 / Avg: 0.59 / Max: 0.6 Min: 0.54 / Avg: 0.55 / Max: 0.55 Min: 0.53 / Avg: 0.54 / Max: 0.55 Min: 0.55 / Avg: 0.55 / Max: 0.55 Min: 0.54 / Avg: 0.54 / Max: 0.55 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
TensorFlow Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: AlexNet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 400 800 1200 1600 2000 SE +/- 0.51, N = 3 SE +/- 18.52, N = 3 SE +/- 1.84, N = 3 SE +/- 19.23, N = 3 SE +/- 3.89, N = 3 SE +/- 17.88, N = 4 SE +/- 5.13, N = 3 SE +/- 8.55, N = 3 1278.45 1899.64 1486.12 2039.63 1047.96 1604.11 1108.95 1677.62 Result Confidence
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: AlexNet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 400 800 1200 1600 2000 Min: 1277.58 / Avg: 1278.45 / Max: 1279.36 Min: 1868.64 / Avg: 1899.64 / Max: 1932.69 Min: 1482.99 / Avg: 1486.12 / Max: 1489.37 Min: 2015.57 / Avg: 2039.63 / Max: 2077.65 Min: 1040.33 / Avg: 1047.96 / Max: 1053.1 Min: 1571.21 / Avg: 1604.11 / Max: 1643.67 Min: 1099.81 / Avg: 1108.95 / Max: 1117.55 Min: 1660.98 / Avg: 1677.62 / Max: 1689.32
JPEG-XL libjxl Result
OpenBenchmarking.org MP/s, More Is Better JPEG-XL libjxl 0.10.1 Input: PNG - Quality: 90 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11 22 33 44 55 SE +/- 0.17, N = 3 SE +/- 0.12, N = 3 SE +/- 0.49, N = 14 SE +/- 0.50, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.32, N = 3 42.91 40.08 46.32 39.52 43.36 34.83 40.35 33.27 1. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm Result Confidence
OpenBenchmarking.org MP/s, More Is Better JPEG-XL libjxl 0.10.1 Input: PNG - Quality: 90 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 Min: 42.58 / Avg: 42.91 / Max: 43.09 Min: 39.86 / Avg: 40.07 / Max: 40.27 Min: 43.16 / Avg: 46.32 / Max: 50.03 Min: 38.68 / Avg: 39.52 / Max: 40.41 Min: 43.3 / Avg: 43.36 / Max: 43.42 Min: 34.77 / Avg: 34.83 / Max: 34.92 Min: 40.3 / Avg: 40.35 / Max: 40.42 Min: 32.86 / Avg: 33.27 / Max: 33.91 1. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm
Primesieve Result
OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e13 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 15 30 45 60 75 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 51.82 27.11 48.41 25.02 67.32 33.92 58.16 30.20 1. (CXX) g++ options: -O3 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e13 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 13 26 39 52 65 Min: 51.77 / Avg: 51.82 / Max: 51.9 Min: 27.09 / Avg: 27.11 / Max: 27.13 Min: 48.35 / Avg: 48.41 / Max: 48.48 Min: 24.98 / Avg: 25.02 / Max: 25.09 Min: 67.25 / Avg: 67.32 / Max: 67.47 Min: 33.85 / Avg: 33.92 / Max: 33.97 Min: 58.09 / Avg: 58.16 / Max: 58.21 Min: 30.13 / Avg: 30.2 / Max: 30.33 1. (CXX) g++ options: -O3
Graph500 OpenBenchmarking.org sssp median_TEPS, More Is Better Graph500 3.0 Scale: 26 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 100M 200M 300M 400M 500M 416523000 484977000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi Scale: 26
Xeon Platinum 8490H: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Platinum 8490H 2P: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Max 9468: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Max 9468 2P: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Max 9480: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Max 9480 2P: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
OpenBenchmarking.org sssp max_TEPS, More Is Better Graph500 3.0 Scale: 26 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 140M 280M 420M 560M 700M 539613000 667365000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi Scale: 26
Xeon Platinum 8490H: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Platinum 8490H 2P: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Max 9468: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Max 9468 2P: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Max 9480: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Max 9480 2P: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
OpenBenchmarking.org bfs median_TEPS, More Is Better Graph500 3.0 Scale: 26 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 300M 600M 900M 1200M 1500M 1244300000 1204520000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi Scale: 26
Xeon Platinum 8490H: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Platinum 8490H 2P: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Max 9468: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Max 9468 2P: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Max 9480: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Max 9480 2P: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
OpenBenchmarking.org bfs max_TEPS, More Is Better Graph500 3.0 Scale: 26 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 300M 600M 900M 1200M 1500M 1299170000 1267480000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi Scale: 26
Xeon Platinum 8490H: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Platinum 8490H 2P: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Max 9468: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Max 9468 2P: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Max 9480: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Xeon Max 9480 2P: The test quit with a non-zero exit status. E: AML: Fatal: non power2 groupsize unsupported. Define macro PROCS_PER_NODE_NOT_POWER_OF_TWO to override
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 16M 32M 48M 64M 80M SE +/- 666.67, N = 3 SE +/- 3844.19, N = 3 SE +/- 599433.09, N = 9 SE +/- 68119.99, N = 3 SE +/- 4910.31, N = 3 SE +/- 4163.33, N = 3 SE +/- 5364.49, N = 3 SE +/- 822374.71, N = 4 67074667 66991333 73140667 70499000 67130333 67064000 67127667 66266000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid Result Confidence
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 13M 26M 39M 52M 65M Min: 67074000 / Avg: 67074666.67 / Max: 67076000 Min: 66987000 / Avg: 66991333.33 / Max: 66999000 Min: 70713000 / Avg: 73140666.67 / Max: 74344000 Min: 70424000 / Avg: 70499000 / Max: 70635000 Min: 67122000 / Avg: 67130333.33 / Max: 67139000 Min: 67058000 / Avg: 67064000 / Max: 67072000 Min: 67120000 / Avg: 67127666.67 / Max: 67138000 Min: 63799000 / Avg: 66266000 / Max: 67110000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
srsRAN Project Result
OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PUSCH Processor Benchmark, Throughput Total Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1200 2400 3600 4800 6000 SE +/- 18.43, N = 3 SE +/- 47.68, N = 6 SE +/- 18.09, N = 3 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 SE +/- 26.47, N = 3 SE +/- 18.30, N = 3 SE +/- 0.15, N = 3 2616.9 4853.6 3088.7 5493.4 2170.7 3787.0 2514.0 4386.6 MIN: 1591.7 / MAX: 2653.8 MIN: 3181.8 / MAX: 4929.4 MIN: 1852.6 / MAX: 3124.9 MIN: 3703.4 / MAX: 5493.6 MIN: 1388.2 / MAX: 2170.8 MIN: 2545.7 / MAX: 3839.9 MIN: 1550.4 / MAX: 2532.5 MIN: 2970.2 / MAX: 4386.9 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl Result Confidence
OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PUSCH Processor Benchmark, Throughput Total Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1000 2000 3000 4000 5000 Min: 2598.4 / Avg: 2616.93 / Max: 2653.8 Min: 4702.5 / Avg: 4853.58 / Max: 4929.4 Min: 3070 / Avg: 3088.73 / Max: 3124.9 Min: 5493.2 / Avg: 5493.43 / Max: 5493.6 Min: 2170.5 / Avg: 2170.67 / Max: 2170.8 Min: 3760.1 / Avg: 3786.97 / Max: 3839.9 Min: 2477.4 / Avg: 2514 / Max: 2532.5 Min: 4386.4 / Avg: 4386.63 / Max: 4386.9 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl
libavif avifenc Result
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 2 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.21, N = 3 SE +/- 0.22, N = 3 SE +/- 0.31, N = 3 SE +/- 0.06, N = 3 37.75 37.31 34.79 33.65 41.13 38.65 39.88 38.14 1. (CXX) g++ options: -O3 -fPIC -lm Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 2 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 Min: 37.68 / Avg: 37.75 / Max: 37.8 Min: 37.11 / Avg: 37.31 / Max: 37.63 Min: 34.71 / Avg: 34.79 / Max: 34.88 Min: 33.49 / Avg: 33.65 / Max: 33.8 Min: 40.75 / Avg: 41.13 / Max: 41.49 Min: 38.42 / Avg: 38.65 / Max: 39.1 Min: 39.56 / Avg: 39.88 / Max: 40.5 Min: 38.04 / Avg: 38.14 / Max: 38.24 1. (CXX) g++ options: -O3 -fPIC -lm
ASKAP ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Mpix/sec, More Is Better ASKAP 1.0 Test: tConvolve MPI - Gridding Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 15K 30K 45K 60K 75K SE +/- 76.67, N = 3 SE +/- 412.68, N = 4 SE +/- 219.20, N = 3 SE +/- 1080.03, N = 3 SE +/- 99.83, N = 3 SE +/- 194.30, N = 3 SE +/- 0.00, N = 3 SE +/- 802.88, N = 3 21314.2 41773.0 37265.9 72004.0 21766.5 42939.2 23250.2 45195.1 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp Result Confidence
OpenBenchmarking.org Mpix/sec, More Is Better ASKAP 1.0 Test: tConvolve MPI - Gridding Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12K 24K 36K 48K 60K Min: 21160.9 / Avg: 21314.23 / Max: 21390.9 Min: 40576.6 / Avg: 41773 / Max: 42321.9 Min: 36827.5 / Avg: 37265.9 / Max: 37485.1 Min: 69972.2 / Avg: 72004.03 / Max: 73654.9 Min: 21566.8 / Avg: 21766.47 / Max: 21866.3 Min: 42550.6 / Avg: 42939.2 / Max: 43133.5 Min: 23250.2 / Avg: 23250.2 / Max: 23250.2 Min: 43732.6 / Avg: 45195.13 / Max: 46500.5 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
Result
OpenBenchmarking.org Mpix/sec, More Is Better ASKAP 1.0 Test: tConvolve MPI - Degridding Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 13K 26K 39K 52K 65K SE +/- 93.91, N = 3 SE +/- 378.22, N = 4 SE +/- 153.57, N = 3 SE +/- 480.95, N = 3 SE +/- 0.00, N = 3 SE +/- 143.60, N = 3 SE +/- 76.47, N = 3 SE +/- 0.00, N = 3 17891.6 34614.1 31177.2 59139.2 18522.0 36900.5 20561.4 40368.6 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp Result Confidence
OpenBenchmarking.org Mpix/sec, More Is Better ASKAP 1.0 Test: tConvolve MPI - Degridding Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 10K 20K 30K 40K 50K Min: 17729.4 / Avg: 17891.57 / Max: 18054.7 Min: 33640.5 / Avg: 34614.1 / Max: 35458.9 Min: 30870.1 / Avg: 31177.23 / Max: 31330.8 Min: 58310.1 / Avg: 59139.2 / Max: 59976.1 Min: 18522 / Avg: 18522 / Max: 18522 Min: 36613.3 / Avg: 36900.5 / Max: 37044.1 Min: 20408.5 / Avg: 20561.43 / Max: 20637.9 Min: 40368.6 / Avg: 40368.6 / Max: 40368.6 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenRadioss OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Cell Phone Drop Test Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 SE +/- 0.18, N = 3 SE +/- 0.32, N = 3 SE +/- 0.08, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 31.49 28.22 27.90 26.88 33.75 27.51 31.92 27.63 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Cell Phone Drop Test Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 Min: 31.4 / Avg: 31.49 / Max: 31.66 Min: 28.01 / Avg: 28.22 / Max: 28.35 Min: 27.61 / Avg: 27.9 / Max: 28.23 Min: 26.52 / Avg: 26.88 / Max: 27.52 Min: 33.61 / Avg: 33.75 / Max: 33.88 Min: 27.5 / Avg: 27.51 / Max: 27.53 Min: 31.89 / Avg: 31.92 / Max: 31.95 Min: 27.53 / Avg: 27.63 / Max: 27.7
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 200M 400M 600M 800M 1000M SE +/- 940265.92, N = 3 SE +/- 3717554.45, N = 3 SE +/- 1515552.70, N = 3 SE +/- 7562646.32, N = 8 SE +/- 1611276.24, N = 3 SE +/- 4432294.36, N = 3 SE +/- 1289603.73, N = 3 SE +/- 6141471.96, N = 3 744410000 799496667 783770000 883701250 632396667 732560000 689003333 757176667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid Result Confidence
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 150M 300M 450M 600M 750M Min: 743120000 / Avg: 744410000 / Max: 746240000 Min: 794190000 / Avg: 799496666.67 / Max: 806660000 Min: 780790000 / Avg: 783770000 / Max: 785740000 Min: 843790000 / Avg: 883701250 / Max: 908490000 Min: 630210000 / Avg: 632396666.67 / Max: 635540000 Min: 725240000 / Avg: 732560000 / Max: 740550000 Min: 687500000 / Avg: 689003333.33 / Max: 691570000 Min: 745540000 / Avg: 757176666.67 / Max: 766400000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9M 18M 27M 36M 45M SE +/- 1527.53, N = 3 SE +/- 1154.70, N = 3 SE +/- 417042.80, N = 5 SE +/- 419600.12, N = 5 SE +/- 1666.67, N = 3 SE +/- 1201.85, N = 3 SE +/- 3000.00, N = 3 SE +/- 1452.97, N = 3 36506000 36461000 40244000 38950600 36537667 36497667 36539000 36521333 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid Result Confidence
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7M 14M 21M 28M 35M Min: 36503000 / Avg: 36506000 / Max: 36508000 Min: 36459000 / Avg: 36461000 / Max: 36463000 Min: 38576000 / Avg: 40244000 / Max: 40671000 Min: 38530000 / Avg: 38950600 / Max: 40629000 Min: 36536000 / Avg: 36537666.67 / Max: 36541000 Min: 36496000 / Avg: 36497666.67 / Max: 36500000 Min: 36536000 / Avg: 36539000 / Max: 36545000 Min: 36519000 / Avg: 36521333.33 / Max: 36524000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Timed Wasmer Compilation This test times how long it takes to compile Wasmer. Wasmer is written in the Rust programming language and is a WebAssembly runtime implementation that supports WASI and EmScripten. This test profile builds Wasmer with the Cranelift and Singlepast compiler features enabled. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed Wasmer Compilation 2.3 Time To Compile Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 SE +/- 0.03, N = 3 SE +/- 0.11, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.16, N = 3 SE +/- 0.12, N = 3 SE +/- 0.16, N = 3 SE +/- 0.17, N = 3 34.93 35.46 30.17 30.47 35.66 36.20 35.20 35.70 1. (CC) gcc options: -m64 -ldl -lgcc_s -lutil -lrt -lpthread -lm -lc -pie -nodefaultlibs Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Timed Wasmer Compilation 2.3 Time To Compile Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 Min: 34.88 / Avg: 34.93 / Max: 34.97 Min: 35.29 / Avg: 35.46 / Max: 35.66 Min: 30.1 / Avg: 30.17 / Max: 30.27 Min: 30.35 / Avg: 30.47 / Max: 30.6 Min: 35.44 / Avg: 35.66 / Max: 35.97 Min: 36.02 / Avg: 36.2 / Max: 36.41 Min: 35.01 / Avg: 35.2 / Max: 35.52 Min: 35.41 / Avg: 35.7 / Max: 35.99 1. (CC) gcc options: -m64 -ldl -lgcc_s -lutil -lrt -lpthread -lm -lc -pie -nodefaultlibs
PyTorch Result
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.03, N = 3 SE +/- 0.49, N = 3 SE +/- 0.16, N = 3 SE +/- 0.52, N = 3 SE +/- 0.28, N = 3 SE +/- 0.38, N = 8 SE +/- 0.36, N = 3 SE +/- 0.44, N = 3 51.46 35.53 77.52 45.69 50.99 46.49 48.59 35.46 MIN: 35.78 / MAX: 55.29 MIN: 16.36 / MAX: 38.41 MIN: 36.51 / MAX: 79.65 MIN: 13.24 / MAX: 48.92 MIN: 11.73 / MAX: 59.01 MIN: 15.6 / MAX: 50.65 MIN: 4.58 / MAX: 55.2 MIN: 0.7 / MAX: 41 Result Confidence
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 15 30 45 60 75 Min: 51.42 / Avg: 51.46 / Max: 51.52 Min: 34.55 / Avg: 35.53 / Max: 36.12 Min: 77.23 / Avg: 77.52 / Max: 77.78 Min: 45.09 / Avg: 45.69 / Max: 46.73 Min: 50.49 / Avg: 50.99 / Max: 51.46 Min: 44 / Avg: 46.49 / Max: 47.5 Min: 48.02 / Avg: 48.59 / Max: 49.26 Min: 34.58 / Avg: 35.46 / Max: 35.97
Appleseed Appleseed is an open-source production renderer focused on physically-based global illumination rendering engine primarily designed for animation and visual effects. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Appleseed 2.0 Beta Scene: Disney Material Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 13 26 39 52 65 53.49 48.56 48.43 43.70 58.38 51.25 56.40 49.14
ASTC Encoder Result
OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Very Thorough Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 SE +/- 0.0054, N = 3 SE +/- 0.0379, N = 3 SE +/- 0.0294, N = 3 SE +/- 0.0007, N = 3 SE +/- 0.0016, N = 3 SE +/- 0.0055, N = 3 SE +/- 0.0016, N = 3 SE +/- 0.0022, N = 3 7.0885 13.7518 7.6240 14.6334 5.1342 10.2051 5.9702 11.8875 1. (CXX) g++ options: -O3 -flto -pthread Result Confidence
OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Very Thorough Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 Min: 7.08 / Avg: 7.09 / Max: 7.1 Min: 13.68 / Avg: 13.75 / Max: 13.8 Min: 7.59 / Avg: 7.62 / Max: 7.68 Min: 14.63 / Avg: 14.63 / Max: 14.63 Min: 5.13 / Avg: 5.13 / Max: 5.14 Min: 10.2 / Avg: 10.21 / Max: 10.22 Min: 5.97 / Avg: 5.97 / Max: 5.97 Min: 11.88 / Avg: 11.89 / Max: 11.89 1. (CXX) g++ options: -O3 -flto -pthread
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 600M 1200M 1800M 2400M 3000M SE +/- 7076957.92, N = 3 SE +/- 28500058.48, N = 3 SE +/- 11426868.92, N = 3 SE +/- 32405829.38, N = 3 SE +/- 2629533.12, N = 3 SE +/- 28812627.44, N = 4 SE +/- 5493127.02, N = 3 SE +/- 27382304.50, N = 5 2539200000 2655500000 2475500000 2620066667 2138766667 2494050000 2308966667 2491340000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid Result Confidence
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 500M 1000M 1500M 2000M 2500M Min: 2526700000 / Avg: 2539200000 / Max: 2551200000 Min: 2626900000 / Avg: 2655500000 / Max: 2712500000 Min: 2454700000 / Avg: 2475500000 / Max: 2494100000 Min: 2565000000 / Avg: 2620066666.67 / Max: 2677200000 Min: 2134100000 / Avg: 2138766666.67 / Max: 2143200000 Min: 2449200000 / Avg: 2494050000 / Max: 2574500000 Min: 2298600000 / Avg: 2308966666.67 / Max: 2317300000 Min: 2425700000 / Avg: 2491340000 / Max: 2564300000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
uvg266 uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 6 12 18 24 30 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 15.71 24.71 16.06 27.11 13.36 19.75 13.89 22.14 Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 6 12 18 24 30 Min: 15.67 / Avg: 15.71 / Max: 15.76 Min: 24.63 / Avg: 24.71 / Max: 24.76 Min: 16.03 / Avg: 16.06 / Max: 16.08 Min: 27.07 / Avg: 27.11 / Max: 27.15 Min: 13.32 / Avg: 13.36 / Max: 13.39 Min: 19.68 / Avg: 19.75 / Max: 19.79 Min: 13.87 / Avg: 13.89 / Max: 13.91 Min: 22.06 / Avg: 22.14 / Max: 22.2
ASTC Encoder Result
OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Exhaustive Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.0024, N = 3 SE +/- 0.0164, N = 3 SE +/- 0.0072, N = 3 SE +/- 0.0157, N = 3 SE +/- 0.0003, N = 3 SE +/- 0.0033, N = 3 SE +/- 0.0011, N = 3 SE +/- 0.0016, N = 3 4.2689 8.3701 4.6303 8.9091 3.1204 6.2126 3.6276 7.2075 1. (CXX) g++ options: -O3 -flto -pthread Result Confidence
OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Exhaustive Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 4.26 / Avg: 4.27 / Max: 4.27 Min: 8.34 / Avg: 8.37 / Max: 8.4 Min: 4.62 / Avg: 4.63 / Max: 4.64 Min: 8.88 / Avg: 8.91 / Max: 8.94 Min: 3.12 / Avg: 3.12 / Max: 3.12 Min: 6.21 / Avg: 6.21 / Max: 6.22 Min: 3.63 / Avg: 3.63 / Max: 3.63 Min: 7.2 / Avg: 7.21 / Max: 7.21 1. (CXX) g++ options: -O3 -flto -pthread
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 300M 600M 900M 1200M 1500M SE +/- 1740596.96, N = 3 SE +/- 6842108.19, N = 3 SE +/- 2313246.88, N = 3 SE +/- 4790383.89, N = 3 SE +/- 681281.47, N = 3 SE +/- 11560043.25, N = 5 SE +/- 1345523.44, N = 3 SE +/- 2123152.79, N = 3 918566667 1126466667 1152933333 1493833333 800186667 1091460000 882200000 1206066667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid Result Confidence
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 300M 600M 900M 1200M 1500M Min: 916530000 / Avg: 918566666.67 / Max: 922030000 Min: 1112900000 / Avg: 1126466666.67 / Max: 1134800000 Min: 1148800000 / Avg: 1152933333.33 / Max: 1156800000 Min: 1488600000 / Avg: 1493833333.33 / Max: 1503400000 Min: 799130000 / Avg: 800186666.67 / Max: 801460000 Min: 1052100000 / Avg: 1091460000 / Max: 1118000000 Min: 880040000 / Avg: 882200000 / Max: 884670000 Min: 1202900000 / Avg: 1206066666.67 / Max: 1210100000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
SVT-AV1 Result
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 4K Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 SE +/- 2.31, N = 15 SE +/- 2.18, N = 15 SE +/- 2.83, N = 15 SE +/- 2.84, N = 15 SE +/- 1.44, N = 15 SE +/- 1.63, N = 15 SE +/- 1.62, N = 15 SE +/- 1.67, N = 15 162.47 154.50 174.83 162.98 144.70 122.62 150.00 124.26 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 4K Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 Min: 130.33 / Avg: 162.47 / Max: 166.5 Min: 124.23 / Avg: 154.5 / Max: 158.43 Min: 135.47 / Avg: 174.83 / Max: 179.18 Min: 123.62 / Avg: 162.98 / Max: 168.5 Min: 124.82 / Avg: 144.7 / Max: 147.49 Min: 101.28 / Avg: 122.62 / Max: 131.09 Min: 127.75 / Avg: 150 / Max: 153.19 Min: 101.43 / Avg: 124.26 / Max: 128.92 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
QuantLib QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MFLOPS, More Is Better QuantLib 1.32 Configuration: Single-Threaded Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 800 1600 2400 3200 4000 SE +/- 28.42, N = 3 SE +/- 25.40, N = 3 SE +/- 33.58, N = 3 SE +/- 30.36, N = 12 SE +/- 22.17, N = 3 SE +/- 28.11, N = 3 SE +/- 25.35, N = 3 SE +/- 28.57, N = 3 3209.6 3210.1 3600.5 3586.3 3225.7 3207.0 3229.1 3222.8 1. (CXX) g++ options: -O3 -march=native -fPIE -pie Result Confidence
OpenBenchmarking.org MFLOPS, More Is Better QuantLib 1.32 Configuration: Single-Threaded Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 600 1200 1800 2400 3000 Min: 3152.8 / Avg: 3209.63 / Max: 3239 Min: 3159.5 / Avg: 3210.1 / Max: 3239.3 Min: 3533.3 / Avg: 3600.47 / Max: 3634.3 Min: 3261.3 / Avg: 3586.3 / Max: 3632.5 Min: 3181.4 / Avg: 3225.73 / Max: 3247.9 Min: 3153.8 / Avg: 3207.03 / Max: 3249.3 Min: 3178.4 / Avg: 3229.1 / Max: 3254.8 Min: 3165.7 / Avg: 3222.8 / Max: 3253 1. (CXX) g++ options: -O3 -march=native -fPIE -pie
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1000M 2000M 3000M 4000M 5000M SE +/- 3116800.35, N = 3 SE +/- 13655808.69, N = 3 SE +/- 5260228.13, N = 3 SE +/- 51282832.98, N = 4 SE +/- 2030052.00, N = 3 SE +/- 25888414.40, N = 3 SE +/- 3119294.79, N = 3 SE +/- 14772609.79, N = 3 3181266667 3723666667 3503200000 4450525000 2670033333 3596400000 2972400000 3896500000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid Result Confidence
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 800M 1600M 2400M 3200M 4000M Min: 3175500000 / Avg: 3181266666.67 / Max: 3186200000 Min: 3702000000 / Avg: 3723666666.67 / Max: 3748900000 Min: 3493100000 / Avg: 3503200000 / Max: 3510800000 Min: 4359000000 / Avg: 4450525000 / Max: 4593200000 Min: 2667300000 / Avg: 2670033333.33 / Max: 2674000000 Min: 3565300000 / Avg: 3596400000 / Max: 3647800000 Min: 2967100000 / Avg: 2972400000 / Max: 2977900000 Min: 3878000000 / Avg: 3896500000 / Max: 3925700000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
nginx This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking. Learn more via the OpenBenchmarking.org test page.
Connections: 1000
Xeon Platinum 8490H: The test quit with a non-zero exit status.
Xeon Platinum 8490H 2P: The test quit with a non-zero exit status.
Xeon Max 9468: The test quit with a non-zero exit status.
Xeon Max 9468 2P: The test quit with a non-zero exit status.
Xeon Max 9480 2P: The test quit with a non-zero exit status.
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 400M 800M 1200M 1600M 2000M SE +/- 1722723.94, N = 3 SE +/- 5630373.98, N = 3 SE +/- 240370.09, N = 3 SE +/- 14465476.14, N = 3 SE +/- 569766.03, N = 3 SE +/- 4238841.56, N = 3 SE +/- 740202.67, N = 3 SE +/- 6728628.72, N = 3 1020833333 1616966667 1178766667 2027000000 838530000 1444066667 944550000 1518933333 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid Result Confidence
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 400M 800M 1200M 1600M 2000M Min: 1017400000 / Avg: 1020833333.33 / Max: 1022800000 Min: 1609500000 / Avg: 1616966666.67 / Max: 1628000000 Min: 1178300000 / Avg: 1178766666.67 / Max: 1179100000 Min: 2004500000 / Avg: 2027000000 / Max: 2054000000 Min: 837510000 / Avg: 838530000 / Max: 839480000 Min: 1439100000 / Avg: 1444066666.67 / Max: 1452500000 Min: 943070000 / Avg: 944550000 / Max: 945320000 Min: 1507100000 / Avg: 1518933333.33 / Max: 1530400000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Blender Result
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Junkshop - Compute: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 10 20 30 40 50 SE +/- 0.24, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.19, N = 3 35.96 21.15 32.08 18.31 42.85 24.99 39.17 23.45 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Junkshop - Compute: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 Min: 35.61 / Avg: 35.96 / Max: 36.43 Min: 21.1 / Avg: 21.15 / Max: 21.23 Min: 31.88 / Avg: 32.08 / Max: 32.19 Min: 18.17 / Avg: 18.31 / Max: 18.47 Min: 42.81 / Avg: 42.85 / Max: 42.93 Min: 24.92 / Avg: 24.99 / Max: 25.11 Min: 38.99 / Avg: 39.17 / Max: 39.32 Min: 23.22 / Avg: 23.45 / Max: 23.82
NAS Parallel Benchmarks NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: EP.D Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3K 6K 9K 12K 15K SE +/- 6.77, N = 3 SE +/- 100.23, N = 4 SE +/- 22.33, N = 3 SE +/- 30.19, N = 4 SE +/- 155.10, N = 12 SE +/- 4.83, N = 4 SE +/- 6.53, N = 3 SE +/- 10.93, N = 4 7562.80 14946.76 8089.14 16004.07 5366.69 10970.45 6445.09 12793.01 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6 Result Confidence
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: EP.D Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3K 6K 9K 12K 15K Min: 7555.79 / Avg: 7562.8 / Max: 7576.34 Min: 14774.48 / Avg: 14946.76 / Max: 15196.8 Min: 8047.87 / Avg: 8089.14 / Max: 8124.56 Min: 15962.64 / Avg: 16004.07 / Max: 16092.29 Min: 3660.9 / Avg: 5366.69 / Max: 5540.08 Min: 10957.6 / Avg: 10970.45 / Max: 10981.02 Min: 6432.47 / Avg: 6445.09 / Max: 6454.32 Min: 12767.18 / Avg: 12793.01 / Max: 12820.48 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
John The Ripper This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: bcrypt Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40K 80K 120K 160K 200K SE +/- 10.67, N = 3 SE +/- 292.24, N = 3 SE +/- 46.28, N = 3 SE +/- 288.38, N = 3 SE +/- 8.84, N = 3 SE +/- 866.68, N = 3 SE +/- 8.67, N = 3 SE +/- 576.80, N = 3 94551 183603 105781 206778 67875 133866 79144 155959 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2 Result Confidence
OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: bcrypt Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40K 80K 120K 160K 200K Min: 94540 / Avg: 94550.67 / Max: 94572 Min: 183024 / Avg: 183603.33 / Max: 183960 Min: 105718 / Avg: 105780.67 / Max: 105871 Min: 206292 / Avg: 206778.33 / Max: 207290 Min: 67858 / Avg: 67875.33 / Max: 67887 Min: 132134 / Avg: 133866.33 / Max: 134784 Min: 79135 / Avg: 79143.67 / Max: 79161 Min: 155113 / Avg: 155958.67 / Max: 157061 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
Result
OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: Blowfish Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40K 80K 120K 160K 200K SE +/- 11.39, N = 3 SE +/- 348.45, N = 3 SE +/- 79.75, N = 3 SE +/- 649.08, N = 3 SE +/- 17.33, N = 3 SE +/- 116.69, N = 3 SE +/- 8.67, N = 3 SE +/- 169.28, N = 3 94513 183583 105831 205499 67893 134562 79152 156658 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2 Result Confidence
OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: Blowfish Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40K 80K 120K 160K 200K Min: 94500 / Avg: 94513.33 / Max: 94536 Min: 183096 / Avg: 183582.67 / Max: 184258 Min: 105715 / Avg: 105831.33 / Max: 105984 Min: 204296 / Avg: 205499 / Max: 206523 Min: 67858 / Avg: 67892.67 / Max: 67910 Min: 134336 / Avg: 134561.67 / Max: 134726 Min: 79135 / Avg: 79152.33 / Max: 79161 Min: 156456 / Avg: 156657.67 / Max: 156994 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1300M 2600M 3900M 5200M 6500M SE +/- 5292237.50, N = 3 SE +/- 2331189.49, N = 3 SE +/- 3555434.03, N = 3 SE +/- 61971606.40, N = 3 SE +/- 4088330.28, N = 3 SE +/- 17558125.69, N = 3 SE +/- 1976810.00, N = 3 SE +/- 28453880.81, N = 3 3500833333 5361266667 3806833333 6284300000 2848933333 4825133333 3222533333 5036000000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid Result Confidence
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1100M 2200M 3300M 4400M 5500M Min: 3493200000 / Avg: 3500833333.33 / Max: 3511000000 Min: 5358500000 / Avg: 5361266666.67 / Max: 5365900000 Min: 3801800000 / Avg: 3806833333.33 / Max: 3813700000 Min: 6187100000 / Avg: 6284300000 / Max: 6399500000 Min: 2841500000 / Avg: 2848933333.33 / Max: 2855600000 Min: 4801700000 / Avg: 4825133333.33 / Max: 4859500000 Min: 3218900000 / Avg: 3222533333.33 / Max: 3225700000 Min: 4985700000 / Avg: 5036000000 / Max: 5084200000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1300M 2600M 3900M 5200M 6500M SE +/- 4021608.30, N = 3 SE +/- 10496401.50, N = 3 SE +/- 2516611.48, N = 3 SE +/- 6711433.03, N = 3 SE +/- 1320353.49, N = 3 SE +/- 2447674.63, N = 3 SE +/- 1338323.99, N = 3 SE +/- 895048.11, N = 3 3243800000 6116566667 3167200000 6077300000 2381800000 4670966667 2769066667 5367033333 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid Result Confidence
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1100M 2200M 3300M 4400M 5500M Min: 3236000000 / Avg: 3243800000 / Max: 3249400000 Min: 6102900000 / Avg: 6116566666.67 / Max: 6137200000 Min: 3164200000 / Avg: 3167200000 / Max: 3172200000 Min: 6067400000 / Avg: 6077300000 / Max: 6090100000 Min: 2380100000 / Avg: 2381800000 / Max: 2384400000 Min: 4667100000 / Avg: 4670966666.67 / Max: 4675500000 Min: 2766600000 / Avg: 2769066666.67 / Max: 2771200000 Min: 5365900000 / Avg: 5367033333.33 / Max: 5368800000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
uvg266 uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 17.85 27.65 16.64 30.37 15.17 22.25 15.68 24.65 Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 Min: 17.83 / Avg: 17.85 / Max: 17.89 Min: 27.57 / Avg: 27.65 / Max: 27.71 Min: 16.41 / Avg: 16.64 / Max: 16.94 Min: 30.29 / Avg: 30.37 / Max: 30.45 Min: 15.13 / Avg: 15.17 / Max: 15.21 Min: 22.2 / Avg: 22.25 / Max: 22.29 Min: 15.65 / Avg: 15.68 / Max: 15.7 Min: 24.59 / Avg: 24.65 / Max: 24.7
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 800M 1600M 2400M 3200M 4000M SE +/- 1858314.65, N = 3 SE +/- 26633124.74, N = 3 SE +/- 2236316.42, N = 3 SE +/- 13813198.20, N = 3 SE +/- 400000.00, N = 3 SE +/- 4598671.31, N = 3 SE +/- 1342054.81, N = 3 SE +/- 2403700.85, N = 3 3200600000 3558600000 3148233333 3520766667 2351900000 3254033333 2739633333 3337066667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid Result Confidence
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 600M 1200M 1800M 2400M 3000M Min: 3197600000 / Avg: 3200600000 / Max: 3204000000 Min: 3510300000 / Avg: 3558600000 / Max: 3602200000 Min: 3144000000 / Avg: 3148233333.33 / Max: 3151600000 Min: 3497500000 / Avg: 3520766666.67 / Max: 3545300000 Min: 2351100000 / Avg: 2351900000 / Max: 2352300000 Min: 3248800000 / Avg: 3254033333.33 / Max: 3263200000 Min: 2737000000 / Avg: 2739633333.33 / Max: 2741400000 Min: 3332400000 / Avg: 3337066666.67 / Max: 3340400000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Google SynthMark SynthMark is a cross platform tool for benchmarking CPU performance under a variety of real-time audio workloads. It uses a polyphonic synthesizer model to provide standardized tests for latency, jitter and computational throughput. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Voices, More Is Better Google SynthMark 20201109 Test: VoiceMark_100 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 200 400 600 800 1000 SE +/- 0.22, N = 3 SE +/- 1.51, N = 3 SE +/- 0.13, N = 3 SE +/- 0.38, N = 3 SE +/- 0.26, N = 3 SE +/- 0.30, N = 3 SE +/- 0.24, N = 3 SE +/- 0.48, N = 3 711.38 712.70 799.72 799.49 711.10 710.92 712.01 712.09 1. (CXX) g++ options: -lm -lpthread -std=c++11 -Ofast Result Confidence
OpenBenchmarking.org Voices, More Is Better Google SynthMark 20201109 Test: VoiceMark_100 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 140 280 420 560 700 Min: 711.02 / Avg: 711.38 / Max: 711.79 Min: 710.79 / Avg: 712.7 / Max: 715.68 Min: 799.47 / Avg: 799.72 / Max: 799.89 Min: 798.81 / Avg: 799.49 / Max: 800.14 Min: 710.75 / Avg: 711.1 / Max: 711.61 Min: 710.34 / Avg: 710.92 / Max: 711.3 Min: 711.65 / Avg: 712.01 / Max: 712.48 Min: 711.17 / Avg: 712.09 / Max: 712.76 1. (CXX) g++ options: -lm -lpthread -std=c++11 -Ofast
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 500M 1000M 1500M 2000M 2500M SE +/- 3167192.94, N = 3 SE +/- 3300505.01, N = 3 SE +/- 27191440.65, N = 3 SE +/- 17236814.61, N = 3 SE +/- 688799.28, N = 3 SE +/- 2206304.10, N = 3 SE +/- 692820.32, N = 3 SE +/- 3017909.50, N = 3 1890566667 2025000000 1927766667 2154633333 1640266667 1963233333 1679700000 2090466667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid Result Confidence
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 400M 800M 1200M 1600M 2000M Min: 1887300000 / Avg: 1890566666.67 / Max: 1896900000 Min: 2018400000 / Avg: 2025000000 / Max: 2028400000 Min: 1889600000 / Avg: 1927766666.67 / Max: 1980400000 Min: 2127000000 / Avg: 2154633333.33 / Max: 2186300000 Min: 1638900000 / Avg: 1640266666.67 / Max: 1641100000 Min: 1959200000 / Avg: 1963233333.33 / Max: 1966800000 Min: 1678500000 / Avg: 1679700000 / Max: 1680900000 Min: 2084800000 / Avg: 2090466666.67 / Max: 2095100000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Blender Result
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Fishy Cat - Compute: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 10 20 30 40 50 SE +/- 0.11, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.17, N = 3 SE +/- 0.13, N = 3 SE +/- 0.04, N = 3 SE +/- 0.18, N = 3 34.83 19.13 31.91 17.29 42.78 23.17 38.48 21.45 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Fishy Cat - Compute: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 Min: 34.66 / Avg: 34.83 / Max: 35.05 Min: 19.01 / Avg: 19.13 / Max: 19.28 Min: 31.84 / Avg: 31.91 / Max: 32.02 Min: 17.22 / Avg: 17.29 / Max: 17.37 Min: 42.54 / Avg: 42.78 / Max: 43.11 Min: 23 / Avg: 23.17 / Max: 23.42 Min: 38.44 / Avg: 38.48 / Max: 38.56 Min: 21.14 / Avg: 21.45 / Max: 21.75
TensorFlow Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: GoogLeNet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 SE +/- 0.19, N = 6 SE +/- 0.23, N = 15 SE +/- 0.21, N = 6 SE +/- 0.12, N = 6 SE +/- 0.27, N = 7 SE +/- 0.20, N = 15 SE +/- 0.27, N = 6 SE +/- 0.23, N = 12 33.56 13.50 21.67 12.69 36.13 18.24 31.47 14.67 Result Confidence
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: GoogLeNet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 Min: 32.93 / Avg: 33.56 / Max: 34.1 Min: 11.96 / Avg: 13.5 / Max: 15.09 Min: 21.03 / Avg: 21.67 / Max: 22.4 Min: 12.4 / Avg: 12.69 / Max: 13.12 Min: 35.26 / Avg: 36.13 / Max: 37.01 Min: 16.92 / Avg: 18.24 / Max: 19.31 Min: 30.65 / Avg: 31.47 / Max: 32.43 Min: 13.61 / Avg: 14.67 / Max: 15.96
DaCapo Benchmark This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Apache Lucene Search Index Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 800 1600 2400 3200 4000 SE +/- 11.79, N = 3 SE +/- 41.09, N = 5 SE +/- 18.19, N = 3 SE +/- 12.44, N = 3 SE +/- 33.41, N = 3 SE +/- 10.84, N = 3 SE +/- 42.24, N = 4 SE +/- 11.86, N = 3 3581 3689 3242 3345 3378 3643 3396 3537 Result Confidence
OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Apache Lucene Search Index Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 600 1200 1800 2400 3000 Min: 3558 / Avg: 3581.33 / Max: 3596 Min: 3541 / Avg: 3688.8 / Max: 3780 Min: 3210 / Avg: 3241.67 / Max: 3273 Min: 3323 / Avg: 3345.33 / Max: 3366 Min: 3341 / Avg: 3378.33 / Max: 3445 Min: 3623 / Avg: 3643.33 / Max: 3660 Min: 3275 / Avg: 3396 / Max: 3469 Min: 3524 / Avg: 3537.33 / Max: 3561
Embree Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Obj Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 SE +/- 0.09, N = 3 SE +/- 0.22, N = 4 SE +/- 0.35, N = 3 SE +/- 0.29, N = 4 SE +/- 0.08, N = 3 SE +/- 0.76, N = 3 SE +/- 0.09, N = 3 SE +/- 0.89, N = 15 79.38 132.28 97.19 173.22 64.96 104.84 71.83 112.72 MIN: 76.07 / MAX: 85.98 MIN: 125 / MAX: 146.52 MIN: 92.96 / MAX: 102.04 MIN: 164.07 / MAX: 187.8 MIN: 63.12 / MAX: 67.81 MIN: 101.05 / MAX: 112.02 MIN: 69.55 / MAX: 76.73 MIN: 102 / MAX: 125.96 Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Obj Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 Min: 79.19 / Avg: 79.38 / Max: 79.5 Min: 131.73 / Avg: 132.28 / Max: 132.76 Min: 96.49 / Avg: 97.19 / Max: 97.59 Min: 172.52 / Avg: 173.22 / Max: 173.86 Min: 64.82 / Avg: 64.96 / Max: 65.11 Min: 103.67 / Avg: 104.84 / Max: 106.27 Min: 71.64 / Avg: 71.83 / Max: 71.93 Min: 105.89 / Avg: 112.72 / Max: 117.07
GROMACS The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2024 Implementation: MPI CPU - Input: water_GMX50_bare Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 SE +/- 0.010, N = 3 SE +/- 0.019, N = 3 SE +/- 0.009, N = 3 SE +/- 0.046, N = 3 SE +/- 0.019, N = 3 SE +/- 0.025, N = 3 SE +/- 0.007, N = 3 SE +/- 0.032, N = 3 8.762 15.450 10.477 18.540 7.545 13.392 8.282 14.127 1. (CXX) g++ options: -O3 -lm Result Confidence
OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2024 Implementation: MPI CPU - Input: water_GMX50_bare Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 Min: 8.75 / Avg: 8.76 / Max: 8.78 Min: 15.41 / Avg: 15.45 / Max: 15.47 Min: 10.46 / Avg: 10.48 / Max: 10.49 Min: 18.45 / Avg: 18.54 / Max: 18.59 Min: 7.51 / Avg: 7.55 / Max: 7.56 Min: 13.36 / Avg: 13.39 / Max: 13.44 Min: 8.27 / Avg: 8.28 / Max: 8.3 Min: 14.07 / Avg: 14.13 / Max: 14.18 1. (CXX) g++ options: -O3 -lm
SVT-AV1 Result
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 4 - Input: Bosphorus 4K Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.030, N = 3 SE +/- 0.049, N = 3 SE +/- 0.005, N = 3 SE +/- 0.044, N = 3 SE +/- 0.027, N = 3 SE +/- 0.015, N = 3 SE +/- 0.047, N = 3 SE +/- 0.042, N = 3 7.061 6.698 7.876 7.360 6.490 5.991 6.572 6.052 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 4 - Input: Bosphorus 4K Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 7.02 / Avg: 7.06 / Max: 7.12 Min: 6.6 / Avg: 6.7 / Max: 6.75 Min: 7.87 / Avg: 7.88 / Max: 7.88 Min: 7.27 / Avg: 7.36 / Max: 7.42 Min: 6.46 / Avg: 6.49 / Max: 6.54 Min: 5.98 / Avg: 5.99 / Max: 6.02 Min: 6.51 / Avg: 6.57 / Max: 6.66 Min: 5.98 / Avg: 6.05 / Max: 6.13 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
TensorFlow Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: GoogLeNet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 80 160 240 320 400 SE +/- 1.62, N = 3 SE +/- 2.37, N = 3 SE +/- 1.12, N = 3 SE +/- 0.21, N = 3 SE +/- 1.94, N = 3 SE +/- 3.52, N = 5 SE +/- 0.83, N = 3 SE +/- 2.38, N = 3 380.14 331.76 319.76 291.37 333.73 341.51 335.58 308.95 Result Confidence
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: GoogLeNet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 70 140 210 280 350 Min: 377.14 / Avg: 380.14 / Max: 382.69 Min: 327.05 / Avg: 331.76 / Max: 334.55 Min: 317.52 / Avg: 319.76 / Max: 320.93 Min: 291.02 / Avg: 291.37 / Max: 291.73 Min: 329.88 / Avg: 333.73 / Max: 336.1 Min: 329.53 / Avg: 341.51 / Max: 350.64 Min: 334.46 / Avg: 335.58 / Max: 337.2 Min: 306.48 / Avg: 308.95 / Max: 313.7
ASKAP ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Million Grid Points Per Second, More Is Better ASKAP 1.0 Test: tConvolve OpenMP - Degridding Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11K 22K 33K 44K 55K SE +/- 677.85, N = 15 SE +/- 948.80, N = 15 SE +/- 131.12, N = 15 SE +/- 1365.55, N = 15 SE +/- 41.81, N = 5 SE +/- 0.00, N = 4 SE +/- 69.31, N = 5 SE +/- 955.08, N = 5 30471.50 51476.20 16936.80 48686.80 6758.81 4437.60 7046.56 7304.58 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp Result Confidence
OpenBenchmarking.org Million Grid Points Per Second, More Is Better ASKAP 1.0 Test: tConvolve OpenMP - Degridding Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9K 18K 27K 36K 45K Min: 26625.6 / Avg: 30471.52 / Max: 33282 Min: 44376 / Avg: 51476.16 / Max: 53251.2 Min: 16641 / Avg: 16936.84 / Max: 17750.4 Min: 38036.6 / Avg: 48686.81 / Max: 53251.2 Min: 6656.4 / Avg: 6758.81 / Max: 6827.08 Min: 4437.6 / Avg: 4437.6 / Max: 4437.6 Min: 6827.08 / Avg: 7046.56 / Max: 7196.11 Min: 4671.16 / Avg: 7304.58 / Max: 9509.14 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
Result
OpenBenchmarking.org Million Grid Points Per Second, More Is Better ASKAP 1.0 Test: tConvolve OpenMP - Gridding Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4K 8K 12K 16K 20K SE +/- 195.05, N = 15 SE +/- 139.77, N = 15 SE +/- 211.64, N = 15 SE +/- 221.77, N = 15 SE +/- 13.21, N = 5 SE +/- 40.14, N = 4 SE +/- 33.09, N = 5 SE +/- 13.50, N = 5 19798.50 17010.80 19141.80 20204.90 4173.46 3916.78 4438.58 3836.73 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp Result Confidence
OpenBenchmarking.org Million Grid Points Per Second, More Is Better ASKAP 1.0 Test: tConvolve OpenMP - Gridding Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4K 8K 12K 16K 20K Min: 19018.3 / Avg: 19798.51 / Max: 20481.2 Min: 16641 / Avg: 17010.8 / Max: 17750.4 Min: 17750.4 / Avg: 19141.83 / Max: 20481.2 Min: 19018.3 / Avg: 20204.88 / Max: 22188 Min: 4160.25 / Avg: 4173.46 / Max: 4226.29 Min: 3803.66 / Avg: 3916.78 / Max: 3973.97 Min: 4364.85 / Avg: 4438.58 / Max: 4512.81 Min: 3803.66 / Avg: 3836.73 / Max: 3858.78 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
Kvazaar This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Slow Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 4 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 20.23 31.24 24.23 40.92 17.52 26.00 18.24 28.96 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Slow Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 Min: 20.18 / Avg: 20.23 / Max: 20.29 Min: 31.09 / Avg: 31.24 / Max: 31.35 Min: 24.1 / Avg: 24.23 / Max: 24.34 Min: 40.79 / Avg: 40.92 / Max: 40.99 Min: 17.47 / Avg: 17.52 / Max: 17.57 Min: 25.94 / Avg: 26 / Max: 26.06 Min: 18.21 / Avg: 18.24 / Max: 18.26 Min: 28.91 / Avg: 28.96 / Max: 28.99 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Result
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Medium Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.27, N = 4 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 20.97 32.04 24.80 41.58 18.13 26.69 18.84 29.62 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Medium Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 Min: 20.94 / Avg: 20.97 / Max: 21.01 Min: 31.94 / Avg: 32.04 / Max: 32.16 Min: 24.75 / Avg: 24.8 / Max: 24.86 Min: 40.95 / Avg: 41.58 / Max: 42.09 Min: 18.06 / Avg: 18.13 / Max: 18.21 Min: 26.53 / Avg: 26.69 / Max: 26.79 Min: 18.81 / Avg: 18.84 / Max: 18.89 Min: 29.53 / Avg: 29.62 / Max: 29.76 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
SVT-AV1 Result
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 8 - Input: Bosphorus 4K Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.20, N = 5 SE +/- 0.46, N = 4 SE +/- 0.22, N = 5 SE +/- 0.79, N = 5 SE +/- 0.26, N = 4 SE +/- 0.58, N = 5 SE +/- 0.29, N = 4 SE +/- 0.44, N = 15 70.91 65.22 79.44 70.43 62.75 54.82 65.36 55.98 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 8 - Input: Bosphorus 4K Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 15 30 45 60 75 Min: 70.19 / Avg: 70.91 / Max: 71.45 Min: 64.17 / Avg: 65.22 / Max: 66.2 Min: 78.71 / Avg: 79.44 / Max: 80.05 Min: 68.36 / Avg: 70.43 / Max: 73.07 Min: 62.03 / Avg: 62.75 / Max: 63.22 Min: 53.25 / Avg: 54.82 / Max: 56.57 Min: 64.77 / Avg: 65.36 / Max: 66.14 Min: 53.7 / Avg: 55.98 / Max: 59 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
uvg266 uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 14 28 42 56 70 SE +/- 0.07, N = 5 SE +/- 0.58, N = 5 SE +/- 0.04, N = 4 SE +/- 0.17, N = 5 SE +/- 0.06, N = 4 SE +/- 0.50, N = 5 SE +/- 0.13, N = 4 SE +/- 0.36, N = 15 60.87 55.26 39.31 57.13 48.91 46.13 50.09 45.79 Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12 24 36 48 60 Min: 60.68 / Avg: 60.87 / Max: 61.03 Min: 53.85 / Avg: 55.26 / Max: 57.39 Min: 39.22 / Avg: 39.31 / Max: 39.38 Min: 56.76 / Avg: 57.13 / Max: 57.74 Min: 48.8 / Avg: 48.91 / Max: 49.08 Min: 44.88 / Avg: 46.13 / Max: 47.42 Min: 49.94 / Avg: 50.09 / Max: 50.47 Min: 43.93 / Avg: 45.79 / Max: 47.81
TensorFlow Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: AlexNet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 400 800 1200 1600 2000 SE +/- 0.54, N = 3 SE +/- 5.06, N = 3 SE +/- 4.27, N = 3 SE +/- 1.86, N = 3 SE +/- 1.21, N = 3 SE +/- 1.15, N = 3 SE +/- 6.82, N = 3 SE +/- 5.81, N = 3 1205.30 1730.25 1277.46 1681.44 986.04 1479.53 1058.99 1528.41 Result Confidence
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: AlexNet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 300 600 900 1200 1500 Min: 1204.31 / Avg: 1205.3 / Max: 1206.15 Min: 1720.58 / Avg: 1730.25 / Max: 1737.65 Min: 1270.92 / Avg: 1277.46 / Max: 1285.48 Min: 1678.14 / Avg: 1681.44 / Max: 1684.59 Min: 983.65 / Avg: 986.04 / Max: 987.58 Min: 1477.32 / Avg: 1479.53 / Max: 1481.18 Min: 1046.92 / Avg: 1058.99 / Max: 1070.53 Min: 1517.02 / Avg: 1528.41 / Max: 1536.13
miniBUDE MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 SE +/- 0.61, N = 5 SE +/- 0.81, N = 7 SE +/- 0.20, N = 6 SE +/- 1.02, N = 8 SE +/- 0.12, N = 4 SE +/- 1.28, N = 12 SE +/- 0.84, N = 15 SE +/- 1.85, N = 12 82.85 133.63 106.40 199.73 63.62 108.40 70.84 114.90 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm Result Confidence
OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 Min: 81.26 / Avg: 82.85 / Max: 83.99 Min: 130.38 / Avg: 133.63 / Max: 135.93 Min: 105.99 / Avg: 106.4 / Max: 107.33 Min: 193.37 / Avg: 199.73 / Max: 203.55 Min: 63.4 / Avg: 63.62 / Max: 63.94 Min: 100.57 / Avg: 108.4 / Max: 116.86 Min: 65.44 / Avg: 70.84 / Max: 75.47 Min: 99.31 / Avg: 114.9 / Max: 122.85 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
Result
OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1100 2200 3300 4400 5500 SE +/- 15.23, N = 5 SE +/- 20.15, N = 7 SE +/- 5.07, N = 6 SE +/- 25.44, N = 8 SE +/- 2.91, N = 4 SE +/- 32.01, N = 12 SE +/- 21.10, N = 15 SE +/- 46.19, N = 12 2071.19 3340.69 2659.88 4993.34 1590.50 2709.93 1771.07 2872.56 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm Result Confidence
OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 900 1800 2700 3600 4500 Min: 2031.44 / Avg: 2071.19 / Max: 2099.76 Min: 3259.48 / Avg: 3340.69 / Max: 3398.22 Min: 2649.69 / Avg: 2659.88 / Max: 2683.19 Min: 4834.27 / Avg: 4993.34 / Max: 5088.63 Min: 1585.04 / Avg: 1590.5 / Max: 1598.58 Min: 2514.13 / Avg: 2709.93 / Max: 2921.44 Min: 1636 / Avg: 1771.07 / Max: 1886.65 Min: 2482.82 / Avg: 2872.56 / Max: 3071.28 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
TensorFlow Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: AlexNet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 13 26 39 52 65 SE +/- 0.08, N = 8 SE +/- 0.44, N = 15 SE +/- 0.66, N = 15 SE +/- 0.45, N = 15 SE +/- 0.76, N = 15 SE +/- 0.57, N = 15 SE +/- 1.22, N = 15 SE +/- 0.52, N = 15 56.53 37.57 35.50 30.76 48.28 37.76 43.67 33.21 Result Confidence
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: AlexNet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11 22 33 44 55 Min: 56.28 / Avg: 56.53 / Max: 57.04 Min: 33.9 / Avg: 37.57 / Max: 40.77 Min: 31.2 / Avg: 35.5 / Max: 39.42 Min: 27.56 / Avg: 30.76 / Max: 33.44 Min: 42.43 / Avg: 48.28 / Max: 52.42 Min: 34.31 / Avg: 37.76 / Max: 41.21 Min: 30.34 / Avg: 43.67 / Max: 49.86 Min: 30.26 / Avg: 33.21 / Max: 37.23
Blender Result
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: BMW27 - Compute: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 SE +/- 0.15, N = 3 SE +/- 0.08, N = 4 SE +/- 0.04, N = 3 SE +/- 0.03, N = 4 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.24, N = 3 SE +/- 0.08, N = 4 25.89 13.74 23.72 12.76 31.66 16.55 28.49 15.29 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: BMW27 - Compute: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 Min: 25.7 / Avg: 25.89 / Max: 26.18 Min: 13.55 / Avg: 13.74 / Max: 13.95 Min: 23.65 / Avg: 23.72 / Max: 23.79 Min: 12.68 / Avg: 12.76 / Max: 12.84 Min: 31.52 / Avg: 31.66 / Max: 31.88 Min: 16.52 / Avg: 16.55 / Max: 16.6 Min: 28.24 / Avg: 28.49 / Max: 28.97 Min: 15.11 / Avg: 15.29 / Max: 15.48
Y-Cruncher Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Y-Cruncher 0.8.3 Pi Digits To Calculate: 1B Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.005, N = 5 SE +/- 0.007, N = 6 SE +/- 0.030, N = 5 SE +/- 0.010, N = 6 SE +/- 0.045, N = 5 SE +/- 0.122, N = 15 SE +/- 0.026, N = 5 SE +/- 0.142, N = 12 7.047 5.008 6.701 5.110 8.300 6.334 7.959 6.266 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Y-Cruncher 0.8.3 Pi Digits To Calculate: 1B Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 7.03 / Avg: 7.05 / Max: 7.06 Min: 4.99 / Avg: 5.01 / Max: 5.03 Min: 6.63 / Avg: 6.7 / Max: 6.81 Min: 5.07 / Avg: 5.11 / Max: 5.14 Min: 8.2 / Avg: 8.3 / Max: 8.43 Min: 5.91 / Avg: 6.33 / Max: 7.33 Min: 7.91 / Avg: 7.96 / Max: 8.06 Min: 5.81 / Avg: 6.27 / Max: 7.49
OpenFOAM OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Execution Time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 10 20 30 40 50 42.22 28.56 33.07 23.56 45.95 28.99 41.75 27.58 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Mesh Time Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 31.38 35.60 31.70 29.33 31.78 32.48 32.00 28.84 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
NAS Parallel Benchmarks NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: IS.D Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1600 3200 4800 6400 8000 SE +/- 6.56, N = 3 SE +/- 23.92, N = 4 SE +/- 8.92, N = 4 SE +/- 155.00, N = 15 SE +/- 15.55, N = 4 SE +/- 12.99, N = 4 SE +/- 18.08, N = 4 SE +/- 4.96, N = 4 2865.72 3960.28 4059.70 7437.81 3050.16 3816.70 3076.66 3819.83 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6 Result Confidence
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: IS.D Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1300 2600 3900 5200 6500 Min: 2855.78 / Avg: 2865.72 / Max: 2878.11 Min: 3893.71 / Avg: 3960.28 / Max: 3998.43 Min: 4037.02 / Avg: 4059.7 / Max: 4080.47 Min: 6535.32 / Avg: 7437.81 / Max: 8135.72 Min: 3009.06 / Avg: 3050.16 / Max: 3079.43 Min: 3782.03 / Avg: 3816.7 / Max: 3842.02 Min: 3024.29 / Avg: 3076.66 / Max: 3104.23 Min: 3805.61 / Avg: 3819.83 / Max: 3827.3 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
Kvazaar This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Super Fast Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 15 30 45 60 75 SE +/- 0.07, N = 5 SE +/- 0.50, N = 5 SE +/- 0.09, N = 4 SE +/- 0.21, N = 5 SE +/- 0.12, N = 5 SE +/- 0.49, N = 5 SE +/- 0.20, N = 5 SE +/- 0.49, N = 15 66.74 69.05 39.20 66.78 53.13 52.63 54.47 54.19 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Super Fast Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 13 26 39 52 65 Min: 66.54 / Avg: 66.74 / Max: 66.93 Min: 67.52 / Avg: 69.05 / Max: 70.41 Min: 38.96 / Avg: 39.2 / Max: 39.36 Min: 66.33 / Avg: 66.78 / Max: 67.37 Min: 52.83 / Avg: 53.13 / Max: 53.51 Min: 51.59 / Avg: 52.63 / Max: 54.38 Min: 53.91 / Avg: 54.47 / Max: 54.82 Min: 51.69 / Avg: 54.19 / Max: 57.01 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Algebraic Multi-Grid Benchmark AMG is a parallel algebraic multigrid solver for linear systems arising from problems on unstructured grids. The driver provided with AMG builds linear systems for various 3-dimensional problems. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Figure Of Merit, More Is Better Algebraic Multi-Grid Benchmark 1.2 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 800M 1600M 2400M 3200M 4000M SE +/- 468935.32, N = 3 SE +/- 2438223.49, N = 3 SE +/- 4000850.45, N = 3 SE +/- 9014927.20, N = 3 SE +/- 3359086.30, N = 3 SE +/- 7233468.75, N = 3 SE +/- 1778769.08, N = 3 SE +/- 9164253.67, N = 3 1605097000 3124402667 1814760000 3609646333 1588496667 3156261667 1597993333 3205161000 1. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi Result Confidence
OpenBenchmarking.org Figure Of Merit, More Is Better Algebraic Multi-Grid Benchmark 1.2 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 600M 1200M 1800M 2400M 3000M Min: 1604196000 / Avg: 1605097000 / Max: 1605773000 Min: 3119972000 / Avg: 3124402666.67 / Max: 3128382000 Min: 1808063000 / Avg: 1814760000 / Max: 1821901000 Min: 3594221000 / Avg: 3609646333.33 / Max: 3625443000 Min: 1583443000 / Avg: 1588496666.67 / Max: 1594857000 Min: 3148914000 / Avg: 3156261666.67 / Max: 3170728000 Min: 1594535000 / Avg: 1597993333.33 / Max: 1600445000 Min: 3187407000 / Avg: 3205161000 / Max: 3217981000 1. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi
Xcompact3d Incompact3d Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 193 Cells Per Direction Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 SE +/- 0.01004100, N = 4 SE +/- 0.04312801, N = 5 SE +/- 0.02923582, N = 4 SE +/- 0.03329814, N = 5 SE +/- 0.04445674, N = 4 SE +/- 0.01741826, N = 5 SE +/- 0.01708632, N = 4 SE +/- 0.05695382, N = 15 12.92934130 6.39169817 10.19670660 5.39125967 13.96923760 7.29349117 12.79975820 6.66387510 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 193 Cells Per Direction Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 Min: 12.9 / Avg: 12.93 / Max: 12.94 Min: 6.3 / Avg: 6.39 / Max: 6.5 Min: 10.11 / Avg: 10.2 / Max: 10.24 Min: 5.3 / Avg: 5.39 / Max: 5.5 Min: 13.89 / Avg: 13.97 / Max: 14.08 Min: 7.25 / Avg: 7.29 / Max: 7.35 Min: 12.76 / Avg: 12.8 / Max: 12.84 Min: 6.44 / Avg: 6.66 / Max: 7.05 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
Timed FFmpeg Compilation Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed FFmpeg Compilation 7.0 Time To Compile Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 6 12 18 24 30 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 24.06 19.51 21.36 17.39 26.46 20.79 24.84 20.01 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Timed FFmpeg Compilation 7.0 Time To Compile Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 6 12 18 24 30 Min: 23.99 / Avg: 24.06 / Max: 24.11 Min: 19.48 / Avg: 19.51 / Max: 19.53 Min: 21.25 / Avg: 21.36 / Max: 21.48 Min: 17.29 / Avg: 17.39 / Max: 17.47 Min: 26.4 / Avg: 26.46 / Max: 26.49 Min: 20.61 / Avg: 20.79 / Max: 20.91 Min: 24.75 / Avg: 24.84 / Max: 25.02 Min: 19.96 / Avg: 20.01 / Max: 20.06
Intel Open Image Denoise Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.54 1.08 1.62 2.16 2.7 SE +/- 0.00, N = 3 SE +/- 0.01, N = 4 SE +/- 0.00, N = 3 SE +/- 0.01, N = 4 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 1.29 2.18 1.58 2.40 1.08 1.72 1.14 1.74 Result Confidence
OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 1.29 / Avg: 1.29 / Max: 1.29 Min: 2.17 / Avg: 2.18 / Max: 2.2 Min: 1.57 / Avg: 1.58 / Max: 1.58 Min: 2.36 / Avg: 2.4 / Max: 2.43 Min: 1.08 / Avg: 1.08 / Max: 1.08 Min: 1.69 / Avg: 1.72 / Max: 1.75 Min: 1.14 / Avg: 1.14 / Max: 1.14 Min: 1.72 / Avg: 1.74 / Max: 1.77
oneDNN Result
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Deconvolution Batch shapes_1d - Engine: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 SE +/- 0.00627, N = 3 SE +/- 0.10023, N = 3 SE +/- 0.08324, N = 3 SE +/- 0.32768, N = 3 SE +/- 0.00876, N = 3 SE +/- 0.10586, N = 3 SE +/- 0.02700, N = 3 SE +/- 0.09318, N = 3 6.15856 16.55070 6.69692 38.08130 5.30953 13.45000 6.09747 16.09010 MIN: 14.58 MIN: 3.74 MIN: 9.76 MIN: 11.97 MIN: 9.89 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread Result Confidence
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Deconvolution Batch shapes_1d - Engine: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 Min: 6.15 / Avg: 6.16 / Max: 6.17 Min: 16.42 / Avg: 16.55 / Max: 16.75 Min: 6.53 / Avg: 6.7 / Max: 6.79 Min: 37.55 / Avg: 38.08 / Max: 38.68 Min: 5.3 / Avg: 5.31 / Max: 5.33 Min: 13.34 / Avg: 13.45 / Max: 13.66 Min: 6.06 / Avg: 6.1 / Max: 6.15 Min: 15.93 / Avg: 16.09 / Max: 16.25 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
x265 Result
OpenBenchmarking.org Frames Per Second, More Is Better x265 3.6 Video Input: Bosphorus 4K Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 9 18 27 36 45 SE +/- 0.11, N = 4 SE +/- 0.20, N = 4 SE +/- 0.06, N = 4 SE +/- 0.09, N = 4 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 SE +/- 0.39, N = 3 SE +/- 0.10, N = 3 37.86 37.04 38.93 39.31 29.05 27.26 31.40 27.90 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better x265 3.6 Video Input: Bosphorus 4K Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 8 16 24 32 40 Min: 37.57 / Avg: 37.86 / Max: 38.09 Min: 36.47 / Avg: 37.04 / Max: 37.35 Min: 38.78 / Avg: 38.93 / Max: 39.05 Min: 39.1 / Avg: 39.31 / Max: 39.54 Min: 28.95 / Avg: 29.05 / Max: 29.2 Min: 27.05 / Avg: 27.26 / Max: 27.46 Min: 30.63 / Avg: 31.4 / Max: 31.86 Min: 27.71 / Avg: 27.9 / Max: 28.05 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
uvg266 uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12 24 36 48 60 SE +/- 0.01, N = 4 SE +/- 0.50, N = 5 SE +/- 0.08, N = 3 SE +/- 0.16, N = 5 SE +/- 0.12, N = 4 SE +/- 0.39, N = 4 SE +/- 0.02, N = 4 SE +/- 0.38, N = 9 49.42 54.88 35.10 53.66 39.56 44.75 40.82 46.25 Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11 22 33 44 55 Min: 49.38 / Avg: 49.42 / Max: 49.44 Min: 53.2 / Avg: 54.88 / Max: 55.71 Min: 35 / Avg: 35.1 / Max: 35.26 Min: 53.09 / Avg: 53.66 / Max: 54.03 Min: 39.31 / Avg: 39.56 / Max: 39.87 Min: 43.63 / Avg: 44.75 / Max: 45.44 Min: 40.78 / Avg: 40.82 / Max: 40.87 Min: 43.42 / Avg: 46.25 / Max: 47.35
LULESH LULESH is the Livermore Unstructured Lagrangian Explicit Shock Hydrodynamics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org z/s, More Is Better LULESH 2.0.3 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 15K 30K 45K 60K 75K SE +/- 182.38, N = 15 SE +/- 272.44, N = 4 SE +/- 437.51, N = 4 SE +/- 359.29, N = 3 SE +/- 211.12, N = 6 SE +/- 206.20, N = 5 SE +/- 217.67, N = 6 SE +/- 207.54, N = 5 23072.30 43724.06 38433.97 70826.73 23848.54 52102.67 25831.84 53269.47 1. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi Result Confidence
OpenBenchmarking.org z/s, More Is Better LULESH 2.0.3 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12K 24K 36K 48K 60K Min: 22442.42 / Avg: 23072.3 / Max: 24854.97 Min: 43120.05 / Avg: 43724.06 / Max: 44351.44 Min: 37570.41 / Avg: 38433.97 / Max: 39581.93 Min: 70411.43 / Avg: 70826.73 / Max: 71542.22 Min: 23318.39 / Avg: 23848.54 / Max: 24737.69 Min: 51553.3 / Avg: 52102.67 / Max: 52648.4 Min: 25218.46 / Avg: 25831.84 / Max: 26468.29 Min: 52904.08 / Avg: 53269.47 / Max: 54044.05 1. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi
oneDNN Result
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: IP Shapes 1D - Engine: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.1762 0.3524 0.5286 0.7048 0.881 SE +/- 0.000915, N = 4 SE +/- 0.004208, N = 4 SE +/- 0.000767, N = 4 SE +/- 0.004443, N = 4 SE +/- 0.001869, N = 4 SE +/- 0.004822, N = 4 SE +/- 0.000666, N = 4 SE +/- 0.003500, N = 4 0.539467 0.783180 0.398446 0.580664 0.725974 0.662387 0.617190 0.759434 MIN: 0.5 MIN: 0.69 MIN: 0.37 MIN: 0.51 MIN: 0.67 MIN: 0.58 MIN: 0.55 MIN: 0.67 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread Result Confidence
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: IP Shapes 1D - Engine: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 0.54 / Avg: 0.54 / Max: 0.54 Min: 0.78 / Avg: 0.78 / Max: 0.79 Min: 0.4 / Avg: 0.4 / Max: 0.4 Min: 0.57 / Avg: 0.58 / Max: 0.59 Min: 0.72 / Avg: 0.73 / Max: 0.73 Min: 0.65 / Avg: 0.66 / Max: 0.67 Min: 0.62 / Avg: 0.62 / Max: 0.62 Min: 0.75 / Avg: 0.76 / Max: 0.77 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
TensorFlow Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: AlexNet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 200 400 600 800 1000 SE +/- 0.51, N = 5 SE +/- 7.98, N = 5 SE +/- 6.22, N = 5 SE +/- 2.22, N = 5 SE +/- 1.95, N = 5 SE +/- 6.39, N = 13 SE +/- 2.31, N = 5 SE +/- 7.35, N = 5 969.62 996.47 819.89 858.84 841.68 932.59 852.36 940.40 Result Confidence
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: AlexNet Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 200 400 600 800 1000 Min: 967.81 / Avg: 969.62 / Max: 970.66 Min: 974.8 / Avg: 996.47 / Max: 1013.95 Min: 804.06 / Avg: 819.89 / Max: 835.54 Min: 851.44 / Avg: 858.84 / Max: 863.21 Min: 835.07 / Avg: 841.68 / Max: 847.3 Min: 886.72 / Avg: 932.59 / Max: 964.83 Min: 843.3 / Avg: 852.36 / Max: 855.6 Min: 915.38 / Avg: 940.4 / Max: 955.94
NAS Parallel Benchmarks NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: SP.C Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50K 100K 150K 200K 250K SE +/- 150.79, N = 3 SE +/- 560.20, N = 4 SE +/- 31.76, N = 4 SE +/- 1528.09, N = 5 SE +/- 67.02, N = 3 SE +/- 679.14, N = 4 SE +/- 9.58, N = 3 SE +/- 420.81, N = 4 71245.26 147311.14 109416.42 228184.68 58815.36 135939.25 69776.41 141954.15 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6 Result Confidence
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: SP.C Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40K 80K 120K 160K 200K Min: 70955.45 / Avg: 71245.26 / Max: 71462.44 Min: 145959.03 / Avg: 147311.14 / Max: 148493.65 Min: 109336.91 / Avg: 109416.42 / Max: 109491.39 Min: 224647.99 / Avg: 228184.68 / Max: 232147.61 Min: 58681.77 / Avg: 58815.36 / Max: 58891.71 Min: 134710.35 / Avg: 135939.25 / Max: 137559.55 Min: 69763.13 / Avg: 69776.41 / Max: 69795.01 Min: 141180.27 / Avg: 141954.15 / Max: 143017.08 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
Pennant Pennant is an application focused on hydrodynamics on general unstructured meshes in 2D. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: sedovbig Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 SE +/- 0.002987, N = 3 SE +/- 0.016400, N = 4 SE +/- 0.002400, N = 3 SE +/- 0.018471, N = 4 SE +/- 0.001847, N = 3 SE +/- 0.003237, N = 4 SE +/- 0.013353, N = 3 SE +/- 0.003253, N = 4 16.030800 11.284380 16.969100 9.964526 21.021120 13.211250 19.882460 12.106900 1. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi Result Confidence
OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: sedovbig Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 Min: 16.03 / Avg: 16.03 / Max: 16.04 Min: 11.26 / Avg: 11.28 / Max: 11.32 Min: 16.96 / Avg: 16.97 / Max: 16.97 Min: 9.93 / Avg: 9.96 / Max: 10.01 Min: 21.02 / Avg: 21.02 / Max: 21.02 Min: 13.2 / Avg: 13.21 / Max: 13.22 Min: 19.86 / Avg: 19.88 / Max: 19.91 Min: 12.1 / Avg: 12.11 / Max: 12.12 1. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
Kvazaar This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.75, N = 15 SE +/- 0.54, N = 6 SE +/- 0.17, N = 4 SE +/- 0.39, N = 6 SE +/- 0.13, N = 5 SE +/- 0.55, N = 5 SE +/- 0.32, N = 5 SE +/- 0.56, N = 5 74.57 72.01 47.07 73.81 63.10 54.98 63.99 58.14 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 14 28 42 56 70 Min: 70.66 / Avg: 74.57 / Max: 78.92 Min: 70.3 / Avg: 72.01 / Max: 74.05 Min: 46.74 / Avg: 47.07 / Max: 47.5 Min: 72.23 / Avg: 73.81 / Max: 74.78 Min: 62.76 / Avg: 63.1 / Max: 63.39 Min: 53.66 / Avg: 54.98 / Max: 56.35 Min: 63.29 / Avg: 63.99 / Max: 65.12 Min: 56.45 / Avg: 58.14 / Max: 59.86 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
uvg266 uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12 24 36 48 60 SE +/- 0.05, N = 5 SE +/- 0.16, N = 5 SE +/- 0.07, N = 3 SE +/- 0.21, N = 5 SE +/- 0.15, N = 4 SE +/- 0.43, N = 4 SE +/- 0.15, N = 4 SE +/- 0.41, N = 7 55.54 55.40 35.56 54.95 44.05 45.09 45.32 44.40 Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11 22 33 44 55 Min: 55.38 / Avg: 55.54 / Max: 55.63 Min: 55.15 / Avg: 55.4 / Max: 56.02 Min: 35.42 / Avg: 35.56 / Max: 35.67 Min: 54.35 / Avg: 54.95 / Max: 55.44 Min: 43.8 / Avg: 44.05 / Max: 44.49 Min: 43.91 / Avg: 45.09 / Max: 45.73 Min: 45.06 / Avg: 45.32 / Max: 45.73 Min: 43.12 / Avg: 44.4 / Max: 46.35
DaCapo Benchmark This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Jython Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 800 1600 2400 3200 4000 SE +/- 7.09, N = 4 SE +/- 24.09, N = 4 SE +/- 21.99, N = 4 SE +/- 9.71, N = 4 SE +/- 20.55, N = 4 SE +/- 28.30, N = 4 SE +/- 38.86, N = 5 SE +/- 24.34, N = 4 3801 3892 3424 3466 3785 3926 3707 3921 Result Confidence
OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Jython Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 700 1400 2100 2800 3500 Min: 3781 / Avg: 3800.5 / Max: 3811 Min: 3834 / Avg: 3892 / Max: 3936 Min: 3387 / Avg: 3424.25 / Max: 3477 Min: 3437 / Avg: 3465.75 / Max: 3478 Min: 3740 / Avg: 3785 / Max: 3829 Min: 3869 / Avg: 3925.75 / Max: 4000 Min: 3555 / Avg: 3707.2 / Max: 3770 Min: 3882 / Avg: 3921 / Max: 3989
JPEG-XL libjxl Result
OpenBenchmarking.org MP/s, More Is Better JPEG-XL libjxl 0.10.1 Input: PNG - Quality: 100 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 4 SE +/- 0.08, N = 4 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 28.10 27.66 31.35 30.97 26.25 26.84 27.09 26.99 1. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm Result Confidence
OpenBenchmarking.org MP/s, More Is Better JPEG-XL libjxl 0.10.1 Input: PNG - Quality: 100 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 Min: 28.02 / Avg: 28.1 / Max: 28.17 Min: 27.58 / Avg: 27.66 / Max: 27.72 Min: 31.21 / Avg: 31.35 / Max: 31.49 Min: 30.74 / Avg: 30.97 / Max: 31.11 Min: 26.23 / Avg: 26.25 / Max: 26.27 Min: 26.77 / Avg: 26.84 / Max: 26.91 Min: 27.04 / Avg: 27.09 / Max: 27.18 Min: 26.91 / Avg: 26.99 / Max: 27.05 1. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm
Timed Mesa Compilation Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed Mesa Compilation 24.0 Time To Compile Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 4 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 SE +/- 0.17, N = 3 19.23 18.29 17.26 16.18 20.18 18.47 19.65 18.14 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Timed Mesa Compilation 24.0 Time To Compile Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 Min: 19.12 / Avg: 19.23 / Max: 19.35 Min: 18.08 / Avg: 18.29 / Max: 18.51 Min: 17.11 / Avg: 17.26 / Max: 17.36 Min: 16.1 / Avg: 16.18 / Max: 16.32 Min: 20.13 / Avg: 20.18 / Max: 20.21 Min: 18.34 / Avg: 18.47 / Max: 18.57 Min: 19.52 / Avg: 19.65 / Max: 19.8 Min: 17.89 / Avg: 18.14 / Max: 18.46
PyBench This test profile reports the total time of the different average timed test results from PyBench. PyBench reports average test times for different functions such as BuiltinFunctionCalls and NestedForLoops, with this total result providing a rough estimate as to Python's average performance on a given system. This test profile runs PyBench each time for 20 rounds. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2018-02-16 Total For Average Test Times Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 170 340 510 680 850 SE +/- 0.33, N = 3 SE +/- 1.15, N = 3 SE +/- 0.41, N = 4 SE +/- 0.48, N = 4 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 SE +/- 0.58, N = 3 SE +/- 0.67, N = 3 765 767 691 692 763 763 762 763 Result Confidence
OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2018-02-16 Total For Average Test Times Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 130 260 390 520 650 Min: 764 / Avg: 764.67 / Max: 765 Min: 765 / Avg: 767 / Max: 769 Min: 690 / Avg: 691 / Max: 692 Min: 691 / Avg: 691.75 / Max: 693 Min: 762 / Avg: 762.67 / Max: 763 Min: 762 / Avg: 763.33 / Max: 764 Min: 761 / Avg: 762 / Max: 763 Min: 762 / Avg: 762.67 / Max: 764
DaCapo Benchmark This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Apache Kafka Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1200 2400 3600 4800 6000 SE +/- 1.20, N = 3 SE +/- 1.76, N = 3 SE +/- 31.50, N = 3 SE +/- 10.11, N = 3 SE +/- 6.44, N = 3 SE +/- 2.03, N = 3 SE +/- 3.51, N = 3 SE +/- 4.06, N = 3 5106 5113 5560 5611 5108 5101 5102 5088 Result Confidence
OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Apache Kafka Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1000 2000 3000 4000 5000 Min: 5104 / Avg: 5105.67 / Max: 5108 Min: 5110 / Avg: 5113.33 / Max: 5116 Min: 5528 / Avg: 5560 / Max: 5623 Min: 5593 / Avg: 5610.67 / Max: 5628 Min: 5100 / Avg: 5108.33 / Max: 5121 Min: 5097 / Avg: 5100.67 / Max: 5104 Min: 5098 / Avg: 5102 / Max: 5109 Min: 5081 / Avg: 5088.33 / Max: 5095
WebP Image Encode This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Lossless Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.3375 0.675 1.0125 1.35 1.6875 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 4 SE +/- 0.00, N = 4 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 1.31 1.30 1.50 1.50 1.40 1.39 1.39 1.39 1. (CC) gcc options: -fvisibility=hidden -O2 -lm Result Confidence
OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Lossless Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 1.31 / Avg: 1.31 / Max: 1.32 Min: 1.3 / Avg: 1.3 / Max: 1.3 Min: 1.5 / Avg: 1.5 / Max: 1.5 Min: 1.5 / Avg: 1.5 / Max: 1.51 Min: 1.4 / Avg: 1.4 / Max: 1.4 Min: 1.39 / Avg: 1.39 / Max: 1.4 Min: 1.37 / Avg: 1.39 / Max: 1.4 Min: 1.39 / Avg: 1.39 / Max: 1.39 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
Timed ImageMagick Compilation This test times how long it takes to build ImageMagick. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed ImageMagick Compilation 6.9.0 Time To Compile Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 SE +/- 0.10, N = 4 SE +/- 0.13, N = 4 SE +/- 0.10, N = 4 SE +/- 0.03, N = 4 SE +/- 0.15, N = 4 SE +/- 0.11, N = 4 SE +/- 0.06, N = 4 SE +/- 0.07, N = 4 14.72 13.26 12.60 11.49 16.08 14.40 15.38 14.09 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Timed ImageMagick Compilation 6.9.0 Time To Compile Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 Min: 14.58 / Avg: 14.72 / Max: 15.02 Min: 12.91 / Avg: 13.26 / Max: 13.45 Min: 12.33 / Avg: 12.59 / Max: 12.77 Min: 11.45 / Avg: 11.49 / Max: 11.58 Min: 15.84 / Avg: 16.07 / Max: 16.45 Min: 14.08 / Avg: 14.4 / Max: 14.57 Min: 15.25 / Avg: 15.38 / Max: 15.51 Min: 13.9 / Avg: 14.09 / Max: 14.22
JPEG-XL libjxl Result
OpenBenchmarking.org MP/s, More Is Better JPEG-XL libjxl 0.10.1 Input: JPEG - Quality: 100 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 4 SE +/- 0.07, N = 4 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 28.75 28.16 32.24 31.61 26.86 27.33 27.75 27.26 1. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm Result Confidence
OpenBenchmarking.org MP/s, More Is Better JPEG-XL libjxl 0.10.1 Input: JPEG - Quality: 100 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 7 14 21 28 35 Min: 28.71 / Avg: 28.75 / Max: 28.79 Min: 28.02 / Avg: 28.16 / Max: 28.3 Min: 32.13 / Avg: 32.24 / Max: 32.33 Min: 31.44 / Avg: 31.61 / Max: 31.73 Min: 26.8 / Avg: 26.86 / Max: 26.92 Min: 27.3 / Avg: 27.33 / Max: 27.35 Min: 27.7 / Avg: 27.75 / Max: 27.8 Min: 27.13 / Avg: 27.26 / Max: 27.37 1. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm
ASTC Encoder Result
OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Thorough Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.01, N = 4 SE +/- 0.19, N = 5 SE +/- 0.05, N = 4 SE +/- 0.55, N = 5 SE +/- 0.01, N = 3 SE +/- 0.05, N = 4 SE +/- 0.03, N = 4 SE +/- 0.03, N = 5 51.30 86.98 54.45 97.94 37.01 72.33 42.98 83.34 1. (CXX) g++ options: -O3 -flto -pthread Result Confidence
OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Thorough Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 Min: 51.28 / Avg: 51.3 / Max: 51.34 Min: 86.65 / Avg: 86.98 / Max: 87.71 Min: 54.31 / Avg: 54.45 / Max: 54.51 Min: 96.94 / Avg: 97.94 / Max: 100 Min: 36.99 / Avg: 37.01 / Max: 37.02 Min: 72.18 / Avg: 72.33 / Max: 72.42 Min: 42.9 / Avg: 42.98 / Max: 43.03 Min: 83.28 / Avg: 83.34 / Max: 83.41 1. (CXX) g++ options: -O3 -flto -pthread
NAS Parallel Benchmarks NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: LU.C Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 100K 200K 300K 400K 500K SE +/- 130.20, N = 4 SE +/- 398.40, N = 5 SE +/- 213.44, N = 5 SE +/- 726.00, N = 5 SE +/- 71.37, N = 3 SE +/- 441.66, N = 5 SE +/- 37.04, N = 4 SE +/- 411.20, N = 5 135125.15 261127.09 232012.77 455312.09 126171.52 246822.52 131606.86 257384.55 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6 Result Confidence
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: LU.C Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 80K 160K 240K 320K 400K Min: 134862.89 / Avg: 135125.15 / Max: 135480.43 Min: 259931.1 / Avg: 261127.09 / Max: 262324.4 Min: 231497.6 / Avg: 232012.77 / Max: 232534.8 Min: 453562.19 / Avg: 455312.09 / Max: 457552.33 Min: 126028.82 / Avg: 126171.52 / Max: 126245.73 Min: 245480.17 / Avg: 246822.52 / Max: 248109.68 Min: 131510.26 / Avg: 131606.86 / Max: 131683.36 Min: 256169.08 / Avg: 257384.55 / Max: 258663.51 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
m-queens A solver for the N-queens problem with multi-threading support via the OpenMP library. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better m-queens 1.2 Time To Solve Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 SE +/- 0.025, N = 4 SE +/- 0.021, N = 6 SE +/- 0.030, N = 4 SE +/- 0.028, N = 6 SE +/- 0.031, N = 3 SE +/- 0.021, N = 5 SE +/- 0.035, N = 3 SE +/- 0.028, N = 5 15.211 7.881 14.257 7.402 21.030 10.840 18.102 9.285 1. (CXX) g++ options: -fopenmp -O2 -march=native Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better m-queens 1.2 Time To Solve Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 Min: 15.14 / Avg: 15.21 / Max: 15.26 Min: 7.83 / Avg: 7.88 / Max: 7.95 Min: 14.2 / Avg: 14.26 / Max: 14.31 Min: 7.29 / Avg: 7.4 / Max: 7.48 Min: 21 / Avg: 21.03 / Max: 21.09 Min: 10.77 / Avg: 10.84 / Max: 10.89 Min: 18.04 / Avg: 18.1 / Max: 18.16 Min: 9.2 / Avg: 9.28 / Max: 9.37 1. (CXX) g++ options: -fopenmp -O2 -march=native
srsRAN Project Result
OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PUSCH Processor Benchmark, Throughput Thread Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 129.7 129.7 129.5 129.5 129.7 129.7 129.7 129.7 MIN: 105.9 MIN: 105.9 MIN: 105.7 MIN: 105.7 MIN: 105.9 MIN: 105.9 MIN: 105.9 MIN: 105.9 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl Result Confidence
OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PUSCH Processor Benchmark, Throughput Thread Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20 40 60 80 100 Min: 129.7 / Avg: 129.7 / Max: 129.7 Min: 129.7 / Avg: 129.7 / Max: 129.7 Min: 129.5 / Avg: 129.5 / Max: 129.5 Min: 129.5 / Avg: 129.5 / Max: 129.5 Min: 129.7 / Avg: 129.7 / Max: 129.7 Min: 129.7 / Avg: 129.7 / Max: 129.7 Min: 129.7 / Avg: 129.7 / Max: 129.7 Min: 129.7 / Avg: 129.7 / Max: 129.7 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl
Y-Cruncher Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Y-Cruncher 0.8.3 Pi Digits To Calculate: 500M Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.8507 1.7014 2.5521 3.4028 4.2535 SE +/- 0.003, N = 7 SE +/- 0.002, N = 8 SE +/- 0.008, N = 7 SE +/- 0.004, N = 7 SE +/- 0.010, N = 7 SE +/- 0.064, N = 15 SE +/- 0.023, N = 15 SE +/- 0.074, N = 15 3.267 2.364 3.391 2.659 3.781 3.110 3.704 2.961 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Y-Cruncher 0.8.3 Pi Digits To Calculate: 500M Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 3.26 / Avg: 3.27 / Max: 3.28 Min: 2.36 / Avg: 2.36 / Max: 2.38 Min: 3.37 / Avg: 3.39 / Max: 3.43 Min: 2.65 / Avg: 2.66 / Max: 2.68 Min: 3.74 / Avg: 3.78 / Max: 3.82 Min: 2.76 / Avg: 3.11 / Max: 3.5 Min: 3.6 / Avg: 3.7 / Max: 3.98 Min: 2.67 / Avg: 2.96 / Max: 3.48
NAS Parallel Benchmarks NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: CG.C Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20K 40K 60K 80K 100K SE +/- 243.41, N = 12 SE +/- 178.23, N = 8 SE +/- 328.18, N = 8 SE +/- 271.54, N = 6 SE +/- 313.88, N = 7 SE +/- 545.92, N = 15 SE +/- 260.16, N = 15 SE +/- 560.41, N = 15 33811.63 58128.24 63760.45 98764.93 35116.55 65396.22 35234.06 66492.44 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6 Result Confidence
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: CG.C Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 20K 40K 60K 80K 100K Min: 32823.96 / Avg: 33811.63 / Max: 35427.22 Min: 57523.16 / Avg: 58128.24 / Max: 59031.08 Min: 62397.94 / Avg: 63760.45 / Max: 64819.94 Min: 98048.32 / Avg: 98764.93 / Max: 99644.91 Min: 34000.56 / Avg: 35116.55 / Max: 36330.28 Min: 62703.28 / Avg: 65396.22 / Max: 69335.3 Min: 33494.3 / Avg: 35234.06 / Max: 36603.54 Min: 64389.69 / Avg: 66492.44 / Max: 70869.72 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
Kvazaar This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Very Fast Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 15 30 45 60 75 SE +/- 0.08, N = 4 SE +/- 0.45, N = 5 SE +/- 0.04, N = 4 SE +/- 0.36, N = 5 SE +/- 0.06, N = 4 SE +/- 0.33, N = 4 SE +/- 0.08, N = 4 SE +/- 0.29, N = 4 50.03 67.64 38.02 65.38 40.23 51.91 41.34 52.23 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Very Fast Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 13 26 39 52 65 Min: 49.83 / Avg: 50.03 / Max: 50.24 Min: 65.99 / Avg: 67.64 / Max: 68.59 Min: 37.96 / Avg: 38.02 / Max: 38.14 Min: 64.71 / Avg: 65.38 / Max: 66.72 Min: 40.08 / Avg: 40.23 / Max: 40.36 Min: 51.22 / Avg: 51.91 / Max: 52.55 Min: 41.16 / Avg: 41.34 / Max: 41.47 Min: 51.62 / Avg: 52.23 / Max: 52.85 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Embree Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 SE +/- 0.05, N = 5 SE +/- 0.13, N = 7 SE +/- 0.13, N = 6 SE +/- 0.26, N = 8 SE +/- 0.04, N = 5 SE +/- 0.63, N = 6 SE +/- 0.11, N = 5 SE +/- 1.20, N = 15 91.99 152.75 112.66 199.61 75.47 125.75 83.49 129.75 MIN: 88.57 / MAX: 98.54 MIN: 143.8 / MAX: 168.98 MIN: 107.88 / MAX: 117.19 MIN: 185.98 / MAX: 216.64 MIN: 72.93 / MAX: 78.77 MIN: 120.06 / MAX: 135.13 MIN: 80.58 / MAX: 88.97 MIN: 110.67 / MAX: 151.91 Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 Min: 91.83 / Avg: 91.99 / Max: 92.12 Min: 152.14 / Avg: 152.75 / Max: 153.15 Min: 112.23 / Avg: 112.66 / Max: 112.98 Min: 198.29 / Avg: 199.61 / Max: 200.37 Min: 75.31 / Avg: 75.47 / Max: 75.57 Min: 123.85 / Avg: 125.75 / Max: 127.4 Min: 83.26 / Avg: 83.49 / Max: 83.88 Min: 122.92 / Avg: 129.75 / Max: 137.51
GNU Octave Benchmark This test profile measures how long it takes to complete several reference GNU Octave files via octave-benchmark. GNU Octave is used for numerical computations and is an open-source alternative to MATLAB. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better GNU Octave Benchmark 8.4.0 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 SE +/- 0.015, N = 6 SE +/- 0.019, N = 6 SE +/- 0.020, N = 6 SE +/- 0.019, N = 6 SE +/- 0.015, N = 6 SE +/- 0.096, N = 5 SE +/- 0.024, N = 6 SE +/- 0.082, N = 5 7.532 8.036 6.458 6.856 7.622 12.617 7.748 12.578 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better GNU Octave Benchmark 8.4.0 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 4 8 12 16 20 Min: 7.49 / Avg: 7.53 / Max: 7.6 Min: 7.97 / Avg: 8.04 / Max: 8.09 Min: 6.42 / Avg: 6.46 / Max: 6.55 Min: 6.81 / Avg: 6.86 / Max: 6.94 Min: 7.57 / Avg: 7.62 / Max: 7.67 Min: 12.38 / Avg: 12.62 / Max: 12.95 Min: 7.69 / Avg: 7.75 / Max: 7.83 Min: 12.35 / Avg: 12.58 / Max: 12.85
Intel Open Image Denoise Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1.1318 2.2636 3.3954 4.5272 5.659 SE +/- 0.00, N = 4 SE +/- 0.03, N = 6 SE +/- 0.00, N = 5 SE +/- 0.03, N = 6 SE +/- 0.00, N = 4 SE +/- 0.01, N = 5 SE +/- 0.00, N = 4 SE +/- 0.04, N = 5 2.71 4.41 3.31 5.03 2.26 3.51 2.38 3.65 Result Confidence
OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 2.71 / Avg: 2.71 / Max: 2.71 Min: 4.31 / Avg: 4.41 / Max: 4.47 Min: 3.3 / Avg: 3.31 / Max: 3.31 Min: 4.94 / Avg: 5.03 / Max: 5.1 Min: 2.26 / Avg: 2.26 / Max: 2.26 Min: 3.48 / Avg: 3.51 / Max: 3.55 Min: 2.37 / Avg: 2.38 / Max: 2.38 Min: 3.5 / Avg: 3.65 / Max: 3.72
Pennant Pennant is an application focused on hydrodynamics on general unstructured meshes in 2D. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: leblancbig Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1.3345 2.669 4.0035 5.338 6.6725 SE +/- 0.022393, N = 7 SE +/- 0.019069, N = 15 SE +/- 0.022698, N = 7 SE +/- 0.013568, N = 6 SE +/- 0.025580, N = 6 SE +/- 0.010204, N = 7 SE +/- 0.023904, N = 7 SE +/- 0.008354, N = 7 4.955865 2.529807 4.182707 2.159459 5.930957 2.881099 5.114161 2.527363 1. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi Result Confidence
OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: leblancbig Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 4.88 / Avg: 4.96 / Max: 5.02 Min: 2.43 / Avg: 2.53 / Max: 2.69 Min: 4.11 / Avg: 4.18 / Max: 4.29 Min: 2.1 / Avg: 2.16 / Max: 2.2 Min: 5.84 / Avg: 5.93 / Max: 6 Min: 2.84 / Avg: 2.88 / Max: 2.91 Min: 5.02 / Avg: 5.11 / Max: 5.19 Min: 2.5 / Avg: 2.53 / Max: 2.55 1. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
Intel Open Image Denoise Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1.1453 2.2906 3.4359 4.5812 5.7265 SE +/- 0.00, N = 4 SE +/- 0.01, N = 6 SE +/- 0.00, N = 5 SE +/- 0.03, N = 6 SE +/- 0.00, N = 4 SE +/- 0.02, N = 5 SE +/- 0.00, N = 4 SE +/- 0.02, N = 5 2.71 4.48 3.32 5.09 2.27 3.49 2.39 3.66 Result Confidence
OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 2.71 / Avg: 2.71 / Max: 2.71 Min: 4.44 / Avg: 4.48 / Max: 4.51 Min: 3.31 / Avg: 3.32 / Max: 3.32 Min: 4.98 / Avg: 5.09 / Max: 5.17 Min: 2.26 / Avg: 2.27 / Max: 2.27 Min: 3.47 / Avg: 3.49 / Max: 3.57 Min: 2.38 / Avg: 2.39 / Max: 2.4 Min: 3.61 / Avg: 3.66 / Max: 3.71
Embree Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Crown Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 SE +/- 0.07, N = 5 SE +/- 0.12, N = 6 SE +/- 0.05, N = 5 SE +/- 0.07, N = 7 SE +/- 0.05, N = 4 SE +/- 0.14, N = 6 SE +/- 0.02, N = 4 SE +/- 0.48, N = 6 70.05 124.71 82.97 153.16 58.42 107.63 65.33 116.61 MIN: 63.26 / MAX: 79.13 MIN: 115.3 / MAX: 143.82 MIN: 79.09 / MAX: 87.11 MIN: 143.78 / MAX: 166.08 MIN: 55.81 / MAX: 61.43 MIN: 102.22 / MAX: 114.8 MIN: 60.89 / MAX: 69.91 MIN: 107.47 / MAX: 129.72 Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Crown Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 Min: 69.83 / Avg: 70.05 / Max: 70.24 Min: 124.35 / Avg: 124.71 / Max: 124.98 Min: 82.86 / Avg: 82.97 / Max: 83.1 Min: 152.88 / Avg: 153.16 / Max: 153.46 Min: 58.32 / Avg: 58.42 / Max: 58.54 Min: 107.1 / Avg: 107.63 / Max: 108.16 Min: 65.28 / Avg: 65.33 / Max: 65.36 Min: 114.38 / Avg: 116.61 / Max: 117.54
WebP Image Encode This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Highest Compression Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.7808 1.5616 2.3424 3.1232 3.904 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 3.08 3.07 3.47 3.46 3.10 3.09 3.10 3.09 1. (CC) gcc options: -fvisibility=hidden -O2 -lm Result Confidence
OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Highest Compression Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 3.08 / Avg: 3.08 / Max: 3.08 Min: 3.07 / Avg: 3.07 / Max: 3.07 Min: 3.46 / Avg: 3.47 / Max: 3.47 Min: 3.46 / Avg: 3.46 / Max: 3.46 Min: 3.1 / Avg: 3.1 / Max: 3.1 Min: 3.09 / Avg: 3.09 / Max: 3.09 Min: 3.09 / Avg: 3.1 / Max: 3.1 Min: 3.09 / Avg: 3.09 / Max: 3.09 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
oneDNN Result
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: IP Shapes 3D - Engine: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.973 1.946 2.919 3.892 4.865 SE +/- 0.003025, N = 5 SE +/- 0.005935, N = 5 SE +/- 0.001432, N = 5 SE +/- 0.004380, N = 5 SE +/- 0.003490, N = 5 SE +/- 0.004988, N = 5 SE +/- 0.010419, N = 5 SE +/- 0.005278, N = 5 0.771506 0.714699 0.841608 0.738442 4.324650 4.283990 4.274810 4.175530 MIN: 0.81 MIN: 4.21 MIN: 4.18 MIN: 4.18 MIN: 4.06 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread Result Confidence
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: IP Shapes 3D - Engine: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 0.76 / Avg: 0.77 / Max: 0.78 Min: 0.69 / Avg: 0.71 / Max: 0.73 Min: 0.84 / Avg: 0.84 / Max: 0.84 Min: 0.72 / Avg: 0.74 / Max: 0.75 Min: 4.31 / Avg: 4.32 / Max: 4.33 Min: 4.27 / Avg: 4.28 / Max: 4.3 Min: 4.24 / Avg: 4.27 / Max: 4.3 Min: 4.17 / Avg: 4.18 / Max: 4.19 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Google Draco Result
OpenBenchmarking.org ms, Fewer Is Better Google Draco 1.5.6 Model: Church Facade Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1500 3000 4500 6000 7500 SE +/- 14.74, N = 6 SE +/- 18.12, N = 6 SE +/- 30.70, N = 7 SE +/- 20.74, N = 7 SE +/- 7.18, N = 6 SE +/- 7.99, N = 6 SE +/- 9.53, N = 6 SE +/- 22.13, N = 6 5670 5672 4565 4693 6707 6821 6693 6777 1. (CXX) g++ options: -O3 Result Confidence
OpenBenchmarking.org ms, Fewer Is Better Google Draco 1.5.6 Model: Church Facade Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1200 2400 3600 4800 6000 Min: 5627 / Avg: 5669.67 / Max: 5716 Min: 5610 / Avg: 5672 / Max: 5728 Min: 4454 / Avg: 4564.71 / Max: 4671 Min: 4619 / Avg: 4693.29 / Max: 4788 Min: 6681 / Avg: 6706.67 / Max: 6731 Min: 6805 / Avg: 6821.17 / Max: 6852 Min: 6661 / Avg: 6692.5 / Max: 6711 Min: 6747 / Avg: 6777 / Max: 6884 1. (CXX) g++ options: -O3
oneDNN Result
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Convolution Batch Shapes Auto - Engine: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 SE +/- 0.001388, N = 7 SE +/- 0.001522, N = 7 SE +/- 0.002339, N = 7 SE +/- 0.001169, N = 7 SE +/- 0.005800, N = 7 SE +/- 0.039215, N = 7 SE +/- 0.017741, N = 7 SE +/- 0.015670, N = 7 0.650618 0.438154 0.585804 0.306795 9.194340 7.754310 8.751050 7.060430 MIN: 6.88 MIN: 6.74 MIN: 7.59 MIN: 6.83 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread Result Confidence
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Convolution Batch Shapes Auto - Engine: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 0.65 / Avg: 0.65 / Max: 0.66 Min: 0.43 / Avg: 0.44 / Max: 0.45 Min: 0.58 / Avg: 0.59 / Max: 0.59 Min: 0.3 / Avg: 0.31 / Max: 0.31 Min: 9.17 / Avg: 9.19 / Max: 9.21 Min: 7.62 / Avg: 7.75 / Max: 7.93 Min: 8.65 / Avg: 8.75 / Max: 8.79 Min: 7.03 / Avg: 7.06 / Max: 7.15 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
ACES DGEMM This is a multi-threaded DGEMM benchmark. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org GFLOP/s, More Is Better ACES DGEMM 1.0 Sustained Floating-Point Rate Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 13 26 39 52 65 SE +/- 0.09, N = 5 SE +/- 0.28, N = 7 SE +/- 0.08, N = 6 SE +/- 0.11, N = 8 SE +/- 0.04, N = 4 SE +/- 0.06, N = 7 SE +/- 0.09, N = 5 SE +/- 0.04, N = 7 23.54 45.97 29.14 58.25 19.77 39.35 22.54 44.67 1. (CC) gcc options: -O3 -march=native -fopenmp Result Confidence
OpenBenchmarking.org GFLOP/s, More Is Better ACES DGEMM 1.0 Sustained Floating-Point Rate Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12 24 36 48 60 Min: 23.19 / Avg: 23.54 / Max: 23.66 Min: 44.71 / Avg: 45.97 / Max: 47.18 Min: 28.91 / Avg: 29.14 / Max: 29.35 Min: 57.76 / Avg: 58.25 / Max: 58.71 Min: 19.64 / Avg: 19.77 / Max: 19.83 Min: 39.07 / Avg: 39.35 / Max: 39.58 Min: 22.19 / Avg: 22.54 / Max: 22.74 Min: 44.57 / Avg: 44.67 / Max: 44.81 1. (CC) gcc options: -O3 -march=native -fopenmp
ASTC Encoder Result
OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Medium Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 120 240 360 480 600 SE +/- 0.16, N = 6 SE +/- 2.79, N = 6 SE +/- 1.17, N = 6 SE +/- 1.56, N = 7 SE +/- 0.03, N = 6 SE +/- 0.52, N = 6 SE +/- 0.08, N = 6 SE +/- 0.77, N = 6 333.99 484.55 327.78 550.02 247.30 441.65 284.33 483.10 1. (CXX) g++ options: -O3 -flto -pthread Result Confidence
OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Medium Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 100 200 300 400 500 Min: 333.25 / Avg: 333.99 / Max: 334.3 Min: 475.22 / Avg: 484.55 / Max: 496.05 Min: 323.69 / Avg: 327.78 / Max: 332.24 Min: 544.51 / Avg: 550.02 / Max: 557.3 Min: 247.19 / Avg: 247.3 / Max: 247.37 Min: 440.15 / Avg: 441.65 / Max: 443.01 Min: 284.1 / Avg: 284.33 / Max: 284.68 Min: 481.24 / Avg: 483.1 / Max: 486.35 1. (CXX) g++ options: -O3 -flto -pthread
libavif avifenc Result
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 6, Lossless Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.013, N = 7 SE +/- 0.022, N = 7 SE +/- 0.025, N = 7 SE +/- 0.031, N = 7 SE +/- 0.045, N = 6 SE +/- 0.027, N = 6 SE +/- 0.033, N = 6 SE +/- 0.035, N = 6 6.278 6.172 5.784 5.613 6.836 7.121 6.605 7.038 1. (CXX) g++ options: -O3 -fPIC -lm Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 6, Lossless Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 6.24 / Avg: 6.28 / Max: 6.34 Min: 6.12 / Avg: 6.17 / Max: 6.28 Min: 5.68 / Avg: 5.78 / Max: 5.87 Min: 5.49 / Avg: 5.61 / Max: 5.76 Min: 6.64 / Avg: 6.84 / Max: 6.93 Min: 7.04 / Avg: 7.12 / Max: 7.21 Min: 6.5 / Avg: 6.61 / Max: 6.7 Min: 6.95 / Avg: 7.04 / Max: 7.19 1. (CXX) g++ options: -O3 -fPIC -lm
SVT-AV1 Result
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 12 - Input: Bosphorus 4K Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40 80 120 160 200 SE +/- 0.41, N = 7 SE +/- 0.25, N = 7 SE +/- 0.20, N = 7 SE +/- 0.42, N = 7 SE +/- 0.61, N = 7 SE +/- 0.83, N = 5 SE +/- 0.40, N = 7 SE +/- 0.97, N = 6 164.25 156.52 177.86 165.50 146.10 122.09 151.72 127.55 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq Result Confidence
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 12 - Input: Bosphorus 4K Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 Min: 162.43 / Avg: 164.25 / Max: 165.44 Min: 155.7 / Avg: 156.52 / Max: 157.59 Min: 176.95 / Avg: 177.86 / Max: 178.57 Min: 163.4 / Avg: 165.49 / Max: 167.01 Min: 143.58 / Avg: 146.1 / Max: 148.45 Min: 119.74 / Avg: 122.09 / Max: 124.16 Min: 150.35 / Avg: 151.72 / Max: 153.47 Min: 125.11 / Avg: 127.55 / Max: 131.28 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Google Draco Result
OpenBenchmarking.org ms, Fewer Is Better Google Draco 1.5.6 Model: Lion Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1100 2200 3300 4400 5500 SE +/- 23.47, N = 7 SE +/- 25.25, N = 7 SE +/- 22.92, N = 8 SE +/- 21.09, N = 7 SE +/- 21.44, N = 6 SE +/- 18.24, N = 6 SE +/- 15.47, N = 6 SE +/- 25.38, N = 6 4731 4733 3861 3894 5217 5342 5188 5322 1. (CXX) g++ options: -O3 Result Confidence
OpenBenchmarking.org ms, Fewer Is Better Google Draco 1.5.6 Model: Lion Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 900 1800 2700 3600 4500 Min: 4655 / Avg: 4731.14 / Max: 4808 Min: 4650 / Avg: 4733 / Max: 4814 Min: 3776 / Avg: 3860.63 / Max: 3964 Min: 3821 / Avg: 3893.71 / Max: 3981 Min: 5164 / Avg: 5216.67 / Max: 5275 Min: 5293 / Avg: 5342.17 / Max: 5400 Min: 5162 / Avg: 5187.67 / Max: 5260 Min: 5250 / Avg: 5322 / Max: 5407 1. (CXX) g++ options: -O3
LAMMPS Molecular Dynamics Simulator LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ns/day, More Is Better LAMMPS Molecular Dynamics Simulator 23Jun2022 Model: Rhodopsin Protein Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 12 24 36 48 60 SE +/- 0.36, N = 15 SE +/- 0.33, N = 8 SE +/- 0.29, N = 15 SE +/- 0.97, N = 15 SE +/- 0.05, N = 11 SE +/- 0.11, N = 9 SE +/- 0.04, N = 11 SE +/- 0.09, N = 8 28.72 42.28 34.30 55.50 27.63 47.51 30.84 52.24 1. (CXX) g++ options: -O3 -lm -ldl Result Confidence
OpenBenchmarking.org ns/day, More Is Better LAMMPS Molecular Dynamics Simulator 23Jun2022 Model: Rhodopsin Protein Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11 22 33 44 55 Min: 26.69 / Avg: 28.72 / Max: 30.77 Min: 41.22 / Avg: 42.28 / Max: 43.66 Min: 32.32 / Avg: 34.3 / Max: 36.34 Min: 49.67 / Avg: 55.5 / Max: 63.1 Min: 27.37 / Avg: 27.63 / Max: 27.89 Min: 46.93 / Avg: 47.51 / Max: 47.92 Min: 30.65 / Avg: 30.84 / Max: 31.07 Min: 51.98 / Avg: 52.24 / Max: 52.65 1. (CXX) g++ options: -O3 -lm -ldl
libavif avifenc Result
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 10, Lossless Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 1.1963 2.3926 3.5889 4.7852 5.9815 SE +/- 0.006, N = 7 SE +/- 0.014, N = 7 SE +/- 0.008, N = 8 SE +/- 0.015, N = 8 SE +/- 0.005, N = 7 SE +/- 0.019, N = 7 SE +/- 0.015, N = 7 SE +/- 0.028, N = 7 4.923 5.074 4.456 4.579 4.916 5.317 4.867 5.311 1. (CXX) g++ options: -O3 -fPIC -lm Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 10, Lossless Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 4.9 / Avg: 4.92 / Max: 4.94 Min: 4.99 / Avg: 5.07 / Max: 5.1 Min: 4.42 / Avg: 4.46 / Max: 4.48 Min: 4.53 / Avg: 4.58 / Max: 4.67 Min: 4.9 / Avg: 4.92 / Max: 4.93 Min: 5.24 / Avg: 5.32 / Max: 5.39 Min: 4.78 / Avg: 4.87 / Max: 4.91 Min: 5.22 / Avg: 5.31 / Max: 5.44 1. (CXX) g++ options: -O3 -fPIC -lm
srsRAN Project Result
OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Thread Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 160 320 480 640 800 SE +/- 1.17, N = 8 SE +/- 2.57, N = 8 SE +/- 1.34, N = 8 SE +/- 1.89, N = 8 SE +/- 1.64, N = 8 SE +/- 3.86, N = 8 SE +/- 1.27, N = 8 SE +/- 5.02, N = 8 680.2 675.5 742.9 755.5 702.6 651.9 705.5 663.8 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl Result Confidence
OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Thread Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 130 260 390 520 650 Min: 673.5 / Avg: 680.21 / Max: 684.9 Min: 660.5 / Avg: 675.49 / Max: 682.4 Min: 736.2 / Avg: 742.86 / Max: 748 Min: 744 / Avg: 755.46 / Max: 760.7 Min: 693.6 / Avg: 702.59 / Max: 706.9 Min: 630.2 / Avg: 651.88 / Max: 668 Min: 698.5 / Avg: 705.51 / Max: 709.4 Min: 648.1 / Avg: 663.79 / Max: 686.5 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl
Primesieve Result
OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e12 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.019, N = 8 SE +/- 0.006, N = 10 SE +/- 0.007, N = 8 SE +/- 0.008, N = 11 SE +/- 0.006, N = 7 SE +/- 0.004, N = 9 SE +/- 0.010, N = 7 SE +/- 0.005, N = 10 4.576 2.325 4.250 2.187 6.160 3.121 5.332 2.691 1. (CXX) g++ options: -O3 Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e12 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 4.5 / Avg: 4.58 / Max: 4.65 Min: 2.29 / Avg: 2.32 / Max: 2.35 Min: 4.23 / Avg: 4.25 / Max: 4.29 Min: 2.14 / Avg: 2.19 / Max: 2.24 Min: 6.14 / Avg: 6.16 / Max: 6.19 Min: 3.11 / Avg: 3.12 / Max: 3.15 Min: 5.29 / Avg: 5.33 / Max: 5.37 Min: 2.67 / Avg: 2.69 / Max: 2.72 1. (CXX) g++ options: -O3
libavif avifenc Result
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 6 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.8496 1.6992 2.5488 3.3984 4.248 SE +/- 0.022, N = 9 SE +/- 0.008, N = 9 SE +/- 0.016, N = 9 SE +/- 0.009, N = 10 SE +/- 0.017, N = 9 SE +/- 0.029, N = 8 SE +/- 0.011, N = 9 SE +/- 0.022, N = 9 3.169 3.044 2.971 2.805 3.730 3.776 3.550 3.738 1. (CXX) g++ options: -O3 -fPIC -lm Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 6 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 3.07 / Avg: 3.17 / Max: 3.24 Min: 3.02 / Avg: 3.04 / Max: 3.08 Min: 2.91 / Avg: 2.97 / Max: 3.06 Min: 2.77 / Avg: 2.81 / Max: 2.87 Min: 3.65 / Avg: 3.73 / Max: 3.81 Min: 3.64 / Avg: 3.78 / Max: 3.93 Min: 3.52 / Avg: 3.55 / Max: 3.62 Min: 3.67 / Avg: 3.74 / Max: 3.87 1. (CXX) g++ options: -O3 -fPIC -lm
NAS Parallel Benchmarks NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: MG.C Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 50K 100K 150K 200K 250K SE +/- 152.92, N = 9 SE +/- 1262.04, N = 9 SE +/- 406.29, N = 9 SE +/- 1422.07, N = 7 SE +/- 436.97, N = 10 SE +/- 1415.96, N = 9 SE +/- 382.59, N = 10 SE +/- 1298.67, N = 9 83448.70 163333.21 107321.89 220893.78 85910.95 172614.10 86407.46 171436.47 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6 Result Confidence
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: MG.C Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 40K 80K 120K 160K 200K Min: 82696.98 / Avg: 83448.7 / Max: 83933.89 Min: 159113.63 / Avg: 163333.21 / Max: 170615.72 Min: 105988.93 / Avg: 107321.89 / Max: 109240.43 Min: 215470.66 / Avg: 220893.78 / Max: 226829.96 Min: 83606.71 / Avg: 85910.95 / Max: 88256.51 Min: 164903.28 / Avg: 172614.1 / Max: 177274.16 Min: 84619.8 / Avg: 86407.46 / Max: 88485.16 Min: 166974.27 / Avg: 171436.47 / Max: 178199.79 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
Parallel BZIP2 Compression Result
OpenBenchmarking.org Seconds, Fewer Is Better Parallel BZIP2 Compression 1.1.13 FreeBSD-13.0-RELEASE-amd64-memstick.img Compression Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.5922 1.1844 1.7766 2.3688 2.961 SE +/- 0.007749, N = 10 SE +/- 0.017240, N = 15 SE +/- 0.023842, N = 15 SE +/- 0.024402, N = 15 SE +/- 0.023295, N = 15 SE +/- 0.030907, N = 15 SE +/- 0.020941, N = 15 SE +/- 0.028863, N = 15 2.144857 1.469210 1.847537 1.432362 2.632077 1.982932 2.287766 1.711296 1. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread Result Confidence
OpenBenchmarking.org Seconds, Fewer Is Better Parallel BZIP2 Compression 1.1.13 FreeBSD-13.0-RELEASE-amd64-memstick.img Compression Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 2.11 / Avg: 2.14 / Max: 2.2 Min: 1.4 / Avg: 1.47 / Max: 1.67 Min: 1.7 / Avg: 1.85 / Max: 2.11 Min: 1.33 / Avg: 1.43 / Max: 1.7 Min: 2.49 / Avg: 2.63 / Max: 2.87 Min: 1.86 / Avg: 1.98 / Max: 2.22 Min: 2.15 / Avg: 2.29 / Max: 2.4 Min: 1.55 / Avg: 1.71 / Max: 1.92 1. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread
oneDNN Result
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Deconvolution Batch shapes_3d - Engine: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 0.2844 0.5688 0.8532 1.1376 1.422 SE +/- 0.000805, N = 9 SE +/- 0.001274, N = 9 SE +/- 0.000392, N = 9 SE +/- 0.000902, N = 9 SE +/- 0.000508, N = 9 SE +/- 0.000806, N = 9 SE +/- 0.000927, N = 9 SE +/- 0.001240, N = 9 1.077430 0.736170 0.907161 0.624250 1.264070 0.945075 1.196430 0.864358 MIN: 1.06 MIN: 0.66 MIN: 0.87 MIN: 0.58 MIN: 1.21 MIN: 0.9 MIN: 1.16 MIN: 0.81 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread Result Confidence
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Deconvolution Batch shapes_3d - Engine: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 2 4 6 8 10 Min: 1.07 / Avg: 1.08 / Max: 1.08 Min: 0.73 / Avg: 0.74 / Max: 0.74 Min: 0.91 / Avg: 0.91 / Max: 0.91 Min: 0.62 / Avg: 0.62 / Max: 0.63 Min: 1.26 / Avg: 1.26 / Max: 1.27 Min: 0.94 / Avg: 0.95 / Max: 0.95 Min: 1.19 / Avg: 1.2 / Max: 1.2 Min: 0.86 / Avg: 0.86 / Max: 0.87 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
WebP Image Encode This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 SE +/- 0.01, N = 10 SE +/- 0.01, N = 10 SE +/- 0.00, N = 10 SE +/- 0.01, N = 10 SE +/- 0.00, N = 10 SE +/- 0.00, N = 10 SE +/- 0.00, N = 10 SE +/- 0.00, N = 10 10.11 10.05 11.36 11.31 10.13 10.01 10.13 10.03 1. (CC) gcc options: -fvisibility=hidden -O2 -lm Result Confidence
OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 3 6 9 12 15 Min: 10.08 / Avg: 10.11 / Max: 10.12 Min: 10 / Avg: 10.05 / Max: 10.1 Min: 11.34 / Avg: 11.36 / Max: 11.39 Min: 11.28 / Avg: 11.31 / Max: 11.34 Min: 10.11 / Avg: 10.13 / Max: 10.15 Min: 9.99 / Avg: 10.01 / Max: 10.03 Min: 10.11 / Avg: 10.13 / Max: 10.15 Min: 10.01 / Avg: 10.03 / Max: 10.05 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
Timed CPython Compilation This test times how long it takes to build the reference Python implementation, CPython, with optimizations and LTO enabled for a release build. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Timed CPython Compilation 3.10.6 Build Configuration: Default Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 5 10 15 20 25 19.20 18.93 17.08 16.93 19.12 18.81 18.85 18.82
Xeon Platinum 8490H Processor: Intel Xeon Platinum 8490H @ 3.50GHz (60 Cores / 120 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 16 April 2024 00:42 by user phoronix.
Xeon Platinum 8490H 2P Processor: 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 17 April 2024 09:38 by user phoronix.
Xeon Platinum 8592+ Processor: INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 11 April 2024 18:15 by user phoronix.
Xeon Platinum 8592+ 2P Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 8 April 2024 10:49 by user phoronix.
Xeon Max 9468 Processor: Intel Xeon Max 9468 @ 3.50GHz (48 Cores / 96 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 576GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 21 April 2024 09:58 by user phoronix.
Xeon Max 9468 2P Processor: 2 x Intel Xeon Max 9468 @ 3.50GHz (96 Cores / 192 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1136GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 22 April 2024 15:30 by user phoronix.
Xeon Max 9480 Processor: Intel Xeon Max 9480 @ 3.50GHz (56 Cores / 112 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 576GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 26 April 2024 09:38 by user phoronix.
Xeon Max 9480 2P Processor: 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1136GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 27 April 2024 16:18 by user phoronix.