2024 Server CPUs Benchmarks by Michael Larabel for a future article. 2 x Intel Xeon Max 9480 testing with a Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2405073-NE-UPLOAD15789&grr&sor&rro .
2024 Server CPUs Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System Screen Resolution Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Intel Xeon Platinum 8490H @ 3.50GHz (60 Cores / 120 Threads) Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS) Intel Device 1bce 512GB 2 x 1920GB KIOXIA KCD8XPUG1T92 ASPEED Ubuntu 24.04 6.9.0-060900rc3-generic (x86_64) GCC 13.2.0 ext4 1920x1200 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads) 1008GB 2 x Intel X710 for 10GBASE-T INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads) 512GB 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads) 1008GB 2 x Intel X710 for 10GBASE-T Intel Xeon Max 9468 @ 3.50GHz (48 Cores / 96 Threads) 576GB 2 x Intel Xeon Max 9468 @ 3.50GHz (96 Cores / 192 Threads) 1136GB 2 x Intel X710 for 10GBASE-T Intel Xeon Max 9480 @ 3.50GHz (56 Cores / 112 Threads) 576GB 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads) 1136GB 2 x Intel X710 for 10GBASE-T OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Xeon Platinum 8490H: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590 - Xeon Platinum 8490H 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590 - Xeon Platinum 8592+: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200 - Xeon Platinum 8592+ 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200 - Xeon Max 9468: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290 - Xeon Max 9468 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290 - Xeon Max 9480: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290 - Xeon Max 9480 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290 Java Details - OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) Python Details - Python 3.12.2 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
2024 Server CPUs wrf: conus 2.5km openvkl: vklBenchmarkCPU ISPC askap: tConvolve MT - Degridding nwchem: C240 Buckyball relion: Basic - CPU easywave: e2Asean Grid + BengkuluSept2007 Source - 2400 askap: tConvolve MT - Gridding cockroach: KV, 95% Reads - 512 brl-cad: VGR Performance Metric cockroach: KV, 60% Reads - 512 pgbench: 100 - 1000 - Read Only - Average Latency pgbench: 100 - 1000 - Read Only tensorflow: CPU - 512 - ResNet-50 cloverleaf: clover_bm16 namd: STMV with 1,066,628 Atoms hpcg: 144 144 144 - 60 apache-iotdb: 500 - 100 - 800 - 400 apache-iotdb: 500 - 100 - 800 - 400 clickhouse: 100M Rows Hits Dataset, Third Run clickhouse: 100M Rows Hits Dataset, Second Run clickhouse: 100M Rows Hits Dataset, First Run / Cold Cache openssl: RSA4096 openssl: RSA4096 tensorflow: CPU - 256 - ResNet-50 build-linux-kernel: allmodconfig incompact3d: X3D-benchmarking input.i3d stockfish: Chess Benchmark securemark: SecureMark-TLS apache-iotdb: 800 - 100 - 800 - 100 apache-iotdb: 800 - 100 - 800 - 100 cockroach: KV, 50% Reads - 512 pytorch: CPU - 64 - ResNet-152 luxcorerender: Danish Mood - CPU build-gem5: Time To Compile rocksdb: Read While Writing lammps: 20k Atoms blender: Barbershop - CPU-Only llamafile: wizardcoder-python-34b-v1.0.Q6_K - CPU build-nodejs: Time To Compile onnx: fcn-resnet101-11 - CPU - Standard onnx: fcn-resnet101-11 - CPU - Standard duckdb: TPC-H Parquet easywave: e2Asean Grid + BengkuluSept2007 Source - 1200 openradioss: Chrysler Neon 1M luxcorerender: DLSC - CPU ffmpeg: libx265 - Upload onnx: yolov4 - CPU - Standard onnx: yolov4 - CPU - Standard openssl: AES-128-GCM openssl: AES-256-GCM openssl: ChaCha20-Poly1305 openssl: SHA512 openssl: ChaCha20 openssl: SHA256 speedb: Rand Read ffmpeg: libx265 - Video On Demand ffmpeg: libx265 - Platform pytorch: CPU - 512 - ResNet-152 compress-zstd: 19 - Decompression Speed compress-zstd: 19 - Compression Speed onednn: Recurrent Neural Network Inference - CPU john-the-ripper: MD5 pytorch: CPU - 256 - ResNet-152 ospray: particle_volume/scivis/real_time duckdb: IMDB ospray: particle_volume/pathtracer/real_time ospray: gravity_spheres_volume/dim_512/scivis/real_time luxcorerender: Orange Juice - CPU build-llvm: Ninja namd: ATPase with 327,506 Atoms vvenc: Bosphorus 4K - Fast numpy: pytorch: CPU - 512 - ResNet-50 luxcorerender: LuxCore Benchmark - CPU openfoam: drivaerFastback, Medium Mesh Size - Execution Time openfoam: drivaerFastback, Medium Mesh Size - Mesh Time pgbench: 100 - 1000 - Read Write - Average Latency pgbench: 100 - 1000 - Read Write openradioss: Rubber O-Ring Seal Installation openradioss: INIVOL and Fluid Structure Interaction Drop Container compress-zstd: 19, Long Mode - Decompression Speed compress-zstd: 19, Long Mode - Compression Speed build-godot: Time To Compile xmrig: GhostRider - 1M tensorflow: CPU - 512 - GoogLeNet onnx: CaffeNet 12-int8 - CPU - Standard onnx: CaffeNet 12-int8 - CPU - Standard onnx: GPT-2 - CPU - Standard onnx: GPT-2 - CPU - Standard onnx: T5 Encoder - CPU - Parallel onnx: T5 Encoder - CPU - Parallel openradioss: Bird Strike on Windshield qmcpack: Li2_STO_ae appleseed: Material Tester onnx: ArcFace ResNet-100 - CPU - Standard onnx: ArcFace ResNet-100 - CPU - Standard ospray: gravity_spheres_volume/dim_512/ao/real_time ospray: particle_volume/ao/real_time onednn: Recurrent Neural Network Training - CPU speedb: Read While Writing memcached: 1:100 dacapobench: Tradesoap onnx: ResNet50 v1-12-int8 - CPU - Standard onnx: ResNet50 v1-12-int8 - CPU - Standard onnx: super-resolution-10 - CPU - Standard onnx: super-resolution-10 - CPU - Standard pytorch: CPU - 1 - ResNet-152 onnx: bertsquad-12 - CPU - Standard onnx: bertsquad-12 - CPU - Standard openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU onnx: T5 Encoder - CPU - Standard onnx: T5 Encoder - CPU - Standard build-python: Released Build, PGO + LTO Optimized appleseed: Emily onnx: fcn-resnet101-11 - CPU - Parallel onnx: fcn-resnet101-11 - CPU - Parallel openradioss: Bumper Beam aircrack-ng: helsing: 14 digit dacapobench: Tradebeans tensorflow: CPU - 1 - ResNet-50 tensorflow: CPU - 64 - ResNet-50 blender: Pabellon Barcelona - CPU-Only avifenc: 0 ospray-studio: 3 - 4K - 1 - Path Tracer - CPU tensorflow: CPU - 256 - GoogLeNet graphics-magick: Rotate ospray-studio: 1 - 4K - 1 - Path Tracer - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU ospray-studio: 3 - 4K - 32 - Path Tracer - CPU minibude: OpenMP - BM2 minibude: OpenMP - BM2 ospray: gravity_spheres_volume/dim_512/pathtracer/real_time ospray-studio: 1 - 4K - 32 - Path Tracer - CPU ospray-studio: 1 - 4K - 16 - Path Tracer - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU ospray-studio: 3 - 4K - 16 - Path Tracer - CPU onnx: CaffeNet 12-int8 - CPU - Parallel onnx: CaffeNet 12-int8 - CPU - Parallel openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU quantlib: Multi-Threaded onnx: Faster R-CNN R-50-FPN-int8 - CPU - Standard onnx: Faster R-CNN R-50-FPN-int8 - CPU - Standard onnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallel onnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallel jpegxl: JPEG - 90 openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU onnx: GPT-2 - CPU - Parallel onnx: GPT-2 - CPU - Parallel openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU node-web-tooling: openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU onnx: yolov4 - CPU - Parallel onnx: yolov4 - CPU - Parallel onnx: bertsquad-12 - CPU - Parallel onnx: bertsquad-12 - CPU - Parallel openvino: Face Detection Retail FP16-INT8 - CPU openvino: Face Detection Retail FP16-INT8 - CPU onnx: ArcFace ResNet-100 - CPU - Parallel onnx: ArcFace ResNet-100 - CPU - Parallel openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU graphics-magick: Sharpen graphics-magick: Noise-Gaussian graphics-magick: Resizing onnx: ResNet50 v1-12-int8 - CPU - Parallel onnx: ResNet50 v1-12-int8 - CPU - Parallel graphics-magick: HWB Color Space graphics-magick: Enhanced onnx: super-resolution-10 - CPU - Parallel onnx: super-resolution-10 - CPU - Parallel graphics-magick: Swirl rocksdb: Rand Read blender: Classroom - CPU-Only pytorch: CPU - 256 - ResNet-50 pytorch: CPU - 64 - ResNet-50 cloverleaf: clover_bm64_short llamafile: llava-v1.5-7b-q4 - CPU srsran: PDSCH Processor Benchmark, Throughput Total rawtherapee: Total Benchmark Time gpaw: Carbon Nanotube vvenc: Bosphorus 4K - Faster coremark: CoreMark Size 666 - Iterations Per Second minife: Small build-php: Time To Compile john-the-ripper: WPA PSK compress-7zip: Decompression Rating compress-7zip: Compression Rating luxcorerender: Rainbow Colors and Prism - CPU liquid-dsp: 1 - 256 - 512 build-linux-kernel: defconfig webp: Quality 100, Lossless, Highest Compression tensorflow: CPU - 512 - AlexNet jpegxl: PNG - 90 primesieve: 1e13 graph500: 26 graph500: 26 graph500: 26 graph500: 26 liquid-dsp: 1 - 256 - 57 srsran: PUSCH Processor Benchmark, Throughput Total avifenc: 2 askap: tConvolve MPI - Gridding askap: tConvolve MPI - Degridding openradioss: Cell Phone Drop Test liquid-dsp: 64 - 256 - 512 liquid-dsp: 1 - 256 - 32 build-wasmer: Time To Compile pytorch: CPU - 1 - ResNet-50 appleseed: Disney Material astcenc: Very Thorough liquid-dsp: 64 - 256 - 57 uvg266: Bosphorus 4K - Slow astcenc: Exhaustive liquid-dsp: 128 - 256 - 512 svt-av1: Preset 13 - Bosphorus 4K quantlib: Single-Threaded liquid-dsp: 128 - 256 - 57 nginx: 1000 liquid-dsp: 256 - 256 - 512 blender: Junkshop - CPU-Only npb: EP.D john-the-ripper: bcrypt john-the-ripper: Blowfish liquid-dsp: 256 - 256 - 57 liquid-dsp: 256 - 256 - 32 uvg266: Bosphorus 4K - Medium liquid-dsp: 128 - 256 - 32 synthmark: VoiceMark_100 liquid-dsp: 64 - 256 - 32 blender: Fishy Cat - CPU-Only tensorflow: CPU - 1 - GoogLeNet dacapobench: Apache Lucene Search Index embree: Pathtracer ISPC - Asian Dragon Obj gromacs: MPI CPU - water_GMX50_bare svt-av1: Preset 4 - Bosphorus 4K tensorflow: CPU - 64 - GoogLeNet askap: tConvolve OpenMP - Degridding askap: tConvolve OpenMP - Gridding kvazaar: Bosphorus 4K - Slow kvazaar: Bosphorus 4K - Medium svt-av1: Preset 8 - Bosphorus 4K uvg266: Bosphorus 4K - Ultra Fast tensorflow: CPU - 256 - AlexNet minibude: OpenMP - BM1 minibude: OpenMP - BM1 tensorflow: CPU - 1 - AlexNet blender: BMW27 - CPU-Only y-cruncher: 1B openfoam: drivaerFastback, Small Mesh Size - Execution Time openfoam: drivaerFastback, Small Mesh Size - Mesh Time npb: IS.D kvazaar: Bosphorus 4K - Super Fast amg: incompact3d: input.i3d 193 Cells Per Direction build-ffmpeg: Time To Compile oidn: RTLightmap.hdr.4096x4096 - CPU-Only onednn: Deconvolution Batch shapes_1d - CPU x265: Bosphorus 4K uvg266: Bosphorus 4K - Very Fast lulesh: onednn: IP Shapes 1D - CPU tensorflow: CPU - 64 - AlexNet npb: SP.C pennant: sedovbig kvazaar: Bosphorus 4K - Ultra Fast uvg266: Bosphorus 4K - Super Fast dacapobench: Jython jpegxl: PNG - 100 build-mesa: Time To Compile pybench: Total For Average Test Times dacapobench: Apache Kafka webp: Quality 100, Lossless build-imagemagick: Time To Compile jpegxl: JPEG - 100 astcenc: Thorough npb: LU.C m-queens: Time To Solve srsran: PUSCH Processor Benchmark, Throughput Thread y-cruncher: 500M npb: CG.C kvazaar: Bosphorus 4K - Very Fast embree: Pathtracer ISPC - Asian Dragon octave-benchmark: oidn: RT.hdr_alb_nrm.3840x2160 - CPU-Only pennant: leblancbig oidn: RT.ldr_alb_nrm.3840x2160 - CPU-Only embree: Pathtracer ISPC - Crown webp: Quality 100, Highest Compression onednn: IP Shapes 3D - CPU draco: Church Facade onednn: Convolution Batch Shapes Auto - CPU mt-dgemm: Sustained Floating-Point Rate astcenc: Medium avifenc: 6, Lossless svt-av1: Preset 12 - Bosphorus 4K draco: Lion lammps: Rhodopsin Protein avifenc: 10, Lossless srsran: PDSCH Processor Benchmark, Throughput Thread primesieve: 1e12 avifenc: 6 npb: MG.C compress-pbzip2: FreeBSD-13.0-RELEASE-amd64-memstick.img Compression onednn: Deconvolution Batch shapes_3d - CPU webp: Quality 100 build-python: Default Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11980.806 1734 2070.3 373.182 119.837 8088.11 131999.7 833892 116603.7 0.572 1748146 148.45 328.47 1.05274 31.0738 294.33 87797206 481.66 486.05 465.50 974189.9 27431.1 143.67 362.454 357.009712 96887479 277205 85.16 90871770 108953.6 20.13 6.85 210.934 7841738 34.892 261.97 5.85 254.003 116.315 8.59719 145.574 46.289 207.20 8.72 24.97 50.3522 19.8593 768804693697 700239352717 225038850730 22219927723 316126421173 61806994523 276179617 49.84 49.79 20.46 1032.0 14.6 409.592 9583000 20.25 21.8932 99.493 160.242 19.5762 13.46 187.017 2.97021 6.719 455.57 56.44 7.10 420.6467 160.72685 14.040 71227 59.91 140.43 1069.1 7.94 140.233 5808.8 461.23 1.17292 852.326 4.49976 222.029 3.06500 326.143 117.41 109.30 126.152247 18.9319 52.8167 19.8458 21.9324 623.604 10695360 4481667.95 4115 3.17002 315.410 4.39649 227.423 19.41 49.6376 20.1453 0.43 115106.30 2.79694 357.355 277.39 120.750285 329.036 3.03922 79.54 147469.328 93.348 7270 10.53 120.93 87.92 69.931 1977 448.46 196 1657 356.38 167.83 68006 86.967 2174.192 24.6445 58026 31380 3.58 15943.17 13.95 4209.10 36649 1.27368 784.304 16.50 3606.12 9.79 5943.66 55.99 1068.43 179647.5 29.4080 34.0021 30.9165 32.3433 43.202 100.39 298.56 5.21520 191.562 62.46 477.77 15.76 17.84 3325.90 55.1204 18.1413 62.1276 16.0956 6.43 9004.23 21.3436 46.8491 36.20 1643.43 157 158 229 3.19298 313.100 265 216 4.86604 205.525 502 265366170 68.61 54.84 56.01 39.48 20.95 24688.5 46.757 47.776 15.060 2194630.600449 35230.1 48.007 401278 287862 388190 13.54 16882333 39.450 0.52 1278.45 42.905 51.820 67074667 2616.9 37.752 21314.2 17891.6 31.49 744410000 36506000 34.933 51.46 53.490276 7.0885 2539200000 15.71 4.2689 918566667 162.474 3209.6 3181266667 1020833333 35.96 7562.80 94551 94513 3500833333 3243800000 17.85 3200600000 711.378 1890566667 34.83 33.56 3581 79.3805 8.762 7.061 380.14 30471.5 19798.5 20.23 20.97 70.908 60.87 1205.30 82.848 2071.189 56.53 25.89 7.047 42.219419 31.384585 2865.72 66.74 1605097000 12.9293413 24.056 1.29 6.15856 37.86 49.42 23072.302 0.539467 969.62 71245.26 16.03080 74.57 55.54 3801 28.100 19.226 765 5106 1.31 14.724 28.754 51.2971 135125.15 15.211 129.7 3.267 33811.63 50.03 91.9925 7.532 2.71 4.955865 2.71 70.0540 3.08 0.771506 5670 0.650618 23.543705 333.9902 6.278 164.250 4731 28.716 4.923 680.2 4.576 3.169 83448.70 2.144857 1.07743 10.11 19.201 6674.12 2716 1960.9 203.407 126.388 7630.06 82341.2 4136969 72110.1 1.293 778141 174.95 214.80 1.10900 60.8515 317.36 80169620 501.63 507.56 485.63 1916162.9 54601.1 161.06 218.570 196.808116 187761769 275472 92.23 83651785 68524.7 14.03 7.00 178.282 12321300 50.521 141.54 3.82 172.990 92.3473 10.83623 155.730 50.834 115.89 11.12 24.56 64.2858 15.5555 1533026300727 1369534328470 442202532977 42846254477 624402972947 119106802107 551286958 48.77 48.76 14.59 963.6 15.2 633.288 18166000 14.08 38.2269 125.882 149.088 35.6026 18.70 122.314 2.21948 6.480 456.18 37.55 8.82 196.49644 162.02669 14.856 67315 88.39 107.36 992.1 8.16 118.572 11263.2 576.08 1.43573 696.980 5.55101 180.032 4.05881 246.335 124.44 101.629 225.34692 27.5944 36.2493 36.1529 38.2235 635.154 17297027 3245908.40 4215 5.62517 177.763 4.72530 212.924 15.77 60.3589 16.5705 0.29 189893.31 3.46571 288.471 279.692 130.618252 352.738 2.83498 81.30 53914.933 50.831 8050 4.39 115.47 46.38 67.375 1063 528.93 172 894 283.11 423.18 38813 140.828 3520.705 42.8188 33411 14138 2.50 47654.95 15.96 7356.63 16837 1.76353 566.377 15.04 7862.58 7.72 15519.92 65.02 1843.61 350187.5 29.7536 33.6082 33.2899 30.0368 42.040 45.78 654.84 6.90619 144.640 37.58 793.64 15.49 21.73 5483.81 78.3989 12.7546 68.8299 14.5280 5.72 20937.58 34.3054 29.1487 25.12 4744.05 265 182 95 6.39031 156.461 236 342 5.29287 188.890 617 525049998 35.91 37.44 37.08 26.58 10.44 30108.7 53.758 41.563 12.536 3902076.243612 46877.5 46.644 793253 557054 592729 5.96 16843333 29.981 0.51 1899.64 40.075 27.107 66991333 4853.6 37.311 41773.0 34614.1 28.22 799496667 36461000 35.455 35.53 48.56418 13.7518 2655500000 24.71 8.3701 1126466667 154.502 3210.1 3723666667 1616966667 21.15 14946.76 183603 183583 5361266667 6116566667 27.65 3558600000 712.697 2025000000 19.13 13.50 3689 132.2806 15.450 6.698 331.76 51476.2 17010.8 31.24 32.04 65.224 55.26 1730.25 133.628 3340.694 37.57 13.74 5.008 28.556037 35.604097 3960.28 69.05 3124402667 6.39169817 19.506 2.18 16.5507 37.04 54.88 43724.062 0.783180 996.47 147311.14 11.28438 72.01 55.40 3892 27.659 18.293 767 5113 1.30 13.262 28.163 86.9845 261127.09 7.881 129.7 2.364 58128.24 67.64 152.7472 8.036 4.41 2.529807 4.48 124.7084 3.07 0.714699 5672 0.438154 45.965955 484.5499 6.172 156.516 4733 42.281 5.074 675.5 2.325 3.044 163333.21 1.469210 0.736170 10.05 18.931 10602.408 2004 1878.3 290.448 75.732 5062.07 135861.9 916904 121465.2 0.589 1699046 140.53 410.59 1.43787 35.1361 280.26 92709751 458.23 455.79 437.20 1036735.6 31594.4 129.02 316.902 323.245697 109766345 309896 81.73 94616807 115715.8 23.49 7.63 187.507 8926893 37.460 236.73 4.08 214.431 109.670 9.11885 132.873 28.698 157.56 9.38 26.93 43.5355 22.9689 889567506540 744387683670 223625738013 23886054770 344150916937 66573957920 315178381 53.99 53.92 23.41 1221.8 18.0 488.922 10922667 23.33 30.6799 99.184 193.138 23.1755 14.74 165.048 4.64814 7.392 520.22 63.30 8.06 302.0641 148.40248 13.264 75396 54.14 128.74 1242.6 9.80 122.718 8378.3 462.78 1.10042 908.187 3.69649 270.329 2.15980 462.855 110.32 105.98 118.779059 15.0376 66.5162 23.7293 30.8404 703.474 12168413 4752673.79 7321 3.18392 314.057 3.85774 259.186 27.21 39.7451 25.1591 0.49 81279.79 2.16966 460.775 244.824 119.803392 302.266 3.30836 78.71 153584.203 89.070 11004 6.43 91.51 80.29 64.475 1709 423.59 203 1441 224.64 284.64 59522 108.124 2703.088 27.1010 50798 23125 2.36 26943.42 9.40 6757.26 31993 1.20298 830.725 11.17 5725.03 6.72 9515.86 55.07 1159.66 195648.8 29.0185 34.4595 29.9566 33.3797 48.360 39.62 403.20 4.01687 248.682 26.85 592.20 17.42 13.73 4656.92 47.8953 20.8795 50.8307 19.6773 5.19 12317.94 16.5534 60.4094 21.87 2924.66 167 171 230 3.23780 308.801 285 228 4.26352 234.540 529 297517946 63.61 63.60 63.06 39.38 16.61 26378.1 42.775 43.048 15.966 2369998.356940 31830.2 41.846 428116 338146 441636 14.28 18774333 34.591 0.60 1486.12 46.317 48.406 416523000 539613000 1244300000 1299170000 73140667 3088.7 34.791 37265.9 31177.2 27.90 783770000 40244000 30.174 77.52 48.425051 7.6240 2475500000 16.06 4.6303 1152933333 174.832 3600.5 3503200000 399698.78 1178766667 32.08 8089.14 105781 105831 3806833333 3167200000 16.64 3148233333 799.717 1927766667 31.91 21.67 3242 97.1861 10.477 7.876 319.76 16936.8 19141.8 24.23 24.80 79.437 39.31 1277.46 106.395 2659.883 35.50 23.72 6.701 33.065393 31.704905 4059.70 39.20 1814760000 10.1967066 21.357 1.58 6.69692 38.93 35.10 38433.973 0.398446 819.89 109416.42 16.96910 47.07 35.56 3424 31.348 17.258 691 5560 1.50 12.595 32.239 54.4547 232012.77 14.257 129.5 3.391 63760.45 38.02 112.6611 6.458 3.31 4.182707 3.32 82.9663 3.47 0.841608 4565 0.585804 29.141078 327.7829 5.784 177.861 3861 34.301 4.456 742.9 4.250 2.971 107321.89 1.847537 0.907161 11.36 17.076 5601.101 3222 1809.7 155.741 102.125 6038.92 85613.1 5186677 73640.9 1.149 881881 169.75 378.05 2.25422 69.2976 286.78 89231850 438.60 443.58 423.30 2057021.6 61499.6 150.33 189.739 171.375778 222610378 308434 82.73 92771639 77327.1 16.25 7.70 157.363 12425519 56.400 125.87 3.05 145.413 100.738 9.92684 144.258 37.660 86.93 12.74 26.80 58.9394 16.9672 1769313146013 1497529939377 444099144270 46520760707 684284382760 131976050120 586147871 53.29 53.22 16.17 1165.8 17.8 538.225 18438600 16.00 53.9348 127.567 176.395 41.9111 19.91 106.815 5.85267 6.960 519.89 40.83 8.88 137.03802 139.61713 30.203 33110 86.85 100.00 1189.7 9.67 103.376 16324.7 577.76 1.32454 754.805 4.29531 236.648 2.81739 354.754 113.15 97.911 210.815856 26.0866 38.4240 42.1295 54.1195 626.138 17585737 3780240.56 7492 5.83954 171.231 3.98013 251.305 17.57 44.5996 22.4251 0.46 128566.81 2.80263 356.764 244.952 129.956841 327.875 3.05085 86.11 64181.293 48.091 12713 3.85 94.66 41.85 60.526 898 501.39 182 759 234.24 545.21 33391 191.818 4795.462 48.7576 24249 12124 2.48 48122.16 13.15 9360.89 14358 1.64919 605.589 11.69 10934.17 6.95 18375.63 57.13 2237.69 380867.5 28.8481 34.6628 31.5324 31.7109 42.974 43.41 736.23 5.10948 195.453 28.17 1128.78 17.02 14.67 8719.37 70.4377 14.1980 64.7891 15.4341 5.18 24676.86 31.7907 31.4589 22.96 5570.63 284 194 96 6.49693 153.922 256 374 4.65431 214.812 689 578392800 33.61 41.45 40.77 31.90 7.49 30547.6 52.689 38.049 13.256 4966250.777983 42114.6 40.381 797093 573410 674239 7.22 18200533 25.872 0.59 2039.63 39.524 25.021 484977000 667365000 1204520000 1267480000 70499000 5493.4 33.650 72004.0 59139.2 26.88 883701250 38950600 30.472 45.69 43.695399 14.6334 2620066667 27.11 8.9091 1493833333 162.979 3586.3 4450525000 381352.69 2027000000 18.31 16004.07 206778 205499 6284300000 6077300000 30.37 3520766667 799.491 2154633333 17.29 12.69 3345 173.2208 18.540 7.360 291.37 48686.8 20204.9 40.92 41.58 70.426 57.13 1681.44 199.734 4993.343 30.76 12.76 5.110 23.558932 29.325125 7437.81 66.78 3609646333 5.39125967 17.389 2.40 38.0813 39.31 53.66 70826.734 0.580664 858.84 228184.68 9.964526 73.81 54.95 3466 30.966 16.183 692 5611 1.50 11.493 31.610 97.9383 455312.09 7.402 129.5 2.659 98764.93 65.38 199.6089 6.856 5.03 2.159459 5.09 153.1622 3.46 0.738442 4693 0.306795 58.253340 550.0168 5.613 165.495 3894 55.496 4.579 755.5 2.187 2.805 220893.78 1.432362 0.624250 11.31 16.928 13273.694 1243 8868.20 2530.5 412.371 173.014 3375.32 128125.9 713937 110666.9 0.559 1792636 117.53 351.29 1.45223 25.2423 314.44 82455664 470.02 465.06 446.40 697707.2 22861.0 119.73 428.387 407.589406 68019088 277647 90.02 85744542 103089.8 19.01 6.03 220.569 7439663 28.278 320.11 1.47 270.380 139.096 7.24187 146.868 63.428 228.74 7.46 23.33 54.9599 18.2179 641200848170 507456728087 161321058213 16199261277 226597354153 44439185187 211457048 47.34 47.32 19.47 1126.4 14.4 734.804 7626333 19.20 16.0869 100.089 144.481 15.5028 11.86 212.482 5.97130 6.324 461.61 51.05 6.30 440.83113 153.12467 14.292 69969 59.58 160.56 1131.1 7.76 149.378 5446.8 383.57 1.37831 728.469 5.67700 176.333 2.97094 337.004 126.89 121.19 136.492406 21.2179 47.2703 15.3984 16.0502 1200.75 8795408 4384040.52 3887 3.02897 330.104 4.58912 217.880 19.99 47.2417 21.1702 0.33 135075.07 4.57581 219.532 275.385 132.132632 380.902 2.62544 83.44 117588.992 123.832 6130 11.29 104.23 106.96 76.915 2357 375.73 197 1988 236.52 202.59 80742 70.213 1755.333 19.9102 68973 37055 2.50 19183.83 11.37 4208.49 42837 1.45280 687.671 12.54 3802.61 7.13 6717.65 55.74 860.64 143755.3 33.3341 29.9973 35.0665 28.5164 39.100 41.93 285.95 5.22781 191.111 28.73 415.96 15.59 16.33 2935.47 61.8256 16.1742 61.2547 16.3251 5.27 9087.12 24.5535 40.7289 23.12 2074.30 114 150 245 3.13366 319.043 286 160 5.10914 195.705 394 205346154 86.67 52.97 51.55 41.43 7.67 21286.6 46.959 54.376 14.101 1614763.703237 20091.1 48.708 286552 207738 314716 12.80 16906333 43.421 0.55 1047.96 43.362 67.324 67130333 2170.7 41.125 21766.5 18522 33.75 632396667 36537667 35.657 50.99 58.379116 5.1342 2138766667 13.36 3.1204 800186667 144.698 3225.7 2670033333 838530000 42.85 5366.69 67875 67893 2848933333 2381800000 15.17 2351900000 711.101 1640266667 42.78 36.13 3378 64.9597 7.545 6.490 333.73 6758.81 4173.46 17.52 18.13 62.750 48.91 986.04 63.620 1590.501 48.28 31.66 8.300 45.947435 31.781874 3050.16 53.13 1588496667 13.9692376 26.458 1.08 5.30953 29.05 39.56 23848.540 0.725974 841.68 58815.36 21.02112 63.10 44.05 3785 26.249 20.175 763 5108 1.40 16.075 26.864 37.0051 126171.52 21.030 129.7 3.781 35116.55 40.23 75.4690 7.622 2.26 5.930957 2.27 58.4230 3.10 4.32465 6707 9.19434 19.768930 247.2979 6.836 146.097 5217 27.629 4.916 702.6 6.160 3.730 85910.95 2.632077 1.26407 10.13 19.117 7157.961 1776 14665.0 1785 214.416 182.123 3347.93 80804.7 3658790 71680.5 1.027 976035 145.29 263.33 1.88679 54.4054 328.41 77501248 501.07 499.18 491.89 1395446.4 45531.0 141.95 246.936 189.686116 137977203 277589 94.84 80770465 69221.4 15.84 6.23 184.298 9624417 46.705 169.44 1.77 175.625 121.670 8.39962 156.136 74.866 125.15 10.17 22.34 69.4501 14.4831 1277583382757 1011898993323 320396720447 32304222993 449908494927 88635753413 419943570 45.29 45.95 16.68 1040.2 13.8 1498.584 12958000 16.30 29.3496 127.703 137.503 15.3405 16.91 134.419 7.30065 6.023 435.21 41.65 6.81 201.10956 134.78213 16.963 58952 70.73 114.29 1041.8 7.62 123.882 10975.8 467.91 1.65270 604.755 7.04111 141.954 4.05270 246.680 116.49 102.12 243.236578 24.6510 40.5671 15.9777 29.5018 1966.88 13859254 3373323.92 4199 5.74491 174.677 4.85818 205.885 17.91 60.1120 16.6394 0.28 174862.56 5.02267 199.079 276.457 137.457437 460.673 2.17463 78.27 83665.758 65.026 6681 5.11 111.71 55.26 69.647 1237 447.50 148 1049 256.63 373.50 45211 127.845 3196.123 35.9324 38926 16645 2.53 37710.60 17.15 5565.23 19701 2.02659 492.885 13.34 7127.28 7.32 13102.28 56.71 1691.79 288129.1 36.2283 27.6074 40.4534 24.7274 39.594 42.16 568.81 7.34848 135.976 29.98 795.63 14.99 17.19 5576.86 76.4227 13.0869 72.8018 13.7366 5.55 17252.27 30.4733 32.8141 24.00 3998.02 199 150 108 6.00525 166.485 193 269 5.74921 173.909 509 405533173 44.71 41.68 42.35 32.25 7.77 30236.0 55.442 42.873 11.897 2993136.601832 19876.5 46.871 562875 401707 491729 9.64 16904667 32.143 0.54 1604.11 34.826 33.921 67064000 3787.0 38.653 42939.2 36900.5 27.51 732560000 36497667 36.197 46.49 51.245898 10.2051 2494050000 19.75 6.2126 1091460000 122.617 3207.0 3596400000 1444066667 24.99 10970.45 133866 134562 4825133333 4670966667 22.25 3254033333 710.916 1963233333 23.17 18.24 3643 104.8425 13.392 5.991 341.51 4437.6 3916.78 26.00 26.69 54.823 46.13 1479.53 108.397 2709.930 37.76 16.55 6.334 28.993119 32.481993 3816.70 52.63 3156261667 7.29349117 20.788 1.72 13.4500 27.26 44.75 52102.668 0.662387 932.59 135939.25 13.21125 54.98 45.09 3926 26.842 18.474 763 5101 1.39 14.402 27.325 72.3297 246822.52 10.840 129.7 3.110 65396.22 51.91 125.7494 12.617 3.51 2.881099 3.49 107.6299 3.09 4.28399 6821 7.75431 39.345732 441.6518 7.121 122.089 5342 47.512 5.317 651.9 3.121 3.776 172614.10 1.982932 0.945075 10.01 18.812 12410.29 1356 9204.87 2245.2 384.384 145.236 3406.96 120494.3 767812 109388.2 0.622 1607424 125.14 357.57 1.50214 30.5872 309.03 83475645 476.91 474.68 461.62 813667.6 25441.5 123.69 384.063 351.644165 73592230 277260 89.53 86354518 112265.3 19.24 6.29 215.496 7366500 32.157 290.56 1.54 252.648 155.788 6.54965 145.238 64.883 212.99 8.00 23.77 59.1795 16.9166 747710702660 592014115453 187796174440 18893980783 263740690067 51840436763 244070674 48.14 48.35 19.29 1127.5 14.5 632.146 8957000 19.58 18.4851 99.619 143.480 16.2652 12.50 197.844 5.92501 6.501 464.72 51.86 6.82 410.29005 150.66848 13.845 72225 59.32 146.03 1133.3 7.72 143.808 6122.3 398.40 1.41662 705.606 5.91961 168.859 2.88734 346.213 120.76 117.81 134.388009 23.6625 42.2747 16.3219 18.5533 1180.85 9988176 4315467.17 3884 3.37034 296.799 4.67269 213.985 18.07 49.9740 20.0103 0.37 140144.01 4.64757 215.127 273.515 128.603449 382.109 2.61721 81.72 134048.964 107.237 5994 9.99 103.56 97.80 73.060 2123 386.00 194 1792 257.50 217.11 73366 78.105 1952.606 22.3625 62540 33790 2.67 20910.53 12.72 4386.48 39238 1.47249 678.483 13.59 4093.73 7.76 7207.74 62.53 894.87 162727.4 33.9877 29.4250 35.1110 28.4798 43.629 59.69 301.30 5.29027 188.930 38.50 467.08 15.62 19.44 2877.32 61.0107 16.3898 63.5353 15.7394 5.77 9686.39 23.6565 42.2711 24.94 2243.84 130 158 213 3.32030 301.136 277 181 5.26075 190.063 432 234469939 76.87 51.56 51.35 42.22 8.13 15081.0 47.086 48.487 14.362 1855135.326098 18621.2 47.951 334076 243347 342363 12.97 16885333 40.501 0.55 1108.95 40.347 58.159 67127667 2514.0 39.876 23250.2 20561.4 31.92 689003333 36539000 35.201 48.59 56.401698 5.9702 2308966667 13.89 3.6276 882200000 149.996 3229.1 2972400000 367199.06 944550000 39.17 6445.09 79144 79152 3222533333 2769066667 15.68 2739633333 712.013 1679700000 38.48 31.47 3396 71.8253 8.282 6.572 335.58 7046.56 4438.58 18.24 18.84 65.359 50.09 1058.99 70.843 1771.065 43.67 28.49 7.959 41.746192 31.998248 3076.66 54.47 1597993333 12.7997582 24.840 1.14 6.09747 31.40 40.82 25831.838 0.617190 852.36 69776.41 19.88246 63.99 45.32 3707 27.087 19.650 762 5102 1.39 15.376 27.750 42.9834 131606.86 18.102 129.7 3.704 35234.06 41.34 83.4921 7.748 2.38 5.114161 2.39 65.3318 3.10 4.27481 6693 8.75105 22.539990 284.3336 6.605 151.718 5188 30.843 4.867 705.5 5.332 3.550 86407.46 2.287766 1.19643 10.13 18.847 6840.057 1852 14463.4 1873.1 201.382 173.550 4382.97 76524.7 4075342 71696.5 1.098 920725 138.39 269.20 1.76778 62.6357 325.97 78057728 471.79 467.96 460.66 1627941.4 48534.8 135.28 231.033 187.224004 149409082 277298 95.39 80139566 66816.9 14.96 5.91 181.629 11223329 51.816 156.70 1.54 171.174 121.780 8.26016 158.310 68.860 117.91 10.44 23.30 69.2014 14.4583 1484669627050 1181148957353 372735215297 37564522053 522912403347 103382860113 497907490 46.79 46.59 14.74 1039.2 13.3 719.229 14609417 14.92 33.1275 131.795 135.436 15.8207 16.64 128.066 2.56319 6.077 439.84 37.84 7.41 186.32539 159.31171 16.655 60046 81.65 110.56 1046.0 7.46 122.704 12115.0 477.33 1.71875 581.769 7.53259 132.712 3.95819 252.671 119.03 106.27 239.726773 29.4448 33.9621 15.3743 33.1125 2776.52 15354400 3392842.38 4069 6.17796 161.886 5.00222 199.896 14.86 55.9019 17.9873 0.30 176900.32 5.39123 185.46 276.229 137.004266 475.254 2.10480 80.32 65663.823 58.248 6672 4.37 107.30 51.29 68.437 1143 449.91 143 961 278.52 401.45 41971 133.990 3349.756 39.3389 36179 15357 2.79 40032.81 18.72 5933.65 18111 2.08780 478.467 14.42 7689.32 7.97 14033.94 62.11 1801.89 316359.2 36.0039 27.7772 40.5178 24.6818 34.634 64.91 569.60 7.30822 136.689 41.57 889.18 14.51 20.24 5525.56 79.3770 12.5974 73.9684 13.5190 6.02 18561.91 34.2507 29.1955 25.72 4351.59 227 164 97 6.51744 153.407 207 301 5.88628 169.850 558 473755946 40.38 37.91 38.30 32.44 7.26 11866.7 56.776 43.911 11.967 3279262.530349 21583.2 46.571 657889 469131 525514 6.51 16884000 30.530 0.54 1677.62 33.274 30.196 66266000 4386.6 38.136 45195.1 40368.6 27.63 757176667 36521333 35.700 35.46 49.136175 11.8875 2491340000 22.14 7.2075 1206066667 124.263 3222.8 3896500000 1518933333 23.45 12793.01 155959 156658 5036000000 5367033333 24.65 3337066667 712.085 2090466667 21.45 14.67 3537 112.7231 14.127 6.052 308.95 7304.58 3836.73 28.96 29.62 55.979 45.79 1528.41 114.902 2872.562 33.21 15.29 6.266 27.577291 28.840157 3819.83 54.19 3205161000 6.66387510 20.008 1.74 16.0901 27.90 46.25 53269.469 0.759434 940.40 141954.15 12.10690 58.14 44.40 3921 26.994 18.138 763 5088 1.39 14.094 27.260 83.3395 257384.55 9.285 129.7 2.961 66492.44 52.23 129.7482 12.578 3.65 2.527363 3.66 116.6053 3.09 4.17553 6777 7.06043 44.668302 483.1049 7.038 127.546 5322 52.244 5.311 663.8 2.691 3.738 171436.47 1.711296 0.864358 10.03 18.824 OpenBenchmarking.org
WRF Input: conus 2.5km OpenBenchmarking.org Seconds, Fewer Is Better WRF 4.2.2 Input: conus 2.5km Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 3K 6K 9K 12K 15K 13273.69 12410.29 11980.81 10602.41 7157.96 6840.06 6674.12 5601.10 1. (F9X) gfortran options: -O2 -ftree-vectorize -funroll-loops -ffree-form -fconvert=big-endian -frecord-marker=4 -fallow-invalid-boz -lesmf_time -lwrfio_nf -lnetcdff -lnetcdf -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
OpenVKL Benchmark: vklBenchmarkCPU ISPC OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 2.0.0 Benchmark: vklBenchmarkCPU ISPC Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 700 1400 2100 2800 3500 SE +/- 6.66, N = 3 SE +/- 13.96, N = 3 SE +/- 1.53, N = 3 SE +/- 8.62, N = 3 SE +/- 4.36, N = 3 SE +/- 2.08, N = 3 SE +/- 6.74, N = 3 SE +/- 13.62, N = 3 1243 1356 1734 1776 1852 2004 2716 3222 MIN: 95 / MAX: 19286 MIN: 107 / MAX: 20909 MIN: 104 / MAX: 26188 MIN: 177 / MAX: 27371 MIN: 191 / MAX: 28947 MIN: 134 / MAX: 29750 MIN: 188 / MAX: 30888 MIN: 248 / MAX: 36519
ASKAP Test: tConvolve MT - Degridding OpenBenchmarking.org Million Grid Points Per Second, More Is Better ASKAP 1.0 Test: tConvolve MT - Degridding Xeon Max 9468 Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 2P 3K 6K 9K 12K 15K SE +/- 150.41, N = 12 SE +/- 228.53, N = 12 SE +/- 295.26, N = 8 SE +/- 577.93, N = 3 8868.20 9204.87 14463.40 14665.00 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
NWChem Input: C240 Buckyball OpenBenchmarking.org Seconds, Fewer Is Better NWChem 7.0.2 Input: C240 Buckyball Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P 500 1000 1500 2000 2500 2530.5 2245.2 2070.3 1960.9 1878.3 1873.1 1809.7 1785.0 1. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz -lcomex -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2
RELION Test: Basic - Device: CPU OpenBenchmarking.org Seconds, Fewer Is Better RELION 4.0.1 Test: Basic - Device: CPU Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 90 180 270 360 450 SE +/- 2.98, N = 3 SE +/- 4.65, N = 9 SE +/- 7.14, N = 9 SE +/- 2.68, N = 7 SE +/- 3.24, N = 12 SE +/- 2.65, N = 3 SE +/- 2.66, N = 12 SE +/- 1.41, N = 3 412.37 384.38 373.18 290.45 214.42 203.41 201.38 155.74 1. (CXX) g++ options: -fopenmp -std=c++11 -O3 -rdynamic -ldl -ltiff -lfftw3f -lfftw3 -lpng -ljpeg -lmpi_cxx -lmpi
easyWave Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400 OpenBenchmarking.org Seconds, Fewer Is Better easyWave r34 Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 40 80 120 160 200 SE +/- 15.80, N = 12 SE +/- 18.26, N = 12 SE +/- 12.12, N = 12 SE +/- 5.17, N = 9 SE +/- 0.99, N = 12 SE +/- 0.67, N = 3 SE +/- 9.88, N = 12 SE +/- 0.96, N = 15 182.12 173.55 173.01 145.24 126.39 119.84 102.13 75.73 1. (CXX) g++ options: -O3 -fopenmp
ASKAP Test: tConvolve MT - Gridding OpenBenchmarking.org Million Grid Points Per Second, More Is Better ASKAP 1.0 Test: tConvolve MT - Gridding Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Platinum 8490H 2K 4K 6K 8K 10K SE +/- 23.56, N = 3 SE +/- 87.89, N = 12 SE +/- 32.87, N = 12 SE +/- 195.28, N = 8 SE +/- 54.27, N = 5 SE +/- 60.72, N = 3 SE +/- 75.19, N = 5 SE +/- 4.15, N = 3 3347.93 3375.32 3406.96 4382.97 5062.07 6038.92 7630.06 8088.11 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
CockroachDB Workload: KV, 95% Reads - Concurrency: 512 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 512 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 30K 60K 90K 120K 150K SE +/- 1792.91, N = 12 SE +/- 1830.36, N = 15 SE +/- 1606.68, N = 15 SE +/- 1875.64, N = 15 SE +/- 2047.28, N = 12 SE +/- 2758.29, N = 15 SE +/- 3058.00, N = 15 SE +/- 2853.06, N = 12 76524.7 80804.7 82341.2 85613.1 120494.3 128125.9 131999.7 135861.9
BRL-CAD VGR Performance Metric OpenBenchmarking.org VGR Performance Metric, More Is Better BRL-CAD 7.38.2 VGR Performance Metric Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 1.1M 2.2M 3.3M 4.4M 5.5M 713937 767812 833892 916904 3658790 4075342 4136969 5186677 1. (CXX) g++ options: -std=c++17 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lnetpbm -lregex_brl -lz_brl -lassimp -ldl -lm -ltk8.6
CockroachDB Workload: KV, 60% Reads - Concurrency: 512 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 512 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 30K 60K 90K 120K 150K SE +/- 889.12, N = 15 SE +/- 970.10, N = 15 SE +/- 886.06, N = 15 SE +/- 1250.17, N = 13 SE +/- 1384.66, N = 15 SE +/- 1362.07, N = 3 SE +/- 1885.96, N = 15 SE +/- 2440.36, N = 12 71680.5 71696.5 72110.1 73640.9 109388.2 110666.9 116603.7 121465.2
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 0.2909 0.5818 0.8727 1.1636 1.4545 SE +/- 0.030, N = 12 SE +/- 0.040, N = 12 SE +/- 0.038, N = 9 SE +/- 0.017, N = 9 SE +/- 0.007, N = 3 SE +/- 0.005, N = 12 SE +/- 0.007, N = 3 SE +/- 0.008, N = 12 1.293 1.149 1.098 1.027 0.622 0.589 0.572 0.559 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 400K 800K 1200K 1600K 2000K SE +/- 18635.21, N = 12 SE +/- 30933.90, N = 12 SE +/- 36627.33, N = 9 SE +/- 16726.04, N = 9 SE +/- 17697.00, N = 3 SE +/- 13863.97, N = 12 SE +/- 20350.34, N = 3 SE +/- 24978.23, N = 12 778141 881881 920725 976035 1607424 1699046 1748146 1792636 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
TensorFlow Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 Xeon Max 9468 Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 40 80 120 160 200 SE +/- 1.17, N = 3 SE +/- 0.61, N = 3 SE +/- 1.80, N = 3 SE +/- 0.48, N = 3 SE +/- 0.79, N = 3 SE +/- 0.01, N = 3 SE +/- 0.61, N = 3 SE +/- 1.39, N = 3 117.53 125.14 138.39 140.53 145.29 148.45 169.75 174.95
CloverLeaf Input: clover_bm16 OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm16 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P 90 180 270 360 450 SE +/- 0.54, N = 3 SE +/- 2.02, N = 3 SE +/- 2.03, N = 3 SE +/- 1.43, N = 3 SE +/- 0.13, N = 3 SE +/- 2.11, N = 9 SE +/- 1.56, N = 3 SE +/- 0.74, N = 3 410.59 378.05 357.57 351.29 328.47 269.20 263.33 214.80 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
NAMD Input: STMV with 1,066,628 Atoms OpenBenchmarking.org ns/day, More Is Better NAMD 3.0b6 Input: STMV with 1,066,628 Atoms Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P 0.5072 1.0144 1.5216 2.0288 2.536 SE +/- 0.01396, N = 15 SE +/- 0.04403, N = 15 SE +/- 0.02648, N = 15 SE +/- 0.05087, N = 15 SE +/- 0.05862, N = 15 SE +/- 0.05463, N = 15 SE +/- 0.05644, N = 12 SE +/- 0.08185, N = 13 1.05274 1.10900 1.43787 1.45223 1.50214 1.76778 1.88679 2.25422
High Performance Conjugate Gradient X Y Z: 144 144 144 - RT: 60 OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.1 X Y Z: 144 144 144 - RT: 60 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 15 30 45 60 75 SE +/- 0.08, N = 3 SE +/- 0.37, N = 3 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.29, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.94, N = 3 25.24 30.59 31.07 35.14 54.41 60.85 62.64 69.30 1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi
Apache IoTDB Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 OpenBenchmarking.org Average Latency, Fewer Is Better Apache IoTDB 1.2 Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 70 140 210 280 350 SE +/- 2.59, N = 12 SE +/- 3.74, N = 12 SE +/- 3.79, N = 8 SE +/- 5.15, N = 3 SE +/- 5.07, N = 3 SE +/- 2.20, N = 3 SE +/- 3.40, N = 12 SE +/- 3.41, N = 3 328.41 325.97 317.36 314.44 309.03 294.33 286.78 280.26 MAX: 29309.84 MAX: 30042.47 MAX: 32341.07 MAX: 27244.84 MAX: 26720.06 MAX: 27740.38 MAX: 28496.67 MAX: 27450.82
Apache IoTDB Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 OpenBenchmarking.org point/sec, More Is Better Apache IoTDB 1.2 Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 20M 40M 60M 80M 100M SE +/- 565297.90, N = 12 SE +/- 574699.97, N = 12 SE +/- 692701.79, N = 8 SE +/- 662950.65, N = 3 SE +/- 1037167.36, N = 3 SE +/- 308756.34, N = 3 SE +/- 761276.42, N = 12 SE +/- 746822.47, N = 3 77501248 78057728 80169620 82455664 83475645 87797206 89231850 92709751
ClickHouse 100M Rows Hits Dataset, Third Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8490H 2P 110 220 330 440 550 SE +/- 5.39, N = 5 SE +/- 3.62, N = 6 SE +/- 6.03, N = 3 SE +/- 3.54, N = 12 SE +/- 3.60, N = 3 SE +/- 3.45, N = 3 SE +/- 3.08, N = 3 SE +/- 2.55, N = 3 438.60 458.23 470.02 471.79 476.91 481.66 501.07 501.63 MIN: 58.2 / MAX: 6000 MIN: 42.16 / MAX: 6000 MIN: 32.59 / MAX: 5454.55 MIN: 53.43 / MAX: 6000 MIN: 36.01 / MAX: 5000 MIN: 40.16 / MAX: 5454.55 MIN: 54.25 / MAX: 5000 MIN: 64.45 / MAX: 6666.67
ClickHouse 100M Rows Hits Dataset, Second Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8490H 2P 110 220 330 440 550 SE +/- 3.10, N = 5 SE +/- 2.86, N = 6 SE +/- 1.94, N = 3 SE +/- 3.17, N = 12 SE +/- 4.95, N = 3 SE +/- 2.93, N = 3 SE +/- 0.19, N = 3 SE +/- 3.26, N = 3 443.58 455.79 465.06 467.96 474.68 486.05 499.18 507.56 MIN: 62.43 / MAX: 6666.67 MIN: 42.19 / MAX: 6666.67 MIN: 32.59 / MAX: 5000 MIN: 52.36 / MAX: 6000 MIN: 36.43 / MAX: 6000 MIN: 40.43 / MAX: 6666.67 MIN: 54.2 / MAX: 4615.38 MIN: 66.45 / MAX: 5454.55
ClickHouse 100M Rows Hits Dataset, First Run / Cold Cache OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 2P 110 220 330 440 550 SE +/- 4.12, N = 5 SE +/- 4.18, N = 6 SE +/- 2.85, N = 3 SE +/- 3.85, N = 12 SE +/- 5.88, N = 3 SE +/- 3.41, N = 3 SE +/- 4.37, N = 3 SE +/- 1.35, N = 3 423.30 437.20 446.40 460.66 461.62 465.50 485.63 491.89 MIN: 61.54 / MAX: 6000 MIN: 41.7 / MAX: 5454.55 MIN: 32.64 / MAX: 4615.38 MIN: 53.62 / MAX: 5454.55 MIN: 35.59 / MAX: 5454.55 MIN: 40.93 / MAX: 5454.55 MIN: 63.63 / MAX: 5000 MIN: 51.86 / MAX: 5454.55
OpenSSL Algorithm: RSA4096 OpenBenchmarking.org verify/s, More Is Better OpenSSL 3.3 Algorithm: RSA4096 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 400K 800K 1200K 1600K 2000K SE +/- 165.80, N = 3 SE +/- 200.66, N = 3 SE +/- 92.46, N = 3 SE +/- 92.62, N = 3 SE +/- 355.69, N = 3 SE +/- 277.84, N = 3 SE +/- 862.96, N = 3 SE +/- 6745.42, N = 3 697707.2 813667.6 974189.9 1036735.6 1395446.4 1627941.4 1916162.9 2057021.6 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenSSL Algorithm: RSA4096 OpenBenchmarking.org sign/s, More Is Better OpenSSL 3.3 Algorithm: RSA4096 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 13K 26K 39K 52K 65K SE +/- 19.45, N = 3 SE +/- 20.13, N = 3 SE +/- 9.84, N = 3 SE +/- 15.15, N = 3 SE +/- 6.92, N = 3 SE +/- 83.09, N = 3 SE +/- 14.34, N = 3 SE +/- 56.68, N = 3 22861.0 25441.5 27431.1 31594.4 45531.0 48534.8 54601.1 61499.6 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
TensorFlow Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 40 80 120 160 200 SE +/- 0.14, N = 3 SE +/- 0.63, N = 3 SE +/- 0.58, N = 3 SE +/- 1.04, N = 12 SE +/- 1.40, N = 3 SE +/- 0.03, N = 3 SE +/- 0.21, N = 3 SE +/- 1.57, N = 3 119.73 123.69 129.02 135.28 141.95 143.67 150.33 161.06
Timed Linux Kernel Compilation Build: allmodconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: allmodconfig Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 90 180 270 360 450 SE +/- 0.61, N = 3 SE +/- 0.67, N = 3 SE +/- 0.80, N = 3 SE +/- 0.72, N = 3 SE +/- 0.56, N = 3 SE +/- 0.73, N = 3 SE +/- 0.86, N = 3 SE +/- 0.56, N = 3 428.39 384.06 362.45 316.90 246.94 231.03 218.57 189.74
Xcompact3d Incompact3d Input: X3D-benchmarking input.i3d OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: X3D-benchmarking input.i3d Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 90 180 270 360 450 SE +/- 1.25, N = 3 SE +/- 3.88, N = 4 SE +/- 0.14, N = 3 SE +/- 2.51, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.37, N = 3 407.59 357.01 351.64 323.25 196.81 189.69 187.22 171.38 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
Stockfish Chess Benchmark OpenBenchmarking.org Nodes Per Second, More Is Better Stockfish 16.1 Chess Benchmark Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 50M 100M 150M 200M 250M SE +/- 1751369.24, N = 12 SE +/- 629927.17, N = 3 SE +/- 1304590.97, N = 3 SE +/- 2966712.90, N = 9 SE +/- 4344961.90, N = 10 SE +/- 2925715.37, N = 11 SE +/- 2148606.38, N = 4 SE +/- 2482737.87, N = 3 68019088 73592230 96887479 109766345 137977203 149409082 187761769 222610378 1. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver
SecureMark Benchmark: SecureMark-TLS OpenBenchmarking.org marks, More Is Better SecureMark 1.0.4 Benchmark: SecureMark-TLS Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 70K 140K 210K 280K 350K SE +/- 330.95, N = 3 SE +/- 625.56, N = 3 SE +/- 670.43, N = 3 SE +/- 196.24, N = 3 SE +/- 384.08, N = 3 SE +/- 256.85, N = 3 SE +/- 411.11, N = 3 SE +/- 209.97, N = 3 275472 277205 277260 277298 277589 277647 308434 309896 1. (CC) gcc options: -pedantic -O3
Apache IoTDB Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 OpenBenchmarking.org Average Latency, Fewer Is Better Apache IoTDB 1.2 Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 20 40 60 80 100 SE +/- 1.11, N = 4 SE +/- 1.01, N = 3 SE +/- 1.18, N = 3 SE +/- 0.48, N = 3 SE +/- 0.87, N = 3 SE +/- 0.15, N = 3 SE +/- 0.80, N = 7 SE +/- 0.68, N = 3 95.39 94.84 92.23 90.02 89.53 85.16 82.73 81.73 MAX: 23846.38 MAX: 23842.98 MAX: 23842.9 MAX: 23857.34 MAX: 23819.37 MAX: 23810.86 MAX: 24148.34 MAX: 24081.78
Apache IoTDB Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 OpenBenchmarking.org point/sec, More Is Better Apache IoTDB 1.2 Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 20M 40M 60M 80M 100M SE +/- 872659.60, N = 4 SE +/- 594234.55, N = 3 SE +/- 928557.10, N = 3 SE +/- 435900.66, N = 3 SE +/- 782176.98, N = 3 SE +/- 276414.35, N = 3 SE +/- 862582.24, N = 7 SE +/- 739343.51, N = 3 80139566 80770465 83651785 85744542 86354518 90871770 92771639 94616807
CockroachDB Workload: KV, 50% Reads - Concurrency: 512 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 512 Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ 20K 40K 60K 80K 100K SE +/- 556.62, N = 3 SE +/- 639.27, N = 15 SE +/- 833.19, N = 3 SE +/- 325.76, N = 3 SE +/- 297.86, N = 3 SE +/- 1037.18, N = 15 SE +/- 1352.20, N = 3 SE +/- 1659.04, N = 15 66816.9 68524.7 69221.4 77327.1 103089.8 108953.6 112265.3 115715.8
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-152 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 6 12 18 24 30 SE +/- 0.17, N = 3 SE +/- 0.05, N = 3 SE +/- 0.21, N = 3 SE +/- 0.15, N = 12 SE +/- 0.19, N = 5 SE +/- 0.17, N = 12 SE +/- 0.18, N = 3 SE +/- 0.34, N = 3 14.03 14.96 15.84 16.25 19.01 19.24 20.13 23.49 MIN: 8.98 / MAX: 15.41 MIN: 10.89 / MAX: 15.42 MIN: 6.82 / MAX: 16.51 MIN: 6.19 / MAX: 17.5 MIN: 11.15 / MAX: 20.08 MIN: 10.95 / MAX: 20.39 MIN: 17.06 / MAX: 21.01 MIN: 19.73 / MAX: 24.56
LuxCoreRender Scene: Danish Mood - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Danish Mood - Acceleration: CPU Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 2 4 6 8 10 SE +/- 0.20, N = 15 SE +/- 0.02, N = 3 SE +/- 0.22, N = 15 SE +/- 0.07, N = 15 SE +/- 0.08, N = 3 SE +/- 0.18, N = 12 SE +/- 0.10, N = 12 SE +/- 0.11, N = 15 5.91 6.03 6.23 6.29 6.85 7.00 7.63 7.70 MIN: 2.31 / MAX: 9.24 MIN: 2.52 / MAX: 7 MIN: 2.27 / MAX: 9.18 MIN: 2.44 / MAX: 7.56 MIN: 3.05 / MAX: 8.02 MIN: 2.74 / MAX: 9.4 MIN: 3.26 / MAX: 9.01 MIN: 3.44 / MAX: 9.79
Timed Gem5 Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Gem5 Compilation 23.0.1 Time To Compile Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 50 100 150 200 250 SE +/- 2.59, N = 4 SE +/- 2.11, N = 6 SE +/- 0.92, N = 3 SE +/- 2.17, N = 3 SE +/- 1.72, N = 3 SE +/- 1.01, N = 3 SE +/- 0.58, N = 3 SE +/- 0.89, N = 3 220.57 215.50 210.93 187.51 184.30 181.63 178.28 157.36
RocksDB Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Read While Writing Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 3M 6M 9M 12M 15M SE +/- 26369.56, N = 3 SE +/- 83772.27, N = 13 SE +/- 61518.27, N = 10 SE +/- 28201.44, N = 3 SE +/- 218479.19, N = 15 SE +/- 254193.37, N = 15 SE +/- 343737.14, N = 15 SE +/- 215352.04, N = 15 7366500 7439663 7841738 8926893 9624417 11223329 12321300 12425519 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
LAMMPS Molecular Dynamics Simulator Model: 20k Atoms OpenBenchmarking.org ns/day, More Is Better LAMMPS Molecular Dynamics Simulator 23Jun2022 Model: 20k Atoms Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 13 26 39 52 65 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 28.28 32.16 34.89 37.46 46.71 50.52 51.82 56.40 1. (CXX) g++ options: -O3 -lm -ldl
Blender Blend File: Barbershop - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Barbershop - Compute: CPU-Only Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 70 140 210 280 350 SE +/- 0.12, N = 3 SE +/- 1.09, N = 3 SE +/- 0.18, N = 3 SE +/- 0.69, N = 3 SE +/- 0.23, N = 3 SE +/- 0.06, N = 3 SE +/- 0.42, N = 3 SE +/- 0.21, N = 3 320.11 290.56 261.97 236.73 169.44 156.70 141.54 125.87
Llamafile Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.7 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU Xeon Max 9468 Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8490H 1.3163 2.6326 3.9489 5.2652 6.5815 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.12, N = 6 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 1.47 1.54 1.54 1.77 3.05 3.82 4.08 5.85
Timed Node.js Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 21.7.2 Time To Compile Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 60 120 180 240 300 SE +/- 0.53, N = 3 SE +/- 0.71, N = 3 SE +/- 0.74, N = 3 SE +/- 0.52, N = 3 SE +/- 0.84, N = 3 SE +/- 0.48, N = 3 SE +/- 0.52, N = 3 SE +/- 0.12, N = 3 270.38 254.00 252.65 214.43 175.63 172.99 171.17 145.41
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 30 60 90 120 150 SE +/- 6.41, N = 15 SE +/- 3.36, N = 15 SE +/- 2.59, N = 15 SE +/- 5.82, N = 12 SE +/- 0.09, N = 3 SE +/- 0.71, N = 3 SE +/- 0.44, N = 3 SE +/- 0.69, N = 15 155.79 139.10 121.78 121.67 116.32 109.67 100.74 92.35 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 3 6 9 12 15 SE +/- 0.22869, N = 15 SE +/- 0.15651, N = 15 SE +/- 0.16487, N = 15 SE +/- 0.34632, N = 12 SE +/- 0.00664, N = 3 SE +/- 0.05824, N = 3 SE +/- 0.04271, N = 3 SE +/- 0.07619, N = 15 6.54965 7.24187 8.26016 8.39962 8.59719 9.11885 9.92684 10.83623 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
DuckDB Benchmark: TPC-H Parquet OpenBenchmarking.org Seconds, Fewer Is Better DuckDB 0.9.1 Benchmark: TPC-H Parquet Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 30 60 90 120 150 SE +/- 0.95, N = 3 SE +/- 0.57, N = 3 SE +/- 0.55, N = 3 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 SE +/- 0.58, N = 3 SE +/- 0.44, N = 3 SE +/- 0.34, N = 3 158.31 156.14 155.73 146.87 145.57 145.24 144.26 132.87 1. (CXX) g++ options: -O3 -rdynamic -lssl -lcrypto -ldl
easyWave Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200 OpenBenchmarking.org Seconds, Fewer Is Better easyWave r34 Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 20 40 60 80 100 SE +/- 4.11, N = 15 SE +/- 3.75, N = 15 SE +/- 3.75, N = 15 SE +/- 3.12, N = 12 SE +/- 0.24, N = 3 SE +/- 0.10, N = 3 SE +/- 0.23, N = 3 SE +/- 0.32, N = 4 74.87 68.86 64.88 63.43 50.83 46.29 37.66 28.70 1. (CXX) g++ options: -O3 -fopenmp
OpenRadioss Model: Chrysler Neon 1M OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Chrysler Neon 1M Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 50 100 150 200 250 SE +/- 0.08, N = 3 SE +/- 0.18, N = 3 SE +/- 0.15, N = 3 SE +/- 0.20, N = 3 SE +/- 0.13, N = 3 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 SE +/- 0.14, N = 3 228.74 212.99 207.20 157.56 125.15 117.91 115.89 86.93
LuxCoreRender Scene: DLSC - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: DLSC - Acceleration: CPU Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 3 6 9 12 15 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 SE +/- 0.06, N = 15 SE +/- 0.02, N = 3 SE +/- 0.12, N = 3 SE +/- 0.20, N = 15 SE +/- 0.23, N = 15 SE +/- 0.24, N = 15 7.46 8.00 8.72 9.38 10.17 10.44 11.12 12.74 MIN: 7.17 / MAX: 8.21 MIN: 7.65 / MAX: 9.12 MIN: 8.12 / MAX: 10.6 MIN: 8.94 / MAX: 11.49 MIN: 9.34 / MAX: 14.75 MIN: 8.86 / MAX: 16.08 MIN: 9.18 / MAX: 17.51 MIN: 10.69 / MAX: 19.19
FFmpeg Encoder: libx265 - Scenario: Upload OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Upload Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 6 12 18 24 30 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.00, N = 3 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 22.34 23.30 23.33 23.77 24.56 24.97 26.80 26.93 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Standard Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 15 30 45 60 75 SE +/- 1.43, N = 15 SE +/- 0.47, N = 14 SE +/- 0.28, N = 3 SE +/- 0.55, N = 15 SE +/- 0.35, N = 3 SE +/- 0.55, N = 15 SE +/- 0.12, N = 3 SE +/- 0.10, N = 3 69.45 69.20 64.29 59.18 58.94 54.96 50.35 43.54 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Standard Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 6 12 18 24 30 SE +/- 0.10, N = 14 SE +/- 0.29, N = 15 SE +/- 0.07, N = 3 SE +/- 0.15, N = 15 SE +/- 0.10, N = 3 SE +/- 0.17, N = 15 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 14.46 14.48 15.56 16.92 16.97 18.22 19.86 22.97 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenSSL Algorithm: AES-128-GCM OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: AES-128-GCM Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 400000M 800000M 1200000M 1600000M 2000000M SE +/- 43545680.66, N = 3 SE +/- 56355870.99, N = 3 SE +/- 28627701.54, N = 3 SE +/- 1253503549.61, N = 3 SE +/- 268465891.11, N = 3 SE +/- 697208281.49, N = 3 SE +/- 159598753.20, N = 3 SE +/- 1622921637.03, N = 3 641200848170 747710702660 768804693697 889567506540 1277583382757 1484669627050 1533026300727 1769313146013 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenSSL Algorithm: AES-256-GCM OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: AES-256-GCM Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 300000M 600000M 900000M 1200000M 1500000M SE +/- 119857064.56, N = 3 SE +/- 63026881.96, N = 3 SE +/- 2848140790.67, N = 3 SE +/- 3966858436.56, N = 3 SE +/- 108288170.03, N = 3 SE +/- 112278705.55, N = 3 SE +/- 1397764228.85, N = 3 SE +/- 1320809584.03, N = 3 507456728087 592014115453 700239352717 744387683670 1011898993323 1181148957353 1369534328470 1497529939377 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenSSL Algorithm: ChaCha20-Poly1305 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: ChaCha20-Poly1305 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 100000M 200000M 300000M 400000M 500000M SE +/- 6370607.14, N = 3 SE +/- 37795783.50, N = 3 SE +/- 120899798.30, N = 3 SE +/- 766713911.50, N = 3 SE +/- 4148679.28, N = 3 SE +/- 36941390.18, N = 3 SE +/- 132227134.30, N = 3 SE +/- 82161991.11, N = 3 161321058213 187796174440 223625738013 225038850730 320396720447 372735215297 442202532977 444099144270 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenSSL Algorithm: SHA512 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: SHA512 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 10000M 20000M 30000M 40000M 50000M SE +/- 500176.69, N = 3 SE +/- 1250834.62, N = 3 SE +/- 203213936.42, N = 3 SE +/- 37654528.63, N = 3 SE +/- 3500318.33, N = 3 SE +/- 14339684.98, N = 3 SE +/- 481040738.21, N = 3 SE +/- 14734422.48, N = 3 16199261277 18893980783 22219927723 23886054770 32304222993 37564522053 42846254477 46520760707 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenSSL Algorithm: ChaCha20 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: ChaCha20 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 150000M 300000M 450000M 600000M 750000M SE +/- 415487944.57, N = 3 SE +/- 312824840.64, N = 3 SE +/- 232288636.76, N = 3 SE +/- 3335467.26, N = 3 SE +/- 329510485.23, N = 3 SE +/- 863978337.15, N = 3 SE +/- 271318554.29, N = 3 SE +/- 303075210.03, N = 3 226597354153 263740690067 316126421173 344150916937 449908494927 522912403347 624402972947 684284382760 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenSSL Algorithm: SHA256 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: SHA256 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 30000M 60000M 90000M 120000M 150000M SE +/- 27466135.54, N = 3 SE +/- 33334799.97, N = 3 SE +/- 159515825.53, N = 3 SE +/- 23323764.84, N = 3 SE +/- 126029257.64, N = 3 SE +/- 70647143.49, N = 3 SE +/- 66583540.43, N = 3 SE +/- 29142783.86, N = 3 44439185187 51840436763 61806994523 66573957920 88635753413 103382860113 119106802107 131976050120 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
Speedb Test: Random Read OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Random Read Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 130M 260M 390M 520M 650M SE +/- 3698537.65, N = 15 SE +/- 2763560.64, N = 13 SE +/- 168680.90, N = 3 SE +/- 242146.75, N = 3 SE +/- 8491098.40, N = 15 SE +/- 2955608.21, N = 3 SE +/- 5393159.45, N = 3 SE +/- 5399265.88, N = 15 211457048 244070674 276179617 315178381 419943570 497907490 551286958 586147871 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
FFmpeg Encoder: libx265 - Scenario: Video On Demand OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Video On Demand Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 12 24 36 48 60 SE +/- 0.43, N = 3 SE +/- 0.13, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 45.29 46.79 47.34 48.14 48.77 49.84 53.29 53.99 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx265 - Scenario: Platform OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Platform Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 12 24 36 48 60 SE +/- 0.09, N = 3 SE +/- 0.27, N = 3 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 SE +/- 0.16, N = 3 SE +/- 0.15, N = 3 SE +/- 0.14, N = 3 45.95 46.59 47.32 48.35 48.76 49.79 53.22 53.92 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-152 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 6 12 18 24 30 SE +/- 0.09, N = 3 SE +/- 0.16, N = 3 SE +/- 0.18, N = 3 SE +/- 0.09, N = 3 SE +/- 0.18, N = 7 SE +/- 0.18, N = 7 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 14.59 14.74 16.17 16.68 19.29 19.47 20.46 23.41 MIN: 10.11 / MAX: 16.06 MIN: 10.63 / MAX: 15.36 MIN: 11.54 / MAX: 16.69 MIN: 7.02 / MAX: 17.07 MIN: 10.66 / MAX: 20.07 MIN: 11.79 / MAX: 20.53 MIN: 17.25 / MAX: 21.16 MIN: 22.41 / MAX: 24.3
Zstd Compression Compression Level: 19 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19 - Decompression Speed Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 300 600 900 1200 1500 SE +/- 4.96, N = 3 SE +/- 4.45, N = 3 SE +/- 0.65, N = 15 SE +/- 0.66, N = 15 SE +/- 2.12, N = 3 SE +/- 1.08, N = 15 SE +/- 1.88, N = 3 SE +/- 3.01, N = 4 963.6 1032.0 1039.2 1040.2 1126.4 1127.5 1165.8 1221.8 1. (CC) gcc options: -O3 -pthread -lz -llzma
Zstd Compression Compression Level: 19 - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19 - Compression Speed Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 4 8 12 16 20 SE +/- 0.13, N = 15 SE +/- 0.09, N = 15 SE +/- 0.15, N = 3 SE +/- 0.11, N = 15 SE +/- 0.06, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 SE +/- 0.21, N = 4 13.3 13.8 14.4 14.5 14.6 15.2 17.8 18.0 1. (CC) gcc options: -O3 -pthread -lz -llzma
oneDNN Harness: Recurrent Neural Network Inference - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Recurrent Neural Network Inference - Engine: CPU Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H 300 600 900 1200 1500 SE +/- 113.47, N = 12 SE +/- 21.06, N = 12 SE +/- 7.22, N = 3 SE +/- 2.30, N = 3 SE +/- 20.21, N = 15 SE +/- 3.17, N = 3 SE +/- 2.24, N = 3 SE +/- 0.29, N = 3 1498.58 734.80 719.23 633.29 632.15 538.23 488.92 409.59 MIN: 641.2 MIN: 546.95 MIN: 696.95 MIN: 621.42 MIN: 459.4 MIN: 529.58 MIN: 457.65 MIN: 390.22 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
John The Ripper Test: MD5 OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: MD5 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 4M 8M 12M 16M 20M SE +/- 54649.77, N = 15 SE +/- 5000.00, N = 3 SE +/- 3511.88, N = 3 SE +/- 1201.85, N = 3 SE +/- 601801.63, N = 12 SE +/- 695042.48, N = 12 SE +/- 22338.31, N = 3 SE +/- 317498.76, N = 15 7626333 8957000 9583000 10922667 12958000 14609417 18166000 18438600 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-152 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 6 12 18 24 30 SE +/- 0.13, N = 7 SE +/- 0.18, N = 4 SE +/- 0.16, N = 3 SE +/- 0.09, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.08, N = 3 SE +/- 0.29, N = 3 14.08 14.92 16.00 16.30 19.20 19.58 20.25 23.33 MIN: 6.98 / MAX: 15.46 MIN: 8.28 / MAX: 15.85 MIN: 11.43 / MAX: 16.66 MIN: 11.86 / MAX: 16.95 MIN: 10.93 / MAX: 20 MIN: 13.13 / MAX: 20.27 MIN: 17.03 / MAX: 21.21 MIN: 19.78 / MAX: 24.54
OSPRay Benchmark: particle_volume/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/scivis/real_time Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 12 24 36 48 60 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 16.09 18.49 21.89 29.35 30.68 33.13 38.23 53.93
DuckDB Benchmark: IMDB OpenBenchmarking.org Seconds, Fewer Is Better DuckDB 0.9.1 Benchmark: IMDB Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 30 60 90 120 150 SE +/- 0.41, N = 3 SE +/- 0.07, N = 3 SE +/- 0.30, N = 3 SE +/- 0.67, N = 3 SE +/- 0.23, N = 3 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 SE +/- 0.59, N = 3 131.80 127.70 127.57 125.88 100.09 99.62 99.49 99.18 1. (CXX) g++ options: -O3 -rdynamic -lssl -lcrypto -ldl
OSPRay Benchmark: particle_volume/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/pathtracer/real_time Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 40 80 120 160 200 SE +/- 0.81, N = 3 SE +/- 0.42, N = 3 SE +/- 0.29, N = 3 SE +/- 0.09, N = 3 SE +/- 0.49, N = 3 SE +/- 0.17, N = 3 SE +/- 0.89, N = 3 SE +/- 0.25, N = 3 135.44 137.50 143.48 144.48 149.09 160.24 176.40 193.14
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 10 20 30 40 50 SE +/- 0.24, N = 12 SE +/- 0.22, N = 15 SE +/- 0.22, N = 15 SE +/- 0.18, N = 15 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 15.34 15.50 15.82 16.27 19.58 23.18 35.60 41.91
LuxCoreRender Scene: Orange Juice - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Orange Juice - Acceleration: CPU Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 5 10 15 20 25 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.28, N = 15 SE +/- 0.16, N = 15 SE +/- 0.12, N = 3 SE +/- 0.30, N = 15 11.86 12.50 13.46 14.74 16.64 16.91 18.70 19.91 MIN: 9.93 / MAX: 13.28 MIN: 10.38 / MAX: 14.93 MIN: 11.09 / MAX: 16.56 MIN: 12.17 / MAX: 18.21 MIN: 12.39 / MAX: 24.93 MIN: 12.9 / MAX: 23.07 MIN: 16.22 / MAX: 25.05 MIN: 15 / MAX: 30.59
Timed LLVM Compilation Build System: Ninja OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 16.0 Build System: Ninja Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 50 100 150 200 250 SE +/- 0.19, N = 3 SE +/- 0.36, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.17, N = 3 SE +/- 0.79, N = 3 SE +/- 0.15, N = 3 SE +/- 0.27, N = 3 212.48 197.84 187.02 165.05 134.42 128.07 122.31 106.82
NAMD Input: ATPase with 327,506 Atoms OpenBenchmarking.org ns/day, More Is Better NAMD 3.0b6 Input: ATPase with 327,506 Atoms Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9468 2P 2 4 6 8 10 SE +/- 0.17435, N = 15 SE +/- 0.44989, N = 15 SE +/- 0.21567, N = 12 SE +/- 0.54361, N = 15 SE +/- 0.34017, N = 12 SE +/- 0.14537, N = 15 SE +/- 0.16058, N = 15 SE +/- 0.26203, N = 15 2.21948 2.56319 2.97021 4.64814 5.85267 5.92501 5.97130 7.30065
VVenC Video Input: Bosphorus 4K - Video Preset: Fast OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Fast Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 2 4 6 8 10 SE +/- 0.081, N = 3 SE +/- 0.043, N = 15 SE +/- 0.010, N = 3 SE +/- 0.047, N = 3 SE +/- 0.033, N = 3 SE +/- 0.022, N = 3 SE +/- 0.038, N = 3 SE +/- 0.023, N = 3 6.023 6.077 6.324 6.480 6.501 6.719 6.960 7.392 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
Numpy Benchmark OpenBenchmarking.org Score, More Is Better Numpy Benchmark Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 110 220 330 440 550 SE +/- 1.13, N = 3 SE +/- 1.30, N = 3 SE +/- 0.33, N = 3 SE +/- 0.26, N = 3 SE +/- 0.60, N = 3 SE +/- 0.79, N = 3 SE +/- 1.42, N = 3 SE +/- 1.84, N = 3 435.21 439.84 455.57 456.18 461.61 464.72 519.89 520.22
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 14 28 42 56 70 SE +/- 0.21, N = 3 SE +/- 0.34, N = 15 SE +/- 0.30, N = 15 SE +/- 0.26, N = 3 SE +/- 0.72, N = 3 SE +/- 0.43, N = 15 SE +/- 0.12, N = 3 SE +/- 0.19, N = 3 37.55 37.84 40.83 41.65 51.05 51.86 56.44 63.30 MIN: 24.5 / MAX: 40.69 MIN: 19.63 / MAX: 40.77 MIN: 15.4 / MAX: 43.41 MIN: 31.6 / MAX: 43.65 MIN: 40.71 / MAX: 53.89 MIN: 30.55 / MAX: 55.87 MIN: 48.09 / MAX: 58.6 MIN: 48.94 / MAX: 65.25
LuxCoreRender Scene: LuxCore Benchmark - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: LuxCore Benchmark - Acceleration: CPU Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 2 4 6 8 10 SE +/- 0.03, N = 3 SE +/- 0.22, N = 12 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.16, N = 15 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.17, N = 12 6.30 6.81 6.82 7.10 7.41 8.06 8.82 8.88 MIN: 2.53 / MAX: 7.3 MIN: 2.55 / MAX: 9.19 MIN: 2.81 / MAX: 7.94 MIN: 3.06 / MAX: 8.2 MIN: 2.67 / MAX: 9.42 MIN: 3.62 / MAX: 9.37 MIN: 3.72 / MAX: 10.41 MIN: 3.73 / MAX: 11.48
OpenFOAM Input: drivaerFastback, Medium Mesh Size - Execution Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Execution Time Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 100 200 300 400 500 440.83 420.65 410.29 302.06 201.11 196.50 186.33 137.04 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenFOAM Input: drivaerFastback, Medium Mesh Size - Mesh Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Mesh Time Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 2P 40 80 120 160 200 162.03 160.73 159.31 153.12 150.67 148.40 139.62 134.78 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ 7 14 21 28 35 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 30.20 16.96 16.66 14.86 14.29 14.04 13.85 13.26 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ 16K 32K 48K 64K 80K SE +/- 106.16, N = 3 SE +/- 195.77, N = 3 SE +/- 440.63, N = 3 SE +/- 137.82, N = 3 SE +/- 95.84, N = 3 SE +/- 78.02, N = 3 SE +/- 143.25, N = 3 SE +/- 198.41, N = 3 33110 58952 60046 67315 69969 71227 72225 75396 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenRadioss Model: Rubber O-Ring Seal Installation OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Rubber O-Ring Seal Installation Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 20 40 60 80 100 SE +/- 0.06, N = 3 SE +/- 0.72, N = 8 SE +/- 0.51, N = 15 SE +/- 0.02, N = 3 SE +/- 0.12, N = 3 SE +/- 0.60, N = 3 SE +/- 0.32, N = 3 SE +/- 0.34, N = 3 88.39 86.85 81.65 70.73 59.91 59.58 59.32 54.14
OpenRadioss Model: INIVOL and Fluid Structure Interaction Drop Container OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: INIVOL and Fluid Structure Interaction Drop Container Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 40 80 120 160 200 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.19, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.17, N = 3 SE +/- 0.30, N = 3 160.56 146.03 140.43 128.74 114.29 110.56 107.36 100.00
Zstd Compression Compression Level: 19, Long Mode - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Decompression Speed Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 300 600 900 1200 1500 SE +/- 3.69, N = 3 SE +/- 1.00, N = 3 SE +/- 1.78, N = 15 SE +/- 0.43, N = 3 SE +/- 0.56, N = 3 SE +/- 1.45, N = 3 SE +/- 1.60, N = 3 SE +/- 0.84, N = 3 992.1 1041.8 1046.0 1069.1 1131.1 1133.3 1189.7 1242.6 1. (CC) gcc options: -O3 -pthread -lz -llzma
Zstd Compression Compression Level: 19, Long Mode - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Compression Speed Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 3 6 9 12 15 SE +/- 0.06, N = 15 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 7.46 7.62 7.72 7.76 7.94 8.16 9.67 9.80 1. (CC) gcc options: -O3 -pthread -lz -llzma
Timed Godot Game Engine Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Godot Game Engine Compilation 4.0 Time To Compile Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 30 60 90 120 150 SE +/- 0.18, N = 3 SE +/- 0.32, N = 3 SE +/- 0.76, N = 3 SE +/- 0.56, N = 3 SE +/- 0.91, N = 3 SE +/- 1.69, N = 3 SE +/- 0.56, N = 3 SE +/- 0.29, N = 3 149.38 143.81 140.23 123.88 122.72 122.70 118.57 103.38
Xmrig Variant: GhostRider - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: GhostRider - Hash Count: 1M Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 3K 6K 9K 12K 15K SE +/- 12.93, N = 3 SE +/- 23.16, N = 3 SE +/- 14.78, N = 3 SE +/- 44.68, N = 3 SE +/- 14.02, N = 3 SE +/- 4.03, N = 3 SE +/- 7.44, N = 3 SE +/- 64.69, N = 3 5446.8 5808.8 6122.3 8378.3 10975.8 11263.2 12115.0 16324.7 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
TensorFlow Device: CPU - Batch Size: 512 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: GoogLeNet Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 120 240 360 480 600 SE +/- 0.41, N = 3 SE +/- 0.37, N = 3 SE +/- 0.34, N = 3 SE +/- 3.68, N = 3 SE +/- 1.14, N = 3 SE +/- 2.46, N = 3 SE +/- 2.62, N = 3 SE +/- 1.52, N = 3 383.57 398.40 461.23 462.78 467.91 477.33 576.08 577.76
ONNX Runtime Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8592+ 0.3867 0.7734 1.1601 1.5468 1.9335 SE +/- 0.01853, N = 5 SE +/- 0.00498, N = 3 SE +/- 0.01405, N = 15 SE +/- 0.01456, N = 3 SE +/- 0.02719, N = 15 SE +/- 0.01541, N = 3 SE +/- 0.01594, N = 3 SE +/- 0.00291, N = 3 1.71875 1.65270 1.43573 1.41662 1.37831 1.32454 1.17292 1.10042 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8592+ 200 400 600 800 1000 SE +/- 6.21, N = 5 SE +/- 1.83, N = 3 SE +/- 6.50, N = 15 SE +/- 7.34, N = 3 SE +/- 12.91, N = 15 SE +/- 8.88, N = 3 SE +/- 11.46, N = 3 SE +/- 2.43, N = 3 581.77 604.76 696.98 705.61 728.47 754.81 852.33 908.19 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Standard Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 2 4 6 8 10 SE +/- 0.06105, N = 3 SE +/- 0.02902, N = 3 SE +/- 0.06620, N = 3 SE +/- 0.06596, N = 15 SE +/- 0.03218, N = 3 SE +/- 0.03075, N = 3 SE +/- 0.15083, N = 15 SE +/- 0.01631, N = 3 7.53259 7.04111 5.91961 5.67700 5.55101 4.49976 4.29531 3.69649 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Standard Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 60 120 180 240 300 SE +/- 1.08, N = 3 SE +/- 0.58, N = 3 SE +/- 1.88, N = 3 SE +/- 2.01, N = 15 SE +/- 1.05, N = 3 SE +/- 1.50, N = 3 SE +/- 8.14, N = 15 SE +/- 1.19, N = 3 132.71 141.95 168.86 176.33 180.03 222.03 236.65 270.33 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: T5 Encoder - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Parallel Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 0.9132 1.8264 2.7396 3.6528 4.566 SE +/- 0.04801, N = 3 SE +/- 0.04072, N = 3 SE +/- 0.02633, N = 15 SE +/- 0.00807, N = 3 SE +/- 0.03338, N = 15 SE +/- 0.01443, N = 3 SE +/- 0.01381, N = 3 SE +/- 0.01801, N = 3 4.05881 4.05270 3.95819 3.06500 2.97094 2.88734 2.81739 2.15980 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: T5 Encoder - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Parallel Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 100 200 300 400 500 SE +/- 2.94, N = 3 SE +/- 2.44, N = 3 SE +/- 1.67, N = 15 SE +/- 0.86, N = 3 SE +/- 3.48, N = 15 SE +/- 1.74, N = 3 SE +/- 1.73, N = 3 SE +/- 3.84, N = 3 246.34 246.68 252.67 326.14 337.00 346.21 354.75 462.86 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenRadioss Model: Bird Strike on Windshield OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Bird Strike on Windshield Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 30 60 90 120 150 SE +/- 0.45, N = 3 SE +/- 0.29, N = 3 SE +/- 0.03, N = 3 SE +/- 0.38, N = 3 SE +/- 0.24, N = 3 SE +/- 0.69, N = 3 SE +/- 0.83, N = 3 SE +/- 0.14, N = 3 126.89 124.44 120.76 119.03 117.41 116.49 113.15 110.32
QMCPACK Input: Li2_STO_ae OpenBenchmarking.org Total Execution Time - Seconds, Fewer Is Better QMCPACK 3.17.1 Input: Li2_STO_ae Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 30 60 90 120 150 SE +/- 1.20, N = 3 SE +/- 1.04, N = 3 SE +/- 0.89, N = 3 SE +/- 1.11, N = 5 SE +/- 1.03, N = 3 SE +/- 0.88, N = 3 SE +/- 1.11, N = 3 SE +/- 0.93, N = 3 121.19 117.81 109.30 106.27 105.98 102.12 101.63 97.91 1. (CXX) g++ options: -fopenmp -foffload=disable -finline-limit=1000 -fstrict-aliasing -funroll-all-loops -ffast-math -march=native -O3 -lm -ldl
Appleseed Scene: Material Tester OpenBenchmarking.org Seconds, Fewer Is Better Appleseed 2.0 Beta Scene: Material Tester Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 50 100 150 200 250 243.24 239.73 225.35 210.82 136.49 134.39 126.15 118.78
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 7 14 21 28 35 SE +/- 0.18, N = 3 SE +/- 0.36, N = 3 SE +/- 0.39, N = 13 SE +/- 0.21, N = 3 SE +/- 0.33, N = 3 SE +/- 0.32, N = 15 SE +/- 0.06, N = 3 SE +/- 0.19, N = 3 29.44 27.59 26.09 24.65 23.66 21.22 18.93 15.04 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 15 30 45 60 75 SE +/- 0.21, N = 3 SE +/- 0.48, N = 3 SE +/- 0.51, N = 13 SE +/- 0.34, N = 3 SE +/- 0.59, N = 3 SE +/- 0.69, N = 15 SE +/- 0.16, N = 3 SE +/- 0.82, N = 3 33.96 36.25 38.42 40.57 42.27 47.27 52.82 66.52 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 10 20 30 40 50 SE +/- 0.32, N = 15 SE +/- 0.17, N = 3 SE +/- 0.22, N = 3 SE +/- 0.18, N = 15 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 SE +/- 0.36, N = 3 15.37 15.40 15.98 16.32 19.85 23.73 36.15 42.13
OSPRay Benchmark: particle_volume/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/ao/real_time Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 12 24 36 48 60 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 16.05 18.55 21.93 29.50 30.84 33.11 38.22 54.12
oneDNN Harness: Recurrent Neural Network Training - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Recurrent Neural Network Training - Engine: CPU Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 600 1200 1800 2400 3000 SE +/- 31.34, N = 3 SE +/- 119.20, N = 12 SE +/- 12.69, N = 3 SE +/- 8.14, N = 3 SE +/- 5.57, N = 3 SE +/- 2.79, N = 3 SE +/- 4.22, N = 3 SE +/- 0.67, N = 3 2776.52 1966.88 1200.75 1180.85 703.47 635.15 626.14 623.60 MIN: 2715.64 MIN: 1146.52 MIN: 1127.94 MIN: 1153.29 MIN: 649.83 MIN: 612.85 MIN: 600.37 MIN: 598.72 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Speedb Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Read While Writing Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 4M 8M 12M 16M 20M SE +/- 88257.34, N = 3 SE +/- 93731.24, N = 7 SE +/- 62510.72, N = 3 SE +/- 143570.67, N = 4 SE +/- 171807.74, N = 3 SE +/- 197596.27, N = 3 SE +/- 239363.92, N = 3 SE +/- 195912.00, N = 15 8795408 9988176 10695360 12168413 13859254 15354400 17297027 17585737 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Memcached Set To Get Ratio: 1:100 OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.19 Set To Get Ratio: 1:100 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 1000K 2000K 3000K 4000K 5000K SE +/- 50660.01, N = 15 SE +/- 26891.33, N = 3 SE +/- 24083.78, N = 3 SE +/- 35300.21, N = 3 SE +/- 52575.97, N = 3 SE +/- 21428.06, N = 3 SE +/- 25335.31, N = 3 SE +/- 35182.67, N = 3 3245908.40 3373323.92 3392842.38 3780240.56 4315467.17 4384040.52 4481667.95 4752673.79 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
DaCapo Benchmark Java Test: Tradesoap OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Tradesoap Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 1600 3200 4800 6400 8000 SE +/- 52.55, N = 15 SE +/- 57.43, N = 15 SE +/- 31.29, N = 3 SE +/- 48.92, N = 14 SE +/- 29.41, N = 3 SE +/- 48.60, N = 15 SE +/- 36.36, N = 15 SE +/- 40.72, N = 15 7492 7321 4215 4199 4115 4069 3887 3884
ONNX Runtime Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 2 4 6 8 10 SE +/- 0.06816, N = 3 SE +/- 0.01358, N = 3 SE +/- 0.09530, N = 15 SE +/- 0.03225, N = 3 SE +/- 0.03815, N = 5 SE +/- 0.02572, N = 3 SE +/- 0.01810, N = 3 SE +/- 0.02187, N = 3 6.17796 5.83954 5.74491 5.62517 3.37034 3.18392 3.17002 3.02897 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 70 140 210 280 350 SE +/- 1.78, N = 3 SE +/- 0.40, N = 3 SE +/- 2.72, N = 15 SE +/- 1.01, N = 3 SE +/- 3.31, N = 5 SE +/- 2.52, N = 3 SE +/- 1.80, N = 3 SE +/- 2.40, N = 3 161.89 171.23 174.68 177.76 296.80 314.06 315.41 330.10 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Standard Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 1.1255 2.251 3.3765 4.502 5.6275 SE +/- 0.02558, N = 3 SE +/- 0.05347, N = 4 SE +/- 0.10855, N = 15 SE +/- 0.00532, N = 3 SE +/- 0.00187, N = 3 SE +/- 0.00313, N = 3 SE +/- 0.05342, N = 3 SE +/- 0.00044, N = 3 5.00222 4.85818 4.72530 4.67269 4.58912 4.39649 3.98013 3.85774 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Standard Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 60 120 180 240 300 SE +/- 1.02, N = 3 SE +/- 2.30, N = 4 SE +/- 4.15, N = 15 SE +/- 0.25, N = 3 SE +/- 0.09, N = 3 SE +/- 0.16, N = 3 SE +/- 3.39, N = 3 SE +/- 0.03, N = 3 199.90 205.89 212.92 213.99 217.88 227.42 251.31 259.19 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 Xeon Platinum 8592+ 6 12 18 24 30 SE +/- 0.13, N = 8 SE +/- 0.16, N = 4 SE +/- 0.19, N = 5 SE +/- 0.18, N = 3 SE +/- 0.16, N = 3 SE +/- 0.09, N = 3 SE +/- 0.26, N = 3 SE +/- 0.08, N = 3 14.86 15.77 17.57 17.91 18.07 19.41 19.99 27.21 MIN: 0.53 / MAX: 17.18 MIN: 8.33 / MAX: 16.91 MIN: 5.14 / MAX: 18.58 MIN: 5.47 / MAX: 18.9 MIN: 0.27 / MAX: 21.93 MIN: 14.68 / MAX: 22.3 MIN: 0.34 / MAX: 23.05 MIN: 13.91 / MAX: 28.31
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Standard Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 14 28 42 56 70 SE +/- 0.62, N = 3 SE +/- 0.68, N = 3 SE +/- 1.12, N = 15 SE +/- 0.23, N = 3 SE +/- 0.17, N = 3 SE +/- 0.44, N = 3 SE +/- 0.44, N = 3 SE +/- 0.04, N = 3 60.36 60.11 55.90 49.97 49.64 47.24 44.60 39.75 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Standard Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 6 12 18 24 30 SE +/- 0.17, N = 3 SE +/- 0.19, N = 3 SE +/- 0.35, N = 15 SE +/- 0.09, N = 3 SE +/- 0.07, N = 3 SE +/- 0.20, N = 3 SE +/- 0.22, N = 3 SE +/- 0.02, N = 3 16.57 16.64 17.99 20.01 20.15 21.17 22.43 25.16 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P 0.1103 0.2206 0.3309 0.4412 0.5515 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.49 0.46 0.43 0.37 0.33 0.30 0.29 0.28 MIN: 0.18 / MAX: 16.07 MIN: 0.18 / MAX: 22.29 MIN: 0.23 / MAX: 17.03 MIN: 0.28 / MAX: 40.85 MIN: 0.26 / MAX: 19.2 MIN: 0.26 / MAX: 42.1 MIN: 0.24 / MAX: 39.69 MIN: 0.25 / MAX: 41.4 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P 40K 80K 120K 160K 200K SE +/- 988.12, N = 3 SE +/- 75.30, N = 3 SE +/- 1158.60, N = 3 SE +/- 383.22, N = 3 SE +/- 1761.33, N = 3 SE +/- 18.38, N = 3 SE +/- 1422.88, N = 15 SE +/- 2494.14, N = 3 81279.79 115106.30 128566.81 135075.07 140144.01 174862.56 176900.32 189893.31 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
ONNX Runtime Model: T5 Encoder - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Standard Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8592+ 1.213 2.426 3.639 4.852 6.065 SE +/- 0.02608, N = 3 SE +/- 0.03283, N = 3 SE +/- 0.01103, N = 3 SE +/- 0.08827, N = 15 SE +/- 0.00316, N = 3 SE +/- 0.02371, N = 3 SE +/- 0.00659, N = 3 SE +/- 0.00472, N = 3 5.39123 5.02267 4.64757 4.57581 3.46571 2.80263 2.79694 2.16966 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: T5 Encoder - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Standard Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8592+ 100 200 300 400 500 SE +/- 0.89, N = 3 SE +/- 1.31, N = 3 SE +/- 0.51, N = 3 SE +/- 3.95, N = 15 SE +/- 0.26, N = 3 SE +/- 3.01, N = 3 SE +/- 0.84, N = 3 SE +/- 1.00, N = 3 185.46 199.08 215.13 219.53 288.47 356.76 357.36 460.78 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Timed CPython Compilation Build Configuration: Released Build, PGO + LTO Optimized OpenBenchmarking.org Seconds, Fewer Is Better Timed CPython Compilation 3.10.6 Build Configuration: Released Build, PGO + LTO Optimized Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 60 120 180 240 300 279.69 277.39 276.46 276.23 275.39 273.52 244.95 244.82
Appleseed Scene: Emily OpenBenchmarking.org Seconds, Fewer Is Better Appleseed 2.0 Beta Scene: Emily Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 30 60 90 120 150 137.46 137.00 132.13 130.62 129.96 128.60 120.75 119.80
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 100 200 300 400 500 SE +/- 6.06, N = 3 SE +/- 5.57, N = 13 SE +/- 2.21, N = 3 SE +/- 1.73, N = 3 SE +/- 0.96, N = 3 SE +/- 0.94, N = 3 SE +/- 4.07, N = 3 SE +/- 0.74, N = 3 475.25 460.67 382.11 380.90 352.74 329.04 327.88 302.27 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 0.7444 1.4888 2.2332 2.9776 3.722 SE +/- 0.02652, N = 3 SE +/- 0.02702, N = 13 SE +/- 0.01517, N = 3 SE +/- 0.01189, N = 3 SE +/- 0.00768, N = 3 SE +/- 0.00871, N = 3 SE +/- 0.03826, N = 3 SE +/- 0.00805, N = 3 2.10480 2.17463 2.61721 2.62544 2.83498 3.03922 3.05085 3.30836 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenRadioss Model: Bumper Beam OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Bumper Beam Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P 20 40 60 80 100 SE +/- 0.22, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.27, N = 3 SE +/- 0.22, N = 3 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.23, N = 3 86.11 83.44 81.72 81.30 80.32 79.54 78.71 78.27
Aircrack-ng OpenBenchmarking.org k/s, More Is Better Aircrack-ng 1.7 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 30K 60K 90K 120K 150K SE +/- 1197.41, N = 15 SE +/- 773.70, N = 3 SE +/- 1131.21, N = 15 SE +/- 1027.07, N = 15 SE +/- 36.42, N = 3 SE +/- 122.31, N = 3 SE +/- 1953.08, N = 3 SE +/- 840.59, N = 3 53914.93 64181.29 65663.82 83665.76 117588.99 134048.96 147469.33 153584.20 1. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lsqlite3 -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -pthread
Helsing Digit Range: 14 digit OpenBenchmarking.org Seconds, Fewer Is Better Helsing 1.0-beta Digit Range: 14 digit Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 30 60 90 120 150 SE +/- 0.53, N = 3 SE +/- 0.12, N = 3 SE +/- 0.26, N = 3 SE +/- 0.08, N = 3 SE +/- 0.11, N = 3 SE +/- 0.42, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 123.83 107.24 93.35 89.07 65.03 58.25 50.83 48.09 1. (CC) gcc options: -O2 -pthread
DaCapo Benchmark Java Test: Tradebeans OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Tradebeans Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 3K 6K 9K 12K 15K SE +/- 16.01, N = 3 SE +/- 226.65, N = 15 SE +/- 64.94, N = 3 SE +/- 79.99, N = 3 SE +/- 66.27, N = 3 SE +/- 10.41, N = 3 SE +/- 51.68, N = 15 SE +/- 54.76, N = 15 12713 11004 8050 7270 6681 6672 6130 5994
TensorFlow Device: CPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 3 6 9 12 15 SE +/- 0.03, N = 15 SE +/- 0.04, N = 15 SE +/- 0.06, N = 15 SE +/- 0.07, N = 3 SE +/- 0.05, N = 9 SE +/- 0.10, N = 4 SE +/- 0.05, N = 4 SE +/- 0.09, N = 4 3.85 4.37 4.39 5.11 6.43 9.99 10.53 11.29
TensorFlow Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8490H 30 60 90 120 150 SE +/- 0.50, N = 3 SE +/- 0.70, N = 3 SE +/- 0.93, N = 3 SE +/- 0.13, N = 3 SE +/- 1.28, N = 3 SE +/- 0.39, N = 3 SE +/- 1.12, N = 3 SE +/- 0.04, N = 3 91.51 94.66 103.56 104.23 107.30 111.71 115.47 120.93
Blender Blend File: Pabellon Barcelona - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Pabellon Barcelona - Compute: CPU-Only Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 20 40 60 80 100 SE +/- 0.31, N = 3 SE +/- 0.44, N = 3 SE +/- 0.15, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.20, N = 3 SE +/- 0.26, N = 3 SE +/- 0.06, N = 3 106.96 97.80 87.92 80.29 55.26 51.29 46.38 41.85
libavif avifenc Encoder Speed: 0 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 0 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 20 40 60 80 100 SE +/- 0.15, N = 3 SE +/- 0.22, N = 3 SE +/- 0.32, N = 3 SE +/- 0.29, N = 3 SE +/- 0.32, N = 3 SE +/- 0.05, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 76.92 73.06 69.93 69.65 68.44 67.38 64.48 60.53 1. (CXX) g++ options: -O3 -fPIC -lm
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 500 1000 1500 2000 2500 SE +/- 1.20, N = 3 SE +/- 1.20, N = 3 SE +/- 0.88, N = 3 SE +/- 1.45, N = 3 SE +/- 2.65, N = 3 SE +/- 0.33, N = 3 SE +/- 0.88, N = 3 SE +/- 0.00, N = 3 2357 2123 1977 1709 1237 1143 1063 898
TensorFlow Device: CPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: GoogLeNet Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 110 220 330 440 550 SE +/- 1.67, N = 3 SE +/- 1.91, N = 3 SE +/- 2.30, N = 3 SE +/- 2.29, N = 3 SE +/- 0.24, N = 3 SE +/- 4.80, N = 3 SE +/- 2.68, N = 3 SE +/- 4.87, N = 3 375.73 386.00 423.59 447.50 448.46 449.91 501.39 528.93
GraphicsMagick Operation: Rotate OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Rotate Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 Xeon Platinum 8592+ 40 80 120 160 200 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 1.93, N = 6 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 143 148 172 182 194 196 197 203 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 400 800 1200 1600 2000 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 0.58, N = 3 SE +/- 0.88, N = 3 SE +/- 1.76, N = 3 SE +/- 0.58, N = 3 SE +/- 0.58, N = 3 SE +/- 0.88, N = 3 1988 1792 1657 1441 1049 961 894 759
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 80 160 240 320 400 SE +/- 0.28, N = 3 SE +/- 0.00, N = 3 SE +/- 0.35, N = 3 SE +/- 0.47, N = 3 SE +/- 0.40, N = 3 SE +/- 0.15, N = 3 SE +/- 0.33, N = 3 SE +/- 0.69, N = 3 356.38 283.11 278.52 257.50 256.63 236.52 234.24 224.64 MIN: 109.11 / MAX: 395.69 MIN: 203.37 / MAX: 332.08 MIN: 196.58 / MAX: 401.59 MIN: 187.62 / MAX: 295.06 MIN: 191.95 / MAX: 301.21 MIN: 172.47 / MAX: 265.77 MIN: 148.68 / MAX: 448.54 MIN: 153.29 / MAX: 553.64 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 120 240 360 480 600 SE +/- 0.12, N = 3 SE +/- 0.14, N = 3 SE +/- 0.41, N = 3 SE +/- 0.69, N = 3 SE +/- 0.58, N = 3 SE +/- 0.54, N = 3 SE +/- 0.01, N = 3 SE +/- 0.77, N = 3 167.83 202.59 217.11 284.64 373.50 401.45 423.18 545.21 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 20K 40K 60K 80K 100K SE +/- 41.33, N = 3 SE +/- 65.97, N = 3 SE +/- 58.68, N = 3 SE +/- 162.52, N = 3 SE +/- 155.80, N = 3 SE +/- 141.04, N = 3 SE +/- 125.33, N = 3 SE +/- 47.16, N = 3 80742 73366 68006 59522 45211 41971 38813 33391
miniBUDE Implementation: OpenMP - Input Deck: BM2 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 40 80 120 160 200 SE +/- 0.31, N = 3 SE +/- 0.96, N = 4 SE +/- 0.31, N = 3 SE +/- 0.03, N = 3 SE +/- 1.48, N = 3 SE +/- 0.93, N = 3 SE +/- 0.99, N = 3 SE +/- 1.93, N = 15 70.21 78.11 86.97 108.12 127.85 133.99 140.83 191.82 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM2 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 1000 2000 3000 4000 5000 SE +/- 7.81, N = 3 SE +/- 23.93, N = 4 SE +/- 7.77, N = 3 SE +/- 0.70, N = 3 SE +/- 36.96, N = 3 SE +/- 23.14, N = 3 SE +/- 24.63, N = 3 SE +/- 48.20, N = 15 1755.33 1952.61 2174.19 2703.09 3196.12 3349.76 3520.71 4795.46 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 11 22 33 44 55 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.16, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 19.91 22.36 24.64 27.10 35.93 39.34 42.82 48.76
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 15K 30K 45K 60K 75K SE +/- 134.33, N = 3 SE +/- 64.91, N = 3 SE +/- 102.40, N = 3 SE +/- 90.37, N = 3 SE +/- 37.55, N = 3 SE +/- 13.86, N = 3 SE +/- 64.24, N = 3 SE +/- 16.05, N = 3 68973 62540 58026 50798 38926 36179 33411 24249
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 8K 16K 24K 32K 40K SE +/- 28.06, N = 3 SE +/- 83.47, N = 3 SE +/- 62.46, N = 3 SE +/- 37.49, N = 3 SE +/- 72.42, N = 3 SE +/- 51.39, N = 3 SE +/- 34.10, N = 3 SE +/- 7.13, N = 3 37055 33790 31380 23125 16645 15357 14138 12124
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 0.8055 1.611 2.4165 3.222 4.0275 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 4 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 3.58 2.79 2.67 2.53 2.50 2.50 2.48 2.36 MIN: 1.4 / MAX: 12.71 MIN: 2.44 / MAX: 34.21 MIN: 2.39 / MAX: 34.22 MIN: 2.23 / MAX: 31.44 MIN: 2.22 / MAX: 27.89 MIN: 2.28 / MAX: 40.8 MIN: 1.98 / MAX: 34.01 MIN: 2.02 / MAX: 21.33 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 10K 20K 30K 40K 50K SE +/- 2.71, N = 3 SE +/- 234.43, N = 4 SE +/- 21.27, N = 3 SE +/- 47.41, N = 3 SE +/- 80.58, N = 3 SE +/- 233.95, N = 3 SE +/- 53.98, N = 3 SE +/- 39.08, N = 3 15943.17 19183.83 20910.53 26943.42 37710.60 40032.81 47654.95 48122.16 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ 5 10 15 20 25 SE +/- 0.09, N = 3 SE +/- 0.12, N = 3 SE +/- 0.05, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 18.72 17.15 15.96 13.95 13.15 12.72 11.37 9.40 MIN: 12.15 / MAX: 64.81 MIN: 10.81 / MAX: 59.34 MIN: 10.38 / MAX: 43.64 MIN: 8.67 / MAX: 65.92 MIN: 7.28 / MAX: 47.97 MIN: 9.56 / MAX: 30.66 MIN: 9.17 / MAX: 32.12 MIN: 7.66 / MAX: 25.07 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 2K 4K 6K 8K 10K SE +/- 15.13, N = 3 SE +/- 1.87, N = 3 SE +/- 7.60, N = 3 SE +/- 37.79, N = 3 SE +/- 28.98, N = 3 SE +/- 10.14, N = 3 SE +/- 13.31, N = 3 SE +/- 24.76, N = 3 4208.49 4209.10 4386.48 5565.23 5933.65 6757.26 7356.63 9360.89 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 9K 18K 27K 36K 45K SE +/- 36.47, N = 3 SE +/- 74.33, N = 3 SE +/- 61.20, N = 3 SE +/- 26.00, N = 3 SE +/- 25.12, N = 3 SE +/- 10.97, N = 3 SE +/- 29.96, N = 3 SE +/- 8.00, N = 3 42837 39238 36649 31993 19701 18111 16837 14358
ONNX Runtime Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 0.4698 0.9396 1.4094 1.8792 2.349 SE +/- 0.00871, N = 3 SE +/- 0.00720, N = 3 SE +/- 0.01492, N = 3 SE +/- 0.00701, N = 3 SE +/- 0.01053, N = 3 SE +/- 0.00884, N = 3 SE +/- 0.00936, N = 3 SE +/- 0.01491, N = 4 2.08780 2.02659 1.76353 1.64919 1.47249 1.45280 1.27368 1.20298 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 200 400 600 800 1000 SE +/- 1.98, N = 3 SE +/- 1.77, N = 3 SE +/- 4.81, N = 3 SE +/- 2.57, N = 3 SE +/- 4.87, N = 3 SE +/- 4.16, N = 3 SE +/- 5.72, N = 3 SE +/- 10.06, N = 4 478.47 492.89 566.38 605.59 678.48 687.67 784.30 830.73 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 16.50 15.04 14.42 13.59 13.34 12.54 11.69 11.17 MIN: 11.95 / MAX: 28.87 MIN: 12.32 / MAX: 32.87 MIN: 9.74 / MAX: 43.95 MIN: 9.53 / MAX: 21.61 MIN: 9.67 / MAX: 39.84 MIN: 9.17 / MAX: 21.01 MIN: 10.28 / MAX: 42.12 MIN: 10.18 / MAX: 19.36 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 2K 4K 6K 8K 10K SE +/- 4.52, N = 3 SE +/- 7.17, N = 3 SE +/- 9.37, N = 3 SE +/- 4.97, N = 3 SE +/- 4.05, N = 3 SE +/- 3.66, N = 3 SE +/- 8.98, N = 3 SE +/- 3.37, N = 3 3606.12 3802.61 4093.73 5725.03 7127.28 7689.32 7862.58 10934.17 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 9.79 7.97 7.76 7.72 7.32 7.13 6.95 6.72 MIN: 4.37 / MAX: 18.18 MIN: 7.04 / MAX: 21.51 MIN: 6.86 / MAX: 12.92 MIN: 7.16 / MAX: 18.31 MIN: 6.78 / MAX: 18.72 MIN: 6.64 / MAX: 12.22 MIN: 6.28 / MAX: 20.42 MIN: 6.22 / MAX: 11.15 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 4K 8K 12K 16K 20K SE +/- 3.97, N = 3 SE +/- 3.72, N = 3 SE +/- 0.46, N = 3 SE +/- 5.57, N = 3 SE +/- 3.67, N = 3 SE +/- 7.22, N = 3 SE +/- 4.14, N = 3 SE +/- 7.74, N = 3 5943.66 6717.65 7207.74 9515.86 13102.28 14033.94 15519.92 18375.63 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Platinum 8592+ 15 30 45 60 75 SE +/- 0.03, N = 3 SE +/- 0.21, N = 3 SE +/- 0.06, N = 3 SE +/- 0.28, N = 3 SE +/- 0.05, N = 3 SE +/- 0.14, N = 3 SE +/- 0.15, N = 3 SE +/- 0.02, N = 3 65.02 62.53 62.11 57.13 56.71 55.99 55.74 55.07 MIN: 55.15 / MAX: 104.43 MIN: 48.23 / MAX: 78.43 MIN: 47.82 / MAX: 101.26 MIN: 39.58 / MAX: 104.91 MIN: 45.43 / MAX: 89.46 MIN: 27.63 / MAX: 76.45 MIN: 44.83 / MAX: 69.99 MIN: 46.78 / MAX: 80.73 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 500 1000 1500 2000 2500 SE +/- 2.29, N = 3 SE +/- 2.94, N = 3 SE +/- 2.65, N = 3 SE +/- 0.47, N = 3 SE +/- 1.56, N = 3 SE +/- 1.74, N = 3 SE +/- 0.66, N = 3 SE +/- 11.53, N = 3 860.64 894.87 1068.43 1159.66 1691.79 1801.89 1843.61 2237.69 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
QuantLib Configuration: Multi-Threaded OpenBenchmarking.org MFLOPS, More Is Better QuantLib 1.32 Configuration: Multi-Threaded Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 80K 160K 240K 320K 400K SE +/- 155.19, N = 3 SE +/- 40.48, N = 3 SE +/- 105.60, N = 3 SE +/- 63.14, N = 3 SE +/- 286.86, N = 3 SE +/- 160.59, N = 3 SE +/- 362.38, N = 3 SE +/- 248.00, N = 3 143755.3 162727.4 179647.5 195648.8 288129.1 316359.2 350187.5 380867.5 1. (CXX) g++ options: -O3 -march=native -fPIE -pie
ONNX Runtime Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 8 16 24 32 40 SE +/- 0.40, N = 3 SE +/- 0.33, N = 3 SE +/- 0.31, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 36.23 36.00 33.99 33.33 29.75 29.41 29.02 28.85 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 8 16 24 32 40 SE +/- 0.31, N = 3 SE +/- 0.26, N = 3 SE +/- 0.27, N = 3 SE +/- 0.09, N = 3 SE +/- 0.13, N = 3 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 SE +/- 0.11, N = 3 27.61 27.78 29.43 30.00 33.61 34.00 34.46 34.66 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8592+ 9 18 27 36 45 SE +/- 0.32, N = 3 SE +/- 0.55, N = 3 SE +/- 0.08, N = 3 SE +/- 0.13, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 40.52 40.45 35.11 35.07 33.29 31.53 30.92 29.96 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8592+ 8 16 24 32 40 SE +/- 0.19, N = 3 SE +/- 0.34, N = 3 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 24.68 24.73 28.48 28.52 30.04 31.71 32.34 33.38 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
JPEG-XL libjxl Input: JPEG - Quality: 90 OpenBenchmarking.org MP/s, More Is Better JPEG-XL libjxl 0.10.1 Input: JPEG - Quality: 90 Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ 11 22 33 44 55 SE +/- 0.36, N = 5 SE +/- 0.34, N = 8 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.67, N = 12 SE +/- 0.35, N = 3 SE +/- 0.21, N = 3 SE +/- 0.53, N = 15 34.63 39.10 39.59 42.04 42.97 43.20 43.63 48.36 1. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Platinum 8592+ 20 40 60 80 100 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.10, N = 3 SE +/- 0.18, N = 3 SE +/- 0.09, N = 3 100.39 64.91 59.69 45.78 43.41 42.16 41.93 39.62 MIN: 41.76 / MAX: 139.86 MIN: 49.88 / MAX: 107.03 MIN: 42.86 / MAX: 84.25 MIN: 33.94 / MAX: 85.21 MIN: 27.3 / MAX: 82.85 MIN: 32.47 / MAX: 70.84 MIN: 27.14 / MAX: 54.05 MIN: 26.71 / MAX: 62.24 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 160 320 480 640 800 SE +/- 1.23, N = 3 SE +/- 0.04, N = 3 SE +/- 0.52, N = 3 SE +/- 0.95, N = 3 SE +/- 1.28, N = 3 SE +/- 0.55, N = 3 SE +/- 0.69, N = 3 SE +/- 1.42, N = 3 285.95 298.56 301.30 403.20 568.81 569.60 654.84 736.23 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Parallel Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 2 4 6 8 10 SE +/- 0.08283, N = 3 SE +/- 0.01417, N = 3 SE +/- 0.03717, N = 3 SE +/- 0.07483, N = 3 SE +/- 0.02823, N = 3 SE +/- 0.01428, N = 3 SE +/- 0.02114, N = 3 SE +/- 0.00434, N = 3 7.34848 7.30822 6.90619 5.29027 5.22781 5.21520 5.10948 4.01687 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Parallel Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 50 100 150 200 250 SE +/- 1.53, N = 3 SE +/- 0.26, N = 3 SE +/- 0.78, N = 3 SE +/- 2.63, N = 3 SE +/- 1.04, N = 3 SE +/- 0.53, N = 3 SE +/- 0.81, N = 3 SE +/- 0.27, N = 3 135.98 136.69 144.64 188.93 191.11 191.56 195.45 248.68 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 14 28 42 56 70 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.34, N = 3 SE +/- 0.16, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 62.46 41.57 38.50 37.58 29.98 28.73 28.17 26.85 MIN: 46.12 / MAX: 79.06 MIN: 28.11 / MAX: 155.06 MIN: 25.18 / MAX: 161.13 MIN: 20.58 / MAX: 347.67 MIN: 20.48 / MAX: 222.7 MIN: 19.52 / MAX: 209.26 MIN: 20.12 / MAX: 261.31 MIN: 20.18 / MAX: 307.38 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 200 400 600 800 1000 SE +/- 1.21, N = 3 SE +/- 4.09, N = 3 SE +/- 0.17, N = 3 SE +/- 0.54, N = 3 SE +/- 3.48, N = 3 SE +/- 1.99, N = 3 SE +/- 1.13, N = 3 SE +/- 0.85, N = 3 415.96 467.08 477.77 592.20 793.64 795.63 889.18 1128.78 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Node.js V8 Web Tooling Benchmark OpenBenchmarking.org runs/s, More Is Better Node.js V8 Web Tooling Benchmark Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 4 8 12 16 20 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.11, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 14.51 14.99 15.49 15.59 15.62 15.76 17.02 17.42
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 5 10 15 20 25 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 21.73 20.24 19.44 17.84 17.19 16.33 14.67 13.73 MIN: 15.08 / MAX: 39.82 MIN: 13.69 / MAX: 36.9 MIN: 15.1 / MAX: 32.19 MIN: 9.08 / MAX: 37.11 MIN: 13.16 / MAX: 42.02 MIN: 13.49 / MAX: 26.98 MIN: 12.73 / MAX: 41.28 MIN: 12.23 / MAX: 23.01 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P 2K 4K 6K 8K 10K SE +/- 5.68, N = 3 SE +/- 8.09, N = 3 SE +/- 0.81, N = 3 SE +/- 0.73, N = 3 SE +/- 11.51, N = 3 SE +/- 8.70, N = 3 SE +/- 4.11, N = 3 SE +/- 6.25, N = 3 2877.32 2935.47 3325.90 4656.92 5483.81 5525.56 5576.86 8719.37 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Parallel Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 20 40 60 80 100 SE +/- 0.13, N = 3 SE +/- 0.09, N = 3 SE +/- 0.74, N = 3 SE +/- 0.57, N = 3 SE +/- 0.22, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.30, N = 3 79.38 78.40 76.42 70.44 61.83 61.01 55.12 47.90 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Parallel Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 5 10 15 20 25 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.13, N = 3 12.60 12.75 13.09 14.20 16.17 16.39 18.14 20.88 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Parallel Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 Xeon Platinum 8592+ 16 32 48 64 80 SE +/- 0.23, N = 3 SE +/- 0.50, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.31, N = 3 SE +/- 0.18, N = 3 SE +/- 0.23, N = 3 SE +/- 0.57, N = 3 73.97 72.80 68.83 64.79 63.54 62.13 61.25 50.83 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Parallel Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 Xeon Platinum 8592+ 5 10 15 20 25 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.22, N = 3 13.52 13.74 14.53 15.43 15.74 16.10 16.33 19.68 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 6.43 6.02 5.77 5.72 5.55 5.27 5.19 5.18 MIN: 3.84 / MAX: 15.83 MIN: 5.37 / MAX: 27.77 MIN: 5.26 / MAX: 13.86 MIN: 5.1 / MAX: 17.93 MIN: 5.12 / MAX: 24.99 MIN: 4.98 / MAX: 13.16 MIN: 4.72 / MAX: 11.02 MIN: 4.74 / MAX: 26.35 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 5K 10K 15K 20K 25K SE +/- 5.45, N = 3 SE +/- 18.13, N = 3 SE +/- 7.39, N = 3 SE +/- 4.30, N = 3 SE +/- 12.64, N = 3 SE +/- 3.89, N = 3 SE +/- 12.64, N = 3 SE +/- 17.69, N = 3 9004.23 9087.12 9686.39 12317.94 17252.27 18561.91 20937.58 24676.86 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 8 16 24 32 40 SE +/- 0.11, N = 3 SE +/- 0.13, N = 3 SE +/- 0.28, N = 3 SE +/- 0.11, N = 3 SE +/- 0.17, N = 3 SE +/- 0.12, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 34.31 34.25 31.79 30.47 24.55 23.66 21.34 16.55 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 14 28 42 56 70 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 SE +/- 0.27, N = 3 SE +/- 0.12, N = 3 SE +/- 0.28, N = 3 SE +/- 0.21, N = 3 SE +/- 0.10, N = 3 SE +/- 0.27, N = 3 29.15 29.20 31.46 32.81 40.73 42.27 46.85 60.41 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 8 16 24 32 40 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 36.20 25.72 25.12 24.94 24.00 23.12 22.96 21.87 MIN: 20.73 / MAX: 45.28 MIN: 20.7 / MAX: 44.98 MIN: 19.86 / MAX: 59.96 MIN: 19.75 / MAX: 33.18 MIN: 19.19 / MAX: 45.88 MIN: 18.74 / MAX: 31.08 MIN: 20.8 / MAX: 34.86 MIN: 20.16 / MAX: 32.36 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 1200 2400 3600 4800 6000 SE +/- 1.46, N = 3 SE +/- 3.41, N = 3 SE +/- 4.55, N = 3 SE +/- 0.73, N = 3 SE +/- 1.09, N = 3 SE +/- 2.81, N = 3 SE +/- 2.46, N = 3 SE +/- 3.43, N = 3 1643.43 2074.30 2243.84 2924.66 3998.02 4351.59 4744.05 5570.63 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
GraphicsMagick Operation: Sharpen OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Sharpen Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 60 120 180 240 300 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 1.20, N = 3 SE +/- 0.33, N = 3 SE +/- 1.67, N = 3 SE +/- 1.67, N = 3 114 130 157 167 199 227 265 284 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
GraphicsMagick Operation: Noise-Gaussian OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Noise-Gaussian Xeon Max 9468 Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 40 80 120 160 200 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 1.15, N = 3 SE +/- 0.88, N = 3 150 150 158 158 164 171 182 194 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
GraphicsMagick Operation: Resizing OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Resizing Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 50 100 150 200 250 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 95 96 97 108 213 229 230 245 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
ONNX Runtime Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 2 4 6 8 10 SE +/- 0.03080, N = 3 SE +/- 0.06875, N = 3 SE +/- 0.02968, N = 3 SE +/- 0.01680, N = 3 SE +/- 0.03023, N = 3 SE +/- 0.02630, N = 3 SE +/- 0.00544, N = 3 SE +/- 0.01698, N = 3 6.51744 6.49693 6.39031 6.00525 3.32030 3.23780 3.19298 3.13366 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 70 140 210 280 350 SE +/- 0.73, N = 3 SE +/- 1.63, N = 3 SE +/- 0.73, N = 3 SE +/- 0.47, N = 3 SE +/- 2.72, N = 3 SE +/- 2.50, N = 3 SE +/- 0.53, N = 3 SE +/- 1.74, N = 3 153.41 153.92 156.46 166.49 301.14 308.80 313.10 319.04 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
GraphicsMagick Operation: HWB Color Space OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: HWB Color Space Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9468 60 120 180 240 300 SE +/- 1.20, N = 3 SE +/- 2.40, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 0.67, N = 3 SE +/- 1.00, N = 3 193 207 236 256 265 277 285 286 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
GraphicsMagick Operation: Enhanced OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Enhanced Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 80 160 240 320 400 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 2.60, N = 3 SE +/- 1.00, N = 3 SE +/- 0.33, N = 3 SE +/- 1.15, N = 3 160 181 216 228 269 301 342 374 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Parallel Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 1.3244 2.6488 3.9732 5.2976 6.622 SE +/- 0.02155, N = 3 SE +/- 0.03854, N = 3 SE +/- 0.02062, N = 3 SE +/- 0.01694, N = 3 SE +/- 0.02534, N = 3 SE +/- 0.05586, N = 3 SE +/- 0.02988, N = 3 SE +/- 0.03569, N = 3 5.88628 5.74921 5.29287 5.26075 5.10914 4.86604 4.65431 4.26352 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Parallel Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 50 100 150 200 250 SE +/- 0.62, N = 3 SE +/- 1.17, N = 3 SE +/- 0.74, N = 3 SE +/- 0.61, N = 3 SE +/- 0.98, N = 3 SE +/- 2.34, N = 3 SE +/- 1.38, N = 3 SE +/- 1.98, N = 3 169.85 173.91 188.89 190.06 195.71 205.53 214.81 234.54 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
GraphicsMagick Operation: Swirl OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Swirl Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 150 300 450 600 750 SE +/- 0.58, N = 3 SE +/- 0.67, N = 3 SE +/- 1.15, N = 3 SE +/- 1.33, N = 3 SE +/- 0.88, N = 3 SE +/- 0.67, N = 3 SE +/- 1.76, N = 3 SE +/- 0.58, N = 3 394 432 502 509 529 558 617 689 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Random Read Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 120M 240M 360M 480M 600M SE +/- 81327.78, N = 3 SE +/- 86315.43, N = 3 SE +/- 3338569.32, N = 3 SE +/- 1119855.47, N = 3 SE +/- 1120857.00, N = 3 SE +/- 785893.13, N = 3 SE +/- 1411218.60, N = 3 SE +/- 82996.27, N = 3 205346154 234469939 265366170 297517946 405533173 473755946 525049998 578392800 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Blender Blend File: Classroom - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Classroom - Compute: CPU-Only Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 20 40 60 80 100 SE +/- 0.20, N = 3 SE +/- 0.40, N = 3 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 SE +/- 0.38, N = 3 SE +/- 0.25, N = 3 SE +/- 0.05, N = 3 SE +/- 0.22, N = 3 86.67 76.87 68.61 63.61 44.71 40.38 35.91 33.61
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 14 28 42 56 70 SE +/- 0.49, N = 3 SE +/- 0.45, N = 3 SE +/- 0.29, N = 3 SE +/- 0.52, N = 3 SE +/- 0.62, N = 3 SE +/- 0.76, N = 3 SE +/- 0.52, N = 3 SE +/- 0.64, N = 3 37.44 37.91 41.45 41.68 51.56 52.97 54.84 63.60 MIN: 26.88 / MAX: 41.26 MIN: 16.15 / MAX: 40.53 MIN: 38.42 / MAX: 42.93 MIN: 37.38 / MAX: 44.02 MIN: 30.49 / MAX: 54.7 MIN: 33.28 / MAX: 55.78 MIN: 46.5 / MAX: 58.5 MIN: 37.79 / MAX: 65.67
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 14 28 42 56 70 SE +/- 0.50, N = 3 SE +/- 0.46, N = 4 SE +/- 0.12, N = 3 SE +/- 0.51, N = 3 SE +/- 0.62, N = 3 SE +/- 0.71, N = 3 SE +/- 0.24, N = 3 SE +/- 0.12, N = 3 37.08 38.30 40.77 42.35 51.35 51.55 56.01 63.06 MIN: 26.46 / MAX: 40.15 MIN: 27.11 / MAX: 40.39 MIN: 16.88 / MAX: 42.06 MIN: 36.76 / MAX: 44.4 MIN: 41.6 / MAX: 53.81 MIN: 37.49 / MAX: 54.33 MIN: 51.84 / MAX: 59.12 MIN: 33.2 / MAX: 65.54
CloverLeaf Input: clover_bm64_short OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm64_short Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 10 20 30 40 50 SE +/- 0.17, N = 3 SE +/- 0.15, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.40, N = 4 SE +/- 0.31, N = 15 SE +/- 0.45, N = 3 SE +/- 0.24, N = 3 42.22 41.43 39.48 39.38 32.44 32.25 31.90 26.58 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
Llamafile Test: llava-v1.5-7b-q4 - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.7 Test: llava-v1.5-7b-q4 - Acceleration: CPU Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8490H 5 10 15 20 25 SE +/- 0.04, N = 3 SE +/- 1.08, N = 12 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.09, N = 15 SE +/- 0.17, N = 4 SE +/- 0.15, N = 4 7.26 7.49 7.67 7.77 8.13 10.44 16.61 20.95
srsRAN Project Test: PDSCH Processor Benchmark, Throughput Total OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Total Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P 7K 14K 21K 28K 35K SE +/- 490.54, N = 15 SE +/- 281.72, N = 15 SE +/- 938.95, N = 15 SE +/- 236.27, N = 4 SE +/- 298.34, N = 15 SE +/- 312.17, N = 3 SE +/- 175.78, N = 4 SE +/- 356.81, N = 15 11866.7 15081.0 21286.6 24688.5 26378.1 30108.7 30236.0 30547.6 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl
RawTherapee Total Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better RawTherapee Total Benchmark Time Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 13 26 39 52 65 SE +/- 0.19, N = 3 SE +/- 0.10, N = 3 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.17, N = 3 SE +/- 0.04, N = 3 56.78 55.44 53.76 52.69 47.09 46.96 46.76 42.78 1. RawTherapee, version 5.10, command line.
GPAW Input: Carbon Nanotube OpenBenchmarking.org Seconds, Fewer Is Better GPAW 23.6 Input: Carbon Nanotube Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 12 24 36 48 60 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.24, N = 3 SE +/- 0.27, N = 3 SE +/- 0.12, N = 3 SE +/- 0.08, N = 3 SE +/- 0.55, N = 3 SE +/- 0.10, N = 3 54.38 48.49 47.78 43.91 43.05 42.87 41.56 38.05 1. (CC) gcc options: -shared -lxc -lblas -lmpi
VVenC Video Input: Bosphorus 4K - Video Preset: Faster OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Faster Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 4 8 12 16 20 SE +/- 0.11, N = 3 SE +/- 0.13, N = 3 SE +/- 0.16, N = 3 SE +/- 0.12, N = 3 SE +/- 0.05, N = 3 SE +/- 0.13, N = 3 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 11.90 11.97 12.54 13.26 14.10 14.36 15.06 15.97 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
Coremark CoreMark Size 666 - Iterations Per Second OpenBenchmarking.org Iterations/Sec, More Is Better Coremark 1.0 CoreMark Size 666 - Iterations Per Second Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 1.1M 2.2M 3.3M 4.4M 5.5M SE +/- 1747.99, N = 3 SE +/- 5202.86, N = 3 SE +/- 9256.47, N = 3 SE +/- 4635.95, N = 3 SE +/- 7219.73, N = 3 SE +/- 20649.43, N = 3 SE +/- 12743.41, N = 3 SE +/- 9700.21, N = 3 1614763.70 1855135.33 2194630.60 2369998.36 2993136.60 3279262.53 3902076.24 4966250.78 1. (CC) gcc options: -O2 -lrt" -lrt
miniFE Problem Size: Small OpenBenchmarking.org CG Mflops, More Is Better miniFE 2.2 Problem Size: Small Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 10K 20K 30K 40K 50K SE +/- 572.00, N = 12 SE +/- 1097.75, N = 15 SE +/- 601.03, N = 12 SE +/- 283.44, N = 3 SE +/- 135.77, N = 4 SE +/- 11.14, N = 4 SE +/- 1633.92, N = 15 SE +/- 467.78, N = 4 18621.2 19876.5 20091.1 21583.2 31830.2 35230.1 42114.6 46877.5 1. (CXX) g++ options: -O3 -fopenmp -lmpi_cxx -lmpi
Timed PHP Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed PHP Compilation 8.3.4 Time To Compile Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 11 22 33 44 55 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.16, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.31, N = 3 SE +/- 0.09, N = 3 48.71 48.01 47.95 46.87 46.64 46.57 41.85 40.38
John The Ripper Test: WPA PSK OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: WPA PSK Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 200K 400K 600K 800K 1000K SE +/- 987.33, N = 3 SE +/- 1274.00, N = 3 SE +/- 1599.31, N = 3 SE +/- 864.17, N = 3 SE +/- 5122.51, N = 3 SE +/- 788.50, N = 3 SE +/- 2519.00, N = 3 SE +/- 15579.94, N = 15 286552 334076 401278 428116 562875 657889 793253 797093 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 120K 240K 360K 480K 600K SE +/- 916.22, N = 3 SE +/- 374.59, N = 3 SE +/- 61.74, N = 3 SE +/- 119.21, N = 3 SE +/- 2598.93, N = 3 SE +/- 6276.88, N = 3 SE +/- 185.14, N = 3 SE +/- 28320.74, N = 3 207738 243347 287862 338146 401707 469131 557054 573410 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
7-Zip Compression Test: Compression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Compression Rating Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 140K 280K 420K 560K 700K SE +/- 1836.55, N = 3 SE +/- 2258.81, N = 3 SE +/- 1535.53, N = 3 SE +/- 1982.97, N = 3 SE +/- 5127.15, N = 3 SE +/- 3924.87, N = 3 SE +/- 4200.62, N = 3 SE +/- 709.87, N = 3 314716 342363 388190 441636 491729 525514 592729 674239 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
LuxCoreRender Scene: Rainbow Colors and Prism - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Rainbow Colors and Prism - Acceleration: CPU Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 4 8 12 16 20 SE +/- 0.10, N = 15 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 15 SE +/- 0.12, N = 7 SE +/- 0.06, N = 4 SE +/- 0.05, N = 4 SE +/- 0.15, N = 4 5.96 6.51 7.22 9.64 12.80 12.97 13.54 14.28 MIN: 5.5 / MAX: 7.04 MIN: 6.27 / MAX: 6.67 MIN: 7.13 / MAX: 7.4 MIN: 8.98 / MAX: 10.13 MIN: 11.39 / MAX: 13.21 MIN: 12.11 / MAX: 13.11 MIN: 13.42 / MAX: 13.68 MIN: 12.85 / MAX: 14.54
Liquid-DSP Threads: 1 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 4M 8M 12M 16M 20M SE +/- 38670.98, N = 3 SE +/- 8685.88, N = 3 SE +/- 7571.88, N = 3 SE +/- 30179.10, N = 3 SE +/- 17457.89, N = 3 SE +/- 5238.74, N = 3 SE +/- 162096.41, N = 15 SE +/- 9492.69, N = 3 16843333 16882333 16884000 16885333 16904667 16906333 18200533 18774333 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: defconfig Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 10 20 30 40 50 SE +/- 0.59, N = 3 SE +/- 0.57, N = 3 SE +/- 0.55, N = 3 SE +/- 0.39, N = 4 SE +/- 0.40, N = 4 SE +/- 0.31, N = 5 SE +/- 0.43, N = 3 SE +/- 0.23, N = 7 43.42 40.50 39.45 34.59 32.14 30.53 29.98 25.87
WebP Image Encode Encode Settings: Quality 100, Lossless, Highest Compression OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Lossless, Highest Compression Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 0.135 0.27 0.405 0.54 0.675 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.51 0.52 0.54 0.54 0.55 0.55 0.59 0.60 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
TensorFlow Device: CPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: AlexNet Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 400 800 1200 1600 2000 SE +/- 3.89, N = 3 SE +/- 5.13, N = 3 SE +/- 0.51, N = 3 SE +/- 1.84, N = 3 SE +/- 17.88, N = 4 SE +/- 8.55, N = 3 SE +/- 18.52, N = 3 SE +/- 19.23, N = 3 1047.96 1108.95 1278.45 1486.12 1604.11 1677.62 1899.64 2039.63
JPEG-XL libjxl Input: PNG - Quality: 90 OpenBenchmarking.org MP/s, More Is Better JPEG-XL libjxl 0.10.1 Input: PNG - Quality: 90 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 Xeon Platinum 8592+ 11 22 33 44 55 SE +/- 0.32, N = 3 SE +/- 0.05, N = 3 SE +/- 0.50, N = 3 SE +/- 0.12, N = 3 SE +/- 0.04, N = 3 SE +/- 0.17, N = 3 SE +/- 0.04, N = 3 SE +/- 0.49, N = 14 33.27 34.83 39.52 40.08 40.35 42.91 43.36 46.32 1. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm
Primesieve Length: 1e13 OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e13 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 15 30 45 60 75 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 67.32 58.16 51.82 48.41 33.92 30.20 27.11 25.02 1. (CXX) g++ options: -O3
Graph500 Scale: 26 OpenBenchmarking.org sssp median_TEPS, More Is Better Graph500 3.0 Scale: 26 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 100M 200M 300M 400M 500M 416523000 484977000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org sssp max_TEPS, More Is Better Graph500 3.0 Scale: 26 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 140M 280M 420M 560M 700M 539613000 667365000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org bfs median_TEPS, More Is Better Graph500 3.0 Scale: 26 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 300M 600M 900M 1200M 1500M 1204520000 1244300000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org bfs max_TEPS, More Is Better Graph500 3.0 Scale: 26 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 300M 600M 900M 1200M 1500M 1267480000 1299170000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Liquid-DSP Threads: 1 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 57 Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 16M 32M 48M 64M 80M SE +/- 822374.71, N = 4 SE +/- 3844.19, N = 3 SE +/- 4163.33, N = 3 SE +/- 666.67, N = 3 SE +/- 5364.49, N = 3 SE +/- 4910.31, N = 3 SE +/- 68119.99, N = 3 SE +/- 599433.09, N = 9 66266000 66991333 67064000 67074667 67127667 67130333 70499000 73140667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
srsRAN Project Test: PUSCH Processor Benchmark, Throughput Total OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PUSCH Processor Benchmark, Throughput Total Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 1200 2400 3600 4800 6000 SE +/- 0.09, N = 3 SE +/- 18.30, N = 3 SE +/- 18.43, N = 3 SE +/- 18.09, N = 3 SE +/- 26.47, N = 3 SE +/- 0.15, N = 3 SE +/- 47.68, N = 6 SE +/- 0.12, N = 3 2170.7 2514.0 2616.9 3088.7 3787.0 4386.6 4853.6 5493.4 MIN: 1388.2 / MAX: 2170.8 MIN: 1550.4 / MAX: 2532.5 MIN: 1591.7 / MAX: 2653.8 MIN: 1852.6 / MAX: 3124.9 MIN: 2545.7 / MAX: 3839.9 MIN: 2970.2 / MAX: 4386.9 MIN: 3181.8 / MAX: 4929.4 MIN: 3703.4 / MAX: 5493.6 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl
libavif avifenc Encoder Speed: 2 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 2 Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 9 18 27 36 45 SE +/- 0.21, N = 3 SE +/- 0.31, N = 3 SE +/- 0.22, N = 3 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 41.13 39.88 38.65 38.14 37.75 37.31 34.79 33.65 1. (CXX) g++ options: -O3 -fPIC -lm
ASKAP Test: tConvolve MPI - Gridding OpenBenchmarking.org Mpix/sec, More Is Better ASKAP 1.0 Test: tConvolve MPI - Gridding Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 15K 30K 45K 60K 75K SE +/- 76.67, N = 3 SE +/- 99.83, N = 3 SE +/- 0.00, N = 3 SE +/- 219.20, N = 3 SE +/- 412.68, N = 4 SE +/- 194.30, N = 3 SE +/- 802.88, N = 3 SE +/- 1080.03, N = 3 21314.2 21766.5 23250.2 37265.9 41773.0 42939.2 45195.1 72004.0 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
ASKAP Test: tConvolve MPI - Degridding OpenBenchmarking.org Mpix/sec, More Is Better ASKAP 1.0 Test: tConvolve MPI - Degridding Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 13K 26K 39K 52K 65K SE +/- 93.91, N = 3 SE +/- 0.00, N = 3 SE +/- 76.47, N = 3 SE +/- 153.57, N = 3 SE +/- 378.22, N = 4 SE +/- 143.60, N = 3 SE +/- 0.00, N = 3 SE +/- 480.95, N = 3 17891.6 18522.0 20561.4 31177.2 34614.1 36900.5 40368.6 59139.2 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenRadioss Model: Cell Phone Drop Test OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Cell Phone Drop Test Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P 8 16 24 32 40 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 SE +/- 0.18, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.32, N = 3 33.75 31.92 31.49 28.22 27.90 27.63 27.51 26.88
Liquid-DSP Threads: 64 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 512 Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 200M 400M 600M 800M 1000M SE +/- 1611276.24, N = 3 SE +/- 1289603.73, N = 3 SE +/- 4432294.36, N = 3 SE +/- 940265.92, N = 3 SE +/- 6141471.96, N = 3 SE +/- 1515552.70, N = 3 SE +/- 3717554.45, N = 3 SE +/- 7562646.32, N = 8 632396667 689003333 732560000 744410000 757176667 783770000 799496667 883701250 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 1 - Buffer Length: 256 - Filter Length: 32 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 9M 18M 27M 36M 45M SE +/- 1154.70, N = 3 SE +/- 1201.85, N = 3 SE +/- 1527.53, N = 3 SE +/- 1452.97, N = 3 SE +/- 1666.67, N = 3 SE +/- 3000.00, N = 3 SE +/- 419600.12, N = 5 SE +/- 417042.80, N = 5 36461000 36497667 36506000 36521333 36537667 36539000 38950600 40244000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Timed Wasmer Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Wasmer Compilation 2.3 Time To Compile Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 8 16 24 32 40 SE +/- 0.12, N = 3 SE +/- 0.17, N = 3 SE +/- 0.16, N = 3 SE +/- 0.11, N = 3 SE +/- 0.16, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 36.20 35.70 35.66 35.46 35.20 34.93 30.47 30.17 1. (CC) gcc options: -m64 -ldl -lgcc_s -lutil -lrt -lpthread -lm -lc -pie -nodefaultlibs
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 20 40 60 80 100 SE +/- 0.44, N = 3 SE +/- 0.49, N = 3 SE +/- 0.52, N = 3 SE +/- 0.38, N = 8 SE +/- 0.36, N = 3 SE +/- 0.28, N = 3 SE +/- 0.03, N = 3 SE +/- 0.16, N = 3 35.46 35.53 45.69 46.49 48.59 50.99 51.46 77.52 MIN: 0.7 / MAX: 41 MIN: 16.36 / MAX: 38.41 MIN: 13.24 / MAX: 48.92 MIN: 15.6 / MAX: 50.65 MIN: 4.58 / MAX: 55.2 MIN: 11.73 / MAX: 59.01 MIN: 35.78 / MAX: 55.29 MIN: 36.51 / MAX: 79.65
Appleseed Scene: Disney Material OpenBenchmarking.org Seconds, Fewer Is Better Appleseed 2.0 Beta Scene: Disney Material Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 13 26 39 52 65 58.38 56.40 53.49 51.25 49.14 48.56 48.43 43.70
ASTC Encoder Preset: Very Thorough OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Very Thorough Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 4 8 12 16 20 SE +/- 0.0016, N = 3 SE +/- 0.0016, N = 3 SE +/- 0.0054, N = 3 SE +/- 0.0294, N = 3 SE +/- 0.0055, N = 3 SE +/- 0.0022, N = 3 SE +/- 0.0379, N = 3 SE +/- 0.0007, N = 3 5.1342 5.9702 7.0885 7.6240 10.2051 11.8875 13.7518 14.6334 1. (CXX) g++ options: -O3 -flto -pthread
Liquid-DSP Threads: 64 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 57 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 600M 1200M 1800M 2400M 3000M SE +/- 2629533.12, N = 3 SE +/- 5493127.02, N = 3 SE +/- 11426868.92, N = 3 SE +/- 27382304.50, N = 5 SE +/- 28812627.44, N = 4 SE +/- 7076957.92, N = 3 SE +/- 32405829.38, N = 3 SE +/- 28500058.48, N = 3 2138766667 2308966667 2475500000 2491340000 2494050000 2539200000 2620066667 2655500000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
uvg266 Video Input: Bosphorus 4K - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 6 12 18 24 30 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 13.36 13.89 15.71 16.06 19.75 22.14 24.71 27.11
ASTC Encoder Preset: Exhaustive OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Exhaustive Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 2 4 6 8 10 SE +/- 0.0003, N = 3 SE +/- 0.0011, N = 3 SE +/- 0.0024, N = 3 SE +/- 0.0072, N = 3 SE +/- 0.0033, N = 3 SE +/- 0.0016, N = 3 SE +/- 0.0164, N = 3 SE +/- 0.0157, N = 3 3.1204 3.6276 4.2689 4.6303 6.2126 7.2075 8.3701 8.9091 1. (CXX) g++ options: -O3 -flto -pthread
Liquid-DSP Threads: 128 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 512 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Platinum 8592+ 2P 300M 600M 900M 1200M 1500M SE +/- 681281.47, N = 3 SE +/- 1345523.44, N = 3 SE +/- 1740596.96, N = 3 SE +/- 11560043.25, N = 5 SE +/- 6842108.19, N = 3 SE +/- 2313246.88, N = 3 SE +/- 2123152.79, N = 3 SE +/- 4790383.89, N = 3 800186667 882200000 918566667 1091460000 1126466667 1152933333 1206066667 1493833333 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 4K Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 40 80 120 160 200 SE +/- 1.63, N = 15 SE +/- 1.67, N = 15 SE +/- 1.44, N = 15 SE +/- 1.62, N = 15 SE +/- 2.18, N = 15 SE +/- 2.31, N = 15 SE +/- 2.84, N = 15 SE +/- 2.83, N = 15 122.62 124.26 144.70 150.00 154.50 162.47 162.98 174.83 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
QuantLib Configuration: Single-Threaded OpenBenchmarking.org MFLOPS, More Is Better QuantLib 1.32 Configuration: Single-Threaded Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 800 1600 2400 3200 4000 SE +/- 28.11, N = 3 SE +/- 28.42, N = 3 SE +/- 25.40, N = 3 SE +/- 28.57, N = 3 SE +/- 22.17, N = 3 SE +/- 25.35, N = 3 SE +/- 30.36, N = 12 SE +/- 33.58, N = 3 3207.0 3209.6 3210.1 3222.8 3225.7 3229.1 3586.3 3600.5 1. (CXX) g++ options: -O3 -march=native -fPIE -pie
Liquid-DSP Threads: 128 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 57 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 1000M 2000M 3000M 4000M 5000M SE +/- 2030052.00, N = 3 SE +/- 3119294.79, N = 3 SE +/- 3116800.35, N = 3 SE +/- 5260228.13, N = 3 SE +/- 25888414.40, N = 3 SE +/- 13655808.69, N = 3 SE +/- 14772609.79, N = 3 SE +/- 51282832.98, N = 4 2670033333 2972400000 3181266667 3503200000 3596400000 3723666667 3896500000 4450525000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
nginx Connections: 1000 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 1000 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 90K 180K 270K 360K 450K SE +/- 125.38, N = 3 SE +/- 576.43, N = 2 SE +/- 142.71, N = 3 367199.06 381352.69 399698.78 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
Liquid-DSP Threads: 256 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 512 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 400M 800M 1200M 1600M 2000M SE +/- 569766.03, N = 3 SE +/- 740202.67, N = 3 SE +/- 1722723.94, N = 3 SE +/- 240370.09, N = 3 SE +/- 4238841.56, N = 3 SE +/- 6728628.72, N = 3 SE +/- 5630373.98, N = 3 SE +/- 14465476.14, N = 3 838530000 944550000 1020833333 1178766667 1444066667 1518933333 1616966667 2027000000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Blender Blend File: Junkshop - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Junkshop - Compute: CPU-Only Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 10 20 30 40 50 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.24, N = 3 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 SE +/- 0.19, N = 3 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 42.85 39.17 35.96 32.08 24.99 23.45 21.15 18.31
NAS Parallel Benchmarks Test / Class: EP.D OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: EP.D Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 3K 6K 9K 12K 15K SE +/- 155.10, N = 12 SE +/- 6.53, N = 3 SE +/- 6.77, N = 3 SE +/- 22.33, N = 3 SE +/- 4.83, N = 4 SE +/- 10.93, N = 4 SE +/- 100.23, N = 4 SE +/- 30.19, N = 4 5366.69 6445.09 7562.80 8089.14 10970.45 12793.01 14946.76 16004.07 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
John The Ripper Test: bcrypt OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: bcrypt Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 40K 80K 120K 160K 200K SE +/- 8.84, N = 3 SE +/- 8.67, N = 3 SE +/- 10.67, N = 3 SE +/- 46.28, N = 3 SE +/- 866.68, N = 3 SE +/- 576.80, N = 3 SE +/- 292.24, N = 3 SE +/- 288.38, N = 3 67875 79144 94551 105781 133866 155959 183603 206778 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: Blowfish Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 40K 80K 120K 160K 200K SE +/- 17.33, N = 3 SE +/- 8.67, N = 3 SE +/- 11.39, N = 3 SE +/- 79.75, N = 3 SE +/- 116.69, N = 3 SE +/- 169.28, N = 3 SE +/- 348.45, N = 3 SE +/- 649.08, N = 3 67893 79152 94513 105831 134562 156658 183583 205499 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
Liquid-DSP Threads: 256 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 57 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 1300M 2600M 3900M 5200M 6500M SE +/- 4088330.28, N = 3 SE +/- 1976810.00, N = 3 SE +/- 5292237.50, N = 3 SE +/- 3555434.03, N = 3 SE +/- 17558125.69, N = 3 SE +/- 28453880.81, N = 3 SE +/- 2331189.49, N = 3 SE +/- 61971606.40, N = 3 2848933333 3222533333 3500833333 3806833333 4825133333 5036000000 5361266667 6284300000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 256 - Buffer Length: 256 - Filter Length: 32 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 32 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 1300M 2600M 3900M 5200M 6500M SE +/- 1320353.49, N = 3 SE +/- 1338323.99, N = 3 SE +/- 2516611.48, N = 3 SE +/- 4021608.30, N = 3 SE +/- 2447674.63, N = 3 SE +/- 895048.11, N = 3 SE +/- 6711433.03, N = 3 SE +/- 10496401.50, N = 3 2381800000 2769066667 3167200000 3243800000 4670966667 5367033333 6077300000 6116566667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
uvg266 Video Input: Bosphorus 4K - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 7 14 21 28 35 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.16, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 15.17 15.68 16.64 17.85 22.25 24.65 27.65 30.37
Liquid-DSP Threads: 128 - Buffer Length: 256 - Filter Length: 32 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 32 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 800M 1600M 2400M 3200M 4000M SE +/- 400000.00, N = 3 SE +/- 1342054.81, N = 3 SE +/- 2236316.42, N = 3 SE +/- 1858314.65, N = 3 SE +/- 4598671.31, N = 3 SE +/- 2403700.85, N = 3 SE +/- 13813198.20, N = 3 SE +/- 26633124.74, N = 3 2351900000 2739633333 3148233333 3200600000 3254033333 3337066667 3520766667 3558600000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Google SynthMark Test: VoiceMark_100 OpenBenchmarking.org Voices, More Is Better Google SynthMark 20201109 Test: VoiceMark_100 Xeon Max 9468 2P Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 200 400 600 800 1000 SE +/- 0.30, N = 3 SE +/- 0.26, N = 3 SE +/- 0.22, N = 3 SE +/- 0.24, N = 3 SE +/- 0.48, N = 3 SE +/- 1.51, N = 3 SE +/- 0.38, N = 3 SE +/- 0.13, N = 3 710.92 711.10 711.38 712.01 712.09 712.70 799.49 799.72 1. (CXX) g++ options: -lm -lpthread -std=c++11 -Ofast
Liquid-DSP Threads: 64 - Buffer Length: 256 - Filter Length: 32 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 32 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 500M 1000M 1500M 2000M 2500M SE +/- 688799.28, N = 3 SE +/- 692820.32, N = 3 SE +/- 3167192.94, N = 3 SE +/- 27191440.65, N = 3 SE +/- 2206304.10, N = 3 SE +/- 3300505.01, N = 3 SE +/- 3017909.50, N = 3 SE +/- 17236814.61, N = 3 1640266667 1679700000 1890566667 1927766667 1963233333 2025000000 2090466667 2154633333 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Blender Blend File: Fishy Cat - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Fishy Cat - Compute: CPU-Only Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 10 20 30 40 50 SE +/- 0.17, N = 3 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.13, N = 3 SE +/- 0.18, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 42.78 38.48 34.83 31.91 23.17 21.45 19.13 17.29
TensorFlow Device: CPU - Batch Size: 1 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: GoogLeNet Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 8 16 24 32 40 SE +/- 0.12, N = 6 SE +/- 0.23, N = 15 SE +/- 0.23, N = 12 SE +/- 0.20, N = 15 SE +/- 0.21, N = 6 SE +/- 0.27, N = 6 SE +/- 0.19, N = 6 SE +/- 0.27, N = 7 12.69 13.50 14.67 18.24 21.67 31.47 33.56 36.13
DaCapo Benchmark Java Test: Apache Lucene Search Index OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Apache Lucene Search Index Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 800 1600 2400 3200 4000 SE +/- 41.09, N = 5 SE +/- 10.84, N = 3 SE +/- 11.79, N = 3 SE +/- 11.86, N = 3 SE +/- 42.24, N = 4 SE +/- 33.41, N = 3 SE +/- 12.44, N = 3 SE +/- 18.19, N = 3 3689 3643 3581 3537 3396 3378 3345 3242
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Obj Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 40 80 120 160 200 SE +/- 0.08, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 0.35, N = 3 SE +/- 0.76, N = 3 SE +/- 0.89, N = 15 SE +/- 0.22, N = 4 SE +/- 0.29, N = 4 64.96 71.83 79.38 97.19 104.84 112.72 132.28 173.22 MIN: 63.12 / MAX: 67.81 MIN: 69.55 / MAX: 76.73 MIN: 76.07 / MAX: 85.98 MIN: 92.96 / MAX: 102.04 MIN: 101.05 / MAX: 112.02 MIN: 102 / MAX: 125.96 MIN: 125 / MAX: 146.52 MIN: 164.07 / MAX: 187.8
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2024 Implementation: MPI CPU - Input: water_GMX50_bare Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 5 10 15 20 25 SE +/- 0.019, N = 3 SE +/- 0.007, N = 3 SE +/- 0.010, N = 3 SE +/- 0.009, N = 3 SE +/- 0.025, N = 3 SE +/- 0.032, N = 3 SE +/- 0.019, N = 3 SE +/- 0.046, N = 3 7.545 8.282 8.762 10.477 13.392 14.127 15.450 18.540 1. (CXX) g++ options: -O3 -lm
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 4 - Input: Bosphorus 4K Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 2 4 6 8 10 SE +/- 0.015, N = 3 SE +/- 0.042, N = 3 SE +/- 0.027, N = 3 SE +/- 0.047, N = 3 SE +/- 0.049, N = 3 SE +/- 0.030, N = 3 SE +/- 0.044, N = 3 SE +/- 0.005, N = 3 5.991 6.052 6.490 6.572 6.698 7.061 7.360 7.876 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
TensorFlow Device: CPU - Batch Size: 64 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: GoogLeNet Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Platinum 8490H 80 160 240 320 400 SE +/- 0.21, N = 3 SE +/- 2.38, N = 3 SE +/- 1.12, N = 3 SE +/- 2.37, N = 3 SE +/- 1.94, N = 3 SE +/- 0.83, N = 3 SE +/- 3.52, N = 5 SE +/- 1.62, N = 3 291.37 308.95 319.76 331.76 333.73 335.58 341.51 380.14
ASKAP Test: tConvolve OpenMP - Degridding OpenBenchmarking.org Million Grid Points Per Second, More Is Better ASKAP 1.0 Test: tConvolve OpenMP - Degridding Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 11K 22K 33K 44K 55K SE +/- 0.00, N = 4 SE +/- 41.81, N = 5 SE +/- 69.31, N = 5 SE +/- 955.08, N = 5 SE +/- 131.12, N = 15 SE +/- 677.85, N = 15 SE +/- 1365.55, N = 15 SE +/- 948.80, N = 15 4437.60 6758.81 7046.56 7304.58 16936.80 30471.50 48686.80 51476.20 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
ASKAP Test: tConvolve OpenMP - Gridding OpenBenchmarking.org Million Grid Points Per Second, More Is Better ASKAP 1.0 Test: tConvolve OpenMP - Gridding Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8592+ 2P 4K 8K 12K 16K 20K SE +/- 13.50, N = 5 SE +/- 40.14, N = 4 SE +/- 13.21, N = 5 SE +/- 33.09, N = 5 SE +/- 139.77, N = 15 SE +/- 211.64, N = 15 SE +/- 195.05, N = 15 SE +/- 221.77, N = 15 3836.73 3916.78 4173.46 4438.58 17010.80 19141.80 19798.50 20204.90 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
Kvazaar Video Input: Bosphorus 4K - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Slow Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 9 18 27 36 45 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 4 17.52 18.24 20.23 24.23 26.00 28.96 31.24 40.92 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Kvazaar Video Input: Bosphorus 4K - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Medium Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 9 18 27 36 45 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.27, N = 4 18.13 18.84 20.97 24.80 26.69 29.62 32.04 41.58 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 8 - Input: Bosphorus 4K Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8592+ 20 40 60 80 100 SE +/- 0.58, N = 5 SE +/- 0.44, N = 15 SE +/- 0.26, N = 4 SE +/- 0.46, N = 4 SE +/- 0.29, N = 4 SE +/- 0.79, N = 5 SE +/- 0.20, N = 5 SE +/- 0.22, N = 5 54.82 55.98 62.75 65.22 65.36 70.43 70.91 79.44 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
uvg266 Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 14 28 42 56 70 SE +/- 0.04, N = 4 SE +/- 0.36, N = 15 SE +/- 0.50, N = 5 SE +/- 0.06, N = 4 SE +/- 0.13, N = 4 SE +/- 0.58, N = 5 SE +/- 0.17, N = 5 SE +/- 0.07, N = 5 39.31 45.79 46.13 48.91 50.09 55.26 57.13 60.87
TensorFlow Device: CPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: AlexNet Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 400 800 1200 1600 2000 SE +/- 1.21, N = 3 SE +/- 6.82, N = 3 SE +/- 0.54, N = 3 SE +/- 4.27, N = 3 SE +/- 1.15, N = 3 SE +/- 5.81, N = 3 SE +/- 1.86, N = 3 SE +/- 5.06, N = 3 986.04 1058.99 1205.30 1277.46 1479.53 1528.41 1681.44 1730.25
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 40 80 120 160 200 SE +/- 0.12, N = 4 SE +/- 0.84, N = 15 SE +/- 0.61, N = 5 SE +/- 0.20, N = 6 SE +/- 1.28, N = 12 SE +/- 1.85, N = 12 SE +/- 0.81, N = 7 SE +/- 1.02, N = 8 63.62 70.84 82.85 106.40 108.40 114.90 133.63 199.73 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 1100 2200 3300 4400 5500 SE +/- 2.91, N = 4 SE +/- 21.10, N = 15 SE +/- 15.23, N = 5 SE +/- 5.07, N = 6 SE +/- 32.01, N = 12 SE +/- 46.19, N = 12 SE +/- 20.15, N = 7 SE +/- 25.44, N = 8 1590.50 1771.07 2071.19 2659.88 2709.93 2872.56 3340.69 4993.34 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
TensorFlow Device: CPU - Batch Size: 1 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: AlexNet Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 13 26 39 52 65 SE +/- 0.45, N = 15 SE +/- 0.52, N = 15 SE +/- 0.66, N = 15 SE +/- 0.44, N = 15 SE +/- 0.57, N = 15 SE +/- 1.22, N = 15 SE +/- 0.76, N = 15 SE +/- 0.08, N = 8 30.76 33.21 35.50 37.57 37.76 43.67 48.28 56.53
Blender Blend File: BMW27 - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: BMW27 - Compute: CPU-Only Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 7 14 21 28 35 SE +/- 0.11, N = 3 SE +/- 0.24, N = 3 SE +/- 0.15, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.08, N = 4 SE +/- 0.08, N = 4 SE +/- 0.03, N = 4 31.66 28.49 25.89 23.72 16.55 15.29 13.74 12.76
Y-Cruncher Pi Digits To Calculate: 1B OpenBenchmarking.org Seconds, Fewer Is Better Y-Cruncher 0.8.3 Pi Digits To Calculate: 1B Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 2 4 6 8 10 SE +/- 0.045, N = 5 SE +/- 0.026, N = 5 SE +/- 0.005, N = 5 SE +/- 0.030, N = 5 SE +/- 0.122, N = 15 SE +/- 0.142, N = 12 SE +/- 0.010, N = 6 SE +/- 0.007, N = 6 8.300 7.959 7.047 6.701 6.334 6.266 5.110 5.008
OpenFOAM Input: drivaerFastback, Small Mesh Size - Execution Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Execution Time Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 10 20 30 40 50 45.95 42.22 41.75 33.07 28.99 28.56 27.58 23.56 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenFOAM Input: drivaerFastback, Small Mesh Size - Mesh Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Mesh Time Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Max 9480 2P 8 16 24 32 40 35.60 32.48 32.00 31.78 31.70 31.38 29.33 28.84 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
NAS Parallel Benchmarks Test / Class: IS.D OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: IS.D Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 1600 3200 4800 6400 8000 SE +/- 6.56, N = 3 SE +/- 15.55, N = 4 SE +/- 18.08, N = 4 SE +/- 12.99, N = 4 SE +/- 4.96, N = 4 SE +/- 23.92, N = 4 SE +/- 8.92, N = 4 SE +/- 155.00, N = 15 2865.72 3050.16 3076.66 3816.70 3819.83 3960.28 4059.70 7437.81 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
Kvazaar Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Super Fast Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 15 30 45 60 75 SE +/- 0.09, N = 4 SE +/- 0.49, N = 5 SE +/- 0.12, N = 5 SE +/- 0.49, N = 15 SE +/- 0.20, N = 5 SE +/- 0.07, N = 5 SE +/- 0.21, N = 5 SE +/- 0.50, N = 5 39.20 52.63 53.13 54.19 54.47 66.74 66.78 69.05 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Algebraic Multi-Grid Benchmark OpenBenchmarking.org Figure Of Merit, More Is Better Algebraic Multi-Grid Benchmark 1.2 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 800M 1600M 2400M 3200M 4000M SE +/- 3359086.30, N = 3 SE +/- 1778769.08, N = 3 SE +/- 468935.32, N = 3 SE +/- 4000850.45, N = 3 SE +/- 2438223.49, N = 3 SE +/- 7233468.75, N = 3 SE +/- 9164253.67, N = 3 SE +/- 9014927.20, N = 3 1588496667 1597993333 1605097000 1814760000 3124402667 3156261667 3205161000 3609646333 1. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi
Xcompact3d Incompact3d Input: input.i3d 193 Cells Per Direction OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 193 Cells Per Direction Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 4 8 12 16 20 SE +/- 0.04445674, N = 4 SE +/- 0.01004100, N = 4 SE +/- 0.01708632, N = 4 SE +/- 0.02923582, N = 4 SE +/- 0.01741826, N = 5 SE +/- 0.05695382, N = 15 SE +/- 0.04312801, N = 5 SE +/- 0.03329814, N = 5 13.96923760 12.92934130 12.79975820 10.19670660 7.29349117 6.66387510 6.39169817 5.39125967 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
Timed FFmpeg Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed FFmpeg Compilation 7.0 Time To Compile Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 6 12 18 24 30 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 26.46 24.84 24.06 21.36 20.79 20.01 19.51 17.39
Intel Open Image Denoise Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 0.54 1.08 1.62 2.16 2.7 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 1.08 1.14 1.29 1.58 1.72 1.74 2.18 2.40
oneDNN Harness: Deconvolution Batch shapes_1d - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Deconvolution Batch shapes_1d - Engine: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 9 18 27 36 45 SE +/- 0.32768, N = 3 SE +/- 0.10023, N = 3 SE +/- 0.09318, N = 3 SE +/- 0.10586, N = 3 SE +/- 0.08324, N = 3 SE +/- 0.00627, N = 3 SE +/- 0.02700, N = 3 SE +/- 0.00876, N = 3 38.08130 16.55070 16.09010 13.45000 6.69692 6.15856 6.09747 5.30953 MIN: 9.76 MIN: 14.58 MIN: 9.89 MIN: 11.97 MIN: 3.74 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
x265 Video Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better x265 3.6 Video Input: Bosphorus 4K Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 9 18 27 36 45 SE +/- 0.12, N = 3 SE +/- 0.10, N = 3 SE +/- 0.08, N = 3 SE +/- 0.39, N = 3 SE +/- 0.20, N = 4 SE +/- 0.11, N = 4 SE +/- 0.06, N = 4 SE +/- 0.09, N = 4 27.26 27.90 29.05 31.40 37.04 37.86 38.93 39.31 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
uvg266 Video Input: Bosphorus 4K - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 12 24 36 48 60 SE +/- 0.08, N = 3 SE +/- 0.12, N = 4 SE +/- 0.02, N = 4 SE +/- 0.39, N = 4 SE +/- 0.38, N = 9 SE +/- 0.01, N = 4 SE +/- 0.16, N = 5 SE +/- 0.50, N = 5 35.10 39.56 40.82 44.75 46.25 49.42 53.66 54.88
LULESH OpenBenchmarking.org z/s, More Is Better LULESH 2.0.3 Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 15K 30K 45K 60K 75K SE +/- 182.38, N = 15 SE +/- 211.12, N = 6 SE +/- 217.67, N = 6 SE +/- 437.51, N = 4 SE +/- 272.44, N = 4 SE +/- 206.20, N = 5 SE +/- 207.54, N = 5 SE +/- 359.29, N = 3 23072.30 23848.54 25831.84 38433.97 43724.06 52102.67 53269.47 70826.73 1. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi
oneDNN Harness: IP Shapes 1D - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: IP Shapes 1D - Engine: CPU Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8592+ 0.1762 0.3524 0.5286 0.7048 0.881 SE +/- 0.004208, N = 4 SE +/- 0.003500, N = 4 SE +/- 0.001869, N = 4 SE +/- 0.004822, N = 4 SE +/- 0.000666, N = 4 SE +/- 0.004443, N = 4 SE +/- 0.000915, N = 4 SE +/- 0.000767, N = 4 0.783180 0.759434 0.725974 0.662387 0.617190 0.580664 0.539467 0.398446 MIN: 0.69 MIN: 0.67 MIN: 0.67 MIN: 0.58 MIN: 0.55 MIN: 0.51 MIN: 0.5 MIN: 0.37 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
TensorFlow Device: CPU - Batch Size: 64 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: AlexNet Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P 200 400 600 800 1000 SE +/- 6.22, N = 5 SE +/- 1.95, N = 5 SE +/- 2.31, N = 5 SE +/- 2.22, N = 5 SE +/- 6.39, N = 13 SE +/- 7.35, N = 5 SE +/- 0.51, N = 5 SE +/- 7.98, N = 5 819.89 841.68 852.36 858.84 932.59 940.40 969.62 996.47
NAS Parallel Benchmarks Test / Class: SP.C OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: SP.C Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 50K 100K 150K 200K 250K SE +/- 67.02, N = 3 SE +/- 9.58, N = 3 SE +/- 150.79, N = 3 SE +/- 31.76, N = 4 SE +/- 679.14, N = 4 SE +/- 420.81, N = 4 SE +/- 560.20, N = 4 SE +/- 1528.09, N = 5 58815.36 69776.41 71245.26 109416.42 135939.25 141954.15 147311.14 228184.68 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
Pennant Test: sedovbig OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: sedovbig Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 5 10 15 20 25 SE +/- 0.001847, N = 3 SE +/- 0.013353, N = 3 SE +/- 0.002400, N = 3 SE +/- 0.002987, N = 3 SE +/- 0.003237, N = 4 SE +/- 0.003253, N = 4 SE +/- 0.016400, N = 4 SE +/- 0.018471, N = 4 21.021120 19.882460 16.969100 16.030800 13.211250 12.106900 11.284380 9.964526 1. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
Kvazaar Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 20 40 60 80 100 SE +/- 0.17, N = 4 SE +/- 0.55, N = 5 SE +/- 0.56, N = 5 SE +/- 0.13, N = 5 SE +/- 0.32, N = 5 SE +/- 0.54, N = 6 SE +/- 0.39, N = 6 SE +/- 0.75, N = 15 47.07 54.98 58.14 63.10 63.99 72.01 73.81 74.57 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
uvg266 Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Platinum 8490H 12 24 36 48 60 SE +/- 0.07, N = 3 SE +/- 0.15, N = 4 SE +/- 0.41, N = 7 SE +/- 0.43, N = 4 SE +/- 0.15, N = 4 SE +/- 0.21, N = 5 SE +/- 0.16, N = 5 SE +/- 0.05, N = 5 35.56 44.05 44.40 45.09 45.32 54.95 55.40 55.54
DaCapo Benchmark Java Test: Jython OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Jython Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 800 1600 2400 3200 4000 SE +/- 28.30, N = 4 SE +/- 24.34, N = 4 SE +/- 24.09, N = 4 SE +/- 7.09, N = 4 SE +/- 20.55, N = 4 SE +/- 38.86, N = 5 SE +/- 9.71, N = 4 SE +/- 21.99, N = 4 3926 3921 3892 3801 3785 3707 3466 3424
JPEG-XL libjxl Input: PNG - Quality: 100 OpenBenchmarking.org MP/s, More Is Better JPEG-XL libjxl 0.10.1 Input: PNG - Quality: 100 Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 7 14 21 28 35 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.08, N = 4 SE +/- 0.07, N = 4 26.25 26.84 26.99 27.09 27.66 28.10 30.97 31.35 1. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm
Timed Mesa Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Mesa Compilation 24.0 Time To Compile Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 5 10 15 20 25 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 4 20.18 19.65 19.23 18.47 18.29 18.14 17.26 16.18
PyBench Total For Average Test Times OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2018-02-16 Total For Average Test Times Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 170 340 510 680 850 SE +/- 1.15, N = 3 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 SE +/- 0.67, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 0.48, N = 4 SE +/- 0.41, N = 4 767 765 763 763 763 762 692 691
DaCapo Benchmark Java Test: Apache Kafka OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Apache Kafka Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P 1200 2400 3600 4800 6000 SE +/- 10.11, N = 3 SE +/- 31.50, N = 3 SE +/- 1.76, N = 3 SE +/- 6.44, N = 3 SE +/- 1.20, N = 3 SE +/- 3.51, N = 3 SE +/- 2.03, N = 3 SE +/- 4.06, N = 3 5611 5560 5113 5108 5106 5102 5101 5088
WebP Image Encode Encode Settings: Quality 100, Lossless OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Lossless Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 0.3375 0.675 1.0125 1.35 1.6875 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 4 SE +/- 0.00, N = 4 1.30 1.31 1.39 1.39 1.39 1.40 1.50 1.50 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
Timed ImageMagick Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed ImageMagick Compilation 6.9.0 Time To Compile Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 4 8 12 16 20 SE +/- 0.15, N = 4 SE +/- 0.06, N = 4 SE +/- 0.10, N = 4 SE +/- 0.11, N = 4 SE +/- 0.07, N = 4 SE +/- 0.13, N = 4 SE +/- 0.10, N = 4 SE +/- 0.03, N = 4 16.08 15.38 14.72 14.40 14.09 13.26 12.60 11.49
JPEG-XL libjxl Input: JPEG - Quality: 100 OpenBenchmarking.org MP/s, More Is Better JPEG-XL libjxl 0.10.1 Input: JPEG - Quality: 100 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 7 14 21 28 35 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 4 SE +/- 0.04, N = 4 26.86 27.26 27.33 27.75 28.16 28.75 31.61 32.24 1. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm
ASTC Encoder Preset: Thorough OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Thorough Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 20 40 60 80 100 SE +/- 0.01, N = 3 SE +/- 0.03, N = 4 SE +/- 0.01, N = 4 SE +/- 0.05, N = 4 SE +/- 0.05, N = 4 SE +/- 0.03, N = 5 SE +/- 0.19, N = 5 SE +/- 0.55, N = 5 37.01 42.98 51.30 54.45 72.33 83.34 86.98 97.94 1. (CXX) g++ options: -O3 -flto -pthread
NAS Parallel Benchmarks Test / Class: LU.C OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: LU.C Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 100K 200K 300K 400K 500K SE +/- 71.37, N = 3 SE +/- 37.04, N = 4 SE +/- 130.20, N = 4 SE +/- 213.44, N = 5 SE +/- 441.66, N = 5 SE +/- 411.20, N = 5 SE +/- 398.40, N = 5 SE +/- 726.00, N = 5 126171.52 131606.86 135125.15 232012.77 246822.52 257384.55 261127.09 455312.09 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
m-queens Time To Solve OpenBenchmarking.org Seconds, Fewer Is Better m-queens 1.2 Time To Solve Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 5 10 15 20 25 SE +/- 0.031, N = 3 SE +/- 0.035, N = 3 SE +/- 0.025, N = 4 SE +/- 0.030, N = 4 SE +/- 0.021, N = 5 SE +/- 0.028, N = 5 SE +/- 0.021, N = 6 SE +/- 0.028, N = 6 21.030 18.102 15.211 14.257 10.840 9.285 7.881 7.402 1. (CXX) g++ options: -fopenmp -O2 -march=native
srsRAN Project Test: PUSCH Processor Benchmark, Throughput Thread OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PUSCH Processor Benchmark, Throughput Thread Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 30 60 90 120 150 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 129.5 129.5 129.7 129.7 129.7 129.7 129.7 129.7 MIN: 105.7 MIN: 105.7 MIN: 105.9 MIN: 105.9 MIN: 105.9 MIN: 105.9 MIN: 105.9 MIN: 105.9 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl
Y-Cruncher Pi Digits To Calculate: 500M OpenBenchmarking.org Seconds, Fewer Is Better Y-Cruncher 0.8.3 Pi Digits To Calculate: 500M Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 0.8507 1.7014 2.5521 3.4028 4.2535 SE +/- 0.010, N = 7 SE +/- 0.023, N = 15 SE +/- 0.008, N = 7 SE +/- 0.003, N = 7 SE +/- 0.064, N = 15 SE +/- 0.074, N = 15 SE +/- 0.004, N = 7 SE +/- 0.002, N = 8 3.781 3.704 3.391 3.267 3.110 2.961 2.659 2.364
NAS Parallel Benchmarks Test / Class: CG.C OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: CG.C Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 20K 40K 60K 80K 100K SE +/- 243.41, N = 12 SE +/- 313.88, N = 7 SE +/- 260.16, N = 15 SE +/- 178.23, N = 8 SE +/- 328.18, N = 8 SE +/- 545.92, N = 15 SE +/- 560.41, N = 15 SE +/- 271.54, N = 6 33811.63 35116.55 35234.06 58128.24 63760.45 65396.22 66492.44 98764.93 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
Kvazaar Video Input: Bosphorus 4K - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Very Fast Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 15 30 45 60 75 SE +/- 0.04, N = 4 SE +/- 0.06, N = 4 SE +/- 0.08, N = 4 SE +/- 0.08, N = 4 SE +/- 0.33, N = 4 SE +/- 0.29, N = 4 SE +/- 0.36, N = 5 SE +/- 0.45, N = 5 38.02 40.23 41.34 50.03 51.91 52.23 65.38 67.64 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 40 80 120 160 200 SE +/- 0.04, N = 5 SE +/- 0.11, N = 5 SE +/- 0.05, N = 5 SE +/- 0.13, N = 6 SE +/- 0.63, N = 6 SE +/- 1.20, N = 15 SE +/- 0.13, N = 7 SE +/- 0.26, N = 8 75.47 83.49 91.99 112.66 125.75 129.75 152.75 199.61 MIN: 72.93 / MAX: 78.77 MIN: 80.58 / MAX: 88.97 MIN: 88.57 / MAX: 98.54 MIN: 107.88 / MAX: 117.19 MIN: 120.06 / MAX: 135.13 MIN: 110.67 / MAX: 151.91 MIN: 143.8 / MAX: 168.98 MIN: 185.98 / MAX: 216.64
GNU Octave Benchmark OpenBenchmarking.org Seconds, Fewer Is Better GNU Octave Benchmark 8.4.0 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 3 6 9 12 15 SE +/- 0.096, N = 5 SE +/- 0.082, N = 5 SE +/- 0.019, N = 6 SE +/- 0.024, N = 6 SE +/- 0.015, N = 6 SE +/- 0.015, N = 6 SE +/- 0.019, N = 6 SE +/- 0.020, N = 6 12.617 12.578 8.036 7.748 7.622 7.532 6.856 6.458
Intel Open Image Denoise Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 1.1318 2.2636 3.3954 4.5272 5.659 SE +/- 0.00, N = 4 SE +/- 0.00, N = 4 SE +/- 0.00, N = 4 SE +/- 0.00, N = 5 SE +/- 0.01, N = 5 SE +/- 0.04, N = 5 SE +/- 0.03, N = 6 SE +/- 0.03, N = 6 2.26 2.38 2.71 3.31 3.51 3.65 4.41 5.03
Pennant Test: leblancbig OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: leblancbig Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 1.3345 2.669 4.0035 5.338 6.6725 SE +/- 0.025580, N = 6 SE +/- 0.023904, N = 7 SE +/- 0.022393, N = 7 SE +/- 0.022698, N = 7 SE +/- 0.010204, N = 7 SE +/- 0.019069, N = 15 SE +/- 0.008354, N = 7 SE +/- 0.013568, N = 6 5.930957 5.114161 4.955865 4.182707 2.881099 2.529807 2.527363 2.159459 1. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
Intel Open Image Denoise Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 1.1453 2.2906 3.4359 4.5812 5.7265 SE +/- 0.00, N = 4 SE +/- 0.00, N = 4 SE +/- 0.00, N = 4 SE +/- 0.00, N = 5 SE +/- 0.02, N = 5 SE +/- 0.02, N = 5 SE +/- 0.01, N = 6 SE +/- 0.03, N = 6 2.27 2.39 2.71 3.32 3.49 3.66 4.48 5.09
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Crown Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 30 60 90 120 150 SE +/- 0.05, N = 4 SE +/- 0.02, N = 4 SE +/- 0.07, N = 5 SE +/- 0.05, N = 5 SE +/- 0.14, N = 6 SE +/- 0.48, N = 6 SE +/- 0.12, N = 6 SE +/- 0.07, N = 7 58.42 65.33 70.05 82.97 107.63 116.61 124.71 153.16 MIN: 55.81 / MAX: 61.43 MIN: 60.89 / MAX: 69.91 MIN: 63.26 / MAX: 79.13 MIN: 79.09 / MAX: 87.11 MIN: 102.22 / MAX: 114.8 MIN: 107.47 / MAX: 129.72 MIN: 115.3 / MAX: 143.82 MIN: 143.78 / MAX: 166.08
WebP Image Encode Encode Settings: Quality 100, Highest Compression OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Highest Compression Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 0.7808 1.5616 2.3424 3.1232 3.904 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 3.07 3.08 3.09 3.09 3.10 3.10 3.46 3.47 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
oneDNN Harness: IP Shapes 3D - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: IP Shapes 3D - Engine: CPU Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 0.973 1.946 2.919 3.892 4.865 SE +/- 0.003490, N = 5 SE +/- 0.004988, N = 5 SE +/- 0.010419, N = 5 SE +/- 0.005278, N = 5 SE +/- 0.001432, N = 5 SE +/- 0.003025, N = 5 SE +/- 0.004380, N = 5 SE +/- 0.005935, N = 5 4.324650 4.283990 4.274810 4.175530 0.841608 0.771506 0.738442 0.714699 MIN: 4.21 MIN: 4.18 MIN: 4.18 MIN: 4.06 MIN: 0.81 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Google Draco Model: Church Facade OpenBenchmarking.org ms, Fewer Is Better Google Draco 1.5.6 Model: Church Facade Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 1500 3000 4500 6000 7500 SE +/- 7.99, N = 6 SE +/- 22.13, N = 6 SE +/- 7.18, N = 6 SE +/- 9.53, N = 6 SE +/- 18.12, N = 6 SE +/- 14.74, N = 6 SE +/- 20.74, N = 7 SE +/- 30.70, N = 7 6821 6777 6707 6693 5672 5670 4693 4565 1. (CXX) g++ options: -O3
oneDNN Harness: Convolution Batch Shapes Auto - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Convolution Batch Shapes Auto - Engine: CPU Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 3 6 9 12 15 SE +/- 0.005800, N = 7 SE +/- 0.017741, N = 7 SE +/- 0.039215, N = 7 SE +/- 0.015670, N = 7 SE +/- 0.001388, N = 7 SE +/- 0.002339, N = 7 SE +/- 0.001522, N = 7 SE +/- 0.001169, N = 7 9.194340 8.751050 7.754310 7.060430 0.650618 0.585804 0.438154 0.306795 MIN: 6.88 MIN: 7.59 MIN: 6.74 MIN: 6.83 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
ACES DGEMM Sustained Floating-Point Rate OpenBenchmarking.org GFLOP/s, More Is Better ACES DGEMM 1.0 Sustained Floating-Point Rate Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 13 26 39 52 65 SE +/- 0.04, N = 4 SE +/- 0.09, N = 5 SE +/- 0.09, N = 5 SE +/- 0.08, N = 6 SE +/- 0.06, N = 7 SE +/- 0.04, N = 7 SE +/- 0.28, N = 7 SE +/- 0.11, N = 8 19.77 22.54 23.54 29.14 39.35 44.67 45.97 58.25 1. (CC) gcc options: -O3 -march=native -fopenmp
ASTC Encoder Preset: Medium OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Medium Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 120 240 360 480 600 SE +/- 0.03, N = 6 SE +/- 0.08, N = 6 SE +/- 1.17, N = 6 SE +/- 0.16, N = 6 SE +/- 0.52, N = 6 SE +/- 0.77, N = 6 SE +/- 2.79, N = 6 SE +/- 1.56, N = 7 247.30 284.33 327.78 333.99 441.65 483.10 484.55 550.02 1. (CXX) g++ options: -O3 -flto -pthread
libavif avifenc Encoder Speed: 6, Lossless OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 6, Lossless Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 2 4 6 8 10 SE +/- 0.027, N = 6 SE +/- 0.035, N = 6 SE +/- 0.045, N = 6 SE +/- 0.033, N = 6 SE +/- 0.013, N = 7 SE +/- 0.022, N = 7 SE +/- 0.025, N = 7 SE +/- 0.031, N = 7 7.121 7.038 6.836 6.605 6.278 6.172 5.784 5.613 1. (CXX) g++ options: -O3 -fPIC -lm
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 12 - Input: Bosphorus 4K Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 40 80 120 160 200 SE +/- 0.83, N = 5 SE +/- 0.97, N = 6 SE +/- 0.61, N = 7 SE +/- 0.40, N = 7 SE +/- 0.25, N = 7 SE +/- 0.41, N = 7 SE +/- 0.42, N = 7 SE +/- 0.20, N = 7 122.09 127.55 146.10 151.72 156.52 164.25 165.50 177.86 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Google Draco Model: Lion OpenBenchmarking.org ms, Fewer Is Better Google Draco 1.5.6 Model: Lion Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 1100 2200 3300 4400 5500 SE +/- 18.24, N = 6 SE +/- 25.38, N = 6 SE +/- 21.44, N = 6 SE +/- 15.47, N = 6 SE +/- 25.25, N = 7 SE +/- 23.47, N = 7 SE +/- 21.09, N = 7 SE +/- 22.92, N = 8 5342 5322 5217 5188 4733 4731 3894 3861 1. (CXX) g++ options: -O3
LAMMPS Molecular Dynamics Simulator Model: Rhodopsin Protein OpenBenchmarking.org ns/day, More Is Better LAMMPS Molecular Dynamics Simulator 23Jun2022 Model: Rhodopsin Protein Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 12 24 36 48 60 SE +/- 0.05, N = 11 SE +/- 0.36, N = 15 SE +/- 0.04, N = 11 SE +/- 0.29, N = 15 SE +/- 0.33, N = 8 SE +/- 0.11, N = 9 SE +/- 0.09, N = 8 SE +/- 0.97, N = 15 27.63 28.72 30.84 34.30 42.28 47.51 52.24 55.50 1. (CXX) g++ options: -O3 -lm -ldl
libavif avifenc Encoder Speed: 10, Lossless OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 10, Lossless Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 1.1963 2.3926 3.5889 4.7852 5.9815 SE +/- 0.019, N = 7 SE +/- 0.028, N = 7 SE +/- 0.014, N = 7 SE +/- 0.006, N = 7 SE +/- 0.005, N = 7 SE +/- 0.015, N = 7 SE +/- 0.015, N = 8 SE +/- 0.008, N = 8 5.317 5.311 5.074 4.923 4.916 4.867 4.579 4.456 1. (CXX) g++ options: -O3 -fPIC -lm
srsRAN Project Test: PDSCH Processor Benchmark, Throughput Thread OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Thread Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 160 320 480 640 800 SE +/- 3.86, N = 8 SE +/- 5.02, N = 8 SE +/- 2.57, N = 8 SE +/- 1.17, N = 8 SE +/- 1.64, N = 8 SE +/- 1.27, N = 8 SE +/- 1.34, N = 8 SE +/- 1.89, N = 8 651.9 663.8 675.5 680.2 702.6 705.5 742.9 755.5 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl
Primesieve Length: 1e12 OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e12 Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 2 4 6 8 10 SE +/- 0.006, N = 7 SE +/- 0.010, N = 7 SE +/- 0.019, N = 8 SE +/- 0.007, N = 8 SE +/- 0.004, N = 9 SE +/- 0.005, N = 10 SE +/- 0.006, N = 10 SE +/- 0.008, N = 11 6.160 5.332 4.576 4.250 3.121 2.691 2.325 2.187 1. (CXX) g++ options: -O3
libavif avifenc Encoder Speed: 6 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 6 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 0.8496 1.6992 2.5488 3.3984 4.248 SE +/- 0.029, N = 8 SE +/- 0.022, N = 9 SE +/- 0.017, N = 9 SE +/- 0.011, N = 9 SE +/- 0.022, N = 9 SE +/- 0.008, N = 9 SE +/- 0.016, N = 9 SE +/- 0.009, N = 10 3.776 3.738 3.730 3.550 3.169 3.044 2.971 2.805 1. (CXX) g++ options: -O3 -fPIC -lm
NAS Parallel Benchmarks Test / Class: MG.C OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: MG.C Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P 50K 100K 150K 200K 250K SE +/- 152.92, N = 9 SE +/- 436.97, N = 10 SE +/- 382.59, N = 10 SE +/- 406.29, N = 9 SE +/- 1262.04, N = 9 SE +/- 1298.67, N = 9 SE +/- 1415.96, N = 9 SE +/- 1422.07, N = 7 83448.70 85910.95 86407.46 107321.89 163333.21 171436.47 172614.10 220893.78 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
Parallel BZIP2 Compression FreeBSD-13.0-RELEASE-amd64-memstick.img Compression OpenBenchmarking.org Seconds, Fewer Is Better Parallel BZIP2 Compression 1.1.13 FreeBSD-13.0-RELEASE-amd64-memstick.img Compression Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 0.5922 1.1844 1.7766 2.3688 2.961 SE +/- 0.023295, N = 15 SE +/- 0.020941, N = 15 SE +/- 0.007749, N = 10 SE +/- 0.030907, N = 15 SE +/- 0.023842, N = 15 SE +/- 0.028863, N = 15 SE +/- 0.017240, N = 15 SE +/- 0.024402, N = 15 2.632077 2.287766 2.144857 1.982932 1.847537 1.711296 1.469210 1.432362 1. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread
oneDNN Harness: Deconvolution Batch shapes_3d - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Deconvolution Batch shapes_3d - Engine: CPU Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 0.2844 0.5688 0.8532 1.1376 1.422 SE +/- 0.000508, N = 9 SE +/- 0.000927, N = 9 SE +/- 0.000805, N = 9 SE +/- 0.000806, N = 9 SE +/- 0.000392, N = 9 SE +/- 0.001240, N = 9 SE +/- 0.001274, N = 9 SE +/- 0.000902, N = 9 1.264070 1.196430 1.077430 0.945075 0.907161 0.864358 0.736170 0.624250 MIN: 1.21 MIN: 1.16 MIN: 1.06 MIN: 0.9 MIN: 0.87 MIN: 0.81 MIN: 0.66 MIN: 0.58 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
WebP Image Encode Encode Settings: Quality 100 OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 3 6 9 12 15 SE +/- 0.00, N = 10 SE +/- 0.00, N = 10 SE +/- 0.01, N = 10 SE +/- 0.01, N = 10 SE +/- 0.00, N = 10 SE +/- 0.00, N = 10 SE +/- 0.01, N = 10 SE +/- 0.00, N = 10 10.01 10.03 10.05 10.11 10.13 10.13 11.31 11.36 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
Timed CPython Compilation Build Configuration: Default OpenBenchmarking.org Seconds, Fewer Is Better Timed CPython Compilation 3.10.6 Build Configuration: Default Xeon Platinum 8490H Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 5 10 15 20 25 19.20 19.12 18.93 18.85 18.82 18.81 17.08 16.93
Phoronix Test Suite v10.8.5